System
An interactive system addresses caregiver challenges by collecting user information, proposing care services, guiding procedures, and sharing status updates to streamline access and reduce mental burden.
Patent Information
- Application Number
- JP2024128382
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2026-02-16
AI Technical Summary
Caregivers face difficulties in quickly obtaining appropriate nursing care information and support, navigating complex government subsidies, and managing mental burden due to discrepancies in care manager knowledge and support quality, leading to missed opportunities for necessary services.
A system that interactively collects user information, proposes nursing care services and subsidies, provides procedural guidance, shares information with care managers, and periodically checks the user's care status to offer continuous support and mental health care.
Facilitates easy access to nursing care services and subsidies, reduces mental burden on caregivers by providing continuous support and guidance through interactive information sharing and regular status checks.
Smart Images

Figure 2026025573000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] When the need for care suddenly arises, it is difficult for caregivers to quickly obtain appropriate information and support. The nursing care services and subsidies provided by the government are difficult to understand, and because they require an application to use them, many people are unaware of their existence and miss out on opportunities to use them. There is also a discrepancy in the quality of care managers' knowledge and support, making it difficult for caregivers to easily obtain the information they need. Furthermore, the mental burden associated with caregiving is significant, leading to an increasing demand for mental care. Therefore, there is a need for a system that supports caregivers in smoothly accessing appropriate nursing care services and subsidies, and reduces the mental burden on caregivers. [Means for solving the problem]
[0005] The present invention solves the above-mentioned problems with a system that includes a means for interactively inputting a user's basic information, a means for proposing available nursing care services and subsidies based on the basic information, a means for providing detailed instructions on the procedures for the proposed nursing care services or subsidies, a means for sharing information necessary for using the nursing care services with a care manager, and a means for periodically checking the user's nursing care status and proposing new necessary nursing care services and subsidies. Specifically, the system interactively collects the user's basic information, such as nursing care grade and income, and based on that, proposes a list of appropriate nursing care services and subsidies. The system then provides detailed instructions on the procedures required for the services and subsidies selected by the user, and shares the information with the care manager as needed. Furthermore, the system periodically checks the user's nursing care status and provides appropriate advice and mental health care, ensuring that caregivers receive continuous support.
[0006] "Basic information" refers to the user's personal information necessary for proposing nursing care services and subsidies, including nursing care grade and income information.
[0007] "Care grade" indicates the level of care certification a user has received, and is the standard used to determine the conditions for using care services and subsidies.
[0008] "Income information" refers to information about the user's annual income, and is used as a basis for applying for subsidies and assessing the cost burden of nursing care services.
[0009] "Care services" refers to care-related support and programs available to users, including day care services and home care services.
[0010] "Subsidies" are public financial support that users can receive, including nursing care insurance benefits.
[0011] "Procedures" refers to the specific operations and document submission methods required for a user to use the nursing care services and subsidies they have selected.
[0012] A "care manager" is a professional who is responsible for planning and coordinating care, and who acts as a link between users and service providers.
[0013] "Regularly" refers to being carried out repeatedly at regular intervals, which is important for continuously understanding the user's care status.
[0014] "Mental care" includes advice and counselling to support the mental health of caregivers.
[0015] "Interactive" refers to an interface method in which the user and the system interact with each other, enabling intuitive operation. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] This invention relates to an interactive application system that facilitates access to nursing care services and subsidies. This system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, it shares information with a care manager as needed, periodically checks the user's care status, and provides additional suggestions and mental care as needed.
[0038] System configuration
[0039] This system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to input basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[0040] Program processing flow
[0041] The program of this system mainly performs the following five functions.
[0042] 1. Enter user information
[0043] User: Launches the app and taps the "Start" button.
[0044] Terminal: Displays interactive question prompts including care grade and income information.
[0045] User: Enter answers to the questions, such as "Level 3 nursing care required" or "3 million yen," and submit.
[0046] Terminal: Sends the entered information to the server.
[0047] 2. Information on services and grants
[0048] Server: Analyzes the collected user information and suggests appropriate nursing care services and subsidies from the database.
[0049] Server: Generates lists such as "day care services," "home care," and "long-term care insurance benefits," and sends them to the terminal.
[0050] On the device: Show the user a list of suggestions.
[0051] 3. Select the service you want to use
[0052] User: Select the service they want to use from the list of suggestions.
[0053] Terminal: Requests specific procedural instructions for the selected service from the server.
[0054] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[0055] Terminal: Displays procedural instructions to the user.
[0056] 4. Sharing information with care managers
[0057] User: Select information sharing and instruct the transmission of the required information.
[0058] Terminal: Sends a transmission instruction to the server.
[0059] Server: Generates the necessary information for the care manager and sends notifications.
[0060] Care manager: Checks the received information and takes necessary action.
[0061] 5. Regular status checks and advice
[0062] Server: Generates periodic reminders and sends status check notifications to users.
[0063] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[0064] User: Enter answers about care situation and submit.
[0065] Terminal: Sends the answer to the server.
[0066] Server: Generates proposals for additional services and grants based on new information, and generates advice and mental health information.
[0067] Device: Show new suggestions and advice to the user.
[0068] Specific examples
[0069] For example, when a user starts the app and enters their care level of "Care Level 3" and annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" and confirms the specific procedures (required documents, application method, etc.). They then issue instructions to share the information with a care manager, and the server sends a notification to the care manager. Then, if the user periodically enters and sends the situation, such as "I've been working more at night recently," the server generates additional suggestions such as "nighttime home care," and provides necessary advice and mental care information.
[0070] In this way, the present invention provides a system that can support caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[0071] The processing flow will be explained below.
[0072] Step 1:
[0073] Enter user information
[0074] User: Launches the app and taps the "Start" button.
[0075] Terminal: Presents the user with an interactive interface and prompts them, "What is your care level?"
[0076] User: Enter "Care Level 3" and submit.
[0077] Terminal: Prompt "What is your annual income?"
[0078] User: Enters "3 million yen" and submits.
[0079] Terminal: Temporarily stores the entered information and sends it to the server.
[0080] Step 2:
[0081] Processing and analyzing user information
[0082] Server: Analyzes the received user's care level and income data.
[0083] Server: Searches for applicable nursing care services and subsidies using its own database.
[0084] Step 3:
[0085] Service and Grant Proposals
[0086] Server: Based on the search results, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated.
[0087] Server: Sends the generated proposal list to the device.
[0088] Terminal: Display the list to the user.
[0089] Step 4:
[0090] Select the service you want to use
[0091] User: Select "Day Care" from the list of proposed care services and grants.
[0092] Terminal: Requests information about the selected service from the server.
[0093] Step 5:
[0094] Procedural instructions
[0095] Server: Generates specific procedural instructions, such as the necessary documents and application methods for the selected "day service."
[0096] Server: Sends the generated procedure information to the terminal.
[0097] Terminal: Display procedural instructions to the user.
[0098] Step 6:
[0099] Sharing information with care managers
[0100] User: Selects information sharing and instructs transmission.
[0101] Terminal: Sends a transmission instruction to the server.
[0102] Server: Generates the necessary information for the care manager and sends notifications.
[0103] Care manager: Checks the received information and takes necessary action.
[0104] Step 7:
[0105] Regular status checks
[0106] Server: Generates reminder notifications periodically and sends them to the device.
[0107] Device: Prompt the user with "How is your caregiving situation going these days?"
[0108] Step 8:
[0109] Additional answers and suggestions
[0110] User: Regarding the care situation, enter "Recently, there has been an increase in nighttime care" and submit.
[0111] Terminal: Sends the transmitted information to the server.
[0112] Server: Searches for additional care services and grants based on new information received.
[0113] Server: Sends the generated new proposal to the device.
[0114] On-device: Displays new suggestions to users and provides necessary advice and mental health information.
[0115] Example 1
[0116] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0117] The present invention aims to solve the problem that many users are unable to receive appropriate support due to the complicated procedures involved in using nursing care services and subsidies. In particular, there is a need to reduce the burden on users and enable them to receive appropriate support by consistently providing information on available services and subsidies, guidance on specific procedures, and regular status checks and advice.
[0118] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0119] In this invention, the server includes: means for interactively inputting basic information about a user; means for proposing available nursing care services and subsidies based on the basic information; means for providing detailed instructions for obtaining the proposed nursing care services or subsidies; means for sharing information necessary for using the nursing care services with an administrator; means for periodically checking the user's nursing care status and proposing newly required nursing care services or subsidies; means for transmitting the basic information to the server; means for the server to generate a proposal list of appropriate nursing care services and subsidies from the collected information and transmit it to a user terminal; means for the user to select a service from the proposal list and transmit the selected information to the server; means for the server to generate a procedure for the selected service and transmit it to the user terminal and display it; and means for generating additional proposals and advice based on the information collected through the periodic checks and displaying it to the user. This allows users to easily apply for nursing care services and subsidies, and to receive appropriate support while receiving necessary advice and regular status checks.
[0120] "Basic user information" refers to information about the individual user, including information such as care level and income.
[0121] "Dialogue" refers to the way in which a user interacts with a system, proceeding in a question-and-answer format.
[0122] "Care services" refer to various support services provided to people who need care, including day care services and home care services.
[0123] "Subsidies" are financial support provided when using nursing care services, and include nursing care insurance benefits.
[0124] The "Proposal List" is a list of nursing care services and subsidy options that can be provided based on the user's basic information.
[0125] "Procedures" refer to the specific procedures required to use the proposed nursing care services and subsidies, including the preparation of documents and application methods.
[0126] "Sharing information with the administrator" means notifying the administrator of the information necessary for the user to use nursing care services and sharing the information.
[0127] "Regular status checks" means checking the user's care status at regular intervals and providing additional service suggestions and advice.
[0128] The "server" is a remote computer system that analyzes the information sent by the user and generates a list of appropriate nursing care services and subsidy proposals.
[0129] A "user terminal" is an information and communication device used by a user, such as a computer, tablet, or smartphone.
[0130] This invention is an interactive application system that facilitates access to nursing care services and subsidies. The system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, the system shares information with an administrator as needed, periodically checks the user's nursing care status, and provides additional suggestions and mental health care as needed.
[0131] System configuration
[0132] This system mainly consists of a user terminal, a server, and an administrator terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. In addition, the necessary information is shared with the administrator terminal, making it easier for the administrator to respond.
[0133] Hardware and software used
[0134] Server: Generation of service proposals and procedural steps, database management. Specific software used for this purpose includes database management systems (MySQL, PostgreSQL), a dialog management system, and a periodic notification system.
[0135] User device: A device such as a smartphone or tablet on which application software (iOS, Android app) is installed.
[0136] Administrator device: A computer or tablet used by an administrator.
[0137] Program processing flow
[0138] The system is programmed in the following way: When a user launches the app and enters their care level of "care required 3" and their annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" from this list of suggestions and checks the specific procedures (required documents, application method, etc.). The user then issues an instruction to share the information with the administrator, and the server sends a notification to the administrator's device. The user periodically enters and submits the situation, such as "We've been seeing an increase in night-time appointments recently," and the server generates additional suggestions such as "night-time home care," and provides necessary advice and mental health care information.
[0139] Examples of prompt statements
[0140] Please use the information below to suggest appropriate care services and subsidies.
[0141] Nursing care level: Nursing care level 3
[0142] Annual income: 3 million yen
[0143] Also, please provide specific procedural steps and information on required documents.
[0144] As described above, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[0145] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0146] Step 1: Launch and start the app
[0147] User: Tap the app on the smartphone home screen to launch it. Tap the "Start" button to begin using the system.
[0148] Input: Launching the app and tapping the "Start" button.
[0149] Output: A screen displaying the interactive questions.
[0150] What it does: The app displays an interactive prompt on the user's screen saying, "Please enter your care level and income information."
[0151] Step 2: Display interactive questions
[0152] On the device: The app displays interactive question prompts on the user's screen, asking for information such as care level (e.g., "Care Level 3") and income information (e.g., "3 million yen").
[0153] Input: The question the app will ask.
[0154] Output: The question is displayed on the user's screen.
[0155] Specific Behavior: The system provides multiple choice or open-ended fields to facilitate user input.
[0156] Step 3: User answers and submits
[0157] User: Enter information such as "Level 3 nursing care required" or "3 million yen" in response to the questions, and tap the "Submit" button.
[0158] Input: User-entered care grade and income information.
[0159] Output: The input data is sent to the server.
[0160] Specific operation: The app sends the entered data to the server in real time.
[0161] Step 4: Send the input information to the server
[0162] Terminal: Sends the entered information to the server in real time.
[0163] Input: The information the user entered and tapped the submit button.
[0164] Output: Basic information of the user received by the server.
[0165] Specific operation: The server temporarily stores the received information and prepares it for analysis.
[0166] Step 5: Analyze user information
[0167] Server: Analyzes the entered user information and collates relevant information from the database.
[0168] Input: Basic information of the recipient.
[0169] Output: A list of optimal care services and subsidy proposals.
[0170] Specific operation: The server searches and collates relevant nursing care services and subsidy data in the database based on nursing care grade and income information.
[0171] Step 6: Generate a list of suggestions
[0172] Server: Based on the analysis results, it generates a list of proposals for appropriate nursing care services and subsidies, such as "day care," "home care," and "long-term care insurance benefits."
[0173] Input: Relevant information retrieved from the database.
[0174] Output: A list of suggestions.
[0175] What happens: The server compiles a list of eligible services and grants and converts it into a displayable data format.
[0176] Step 7: Send the list to the user's device
[0177] Server: Sends the proposal list to the user device.
[0178] Input: Suggestion list.
[0179] Output: The suggestion list displayed on the user's device.
[0180] Specific operation: The server uses a communication protocol to send the generated proposal list to the user's device.
[0181] Step 8: View the list
[0182] On the device: The received list of suggestions is displayed in a user-friendly format.
[0183] Input: The proposal list sent by the server.
[0184] Output: The suggestion list displayed on the user screen.
[0185] What it does: The app displays a list of suggestions in a user interface designed to make it easy for the user to select.
[0186] Step 9: Select the proposed service
[0187] User: Select the service they want to use from the list of suggestions.
[0188] Input: The service selected by the user.
[0189] Output: The information about the selected service is sent to the server.
[0190] Specific behavior: The user taps one service from the list and the selection is sent to the server.
[0191] Step 10: Request Procedural Instructions
[0192] Terminal: Requests specific procedural instructions for the selected service from the server.
[0193] Input: Selected service information.
[0194] Output: Request data sent to server.
[0195] What happens: The app sends a request to the server for procedural instructions for the selected service.
[0196] Step 11: Generate procedural steps
[0197] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[0198] Input: The requested service information.
[0199] Output: Detailed information about the procedure steps.
[0200] Specific operations: The server generates the necessary documents and procedures for the selected service and prepares the data to be sent to the user's terminal.
[0201] Step 12: View procedural steps
[0202] Terminal: Displays the necessary information to the user for the procedure.
[0203] Input: Procedural step information sent from the server.
[0204] Output: The procedural steps that are displayed to the user.
[0205] Specific Actions: The app displays the received procedural information in the user interface, helping the user understand the specific next steps.
[0206] Step 13: Information Sharing Options
[0207] User: Makes information sharing choices and directs the transmission of desired information.
[0208] Input: Information sharing selection operation.
[0209] Output: The shared information is sent to the server.
[0210] Specific operation: The user taps the "Share Information" button, sending an instruction to share information to the server.
[0211] Step 14: Sending instructions to the server
[0212] Device: Sends instructions to share information to the server.
[0213] Input: Information sharing selection data.
[0214] Output: Information sharing instructions sent to the server.
[0215] Specific operation: The app prepares the information sharing instruction data and sends it to the server.
[0216] Step 15: Notify administrators
[0217] Server: Generates the information required by the administrator and sends notifications to the administrator's terminal.
[0218] Input: Information sharing instruction data.
[0219] Output: Administrator notification data.
[0220] Specific operation: The server generates notification data and sends it to the administrator terminal.
[0221] Step 16: Check the required information and take action
[0222] Administrator: Review the received information and take appropriate action.
[0223] Input: Administrator notification data sent from the server.
[0224] Output: Administrator response results.
[0225] Specific actions: The administrator checks the notification received in the system and responds to the user based on the required information.
[0226] Step 17: Generate recurring reminders
[0227] Server: Generates periodic reminders and sends status check notifications to users.
[0228] Input: Recurring schedule data.
[0229] Output: Reminder notification to the user.
[0230] Specific operation: The server generates a reminder notification based on the schedule and sends it to the user's device.
[0231] Step 18: Status Check Notification
[0232] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[0233] Input: Reminder notification data sent from the server.
[0234] Output: A challenge question that is displayed to the user.
[0235] What it does: The app prompts the user with a status check question based on the reminder notification.
[0236] Step 19: Enter and submit your situational response
[0237] User: Enter answers about care situation and submit.
[0238] Input: The situational answer data entered by the user.
[0239] Output: The status response data sent to the server.
[0240] Specific behavior: The user enters an answer about the situation and taps the "Submit" button, which sends the data to the server.
[0241] Step 20: Generate and display additional suggestions and advice
[0242] Server: Generates proposals for additional care services and subsidies based on new information, and generates advice and mental health care information.
[0243] Input: User situation answer data.
[0244] Output: Additional suggestions and advice data.
[0245] Specific operation: The server analyzes the received situation data, generates new suggestions and advice, and sends them to the user's device.
[0246] Device: Show new suggestions and advice to the user.
[0247] Input: Additional suggestion and advice data sent by the server.
[0248] Output: Additional suggestions and advice displayed on the user screen.
[0249] What it does: The app displays additional service suggestions and advice in the user interface.
[0250] (Application example 1)
[0251] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0252] In recent years, while support for the elderly and those who require nursing care has become increasingly important, obtaining information on nursing care services and subsidies, procedures, and daily meal management have become complex issues. In particular, arranging daily meals requires appropriate nutritional management and accommodating dietary restrictions, which creates a significant burden. There is a need to solve these issues all at once.
[0253] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0254] In this invention, the server includes means for interactively inputting basic information about the user, means for proposing available nursing care services and subsidies based on the basic information, means for providing detailed instructions on procedures for the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with a care manager, means for periodically checking the user's nursing care status and proposing new necessary nursing care services or subsidies, means for proposing meals that correspond to the user's nutritional management and dietary restrictions, and means for ordering specific meals and sharing the order status with the care manager. This not only allows users to easily access nursing care services and subsidies, but also allows them to manage their meals, thereby improving the quality of their daily lives.
[0255] "Basic user information" refers to personal data such as the user's age, care level, income information, and information regarding nutritional management.
[0256] "Interactive input means" means a system in which a user inputs information via a smartphone or computer by following on-screen prompts.
[0257] "Care services" refer to services such as day care, home care, and night-time home care provided to the elderly and people who need care.
[0258] A "subsidy" is financial assistance provided to users who meet certain conditions.
[0259] "Means for providing detailed procedural guidance" refers to a system that displays how users prepare and apply for the documents necessary to use nursing care services and subsidies.
[0260] A "care manager" is a professional who provides and coordinates nursing care services.
[0261] The "means of periodically checking the user's care status" is a system that periodically asks the user questions about their care status and collects their responses.
[0262] The "means of proposing new necessary nursing care services and subsidies" is a system that proposes new nursing care services and subsidies based on the latest collected user information.
[0263] "Nutritional management and dietary restrictions" refers to management that restricts certain nutrients and food ingredients based on the user's health condition or doctor's instructions.
[0264] The "means for making meal suggestions" is a system that suggests appropriate meal menus that correspond to the user's nutritional management and dietary restrictions.
[0265] A "means for ordering a specific meal" is a mechanism by which a user selects from a suggested menu of meals and orders a meal.
[0266] "Means for sharing with care managers" refers to a system that sends and shares information entered by users and data regarding ordered meals with care managers.
[0267] The present invention relates to an interactive application system that allows elderly people and those in need of care to easily access care services and subsidies. This system allows users to suggest and order meals and share care information to improve the quality of their daily lives.
[0268] System Overview
[0269] The system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and check suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[0270] Program processing overview
[0271] The server is built using Flask, a lightweight Python web framework, and collects and processes user information as follows:
[0272] 1. Enter your basic information
[0273] First, the user launches the smartphone application and taps the "Start" button. The device then displays an interactive question prompt, prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[0274] 2. Proposals for nursing care services and subsidies
[0275] The server analyzes the information sent by the user and suggests appropriate nursing care services and subsidies from a database. The proposal list includes information on day care, home care, nursing care insurance benefits, low-sodium diets, etc.
[0276] 3. Meal suggestions and ordering
[0277] The server will provide specific meal suggestions to users who have entered information about their nutritional management and dietary restrictions. The meal suggestions will display menu items (e.g., "cheese sandwich," "apple," etc.) that correspond to the user's health condition. The user can select a meal from these suggestions and confirm their order.
[0278] 4. Information sharing and status check
[0279] If necessary, the server shares information with the care manager. The server sends information about the user's care situation and dietary choices to the care manager, who then takes appropriate action based on this information. The server also periodically sends the user questions about their care situation and dietary management, and makes new suggestions and advice based on the answers.
[0280] Hardware and software used
[0281] Hardware: Smartphones, computers
[0282] Software: Flask (a lightweight Python web framework), database (e.g., SQLite)
[0283] Specific examples
[0284] For example, if a user starts the app, selects their age as 68, and selects a low-sodium diet as their dietary restriction, the server will suggest meals such as "cheese sandwich" or "apple." If the user orders a "cheese sandwich," that information is shared with the care manager, who can use this information to provide additional advice based on the user's health condition.
[0285] Example prompts for generative AI models
[0286] "A user launches the app and enters their age of 68 and a low-sodium diet as a dietary restriction. Generate and display a list of appropriate meal suggestions."
[0287] In this way, the system helps users smoothly receive appropriate nursing care services and meal suggestions, thereby improving the quality of their daily lives.
[0288] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0289] Step 1:
[0290] The user launches the smartphone application and taps the "Start" button. The device then displays an interactive prompt prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[0291] Input: User taps
[0292] Output: Display the question prompt
[0293] What happens: The device displays the application's welcome screen and presents the user with a question prompt that includes fields for entering basic information.
[0294] Step 2:
[0295] The user follows the prompts, inputs information about age, care level, income, and nutritional management, and taps the send button. The device sends the input information to the server.
[0296] Input: Basic information entered by the user
[0297] Output: Basic information sent to the server
[0298] What it does: The device receives user input, converts it into JSON format, and sends it to the server as a POST request.
[0299] Step 3:
[0300] The server analyzes the transmitted user information and generates appropriate nursing care services, subsidies, and meal suggestions based on nutritional management from the database.
[0301] Input: Basic information sent to the server
[0302] Output: Nursing care services, grant proposal list, meal proposal list
[0303] Specific operation: The server analyzes the user information, extracts appropriate information from a pre-registered database based on that information, and generates a list of suggestions.
[0304] Step 4:
[0305] The terminal displays to the user the nursing care services, a list of subsidies, and a list of meal suggestions proposed by the server, and the user selects the services and meals they wish to use from the suggested list.
[0306] Input: A list of suggestions sent by the server
[0307] Output: The list of suggestions shown to the user
[0308] What it does: The device displays a list of suggestions on the screen and provides an interface for the user to review and make a selection.
[0309] Step 5:
[0310] The user selects a meal or care service from the list of suggestions, and confirms the order and detailed procedures. The terminal then sends the information to the server.
[0311] Input: The meal or service selected by the user
[0312] Output: Selections sent to the server
[0313] Specific operation: The device receives the user's selection, converts it into data to send to the server, and sends it as a POST request.
[0314] Step 6:
[0315] The server generates and transmits to the terminal specific procedural instructions and ordering information for the selected service and meal.
[0316] Input: User selection information
[0317] Output: Specific procedure instructions, order confirmation information
[0318] Specific operations: Based on the selection information received, the server generates the necessary procedure steps and order confirmation information and sends it to the terminal.
[0319] Step 7:
[0320] The terminal displays specific procedure instructions and order confirmation information sent from the server to the user.
[0321] Input: Procedural instructions and order confirmation information sent from the server
[0322] Output: Procedural instructions displayed to the user, order confirmation information
[0323] What it does: The terminal displays the order instructions and order confirmation on the screen for the user to review.
[0324] Step 8:
[0325] The server shares the user's information with the care manager as needed and periodically sends the user questions about their care situation and dietary management.
[0326] Input: User's latest information
[0327] Output: Information shared with care manager, questions sent to user
[0328] Specific operations: The server processes the user's information, sends the necessary data to the care manager, and also sends regular reminders and status check questions to the user.
[0329] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0330] This invention relates to a system that interactively acquires a user's basic information and emotional state, and based on that information, suggests appropriate nursing care services and subsidies, and guides them through specific procedures. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, a care manager terminal, and an emotion engine.
[0331] System configuration
[0332] This system mainly consists of the following components:
[0333] 1. User terminal: Equipped with a conversational interface, it provides a means for users to input basic information and emotions.
[0334] 2. Server: Analyzes the user's basic information and emotional information and suggests appropriate nursing care services and subsidies.
[0335] 3. Care Manager Terminal: Receives necessary information and provides a means for the care manager to plan and adjust the care plan.
[0336] 4. Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions.
[0337] Program processing flow
[0338] The program for this system is implemented in the following steps.
[0339] 1. User information input and emotion recognition
[0340] User: Launches the app and taps the "Start" button.
[0341] Terminal: Displays a conversational interface to the user, prompting them with "Please tell me your level of care." Sends the user's input speech and sentences to the emotion engine.
[0342] User: Enter "Care Level 3" and submit.
[0343] Emotion engine: Recognizes emotions from user input and sends the results to the server.
[0344] Terminal: Prompt "What is your annual income?"
[0345] User: Enters "3 million yen" and submits.
[0346] Terminal: Sends input information and emotion engine results to the server.
[0347] 2. Processing user and emotional information
[0348] Server: Analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Based on the emotional information from the emotion engine, the server changes the priority of the suggestions.
[0349] Server: Generates a list of suggestions such as "day care," "home care," and "long-term care insurance benefits."
[0350] Server: Sends the proposal list to the user device.
[0351] 3. Service and Grant Proposals
[0352] On the device: Show the user a list of suggestions.
[0353] User: Select the service they want to use from the list of suggestions.
[0354] 4. Procedural guidance and emotional response
[0355] Terminal: Requests the server for specific procedure instructions corresponding to the selected service.
[0356] Server: Generates specific procedural instructions such as required documents and application methods for the selected service.
[0357] Emotion engine: Prioritizes suggestions and explains procedures based on the user's emotional state.
[0358] Server: Sends the generated procedure information to the terminal.
[0359] Terminal: Display procedural instructions to the user.
[0360] 5. Sharing information with care managers
[0361] User: Selects information sharing and instructs transmission.
[0362] Terminal: Sends a transmission instruction to the server.
[0363] Server: Generates the necessary information for the care manager and sends notifications.
[0364] Care manager: Checks the received information and takes necessary action.
[0365] 6. Regular check-ins and emotional support
[0366] Server: Generates reminder notifications periodically and sends them to the device.
[0367] Device: Prompt the user with "How is your caregiving situation going these days?"
[0368] User: Enter answers about care situation and submit.
[0369] Terminal: Sends the answer to the server.
[0370] Server: Uses the new information to search for additional services and grants and generate proposals.
[0371] Emotion engine: Analyzes the user's emotional state and provides mental health care information as needed.
[0372] Server: Sends generated new suggestions and advice to the device.
[0373] Device: Show new suggestions and advice to the user.
[0374] Specific examples
[0375] For example, when a user starts the app and enters their care level of "care required 3" and annual income of "3 million yen," the emotion engine recognizes the user's emotional state and sends emotions such as "tired" and "anxiety" to the server. Based on this emotional information, the server generates a list of suggestions, prioritizing options such as "day care," "home care," and "long-term care insurance benefits." When the user selects "day care," specific procedures are displayed in an explanation that takes emotions into account. Furthermore, if necessary, information is shared with a care manager, who periodically checks the user's situation and provides new suggestions and mental care.
[0376] In this way, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers through emotional care.
[0377] The processing flow will be explained below.
[0378] Step 1:
[0379] User information input and emotion recognition
[0380] User: Launches the app and taps the "Start" button.
[0381] Terminal: Presents a conversational interface to the user, prompting them with "Please tell us your level of care." Sends the user's voice and text to the emotion engine.
[0382] User: Enter "Care Level 3" and submit.
[0383] Emotion engine: Analyzes emotions from user input and sends the results to the server.
[0384] Terminal: Followed by the prompt "What is your annual income?"
[0385] User: Enters "3 million yen" and submits.
[0386] Terminal: Sends the input information and the emotion engine's analysis results to the server.
[0387] Step 2:
[0388] User and sentiment analysis
[0389] Server: Analyzes the received basic information and emotional information, and searches the database for relevant nursing care services and subsidies.
[0390] Server: Refers to the results of sentiment analysis by the emotion engine and adjusts the priority of the suggestions.
[0391] Step 3:
[0392] Service and Grant Proposals
[0393] Server: Lists the searched nursing care services and subsidies in order of priority according to the results of the emotion engine.
[0394] Server: Sends the suggestion list to the device.
[0395] Terminal: Display the list to the user.
[0396] Step 4:
[0397] Select the service you want to use
[0398] User: Select "Day Care" from the list of proposed care services and grants.
[0399] Terminal: Requests information about the selected service from the server.
[0400] Step 5:
[0401] Procedural instructions
[0402] Server: Generates specific procedural steps for the selected "day service," such as the necessary documents and application procedures. It applies an explanation method that takes into account the analysis results of the emotion engine.
[0403] Server: Sends procedure information to the terminal.
[0404] Terminal: Display procedural instructions to the user.
[0405] Step 6:
[0406] Sharing information with care managers
[0407] User: Selects information sharing and instructs transmission.
[0408] Terminal: Sends a transmission instruction to the server.
[0409] Server: Generates the necessary information for the care manager and sends notifications.
[0410] Care manager: Checks the received information and takes necessary action.
[0411] Step 7:
[0412] Regular check-ins and emotional support
[0413] Server: Generates reminder notifications periodically and sends them to the device.
[0414] Device: Prompt the user with "How is your caregiving situation going these days?"
[0415] User: Enters the answer to the question about care situation, "Recently, there has been an increase in nighttime care," and submits.
[0416] Terminal: Sends the transmitted information to the server.
[0417] Server: Searches for additional nursing care services and subsidies based on the analysis results and generates proposals.
[0418] Emotion engine: Analyzes the user's emotional state and generates data to provide mental care and support information.
[0419] Server: Generates new suggestions and advice and sends them to the device.
[0420] Device: Show new suggestions and advice to the user.
[0421] Example 2
[0422] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0423] In the current nursing care service provision system, proposals are made based only on the user's basic information, which can sometimes lack consideration for the individual's feelings and emotions. Furthermore, the procedures for applying for proposed nursing care services and subsidies are complicated, often placing a mental burden on users as they go through the procedures. Furthermore, the lack of smooth information sharing with care managers is also a factor that hinders the creation of appropriate nursing care plans. A system that can solve these problems and provide support that is more attuned to users is needed.
[0424] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0425] In this invention, the server includes means for interactively inputting the user's basic information and emotional state, means for proposing available nursing care services and subsidies based on the basic information and emotional state, means for providing detailed instructions on how to obtain the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with an administrator, means for periodically checking the user's nursing care status and proposing new required nursing care services or subsidies, and means for analyzing the user's emotional state and adjusting the priority of the suggestions and the method of explaining the procedures. This makes it possible to provide appropriate nursing care services and subsidies and instructions on how to obtain them, taking the user's emotions into consideration, thereby reducing their mental burden.
[0426] "Basic information" refers to basic data such as the user's personal information, care level, and annual income.
[0427] "Emotional state" refers to the psychological state or mood analyzed from the user's input.
[0428] The "interactive format" is a format in which questions are presented sequentially in response to user input and responses are obtained from the user.
[0429] "Care services" are services that provide care support and assistance, such as day care services and home care.
[0430] "Subsidies" refer to financial support related to nursing care provided by the government or local governments.
[0431] "Procedures" refers to the steps required to use nursing care services and subsidies, such as the documents and application methods.
[0432] "Administrator" refers to a professional who is responsible for planning and coordinating the user's care plan, such as a care manager.
[0433] "Suggestion priority" refers to the display order of a list of care services and subsidies that is generated based on the user's emotional state and basic information.
[0434] An "emotion engine" is an algorithm or software that recognizes and analyzes emotions from a user's voice or text.
[0435] The "server" is a remote computer system that receives and analyzes data sent from user devices and provides appropriate nursing care services and subsidy information.
[0436] This system interactively acquires a user's basic information and emotional state, and then uses that information to suggest appropriate nursing care services and subsidies, providing guidance on specific procedures. Furthermore, by incorporating an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, an administrator terminal, and an emotion engine.
[0437] System configuration
[0438] User device: A device with a conversational interface that provides a means for users to input basic information and emotions. This can be a smartphone, tablet, or other device with an application that allows users to input voice or text.
[0439] Server: Analyzes the user's basic and emotional information and proposes appropriate care services and subsidies. The server communicates with the database and includes a back-end system that searches, analyzes, and generates information. This is often done using a cloud server environment such as AWS or Google Cloud.
[0440] Administrator device: This receives necessary information and provides a means for administrators to plan and adjust care plans. This is a device such as a computer or tablet used by care managers and other professionals.
[0441] Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions. The emotion engine is implemented using NLP (natural language processing) algorithms and AI models (such as OpenAI's GPT-3).
[0442] Specific examples
[0443] When a user launches the app and taps the "Start" button on the screen, the system begins to acquire the user's basic information and emotional state. The device displays a dialogue interface and prompts the user as follows:
[0444] "Please tell me your care level. For example, care level 3."
[0445] When the user enters "Care Level 3," the emotion engine recognizes the emotion from the user's input and sends the result to the server. The device then displays a prompt saying, "Please tell us your annual income. For example, 3 million yen." The user then enters "3 million yen" and sends it.
[0446] The server analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Furthermore, it changes the priority of suggestions based on the emotional information from the emotion engine. For example, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated and sent to the user's device.
[0447] When a user selects a desired service from the list of suggestions displayed on the device, the device requests the server for specific procedural instructions for the selected service. The server generates detailed procedural instructions for the selected service, including the necessary documents and application methods, and sends them to the user's device. The emotion engine adjusts the explanation method based on the user's emotional state, allowing the user to proceed with the procedure without stress.
[0448] Furthermore, if the user wishes, this information can be shared with the administrator, who can then adjust the care plan based on the received information. The system will periodically check the user's care status and send reminders to provide new suggestions and emotional care information.
[0449] The above is a specific embodiment for carrying out the present invention.
[0450] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0451] Step 1:
[0452] The user launches the app and taps the "Start" button. This input causes the system to start the process of obtaining user information, and displays the following interface.
[0453] Step 2:
[0454] The terminal displays a dialogue interface to the user, prompting them to "Please tell us your nursing care level." The user enters "Needs nursing care level 3." This text data is sent to the emotion engine, which performs text analysis and sends the emotional state to the server.
[0455] Step 3:
[0456] The emotion engine receives the user's input data, applies natural language processing (NLP) algorithms to analyze the emotion, and determines that the user is "tired" and sends the emotional state in JSON format to the server.
[0457] Step 4:
[0458] The device displays the following prompt: "Please tell us your annual income," and the user enters "3 million yen." The entered data is then sent to the emotion engine again for an attempt at emotion analysis.
[0459] Step 5:
[0460] The device compiles the input data and the analysis results of the emotion engine and sends them to the server via an HTTP POST request. The data includes the user's basic information (care level, annual income) and emotion information (tired).
[0461] Step 6:
[0462] The server analyzes the received basic information and emotion information. First, it accesses the database to obtain the appropriate data set (care services, subsidy information, etc.).
[0463] Step 7:
[0464] The server uses an analytical algorithm to search the database for appropriate nursing care services and subsidies, and then changes the priority of the suggestions based on the emotion information obtained from the emotion engine to generate a list of suggestions.
[0465] Step 8:
[0466] The server generates a list of suggestions such as "day service," "home care," and "long-term care insurance benefits" in JSON format and sends it to the user's device.
[0467] Step 9:
[0468] The terminal displays the received proposal list on the interface. When the user selects a desired service from the proposal list, the selection information is sent back to the server.
[0469] Step 10:
[0470] The terminal requests the server for specific procedure instructions corresponding to the selected service, and the server generates detailed procedure information such as required documents and application methods and sends it to the user terminal.
[0471] Step 11:
[0472] The server adjusts how it explains the procedure based on the user's emotional state. For example, if the user is determined to be "tired," it adjusts the explanation to be briefer.
[0473] Step 12:
[0474] The terminal displays detailed procedure instructions to the user, and if the user wishes, sends instructions to the server again to share this procedure information with the administrator.
[0475] Step 13:
[0476] The server generates the information again and sends a notification to the administrator, who can then adjust the care plan based on the received information.
[0477] Step 14:
[0478] The server periodically generates reminders and sends information to the user's device to provide improvement suggestions and emotional care.
[0479] Step 15:
[0480] The device periodically prompts the user, "How is your care situation going lately?" and sends the answer to the server.
[0481] (Application example 2)
[0482] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0483] Improving worker safety and work efficiency is important in factories, and it is particularly important to understand workers' emotional states in real time and provide appropriate work instructions and break suggestions. However, conventional methods have had difficulty accurately understanding workers' emotional states and providing quick and appropriate suggestions. This not only makes it difficult to prevent worker fatigue and stress, but also leads to problems such as reduced work efficiency and safety. Therefore, there is a need for a system that can obtain basic information and emotional states of workers in real time and provide optimal work instructions and break suggestions based on that information.
[0484] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0485] In this invention, the server includes means for interactively inputting basic information of a user, means for providing possible work instructions and break suggestions based on the basic information, means for providing detailed instructions for the proposed work instructions or break suggestions, means for transmitting the basic information and emotional information to the server and generating suggestions, means for recognizing the emotional state and optimizing the suggestions, and means for periodically checking the user's work situation and emotional state and regenerating necessary work instructions and break suggestions. This makes it possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[0486] Definition of Terms
[0487] "Basic user information" is data including the worker's name, work, job title, and other personal information.
[0488] The "server" is a central computing device that processes the user's basic information and emotional information and generates appropriate work instructions and break suggestions.
[0489] "Interactive" means that the user communicates with the system and inputs information via text or voice.
[0490] "Work instructions" are proposals that include specific instructions and advice necessary for workers to efficiently carry out their work.
[0491] "Break suggestions" are suggestions that provide appropriate break times and relaxation methods to reduce worker fatigue and stress.
[0492] "Detailed procedures" are information that indicates specific implementation procedures and safety measures for proposed work instructions and break suggestions.
[0493] "Emotion information" is data on the emotional state of a worker obtained by analyzing the worker's voice and facial expression data.
[0494] "Emotional state" is information that indicates the worker's current psychological and emotional state.
[0495] "Optimization means" refers to methods or algorithms that adjust the priority and content of proposals based on emotional information.
[0496] "Work status" is information indicating the current work content of the worker and its progress.
[0497] MODE FOR CARRYING OUT THE INVENTION
[0498] This invention provides a system for improving worker safety and efficiency at a factory site. This system is composed of a user terminal for executing a program, a server, an emotion engine, and a factory robot that works in conjunction with the user terminal. A specific embodiment of this system is described below.
[0499] System configuration
[0500] 1. User Device:
[0501] Provide a means for workers to enter basic information (such as name and job description).
[0502] It has an interface for sending voice and facial expression data to the emotion engine.
[0503] 2. Server:
[0504] Receive and analyze basic information and emotional information of the user.
[0505] Appropriate work instructions and break suggestions are generated and sent to the user's device.
[0506] 3. Care manager terminal:
[0507] Receives necessary information and provides a means for management (e.g., supervisor) to plan and adjust the plan of care.
[0508] 4. Emotion Engine:
[0509] It recognizes emotions from the user's voice or text input and sends the results to the server.
[0510] Program processing flow
[0511] The program is executed as follows:
[0512] 1. Enter basic information:
[0513] The user starts up the user device and taps the "Start" button.
[0514] The terminal will prompt you to enter basic information about the worker.
[0515] 2. Emotion recognition:
[0516] It receives information input by the user via voice or text and sends it to the emotion engine.
[0517] The emotion engine analyzes the emotional state and sends the results to the server.
[0518] 3. Transmission of information to the server and analysis:
[0519] The device sends the input basic information and emotion information to the server.
[0520] The server generates appropriate work instructions and break suggestions based on the received basic information and emotion information.
[0521] 4. Proposal generation and display:
[0522] The server generates suggestions such as "relaxation methods" and "safety measures" and sends them to the user's device.
[0523] The terminal displays the generated proposals to the worker in an interactive format.
[0524] 5. Regularly review and resubmit proposals:
[0525] The server periodically generates reminders and sends them to the device.
[0526] The device prompts the user, "How's your work going lately?"
[0527] Once the user enters their answers, the server generates new suggestions based on that information.
[0528] Specific examples
[0529] For example, if a worker says "I'm tired" to the robot, the emotion engine analyzes it and detects the fatigue. The server immediately suggests a five-minute break, and the suggestion is displayed on the robot's screen. If the worker takes the break as suggested, fatigue will be reduced.
[0530] Prompt Sentence Examples
[0531] "Generate code for a conversational robot application that detects specific emotions (e.g., 'tired' or 'anxious') and offers appropriate breaks or mental health advice to workers."
[0532] This makes it possible to quickly provide optimal work instructions and break suggestions based on the worker's emotional state, improving safety and efficiency.
[0533] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0534] Program processing steps
[0535] Step 1: Enter basic information
[0536] The user starts the user device and taps the "Start" button. The device displays a prompt to enter basic information about the worker (such as name and work content). Once the user has completed the input, the device saves the information.
[0537] Input: Worker name, work content
[0538] Output: Basic information saved
[0539] Step 2: Start Recognizing Emotions
[0540] The terminal provides an interface for receiving a user's voice or text input and acquires emotion information in real time. The user inputs information by voice or text.
[0541] Input: Audio data, text data
[0542] Output: Emotional information
[0543] Step 3: Emotional information analysis
[0544] The emotion engine analyzes the received voice or text data to recognize the user's emotional state, and the analysis results are sent to the server as emotion information.
[0545] Input: Audio data, text data
[0546] Data processing: natural language processing, sentiment analysis
[0547] Output: Emotional information
[0548] Step 4: Send basic information and emotional information to the server
[0549] The device sends the user's basic information and emotional information to the server, which receives it and stores it in a database.
[0550] Input: Basic information, emotional information
[0551] Output: Data stored on the server
[0552] Step 5: Work order and break proposal generation
[0553] The server generates appropriate work instructions and break suggestions based on the stored basic information and emotion information, and sends the suggestions to the user's device.
[0554] Input: Basic information, emotional information
[0555] Data calculation: Algorithm for generating work instructions and break suggestions
[0556] Output: Work instructions, break suggestions
[0557] Step 6: Viewing Proposals
[0558] The terminal receives work instructions and break suggestions from the server and displays them to the user in an interactive format, allowing the user to decide their next action based on the information.
[0559] Input: Work Order, Break Proposal
[0560] Output: The displayed suggestions
[0561] Step 7: Regular check-ins
[0562] The server periodically generates reminders and sends them to the user's terminal, which then displays a prompt to the user asking, "How is your work going recently?"
[0563] input: -
[0564] Output: Reminder notification
[0565] Step 8: User feedback and re-suggestions
[0566] The user enters answers to the prompts and sends them to the terminal, which sends the information to the server, which generates new suggestions, which are then sent back to the user terminal.
[0567] Input: Feedback information
[0568] Data operations: feedback analysis, re-proposal generation
[0569] Output: New proposal
[0570] Through the above steps, it is possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[0571] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0572] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0573] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0574] [Second embodiment]
[0575] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0576] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0577] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0578] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0579] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0580] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0581] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0582] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0583] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0584] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0585] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0586] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0587] This invention relates to an interactive application system that facilitates access to nursing care services and subsidies. This system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, it shares information with a care manager as needed, periodically checks the user's care status, and provides additional suggestions and mental care as needed.
[0588] System configuration
[0589] This system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to input basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[0590] Program processing flow
[0591] The program of this system mainly performs the following five functions.
[0592] 1. Enter user information
[0593] User: Launches the app and taps the "Start" button.
[0594] Terminal: Displays interactive question prompts including care grade and income information.
[0595] User: Enter answers to the questions, such as "Level 3 nursing care required" or "3 million yen," and submit.
[0596] Terminal: Sends the entered information to the server.
[0597] 2. Information on services and grants
[0598] Server: Analyzes the collected user information and suggests appropriate nursing care services and subsidies from the database.
[0599] Server: Generates lists such as "day care services," "home care," and "long-term care insurance benefits," and sends them to the terminal.
[0600] On the device: Show the user a list of suggestions.
[0601] 3. Select the service you want to use
[0602] User: Select the service they want to use from the list of suggestions.
[0603] Terminal: Requests specific procedural instructions for the selected service from the server.
[0604] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[0605] Terminal: Displays procedural instructions to the user.
[0606] 4. Sharing information with care managers
[0607] User: Select information sharing and instruct the transmission of the required information.
[0608] Terminal: Sends a transmission instruction to the server.
[0609] Server: Generates the necessary information for the care manager and sends notifications.
[0610] Care manager: Checks the received information and takes necessary action.
[0611] 5. Regular status checks and advice
[0612] Server: Generates periodic reminders and sends status check notifications to users.
[0613] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[0614] User: Enter answers about care situation and submit.
[0615] Terminal: Sends the answer to the server.
[0616] Server: Generates proposals for additional services and grants based on new information, and generates advice and mental health information.
[0617] Device: Show new suggestions and advice to the user.
[0618] Specific examples
[0619] For example, when a user starts the app and enters their care level of "Care Level 3" and annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" and confirms the specific procedures (required documents, application method, etc.). They then issue instructions to share the information with a care manager, and the server sends a notification to the care manager. Then, if the user periodically enters and sends the situation, such as "I've been working more at night recently," the server generates additional suggestions such as "nighttime home care," and provides necessary advice and mental care information.
[0620] In this way, the present invention provides a system that can support caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[0621] The processing flow will be explained below.
[0622] Step 1:
[0623] Enter user information
[0624] User: Launches the app and taps the "Start" button.
[0625] Terminal: Presents the user with an interactive interface and prompts them, "What is your care level?"
[0626] User: Enter "Care Level 3" and submit.
[0627] Terminal: Prompt "What is your annual income?"
[0628] User: Enters "3 million yen" and submits.
[0629] Terminal: Temporarily stores the entered information and sends it to the server.
[0630] Step 2:
[0631] Processing and analyzing user information
[0632] Server: Analyzes the received user's care level and income data.
[0633] Server: Searches for applicable nursing care services and subsidies using its own database.
[0634] Step 3:
[0635] Service and Grant Proposals
[0636] Server: Based on the search results, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated.
[0637] Server: Sends the generated proposal list to the device.
[0638] Terminal: Display the list to the user.
[0639] Step 4:
[0640] Select the service you want to use
[0641] User: Select "Day Care" from the list of proposed care services and grants.
[0642] Terminal: Requests information about the selected service from the server.
[0643] Step 5:
[0644] Procedural instructions
[0645] Server: Generates specific procedural instructions, such as the necessary documents and application methods for the selected "day service."
[0646] Server: Sends the generated procedure information to the terminal.
[0647] Terminal: Display procedural instructions to the user.
[0648] Step 6:
[0649] Sharing information with care managers
[0650] User: Selects information sharing and instructs transmission.
[0651] Terminal: Sends a transmission instruction to the server.
[0652] Server: Generates the necessary information for the care manager and sends notifications.
[0653] Care manager: Checks the received information and takes necessary action.
[0654] Step 7:
[0655] Regular status checks
[0656] Server: Generates reminder notifications periodically and sends them to the device.
[0657] Device: Prompt the user with "How is your caregiving situation going these days?"
[0658] Step 8:
[0659] Additional answers and suggestions
[0660] User: Regarding the care situation, enter "Recently, there has been an increase in nighttime care" and submit.
[0661] Terminal: Sends the transmitted information to the server.
[0662] Server: Searches for additional care services and grants based on new information received.
[0663] Server: Sends the generated new proposal to the device.
[0664] On-device: Displays new suggestions to users and provides necessary advice and mental health information.
[0665] Example 1
[0666] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0667] The present invention aims to solve the problem that many users are unable to receive appropriate support due to the complicated procedures involved in using nursing care services and subsidies. In particular, there is a need to reduce the burden on users and enable them to receive appropriate support by consistently providing information on available services and subsidies, guidance on specific procedures, and regular status checks and advice.
[0668] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0669] In this invention, the server includes: means for interactively inputting basic information about a user; means for proposing available nursing care services and subsidies based on the basic information; means for providing detailed instructions for obtaining the proposed nursing care services or subsidies; means for sharing information necessary for using the nursing care services with an administrator; means for periodically checking the user's nursing care status and proposing newly required nursing care services or subsidies; means for transmitting the basic information to the server; means for the server to generate a proposal list of appropriate nursing care services and subsidies from the collected information and transmit it to a user terminal; means for the user to select a service from the proposal list and transmit the selected information to the server; means for the server to generate a procedure for the selected service and transmit it to the user terminal and display it; and means for generating additional proposals and advice based on the information collected through the periodic checks and displaying it to the user. This allows users to easily apply for nursing care services and subsidies, and to receive appropriate support while receiving necessary advice and regular status checks.
[0670] "Basic user information" refers to information about the individual user, including information such as care level and income.
[0671] "Dialogue" refers to the way in which a user interacts with a system, proceeding in a question-and-answer format.
[0672] "Care services" refer to various support services provided to people who need care, including day care services and home care services.
[0673] "Subsidies" are financial support provided when using nursing care services, and include nursing care insurance benefits.
[0674] The "Proposal List" is a list of nursing care services and subsidy options that can be provided based on the user's basic information.
[0675] "Procedures" refer to the specific procedures required to use the proposed nursing care services and subsidies, including the preparation of documents and application methods.
[0676] "Sharing information with the administrator" means notifying the administrator of the information necessary for the user to use nursing care services and sharing the information.
[0677] "Regular status checks" means checking the user's care status at regular intervals and providing additional service suggestions and advice.
[0678] The "server" is a remote computer system that analyzes the information sent by the user and generates a list of appropriate nursing care services and subsidy proposals.
[0679] A "user terminal" is an information and communication device used by a user, such as a computer, tablet, or smartphone.
[0680] This invention is an interactive application system that facilitates access to nursing care services and subsidies. The system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, the system shares information with an administrator as needed, periodically checks the user's nursing care status, and provides additional suggestions and mental health care as needed.
[0681] System configuration
[0682] This system mainly consists of a user terminal, a server, and an administrator terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. In addition, the necessary information is shared with the administrator terminal, making it easier for the administrator to respond.
[0683] Hardware and software used
[0684] Server: Generation of service proposals and procedural steps, database management. Specific software used for this purpose includes database management systems (MySQL, PostgreSQL), a dialog management system, and a periodic notification system.
[0685] User device: A device such as a smartphone or tablet on which application software (iOS, Android app) is installed.
[0686] Administrator device: A computer or tablet used by an administrator.
[0687] Program processing flow
[0688] The system is programmed in the following way: When a user launches the app and enters their care level of "care required 3" and their annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" from this list of suggestions and checks the specific procedures (required documents, application method, etc.). The user then issues an instruction to share the information with the administrator, and the server sends a notification to the administrator's device. The user periodically enters and submits the situation, such as "We've been seeing an increase in night-time appointments recently," and the server generates additional suggestions such as "night-time home care," and provides necessary advice and mental health care information.
[0689] Examples of prompt statements
[0690] Please use the information below to suggest appropriate care services and subsidies.
[0691] Nursing care level: Nursing care level 3
[0692] Annual income: 3 million yen
[0693] Also, please provide specific procedural steps and information on required documents.
[0694] As described above, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[0695] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0696] Step 1: Launch and start the app
[0697] User: Tap the app on the smartphone home screen to launch it. Tap the "Start" button to begin using the system.
[0698] Input: Launching the app and tapping the "Start" button.
[0699] Output: A screen displaying the interactive questions.
[0700] What it does: The app displays an interactive prompt on the user's screen saying, "Please enter your care level and income information."
[0701] Step 2: Display interactive questions
[0702] On the device: The app displays interactive question prompts on the user's screen, asking for information such as care level (e.g., "Care Level 3") and income information (e.g., "3 million yen").
[0703] Input: The question the app will ask.
[0704] Output: The question is displayed on the user's screen.
[0705] Specific Behavior: The system provides multiple choice or open-ended fields to facilitate user input.
[0706] Step 3: User answers and submits
[0707] User: Enter information such as "Level 3 nursing care required" or "3 million yen" in response to the questions, and tap the "Submit" button.
[0708] Input: User-entered care grade and income information.
[0709] Output: The input data is sent to the server.
[0710] Specific operation: The app sends the entered data to the server in real time.
[0711] Step 4: Send the input information to the server
[0712] Terminal: Sends the entered information to the server in real time.
[0713] Input: The information the user entered and tapped the submit button.
[0714] Output: Basic information of the user received by the server.
[0715] Specific operation: The server temporarily stores the received information and prepares it for analysis.
[0716] Step 5: Analyze user information
[0717] Server: Analyzes the entered user information and collates relevant information from the database.
[0718] Input: Basic information of the recipient.
[0719] Output: A list of optimal care services and subsidy proposals.
[0720] Specific operation: The server searches and collates relevant nursing care services and subsidy data in the database based on nursing care grade and income information.
[0721] Step 6: Generate a list of suggestions
[0722] Server: Based on the analysis results, it generates a list of proposals for appropriate nursing care services and subsidies, such as "day care," "home care," and "long-term care insurance benefits."
[0723] Input: Relevant information retrieved from the database.
[0724] Output: A list of suggestions.
[0725] What happens: The server compiles a list of eligible services and grants and converts it into a displayable data format.
[0726] Step 7: Send the list to the user's device
[0727] Server: Sends the proposal list to the user device.
[0728] Input: Suggestion list.
[0729] Output: The suggestion list displayed on the user's device.
[0730] Specific operation: The server uses a communication protocol to send the generated proposal list to the user's device.
[0731] Step 8: View the list
[0732] On the device: The received list of suggestions is displayed in a user-friendly format.
[0733] Input: The proposal list sent by the server.
[0734] Output: The suggestion list displayed on the user screen.
[0735] What it does: The app displays a list of suggestions in a user interface designed to make it easy for the user to select.
[0736] Step 9: Select the proposed service
[0737] User: Select the service they want to use from the list of suggestions.
[0738] Input: The service selected by the user.
[0739] Output: The information about the selected service is sent to the server.
[0740] Specific behavior: The user taps one service from the list and the selection is sent to the server.
[0741] Step 10: Request Procedural Instructions
[0742] Terminal: Requests specific procedural instructions for the selected service from the server.
[0743] Input: Selected service information.
[0744] Output: Request data sent to server.
[0745] What happens: The app sends a request to the server for procedural instructions for the selected service.
[0746] Step 11: Generate procedural steps
[0747] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[0748] Input: The requested service information.
[0749] Output: Detailed information about the procedure steps.
[0750] Specific operations: The server generates the necessary documents and procedures for the selected service and prepares the data to be sent to the user's terminal.
[0751] Step 12: View procedural steps
[0752] Terminal: Displays the necessary information to the user for the procedure.
[0753] Input: Procedural step information sent from the server.
[0754] Output: The procedural steps that are displayed to the user.
[0755] Specific Actions: The app displays the received procedural information in the user interface, helping the user understand the specific next steps.
[0756] Step 13: Information Sharing Options
[0757] User: Makes information sharing choices and directs the transmission of desired information.
[0758] Input: Information sharing selection operation.
[0759] Output: The shared information is sent to the server.
[0760] Specific operation: The user taps the "Share Information" button, sending an instruction to share information to the server.
[0761] Step 14: Sending instructions to the server
[0762] Device: Sends instructions to share information to the server.
[0763] Input: Information sharing selection data.
[0764] Output: Information sharing instructions sent to the server.
[0765] Specific operation: The app prepares the information sharing instruction data and sends it to the server.
[0766] Step 15: Notify administrators
[0767] Server: Generates the information required by the administrator and sends notifications to the administrator's terminal.
[0768] Input: Information sharing instruction data.
[0769] Output: Administrator notification data.
[0770] Specific operation: The server generates notification data and sends it to the administrator terminal.
[0771] Step 16: Check the required information and take action
[0772] Administrator: Review the received information and take appropriate action.
[0773] Input: Administrator notification data sent from the server.
[0774] Output: Administrator response results.
[0775] Specific actions: The administrator checks the notification received in the system and responds to the user based on the required information.
[0776] Step 17: Generate recurring reminders
[0777] Server: Generates periodic reminders and sends status check notifications to users.
[0778] Input: Recurring schedule data.
[0779] Output: Reminder notification to the user.
[0780] Specific operation: The server generates a reminder notification based on the schedule and sends it to the user's device.
[0781] Step 18: Status Check Notification
[0782] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[0783] Input: Reminder notification data sent from the server.
[0784] Output: A challenge question that is displayed to the user.
[0785] What it does: The app prompts the user with a status check question based on the reminder notification.
[0786] Step 19: Enter and submit your situational response
[0787] User: Enter answers about care situation and submit.
[0788] Input: The situational answer data entered by the user.
[0789] Output: The status response data sent to the server.
[0790] Specific behavior: The user enters an answer about the situation and taps the "Submit" button, which sends the data to the server.
[0791] Step 20: Generate and display additional suggestions and advice
[0792] Server: Generates proposals for additional care services and subsidies based on new information, and generates advice and mental health care information.
[0793] Input: User situation answer data.
[0794] Output: Additional suggestions and advice data.
[0795] Specific operation: The server analyzes the received situation data, generates new suggestions and advice, and sends them to the user's device.
[0796] Device: Show new suggestions and advice to the user.
[0797] Input: Additional suggestion and advice data sent by the server.
[0798] Output: Additional suggestions and advice displayed on the user screen.
[0799] What it does: The app displays additional service suggestions and advice in the user interface.
[0800] (Application example 1)
[0801] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0802] In recent years, while support for the elderly and those who require nursing care has become increasingly important, obtaining information on nursing care services and subsidies, procedures, and daily meal management have become complex issues. In particular, arranging daily meals requires appropriate nutritional management and accommodating dietary restrictions, which creates a significant burden. There is a need to solve these issues all at once.
[0803] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0804] In this invention, the server includes means for interactively inputting basic information about the user, means for proposing available nursing care services and subsidies based on the basic information, means for providing detailed instructions on procedures for the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with a care manager, means for periodically checking the user's nursing care status and proposing new necessary nursing care services or subsidies, means for proposing meals that correspond to the user's nutritional management and dietary restrictions, and means for ordering specific meals and sharing the order status with the care manager. This not only allows users to easily access nursing care services and subsidies, but also allows them to manage their meals, thereby improving the quality of their daily lives.
[0805] "Basic user information" refers to personal data such as the user's age, care level, income information, and information regarding nutritional management.
[0806] "Interactive input means" means a system in which a user inputs information via a smartphone or computer by following on-screen prompts.
[0807] "Care services" refer to services such as day care, home care, and night-time home care provided to the elderly and people who need care.
[0808] A "subsidy" is financial assistance provided to users who meet certain conditions.
[0809] "Means for providing detailed procedural guidance" refers to a system that displays how users prepare and apply for the documents necessary to use nursing care services and subsidies.
[0810] A "care manager" is a professional who provides and coordinates nursing care services.
[0811] The "means of periodically checking the user's care status" is a system that periodically asks the user questions about their care status and collects their responses.
[0812] The "means of proposing new necessary nursing care services and subsidies" is a system that proposes new nursing care services and subsidies based on the latest collected user information.
[0813] "Nutritional management and dietary restrictions" refers to management that restricts certain nutrients and food ingredients based on the user's health condition or doctor's instructions.
[0814] The "means for making meal suggestions" is a system that suggests appropriate meal menus that correspond to the user's nutritional management and dietary restrictions.
[0815] A "means for ordering a specific meal" is a mechanism by which a user selects from a suggested menu of meals and orders a meal.
[0816] "Means for sharing with care managers" refers to a system that sends and shares information entered by users and data regarding ordered meals with care managers.
[0817] The present invention relates to an interactive application system that allows elderly people and those in need of care to easily access care services and subsidies. This system allows users to suggest and order meals and share care information to improve the quality of their daily lives.
[0818] System Overview
[0819] The system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and check suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[0820] Program processing overview
[0821] The server is built using Flask, a lightweight Python web framework, and collects and processes user information as follows:
[0822] 1. Enter your basic information
[0823] First, the user launches the smartphone application and taps the "Start" button. The device then displays an interactive question prompt, prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[0824] 2. Proposals for nursing care services and subsidies
[0825] The server analyzes the information sent by the user and suggests appropriate nursing care services and subsidies from a database. The proposal list includes information on day care, home care, nursing care insurance benefits, low-sodium diets, etc.
[0826] 3. Meal suggestions and ordering
[0827] The server will provide specific meal suggestions to users who have entered information about their nutritional management and dietary restrictions. The meal suggestions will display menu items (e.g., "cheese sandwich," "apple," etc.) that correspond to the user's health condition. The user can select a meal from these suggestions and confirm their order.
[0828] 4. Information sharing and status check
[0829] If necessary, the server shares information with the care manager. The server sends information about the user's care situation and dietary choices to the care manager, who then takes appropriate action based on this information. The server also periodically sends the user questions about their care situation and dietary management, and makes new suggestions and advice based on the answers.
[0830] Hardware and software used
[0831] Hardware: Smartphones, computers
[0832] Software: Flask (a lightweight Python web framework), database (e.g., SQLite)
[0833] Specific examples
[0834] For example, if a user starts the app, selects their age as 68, and selects a low-sodium diet as their dietary restriction, the server will suggest meals such as "cheese sandwich" or "apple." If the user orders a "cheese sandwich," that information is shared with the care manager, who can use this information to provide additional advice based on the user's health condition.
[0835] Example prompts for generative AI models
[0836] "A user launches the app and enters their age of 68 and a low-sodium diet as a dietary restriction. Generate and display a list of appropriate meal suggestions."
[0837] In this way, the system helps users smoothly receive appropriate nursing care services and meal suggestions, thereby improving the quality of their daily lives.
[0838] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0839] Step 1:
[0840] The user launches the smartphone application and taps the "Start" button. The device then displays an interactive prompt prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[0841] Input: User taps
[0842] Output: Display the question prompt
[0843] What happens: The device displays the application's welcome screen and presents the user with a question prompt that includes fields for entering basic information.
[0844] Step 2:
[0845] The user follows the prompts, inputs information about age, care level, income, and nutritional management, and taps the send button. The device sends the input information to the server.
[0846] Input: Basic information entered by the user
[0847] Output: Basic information sent to the server
[0848] What it does: The device receives user input, converts it into JSON format, and sends it to the server as a POST request.
[0849] Step 3:
[0850] The server analyzes the transmitted user information and generates appropriate nursing care services, subsidies, and meal suggestions based on nutritional management from the database.
[0851] Input: Basic information sent to the server
[0852] Output: Nursing care services, grant proposal list, meal proposal list
[0853] Specific operation: The server analyzes the user information, extracts appropriate information from a pre-registered database based on that information, and generates a list of suggestions.
[0854] Step 4:
[0855] The terminal displays to the user the nursing care services, a list of subsidies, and a list of meal suggestions proposed by the server, and the user selects the services and meals they wish to use from the suggested list.
[0856] Input: A list of suggestions sent by the server
[0857] Output: The list of suggestions shown to the user
[0858] What it does: The device displays a list of suggestions on the screen and provides an interface for the user to review and make a selection.
[0859] Step 5:
[0860] The user selects a meal or care service from the list of suggestions, and confirms the order and detailed procedures. The terminal then sends the information to the server.
[0861] Input: The meal or service selected by the user
[0862] Output: Selections sent to the server
[0863] Specific operation: The device receives the user's selection, converts it into data to send to the server, and sends it as a POST request.
[0864] Step 6:
[0865] The server generates and transmits to the terminal specific procedural instructions and ordering information for the selected service and meal.
[0866] Input: User selection information
[0867] Output: Specific procedure instructions, order confirmation information
[0868] Specific operations: Based on the selection information received, the server generates the necessary procedure steps and order confirmation information and sends it to the terminal.
[0869] Step 7:
[0870] The terminal displays specific procedure instructions and order confirmation information sent from the server to the user.
[0871] Input: Procedural instructions and order confirmation information sent from the server
[0872] Output: Procedural instructions displayed to the user, order confirmation information
[0873] What it does: The terminal displays the order instructions and order confirmation on the screen for the user to review.
[0874] Step 8:
[0875] The server shares the user's information with the care manager as needed and periodically sends the user questions about their care situation and dietary management.
[0876] Input: User's latest information
[0877] Output: Information shared with care manager, questions sent to user
[0878] Specific operations: The server processes the user's information, sends the necessary data to the care manager, and also sends regular reminders and status check questions to the user.
[0879] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0880] This invention relates to a system that interactively acquires a user's basic information and emotional state, and based on that information, suggests appropriate nursing care services and subsidies, and guides them through specific procedures. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, a care manager terminal, and an emotion engine.
[0881] System configuration
[0882] This system mainly consists of the following components:
[0883] 1. User terminal: Equipped with a conversational interface, it provides a means for users to input basic information and emotions.
[0884] 2. Server: Analyzes the user's basic information and emotional information and suggests appropriate nursing care services and subsidies.
[0885] 3. Care Manager Terminal: Receives necessary information and provides a means for the care manager to plan and adjust the care plan.
[0886] 4. Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions.
[0887] Program processing flow
[0888] The program for this system is implemented in the following steps.
[0889] 1. User information input and emotion recognition
[0890] User: Launches the app and taps the "Start" button.
[0891] Terminal: Displays a conversational interface to the user, prompting them with "Please tell me your level of care." Sends the user's input speech and sentences to the emotion engine.
[0892] User: Enter "Care Level 3" and submit.
[0893] Emotion engine: Recognizes emotions from user input and sends the results to the server.
[0894] Terminal: Prompt "What is your annual income?"
[0895] User: Enters "3 million yen" and submits.
[0896] Terminal: Sends input information and emotion engine results to the server.
[0897] 2. Processing user and emotional information
[0898] Server: Analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Based on the emotional information from the emotion engine, the server changes the priority of the suggestions.
[0899] Server: Generates a list of suggestions such as "day care," "home care," and "long-term care insurance benefits."
[0900] Server: Sends the proposal list to the user device.
[0901] 3. Service and Grant Proposals
[0902] On the device: Show the user a list of suggestions.
[0903] User: Select the service they want to use from the list of suggestions.
[0904] 4. Procedural guidance and emotional response
[0905] Terminal: Requests the server for specific procedure instructions corresponding to the selected service.
[0906] Server: Generates specific procedural instructions such as required documents and application methods for the selected service.
[0907] Emotion engine: Prioritizes suggestions and explains procedures based on the user's emotional state.
[0908] Server: Sends the generated procedure information to the terminal.
[0909] Terminal: Display procedural instructions to the user.
[0910] 5. Sharing information with care managers
[0911] User: Selects information sharing and instructs transmission.
[0912] Terminal: Sends a transmission instruction to the server.
[0913] Server: Generates the necessary information for the care manager and sends notifications.
[0914] Care manager: Checks the received information and takes necessary action.
[0915] 6. Regular check-ins and emotional support
[0916] Server: Generates reminder notifications periodically and sends them to the device.
[0917] Device: Prompt the user with "How is your caregiving situation going these days?"
[0918] User: Enter answers about care situation and submit.
[0919] Terminal: Sends the answer to the server.
[0920] Server: Uses the new information to search for additional services and grants and generate proposals.
[0921] Emotion engine: Analyzes the user's emotional state and provides mental health care information as needed.
[0922] Server: Sends generated new suggestions and advice to the device.
[0923] Device: Show new suggestions and advice to the user.
[0924] Specific examples
[0925] For example, when a user starts the app and enters their care level of "care required 3" and annual income of "3 million yen," the emotion engine recognizes the user's emotional state and sends emotions such as "tired" and "anxiety" to the server. Based on this emotional information, the server generates a list of suggestions, prioritizing options such as "day care," "home care," and "long-term care insurance benefits." When the user selects "day care," specific procedures are displayed in an explanation that takes emotions into account. Furthermore, if necessary, information is shared with a care manager, who periodically checks the user's situation and provides new suggestions and mental care.
[0926] In this way, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers through emotional care.
[0927] The processing flow will be explained below.
[0928] Step 1:
[0929] User information input and emotion recognition
[0930] User: Launches the app and taps the "Start" button.
[0931] Terminal: Presents a conversational interface to the user, prompting them with "Please tell us your level of care." Sends the user's voice and text to the emotion engine.
[0932] User: Enter "Care Level 3" and submit.
[0933] Emotion engine: Analyzes emotions from user input and sends the results to the server.
[0934] Terminal: Followed by the prompt "What is your annual income?"
[0935] User: Enters "3 million yen" and submits.
[0936] Terminal: Sends the input information and the emotion engine's analysis results to the server.
[0937] Step 2:
[0938] User and sentiment analysis
[0939] Server: Analyzes the received basic information and emotional information, and searches the database for relevant nursing care services and subsidies.
[0940] Server: Refers to the results of sentiment analysis by the emotion engine and adjusts the priority of the suggestions.
[0941] Step 3:
[0942] Service and Grant Proposals
[0943] Server: Lists the searched nursing care services and subsidies in order of priority according to the results of the emotion engine.
[0944] Server: Sends the suggestion list to the device.
[0945] Terminal: Display the list to the user.
[0946] Step 4:
[0947] Select the service you want to use
[0948] User: Select "Day Care" from the list of proposed care services and grants.
[0949] Terminal: Requests information about the selected service from the server.
[0950] Step 5:
[0951] Procedural instructions
[0952] Server: Generates specific procedural steps for the selected "day service," such as the necessary documents and application procedures. It applies an explanation method that takes into account the analysis results of the emotion engine.
[0953] Server: Sends procedure information to the terminal.
[0954] Terminal: Display procedural instructions to the user.
[0955] Step 6:
[0956] Sharing information with care managers
[0957] User: Selects information sharing and instructs transmission.
[0958] Terminal: Sends a transmission instruction to the server.
[0959] Server: Generates the necessary information for the care manager and sends notifications.
[0960] Care manager: Checks the received information and takes necessary action.
[0961] Step 7:
[0962] Regular check-ins and emotional support
[0963] Server: Generates reminder notifications periodically and sends them to the device.
[0964] Device: Prompt the user with "How is your caregiving situation going these days?"
[0965] User: Enters the answer to the question about care situation, "Recently, there has been an increase in nighttime care," and submits.
[0966] Terminal: Sends the transmitted information to the server.
[0967] Server: Searches for additional nursing care services and subsidies based on the analysis results and generates proposals.
[0968] Emotion engine: Analyzes the user's emotional state and generates data to provide mental care and support information.
[0969] Server: Generates new suggestions and advice and sends them to the device.
[0970] Device: Show new suggestions and advice to the user.
[0971] Example 2
[0972] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0973] In the current nursing care service provision system, proposals are made based only on the user's basic information, which can sometimes lack consideration for the individual's feelings and emotions. Furthermore, the procedures for applying for proposed nursing care services and subsidies are complicated, often placing a mental burden on users as they go through the procedures. Furthermore, the lack of smooth information sharing with care managers is also a factor that hinders the creation of appropriate nursing care plans. A system that can solve these problems and provide support that is more attuned to users is needed.
[0974] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0975] In this invention, the server includes means for interactively inputting the user's basic information and emotional state, means for proposing available nursing care services and subsidies based on the basic information and emotional state, means for providing detailed instructions on how to obtain the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with an administrator, means for periodically checking the user's nursing care status and proposing new required nursing care services or subsidies, and means for analyzing the user's emotional state and adjusting the priority of the suggestions and the method of explaining the procedures. This makes it possible to provide appropriate nursing care services and subsidies and instructions on how to obtain them, taking the user's emotions into consideration, thereby reducing their mental burden.
[0976] "Basic information" refers to basic data such as the user's personal information, care level, and annual income.
[0977] "Emotional state" refers to the psychological state or mood analyzed from the user's input.
[0978] The "interactive format" is a format in which questions are presented sequentially in response to user input and responses are obtained from the user.
[0979] "Care services" are services that provide care support and assistance, such as day care services and home care.
[0980] "Subsidies" refer to financial support related to nursing care provided by the government or local governments.
[0981] "Procedures" refers to the steps required to use nursing care services and subsidies, such as the documents and application methods.
[0982] "Administrator" refers to a professional who is responsible for planning and coordinating the user's care plan, such as a care manager.
[0983] "Suggestion priority" refers to the display order of a list of care services and subsidies that is generated based on the user's emotional state and basic information.
[0984] An "emotion engine" is an algorithm or software that recognizes and analyzes emotions from a user's voice or text.
[0985] The "server" is a remote computer system that receives and analyzes data sent from user devices and provides appropriate nursing care services and subsidy information.
[0986] This system interactively acquires a user's basic information and emotional state, and then uses that information to suggest appropriate nursing care services and subsidies, providing guidance on specific procedures. Furthermore, by incorporating an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, an administrator terminal, and an emotion engine.
[0987] System configuration
[0988] User device: A device with a conversational interface that provides a means for users to input basic information and emotions. This can be a smartphone, tablet, or other device with an application that allows users to input voice or text.
[0989] Server: Analyzes the user's basic and emotional information and proposes appropriate care services and subsidies. The server communicates with the database and includes a back-end system that searches, analyzes, and generates information. This is often done using a cloud server environment such as AWS or Google Cloud.
[0990] Administrator device: This receives necessary information and provides a means for administrators to plan and adjust care plans. This is a device such as a computer or tablet used by care managers and other professionals.
[0991] Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions. The emotion engine is implemented using NLP (natural language processing) algorithms and AI models (such as OpenAI's GPT-3).
[0992] Specific examples
[0993] When a user launches the app and taps the "Start" button on the screen, the system begins to acquire the user's basic information and emotional state. The device displays a dialogue interface and prompts the user as follows:
[0994] "Please tell me your care level. For example, care level 3."
[0995] When the user enters "Care Level 3," the emotion engine recognizes the emotion from the user's input and sends the result to the server. The device then displays a prompt saying, "Please tell us your annual income. For example, 3 million yen." The user then enters "3 million yen" and sends it.
[0996] The server analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Furthermore, it changes the priority of suggestions based on the emotional information from the emotion engine. For example, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated and sent to the user's device.
[0997] When a user selects a desired service from the list of suggestions displayed on the device, the device requests the server for specific procedural instructions for the selected service. The server generates detailed procedural instructions for the selected service, including the necessary documents and application methods, and sends them to the user's device. The emotion engine adjusts the explanation method based on the user's emotional state, allowing the user to proceed with the procedure without stress.
[0998] Furthermore, if the user wishes, this information can be shared with the administrator, who can then adjust the care plan based on the received information. The system will periodically check the user's care status and send reminders to provide new suggestions and emotional care information.
[0999] The above is a specific embodiment for carrying out the present invention.
[1000] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1001] Step 1:
[1002] The user launches the app and taps the "Start" button. This input causes the system to start the process of obtaining user information, and displays the following interface.
[1003] Step 2:
[1004] The terminal displays a dialogue interface to the user, prompting them to "Please tell us your nursing care level." The user enters "Needs nursing care level 3." This text data is sent to the emotion engine, which performs text analysis and sends the emotional state to the server.
[1005] Step 3:
[1006] The emotion engine receives the user's input data, applies natural language processing (NLP) algorithms to analyze the emotion, and determines that the user is "tired" and sends the emotional state in JSON format to the server.
[1007] Step 4:
[1008] The device displays the following prompt: "Please tell us your annual income," and the user enters "3 million yen." The entered data is then sent to the emotion engine again for an attempt at emotion analysis.
[1009] Step 5:
[1010] The device compiles the input data and the analysis results of the emotion engine and sends them to the server via an HTTP POST request. The data includes the user's basic information (care level, annual income) and emotion information (tired).
[1011] Step 6:
[1012] The server analyzes the received basic information and emotion information. First, it accesses the database to obtain the appropriate data set (care services, subsidy information, etc.).
[1013] Step 7:
[1014] The server uses an analytical algorithm to search the database for appropriate nursing care services and subsidies, and then changes the priority of the suggestions based on the emotion information obtained from the emotion engine to generate a list of suggestions.
[1015] Step 8:
[1016] The server generates a list of suggestions such as "day service," "home care," and "long-term care insurance benefits" in JSON format and sends it to the user's device.
[1017] Step 9:
[1018] The terminal displays the received proposal list on the interface. When the user selects a desired service from the proposal list, the selection information is sent back to the server.
[1019] Step 10:
[1020] The terminal requests the server for specific procedure instructions corresponding to the selected service, and the server generates detailed procedure information such as required documents and application methods and sends it to the user terminal.
[1021] Step 11:
[1022] The server adjusts how it explains the procedure based on the user's emotional state. For example, if the user is determined to be "tired," it adjusts the explanation to be briefer.
[1023] Step 12:
[1024] The terminal displays detailed procedure instructions to the user, and if the user wishes, sends instructions to the server again to share this procedure information with the administrator.
[1025] Step 13:
[1026] The server generates the information again and sends a notification to the administrator, who can then adjust the care plan based on the received information.
[1027] Step 14:
[1028] The server periodically generates reminders and sends information to the user's device to provide improvement suggestions and emotional care.
[1029] Step 15:
[1030] The device periodically prompts the user, "How is your care situation going lately?" and sends the answer to the server.
[1031] (Application example 2)
[1032] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1033] Improving worker safety and work efficiency is important in factories, and it is particularly important to understand workers' emotional states in real time and provide appropriate work instructions and break suggestions. However, conventional methods have had difficulty accurately understanding workers' emotional states and providing quick and appropriate suggestions. This not only makes it difficult to prevent worker fatigue and stress, but also leads to problems such as reduced work efficiency and safety. Therefore, there is a need for a system that can obtain basic information and emotional states of workers in real time and provide optimal work instructions and break suggestions based on that information.
[1034] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1035] In this invention, the server includes means for interactively inputting basic information of a user, means for providing possible work instructions and break suggestions based on the basic information, means for providing detailed instructions for the proposed work instructions or break suggestions, means for transmitting the basic information and emotional information to the server and generating suggestions, means for recognizing the emotional state and optimizing the suggestions, and means for periodically checking the user's work situation and emotional state and regenerating necessary work instructions and break suggestions. This makes it possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[1036] Definition of Terms
[1037] "Basic user information" is data including the worker's name, work, job title, and other personal information.
[1038] The "server" is a central computing device that processes the user's basic information and emotional information and generates appropriate work instructions and break suggestions.
[1039] "Interactive" means that the user communicates with the system and inputs information via text or voice.
[1040] "Work instructions" are proposals that include specific instructions and advice necessary for workers to efficiently carry out their work.
[1041] "Break suggestions" are suggestions that provide appropriate break times and relaxation methods to reduce worker fatigue and stress.
[1042] "Detailed procedures" are information that indicates specific implementation procedures and safety measures for proposed work instructions and break suggestions.
[1043] "Emotion information" is data on the emotional state of a worker obtained by analyzing the worker's voice and facial expression data.
[1044] "Emotional state" is information that indicates the worker's current psychological and emotional state.
[1045] "Optimization means" refers to methods or algorithms that adjust the priority and content of proposals based on emotional information.
[1046] "Work status" is information indicating the current work content of the worker and its progress.
[1047] MODE FOR CARRYING OUT THE INVENTION
[1048] This invention provides a system for improving worker safety and efficiency at a factory site. This system is composed of a user terminal for executing a program, a server, an emotion engine, and a factory robot that works in conjunction with the user terminal. A specific embodiment of this system is described below.
[1049] System configuration
[1050] 1. User Device:
[1051] Provide a means for workers to enter basic information (such as name and job description).
[1052] It has an interface for sending voice and facial expression data to the emotion engine.
[1053] 2. Server:
[1054] Receive and analyze basic information and emotional information of the user.
[1055] Appropriate work instructions and break suggestions are generated and sent to the user's device.
[1056] 3. Care manager terminal:
[1057] Receives necessary information and provides a means for management (e.g., supervisor) to plan and adjust the plan of care.
[1058] 4. Emotion Engine:
[1059] It recognizes emotions from the user's voice or text input and sends the results to the server.
[1060] Program processing flow
[1061] The program is executed as follows:
[1062] 1. Enter basic information:
[1063] The user starts up the user device and taps the "Start" button.
[1064] The terminal will prompt you to enter basic information about the worker.
[1065] 2. Emotion recognition:
[1066] It receives information input by the user via voice or text and sends it to the emotion engine.
[1067] The emotion engine analyzes the emotional state and sends the results to the server.
[1068] 3. Transmission of information to the server and analysis:
[1069] The device sends the input basic information and emotion information to the server.
[1070] The server generates appropriate work instructions and break suggestions based on the received basic information and emotion information.
[1071] 4. Proposal generation and display:
[1072] The server generates suggestions such as "relaxation methods" and "safety measures" and sends them to the user's device.
[1073] The terminal displays the generated proposals to the worker in an interactive format.
[1074] 5. Regularly review and resubmit proposals:
[1075] The server periodically generates reminders and sends them to the device.
[1076] The device prompts the user, "How's your work going lately?"
[1077] Once the user enters their answers, the server generates new suggestions based on that information.
[1078] Specific examples
[1079] For example, if a worker says "I'm tired" to the robot, the emotion engine analyzes it and detects the fatigue. The server immediately suggests a five-minute break, and the suggestion is displayed on the robot's screen. If the worker takes the break as suggested, fatigue will be reduced.
[1080] Prompt Sentence Examples
[1081] "Generate code for a conversational robot application that detects specific emotions (e.g., 'tired' or 'anxious') and offers appropriate breaks or mental health advice to workers."
[1082] This makes it possible to quickly provide optimal work instructions and break suggestions based on the worker's emotional state, improving safety and efficiency.
[1083] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1084] Program processing steps
[1085] Step 1: Enter basic information
[1086] The user starts the user device and taps the "Start" button. The device displays a prompt to enter basic information about the worker (such as name and work content). Once the user has completed the input, the device saves the information.
[1087] Input: Worker name, work content
[1088] Output: Basic information saved
[1089] Step 2: Start Recognizing Emotions
[1090] The terminal provides an interface for receiving a user's voice or text input and acquires emotion information in real time. The user inputs information by voice or text.
[1091] Input: Audio data, text data
[1092] Output: Emotional information
[1093] Step 3: Emotional information analysis
[1094] The emotion engine analyzes the received voice or text data to recognize the user's emotional state, and the analysis results are sent to the server as emotion information.
[1095] Input: Audio data, text data
[1096] Data processing: natural language processing, sentiment analysis
[1097] Output: Emotional information
[1098] Step 4: Send basic information and emotional information to the server
[1099] The device sends the user's basic information and emotional information to the server, which receives it and stores it in a database.
[1100] Input: Basic information, emotional information
[1101] Output: Data stored on the server
[1102] Step 5: Work order and break proposal generation
[1103] The server generates appropriate work instructions and break suggestions based on the stored basic information and emotion information, and sends the suggestions to the user's device.
[1104] Input: Basic information, emotional information
[1105] Data calculation: Algorithm for generating work instructions and break suggestions
[1106] Output: Work instructions, break suggestions
[1107] Step 6: Viewing Proposals
[1108] The terminal receives work instructions and break suggestions from the server and displays them to the user in an interactive format, allowing the user to decide their next action based on the information.
[1109] Input: Work Order, Break Proposal
[1110] Output: The displayed suggestions
[1111] Step 7: Regular check-ins
[1112] The server periodically generates reminders and sends them to the user's terminal, which then displays a prompt to the user asking, "How is your work going recently?"
[1113] input: -
[1114] Output: Reminder notification
[1115] Step 8: User feedback and re-suggestions
[1116] The user enters answers to the prompts and sends them to the terminal, which sends the information to the server, which generates new suggestions, which are then sent back to the user terminal.
[1117] Input: Feedback information
[1118] Data operations: feedback analysis, re-proposal generation
[1119] Output: New proposal
[1120] Through the above steps, it is possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[1121] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1122] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1123] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1124] [Third embodiment]
[1125] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1126] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1127] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1128] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1129] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1130] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1131] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1132] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1133] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1134] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1135] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1136] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1137] This invention relates to an interactive application system that facilitates access to nursing care services and subsidies. This system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, it shares information with a care manager as needed, periodically checks the user's care status, and provides additional suggestions and mental care as needed.
[1138] System configuration
[1139] This system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to input basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[1140] Program processing flow
[1141] The program of this system mainly performs the following five functions.
[1142] 1. Enter user information
[1143] User: Launches the app and taps the "Start" button.
[1144] Terminal: Displays interactive question prompts including care grade and income information.
[1145] User: Enter answers to the questions, such as "Level 3 nursing care required" or "3 million yen," and submit.
[1146] Terminal: Sends the entered information to the server.
[1147] 2. Information on services and grants
[1148] Server: Analyzes the collected user information and suggests appropriate nursing care services and subsidies from the database.
[1149] Server: Generates lists such as "day care services," "home care," and "long-term care insurance benefits," and sends them to the terminal.
[1150] On the device: Show the user a list of suggestions.
[1151] 3. Select the service you want to use
[1152] User: Select the service they want to use from the list of suggestions.
[1153] Terminal: Requests specific procedural instructions for the selected service from the server.
[1154] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[1155] Terminal: Displays procedural instructions to the user.
[1156] 4. Sharing information with care managers
[1157] User: Select information sharing and instruct the transmission of the required information.
[1158] Terminal: Sends a transmission instruction to the server.
[1159] Server: Generates the necessary information for the care manager and sends notifications.
[1160] Care manager: Checks the received information and takes necessary action.
[1161] 5. Regular status checks and advice
[1162] Server: Generates periodic reminders and sends status check notifications to users.
[1163] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[1164] User: Enter answers about care situation and submit.
[1165] Terminal: Sends the answer to the server.
[1166] Server: Generates proposals for additional services and grants based on new information, and generates advice and mental health information.
[1167] Device: Show new suggestions and advice to the user.
[1168] Specific examples
[1169] For example, when a user starts the app and enters their care level of "Care Level 3" and annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" and confirms the specific procedures (required documents, application method, etc.). They then issue instructions to share the information with a care manager, and the server sends a notification to the care manager. Then, if the user periodically enters and sends the situation, such as "I've been working more at night recently," the server generates additional suggestions such as "nighttime home care," and provides necessary advice and mental care information.
[1170] In this way, the present invention provides a system that can support caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[1171] The processing flow will be explained below.
[1172] Step 1:
[1173] Enter user information
[1174] User: Launches the app and taps the "Start" button.
[1175] Terminal: Presents the user with an interactive interface and prompts them, "What is your care level?"
[1176] User: Enter "Care Level 3" and submit.
[1177] Terminal: Prompt "What is your annual income?"
[1178] User: Enters "3 million yen" and submits.
[1179] Terminal: Temporarily stores the entered information and sends it to the server.
[1180] Step 2:
[1181] Processing and analyzing user information
[1182] Server: Analyzes the received user's care level and income data.
[1183] Server: Searches for applicable nursing care services and subsidies using its own database.
[1184] Step 3:
[1185] Service and Grant Proposals
[1186] Server: Based on the search results, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated.
[1187] Server: Sends the generated proposal list to the device.
[1188] Terminal: Display the list to the user.
[1189] Step 4:
[1190] Select the service you want to use
[1191] User: Select "Day Care" from the list of proposed care services and grants.
[1192] Terminal: Requests information about the selected service from the server.
[1193] Step 5:
[1194] Procedural instructions
[1195] Server: Generates specific procedural instructions, such as the necessary documents and application methods for the selected "day service."
[1196] Server: Sends the generated procedure information to the terminal.
[1197] Terminal: Display procedural instructions to the user.
[1198] Step 6:
[1199] Sharing information with care managers
[1200] User: Selects information sharing and instructs transmission.
[1201] Terminal: Sends a transmission instruction to the server.
[1202] Server: Generates the necessary information for the care manager and sends notifications.
[1203] Care manager: Checks the received information and takes necessary action.
[1204] Step 7:
[1205] Regular status checks
[1206] Server: Generates reminder notifications periodically and sends them to the device.
[1207] Device: Prompt the user with "How is your caregiving situation going these days?"
[1208] Step 8:
[1209] Additional answers and suggestions
[1210] User: Regarding the care situation, enter "Recently, there has been an increase in nighttime care" and submit.
[1211] Terminal: Sends the transmitted information to the server.
[1212] Server: Searches for additional care services and grants based on new information received.
[1213] Server: Sends the generated new proposal to the device.
[1214] On-device: Displays new suggestions to users and provides necessary advice and mental health information.
[1215] Example 1
[1216] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1217] The present invention aims to solve the problem that many users are unable to receive appropriate support due to the complicated procedures involved in using nursing care services and subsidies. In particular, there is a need to reduce the burden on users and enable them to receive appropriate support by consistently providing information on available services and subsidies, guidance on specific procedures, and regular status checks and advice.
[1218] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1219] In this invention, the server includes: means for interactively inputting basic information about a user; means for proposing available nursing care services and subsidies based on the basic information; means for providing detailed instructions for obtaining the proposed nursing care services or subsidies; means for sharing information necessary for using the nursing care services with an administrator; means for periodically checking the user's nursing care status and proposing newly required nursing care services or subsidies; means for transmitting the basic information to the server; means for the server to generate a proposal list of appropriate nursing care services and subsidies from the collected information and transmit it to a user terminal; means for the user to select a service from the proposal list and transmit the selected information to the server; means for the server to generate a procedure for the selected service and transmit it to the user terminal and display it; and means for generating additional proposals and advice based on the information collected through the periodic checks and displaying it to the user. This allows users to easily apply for nursing care services and subsidies, and to receive appropriate support while receiving necessary advice and regular status checks.
[1220] "Basic user information" refers to information about the individual user, including information such as care level and income.
[1221] "Dialogue" refers to the way in which a user interacts with a system, proceeding in a question-and-answer format.
[1222] "Care services" refer to various support services provided to people who need care, including day care services and home care services.
[1223] "Subsidies" are financial support provided when using nursing care services, and include nursing care insurance benefits.
[1224] The "Proposal List" is a list of nursing care services and subsidy options that can be provided based on the user's basic information.
[1225] "Procedures" refer to the specific procedures required to use the proposed nursing care services and subsidies, including the preparation of documents and application methods.
[1226] "Sharing information with the administrator" means notifying the administrator of the information necessary for the user to use nursing care services and sharing the information.
[1227] "Regular status checks" means checking the user's care status at regular intervals and providing additional service suggestions and advice.
[1228] The "server" is a remote computer system that analyzes the information sent by the user and generates a list of appropriate nursing care services and subsidy proposals.
[1229] A "user terminal" is an information and communication device used by a user, such as a computer, tablet, or smartphone.
[1230] This invention is an interactive application system that facilitates access to nursing care services and subsidies. The system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, the system shares information with an administrator as needed, periodically checks the user's nursing care status, and provides additional suggestions and mental health care as needed.
[1231] System configuration
[1232] This system mainly consists of a user terminal, a server, and an administrator terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. In addition, the necessary information is shared with the administrator terminal, making it easier for the administrator to respond.
[1233] Hardware and software used
[1234] Server: Generation of service proposals and procedural steps, database management. Specific software used for this purpose includes database management systems (MySQL, PostgreSQL), a dialog management system, and a periodic notification system.
[1235] User device: A device such as a smartphone or tablet on which application software (iOS, Android app) is installed.
[1236] Administrator device: A computer or tablet used by an administrator.
[1237] Program processing flow
[1238] The system is programmed in the following way: When a user launches the app and enters their care level of "care required 3" and their annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" from this list of suggestions and checks the specific procedures (required documents, application method, etc.). The user then issues an instruction to share the information with the administrator, and the server sends a notification to the administrator's device. The user periodically enters and submits the situation, such as "We've been seeing an increase in night-time appointments recently," and the server generates additional suggestions such as "night-time home care," and provides necessary advice and mental health care information.
[1239] Examples of prompt statements
[1240] Please use the information below to suggest appropriate care services and subsidies.
[1241] Nursing care level: Nursing care level 3
[1242] Annual income: 3 million yen
[1243] Also, please provide specific procedural steps and information on required documents.
[1244] As described above, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[1245] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1246] Step 1: Launch and start the app
[1247] User: Tap the app on the smartphone home screen to launch it. Tap the "Start" button to begin using the system.
[1248] Input: Launching the app and tapping the "Start" button.
[1249] Output: A screen displaying the interactive questions.
[1250] What it does: The app displays an interactive prompt on the user's screen saying, "Please enter your care level and income information."
[1251] Step 2: Display interactive questions
[1252] On the device: The app displays interactive question prompts on the user's screen, asking for information such as care level (e.g., "Care Level 3") and income information (e.g., "3 million yen").
[1253] Input: The question the app will ask.
[1254] Output: The question is displayed on the user's screen.
[1255] Specific Behavior: The system provides multiple choice or open-ended fields to facilitate user input.
[1256] Step 3: User answers and submits
[1257] User: Enter information such as "Level 3 nursing care required" or "3 million yen" in response to the questions, and tap the "Submit" button.
[1258] Input: User-entered care grade and income information.
[1259] Output: The input data is sent to the server.
[1260] Specific operation: The app sends the entered data to the server in real time.
[1261] Step 4: Send the input information to the server
[1262] Terminal: Sends the entered information to the server in real time.
[1263] Input: The information the user entered and tapped the submit button.
[1264] Output: Basic information of the user received by the server.
[1265] Specific operation: The server temporarily stores the received information and prepares it for analysis.
[1266] Step 5: Analyze user information
[1267] Server: Analyzes the entered user information and collates relevant information from the database.
[1268] Input: Basic information of the recipient.
[1269] Output: A list of optimal care services and subsidy proposals.
[1270] Specific operation: The server searches and collates relevant nursing care services and subsidy data in the database based on nursing care grade and income information.
[1271] Step 6: Generate a list of suggestions
[1272] Server: Based on the analysis results, it generates a list of proposals for appropriate nursing care services and subsidies, such as "day care," "home care," and "long-term care insurance benefits."
[1273] Input: Relevant information retrieved from the database.
[1274] Output: A list of suggestions.
[1275] What happens: The server compiles a list of eligible services and grants and converts it into a displayable data format.
[1276] Step 7: Send the list to the user's device
[1277] Server: Sends the proposal list to the user device.
[1278] Input: Suggestion list.
[1279] Output: The suggestion list displayed on the user's device.
[1280] Specific operation: The server uses a communication protocol to send the generated proposal list to the user's device.
[1281] Step 8: View the list
[1282] On the device: The received list of suggestions is displayed in a user-friendly format.
[1283] Input: The proposal list sent by the server.
[1284] Output: The suggestion list displayed on the user screen.
[1285] What it does: The app displays a list of suggestions in a user interface designed to make it easy for the user to select.
[1286] Step 9: Select the proposed service
[1287] User: Select the service they want to use from the list of suggestions.
[1288] Input: The service selected by the user.
[1289] Output: The information about the selected service is sent to the server.
[1290] Specific behavior: The user taps one service from the list and the selection is sent to the server.
[1291] Step 10: Request Procedural Instructions
[1292] Terminal: Requests specific procedural instructions for the selected service from the server.
[1293] Input: Selected service information.
[1294] Output: Request data sent to server.
[1295] What happens: The app sends a request to the server for procedural instructions for the selected service.
[1296] Step 11: Generate procedural steps
[1297] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[1298] Input: The requested service information.
[1299] Output: Detailed information about the procedure steps.
[1300] Specific operations: The server generates the necessary documents and procedures for the selected service and prepares the data to be sent to the user's terminal.
[1301] Step 12: View procedural steps
[1302] Terminal: Displays the necessary information to the user for the procedure.
[1303] Input: Procedural step information sent from the server.
[1304] Output: The procedural steps that are displayed to the user.
[1305] Specific Actions: The app displays the received procedural information in the user interface, helping the user understand the specific next steps.
[1306] Step 13: Information Sharing Options
[1307] User: Makes information sharing choices and directs the transmission of desired information.
[1308] Input: Information sharing selection operation.
[1309] Output: The shared information is sent to the server.
[1310] Specific operation: The user taps the "Share Information" button, sending an instruction to share information to the server.
[1311] Step 14: Sending instructions to the server
[1312] Device: Sends instructions to share information to the server.
[1313] Input: Information sharing selection data.
[1314] Output: Information sharing instructions sent to the server.
[1315] Specific operation: The app prepares the information sharing instruction data and sends it to the server.
[1316] Step 15: Notify administrators
[1317] Server: Generates the information required by the administrator and sends notifications to the administrator's terminal.
[1318] Input: Information sharing instruction data.
[1319] Output: Administrator notification data.
[1320] Specific operation: The server generates notification data and sends it to the administrator terminal.
[1321] Step 16: Check the required information and take action
[1322] Administrator: Review the received information and take appropriate action.
[1323] Input: Administrator notification data sent from the server.
[1324] Output: Administrator response results.
[1325] Specific actions: The administrator checks the notification received in the system and responds to the user based on the required information.
[1326] Step 17: Generate recurring reminders
[1327] Server: Generates periodic reminders and sends status check notifications to users.
[1328] Input: Recurring schedule data.
[1329] Output: Reminder notification to the user.
[1330] Specific operation: The server generates a reminder notification based on the schedule and sends it to the user's device.
[1331] Step 18: Status Check Notification
[1332] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[1333] Input: Reminder notification data sent from the server.
[1334] Output: A challenge question that is displayed to the user.
[1335] What it does: The app prompts the user with a status check question based on the reminder notification.
[1336] Step 19: Enter and submit your situational response
[1337] User: Enter answers about care situation and submit.
[1338] Input: The situational answer data entered by the user.
[1339] Output: The status response data sent to the server.
[1340] Specific behavior: The user enters an answer about the situation and taps the "Submit" button, which sends the data to the server.
[1341] Step 20: Generate and display additional suggestions and advice
[1342] Server: Generates proposals for additional care services and subsidies based on new information, and generates advice and mental health care information.
[1343] Input: User situation answer data.
[1344] Output: Additional suggestions and advice data.
[1345] Specific operation: The server analyzes the received situation data, generates new suggestions and advice, and sends them to the user's device.
[1346] Device: Show new suggestions and advice to the user.
[1347] Input: Additional suggestion and advice data sent by the server.
[1348] Output: Additional suggestions and advice displayed on the user screen.
[1349] What it does: The app displays additional service suggestions and advice in the user interface.
[1350] (Application example 1)
[1351] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1352] In recent years, while support for the elderly and those who require nursing care has become increasingly important, obtaining information on nursing care services and subsidies, procedures, and daily meal management have become complex issues. In particular, arranging daily meals requires appropriate nutritional management and accommodating dietary restrictions, which creates a significant burden. There is a need to solve these issues all at once.
[1353] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1354] In this invention, the server includes means for interactively inputting basic information about the user, means for proposing available nursing care services and subsidies based on the basic information, means for providing detailed instructions on procedures for the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with a care manager, means for periodically checking the user's nursing care status and proposing new necessary nursing care services or subsidies, means for proposing meals that correspond to the user's nutritional management and dietary restrictions, and means for ordering specific meals and sharing the order status with the care manager. This not only allows users to easily access nursing care services and subsidies, but also allows them to manage their meals, thereby improving the quality of their daily lives.
[1355] "Basic user information" refers to personal data such as the user's age, care level, income information, and information regarding nutritional management.
[1356] "Interactive input means" means a system in which a user inputs information via a smartphone or computer by following on-screen prompts.
[1357] "Care services" refer to services such as day care, home care, and night-time home care provided to the elderly and people who need care.
[1358] A "subsidy" is financial assistance provided to users who meet certain conditions.
[1359] "Means for providing detailed procedural guidance" refers to a system that displays how users prepare and apply for the documents necessary to use nursing care services and subsidies.
[1360] A "care manager" is a professional who provides and coordinates nursing care services.
[1361] The "means of periodically checking the user's care status" is a system that periodically asks the user questions about their care status and collects their responses.
[1362] The "means of proposing new necessary nursing care services and subsidies" is a system that proposes new nursing care services and subsidies based on the latest collected user information.
[1363] "Nutritional management and dietary restrictions" refers to management that restricts certain nutrients and food ingredients based on the user's health condition or doctor's instructions.
[1364] The "means for making meal suggestions" is a system that suggests appropriate meal menus that correspond to the user's nutritional management and dietary restrictions.
[1365] A "means for ordering a specific meal" is a mechanism by which a user selects from a suggested menu of meals and orders a meal.
[1366] "Means for sharing with care managers" refers to a system that sends and shares information entered by users and data regarding ordered meals with care managers.
[1367] The present invention relates to an interactive application system that allows elderly people and those in need of care to easily access care services and subsidies. This system allows users to suggest and order meals and share care information to improve the quality of their daily lives.
[1368] System Overview
[1369] The system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and check suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[1370] Program processing overview
[1371] The server is built using Flask, a lightweight Python web framework, and collects and processes user information as follows:
[1372] 1. Enter your basic information
[1373] First, the user launches the smartphone application and taps the "Start" button. The device then displays an interactive question prompt, prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[1374] 2. Proposals for nursing care services and subsidies
[1375] The server analyzes the information sent by the user and suggests appropriate nursing care services and subsidies from a database. The proposal list includes information on day care, home care, nursing care insurance benefits, low-sodium diets, etc.
[1376] 3. Meal suggestions and ordering
[1377] The server will provide specific meal suggestions to users who have entered information about their nutritional management and dietary restrictions. The meal suggestions will display menu items (e.g., "cheese sandwich," "apple," etc.) that correspond to the user's health condition. The user can select a meal from these suggestions and confirm their order.
[1378] 4. Information sharing and status check
[1379] If necessary, the server shares information with the care manager. The server sends information about the user's care situation and dietary choices to the care manager, who then takes appropriate action based on this information. The server also periodically sends the user questions about their care situation and dietary management, and makes new suggestions and advice based on the answers.
[1380] Hardware and software used
[1381] Hardware: Smartphones, computers
[1382] Software: Flask (a lightweight Python web framework), database (e.g., SQLite)
[1383] Specific examples
[1384] For example, if a user starts the app, selects their age as 68, and selects a low-sodium diet as their dietary restriction, the server will suggest meals such as "cheese sandwich" or "apple." If the user orders a "cheese sandwich," that information is shared with the care manager, who can use this information to provide additional advice based on the user's health condition.
[1385] Example prompts for generative AI models
[1386] "A user launches the app and enters their age of 68 and a low-sodium diet as a dietary restriction. Generate and display a list of appropriate meal suggestions."
[1387] In this way, the system helps users smoothly receive appropriate nursing care services and meal suggestions, thereby improving the quality of their daily lives.
[1388] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1389] Step 1:
[1390] The user launches the smartphone application and taps the "Start" button. The device then displays an interactive prompt prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[1391] Input: User taps
[1392] Output: Display the question prompt
[1393] What happens: The device displays the application's welcome screen and presents the user with a question prompt that includes fields for entering basic information.
[1394] Step 2:
[1395] The user follows the prompts, inputs information about age, care level, income, and nutritional management, and taps the send button. The device sends the input information to the server.
[1396] Input: Basic information entered by the user
[1397] Output: Basic information sent to the server
[1398] What it does: The device receives user input, converts it into JSON format, and sends it to the server as a POST request.
[1399] Step 3:
[1400] The server analyzes the transmitted user information and generates appropriate nursing care services, subsidies, and meal suggestions based on nutritional management from the database.
[1401] Input: Basic information sent to the server
[1402] Output: Nursing care services, grant proposal list, meal proposal list
[1403] Specific operation: The server analyzes the user information, extracts appropriate information from a pre-registered database based on that information, and generates a list of suggestions.
[1404] Step 4:
[1405] The terminal displays to the user the nursing care services, a list of subsidies, and a list of meal suggestions proposed by the server, and the user selects the services and meals they wish to use from the suggested list.
[1406] Input: A list of suggestions sent by the server
[1407] Output: The list of suggestions shown to the user
[1408] What it does: The device displays a list of suggestions on the screen and provides an interface for the user to review and make a selection.
[1409] Step 5:
[1410] The user selects a meal or care service from the list of suggestions, and confirms the order and detailed procedures. The terminal then sends the information to the server.
[1411] Input: The meal or service selected by the user
[1412] Output: Selections sent to the server
[1413] Specific operation: The device receives the user's selection, converts it into data to send to the server, and sends it as a POST request.
[1414] Step 6:
[1415] The server generates and transmits to the terminal specific procedural instructions and ordering information for the selected service and meal.
[1416] Input: User selection information
[1417] Output: Specific procedure instructions, order confirmation information
[1418] Specific operations: Based on the selection information received, the server generates the necessary procedure steps and order confirmation information and sends it to the terminal.
[1419] Step 7:
[1420] The terminal displays specific procedure instructions and order confirmation information sent from the server to the user.
[1421] Input: Procedural instructions and order confirmation information sent from the server
[1422] Output: Procedural instructions displayed to the user, order confirmation information
[1423] What it does: The terminal displays the order instructions and order confirmation on the screen for the user to review.
[1424] Step 8:
[1425] The server shares the user's information with the care manager as needed and periodically sends the user questions about their care situation and dietary management.
[1426] Input: User's latest information
[1427] Output: Information shared with care manager, questions sent to user
[1428] Specific operations: The server processes the user's information, sends the necessary data to the care manager, and also sends regular reminders and status check questions to the user.
[1429] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1430] This invention relates to a system that interactively acquires a user's basic information and emotional state, and based on that information, suggests appropriate nursing care services and subsidies, and guides them through specific procedures. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, a care manager terminal, and an emotion engine.
[1431] System configuration
[1432] This system mainly consists of the following components:
[1433] 1. User terminal: Equipped with a conversational interface, it provides a means for users to input basic information and emotions.
[1434] 2. Server: Analyzes the user's basic information and emotional information and suggests appropriate nursing care services and subsidies.
[1435] 3. Care Manager Terminal: Receives necessary information and provides a means for the care manager to plan and adjust the care plan.
[1436] 4. Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions.
[1437] Program processing flow
[1438] The program for this system is implemented in the following steps.
[1439] 1. User information input and emotion recognition
[1440] User: Launches the app and taps the "Start" button.
[1441] Terminal: Displays a conversational interface to the user, prompting them with "Please tell me your level of care." Sends the user's input speech and sentences to the emotion engine.
[1442] User: Enter "Care Level 3" and submit.
[1443] Emotion engine: Recognizes emotions from user input and sends the results to the server.
[1444] Terminal: Prompt "What is your annual income?"
[1445] User: Enters "3 million yen" and submits.
[1446] Terminal: Sends input information and emotion engine results to the server.
[1447] 2. Processing user and emotional information
[1448] Server: Analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Based on the emotional information from the emotion engine, the server changes the priority of the suggestions.
[1449] Server: Generates a list of suggestions such as "day care," "home care," and "long-term care insurance benefits."
[1450] Server: Sends the proposal list to the user device.
[1451] 3. Service and Grant Proposals
[1452] On the device: Show the user a list of suggestions.
[1453] User: Select the service they want to use from the list of suggestions.
[1454] 4. Procedural guidance and emotional response
[1455] Terminal: Requests the server for specific procedure instructions corresponding to the selected service.
[1456] Server: Generates specific procedural instructions such as required documents and application methods for the selected service.
[1457] Emotion engine: Prioritizes suggestions and explains procedures based on the user's emotional state.
[1458] Server: Sends the generated procedure information to the terminal.
[1459] Terminal: Display procedural instructions to the user.
[1460] 5. Sharing information with care managers
[1461] User: Selects information sharing and instructs transmission.
[1462] Terminal: Sends a transmission instruction to the server.
[1463] Server: Generates the necessary information for the care manager and sends notifications.
[1464] Care manager: Checks the received information and takes necessary action.
[1465] 6. Regular check-ins and emotional support
[1466] Server: Generates reminder notifications periodically and sends them to the device.
[1467] Device: Prompt the user with "How is your caregiving situation going these days?"
[1468] User: Enter answers about care situation and submit.
[1469] Terminal: Sends the answer to the server.
[1470] Server: Uses the new information to search for additional services and grants and generate proposals.
[1471] Emotion engine: Analyzes the user's emotional state and provides mental health care information as needed.
[1472] Server: Sends generated new suggestions and advice to the device.
[1473] Device: Show new suggestions and advice to the user.
[1474] Specific examples
[1475] For example, when a user starts the app and enters their care level of "care required 3" and annual income of "3 million yen," the emotion engine recognizes the user's emotional state and sends emotions such as "tired" and "anxiety" to the server. Based on this emotional information, the server generates a list of suggestions, prioritizing options such as "day care," "home care," and "long-term care insurance benefits." When the user selects "day care," specific procedures are displayed in an explanation that takes emotions into account. Furthermore, if necessary, information is shared with a care manager, who periodically checks the user's situation and provides new suggestions and mental care.
[1476] In this way, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers through emotional care.
[1477] The processing flow will be explained below.
[1478] Step 1:
[1479] User information input and emotion recognition
[1480] User: Launches the app and taps the "Start" button.
[1481] Terminal: Presents a conversational interface to the user, prompting them with "Please tell us your level of care." Sends the user's voice and text to the emotion engine.
[1482] User: Enter "Care Level 3" and submit.
[1483] Emotion engine: Analyzes emotions from user input and sends the results to the server.
[1484] Terminal: Followed by the prompt "What is your annual income?"
[1485] User: Enters "3 million yen" and submits.
[1486] Terminal: Sends the input information and the emotion engine's analysis results to the server.
[1487] Step 2:
[1488] User and sentiment analysis
[1489] Server: Analyzes the received basic information and emotional information, and searches the database for relevant nursing care services and subsidies.
[1490] Server: Refers to the results of sentiment analysis by the emotion engine and adjusts the priority of the suggestions.
[1491] Step 3:
[1492] Service and Grant Proposals
[1493] Server: Lists the searched nursing care services and subsidies in order of priority according to the results of the emotion engine.
[1494] Server: Sends the suggestion list to the device.
[1495] Terminal: Display the list to the user.
[1496] Step 4:
[1497] Select the service you want to use
[1498] User: Select "Day Care" from the list of proposed care services and grants.
[1499] Terminal: Requests information about the selected service from the server.
[1500] Step 5:
[1501] Procedural instructions
[1502] Server: Generates specific procedural steps for the selected "day service," such as the necessary documents and application procedures. It applies an explanation method that takes into account the analysis results of the emotion engine.
[1503] Server: Sends procedure information to the terminal.
[1504] Terminal: Display procedural instructions to the user.
[1505] Step 6:
[1506] Sharing information with care managers
[1507] User: Selects information sharing and instructs transmission.
[1508] Terminal: Sends a transmission instruction to the server.
[1509] Server: Generates the necessary information for the care manager and sends notifications.
[1510] Care manager: Checks the received information and takes necessary action.
[1511] Step 7:
[1512] Regular check-ins and emotional support
[1513] Server: Generates reminder notifications periodically and sends them to the device.
[1514] Device: Prompt the user with "How is your caregiving situation going these days?"
[1515] User: Enters the answer to the question about care situation, "Recently, there has been an increase in nighttime care," and submits.
[1516] Terminal: Sends the transmitted information to the server.
[1517] Server: Searches for additional nursing care services and subsidies based on the analysis results and generates proposals.
[1518] Emotion engine: Analyzes the user's emotional state and generates data to provide mental care and support information.
[1519] Server: Generates new suggestions and advice and sends them to the device.
[1520] Device: Show new suggestions and advice to the user.
[1521] Example 2
[1522] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1523] In the current nursing care service provision system, proposals are made based only on the user's basic information, which can sometimes lack consideration for the individual's feelings and emotions. Furthermore, the procedures for applying for proposed nursing care services and subsidies are complicated, often placing a mental burden on users as they go through the procedures. Furthermore, the lack of smooth information sharing with care managers is also a factor that hinders the creation of appropriate nursing care plans. A system that can solve these problems and provide support that is more attuned to users is needed.
[1524] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1525] In this invention, the server includes means for interactively inputting the user's basic information and emotional state, means for proposing available nursing care services and subsidies based on the basic information and emotional state, means for providing detailed instructions on how to obtain the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with an administrator, means for periodically checking the user's nursing care status and proposing new required nursing care services or subsidies, and means for analyzing the user's emotional state and adjusting the priority of the suggestions and the method of explaining the procedures. This makes it possible to provide appropriate nursing care services and subsidies and instructions on how to obtain them, taking the user's emotions into consideration, thereby reducing their mental burden.
[1526] "Basic information" refers to basic data such as the user's personal information, care level, and annual income.
[1527] "Emotional state" refers to the psychological state or mood analyzed from the user's input.
[1528] The "interactive format" is a format in which questions are presented sequentially in response to user input and responses are obtained from the user.
[1529] "Care services" are services that provide care support and assistance, such as day care services and home care.
[1530] "Subsidies" refer to financial support related to nursing care provided by the government or local governments.
[1531] "Procedures" refers to the steps required to use nursing care services and subsidies, such as the documents and application methods.
[1532] "Administrator" refers to a professional who is responsible for planning and coordinating the user's care plan, such as a care manager.
[1533] "Suggestion priority" refers to the display order of a list of care services and subsidies that is generated based on the user's emotional state and basic information.
[1534] An "emotion engine" is an algorithm or software that recognizes and analyzes emotions from a user's voice or text.
[1535] The "server" is a remote computer system that receives and analyzes data sent from user devices and provides appropriate nursing care services and subsidy information.
[1536] This system interactively acquires a user's basic information and emotional state, and then uses that information to suggest appropriate nursing care services and subsidies, providing guidance on specific procedures. Furthermore, by incorporating an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, an administrator terminal, and an emotion engine.
[1537] System configuration
[1538] User device: A device with a conversational interface that provides a means for users to input basic information and emotions. This can be a smartphone, tablet, or other device with an application that allows users to input voice or text.
[1539] Server: Analyzes the user's basic and emotional information and proposes appropriate care services and subsidies. The server communicates with the database and includes a back-end system that searches, analyzes, and generates information. This is often done using a cloud server environment such as AWS or Google Cloud.
[1540] Administrator device: This receives necessary information and provides a means for administrators to plan and adjust care plans. This is a device such as a computer or tablet used by care managers and other professionals.
[1541] Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions. The emotion engine is implemented using NLP (natural language processing) algorithms and AI models (such as OpenAI's GPT-3).
[1542] Specific examples
[1543] When a user launches the app and taps the "Start" button on the screen, the system begins to acquire the user's basic information and emotional state. The device displays a dialogue interface and prompts the user as follows:
[1544] "Please tell me your care level. For example, care level 3."
[1545] When the user enters "Care Level 3," the emotion engine recognizes the emotion from the user's input and sends the result to the server. The device then displays a prompt saying, "Please tell us your annual income. For example, 3 million yen." The user then enters "3 million yen" and sends it.
[1546] The server analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Furthermore, it changes the priority of suggestions based on the emotional information from the emotion engine. For example, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated and sent to the user's device.
[1547] When a user selects a desired service from the list of suggestions displayed on the device, the device requests the server for specific procedural instructions for the selected service. The server generates detailed procedural instructions for the selected service, including the necessary documents and application methods, and sends them to the user's device. The emotion engine adjusts the explanation method based on the user's emotional state, allowing the user to proceed with the procedure without stress.
[1548] Furthermore, if the user wishes, this information can be shared with the administrator, who can then adjust the care plan based on the received information. The system will periodically check the user's care status and send reminders to provide new suggestions and emotional care information.
[1549] The above is a specific embodiment for carrying out the present invention.
[1550] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1551] Step 1:
[1552] The user launches the app and taps the "Start" button. This input causes the system to start the process of obtaining user information, and displays the following interface.
[1553] Step 2:
[1554] The terminal displays a dialogue interface to the user, prompting them to "Please tell us your nursing care level." The user enters "Needs nursing care level 3." This text data is sent to the emotion engine, which performs text analysis and sends the emotional state to the server.
[1555] Step 3:
[1556] The emotion engine receives the user's input data, applies natural language processing (NLP) algorithms to analyze the emotion, and determines that the user is "tired" and sends the emotional state in JSON format to the server.
[1557] Step 4:
[1558] The device displays the following prompt: "Please tell us your annual income," and the user enters "3 million yen." The entered data is then sent to the emotion engine again for an attempt at emotion analysis.
[1559] Step 5:
[1560] The device compiles the input data and the analysis results of the emotion engine and sends them to the server via an HTTP POST request. The data includes the user's basic information (care level, annual income) and emotion information (tired).
[1561] Step 6:
[1562] The server analyzes the received basic information and emotion information. First, it accesses the database to obtain the appropriate data set (care services, subsidy information, etc.).
[1563] Step 7:
[1564] The server uses an analytical algorithm to search the database for appropriate nursing care services and subsidies, and then changes the priority of the suggestions based on the emotion information obtained from the emotion engine to generate a list of suggestions.
[1565] Step 8:
[1566] The server generates a list of suggestions such as "day service," "home care," and "long-term care insurance benefits" in JSON format and sends it to the user's device.
[1567] Step 9:
[1568] The terminal displays the received proposal list on the interface. When the user selects a desired service from the proposal list, the selection information is sent back to the server.
[1569] Step 10:
[1570] The terminal requests the server for specific procedure instructions corresponding to the selected service, and the server generates detailed procedure information such as required documents and application methods and sends it to the user terminal.
[1571] Step 11:
[1572] The server adjusts how it explains the procedure based on the user's emotional state. For example, if the user is determined to be "tired," it adjusts the explanation to be briefer.
[1573] Step 12:
[1574] The terminal displays detailed procedure instructions to the user, and if the user wishes, sends instructions to the server again to share this procedure information with the administrator.
[1575] Step 13:
[1576] The server generates the information again and sends a notification to the administrator, who can then adjust the care plan based on the received information.
[1577] Step 14:
[1578] The server periodically generates reminders and sends information to the user's device to provide improvement suggestions and emotional care.
[1579] Step 15:
[1580] The device periodically prompts the user, "How is your care situation going lately?" and sends the answer to the server.
[1581] (Application example 2)
[1582] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1583] Improving worker safety and work efficiency is important in factories, and it is particularly important to understand workers' emotional states in real time and provide appropriate work instructions and break suggestions. However, conventional methods have had difficulty accurately understanding workers' emotional states and providing quick and appropriate suggestions. This not only makes it difficult to prevent worker fatigue and stress, but also leads to problems such as reduced work efficiency and safety. Therefore, there is a need for a system that can obtain basic information and emotional states of workers in real time and provide optimal work instructions and break suggestions based on that information.
[1584] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1585] In this invention, the server includes means for interactively inputting basic information of a user, means for providing possible work instructions and break suggestions based on the basic information, means for providing detailed instructions for the proposed work instructions or break suggestions, means for transmitting the basic information and emotional information to the server and generating suggestions, means for recognizing the emotional state and optimizing the suggestions, and means for periodically checking the user's work situation and emotional state and regenerating necessary work instructions and break suggestions. This makes it possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[1586] Definition of Terms
[1587] "Basic user information" is data including the worker's name, work, job title, and other personal information.
[1588] The "server" is a central computing device that processes the user's basic information and emotional information and generates appropriate work instructions and break suggestions.
[1589] "Interactive" means that the user communicates with the system and inputs information via text or voice.
[1590] "Work instructions" are proposals that include specific instructions and advice necessary for workers to efficiently carry out their work.
[1591] "Break suggestions" are suggestions that provide appropriate break times and relaxation methods to reduce worker fatigue and stress.
[1592] "Detailed procedures" are information that indicates specific implementation procedures and safety measures for proposed work instructions and break suggestions.
[1593] "Emotion information" is data on the emotional state of a worker obtained by analyzing the worker's voice and facial expression data.
[1594] "Emotional state" is information that indicates the worker's current psychological and emotional state.
[1595] "Optimization means" refers to methods or algorithms that adjust the priority and content of proposals based on emotional information.
[1596] "Work status" is information indicating the current work content of the worker and its progress.
[1597] MODE FOR CARRYING OUT THE INVENTION
[1598] This invention provides a system for improving worker safety and efficiency at a factory site. This system is composed of a user terminal for executing a program, a server, an emotion engine, and a factory robot that works in conjunction with the user terminal. A specific embodiment of this system is described below.
[1599] System configuration
[1600] 1. User Device:
[1601] Provide a means for workers to enter basic information (such as name and job description).
[1602] It has an interface for sending voice and facial expression data to the emotion engine.
[1603] 2. Server:
[1604] Receive and analyze basic information and emotional information of the user.
[1605] Appropriate work instructions and break suggestions are generated and sent to the user's device.
[1606] 3. Care manager terminal:
[1607] Receives necessary information and provides a means for management (e.g., supervisor) to plan and adjust the plan of care.
[1608] 4. Emotion Engine:
[1609] It recognizes emotions from the user's voice or text input and sends the results to the server.
[1610] Program processing flow
[1611] The program is executed as follows:
[1612] 1. Enter basic information:
[1613] The user starts up the user device and taps the "Start" button.
[1614] The terminal will prompt you to enter basic information about the worker.
[1615] 2. Emotion recognition:
[1616] It receives information input by the user via voice or text and sends it to the emotion engine.
[1617] The emotion engine analyzes the emotional state and sends the results to the server.
[1618] 3. Transmission of information to the server and analysis:
[1619] The device sends the input basic information and emotion information to the server.
[1620] The server generates appropriate work instructions and break suggestions based on the received basic information and emotion information.
[1621] 4. Proposal generation and display:
[1622] The server generates suggestions such as "relaxation methods" and "safety measures" and sends them to the user's device.
[1623] The terminal displays the generated proposals to the worker in an interactive format.
[1624] 5. Regularly review and resubmit proposals:
[1625] The server periodically generates reminders and sends them to the device.
[1626] The device prompts the user, "How's your work going lately?"
[1627] Once the user enters their answers, the server generates new suggestions based on that information.
[1628] Specific examples
[1629] For example, if a worker says "I'm tired" to the robot, the emotion engine analyzes it and detects the fatigue. The server immediately suggests a five-minute break, and the suggestion is displayed on the robot's screen. If the worker takes the break as suggested, fatigue will be reduced.
[1630] Prompt Sentence Examples
[1631] "Generate code for a conversational robot application that detects specific emotions (e.g., 'tired' or 'anxious') and offers appropriate breaks or mental health advice to workers."
[1632] This makes it possible to quickly provide optimal work instructions and break suggestions based on the worker's emotional state, improving safety and efficiency.
[1633] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1634] Program processing steps
[1635] Step 1: Enter basic information
[1636] The user starts the user device and taps the "Start" button. The device displays a prompt to enter basic information about the worker (such as name and work content). Once the user has completed the input, the device saves the information.
[1637] Input: Worker name, work content
[1638] Output: Basic information saved
[1639] Step 2: Start Recognizing Emotions
[1640] The terminal provides an interface for receiving a user's voice or text input and acquires emotion information in real time. The user inputs information by voice or text.
[1641] Input: Audio data, text data
[1642] Output: Emotional information
[1643] Step 3: Emotional information analysis
[1644] The emotion engine analyzes the received voice or text data to recognize the user's emotional state, and the analysis results are sent to the server as emotion information.
[1645] Input: Audio data, text data
[1646] Data processing: natural language processing, sentiment analysis
[1647] Output: Emotional information
[1648] Step 4: Send basic information and emotional information to the server
[1649] The device sends the user's basic information and emotional information to the server, which receives it and stores it in a database.
[1650] Input: Basic information, emotional information
[1651] Output: Data stored on the server
[1652] Step 5: Work order and break proposal generation
[1653] The server generates appropriate work instructions and break suggestions based on the stored basic information and emotion information, and sends the suggestions to the user's device.
[1654] Input: Basic information, emotional information
[1655] Data calculation: Algorithm for generating work instructions and break suggestions
[1656] Output: Work instructions, break suggestions
[1657] Step 6: Viewing Proposals
[1658] The terminal receives work instructions and break suggestions from the server and displays them to the user in an interactive format, allowing the user to decide their next action based on the information.
[1659] Input: Work Order, Break Proposal
[1660] Output: The displayed suggestions
[1661] Step 7: Regular check-ins
[1662] The server periodically generates reminders and sends them to the user's terminal, which then displays a prompt to the user asking, "How is your work going recently?"
[1663] input: -
[1664] Output: Reminder notification
[1665] Step 8: User feedback and re-suggestions
[1666] The user enters answers to the prompts and sends them to the terminal, which sends the information to the server, which generates new suggestions, which are then sent back to the user terminal.
[1667] Input: Feedback information
[1668] Data operations: feedback analysis, re-proposal generation
[1669] Output: New proposal
[1670] Through the above steps, it is possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[1671] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1672] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1673] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1674] [Fourth embodiment]
[1675] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1676] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1677] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1678] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1679] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1680] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1681] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1682] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1683] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1684] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1685] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1686] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1687] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1688] This invention relates to an interactive application system that facilitates access to nursing care services and subsidies. This system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, it shares information with a care manager as needed, periodically checks the user's care status, and provides additional suggestions and mental care as needed.
[1689] System configuration
[1690] This system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to input basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[1691] Program processing flow
[1692] The program of this system mainly performs the following five functions.
[1693] 1. Enter user information
[1694] User: Launches the app and taps the "Start" button.
[1695] Terminal: Displays interactive question prompts including care grade and income information.
[1696] User: Enter answers to the questions, such as "Level 3 nursing care required" or "3 million yen," and submit.
[1697] Terminal: Sends the entered information to the server.
[1698] 2. Information on services and grants
[1699] Server: Analyzes the collected user information and suggests appropriate nursing care services and subsidies from the database.
[1700] Server: Generates lists such as "day care services," "home care," and "long-term care insurance benefits," and sends them to the terminal.
[1701] On the device: Show the user a list of suggestions.
[1702] 3. Select the service you want to use
[1703] User: Select the service they want to use from the list of suggestions.
[1704] Terminal: Requests specific procedural instructions for the selected service from the server.
[1705] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[1706] Terminal: Displays procedural instructions to the user.
[1707] 4. Sharing information with care managers
[1708] User: Select information sharing and instruct the transmission of the required information.
[1709] Terminal: Sends a transmission instruction to the server.
[1710] Server: Generates the necessary information for the care manager and sends notifications.
[1711] Care manager: Checks the received information and takes necessary action.
[1712] 5. Regular status checks and advice
[1713] Server: Generates periodic reminders and sends status check notifications to users.
[1714] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[1715] User: Enter answers about care situation and submit.
[1716] Terminal: Sends the answer to the server.
[1717] Server: Generates proposals for additional services and grants based on new information, and generates advice and mental health information.
[1718] Device: Show new suggestions and advice to the user.
[1719] Specific examples
[1720] For example, when a user starts the app and enters their care level of "Care Level 3" and annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" and confirms the specific procedures (required documents, application method, etc.). They then issue instructions to share the information with a care manager, and the server sends a notification to the care manager. Then, if the user periodically enters and sends the situation, such as "I've been working more at night recently," the server generates additional suggestions such as "nighttime home care," and provides necessary advice and mental care information.
[1721] In this way, the present invention provides a system that can support caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[1722] The processing flow will be explained below.
[1723] Step 1:
[1724] Enter user information
[1725] User: Launches the app and taps the "Start" button.
[1726] Terminal: Presents the user with an interactive interface and prompts them, "What is your care level?"
[1727] User: Enter "Care Level 3" and submit.
[1728] Terminal: Prompt "What is your annual income?"
[1729] User: Enters "3 million yen" and submits.
[1730] Terminal: Temporarily stores the entered information and sends it to the server.
[1731] Step 2:
[1732] Processing and analyzing user information
[1733] Server: Analyzes the received user's care level and income data.
[1734] Server: Searches for applicable nursing care services and subsidies using its own database.
[1735] Step 3:
[1736] Service and Grant Proposals
[1737] Server: Based on the search results, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated.
[1738] Server: Sends the generated proposal list to the device.
[1739] Terminal: Display the list to the user.
[1740] Step 4:
[1741] Select the service you want to use
[1742] User: Select "Day Care" from the list of proposed care services and grants.
[1743] Terminal: Requests information about the selected service from the server.
[1744] Step 5:
[1745] Procedural instructions
[1746] Server: Generates specific procedural instructions, such as the necessary documents and application methods for the selected "day service."
[1747] Server: Sends the generated procedure information to the terminal.
[1748] Terminal: Display procedural instructions to the user.
[1749] Step 6:
[1750] Sharing information with care managers
[1751] User: Selects information sharing and instructs transmission.
[1752] Terminal: Sends a transmission instruction to the server.
[1753] Server: Generates the necessary information for the care manager and sends notifications.
[1754] Care manager: Checks the received information and takes necessary action.
[1755] Step 7:
[1756] Regular status checks
[1757] Server: Generates reminder notifications periodically and sends them to the device.
[1758] Device: Prompt the user with "How is your caregiving situation going these days?"
[1759] Step 8:
[1760] Additional answers and suggestions
[1761] User: Regarding the care situation, enter "Recently, there has been an increase in nighttime care" and submit.
[1762] Terminal: Sends the transmitted information to the server.
[1763] Server: Searches for additional care services and grants based on new information received.
[1764] Server: Sends the generated new proposal to the device.
[1765] On-device: Displays new suggestions to users and provides necessary advice and mental health information.
[1766] Example 1
[1767] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1768] The present invention aims to solve the problem that many users are unable to receive appropriate support due to the complicated procedures involved in using nursing care services and subsidies. In particular, there is a need to reduce the burden on users and enable them to receive appropriate support by consistently providing information on available services and subsidies, guidance on specific procedures, and regular status checks and advice.
[1769] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1770] In this invention, the server includes: means for interactively inputting basic information about a user; means for proposing available nursing care services and subsidies based on the basic information; means for providing detailed instructions for obtaining the proposed nursing care services or subsidies; means for sharing information necessary for using the nursing care services with an administrator; means for periodically checking the user's nursing care status and proposing newly required nursing care services or subsidies; means for transmitting the basic information to the server; means for the server to generate a proposal list of appropriate nursing care services and subsidies from the collected information and transmit it to a user terminal; means for the user to select a service from the proposal list and transmit the selected information to the server; means for the server to generate a procedure for the selected service and transmit it to the user terminal and display it; and means for generating additional proposals and advice based on the information collected through the periodic checks and displaying it to the user. This allows users to easily apply for nursing care services and subsidies, and to receive appropriate support while receiving necessary advice and regular status checks.
[1771] "Basic user information" refers to information about the individual user, including information such as care level and income.
[1772] "Dialogue" refers to the way in which a user interacts with a system, proceeding in a question-and-answer format.
[1773] "Care services" refer to various support services provided to people who need care, including day care services and home care services.
[1774] "Subsidies" are financial support provided when using nursing care services, and include nursing care insurance benefits.
[1775] The "Proposal List" is a list of nursing care services and subsidy options that can be provided based on the user's basic information.
[1776] "Procedures" refer to the specific procedures required to use the proposed nursing care services and subsidies, including the preparation of documents and application methods.
[1777] "Sharing information with the administrator" means notifying the administrator of the information necessary for the user to use nursing care services and sharing the information.
[1778] "Regular status checks" means checking the user's care status at regular intervals and providing additional service suggestions and advice.
[1779] The "server" is a remote computer system that analyzes the information sent by the user and generates a list of appropriate nursing care services and subsidy proposals.
[1780] A "user terminal" is an information and communication device used by a user, such as a computer, tablet, or smartphone.
[1781] This invention is an interactive application system that facilitates access to nursing care services and subsidies. The system collects basic information about the user, proposes available nursing care services and subsidies based on that information, and guides users through specific procedures. Furthermore, the system shares information with an administrator as needed, periodically checks the user's nursing care status, and provides additional suggestions and mental health care as needed.
[1782] System configuration
[1783] This system mainly consists of a user terminal, a server, and an administrator terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and confirm suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. In addition, the necessary information is shared with the administrator terminal, making it easier for the administrator to respond.
[1784] Hardware and software used
[1785] Server: Generation of service proposals and procedural steps, database management. Specific software used for this purpose includes database management systems (MySQL, PostgreSQL), a dialog management system, and a periodic notification system.
[1786] User device: A device such as a smartphone or tablet on which application software (iOS, Android app) is installed.
[1787] Administrator device: A computer or tablet used by an administrator.
[1788] Program processing flow
[1789] The system is programmed in the following way: When a user launches the app and enters their care level of "care required 3" and their annual income of "3 million yen," the server generates a list of suggestions including "day care," "home care," and "long-term care insurance benefits." The user selects "day care" from this list of suggestions and checks the specific procedures (required documents, application method, etc.). The user then issues an instruction to share the information with the administrator, and the server sends a notification to the administrator's device. The user periodically enters and submits the situation, such as "We've been seeing an increase in night-time appointments recently," and the server generates additional suggestions such as "night-time home care," and provides necessary advice and mental health care information.
[1790] Examples of prompt statements
[1791] Please use the information below to suggest appropriate care services and subsidies.
[1792] Nursing care level: Nursing care level 3
[1793] Annual income: 3 million yen
[1794] Also, please provide specific procedural steps and information on required documents.
[1795] As described above, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers.
[1796] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1797] Step 1: Launch and start the app
[1798] User: Tap the app on the smartphone home screen to launch it. Tap the "Start" button to begin using the system.
[1799] Input: Launching the app and tapping the "Start" button.
[1800] Output: A screen displaying the interactive questions.
[1801] What it does: The app displays an interactive prompt on the user's screen saying, "Please enter your care level and income information."
[1802] Step 2: Display interactive questions
[1803] On the device: The app displays interactive question prompts on the user's screen, asking for information such as care level (e.g., "Care Level 3") and income information (e.g., "3 million yen").
[1804] Input: The question the app will ask.
[1805] Output: The question is displayed on the user's screen.
[1806] Specific Behavior: The system provides multiple choice or open-ended fields to facilitate user input.
[1807] Step 3: User answers and submits
[1808] User: Enter information such as "Level 3 nursing care required" or "3 million yen" in response to the questions, and tap the "Submit" button.
[1809] Input: User-entered care grade and income information.
[1810] Output: The input data is sent to the server.
[1811] Specific operation: The app sends the entered data to the server in real time.
[1812] Step 4: Send the input information to the server
[1813] Terminal: Sends the entered information to the server in real time.
[1814] Input: The information the user entered and tapped the submit button.
[1815] Output: Basic information of the user received by the server.
[1816] Specific operation: The server temporarily stores the received information and prepares it for analysis.
[1817] Step 5: Analyze user information
[1818] Server: Analyzes the entered user information and collates relevant information from the database.
[1819] Input: Basic information of the recipient.
[1820] Output: A list of optimal care services and subsidy proposals.
[1821] Specific operation: The server searches and collates relevant nursing care services and subsidy data in the database based on nursing care grade and income information.
[1822] Step 6: Generate a list of suggestions
[1823] Server: Based on the analysis results, it generates a list of proposals for appropriate nursing care services and subsidies, such as "day care," "home care," and "long-term care insurance benefits."
[1824] Input: Relevant information retrieved from the database.
[1825] Output: A list of suggestions.
[1826] What happens: The server compiles a list of eligible services and grants and converts it into a displayable data format.
[1827] Step 7: Send the list to the user's device
[1828] Server: Sends the proposal list to the user device.
[1829] Input: Suggestion list.
[1830] Output: The suggestion list displayed on the user's device.
[1831] Specific operation: The server uses a communication protocol to send the generated proposal list to the user's device.
[1832] Step 8: View the list
[1833] On the device: The received list of suggestions is displayed in a user-friendly format.
[1834] Input: The proposal list sent by the server.
[1835] Output: The suggestion list displayed on the user screen.
[1836] What it does: The app displays a list of suggestions in a user interface designed to make it easy for the user to select.
[1837] Step 9: Select the proposed service
[1838] User: Select the service they want to use from the list of suggestions.
[1839] Input: The service selected by the user.
[1840] Output: The information about the selected service is sent to the server.
[1841] Specific behavior: The user taps one service from the list and the selection is sent to the server.
[1842] Step 10: Request Procedural Instructions
[1843] Terminal: Requests specific procedural instructions for the selected service from the server.
[1844] Input: Selected service information.
[1845] Output: Request data sent to server.
[1846] What happens: The app sends a request to the server for procedural instructions for the selected service.
[1847] Step 11: Generate procedural steps
[1848] Server: Generates specific procedural instructions, such as required documents and application methods, and sends them to the device.
[1849] Input: The requested service information.
[1850] Output: Detailed information about the procedure steps.
[1851] Specific operations: The server generates the necessary documents and procedures for the selected service and prepares the data to be sent to the user's terminal.
[1852] Step 12: View procedural steps
[1853] Terminal: Displays the necessary information to the user for the procedure.
[1854] Input: Procedural step information sent from the server.
[1855] Output: The procedural steps that are displayed to the user.
[1856] Specific Actions: The app displays the received procedural information in the user interface, helping the user understand the specific next steps.
[1857] Step 13: Information Sharing Options
[1858] User: Makes information sharing choices and directs the transmission of desired information.
[1859] Input: Information sharing selection operation.
[1860] Output: The shared information is sent to the server.
[1861] Specific operation: The user taps the "Share Information" button, sending an instruction to share information to the server.
[1862] Step 14: Sending instructions to the server
[1863] Device: Sends instructions to share information to the server.
[1864] Input: Information sharing selection data.
[1865] Output: Information sharing instructions sent to the server.
[1866] Specific operation: The app prepares the information sharing instruction data and sends it to the server.
[1867] Step 15: Notify administrators
[1868] Server: Generates the information required by the administrator and sends notifications to the administrator's terminal.
[1869] Input: Information sharing instruction data.
[1870] Output: Administrator notification data.
[1871] Specific operation: The server generates notification data and sends it to the administrator terminal.
[1872] Step 16: Check the required information and take action
[1873] Administrator: Review the received information and take appropriate action.
[1874] Input: Administrator notification data sent from the server.
[1875] Output: Administrator response results.
[1876] Specific actions: The administrator checks the notification received in the system and responds to the user based on the required information.
[1877] Step 17: Generate recurring reminders
[1878] Server: Generates periodic reminders and sends status check notifications to users.
[1879] Input: Recurring schedule data.
[1880] Output: Reminder notification to the user.
[1881] Specific operation: The server generates a reminder notification based on the schedule and sends it to the user's device.
[1882] Step 18: Status Check Notification
[1883] Device: Prompt the user with the question, "How is your caregiving situation going these days?"
[1884] Input: Reminder notification data sent from the server.
[1885] Output: A challenge question that is displayed to the user.
[1886] What it does: The app prompts the user with a status check question based on the reminder notification.
[1887] Step 19: Enter and submit your situational response
[1888] User: Enter answers about care situation and submit.
[1889] Input: The situational answer data entered by the user.
[1890] Output: The status response data sent to the server.
[1891] Specific behavior: The user enters an answer about the situation and taps the "Submit" button, which sends the data to the server.
[1892] Step 20: Generate and display additional suggestions and advice
[1893] Server: Generates proposals for additional care services and subsidies based on new information, and generates advice and mental health care information.
[1894] Input: User situation answer data.
[1895] Output: Additional suggestions and advice data.
[1896] Specific operation: The server analyzes the received situation data, generates new suggestions and advice, and sends them to the user's device.
[1897] Device: Show new suggestions and advice to the user.
[1898] Input: Additional suggestion and advice data sent by the server.
[1899] Output: Additional suggestions and advice displayed on the user screen.
[1900] What it does: The app displays additional service suggestions and advice in the user interface.
[1901] (Application example 1)
[1902] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1903] In recent years, while support for the elderly and those who require nursing care has become increasingly important, obtaining information on nursing care services and subsidies, procedures, and daily meal management have become complex issues. In particular, arranging daily meals requires appropriate nutritional management and accommodating dietary restrictions, which creates a significant burden. There is a need to solve these issues all at once.
[1904] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1905] In this invention, the server includes means for interactively inputting basic information about the user, means for proposing available nursing care services and subsidies based on the basic information, means for providing detailed instructions on procedures for the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with a care manager, means for periodically checking the user's nursing care status and proposing new necessary nursing care services or subsidies, means for proposing meals that correspond to the user's nutritional management and dietary restrictions, and means for ordering specific meals and sharing the order status with the care manager. This not only allows users to easily access nursing care services and subsidies, but also allows them to manage their meals, thereby improving the quality of their daily lives.
[1906] "Basic user information" refers to personal data such as the user's age, care level, income information, and information regarding nutritional management.
[1907] "Interactive input means" means a system in which a user inputs information via a smartphone or computer by following on-screen prompts.
[1908] "Care services" refer to services such as day care, home care, and night-time home care provided to the elderly and people who need care.
[1909] A "subsidy" is financial assistance provided to users who meet certain conditions.
[1910] "Means for providing detailed procedural guidance" refers to a system that displays how users prepare and apply for the documents necessary to use nursing care services and subsidies.
[1911] A "care manager" is a professional who provides and coordinates nursing care services.
[1912] The "means of periodically checking the user's care status" is a system that periodically asks the user questions about their care status and collects their responses.
[1913] The "means of proposing new necessary nursing care services and subsidies" is a system that proposes new nursing care services and subsidies based on the latest collected user information.
[1914] "Nutritional management and dietary restrictions" refers to management that restricts certain nutrients and food ingredients based on the user's health condition or doctor's instructions.
[1915] The "means for making meal suggestions" is a system that suggests appropriate meal menus that correspond to the user's nutritional management and dietary restrictions.
[1916] A "means for ordering a specific meal" is a mechanism by which a user selects from a suggested menu of meals and orders a meal.
[1917] "Means for sharing with care managers" refers to a system that sends and shares information entered by users and data regarding ordered meals with care managers.
[1918] The present invention relates to an interactive application system that allows elderly people and those in need of care to easily access care services and subsidies. This system allows users to suggest and order meals and share care information to improve the quality of their daily lives.
[1919] System Overview
[1920] The system mainly consists of a user terminal, a server, and a care manager terminal. The user terminal is equipped with an interactive interface, allowing the user to enter basic information and check suggested information. The server generates appropriate suggestions based on the user's basic information and guides them through the necessary procedures. Necessary information is also shared on the care manager terminal, making it easier for the care manager to respond.
[1921] Program processing overview
[1922] The server is built using Flask, a lightweight Python web framework, and collects and processes user information as follows:
[1923] 1. Enter your basic information
[1924] First, the user launches the smartphone application and taps the "Start" button. The device then displays an interactive question prompt, prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[1925] 2. Proposals for nursing care services and subsidies
[1926] The server analyzes the information sent by the user and suggests appropriate nursing care services and subsidies from a database. The proposal list includes information on day care, home care, nursing care insurance benefits, low-sodium diets, etc.
[1927] 3. Meal suggestions and ordering
[1928] The server will provide specific meal suggestions to users who have entered information about their nutritional management and dietary restrictions. The meal suggestions will display menu items (e.g., "cheese sandwich," "apple," etc.) that correspond to the user's health condition. The user can select a meal from these suggestions and confirm their order.
[1929] 4. Information sharing and status check
[1930] If necessary, the server shares information with the care manager. The server sends information about the user's care situation and dietary choices to the care manager, who then takes appropriate action based on this information. The server also periodically sends the user questions about their care situation and dietary management, and makes new suggestions and advice based on the answers.
[1931] Hardware and software used
[1932] Hardware: Smartphones, computers
[1933] Software: Flask (a lightweight Python web framework), database (e.g., SQLite)
[1934] Specific examples
[1935] For example, if a user starts the app, selects their age as 68, and selects a low-sodium diet as their dietary restriction, the server will suggest meals such as "cheese sandwich" or "apple." If the user orders a "cheese sandwich," that information is shared with the care manager, who can use this information to provide additional advice based on the user's health condition.
[1936] Example prompts for generative AI models
[1937] "A user launches the app and enters their age of 68 and a low-sodium diet as a dietary restriction. Generate and display a list of appropriate meal suggestions."
[1938] In this way, the system helps users smoothly receive appropriate nursing care services and meal suggestions, thereby improving the quality of their daily lives.
[1939] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1940] Step 1:
[1941] The user launches the smartphone application and taps the "Start" button. The device then displays an interactive prompt prompting the user to enter basic information such as age, care level, income information, and nutritional management information.
[1942] Input: User taps
[1943] Output: Display the question prompt
[1944] What happens: The device displays the application's welcome screen and presents the user with a question prompt that includes fields for entering basic information.
[1945] Step 2:
[1946] The user follows the prompts, inputs information about age, care level, income, and nutritional management, and taps the send button. The device sends the input information to the server.
[1947] Input: Basic information entered by the user
[1948] Output: Basic information sent to the server
[1949] What it does: The device receives user input, converts it into JSON format, and sends it to the server as a POST request.
[1950] Step 3:
[1951] The server analyzes the transmitted user information and generates appropriate nursing care services, subsidies, and meal suggestions based on nutritional management from the database.
[1952] Input: Basic information sent to the server
[1953] Output: Nursing care services, grant proposal list, meal proposal list
[1954] Specific operation: The server analyzes the user information, extracts appropriate information from a pre-registered database based on that information, and generates a list of suggestions.
[1955] Step 4:
[1956] The terminal displays to the user the nursing care services, a list of subsidies, and a list of meal suggestions proposed by the server, and the user selects the services and meals they wish to use from the suggested list.
[1957] Input: A list of suggestions sent by the server
[1958] Output: The list of suggestions shown to the user
[1959] What it does: The device displays a list of suggestions on the screen and provides an interface for the user to review and make a selection.
[1960] Step 5:
[1961] The user selects a meal or care service from the list of suggestions, and confirms the order and detailed procedures. The terminal then sends the information to the server.
[1962] Input: The meal or service selected by the user
[1963] Output: Selections sent to the server
[1964] Specific operation: The device receives the user's selection, converts it into data to send to the server, and sends it as a POST request.
[1965] Step 6:
[1966] The server generates and transmits to the terminal specific procedural instructions and ordering information for the selected service and meal.
[1967] Input: User selection information
[1968] Output: Specific procedure instructions, order confirmation information
[1969] Specific operations: Based on the selection information received, the server generates the necessary procedure steps and order confirmation information and sends it to the terminal.
[1970] Step 7:
[1971] The terminal displays specific procedure instructions and order confirmation information sent from the server to the user.
[1972] Input: Procedural instructions and order confirmation information sent from the server
[1973] Output: Procedural instructions displayed to the user, order confirmation information
[1974] What it does: The terminal displays the order instructions and order confirmation on the screen for the user to review.
[1975] Step 8:
[1976] The server shares the user's information with the care manager as needed and periodically sends the user questions about their care situation and dietary management.
[1977] Input: User's latest information
[1978] Output: Information shared with care manager, questions sent to user
[1979] Specific operations: The server processes the user's information, sends the necessary data to the care manager, and also sends regular reminders and status check questions to the user.
[1980] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1981] This invention relates to a system that interactively acquires a user's basic information and emotional state, and based on that information, suggests appropriate nursing care services and subsidies, and guides them through specific procedures. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, a care manager terminal, and an emotion engine.
[1982] System configuration
[1983] This system mainly consists of the following components:
[1984] 1. User terminal: Equipped with a conversational interface, it provides a means for users to input basic information and emotions.
[1985] 2. Server: Analyzes the user's basic information and emotional information and suggests appropriate nursing care services and subsidies.
[1986] 3. Care Manager Terminal: Receives necessary information and provides a means for the care manager to plan and adjust the care plan.
[1987] 4. Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions.
[1988] Program processing flow
[1989] The program for this system is implemented in the following steps.
[1990] 1. User information input and emotion recognition
[1991] User: Launches the app and taps the "Start" button.
[1992] Terminal: Displays a conversational interface to the user, prompting them with "Please tell me your level of care." Sends the user's input speech and sentences to the emotion engine.
[1993] User: Enter "Care Level 3" and submit.
[1994] Emotion engine: Recognizes emotions from user input and sends the results to the server.
[1995] Terminal: Prompt "What is your annual income?"
[1996] User: Enters "3 million yen" and submits.
[1997] Terminal: Sends input information and emotion engine results to the server.
[1998] 2. Processing user and emotional information
[1999] Server: Analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Based on the emotional information from the emotion engine, the server changes the priority of the suggestions.
[2000] Server: Generates a list of suggestions such as "day care," "home care," and "long-term care insurance benefits."
[2001] Server: Sends the proposal list to the user device.
[2002] 3. Service and Grant Proposals
[2003] On the device: Show the user a list of suggestions.
[2004] User: Select the service they want to use from the list of suggestions.
[2005] 4. Procedural guidance and emotional response
[2006] Terminal: Requests the server for specific procedure instructions corresponding to the selected service.
[2007] Server: Generates specific procedural instructions such as required documents and application methods for the selected service.
[2008] Emotion engine: Prioritizes suggestions and explains procedures based on the user's emotional state.
[2009] Server: Sends the generated procedure information to the terminal.
[2010] Terminal: Display procedural instructions to the user.
[2011] 5. Sharing information with care managers
[2012] User: Selects information sharing and instructs transmission.
[2013] Terminal: Sends a transmission instruction to the server.
[2014] Server: Generates the necessary information for the care manager and sends notifications.
[2015] Care manager: Checks the received information and takes necessary action.
[2016] 6. Regular check-ins and emotional support
[2017] Server: Generates reminder notifications periodically and sends them to the device.
[2018] Device: Prompt the user with "How is your caregiving situation going these days?"
[2019] User: Enter answers about care situation and submit.
[2020] Terminal: Sends the answer to the server.
[2021] Server: Uses the new information to search for additional services and grants and generate proposals.
[2022] Emotion engine: Analyzes the user's emotional state and provides mental health care information as needed.
[2023] Server: Sends generated new suggestions and advice to the device.
[2024] Device: Show new suggestions and advice to the user.
[2025] Specific examples
[2026] For example, when a user starts the app and enters their care level of "care required 3" and annual income of "3 million yen," the emotion engine recognizes the user's emotional state and sends emotions such as "tired" and "anxiety" to the server. Based on this emotional information, the server generates a list of suggestions, prioritizing options such as "day care," "home care," and "long-term care insurance benefits." When the user selects "day care," specific procedures are displayed in an explanation that takes emotions into account. Furthermore, if necessary, information is shared with a care manager, who periodically checks the user's situation and provides new suggestions and mental care.
[2027] In this way, the present invention provides a system that supports caregivers in smoothly utilizing appropriate care services and subsidies, and can reduce the mental burden on caregivers through emotional care.
[2028] The processing flow will be explained below.
[2029] Step 1:
[2030] User information input and emotion recognition
[2031] User: Launches the app and taps the "Start" button.
[2032] Terminal: Presents a conversational interface to the user, prompting them with "Please tell us your level of care." Sends the user's voice and text to the emotion engine.
[2033] User: Enter "Care Level 3" and submit.
[2034] Emotion engine: Analyzes emotions from user input and sends the results to the server.
[2035] Terminal: Followed by the prompt "What is your annual income?"
[2036] User: Enters "3 million yen" and submits.
[2037] Terminal: Sends the input information and the emotion engine's analysis results to the server.
[2038] Step 2:
[2039] User and sentiment analysis
[2040] Server: Analyzes the received basic information and emotional information, and searches the database for relevant nursing care services and subsidies.
[2041] Server: Refers to the results of sentiment analysis by the emotion engine and adjusts the priority of the suggestions.
[2042] Step 3:
[2043] Service and Grant Proposals
[2044] Server: Lists the searched nursing care services and subsidies in order of priority according to the results of the emotion engine.
[2045] Server: Sends the suggestion list to the device.
[2046] Terminal: Display the list to the user.
[2047] Step 4:
[2048] Select the service you want to use
[2049] User: Select "Day Care" from the list of proposed care services and grants.
[2050] Terminal: Requests information about the selected service from the server.
[2051] Step 5:
[2052] Procedural instructions
[2053] Server: Generates specific procedural steps for the selected "day service," such as the necessary documents and application procedures. It applies an explanation method that takes into account the analysis results of the emotion engine.
[2054] Server: Sends procedure information to the terminal.
[2055] Terminal: Display procedural instructions to the user.
[2056] Step 6:
[2057] Sharing information with care managers
[2058] User: Selects information sharing and instructs transmission.
[2059] Terminal: Sends a transmission instruction to the server.
[2060] Server: Generates the necessary information for the care manager and sends notifications.
[2061] Care manager: Checks the received information and takes necessary action.
[2062] Step 7:
[2063] Regular check-ins and emotional support
[2064] Server: Generates reminder notifications periodically and sends them to the device.
[2065] Device: Prompt the user with "How is your caregiving situation going these days?"
[2066] User: Enters the answer to the question about care situation, "Recently, there has been an increase in nighttime care," and submits.
[2067] Terminal: Sends the transmitted information to the server.
[2068] Server: Searches for additional nursing care services and subsidies based on the analysis results and generates proposals.
[2069] Emotion engine: Analyzes the user's emotional state and generates data to provide mental care and support information.
[2070] Server: Generates new suggestions and advice and sends them to the device.
[2071] Device: Show new suggestions and advice to the user.
[2072] Example 2
[2073] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2074] In the current nursing care service provision system, proposals are made based only on the user's basic information, which can sometimes lack consideration for the individual's feelings and emotions. Furthermore, the procedures for applying for proposed nursing care services and subsidies are complicated, often placing a mental burden on users as they go through the procedures. Furthermore, the lack of smooth information sharing with care managers is also a factor that hinders the creation of appropriate nursing care plans. A system that can solve these problems and provide support that is more attuned to users is needed.
[2075] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[2076] In this invention, the server includes means for interactively inputting the user's basic information and emotional state, means for proposing available nursing care services and subsidies based on the basic information and emotional state, means for providing detailed instructions on how to obtain the proposed nursing care services or subsidies, means for sharing information necessary for using the nursing care services with an administrator, means for periodically checking the user's nursing care status and proposing new required nursing care services or subsidies, and means for analyzing the user's emotional state and adjusting the priority of the suggestions and the method of explaining the procedures. This makes it possible to provide appropriate nursing care services and subsidies and instructions on how to obtain them, taking the user's emotions into consideration, thereby reducing their mental burden.
[2077] "Basic information" refers to basic data such as the user's personal information, care level, and annual income.
[2078] "Emotional state" refers to the psychological state or mood analyzed from the user's input.
[2079] The "interactive format" is a format in which questions are presented sequentially in response to user input and responses are obtained from the user.
[2080] "Care services" are services that provide care support and assistance, such as day care services and home care.
[2081] "Subsidies" refer to financial support related to nursing care provided by the government or local governments.
[2082] "Procedures" refers to the steps required to use nursing care services and subsidies, such as the documents and application methods.
[2083] "Administrator" refers to a professional who is responsible for planning and coordinating the user's care plan, such as a care manager.
[2084] "Suggestion priority" refers to the display order of a list of care services and subsidies that is generated based on the user's emotional state and basic information.
[2085] An "emotion engine" is an algorithm or software that recognizes and analyzes emotions from a user's voice or text.
[2086] The "server" is a remote computer system that receives and analyzes data sent from user devices and provides appropriate nursing care services and subsidy information.
[2087] This system interactively acquires a user's basic information and emotional state, and then uses that information to suggest appropriate nursing care services and subsidies, providing guidance on specific procedures. Furthermore, by incorporating an emotion engine, it is possible to recognize the user's emotions and optimize the content of suggestions and support. This system consists of a user terminal, a server, an administrator terminal, and an emotion engine.
[2088] System configuration
[2089] User device: A device with a conversational interface that provides a means for users to input basic information and emotions. This can be a smartphone, tablet, or other device with an application that allows users to input voice or text.
[2090] Server: Analyzes the user's basic and emotional information and proposes appropriate care services and subsidies. The server communicates with the database and includes a back-end system that searches, analyzes, and generates information. This is often done using a cloud server environment such as AWS or Google Cloud.
[2091] Administrator device: This receives necessary information and provides a means for administrators to plan and adjust care plans. This is a device such as a computer or tablet used by care managers and other professionals.
[2092] Emotion engine: Recognizes emotions from the user's voice or text input and adjusts the priority of suggestions. The emotion engine is implemented using NLP (natural language processing) algorithms and AI models (such as OpenAI's GPT-3).
[2093] Specific examples
[2094] When a user launches the app and taps the "Start" button on the screen, the system begins to acquire the user's basic information and emotional state. The device displays a dialogue interface and prompts the user as follows:
[2095] "Please tell me your care level. For example, care level 3."
[2096] When the user enters "Care Level 3," the emotion engine recognizes the emotion from the user's input and sends the result to the server. The device then displays a prompt saying, "Please tell us your annual income. For example, 3 million yen." The user then enters "3 million yen" and sends it.
[2097] The server analyzes the received basic information and emotional information, and searches the database for appropriate nursing care services and subsidies. Furthermore, it changes the priority of suggestions based on the emotional information from the emotion engine. For example, a list of suggestions such as "day care," "home care," and "long-term care insurance benefits" is generated and sent to the user's device.
[2098] When a user selects a desired service from the list of suggestions displayed on the device, the device requests the server for specific procedural instructions for the selected service. The server generates detailed procedural instructions for the selected service, including the necessary documents and application methods, and sends them to the user's device. The emotion engine adjusts the explanation method based on the user's emotional state, allowing the user to proceed with the procedure without stress.
[2099] Furthermore, if the user wishes, this information can be shared with the administrator, who can then adjust the care plan based on the received information. The system will periodically check the user's care status and send reminders to provide new suggestions and emotional care information.
[2100] The above is a specific embodiment for carrying out the present invention.
[2101] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2102] Step 1:
[2103] The user launches the app and taps the "Start" button. This input causes the system to start the process of obtaining user information, and displays the following interface.
[2104] Step 2:
[2105] The terminal displays a dialogue interface to the user, prompting them to "Please tell us your nursing care level." The user enters "Needs nursing care level 3." This text data is sent to the emotion engine, which performs text analysis and sends the emotional state to the server.
[2106] Step 3:
[2107] The emotion engine receives the user's input data, applies natural language processing (NLP) algorithms to analyze the emotion, and determines that the user is "tired" and sends the emotional state in JSON format to the server.
[2108] Step 4:
[2109] The device displays the following prompt: "Please tell us your annual income," and the user enters "3 million yen." The entered data is then sent to the emotion engine again for an attempt at emotion analysis.
[2110] Step 5:
[2111] The device compiles the input data and the analysis results of the emotion engine and sends them to the server via an HTTP POST request. The data includes the user's basic information (care level, annual income) and emotion information (tired).
[2112] Step 6:
[2113] The server analyzes the received basic information and emotion information. First, it accesses the database to obtain the appropriate data set (care services, subsidy information, etc.).
[2114] Step 7:
[2115] The server uses an analytical algorithm to search the database for appropriate nursing care services and subsidies, and then changes the priority of the suggestions based on the emotion information obtained from the emotion engine to generate a list of suggestions.
[2116] Step 8:
[2117] The server generates a list of suggestions such as "day service," "home care," and "long-term care insurance benefits" in JSON format and sends it to the user's device.
[2118] Step 9:
[2119] The terminal displays the received proposal list on the interface. When the user selects a desired service from the proposal list, the selection information is sent back to the server.
[2120] Step 10:
[2121] The terminal requests the server for specific procedure instructions corresponding to the selected service, and the server generates detailed procedure information such as required documents and application methods and sends it to the user terminal.
[2122] Step 11:
[2123] The server adjusts how it explains the procedure based on the user's emotional state. For example, if the user is determined to be "tired," it adjusts the explanation to be briefer.
[2124] Step 12:
[2125] The terminal displays detailed procedure instructions to the user, and if the user wishes, sends instructions to the server again to share this procedure information with the administrator.
[2126] Step 13:
[2127] The server generates the information again and sends a notification to the administrator, who can then adjust the care plan based on the received information.
[2128] Step 14:
[2129] The server periodically generates reminders and sends information to the user's device to provide improvement suggestions and emotional care.
[2130] Step 15:
[2131] The device periodically prompts the user, "How is your care situation going lately?" and sends the answer to the server.
[2132] (Application example 2)
[2133] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2134] Improving worker safety and work efficiency is important in factories, and it is particularly important to understand workers' emotional states in real time and provide appropriate work instructions and break suggestions. However, conventional methods have had difficulty accurately understanding workers' emotional states and providing quick and appropriate suggestions. This not only makes it difficult to prevent worker fatigue and stress, but also leads to problems such as reduced work efficiency and safety. Therefore, there is a need for a system that can obtain basic information and emotional states of workers in real time and provide optimal work instructions and break suggestions based on that information.
[2135] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[2136] In this invention, the server includes means for interactively inputting basic information of a user, means for providing possible work instructions and break suggestions based on the basic information, means for providing detailed instructions for the proposed work instructions or break suggestions, means for transmitting the basic information and emotional information to the server and generating suggestions, means for recognizing the emotional state and optimizing the suggestions, and means for periodically checking the user's work situation and emotional state and regenerating necessary work instructions and break suggestions. This makes it possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[2137] Definition of Terms
[2138] "Basic user information" is data including the worker's name, work, job title, and other personal information.
[2139] The "server" is a central computing device that processes the user's basic information and emotional information and generates appropriate work instructions and break suggestions.
[2140] "Interactive" means that the user communicates with the system and inputs information via text or voice.
[2141] "Work instructions" are proposals that include specific instructions and advice necessary for workers to efficiently carry out their work.
[2142] "Break suggestions" are suggestions that provide appropriate break times and relaxation methods to reduce worker fatigue and stress.
[2143] "Detailed procedures" are information that indicates specific implementation procedures and safety measures for proposed work instructions and break suggestions.
[2144] "Emotion information" is data on the emotional state of a worker obtained by analyzing the worker's voice and facial expression data.
[2145] "Emotional state" is information that indicates the worker's current psychological and emotional state.
[2146] "Optimization means" refers to methods or algorithms that adjust the priority and content of proposals based on emotional information.
[2147] "Work status" is information indicating the current work content of the worker and its progress.
[2148] MODE FOR CARRYING OUT THE INVENTION
[2149] This invention provides a system for improving worker safety and efficiency at a factory site. This system is composed of a user terminal for executing a program, a server, an emotion engine, and a factory robot that works in conjunction with the user terminal. A specific embodiment of this system is described below.
[2150] System configuration
[2151] 1. User Device:
[2152] Provide a means for workers to enter basic information (such as name and job description).
[2153] It has an interface for sending voice and facial expression data to the emotion engine.
[2154] 2. Server:
[2155] Receive and analyze basic information and emotional information of the user.
[2156] Appropriate work instructions and break suggestions are generated and sent to the user's device.
[2157] 3. Care manager terminal:
[2158] Receives necessary information and provides a means for management (e.g., supervisor) to plan and adjust the plan of care.
[2159] 4. Emotion Engine:
[2160] It recognizes emotions from the user's voice or text input and sends the results to the server.
[2161] Program processing flow
[2162] The program is executed as follows:
[2163] 1. Enter basic information:
[2164] The user starts up the user device and taps the "Start" button.
[2165] The terminal will prompt you to enter basic information about the worker.
[2166] 2. Emotion recognition:
[2167] It receives information input by the user via voice or text and sends it to the emotion engine.
[2168] The emotion engine analyzes the emotional state and sends the results to the server.
[2169] 3. Transmission of information to the server and analysis:
[2170] The device sends the input basic information and emotion information to the server.
[2171] The server generates appropriate work instructions and break suggestions based on the received basic information and emotion information.
[2172] 4. Proposal generation and display:
[2173] The server generates suggestions such as "relaxation methods" and "safety measures" and sends them to the user's device.
[2174] The terminal displays the generated proposals to the worker in an interactive format.
[2175] 5. Regularly review and resubmit proposals:
[2176] The server periodically generates reminders and sends them to the device.
[2177] The device prompts the user, "How's your work going lately?"
[2178] Once the user enters their answers, the server generates new suggestions based on that information.
[2179] Specific examples
[2180] For example, if a worker says "I'm tired" to the robot, the emotion engine analyzes it and detects the fatigue. The server immediately suggests a five-minute break, and the suggestion is displayed on the robot's screen. If the worker takes the break as suggested, fatigue will be reduced.
[2181] Prompt Sentence Examples
[2182] "Generate code for a conversational robot application that detects specific emotions (e.g., 'tired' or 'anxious') and offers appropriate breaks or mental health advice to workers."
[2183] This makes it possible to quickly provide optimal work instructions and break suggestions based on the worker's emotional state, improving safety and efficiency.
[2184] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2185] Program processing steps
[2186] Step 1: Enter basic information
[2187] The user starts the user device and taps the "Start" button. The device displays a prompt to enter basic information about the worker (such as name and work content). Once the user has completed the input, the device saves the information.
[2188] Input: Worker name, work content
[2189] Output: Basic information saved
[2190] Step 2: Start Recognizing Emotions
[2191] The terminal provides an interface for receiving a user's voice or text input and acquires emotion information in real time. The user inputs information by voice or text.
[2192] Input: Audio data, text data
[2193] Output: Emotional information
[2194] Step 3: Emotional information analysis
[2195] The emotion engine analyzes the received voice or text data to recognize the user's emotional state, and the analysis results are sent to the server as emotion information.
[2196] Input: Audio data, text data
[2197] Data processing: natural language processing, sentiment analysis
[2198] Output: Emotional information
[2199] Step 4: Send basic information and emotional information to the server
[2200] The device sends the user's basic information and emotional information to the server, which receives it and stores it in a database.
[2201] Input: Basic information, emotional information
[2202] Output: Data stored on the server
[2203] Step 5: Work order and break proposal generation
[2204] The server generates appropriate work instructions and break suggestions based on the stored basic information and emotion information, and sends the suggestions to the user's device.
[2205] Input: Basic information, emotional information
[2206] Data calculation: Algorithm for generating work instructions and break suggestions
[2207] Output: Work instructions, break suggestions
[2208] Step 6: Viewing Proposals
[2209] The terminal receives work instructions and break suggestions from the server and displays them to the user in an interactive format, allowing the user to decide their next action based on the information.
[2210] Input: Work Order, Break Proposal
[2211] Output: The displayed suggestions
[2212] Step 7: Regular check-ins
[2213] The server periodically generates reminders and sends them to the user's terminal, which then displays a prompt to the user asking, "How is your work going recently?"
[2214] input: -
[2215] Output: Reminder notification
[2216] Step 8: User feedback and re-suggestions
[2217] The user enters answers to the prompts and sends them to the terminal, which sends the information to the server, which generates new suggestions, which are then sent back to the user terminal.
[2218] Input: Feedback information
[2219] Data operations: feedback analysis, re-proposal generation
[2220] Output: New proposal
[2221] Through the above steps, it is possible to quickly provide optimal work instructions and break suggestions based on the emotional state of the worker.
[2222] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[2223] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2224] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[2225] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[2226] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[2227] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[2228] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[2229] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[2230] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[2231] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[2232] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[2233] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific...
Claims
1. A means of interactively entering basic user information; A means for proposing nursing care services and subsidies that can be provided based on the basic information; a means for providing detailed procedural instructions for said proposed care services or subsidies; and A means for sharing information necessary for using the nursing care service with a care manager; A means to regularly check the user's care status and propose new necessary care services and subsidies, A system including:
2. The system of claim 1 , wherein the basic information includes care level and income information.
3. The system of claim 1 , wherein the specific procedural steps for the proposed care services or subsidies include document preparation and application methods.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A