Smart interaction system for home care of disabled old people
Through the behavior monitoring and interaction module of the home care smart interactive system of disabled elderly people, combined with audio and image analysis, it provides correlation analysis and interactive reminders of the behavior of carers and disabled elderly people, solving the problem that the existing technology cannot effectively deal with care beyond care. The event problem of the cognitive scope of the person improves the effectiveness of event processing.
Patent Information
- Application Number
- CN202411099510.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-12
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-08-12
AI Technical Summary
The prior art is difficult to effectively handle events of disabled elderly people who exceed the caregiver's cognitive range, resulting in the inability to effectively handle events.
A smart interactive system for home care for disabled elderly people was designed, including behavior monitoring module, trigger module and interactive module. Through audio and image acquisition and analysis, combined with pre-configured association database and coding database, the caring and disabled elderly people can be realized. Behavior association analysis, enter the auxiliary mode and output prompt information, provide interactive reminders and dangerous behavior warnings.
When events outside the scope of the caregiver's ability, reminder information is output through auxiliary interaction, which improves the effectiveness of incident handling and ensures that caregivers can promptly respond to the dangerous behaviors and daily care needs of disabled elderly people.
Smart Images

Figure CN119069067A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of behavior monitoring assistance technology, and in particular to an intelligent interactive system for home care of disabled elderly people. Background Art
[0002] Elderly people who have lost the ability to take care of themselves are called "disabled elderly people." According to internationally accepted standards, those who cannot do one or two of the six indicators of eating, dressing, getting in and out of bed, going to the toilet, walking around indoors, and taking a bath are defined as "mildly disabled," those who cannot do three or four are defined as "moderately disabled," and those who cannot do five or six are defined as "severely disabled."
[0003] The care of disabled elderly people has always been a social concern. Generally, caregivers provide the care. Caregivers have different skills and abilities to handle events. When they encounter events that are beyond their cognitive scope, they are unable to handle the events effectively. Summary of the invention
[0004] One of the purposes of the present invention is to provide an intelligent interactive system for home care of disabled elderly people, so that when an event occurs that is beyond the ability of the caregiver, reminder information can be output in an auxiliary interactive manner, thereby achieving effective event handling.
[0005] An embodiment of the present invention provides a smart interactive system for home care of disabled elderly people, comprising:
[0006] Behavior monitoring module, used to monitor the behavior of caregivers and disabled elderly people;
[0007] A trigger module, used to enter the assistance mode when the behavior of the caregiver is associated with the behavior of the disabled elderly person and meets the associated behavior in the pre-configured associated trigger library;
[0008] The interactive module is used to output corresponding prompt information according to the interaction information of the caregiver and / or the disabled elderly in the auxiliary mode.
[0009] Preferably, the behavior monitoring module includes:
[0010] An audio collection unit, used for collecting indoor audio data;
[0011] The audio analysis unit is used to analyze the audio data according to the keyword library to obtain a first analysis result.
[0012] Preferably, the behavior monitoring module further includes:
[0013] An image acquisition unit, used for acquiring indoor image data;
[0014] The image analysis unit is used to analyze the image data according to the pre-trained converged behavior analysis model to obtain a second analysis result.
[0015] Preferably, the behavior monitoring module further includes:
[0016] The comprehensive analysis unit is used to comprehensively analyze the first analysis result and the second analysis result to determine the final behavior analysis result.
[0017] Preferably, the trigger module includes:
[0018] A correlation analysis unit is used to conduct correlation analysis between the behavior of the caregiver and the behavior of the disabled elderly to determine whether the behavior of the caregiver and the disabled elderly is correlated;
[0019] A trigger analysis unit, used to determine whether the associated behavior is an associated behavior in the associated trigger library when the behavior of the caregiver and the disabled elderly is associated;
[0020] The mode start module is used to enter the auxiliary mode when the association behavior in the association trigger library is triggered.
[0021] Preferably, the association analysis unit performs the following operations:
[0022] Determine the first code corresponding to the caregiver's behavior and the second code corresponding to the disabled elderly's behavior based on a pre-configured behavior coding library;
[0023] Extracting all third codes associated with the first code from a pre-configured association library, and comparing the third codes with the second code one by one; and / or extracting all third codes associated with the second code from a pre-configured association library, and comparing the third codes with the first code one by one;
[0024] When there are identical items in comparison, determine the behavioral association between the caregiver and the disabled elderly.
[0025] Preferably, the trigger analysis unit performs the following operations:
[0026] Extract another behavior code in the associated behavior related to the first code from the associated trigger library as a fourth code, and compare the fourth code with the second code one by one; and / or extract another behavior code in the associated behavior related to the second code from the associated trigger library as a fourth code, and compare the fourth code with the first code one by one;
[0027] When there are identical items being compared, the behaviors of the caregiver and the disabled elderly are determined to be associated behaviors in the associated trigger library.
[0028] Preferably, the interactive information received by the interactive module includes: interactive gestures and / or interactive voices; the prompt information is pre-stored information associated with the behavior of the corresponding disabled elderly person.
[0029] Preferably, the intelligent interactive system for home care of disabled elderly people also includes:
[0030] The dangerous behavior warning module is used to make dangerous judgments on the behavior of disabled elderly people based on the first dangerous behavior library configured in advance according to the specific circumstances of the disabled elderly people, and to prompt caregivers and / or pre-configured alarm contacts through voice when dangerous behavior occurs.
[0031] Preferably, the intelligent interactive system for home care of disabled elderly people also includes:
[0032] The event reminder module is used to provide event reminders based on pre-configured event reminder items.
[0033] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.
[0034] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0036] Figure 1 A schematic diagram of a smart interactive system for home care of disabled elderly people in an embodiment of the present invention;
[0037] Figure 2 Schematic diagram of abnormal event monitoring in an embodiment of the present invention. DETAILED DESCRIPTION
[0038] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
[0039] The embodiment of the present invention provides a smart interactive system for home care of disabled elderly people, such as Figure 1 As shown, including:
[0040] Behavior monitoring module 1, used to monitor the behavior of caregivers and disabled elderly people;
[0041] Trigger module 2, used for entering the auxiliary mode when the behavior of the caregiver is associated with the behavior of the disabled elderly person and meets the associated behavior in the pre-configured associated trigger library;
[0042] The interactive module 3 is used to output corresponding prompt information according to the interactive information of the caregiver and / or the disabled elderly in the auxiliary mode.
[0043] This embodiment monitors and analyzes the behavior of the caregiver and the disabled elderly, adaptively enters the auxiliary mode, interacts with the caregiver and / or the disabled elderly in the auxiliary mode and provides corresponding prompt information; when an event occurs that is beyond the caregiver's ability, the reminder information is output in an auxiliary interactive manner, thereby achieving effective event processing. Among them, the interactive information received by the interactive module 3 includes: interactive gestures and / or interactive voices; the prompt information is pre-stored information associated with the behavior of the corresponding disabled elderly. For example: when the behavior of the disabled elderly includes: falling, fainting, dysphagia, etc., when the caregiver's behavior is any of the following: standing still, anxiously spinning, etc., the auxiliary mode can be entered after the judgment of the associated trigger library, and precise care support can be given to the caregiver according to the needs of the caregiver; the caregiver's interactive information includes: voice information; output prompt information corresponding to the behavior of the elderly, specifically "confirm the impact position of the fall" corresponding to the fall; when the caregiver confirms, the feedback is "legs"; continue to output prompt information "whether it is red and swollen, whether it is painful to press"... gradually guide the caregiver to handle it. In addition, the caregiver can actively enter the auxiliary mode by making a gesture to trigger the interaction. The gestures include "extending the hand toward the camera and bending the palm several times", "stretching the hand upward", etc.
[0044] The auxiliary reminder function of this system is realized on the basis of behavior monitoring and judgment of caregivers and disabled elderly people. In order to realize behavior monitoring, the present invention provides three behavior analysis modes, specifically:
[0045] 1. Audio analysis method: The audio data in the room is collected by the audio collection unit of the behavior monitoring module 1; the collected audio data is analyzed by the audio analysis unit according to the keyword library to obtain the first analysis result. The collection of audio data can be achieved by a sound collector set up in the room; the keyword library is pre-built, and multiple keywords in the keyword library correspond to one first analysis result, for example, "eat" and "medicine", corresponding to the caregiver's behavior of feeding medicine; corresponding to the disabled elderly's behavior of reminding the caregiver, etc.;
[0046] Second, the image analysis method is to collect indoor image data through the image acquisition unit of the behavior monitoring module 1; the collected image data is input into the pre-trained converged behavior analysis model by the image analysis unit for analysis to obtain the second analysis result. The image data can be collected by a camera set indoors; the behavior analysis model is a neural network model; and behavior analysis through a neural network model is an existing mature technology, which will not be explained in detail here;
[0047] 3. Comprehensive analysis method: On the basis of audio analysis and image analysis, the comprehensive analysis unit of the behavior monitoring module 1 conducts comprehensive analysis on the first analysis result and the second analysis result to determine the final behavior analysis result. That is, if there is only one first analysis result and second analysis result at the same time, the behavior of the existing behavior analysis result shall be the final behavior analysis result; when they exist at the same time and are the same, any one of the analysis results shall be the final behavior analysis result; when they are different, the image analysis shall be temporarily used as the final behavior analysis result, and then recorded and confirmed by the user again. When it happens again, the result confirmed by the user shall prevail.
[0048] In order to implement behavior association analysis, in one embodiment, the trigger module 2 includes:
[0049] A correlation analysis unit is used to conduct correlation analysis between the behavior of the caregiver and the behavior of the disabled elderly to determine whether the behavior of the caregiver and the disabled elderly is correlated;
[0050] A trigger analysis unit, used to determine whether the associated behavior is an associated behavior in the associated trigger library when the behavior of the caregiver and the disabled elderly is associated;
[0051] The mode start module is used to enter the auxiliary mode when the association behavior in the association trigger library is triggered.
[0052] The correlation analysis unit performs the following operations:
[0053] Determine the first code corresponding to the caregiver's behavior and the second code corresponding to the disabled elderly's behavior based on a pre-configured behavior coding library;
[0054] Extracting all third codes associated with the first code from a pre-configured association library, and comparing the third codes with the second code one by one; and / or extracting all third codes associated with the second code from a pre-configured association library, and comparing the third codes with the first code one by one;
[0055] When there are identical items in the comparison, the behavioral association between the caregiver and the disabled elderly is determined.
[0056] The trigger analysis unit performs the following operations:
[0057] Extract another behavior code in the associated behavior related to the first code from the associated trigger library as a fourth code, and compare the fourth code with the second code one by one; and / or extract another behavior code in the associated behavior related to the second code from the associated trigger library as a fourth code, and compare the fourth code with the first code one by one;
[0058] When there are identical items being compared, the behaviors of the caregiver and the disabled elderly are determined to be associated behaviors in the associated trigger library.
[0059] In one embodiment, the smart interactive system for home care of disabled elderly people further includes:
[0060] The dangerous behavior warning module is used to make dangerous judgments on the behavior of disabled elderly people based on the first dangerous behavior library configured in advance according to the specific circumstances of the disabled elderly people, and to prompt caregivers and / or pre-configured alarm contacts through voice when dangerous behavior occurs.
[0061] The first dangerous behavior library is pre-configured. After professionals analyze the specific situation of the disabled elderly, the corresponding behavior codes in the behavior coding library are stored in the first dangerous behavior library; in this way, dangerous behaviors of disabled elderly people can be warned during daily operation; in addition, the corresponding second dangerous behavior library can be configured for caregivers to warn caregivers of dangerous behaviors; the behavior codes corresponding to beating and abusing the elderly can be added to the second dangerous behavior library for synchronous monitoring.
[0062] In one embodiment, the smart interactive system for home care of disabled elderly people further includes:
[0063] The event reminder module is used to remind events based on pre-configured event reminders. Time reminders can be configured by the user in advance, such as daily reminders for taking medicine, reminders for meals, etc.
[0064] In one embodiment, the smart interactive system for home care of disabled elderly people further includes:
[0065] A recommendation module, used to receive a recommendation request from a user and output a recommended list of caregivers in response to the recommendation request;
[0066] The recommendation request is generated by the user operating on the mobile terminal, and specifically fills in various data in the data acquisition interface corresponding to the recommendation request; the filled-in data include: the age of the disabled elderly, the gender of the disabled elderly, the care address, and the feedback data of the ability survey items of the disabled elderly; the recommendation request includes: request instructions, and various data filled in by the user on the data acquisition interface.
[0067] The recommendation module performs the following operations:
[0068] According to the feedback data of the ability survey items of the disabled elderly in the recommendation request and the corresponding quantitative scoring standards, the ability evaluation values of each item are determined and the ability data set of the disabled elderly is constructed on this basis; wherein, the ability data set is formed by arranging the ability evaluation values of each item in a predetermined order and position;
[0069] Matching the capability data set with each standard capability data set in the corresponding association table of each caregiver stored in the system, and when there is a standard capability data set matching the capability data set, taking the corresponding caregiver as a recommended choice, and taking the standard capability data set matching the capability data set as a positioning data set;
[0070] The recommended choices are ranked according to the situation of the positioning data set in the association table, the required salary range, the expected remuneration range entered by the user, and the evaluation of historical clients;
[0071] The sorted recommended choices are output and the personal characteristics are marked, which include: the evaluation statements of managers, the self-evaluation statements and the evaluation statements of historical clients.
[0072] The specific steps for sorting between recommended options are as follows:
[0073] According to the numerical values corresponding to each data in the standard capability data set and the pre-configured weights, the total scores corresponding to each standard capability data set in the association table are calculated;
[0074] Sort each standard capability data set in the association table according to the total score from low to high, and determine the capability adaptation degree according to the ratio of the number of digits of the positioning data set to the total number of standard capability data sets;
[0075] Determine the salary expectation fit based on the overlap between the required salary range and the expected remuneration range input by the user;
[0076] The evaluation of historical clients is quantified and then the sum is taken as the evaluation value; the evaluation value is set by a maximum threshold. When the evaluation value calculated by quantification is greater than the maximum threshold, the maximum threshold is used as the final evaluation value;
[0077] According to the ability fit, salary expectation fit and evaluation value, they are multiplied by the corresponding pre-configured weighting coefficients, and then the sum is calculated to obtain the priority recommendation value;
[0078] The priority recommendation values are sorted from large to small. In addition, the ability fit, salary expectation fit and evaluation value are marked in the recommendation interface and displayed synchronously.
[0079] Among them, each standard capability data set in the caregiver corresponding association table is constructed after analyzing the capability data set of each patient that the caregiver can care for.
[0080] In one embodiment, the intelligent interactive system for home care of disabled elderly people further includes: an abnormal event monitoring module;
[0081] like Figure 2 As shown, the abnormal event monitoring module performs the following operations:
[0082] Step S1: construct an abnormal event monitoring space model based on the internal space division of the house;
[0083] You can directly use the structural diagram of the house to build the model;
[0084] Step S2: The area not monitored by the camera is regarded as a hidden area and a configuration query is issued;
[0085] Since the camera is usually set up in public areas such as living rooms and dining rooms, other areas are not within the camera's shooting range, so the system requires user input and therefore issues a configuration query;
[0086] Step S3: receiving the user's function configuration and stay time threshold configuration for each area;
[0087] Among them, the functional configuration includes: rest room for the elderly, bathroom, master room, guest room, warehouse, etc.; in addition, when the user does not configure the stay time threshold or selects the default, it is configured according to the initial time threshold stored in the system; the initial time threshold stored in the system includes: the rest room for the elderly is from 12 noon to 2 pm; the threshold time for the bathroom is 30 minutes; the threshold for the master room, guest room, warehouse, etc. for disabled elderly people is 5 minutes; the master room and guest room are prohibited areas for caregivers, and the threshold time for the warehouse is 30 minutes;
[0088] Step S4: Monitor the trajectory of the disabled elderly; when the time of entering each hidden area during the daytime care is illegal, it is recorded as an abnormal event and sent to the user;
[0089] The trajectory monitoring is based on the analysis of the images taken by the camera, or it can be done by having disabled elderly people wear positioning bracelets; illegal judgments are made when they do not enter at the specified time or exceed the time threshold for entry. Similarly, the trajectory of the caregiver can also be monitored.
[0090] The abnormal event monitoring module performs the following operations:
[0091] When the caregiver and the disabled elderly enter the hidden area at the same time for a time exceeding the corresponding set threshold, it is recorded as an abnormal event and the images from half an hour before entering to half an hour after leaving are retrieved and stored as evidence associated with the abnormal event;
[0092] The behavior of caregivers and / or disabled elderly people verbally abusing or beating each other is also recorded as an abnormal event;
[0093] When the caregiver intentionally moves behind the disabled elderly and intentionally blocks the camera, it is also recorded as an abnormal event; specifically: the caregiver's line of sight is tracked, and when the line of sight falls on the camera, a countdown is performed (the initial value is configurable). Before the countdown ends, if the caregiver moves behind the disabled elderly (the elderly's outline blocks 30% to 100% of the caregiver's outline), it is judged that the caregiver has intentionally moved behind the disabled elderly to intentionally block the camera;
[0094] The caregiver's line of sight is monitored. When the number of times the line of sight falls on the camera exceeds the preset threshold in a day, it is recorded as an abnormal event; and the images within 5 minutes before and after each event point are associated with the abnormal event and stored.
[0095] In addition, the system can also analyze the care history of the caregiver, identify key focus objects and notify the manager; that is, when a caregiver changes employers multiple times in a short period of time (for example, changing employers once a month), he or she can be identified as a key focus object.
[0096] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A smart interactive system for home care of disabled elderly people, characterized by: include: Behavior monitoring module, trigger module, interaction module; wherein, the behavior monitoring module monitors the behavior of the caregiver and the cared person; when the caregiver's behavior is associated with the cared person's behavior and conforms to the associated behavior in the pre-configured associated trigger library, the trigger module triggers entry into the auxiliary mode; after entering the auxiliary mode, the interaction module outputs corresponding prompt information according to the interaction information of the caregiver and / or the cared person.
2. The intelligent interactive system for home care of disabled elderly people as claimed in claim 1, characterized in that: The behavior monitoring module includes: an audio collection unit and an audio analysis unit, wherein the audio collection unit collects audio data in the room; the collected audio data is analyzed by the audio analysis unit according to a keyword library to obtain a first analysis result.
3. The intelligent interactive system for home care of disabled elderly people as claimed in claim 1, characterized in that: The behavior monitoring module also includes: an image acquisition unit and an image analysis unit; wherein the image acquisition unit acquires indoor image data; the acquired image data is analyzed by the image analysis unit according to a pre-trained converged behavior analysis model to obtain a second analysis result.
4. The intelligent interactive system for home care of disabled elderly people as claimed in claim 2 or 3, characterized in that: The behavior monitoring module further includes: a comprehensive analysis unit, which comprehensively analyzes the first analysis result and the second analysis result to determine a final behavior analysis result.
5. The intelligent interactive system for home care of disabled elderly people as claimed in claim 1, characterized in that: The trigger module includes: an association analysis unit, a trigger analysis unit and a mode start module; wherein the association analysis unit performs an association analysis on the behavior of the caregiver and the behavior of the caregiver to determine whether the behaviors of the caregiver and the caregiver are associated; when the behaviors of the caregiver and the caregiver are associated, the trigger analysis unit determines whether the associated behavior is an associated behavior in the associated trigger library; when it is an associated behavior in the associated trigger library, the mode start module starts the auxiliary mode.
6. The intelligent interactive system for home care of disabled elderly people as claimed in claim 1, characterized in that: The interactive information received by the interactive module includes: interactive gestures and / or interactive voices; the prompt information is pre-stored information associated with the behavior of the corresponding care recipient.
7. The intelligent interactive system for home care of disabled elderly people as claimed in claim 1, characterized in that: Also includes: The dangerous behavior warning module is used to determine the dangerous behavior of the cared person based on the first dangerous behavior library configured in advance according to the specific situation of the cared person, and to prompt the caregiver and / or the pre-configured alarm contact person through voice when dangerous behavior occurs.
8. The intelligent interactive system for home care of disabled elderly people as claimed in claim 1, characterized in that: Also includes: The event reminder module is used to provide event reminders based on pre-configured event reminder items.
Citation Information
Patent Citations
Collaborative interactive service recommendation method for long-term old-age care
CN111834011A
Data acquisition and feedback control system for pre-establishing medical care plan
CN113096782A
Dynamic behavior monitoring and early warning system based on posture recognition and model calculation
CN115578675A
Home-based care intelligent housekeeper
CN117854746A
Empty nest elderly monitoring method and system based on big data artificial intelligence
CN117876919A
