A blockchain-based intelligent interaction method for nursing homes
By leveraging blockchain and facial recognition technologies, the smart interactive device ensures that it provides the elderly with an unalterable and personalized interaction strategy. This solves the problems of easily modified interaction strategies and unclear responsibility in existing technologies, thus improving the applicability and security of the device.
Patent Information
- Application Number
- CN202410987074.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-07-23
AI Technical Summary
Existing smart interactive devices cannot provide personalized services for elderly people with poor eyesight, hearing, or education, and the interaction strategies can be easily modified, leading to unclear liability.
By using blockchain technology, each elderly person's interaction strategy group is set on the blockchain. The image is repaired through facial recognition and multi-level fusion module to ensure the immutability of the interaction strategy. The basic information of the elderly person and the ambient brightness information are obtained through sensing devices to provide personalized interaction strategies.
It achieves security and personalization of the interaction strategy for the elderly, prevents the strategy from being tampered with, ensures clear responsibility, and provides interaction methods that adapt to different ambient brightness and the elderly's condition, thereby improving the applicability and security of the device.
Smart Images

Figure CN118520509B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of blockchain technology, and in particular to a blockchain-based intelligent interaction method for nursing homes. Background Art
[0002] The elderly in existing nursing homes usually have various underlying diseases. For example, some elderly people have presbyopia or cataracts, which lead to low vision. Another example is that some elderly people have hearing degeneration, which leads to low hearing. And some elderly people may have a low level of education and cannot read normally due to their old age.
[0003] Nowadays, smart interactive devices have become the main equipment for nursing home services in the later stage. However, most elderly people with special conditions (such as low vision, low hearing or low cultural level) are unable to use smart interactive devices normally, making it impossible for smart interactive devices to serve the elderly.
[0004] Therefore, nowadays, each elderly person is usually provided with an intelligent dialogue plan that suits the elderly person's own situation. However, if such a dialogue plan can be modified at will, it may lead to unclear identification of responsibilities after problems occur.
[0005] For example, an elderly person sets the interaction scheme of a smart interactive device to interact through voice. However, when some accidents occur during the interaction with the smart interactive device, the elderly person’s family believes that the problem is caused by the unintelligent interaction method of the smart interactive device. At this time, it is difficult for the management of the nursing home to explain that the interaction method of the smart interactive device was set by the elderly person himself. At this time, even if the problem is indeed caused by the inappropriate interaction method set by the elderly person himself, if the elderly person does not admit it or forgets it, there is no way to prove the problem with the setting of the interaction method.
[0006] Therefore, it is desired to have a technical solution to overcome or at least alleviate at least one of the above-mentioned defects of the prior art. Summary of the invention
[0007] The purpose of this application is to provide a blockchain-based intelligent interaction method for nursing homes to overcome or at least alleviate at least one of the above-mentioned defects of the prior art.
[0008] To achieve the above objectives, the present application provides a blockchain-based intelligent interaction method for nursing homes, and the blockchain-based intelligent interaction method for nursing homes includes:
[0009] The main controller obtains the restored face image;
[0010] The main controller obtains a storage database, wherein the storage database includes at least one preset face image and a blockchain node corresponding to each preset face image;
[0011] The main controller obtains a blockchain node corresponding to a preset face image whose similarity with the restored face image exceeds a preset threshold;
[0012] The main controller sends a request message to the blockchain node;
[0013] The blockchain node sends an interaction strategy group to the general controller according to the request information.
[0014] Optionally, before the master controller obtains the restored facial image, the blockchain-based intelligent interaction method for a nursing home further includes:
[0015] The general controller obtains generation policy request information, wherein the generation policy request information includes basic information of the applicant, the first face image, the second face image and basic policy information;
[0016] The general controller determines whether the person is eligible for policy generation based on the basic information of the applicant, the first face image, and the second face image. If so,
[0017] The main controller obtains the interaction strategy group information to be uploaded to the chain;
[0018] The general controller stores the interaction strategy group information to be uploaded to the blockchain on the blockchain node;
[0019] The main controller uses the acquired facial image as the preset facial image and associates the blockchain node with the preset facial image.
[0020] Optionally, the general controller determines whether there is a policy generation qualification according to the basic information of the person applying for modification, the first facial image, and the second facial image, including:
[0021] Acquire a face comparison database for judgment, wherein the face comparison database for judgment includes a plurality of paired face image groups, each face image group includes two preset face images for judgment;
[0022] Comparing the first facial image with each preset facial image in each pair of facial image groups for similarity;
[0023] Comparing the second facial image with each preset facial image in each set of paired facial images for similarity;
[0024] Determine whether the similarity between a preset face image in the same set of paired face images and one of the first face image or the second face image exceeds a preset threshold and the similarity between another preset face image in the same set of paired face images and the other of the first face image or the second face image exceeds a preset threshold, if so, then
[0025] Determine eligibility for strategy generation.
[0026] Optionally, the general controller stores the interaction strategy group information to be uploaded to the blockchain on the blockchain node, including:
[0027] Convert the control logic in the interaction strategy group information into a hash code;
[0028] Store the hash code in the block of the blockchain node.
[0029] Optionally, before the master controller obtains the restored facial image, the blockchain-based intelligent interaction method for a nursing home includes:
[0030] The sensing device obtains the sensing information and transmits it to the main controller;
[0031] The main controller generates shooting information according to the sensing information and transmits it to the camera device;
[0032] The camera device takes pictures according to the shooting information, and transmits the taken initial pictures to the main controller;
[0033] The main controller obtains an initial face image from the initial captured image;
[0034] The main controller carefully repairs the initial face image to obtain a repaired face image.
[0035] Optionally, the general controller carefully repairs the initial facial image to obtain a repaired facial image, including:
[0036] Acquire a trained repair neural network, wherein the repair neural network includes an encoder and a decoder, and the decoder includes a multi-stage fusion module;
[0037] The main controller inputs the initial face image into the encoder to extract features of the face image;
[0038] The main controller inputs the facial image features into the decoder to obtain a restored facial image.
[0039] Optionally, the multi-stage fusion module includes:
[0040] A pooling and splicing module, wherein the pooling and splicing module is used to perform pooling and splicing on the facial image features provided by the encoder to form a first feature;
[0041] A first processing module, the first processing module is used to perform a first processing on the first feature, so as to obtain a second feature;
[0042] a second processing module, the second processing module being used for performing a second processing on the first feature, thereby forming a third feature;
[0043] a third processing module, configured to add the second feature to the third feature and perform a convolution operation to obtain a fourth feature;
[0044] A linear transformation module, wherein the linear transformation module is used to perform a linear transformation on the fourth feature, thereby obtaining a linear transformation feature;
[0045] An activation feature module, wherein the activation feature module is used to perform Sigmoid activation on the fourth feature, thereby obtaining an activation feature;
[0046] A multiplication module, wherein the multiplication module is used to multiply the linear transformation feature and the activation feature to obtain a fifth feature;
[0047] An adding module, wherein the adding module is used to add the fifth feature to the fourth feature to obtain a final fusion feature.
[0048] Optionally, the first processing module includes:
[0049] An average pooling module, wherein the average pooling module is used to perform average pooling on the first feature, thereby obtaining an average pooling feature;
[0050] A maximum pooling module, wherein the maximum pooling module is used to perform maximum pooling on the first feature, thereby obtaining a maximum pooling feature;
[0051] A first splicing module, wherein the first splicing module is used to splice the average pooling feature and the maximum pooling feature to obtain a first splicing feature;
[0052] A position attention mechanism module, wherein the position attention mechanism module is used to perform a position self-attention operation on the first splicing feature;
[0053] An upsampling module is used to upsample the first splicing feature that performs the position self-attention operation, so as to obtain a second feature.
[0054] Optionally, the second processing module includes:
[0055] an anti-overflow module, the anti-overflow module being used to perform an anti-overflow process on the first feature;
[0056] A channel attention mechanism module, wherein the channel attention mechanism module is used to perform a channel self-attention operation on the first feature that has been processed with anti-overflow, so as to obtain a third feature.
[0057] The blockchain-based nursing home of the present application uses an intelligent interaction method to set the interaction strategy group corresponding to each face on the blockchain to prevent tampering by others. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] Figure 1 It is a flowchart of a blockchain-based intelligent interaction method for nursing homes according to an embodiment of the present application. DETAILED DESCRIPTION
[0059] In order to make the purpose, technical scheme and advantages of the implementation of this application clearer, the technical scheme in the embodiment of this application will be described in more detail below in conjunction with the drawings in the embodiment of this application. In the drawings, the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The described embodiments are part of the embodiments of this application, not all of them. The embodiments described below with reference to the drawings are exemplary and are intended to be used to explain this application, and should not be construed as limitations on this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application. The embodiments of this application are described in detail below in conjunction with the drawings.
[0060] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the scope of protection of the present application.
[0061] Figure 1 It is a flowchart of a blockchain-based intelligent interaction method for nursing homes according to an embodiment of the present application.
[0062] like Figure 1 The blockchain-based intelligent interaction methods for nursing homes shown include:
[0063] Step 1: The main controller obtains the restored face image;
[0064] Step 2: The main controller obtains a storage database, where the storage database includes at least one preset face image and a blockchain node corresponding to each preset face image;
[0065] Step 3: The main controller obtains a blockchain node corresponding to a preset face image whose similarity with the restored face image exceeds a preset threshold;
[0066] Step 4: The main controller sends a request message to the blockchain node;
[0067] Step 5: The blockchain node sends an interaction strategy group to the general controller according to the request information.
[0068] The blockchain-based nursing home of the present application uses an intelligent interaction method to set the interaction strategy group corresponding to each face on the blockchain to prevent tampering by others.
[0069] In this embodiment, before the master controller obtains the restored facial image, the blockchain-based intelligent interaction method for nursing homes further includes:
[0070] The general controller obtains generation policy request information, wherein the generation policy request information includes basic information of the applicant, the first face image, the second face image and basic policy information;
[0071] The general controller determines whether the person is eligible for policy generation based on the basic information of the applicant, the first face image, and the second face image. If so,
[0072] The main controller obtains the interaction strategy group information to be uploaded to the chain;
[0073] The general controller stores the interaction strategy group information to be uploaded to the blockchain on the blockchain node;
[0074] The main controller uses the acquired facial image as the preset facial image and associates the blockchain node with the preset facial image.
[0075] In this embodiment, when generating the interactive strategy group information, it needs to be clear who generates it and who monitors it. For example, since the nursing home is full of elderly people, the elderly may not be able to operate the interactive equipment correctly. Therefore, in theory, an assistant is needed to help with the setting. In this case, it can be guaranteed that the generated basic strategy information is correct and reasonable.
[0076] In this embodiment, the application obtains two facial images (the first facial image and the second facial image), one of which is the facial image of the operator, generally speaking, the staff of the nursing home, that is, the person who intends to help the elderly set the interaction strategy, and the other facial image is the facial image of the elderly for whom the interaction strategy is set. In this way, it can be ensured that when setting the interaction strategy, on the one hand, it can prevent the elderly from not knowing how to operate, and on the other hand, it can prevent the staff from operating without the care of the elderly.
[0077] In this embodiment, the first face image and the second face image can also be obtained through a camera device, which will not be described in detail here.
[0078] In this embodiment, the general controller determines whether there is a policy generation qualification according to the basic information of the person applying for modification, the first face image and the second face image, including:
[0079] Acquire a face comparison database for judgment, wherein the face comparison database for judgment includes a plurality of paired face image groups, each face image group includes two preset face images for judgment;
[0080] Comparing the first facial image with each preset facial image in each pair of facial image groups for similarity;
[0081] Comparing the second facial image with each preset facial image in each set of paired facial images for similarity;
[0082] Determine whether the similarity between a preset face image in the same set of paired face images and one of the first face image or the second face image exceeds a preset threshold and the similarity between another preset face image in the same set of paired face images and the other of the first face image or the second face image exceeds a preset threshold, if so, then
[0083] Determine eligibility for strategy generation.
[0084] In this embodiment, the face comparison database for judgment can be set in advance. For example, a unit sets one or more employees as the persons who have the right to help with the operation, and the elderly in the nursing home are also entered into the preset face comparison database at the same time. For example, a nursing home has 3 elderly people and one operating employee, namely employee A, elderly B, elderly C, and elderly D. Then the face comparison database for judgment will have 4 paired face image groups, namely (employee A, elderly B), (employee A, elderly C), and (employee A, elderly D).
[0085] In this embodiment, the similarity comparison of face images adopts conventional technical means, which will not be described in detail here.
[0086] In this embodiment, the general controller stores the interaction strategy group information to be uploaded to the blockchain on the blockchain node, including:
[0087] Convert the control logic in the interaction strategy group information into a hash code;
[0088] Store the hash code in the block of the blockchain node.
[0089] This approach ensures that the various interaction strategies on the blockchain will not be tampered with by unauthorized personnel. No matter who it is, they can only call up the interaction strategy but cannot modify it. If the interaction strategy needs to be modified or added, both facial recognitions must be successful before they can be added or modified.
[0090] In this embodiment, before the master controller obtains the restored facial image, the blockchain-based intelligent interaction method for nursing homes includes:
[0091] The sensing device obtains the sensing information and transmits it to the main controller;
[0092] The main controller generates shooting information according to the sensing information and transmits it to the camera device;
[0093] The camera device takes pictures according to the shooting information, and transmits the taken initial pictures to the main controller;
[0094] The main controller obtains an initial face image from the initial captured image;
[0095] The main controller carefully repairs the initial face image to obtain a repaired face image.
[0096] In this embodiment, the general controller carefully repairs the initial face image to obtain the repaired face image, including:
[0097] Acquire a trained repair neural network, wherein the repair neural network includes an encoder and a decoder, and the decoder includes a multi-stage fusion module;
[0098] The main controller inputs the initial face image into the encoder to extract features of the face image;
[0099] The main controller inputs the facial image features into the decoder to obtain a restored facial image.
[0100] The nursing home of the present application uses an intelligent interaction method to obtain the information of the elderly through image recognition, and reads different interaction strategies according to the different information of the elderly, so as to provide a suitable interaction strategy for each elderly person, such as providing text interaction strategies for deaf-mute elderly people, and providing voice interaction strategies for visually impaired elderly people, etc. In addition, the present application repairs facial images by setting up a multi-level fusion module, thereby preventing the problem of blurred facial images caused by shaking of the elderly.
[0101] In this embodiment, if the initial face image cannot be acquired in the initial captured image, prompt information is generated, and the prompt information may be voice prompt information and / or text prompt information.
[0102] In this embodiment, the present application adopts a GAN network. The GAN network in this embodiment includes an encoder and a decoder, wherein the decoder further includes a multi-stage fusion module.
[0103] In this embodiment, the initial face image enters the encoder to obtain face image features, and the face image features are input into the decoder. After the fusion features are generated in the multi-level fusion module in the decoder, the fusion features are input into the fully connected layer to obtain the repaired face image.
[0104] In this embodiment, the multi-stage fusion module includes a pooling splicing module, a first processing module, a second processing module, a third processing module, a linear transformation module, an activation feature module, a multiplication module and an addition module, wherein:
[0105] The pooling and splicing module is used to pool and splice the facial image features provided by the encoder to form a first feature;
[0106] The first processing module is used for performing a first processing on the first feature, so as to obtain a second feature;
[0107] The second processing module is used for performing a second processing on the first feature to form a third feature;
[0108] The third processing module is used to add the second feature and the third feature and perform a convolution operation to obtain a fourth feature;
[0109] The linear transformation module is used to perform a linear transformation on the fourth feature, thereby obtaining a linear transformation feature;
[0110] The activation feature module is used to perform Sigmoid activation on the fourth feature, so as to obtain the activation feature;
[0111] The multiplication module is used to multiply the linear transformation feature with the activation feature to obtain a fifth feature;
[0112] The adding module is used to add the fifth feature to the fourth feature to obtain a final fusion feature.
[0113] In this embodiment, the first processing module includes an average pooling module, a maximum pooling module, a first splicing module, a position attention mechanism module and an upsampling module, wherein:
[0114] The average pooling module is used to perform average pooling on the first feature, so as to obtain an average pooling feature;
[0115] The maximum pooling module is used to perform maximum pooling on the first feature, so as to obtain the maximum pooling feature;
[0116] The first splicing module is used to splice the average pooling feature and the maximum pooling feature to obtain a first splicing feature;
[0117] The position attention mechanism module is used to perform position self-attention operation on the first splicing feature;
[0118] The upsampling module is used to upsample the first splicing feature that performs the position self-attention operation to obtain the second feature.
[0119] In this embodiment, the second processing module includes an anti-overflow module and a channel attention mechanism module, wherein:
[0120] The anti-overflow module is used to perform an anti-overflow process on the first feature;
[0121] The channel attention mechanism module is used to perform channel self-attention operation on the first feature after anti-overflow processing to obtain the third feature.
[0122] The multi-level fusion module of the present application is adopted, and an upsampling module is added after the position self-attention operation through parallel average pooling and maximum pooling operations and serial channel dimension Concat splicing operations; an anti-overflow module operation is added in front of the Softmax activation function of the channel self-attention operation, and the minimum value of the activation value is limited to zero to enhance the features, thereby solving the problem that the position attention mechanism has a large amount of calculation due to the large image size and the nonlinear activation of the channel attention mechanism deviates from the sensitive area. And through the multi-level fusion module, the multi-resolution convolution features extracted from the low-definition input image and the generative face prior features extracted from the generator are fused, which can better balance the restoration of the face area and the image background, fully restore the details of the original low-definition image, and maintain the fidelity of the face.
[0123] In this embodiment, after acquiring the sensing information transmitted by the sensing device, the method of the present application further includes:
[0124] Get the surrounding brightness information;
[0125] Determine whether the ambient brightness information exceeds a preset brightness threshold, if not,
[0126] First fill light information is generated and sent to a first fill light device, so that the first fill light device adjusts the brightness according to the first fill light information.
[0127] In this embodiment, the first fill light device is a fill light device built into the intelligent interactive device, that is, the first fill light device will not illuminate the entire room, but will only illuminate the area in front of the intelligent interactive device, that is, the area captured by the camera device.
[0128] In this embodiment, each of the interaction strategy groups includes a dim environment interaction strategy and a clear environment interaction strategy, and the intelligent interaction method for the nursing home further includes:
[0129] Get the ambient brightness information in the room;
[0130] Determine whether the ambient brightness information in the room exceeds a preset brightness threshold, if not,
[0131] Selecting the dim environment interaction strategy;
[0132] Determine whether the ambient brightness information in the room exceeds a preset brightness threshold, and if so,
[0133] The clear environment interaction strategy is selected.
[0134] In a scenario, a user may use an interactive device in the dark or in dim light (for example, the curtains are completely or partially drawn). At this time, although the human body image may be captured by the first fill light device, the surrounding environment may still be dim, and this dimness may cause some adverse effects, such as damaging the user's eyesight, especially when the user's eyesight is poor, the surrounding environment is dim, and only the fluorescent screen is bright, it will be more difficult to see things clearly. Therefore, by adopting different interaction strategies in different situations, it is possible to distinguish the way to treat users in dim environments and clear environments.
[0135] In this embodiment, when the interaction strategy group is a dim environment interaction strategy, the intelligent interaction method for the nursing home further includes:
[0136] Obtain basic user information pre-stored in the dim environment interaction strategy;
[0137] Determine whether the user can communicate in a dim environment based on the user's basic information. If not,
[0138] Determine whether to generate auxiliary lighting information based on the ambient brightness information. If so,
[0139] Generate auxiliary lighting information and send it to the auxiliary lighting device.
[0140] In a dim environment, if the user uses voice interaction, the actual environment does not affect the user's interaction. Therefore, the pre-stored basic information of the user can be used to understand whether the user can use voice and other environments that do not require human vision.
[0141] In this embodiment, the perception device may be a sensor, for example, a foot-kick AR sensor commonly used in vehicles.
[0142] In this embodiment, a preset face image is associated with an interaction strategy group. For example, a user named Zhang San is provided with a preset face image and an interaction strategy group. The interaction strategy group may have multiple interaction strategies. For example, in one embodiment, Zhang San's interaction strategy group includes a dim environment interaction strategy and a clear environment interaction strategy. In this embodiment, both the dim environment interaction strategy and the clear environment interaction strategy pre-store Zhang San's user basic information. The user basic information may include the following:
[0143] Zhang San's interaction preferences (for example, voice interaction or text interaction);
[0144] Zhang San's physical condition (e.g., deafness, poor eyesight, difficulty moving, etc.);
[0145] Zhang San's underlying medical conditions (e.g., heart disease, cerebral thrombosis, etc.);
[0146] Zhang San's language preference (e.g., Mandarin, Cantonese).
[0147] In this embodiment, the specific interaction content of the interactive device of the present application when the user interacts is not within the protection scope of the present application, and therefore, it will not be described in detail here.
[0148] In this embodiment, judging whether the user can communicate in a dim environment according to the basic information of the user may be performed in the following manner:
[0149] Example 1: Determine whether Zhang San is deaf based on his physical condition. If not, it is considered that he can communicate through voice, and is judged to be able to communicate in a dim environment.
[0150] Example 2: Determine whether Zhang San likes voice interaction based on interaction preferences. If so, it is considered that he can communicate through voice, and it is determined that he can communicate in a dim environment.
[0151] It is understandable that other judgment conditions may also be set, which will not be described in detail here.
[0152] In this embodiment, if it is determined that the user is unable to communicate in a dim environment, auxiliary lighting information is generated and sent to the auxiliary lighting device.
[0153] In this embodiment, the auxiliary lighting device here can be the light of the room itself or other auxiliary lighting device that can illuminate the room and is set in the room and is connected to the communication of this application.
[0154] In this embodiment, the intelligent interaction method for a nursing home further includes:
[0155] Extracting an image of a human figure part in the image according to the acquired initial captured image;
[0156] Get the trained behavior classifier;
[0157] Extracting posture features of posture information of the image of the human figure part;
[0158] The posture feature is input into the behavior classifier to obtain a behavior classification label, wherein the behavior classification label includes a fall label. When the classification label is a fall label, it is determined that the human figure in the image is in a fall state.
[0159] When the human figure in the image is in a fallen state and the similarity between the restored face image and each of the preset face images is calculated, and it is determined that a similarity value of a similarity exceeds a preset threshold, the intelligent interaction method for the nursing home further includes:
[0160] Acquire an emergency response strategy library, wherein the emergency response strategy library includes at least one preset face image and basic information of a user corresponding to each face image;
[0161] Obtain interaction methods based on user basic information;
[0162] Generate interactive actions using the acquired interactive methods;
[0163] After a preset time, determine whether someone has fed back interaction information based on the interaction action, and if so,
[0164] Analyze the interaction information to determine whether help is needed from others. If so,
[0165] Determine whether the help information can be obtained according to the interaction information, and if so,
[0166] Generate alarm information and send the alarm information and help information to the main control console.
[0167] In some embodiments, the reason why the user wakes up the interactive device may be because the user needs help, such as when the user suffers from a sudden illness (fall, fracture, cerebral thrombosis, myocardial infarction, etc.). At this time, the user may be able to perform simple operations (wake up the smart interactive device), but may not be able to communicate much, for example, he or she may not be able to speak a lot or interact in text.
[0168] At this time, the user's status can be identified through image recognition. If the user is judged to have fallen through the classification label, the interaction method is obtained according to the user's basic information. For example, if the user is judged to be deaf according to the user's basic information, the interaction action is generated by text interaction, that is, the text is displayed on the screen. At this time, the database used for the interaction is the emergency response strategy library. The interaction strategies stored in the emergency response strategy library are all simple and urgent strategies. For example, in the interaction process, whether it is voice interaction or text interaction, multiple-choice questions or question-and-answer questions are used. For example, in one example, the voice interaction is: Do you need to call the police? Or do you need to notify the management staff? In this way, the user only needs to say yes or no.
[0169] Alternatively, several selection boxes can be directly displayed in text format: 1. Call the police; 2. First aid; 3. Notify the management staff.
[0170] This method allows users to interact in the simplest way.
[0171] In this embodiment, if the user can provide feedback based on the interactive action, that is, feedback interactive information, it means that the user can also perform some simple communication. At this time, interactive actions can be generated, such as asking about the condition, asking about the situation, and other voice or text information. At this time, if the user can also provide feedback on the condition, rest, and situation information, these condition information or situation information will be sent to the main console as help information.
[0172] If you cannot obtain this help information, you can also send the alarm information directly to the main console.
[0173] In some cases, even the simplest method may not be able to achieve interaction between the user and the interactive device. For example, if the user suddenly has asthma, he may not be able to speak at all. At this time, if voice interaction is used, the user may not be able to provide any feedback. In this case, the method of the present application further includes:
[0174] After a preset time, determine whether someone has fed back interaction information based on the interaction action. If not,
[0175] Generate alarm information and send the alarm information and user basic information to the main console.
[0176] In this way, the safety of users can be guaranteed to the greatest extent.
[0177] Although the present application is disclosed as above in terms of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.
[0178] Finally, it should be pointed out that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application is described in detail with reference to the above embodiments, a person skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A blockchain-based intelligent interaction method for nursing homes, characterized in that: The blockchain-based intelligent interaction method for nursing homes includes: The main controller obtains the restored face image; The main controller obtains a storage database, wherein the storage database includes at least one preset face image and a blockchain node corresponding to each preset face image; The main controller obtains a blockchain node corresponding to a preset face image whose similarity with the restored face image exceeds a preset threshold; The main controller sends a request message to the blockchain node; The blockchain node sends an interaction strategy group to the general controller according to the request information; Before the master controller obtains the restored facial image, the blockchain-based intelligent interaction method for a nursing home further includes: The general controller obtains generation policy request information, wherein the generation policy request information includes basic information of the applicant, the first face image, the second face image and basic policy information; The general controller determines whether the person is eligible for policy generation based on the basic information of the applicant, the first face image, and the second face image. If so, The main controller obtains the interaction strategy group information to be uploaded to the chain; The general controller stores the interaction strategy group information to be uploaded to the blockchain on the blockchain node; The main controller uses the acquired facial image as the preset facial image and associates the blockchain node with the preset facial image; The general controller determines whether a person is eligible for policy generation according to the basic information of the person applying for modification, the first face image and the second face image: Acquire a face comparison database for judgment, wherein the face comparison database for judgment includes a plurality of paired face image groups, each face image group includes two preset face images for judgment, and one of the preset face images for judgment is a preset face image for judgment of a person who has the right to assist in the operation; Comparing the first facial image with each preset facial image in each pair of facial image groups for similarity; Comparing the second facial image with each preset facial image in each set of paired facial images for similarity; Determine whether the similarity between a preset face image in the same set of paired face images and one of the first face image or the second face image exceeds a preset threshold and the similarity between another preset face image in the same set of paired face images and the other of the first face image or the second face image exceeds a preset threshold, if so, then Determine eligibility for strategy generation.
2. The blockchain-based intelligent interaction method for nursing homes as claimed in claim 1, characterized in that: The general controller stores the interaction strategy group information to be uploaded to the blockchain on the blockchain node, including: Convert the control logic in the interaction strategy group information into a hash code; Store the hash code in the block of the blockchain node.
3. The blockchain-based intelligent interaction method for nursing homes as claimed in claim 2, characterized in that: Before the master controller obtains the restored facial image, the blockchain-based intelligent interaction method for the nursing home includes: The sensing device obtains the sensing information and transmits it to the main controller; The main controller generates shooting information according to the sensing information and transmits it to the camera device; The camera device takes pictures according to the shooting information, and transmits the taken initial pictures to the main controller; The main controller obtains an initial face image from the initial captured image; The main controller carefully repairs the initial face image to obtain a repaired face image.
4. The blockchain-based intelligent interaction method for nursing homes as claimed in claim 3, characterized in that: The general controller repairs the initial face image to obtain a repaired face image, which includes: Acquire a trained repair neural network, wherein the repair neural network includes an encoder and a decoder, and the decoder includes a multi-stage fusion module; The main controller inputs the initial face image into the encoder to extract features of the face image; The main controller inputs the facial image features into the decoder to obtain a restored facial image.
5. The blockchain-based intelligent interaction method for nursing homes as claimed in claim 4, characterized in that: The multi-stage fusion module includes: A pooling and splicing module, wherein the pooling and splicing module is used to perform pooling and splicing on the facial image features provided by the encoder to form a first feature; A first processing module, the first processing module is used to perform a first processing on the first feature, so as to obtain a second feature; a second processing module, the second processing module being used for performing a second processing on the first feature, thereby forming a third feature; a third processing module, configured to add the second feature to the third feature and perform a convolution operation to obtain a fourth feature; A linear transformation module, wherein the linear transformation module is used to perform a linear transformation on the fourth feature, thereby obtaining a linear transformation feature; An activation feature module, wherein the activation feature module is used to perform Sigmoid activation on the fourth feature, thereby obtaining an activation feature; A multiplication module, wherein the multiplication module is used to multiply the linear transformation feature and the activation feature to obtain a fifth feature; An adding module, wherein the adding module is used to add the fifth feature to the fourth feature to obtain a final fusion feature.
6. The blockchain-based intelligent interaction method for nursing homes as claimed in claim 5, characterized in that: The first processing module comprises: An average pooling module, wherein the average pooling module is used to perform average pooling on the first feature, thereby obtaining an average pooling feature; A maximum pooling module, wherein the maximum pooling module is used to perform maximum pooling on the first feature, thereby obtaining a maximum pooling feature; A first splicing module, wherein the first splicing module is used to splice the average pooling feature and the maximum pooling feature to obtain a first splicing feature; A position attention mechanism module, wherein the position attention mechanism module is used to perform a position self-attention operation on the first splicing feature; An upsampling module is used to upsample the first splicing feature that performs the position self-attention operation, so as to obtain a second feature.
7. The blockchain-based intelligent interaction method for nursing homes as claimed in claim 6, characterized in that: The second processing module comprises: an anti-overflow module, the anti-overflow module being used to perform an anti-overflow process on the first feature; A channel attention mechanism module, wherein the channel attention mechanism module is used to perform a channel self-attention operation on the first feature that has been processed with anti-overflow, so as to obtain a third feature.
Citation Information
Patent Citations
Intelligent door access control system based on blockchain
CN109493470A
Identity verification method and device based on face recognition, equipment and storage medium
CN112330331A
Face recognition method and device based on block chain, equipment and storage medium
CN112699799A
Analysis method and analysis device of pension authentication data based on block chain, equipment and medium
CN113487468A
Walking assistance navigation method and system for people with visual impairment in nursing home
CN116698045A
