Psychological rehabilitation training method and device, storage medium and electronic equipment

Abstract

The invention relates to a psychological rehabilitation training method and device, a storage medium and electronic equipment, and relates to the technical field of psychological rehabilitation, and the method comprises the steps that the psychological disease type and the group type of a psychological disease patient are acquired, and the psychological disease patient wears AR equipment; according to the group type, a virtual interaction role matched with the psychological disease patient is generated, and the virtual interaction role is an AR virtual role which replaces a psychologist to interact and communicate with the psychological disease patient; according to the psychological disease type, determining a target rehabilitation training scene matched with the psychological disease patient; and setting an AR virtual scene in the AR equipment as a target rehabilitation training scene, and based on a first interaction mode of the AR equipment, performing communication interaction with the psychological disease patient through a virtual interaction role in the AR virtual scene so as to perform rehabilitation training on the psychological disease patient. Psychological rehabilitation training can be carried out on patients with psychological diseases in a targeted mode, and the psychological rehabilitation training effect is improved.

Description

Technical Field

[0001] The present application relates to the field of psychological rehabilitation technology, and in particular to a psychological rehabilitation training method, device, storage medium and electronic equipment. Background Art

[0002] With the development and progress of society, people's life pressure is increasing. Mental health problems have gradually attracted widespread attention. Among them, mental health problems refer to abnormalities or disorders in an individual's psychology, emotions, behavior, etc. These abnormalities or disorders affect the individual's normal life and function. Mental health problems include many types, such as anxiety, depression, obsessive-compulsive disorder, schizophrenia, etc. These problems may be caused by a variety of factors, including genetic, environmental, and social factors. Symptoms of mental health problems may include depression, anxiety, abnormal behavior, cognitive impairment, etc. Therefore, there is an urgent need for a way to conduct effective psychological rehabilitation training for patients with mental illness.

[0003] At present, the commonly used psychological rehabilitation training method is: psychologists conduct one-on-one interactive communication with patients with mental illnesses, and provide effective psychological counseling for patients with mental illnesses to achieve the purpose of psychological rehabilitation training. However, based on this method, many patients with mental illnesses are ashamed to tell their true thoughts to psychologists due to psychological reasons, making it impossible for psychologists to accurately understand the true psychological conditions of patients with mental illnesses, resulting in the inability to carry out targeted psychological rehabilitation training for patients with mental illnesses, and the effect of psychological rehabilitation training is poor. Summary of the invention

[0004] In order to carry out psychological rehabilitation training for patients with mental illness in a targeted manner and improve the effect of psychological rehabilitation training, the present application provides a psychological rehabilitation training method, device, storage medium and electronic device.

[0005] In a first aspect of the present application, a psychological rehabilitation training method is provided, which specifically comprises: Obtaining a mental illness type and a group type of a mental illness patient, wherein the mental illness patient wears an AR device; Generate a virtual interactive character that matches the patient with mental illness according to the group type, wherein the virtual interactive character is an AR virtual character that replaces the psychologist to interact and communicate with the patient with mental illness; According to the type of mental illness, determining a target rehabilitation training scene that matches the mental illness patient, wherein the target rehabilitation training scene is a virtual scene that can relax the mental illness patient physically and mentally; The AR virtual scene in the AR device is set as the target rehabilitation training scene, and based on the first interaction mode of the AR device, the virtual interactive character in the AR virtual scene communicates and interacts with the mental illness patient to perform rehabilitation training on the mental illness patient.

[0006] By adopting the above technical solution, after obtaining the mental illness type and group type of mental illness patients, first generate a virtual interactive character suitable for mental illness patients, or mental illness patients who are interested in it, according to the group type, and then determine the targeted target rehabilitation training scene according to the mental illness type, so that mental illness patients can better relax their body and mind in this target rehabilitation training scene, and finally set the AR virtual scene as the target rehabilitation training scene, and use virtual interactive characters to replace psychologists to communicate and interact with mental illness patients in the AR virtual scene to conduct psychological counseling, so that mental illness patients have a stronger sense of immersion during communication and interaction, thereby achieving more targeted psychological rehabilitation training for mental illness patients and better rehabilitation training effects.

[0007] Optionally, determining a target rehabilitation training scenario matching the patient with the mental illness according to the type of mental illness specifically includes: Determining at least one first rehabilitation training scenario according to the type of mental illness; Obtaining the condition grade of the mental illness patient, wherein the higher the condition grade, the more serious the condition of the mental illness patient; According to the disease level, determining the scene comfort level for the mental illness patient to perform rehabilitation training, the higher the disease level, the corresponding scene comfort level; Selecting a second rehabilitation training scene corresponding to the scene comfort level from each of the first rehabilitation training scenes, and determining a coordination level between each of the second rehabilitation training scenes and the virtual interactive character, wherein the higher the coordination level, the stronger the sense of immersion of the mental illness patient wearing the AR device; The second rehabilitation training scenario whose coordination level exceeds a preset level threshold is determined as a target rehabilitation training scenario matching the mental illness patient.

[0008] By adopting the above technical solution, since the higher the disease level is and the more serious the disease is, it is necessary to create a more relaxing rehabilitation training scene for patients with mental illness during rehabilitation training, so that the rehabilitation training effect will be better. Therefore, according to the disease level, the appropriate scene comfort level is determined, and then the corresponding second rehabilitation training scene is determined according to the scene comfort level. Furthermore, if the coordination level exceeds the level threshold, it means that the corresponding second rehabilitation training scene has a high degree of coordination with the virtual interactive character, which can bring a better immersive experience to patients with mental illness. Then the corresponding second rehabilitation training scene is determined as the target rehabilitation scene that matches this patient with mental illness, which can not only make the patient with mental illness relax better physically and mentally, but also have a better sense of immersion, making them more engaged in communication and interaction with the virtual interactive character, which helps to improve the effect of rehabilitation training.

[0009] Optionally, the method further includes: If each of the coordination levels does not exceed the level threshold, determining an associated group type of the group type; The virtual interactive character corresponding to the group type is replaced by the target interactive character corresponding to the associated group type.

[0010] By adopting the above technical solution, if the coordination level corresponding to each second rehabilitation training scene does not exceed the level threshold, it means that the coordination degree between the virtual interactive character and each second rehabilitation training scene is low and the virtual interactive character needs to be replaced. Then, the associated group type of the group type of the mental illness patient is determined, and the virtual interactive character corresponding to the group type is replaced with the target interactive character corresponding to the associated group type. In this way, the interactive character can be adapted to the mental illness patient and the coordination with the rehabilitation training scene can be improved as much as possible.

[0011] Optionally, the method further includes: Obtaining semantic confirmation information of the mental illness patient on the interactive information that has been sent by the virtual interactive character, and when the number of the semantic confirmation information exceeds a preset number threshold, determining the semantic similarity between each of the semantic confirmation information and the corresponding interactive information that has been sent, the interactive information that has been sent being the interactive information that has been sent in the first interactive information set for the communication and interaction between the virtual interactive character and the mental illness patient; Counting a first number of first semantic confirmation information whose semantic similarity is lower than a preset similarity threshold in each of the semantic confirmation information, and counting a second number of second semantic confirmation information whose semantic similarity is not lower than the similarity threshold in each of the semantic confirmation information; If the first number is not less than the second number, determining a target interaction expression form that is easy for the mental illness patient to understand according to the semantic confirmation information; Adjusting the expression form of each interactive information in the first interactive information set to the target interactive expression form to obtain a second interactive information set, and re-communicating and interacting with the mental illness patient through the virtual interactive character according to the second interactive information set; A correspondence is established between the group type and the second interactive information set, and the sets are added to a preset interactive information recommendation table.

[0012] By adopting the above technical solution, if the first number is not less than the second number, and there are more first semantic confirmation information with different meanings from the corresponding sent interactive information, it means that the mental illness patient has a large deviation in the semantic understanding of more interactive information, and it is highly likely that the expression form of the interactive information is difficult for the mental illness patient to understand. Further, the expression form of each interactive information in the first interactive information set is adjusted to the target interactive expression form, and the second interactive information set is obtained by summarizing, that is, the semantics of the interactive information remains unchanged and only the expression form is adjusted, so as to facilitate the understanding of the mental illness patient and improve the effect of rehabilitation training.

[0013] Optionally, the method further includes: If the second number is greater than the first number, the interactive information currently sent by the virtual interactive character is replaced with the target interactive expression form until the rehabilitation training is completed, thereby obtaining a third interactive information set; Replacing the corresponding sent interaction information in the first interaction information set with the second semantic confirmation information to obtain a corresponding fourth interaction information set, and combining the third interaction information set with the fourth interaction information set to obtain a fifth interaction information set; A correspondence is established between the group type and the fifth interactive information set, and the sets are added to a preset interactive information recommendation table.

[0014] By adopting the above technical solution, if the second number is greater than the first number, and there are more second semantic confirmation information that are close to the corresponding interactive information that has been sent, it means that the mental illness patient has a smaller deviation in semantic understanding of more interactive information, and the interactive information in the first interactive information set can be understood by the mental illness patient in terms of expression form, but it is not the most suitable for the semantic understanding needs of the mental illness patient. Furthermore, the expression form of the interactive information currently sent by the virtual interactive character is replaced with the target interactive expression form, so that the communication and interaction fluency in the subsequent rehabilitation training process is higher. Finally, a corresponding relationship is established between the group type and the fifth interactive information set, and it is added to the preset interactive information recommendation table to determine the interactive information that best fits this group type.

[0015] Optionally, the method further includes: If a mode switching instruction sent by the AR device is obtained, the first interactive mode is switched to a second interactive mode, where the second interactive mode is an interactive mode for conducting rehabilitation training in a game manner; Determine corresponding rehabilitation training games according to the type of mental illness; Running the rehabilitation training game through the AR device and counting the duration of the game for the mental illness patient; The initial comfort level of the treatment chair on which the mental illness patient sits is adjusted according to the duration of the game.

[0016] By adopting the above technical solution, if the mode switching instruction sent by the AR device is obtained, it means that the mental illness patient has low enthusiasm for communication and interaction in the first interactive mode, then the first interactive mode is switched to the second interactive mode, that is, the interactive mode of rehabilitation training in the form of games. Furthermore, the longer the game lasts, the more likely the mental illness patient will become fatigued, and the comfort will decrease. Finally, according to the duration of the game, the initial comfort level of the treatment chair where the mental illness patient sits is adjusted, so as to promptly eliminate the problem of reduced comfort in the rehabilitation training of the second interactive mode and ensure the effect of rehabilitation training for mental illness patients.

[0017] Optionally, adjusting the initial comfort level of the treatment chair where the mental illness patient sits according to the duration of the game specifically includes: According to the condition level of the mental illness patient, determining the initial comfort level of the treatment chair where the mental illness patient sits, wherein the higher the condition level, the higher the corresponding initial comfort level; Determine the game fatigue duration corresponding to the game type of the rehabilitation training game, and judge whether the game duration exceeds the game fatigue duration; If so, the level adjustment amount is determined according to the difference between the game duration and the game fatigue duration, and the initial comfort level is increased by the level adjustment amount.

[0018] By adopting the above technical solution, the initial comfort level suitable for mental illness patients sitting in the treatment chair is determined according to the disease level. The higher the disease level and the more serious the disease, the more comfortable the mental illness patient needs to be when sitting in the treatment chair, and the higher the corresponding initial comfort level. Furthermore, if the duration of the game exceeds the game fatigue duration, it means that the mental illness patient is likely to become fatigued, and the comfort during rehabilitation training will decrease. Therefore, it is necessary to further improve the comfort level, ensure the rehabilitation training effect, and improve the initial comfort level of the treatment chair.

[0019] In a second aspect of the present application, a psychological rehabilitation training device is provided, which specifically comprises: A type acquisition module, used to acquire the mental illness type and group type of a mental illness patient, wherein the mental illness patient wears an AR device; A role generation module, used to generate a virtual interactive role matching the mental illness patient according to the group type, wherein the virtual interactive role is an AR virtual role that replaces the psychologist to interact and communicate with the mental illness patient; A scene determination module, used to determine a target rehabilitation training scene that matches the mental illness patient according to the type of mental illness, wherein the target rehabilitation training scene is a virtual scene that can relax the mental illness patient physically and mentally; A rehabilitation training module is used to set the AR virtual scene in the AR device as the target rehabilitation training scene, and based on the first interaction mode of the AR device, communicate and interact with the mental illness patient through the virtual interactive character in the AR virtual scene to perform rehabilitation training on the mental illness patient.

[0020] By adopting the above technical solution, the type acquisition module obtains the type of mental illness and the group type. Then the role generation module generates a virtual interactive role suitable for patients with mental illness according to the group type. Then the scene determination module determines the matching target rehabilitation training scene according to the type of mental illness. Finally, the rehabilitation training module sets the AR virtual scene in the AR device as the target rehabilitation training scene, and communicates and interacts with patients with mental illness through virtual interactive characters instead of psychologists.

[0021] In a third aspect of the present application, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is loaded and executed by a processor, the method steps described in any one of the first aspects are performed.

[0022] In a fourth aspect of the present application, an electronic device is provided, specifically comprising: A processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the processor is used to load and execute the computer program stored in the memory so that the electronic device performs the method as described in any one of the first aspects.

[0023] To summarize, the present application includes at least one of the following beneficial technical effects: after obtaining the mental illness type and group type of mental illness patients, first, based on the group type, a virtual interactive character suitable for the mental illness patients, or a virtual interactive character that is of interest to the mental illness patients, is generated; then, based on the mental illness type, a targeted target rehabilitation training scene is determined, so that the mental illness patients can better relax their body and mind in this target rehabilitation training scene; finally, the AR virtual scene is set as the target rehabilitation training scene, and the virtual interactive character is used to replace the psychologist to communicate and interact with the mental illness patients in the AR virtual scene to conduct psychological counseling, so that the mental illness patients have a stronger sense of immersion during communication and interaction, thereby achieving more targeted psychological rehabilitation training for mental illness patients and better rehabilitation training effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a flowchart of a psychological rehabilitation training method provided in an embodiment of the present application; Figure 2 It is a flowchart of another psychological rehabilitation training method provided in an embodiment of the present application; Figure 3 It is a structural schematic diagram of a psychological rehabilitation training device provided in an embodiment of the present application; Figure 4 It is a structural schematic diagram of another psychological rehabilitation training device provided in an embodiment of the present application.

[0025] Explanation of the accompanying drawings: 11. Type acquisition module; 12. Character generation module; 13. Scene determination module; 14. Rehabilitation training module; 15. Character optimization module; 16. First interaction module; 17. Second interaction module; 18. Comfort adjustment module. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0027] In the description of the embodiments of the present application, words such as "illustrative", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "illustrative", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "illustrative", "for example" or "for example" is intended to present related concepts in a concrete way.

[0028] In the description of the embodiments of the present application, the term "and / or" is only a kind of association relationship describing the associated objects, indicating that there may be three kinds of relationships, for example, A and / or B, which can represent: A exists alone, B exists alone, and A and B exist at the same time. In addition, unless otherwise specified, the meaning of the term "multiple" refers to two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the indicated technical features. Thus, the features defined as "first" and "second" can explicitly or implicitly include one or more of the features. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0029] See also Figure 1 The present application embodiment discloses a flowchart of a psychological rehabilitation training method, which can be implemented by a computer program or run on a psychological rehabilitation training device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application, specifically including: S101: Obtain mental illness types and group types of mental illness patients, where the mental illness patients wear AR devices.

[0030] Specifically, in an embodiment of the present application, a patient with a mental illness is a mental patient who wears an augmented reality (AR) device in a mental rehabilitation room and undergoes mental rehabilitation training. A treatment chair is provided in the mental rehabilitation room, and the patient with a mental illness sits on the treatment chair for mental rehabilitation training. The treatment chair can adjust the comfort, which is mainly achieved by adjusting the seat back angle of the treatment chair, so that the patient with a mental illness can be more comfortable and relaxed when undergoing mental rehabilitation training on the treatment chair, and assist in achieving better mental rehabilitation training effects. Among them, the AR device can be AR glasses, which is a device that combines eyes and AR technology, integrates AR functions into glasses, thereby giving the wearer a better immersive experience, and can specifically be vision pro glasses. In other embodiments, the AR device can also be a head-mounted AR device, which uses a head-mounted display to project virtual images into the user's field of view. Alternatively, in another embodiment, the patient with a mental illness can also wear a virtual reality (VR) device.

[0031] In addition, the execution subject of a psychological rehabilitation training method disclosed in an embodiment of the present application is a server, which is wirelessly connected to an AR device. A client related to psychological rehabilitation training is installed in the AR device. The server is a background server of the client, which can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. Furthermore, a feasible way to obtain the type of mental illness and group type of patients with mental illness is to receive the type of mental illness and group type sent by a psychologist's terminal, and the terminal can be a smart phone or a personal computer. Exemplarily, the type of mental illness can be an emotional disorder type; the group type can be children.

[0032] S102: Generate a virtual interactive character that matches the mental illness patient according to the group type, where the virtual interactive character is an AR virtual character that replaces the psychologist to interact and communicate with the mental illness patient.

[0033] Specifically, after the group type to which the mental illness patient belongs is determined, the role type corresponding to this group type is matched from the preset role type matching table in the database, all of which are set based on human experience. Then, a virtual interactive character matching this role type is generated through the preset Make-A-Character tool, which is an AR virtual character that replaces the psychologist to interact and communicate or conduct psychological counseling with the mental illness patient. At the same time, the generated virtual interactive character is matched with the mental illness patient, that is, a virtual character that the mental illness patient is interested in. Exemplarily, if the group type is children, the matching virtual interactive character is an image of a small animal or a cartoon character. Among them, the AR virtual character is a digital character image created by combining AR technology and 3D modeling, which can interact with users in an augmented reality environment. It should be noted that the use of virtual interactive characters that mental illness patients are interested in for communication and interaction is more targeted and the effect of rehabilitation training is better.

[0034] S103: Determine a target rehabilitation training scene that matches the mental illness patient according to the type of mental illness, where the target rehabilitation training scene is a virtual scene that can relax the mental illness patient physically and mentally.

[0035] Specifically, since the effect of psychological rehabilitation training for patients with mental illness is not only related to the object of providing rehabilitation training, but also to the environment in which the patients with mental illness are located, the higher the comfort level brought to the patients with mental illness by the environment, the more relaxed the patients with mental illness are, and the better the rehabilitation training effect is. Therefore, after the type of mental illness of this patient with mental illness is determined, the target rehabilitation training scene corresponding to the type of mental illness is matched from the rehabilitation training scene matching table preset in the database, so as to determine the appropriate rehabilitation training scene that can adapt to this patient with mental illness, so as to relax the mental illness patient physically and mentally to a certain extent, and improve the effect of the rehabilitation training process. The rehabilitation training scene matching table includes different types of mental illnesses and corresponding rehabilitation training scenes, all of which are set based on human experience. It should be noted that in an embodiment of the present application, the target rehabilitation training scene can be a 2D virtual scene, for example, a two-dimensional image of "boundless grassland" and a two-dimensional image of "starry night". In other embodiments, the target rehabilitation training scene can be a 3D virtual scene.

[0036] S104: Setting the AR virtual scene in the AR device as a target rehabilitation training scene, and based on the first interaction mode of the AR device, communicating and interacting with the mental illness patient through the virtual interactive character in the AR virtual scene to assist the mental illness patient in rehabilitation training.

[0037] Specifically, after the virtual interactive role and the target rehabilitation training scene are determined, the target rehabilitation training is set as an AR virtual scene in the AR device, that is, the target rehabilitation training scene is integrated into the real environment of the patient with mental illness through the AR device, so that the patient with mental illness feels that he is in the target rehabilitation training scene, and the immersion is stronger. The specific process of setting is: sending the target rehabilitation training scene to the AR device, and using the AR device to integrate the target rehabilitation training scene with the user's real environment using real-time rendering technology. Through the AR device, the patient with mental illness can see the visual effect of the target rehabilitation training scene superimposed on the real environment. Further, the AR device is controlled to enter the first interactive mode, that is, the mode of communicating and interacting with the patient with mental illness through the virtual interactive role. The model file corresponding to the virtual interactive role is imported into the AR device, and at the same time, the psychological rehabilitation training AI model is used to drive this virtual interactive role to communicate and interact with the patient with mental illness in the AR virtual scene. The AI ​​model adopts the CrewAI model, and the psychological rehabilitation training AI model is the trained CrewAI model. The training process is: the communication and interaction scheme corresponding to this type of mental illness is used as a training sample, and input into the CrewAI model for training to obtain the psychological rehabilitation training AI model. The communication and interaction scheme includes the interactive information and interactive tone of the virtual interactive characters, etc. When the mental illness patient wears the AR device, the virtual interactive characters of interest will appear in the field of vision for targeted communication, interaction and psychological counseling, thus achieving targeted psychological rehabilitation training for the mental illness patient and avoiding the general rehabilitation training method of one-on-one psychological counseling by psychologists.

[0038] In other embodiments, during the communication and interaction between the virtual interactive character and the mental illness patient, semantic confirmation information of the mental illness patient for the interactive information sent by the virtual interactive character is obtained, indicating that the mental illness patient is uncertain about the meaning of the corresponding interactive information sent. The voice confirmation information is the semantic information of the mental illness patient's self-understanding of the interactive information sent. The interactive information sent is the interactive information that has been sent in the first interactive information set for the communication and interaction between the virtual interactive character and the mental illness patient. The first interactive information set is generated in advance by the psychological rehabilitation training AI model.

[0039] A feasible way to obtain the information is: the virtual interactive character sends out one interactive message, the patient with mental illness speaks out the corresponding semantic confirmation information, and the speech recognition system of the AR device collects and recognizes the speech of the patient with mental illness, and finally obtains the semantic confirmation information. If the number of semantic confirmation information exceeds the preset number threshold, it means that the mental patient is uncertain about the meaning of more interactive information, then the semantic similarity between each semantic confirmation information and the corresponding interactive information that has been sent is determined. A feasible way to determine it is: the semantic confirmation information and the corresponding interactive information that has been sent are respectively mapped into vectors in a multidimensional space through the Word2Vec model, and then the cosine similarity between two adjacent ones is calculated, so as to finally determine the semantic similarity.

[0040] Each semantic similarity is compared with a preset similarity threshold. If the semantic similarity is lower than the similarity threshold, it means that the meanings expressed by the semantic confirmation information and the corresponding interactive information that has been sent are far different, and the corresponding semantic confirmation information is determined as the first semantic confirmation information; otherwise, the meanings expressed by the semantic confirmation information and the corresponding interactive information that has been sent are relatively close, and the corresponding semantic confirmation information is confirmed as the second semantic confirmation information. Next, the first number of first semantic confirmation information and the second number of second semantic confirmation information in each semantic confirmation information are counted. If the first number is not less than the second number, there are many first semantic confirmation information with different meanings from the corresponding interactive information that has been sent, indicating that the mental illness patient has a large deviation in the semantic understanding of more interactive information, and it is highly likely that the expression form of the interactive information is difficult for the mental illness patient to understand. Then, according to the voice confirmation information sent by the mental illness patient himself, the target interactive expression form that is easy for the mental illness patient to understand is determined. The specific process is: input the voice confirmation information into the preset expression form determination model to obtain the corresponding target interactive expression form. The expression form determination model is a trained convolutional neural network model, which is mainly trained by inputting text information marked with the corresponding expression form as a sample into the convolutional neural network model. Furthermore, the expression form of each interactive information in the first interactive information set is adjusted to the target interactive expression form, and the second interactive information set is obtained by summarizing, that is, the semantics of the interactive information remains unchanged, only the expression form is adjusted, so as to facilitate the understanding of patients with mental illness. Further, based on the interactive information in this second interactive information set, communication and interaction with patients with mental illness are re-performed through virtual interactive characters to improve the effect of rehabilitation training. Finally, a corresponding relationship is established between this group type and the second interactive information set, and added to the interactive information recommendation table, so as to facilitate subsequent encounters with psychological patients of the same group type, and directly select more accurate interactive information from the interactive information recommendation table for interactive communication, thereby improving the effect of rehabilitation training to a certain extent.

[0041] Furthermore, if the second number is greater than the first number, and there are more second semantic confirmation information with similar meanings to the corresponding interactive information that has been sent, it means that the mental illness patient has a smaller deviation in the semantic understanding of more interactive information, and the interactive information in the first interactive information set is understandable to the mental illness patient in terms of expression form, but it is not the most in line with the semantic understanding needs of the mental illness patient. In this case, the expression form of the interactive information currently sent by the virtual interactive character is replaced with the target interactive expression form until the rehabilitation training is completed, and finally the third interactive information set is obtained, so that the communication and interaction in the subsequent rehabilitation training process is more fluent and the effect is better, and the mental illness patient is prevented from sending semantic confirmation information again.

[0042] Furthermore, the sent interactive information in the first interactive information set is directly replaced with the corresponding second semantic confirmation information to obtain a fourth interactive information set, and then the third interactive information set and the fourth interactive information set are integrated to obtain a fifth interactive information set, thereby obtaining interactive information that best fits the understanding needs of the mental illness patient. Finally, a corresponding relationship is established between the group type and the fifth interactive information set, and added to the preset interactive information recommendation table.

[0043] See also Figure 2 The present application embodiment discloses a flowchart of another psychological rehabilitation training method, which can be implemented by a computer program or run on a psychological rehabilitation training device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application, specifically including: S201: Obtain the mental illness type and group type of the mental illness patient, where the mental illness patient wears an AR device.

[0044] S202: Generate a virtual interactive character that matches the mental illness patient according to the group type, where the virtual interactive character is an AR virtual character that replaces the psychologist to interact and communicate with the mental illness patient.

[0045] For details, please refer to steps S101-S102, which will not be described in detail here.

[0046] S203: Determine at least one first rehabilitation training scenario according to the type of mental illness.

[0047] S204: Obtain the condition level of the mental illness patient. The higher the condition level, the more serious the mental illness patient's condition.

[0048] S205: Determine the scene comfort level for rehabilitation training of patients with mental illness according to the disease level. The higher the disease level, the higher the corresponding scene comfort level.

[0049] S206: Selecting a second rehabilitation training scene corresponding to the scene comfort level from each first rehabilitation training scene, and determining a coordination level between each second rehabilitation training scene and the virtual interactive character. The higher the coordination level, the stronger the sense of immersion of the mental illness patient wearing the AR device.

[0050] S207: Determine the second rehabilitation training scenario whose coordination level exceeds the preset level threshold as a target rehabilitation training scenario matching the mental illness patient.

[0051] Specifically, according to the type of mental illness, the corresponding first rehabilitation training scene is matched from the scene matching table preset in the database, that is, the rehabilitation training scene with a high degree of fit with the type of illness. The scene matching table includes different types of mental illness and at least one corresponding rehabilitation training scene, all of which are set based on human experience. Then the disease level sent by the psychologist's terminal is obtained. The higher the disease level, the more serious the disease of the mental illness patient. Furthermore, due to the higher the disease level, it is necessary to create a more relaxing rehabilitation training scene for the mental illness patient during rehabilitation training, so that the rehabilitation training effect will be better. Therefore, the scene comfort level corresponding to the disease level is matched from the preset comfort level matching table. The comfort level matching table includes different disease levels and corresponding scene comfort levels, all of which are set based on human experience. Further, a second rehabilitation training scene corresponding to the scene comfort level is selected from each first rehabilitation training scene. In other embodiments, a second rehabilitation training scene with a comfort level higher than the scene comfort level can also be selected.

[0052] Furthermore, the coordination level between each second rehabilitation training scene and the virtual interactive character is determined. The higher the coordination level, the better the visual realism of the superposition of the second rehabilitation training scene and the virtual interactive character in the field of vision of patients with mental illness. The stronger the sense of immersion of patients with mental illness wearing AR devices, the more relaxed the body and mind can be, and the better the rehabilitation training effect. A feasible way to determine the coordination level: predict the coordination level through a trained coordination prediction model. The coordination prediction model can be a convolutional neural network model. In other embodiments, it can also be a recurrent neural network model. The training process is briefly described as follows: a combination of multiple rehabilitation training scenes and virtual interactive characters marked with coordination levels are used as training samples and input into the convolutional neural network model. The model continuously learns the ability to judge the coordination of roles and scenes, and finally obtains a trained coordination prediction model. This is a prior art and will not be repeated here.

[0053] If the coordination level exceeds the preset level threshold, it means that the corresponding second rehabilitation training scene has a high degree of coordination with the virtual interactive character, which can bring a better immersion experience to the mental illness patient. Then the corresponding second rehabilitation training scene is determined as the target rehabilitation scene that matches the mental illness patient, which can not only make the mental illness patient relax better physically and mentally, but also have a better sense of immersion, making them more engaged in the communication and interaction with the virtual interactive character, which helps to improve the effect of rehabilitation training.

[0054] If the coordination levels corresponding to each second rehabilitation training scenario do not exceed the level threshold, it means that the degree of coordination between the virtual interactive character and each second rehabilitation training scenario is low, then the associated group type of the group type of patients with mental illness is determined, and the virtual interactive character corresponding to the group type is replaced with the target interactive character corresponding to the associated group type. One way to determine the associated group type is: from the hospital's historical mental illness treatment records, obtain the first historical disease type and the first historical cause of the historical patients corresponding to this group type, obtain the second historical disease type and the second historical cause of the historical patients of other group types, determine the first historical disease type that appears most frequently in the historical patients corresponding to this group type as the first prone type, and determine the first historical cause that appears most frequently as the first prone cause. Similarly, determine the second prone type and the second prone cause corresponding to historical patients of other group types. If the second most likely type is the same as the first most likely type, and the second most likely cause is the same as the first most likely cause, and the first proportion of the first most likely type whose cause is the first most likely cause in all occurrences of the first most likely type is calculated, and the second proportion of the second most likely type whose cause is the second most likely cause in all occurrences of the second most likely type is calculated, if the absolute value of the difference between the first proportion and the second proportion is less than the difference threshold, it means that the two proportions are relatively close, and the corresponding other group types are determined as associated group types.

[0055] S208: Setting the AR virtual scene in the AR device as a target rehabilitation training scene, and based on the first interactive mode of the AR device, communicating and interacting with the mental illness patient through the virtual interactive character in the AR virtual scene to assist the mental illness patient in rehabilitation training.

[0056] For details, please refer to step S105, which will not be described in detail here.

[0057] In other embodiments, during the communication and interaction between the virtual interactive character and the patient with mental illness, if the mode switching instruction sent by the AR device is obtained, it means that the patient with mental illness has low enthusiasm for the communication and interaction in the first interactive mode, then the first interactive mode is switched to the second interactive mode, that is, the interactive mode of rehabilitation training in the form of games. Due to different disease types, the rehabilitation training games adapted to the corresponding patients are different. For example, for patients with anxiety disorders, the type of rehabilitation training game is usually a decompression type game; for patients with depression, the type of rehabilitation training game is a role-playing type game. Therefore, according to matching the game type corresponding to the mental illness type from the preset game type matching table, the game type matching table includes different mental illness types and corresponding game types, all of which are set based on human experience, and then the game set corresponding to this game type is screened from the preset game library, and the game with the highest rehabilitation training effect evaluation level for other patients with mental illness types is selected from it, and determined as the corresponding rehabilitation training game, and the rehabilitation training effect evaluation level is the effect evaluation level given by the psychologist for the rehabilitation training effect under the second interactive mode.

[0058] Furthermore, the rehabilitation training game is run in the form of cloud gaming through an AR device, and the duration of the game of the mental illness patient is counted. The longer the game duration is, the more likely the mental illness patient is to become fatigued. Then, according to the duration of the game, the initial comfort level of the treatment chair where the mental illness patient sits is adjusted, that is, the current comfort level of the treatment chair. The initial treatment level is determined by: according to the disease level, the initial comfort level suitable for the mental illness patient to sit in the treatment chair is determined. The higher the disease level is, the more serious the disease is, the more comfortable the mental illness patient needs to sit in the treatment chair, and the higher the corresponding initial comfort level is. The initial comfort level corresponding to the disease level is mainly matched from the level matching table. The level matching table includes different disease levels and corresponding initial comfort levels, all of which are set based on human experience. Further, the game fatigue time corresponding to the game type of the rehabilitation training game is matched from the preset time matching table. The time matching table includes different game types and corresponding game fatigue time. Different game types have different game fatigue time. For example, the game fatigue time of first-person type games is relatively short.

[0059] Furthermore, if the duration of the game exceeds the game fatigue duration, patients with mental illness are likely to become fatigued, and the comfort during rehabilitation training will decrease. Therefore, it is necessary to further improve the comfort, ensure the effectiveness of rehabilitation training, and improve the initial comfort level of the treatment chair. Specifically, according to the difference between the duration of the game and the fatigue duration of the game, according to the relationship mapping table between the difference and the comfort level adjustment amount, determine the reasonable level adjustment amount, and finally increase the initial comfort level by the level adjustment amount to obtain the target comfort level. A feasible implementation method is: match the target seat angle corresponding to this target comfort level from the seat angle matching table, and adjust the seat angle of the treatment chair to the target seat angle. The seat angle matching table includes different comfort levels and corresponding seat angles.

[0060] The implementation principle of a psychological rehabilitation training method in an embodiment of the present application is as follows: after obtaining the psychological disease type and group type of a psychological disease patient, first, based on the group type, a virtual interactive character suitable for the psychological disease patient, or a virtual interactive character that is of interest to the psychological disease patient, is generated; then, based on the psychological disease type, a targeted target rehabilitation training scene is determined, so that the psychological disease patient can better relax his or her body and mind in this target rehabilitation training scene; finally, the AR virtual scene is set as the target rehabilitation training scene, and a virtual interactive character is used to replace a psychologist to communicate and interact with the psychological disease patient in the AR virtual scene to conduct psychological counseling, so that the psychological disease patient has a stronger sense of immersion during communication and interaction, thereby achieving a more targeted psychological rehabilitation training for the psychological disease patient and a better effect of the rehabilitation training.

[0061] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0062] See also Figure 3 , which is a schematic diagram of the structure of the psychological rehabilitation training device provided in the embodiment of the present application. The application in the psychological rehabilitation training device can be realized as all or part of the device through software, hardware or a combination of both. The device includes a type acquisition module 11, a role generation module 12, a scene determination module 13 and a rehabilitation training module 14.

[0063] A type acquisition module 11 is used to acquire the mental illness type and group type of the mental illness patient, where the mental illness patient wears an AR device; The role generation module 12 is used to generate a virtual interactive role that matches the mental illness patient according to the group type, and the virtual interactive role is an AR virtual role that replaces the psychologist to interact and communicate with the mental illness patient; A scene determination module 13 is used to determine a target rehabilitation training scene that matches the mental illness patient according to the type of mental illness, wherein the target rehabilitation training scene is a virtual scene that can relax the mental illness patient physically and mentally; The rehabilitation training module 14 is used to set the AR virtual scene in the AR device as a target rehabilitation training scene, and based on the first interactive mode of the AR device, communicate and interact with the mental illness patient through the virtual interactive character in the AR virtual scene to provide rehabilitation training for the mental illness patient.

[0064] Optionally, the scene determination module 13 is specifically configured to: Determine at least one first rehabilitation training scenario based on the type of mental illness; Obtain the condition level of the patient with mental illness, the higher the condition level, the more serious the condition of the patient with mental illness; According to the disease level, determine the scene comfort level for mental illness patients to undergo rehabilitation training. The higher the disease level, the higher the corresponding scene comfort level. Selecting a second rehabilitation training scene corresponding to the scene comfort level from each first rehabilitation training scene, and determining the coordination level between each second rehabilitation training scene and the virtual interactive character. The higher the coordination level, the stronger the immersion of the mental illness patient wearing the AR device. A second rehabilitation training scenario whose coordination level exceeds a preset level threshold is determined as a target rehabilitation training scenario that matches the mental illness patient.

[0065] Optional, such as Figure 4 As shown, the device also includes a role optimization module 15, which is specifically used to: If each coordination level does not exceed the level threshold, the associated group type of the group type is determined; Replace the virtual interactive role corresponding to the group type with the target interactive role corresponding to the associated group type.

[0066] Optionally, the device further includes a first interaction module 16, which is specifically configured to: Obtaining semantic confirmation information of the mental illness patient on the interactive information that has been sent by the virtual interactive character, and when the number of semantic confirmation information exceeds a preset number threshold, determining the semantic similarity between each semantic confirmation information and the corresponding interactive information that has been sent, the interactive information that has been sent being the interactive information that has been sent in the first interactive information set for the communication and interaction between the virtual interactive character and the mental illness patient; Counting a first number of first semantic confirmation information whose semantic similarity is lower than a preset similarity threshold in each semantic confirmation information, and counting a second number of second semantic confirmation information whose semantic similarity is not lower than the similarity threshold in each semantic confirmation information; If the first number is not less than the second number, determining a target interactive expression form that is easy for the mental illness patient to understand based on the semantic confirmation information; Adjusting the expression form of each interactive information in the first interactive information set to a target interactive expression form to obtain a second interactive information set, and re-communicating and interacting with the mental illness patient through a virtual interactive character according to the second interactive information set; A correspondence is established between the group type and the second interactive information set, and the set is added to a preset interactive information recommendation table.

[0067] Optionally, the device further includes a second interaction module 17, which is specifically used to: If the second number is greater than the first number, the interactive information currently sent by the virtual interactive character is replaced with the target interactive expression form until the rehabilitation training is completed, thereby obtaining a third interactive information set; Replacing the corresponding sent interaction information in the first interaction information set with the second semantic confirmation information to obtain a corresponding fourth interaction information set, and combining the third interaction information set with the fourth interaction information set to obtain a fifth interaction information set; A corresponding relationship is established between the group type and the fifth interactive information set, and the set is added to the preset interactive information recommendation table.

[0068] Optionally, the device further includes a comfort adjustment module 18, which is specifically used for: If a mode switching instruction sent by the AR device is obtained, the first interactive mode is switched to the second interactive mode, where the second interactive mode is an interactive mode for conducting rehabilitation training in a gaming manner; Determine the corresponding rehabilitation training game according to the type of mental illness; Run rehabilitation training games through AR devices and count the duration of games played by patients with mental illness; Adjust the initial comfort level of the treatment chair used by patients with mental illness based on the duration of the game.

[0069] Optionally, the comfort adjustment module 18 is specifically used for: According to the disease level of the mental illness patient, the initial comfort level of the treatment chair where the mental illness patient sits is determined. The higher the disease level, the higher the corresponding initial comfort level. Determine the game fatigue duration corresponding to the game type of the rehabilitation training game, and judge whether the game duration exceeds the game fatigue duration; If so, the level adjustment amount is determined based on the difference between the game duration and the game fatigue duration, and the initial comfort level is increased by the level adjustment amount.

[0070] It should be noted that the psychological rehabilitation training device provided in the above embodiment only uses the division of the above functional modules as an example when executing the psychological rehabilitation training method. In actual applications, the above functional distribution can be completed by different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the psychological rehabilitation training device provided in the above embodiment and the psychological rehabilitation training method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0071] The embodiment of the present application further discloses a computer-readable storage medium, and the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, a psychological rehabilitation training method of the above embodiment is adopted.

[0072] Among them, the computer program can be stored in a computer-readable medium, the computer program includes computer program code, the computer program code can be in the form of source code, object code, executable file or certain middleware, etc. The computer-readable medium includes any entity or device that can carry the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the computer-readable medium includes but is not limited to the above-mentioned components.

[0073] Among them, through this computer-readable storage medium, a psychological rehabilitation training method of the above embodiment is stored in a computer-readable storage medium, and is loaded and executed on a processor to facilitate the storage and application of the above method.

[0074] The embodiment of the present application also discloses an electronic device, in which a computer program is stored in a computer-readable storage medium, and when the computer program is loaded and executed by a processor, the above-mentioned psychological rehabilitation training method is adopted.

[0075] The electronic device may be a desktop computer, a laptop computer, a cloud server or other electronic device, and the electronic device includes but is not limited to a processor and a memory. For example, the electronic device may also include input and output devices, a network access device, and a bus.

[0076] Among them, the processor can adopt a central processing unit (CPU). Of course, according to actual usage, other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. can also be adopted. The general-purpose processor can adopt a microprocessor or any conventional processor, etc., and this application does not impose any restrictions on this.

[0077] Among them, the memory can be an internal storage unit of the electronic device, such as a hard disk or memory of the electronic device, or it can be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital card (SD) or a flash memory card (FC) equipped on the electronic device. Moreover, the memory can also be a combination of an internal storage unit and an external storage device of the electronic device. The memory is used to store computer programs and other programs and data required by the electronic device. The memory can also be used to temporarily store data that has been output or is to be output, and this application does not impose any restrictions on this.

[0078] Among them, through this electronic device, a psychological rehabilitation training method of the above embodiment is stored in the memory of the electronic device, and is loaded and executed on the processor of the electronic device, which is convenient for use.

[0079] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of other embodiments of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are only regarded as exemplary, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A psychological rehabilitation training method, characterized in that: The method comprises: Obtaining a mental illness type and a group type of a mental illness patient, wherein the mental illness patient wears an AR device; Generate a virtual interactive character that matches the patient with mental illness according to the group type, wherein the virtual interactive character is an AR virtual character that replaces the psychologist to interact and communicate with the patient with mental illness; Determining, according to the type of mental illness, a target rehabilitation training scene that matches the mental illness patient, wherein the target rehabilitation training scene is a virtual scene that can relax the mental illness patient physically and mentally; The AR virtual scene in the AR device is set as the target rehabilitation training scene, and based on the first interaction mode of the AR device, the virtual interactive character in the AR virtual scene communicates and interacts with the mental illness patient to perform rehabilitation training on the mental illness patient.

2. The psychological rehabilitation training method according to claim 1, characterized in that: Determining a target rehabilitation training scenario matching the patient with the mental illness according to the type of mental illness specifically includes: Determining at least one first rehabilitation training scenario according to the type of mental illness; Obtaining the condition grade of the mental illness patient, wherein the higher the condition grade, the more serious the condition of the mental illness patient; According to the disease level, determining the scene comfort level for the mental illness patient to perform rehabilitation training, the higher the disease level, the corresponding scene comfort level; Selecting a second rehabilitation training scene corresponding to the scene comfort level from each of the first rehabilitation training scenes, and determining a coordination level between each of the second rehabilitation training scenes and the virtual interactive character, wherein the higher the coordination level, the stronger the sense of immersion of the mental illness patient wearing the AR device; The second rehabilitation training scenario whose coordination level exceeds a preset level threshold is determined as a target rehabilitation training scenario matching the mental illness patient.

3. The psychological rehabilitation training method according to claim 2, characterized in that: The method further comprises: If each of the coordination levels does not exceed the level threshold, determining an associated group type of the group type; The virtual interactive character corresponding to the group type is replaced by the target interactive character corresponding to the associated group type.

4. The psychological rehabilitation training method according to claim 1, characterized in that: The method further comprises: Obtaining semantic confirmation information of the mental illness patient on the interactive information that has been sent by the virtual interactive character, and when the number of the semantic confirmation information exceeds a preset number threshold, determining the semantic similarity between each of the semantic confirmation information and the corresponding interactive information that has been sent, the interactive information that has been sent being the interactive information that has been sent in the first interactive information set for the communication and interaction between the virtual interactive character and the mental illness patient; Counting a first number of first semantic confirmation information whose semantic similarity is lower than a preset similarity threshold in each of the semantic confirmation information, and counting a second number of second semantic confirmation information whose semantic similarity is not lower than the similarity threshold in each of the semantic confirmation information; If the first number is not less than the second number, determining a target interaction expression form that is easy for the mental illness patient to understand according to the semantic confirmation information; Adjusting the expression form of each interactive information in the first interactive information set to the target interactive expression form to obtain a second interactive information set, and re-communicating and interacting with the mental illness patient through the virtual interactive character according to the second interactive information set; A correspondence is established between the group type and the second interactive information set, and the sets are added to a preset interactive information recommendation table.

5. The psychological rehabilitation training method according to claim 4, characterized in that: The method further comprises: If the second number is greater than the first number, the interactive information currently sent by the virtual interactive character is replaced with the target interactive expression form until the rehabilitation training is completed, thereby obtaining a third interactive information set; Replacing the corresponding sent interaction information in the first interaction information set with the second semantic confirmation information to obtain a corresponding fourth interaction information set, and combining the third interaction information set with the fourth interaction information set to obtain a fifth interaction information set; A correspondence is established between the group type and the fifth interactive information set, and the sets are added to a preset interactive information recommendation table.

6. The psychological rehabilitation training method according to claim 1, characterized in that: The method further comprises: If a mode switching instruction sent by the AR device is obtained, the first interactive mode is switched to a second interactive mode, where the second interactive mode is an interactive mode for conducting rehabilitation training in a game manner; Determine corresponding rehabilitation training games according to the type of mental illness; Running the rehabilitation training game through the AR device and counting the duration of the game for the mental illness patient; The initial comfort level of the treatment chair on which the mental illness patient sits is adjusted according to the duration of the game.

7. The psychological rehabilitation training method according to claim 6, characterized in that: The step of adjusting the initial comfort level of the treatment chair on which the patient with mental illness sits according to the duration of the game specifically includes: According to the condition level of the mental illness patient, determining the initial comfort level of the treatment chair where the mental illness patient sits, wherein the higher the condition level, the higher the corresponding initial comfort level; Determine the game fatigue duration corresponding to the game type of the rehabilitation training game, and judge whether the game duration exceeds the game fatigue duration; If so, the level adjustment amount is determined according to the difference between the game duration and the game fatigue duration, and the initial comfort level is increased by the level adjustment amount.

8. A psychological rehabilitation training device, characterized in that: include: A type acquisition module (11), used for acquiring the mental illness type and group type of a mental illness patient, wherein the mental illness patient wears an AR device; A role generation module (12) is used to generate a virtual interactive role that matches the mental illness patient according to the group type, wherein the virtual interactive role is an AR virtual role that replaces the psychologist to interact and communicate with the mental illness patient; A scene determination module (13) is used to determine a target rehabilitation training scene that matches the patient with the mental illness according to the type of the mental illness, wherein the target rehabilitation training scene is a virtual scene that can relax the patient with the mental illness physically and mentally; A rehabilitation training module (14) is used to set the AR virtual scene in the AR device as the target rehabilitation training scene, and based on the first interaction mode of the AR device, communicate and interact with the mental illness patient through the virtual interactive character in the AR virtual scene to perform rehabilitation training on the mental illness patient.

9. A computer-readable storage medium having a computer program stored therein, characterized in that: When the computer program is loaded and executed by a processor, the method according to any one of claims 1 to 7 is adopted.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, characterized in that: When the processor loads and executes the computer program, the method according to any one of claims 1 to 7 is adopted.

Images