Mental disorder man-machine interaction patient education method and equipment
Through human-computer interaction education methods and equipment for mental disorders, patients can independently select and understand symptoms, explain biological mechanisms, integrate symptom information to determine diagnosis and treatment plans, solving the problems of low education efficiency and large resource utilization in the existing technology. Improve treatment compliance and efficiency of medical resource utilization.
Patent Information
- Application Number
- CN202410991885.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-29
AI Technical Summary
The prior art is difficult to efficiently educate patients with mental disorders, resulting in low treatment compliance, excessive medical resources, and difficulty for patients to accurately understand the condition and treatment plans.
Provides a human-computer interaction patient education method and equipment for mental disorders, displaying symptom information of multiple mental disorders through electronic devices, allowing patients to select and understand symptoms on their own, play multimedia information to explain biological mechanisms, and integrate symptom information to determine diagnosis and Treatment plan.
It has achieved independent understanding of the disease, improved treatment compliance, reduced the burden on medical staff, improved rehabilitation effect, ensured the efficiency of medical resource utilization, and provided doctors with accurate diagnostic information.
Smart Images

Figure CN119049661A_ABST
Abstract
Description
Technical Field
[0001] The disclosed embodiments relate to the field of auxiliary medical technology, and more particularly to a method and device for educating patients with mental disorders through human-computer interaction. Background Art
[0002] Mental disorder refers to the disorder of brain function, which leads to different degrees of mental disorders such as cognition, emotion, behavior and will. Common ones include affective mental disorder and organic brain mental disorder. There are many factors causing the disease: congenital inheritance, personality characteristics and physical factors, organic factors, social environmental factors, etc. Many patients with mental disorders have delusions, hallucinations, illusions, emotional disorders, crying and laughing at random, talking to themselves, strange behavior, and loss of will. The vast majority of patients lack self-awareness, do not admit that they are sick, and do not actively seek help from doctors.
[0003] In current clinical diagnosis and treatment, when patients with mental disorders visit doctors, they provide their medical history and describe their symptoms. Psychiatry currently diagnoses and treats based on the symptoms described by the patient's subjective feelings. In the process of clinical diagnosis and rehabilitation, it is usually necessary to help patients understand their condition and treatment plan, so as to improve treatment compliance and treatment effect. Compliance is very important in psychiatric treatment, and the realization of this goal requires patient education.
[0004] In the current education model for patients with mental disorders, doctors usually rely on verbal explanations. This method is not only time-consuming and inefficient, but also increases the workload of medical staff. In the current situation of overall shortage of medical resources, it occupies unnecessary medical resources, and it is often difficult to ensure that all patients can accurately understand their condition or treatment plan, because for patients with mental disorders, the individual differences in symptoms are strong, and the heterogeneity of mental disorders shows that even for the same mental disorder, the symptoms and treatment plans of different patients may be very different. Therefore, how to efficiently educate patients with mental disorders, ensure that patients accurately understand their condition or treatment plan, and reduce the workload of medical staff to avoid unnecessary medical resource occupation has become an important issue that needs to be solved urgently, but the industry is still blank in this regard. Summary of the invention
[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the embodiments of the present disclosure provide a method and device for educating patients with mental disorders through human-computer interaction.
[0006] In a first aspect, an embodiment of the present disclosure provides a method for educating patients with mental disorders through human-computer interaction, the method being applied to an electronic device, comprising:
[0007] In response to a first trigger operation, a first user interface is displayed, wherein the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information;
[0008] In response to the patient's selection operation of target symptom information, displaying clinical characteristics of the symptom corresponding to the target symptom information and at least one mental disorder information related to the target symptom information, wherein the target symptom information is one or more symptom information selected from the plurality of different first symptom information;
[0009] In response to a second trigger operation of the patient on second symptom information, the first multimedia information is played, the first multimedia information being used to display and explain a biological mechanism corresponding to a symptom identified by the second symptom information, the second symptom information being any one of the target symptom information, and the symptom identified by the second symptom information corresponding to at least one biological mechanism;
[0010] In response to the third trigger operation, symptom integration result information is displayed and saved, wherein the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information ultimately selected and determined by the patient from the target symptom information.
[0011] In one embodiment, the method further comprises:
[0012] In response to a fourth trigger operation, displaying a second user interface, the second user interface displays at least one diagnosis result, the at least one diagnosis result being determined based on the symptom integration result information;
[0013] In response to the doctor's selection operation on the target diagnosis result, the target diagnosis result is saved, and the target diagnosis result is one or more of the at least one diagnosis result.
[0014] In one embodiment, the method further comprises:
[0015] Based on the target diagnosis result, display at least one corresponding treatment plan, wherein the at least one treatment plan is determined based on the target diagnosis result;
[0016] In response to the doctor's selection operation of the target treatment plan, the target treatment plan is saved, and the action mechanism corresponding to the target treatment plan is displayed, and the target treatment plan is one or more of the at least one treatment plan;
[0017] Determine the common mechanism of action of all treatment options based on the mechanism of action corresponding to each treatment option in the target treatment option;
[0018] The common action mechanism is matched with each biological mechanism in the mechanism intersection in the symptom integration result information, and based on the matching results, the symptoms and treatment plans corresponding to each biological mechanism in the matching results are displayed, as well as the side effects caused by the biological mechanisms that do not exist in the patient.
[0019] In one embodiment, displaying the mechanism of action corresponding to the target treatment regimen includes:
[0020] In response to the doctor's triggering operation on any one of the target treatment plans, the second multimedia information is played, where the second multimedia information is used to demonstrate the specific mechanism of action of the treatment plan.
[0021] In one embodiment, the first multimedia information includes an animation that explains the neurotransmitter abnormality corresponding to the symptom identified by the second symptom information; different second symptom information corresponds to different first multimedia information; or, the second multimedia information includes an animation.
[0022] In one embodiment, the second symptom information at least includes symptom text description information; the method further includes:
[0023] The symptom text description information is input into a target generation model to obtain corresponding video content; wherein the target generation model is obtained by pre-training an original video generation model based on different symptom text description information of patients with different mental disorders; and the video content is used as the first multimedia information.
[0024] In one embodiment, the training process of the target generation model further includes: obtaining biological mechanism description information corresponding to the different symptom text description information, and training the original video generation model based on the biological mechanism description information and the different symptom text description information.
[0025] In a second aspect, the present disclosure provides a human-computer interaction education system for patients with mental disorders, including:
[0026] A symptom display module, configured to display a first user interface in response to a first trigger operation, wherein the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information;
[0027] a symptom selection module, configured to display, in response to a patient's selection operation of target symptom information, clinical characteristics of the symptom corresponding to the target symptom information and at least one mental disorder information related to the target symptom information, wherein the target symptom information is one or more symptom information selected from the plurality of different first symptom information;
[0028] a symptom explanation module, configured to play first multimedia information in response to a second trigger operation of the patient on second symptom information, wherein the first multimedia information is used to display and explain a biological mechanism corresponding to a symptom identified by the second symptom information, wherein the second symptom information is any one of the target symptom information, and the symptom identified by the second symptom information corresponds to at least one biological mechanism;
[0029] A symptom determination module is used to display and save symptom integration result information in response to a third trigger operation, wherein the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information ultimately selected and determined by the patient from the target symptom information.
[0030] In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for educating patients with mental disorders through human-computer interaction as described in any of the above embodiments.
[0031] In a fourth aspect, an embodiment of the present disclosure provides an electronic device, including:
[0032] Processor; and
[0033] Memory for storing computer programs;
[0034] Wherein, the processor is configured to execute the method for educating patients with mental disorders through human-computer interaction as described in any of the above-mentioned embodiments by executing the computer program.
[0035] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:
[0036] The human-computer interaction patient education method and device for mental disorders provided by the embodiment of the present disclosure, in response to a first trigger operation, displays a first user interface, the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information; in response to a patient's selection operation of target symptom information, displays the clinical characteristics of the symptoms corresponding to the target symptom information and at least one mental disorder information related to the target symptom information, wherein the target symptom information is one or more symptom information selected from the plurality of different first symptom information; in response to a second trigger operation of the patient on second symptom information, plays a first multimedia information, the first multimedia information is used to display and explain the biological mechanism corresponding to the symptom identified by the second symptom information, the second symptom information is any one of the symptom information in the target symptom information, and the symptom identified by the second symptom information corresponds to at least one biological mechanism; in response to a third trigger operation, displays symptom integration result information and saves the symptom integration result information, the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptom identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information finally selected and determined by the patient from the target symptom information. The solution of this embodiment can be operated and executed by the patient himself. The user interface displays multiple different symptom information belonging to multiple mental disorders. The patient selects the symptoms that he or she subjectively feels, namely the target symptom information. At this time, the clinical characteristics of the symptoms corresponding to the target symptom information and at least one related mental disorder information can be displayed. The patient can view and play multimedia information for each symptom information in the target symptom information. The multimedia information displays and explains the biological mechanism corresponding to the relevant symptoms, that is, explains the possible causes behind the symptoms. Finally, based on the clinical characteristics of the selected symptoms viewed by the patient and the multimedia information, the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by multiple symptom information finally determined from the target symptom information determines the symptom integration result information. In this way, an intuitive and highly interactive patient education program can be provided, and the education of patients with mental disorders can be efficiently realized, so that patients can accurately understand their condition, thereby effectively improving patients' compliance with treatment, and then improving the therapeutic effect of the rehabilitation process. At the same time, there is no need for oral explanations by doctors to educate patients, which reduces the workload of medical staff, avoids occupying medical resources, and realizes more efficient utilization of medical resources, filling the gap in the industry. In addition, determining the symptom integration result information, that is, integrating the possible common causes behind multiple different symptoms selected by the patient, can provide doctors with more precise information to facilitate accurate rehabilitation diagnosis results. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0039] Figure 1 This is a flow chart of the method for educating patients with mental disorders through human-computer interaction according to an embodiment of the present disclosure;
[0040] Figure 2 This is a flow chart of a method for educating patients with mental disorders through human-computer interaction according to another embodiment of the present disclosure;
[0041] Figure 3 This is a flow chart of a method for educating patients with mental disorders through human-computer interaction according to another embodiment of the present disclosure;
[0042] Figure 4 A schematic diagram of a human-computer interaction education system for patients with mental disorders according to an embodiment of the present disclosure;
[0043] Figure 5 Schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0044] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0045] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0046] It should be understood that, in the following, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items.
[0047] Figure 1The flowchart of a method for educating patients with mental disorders by human-computer interaction according to an embodiment of the present disclosure is shown in FIG. 1 . The method is applied to electronic devices such as electronic devices based on touch screens, but is not limited thereto. The method may specifically include the following steps:
[0048] Step S101: In response to a first trigger operation, a first user interface is displayed, wherein the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information.
[0049] In an example embodiment, the method can be specifically performed by a patient education application installed on an electronic device. When the application is started, the screen of the electronic device can display an initial user interface. The initial user interface can include a first selection control such as a virtual button for logging in a registered user, and a second selection control such as a virtual button for logging in an unregistered user. That is, in the initial user interface, the user is faced with button options to select "Log in with an existing ID" and "Register for a new ID". This interface is the starting point for the user to interact with the system. Optionally, after clicking to select "Log in with an existing ID", the user can be directed to the authentication interface. After entering the ID and password, the user can access his or her personal home interface. The personal home interface can include a virtual button of "New Assessment". Clicking to select "New Assessment" can enter the symptom selection module to start a new round of health assessment.
[0050] Specifically, when the user clicks to select "New Assessment", the system will automatically navigate to the symptom selection module, which can list various symptoms related to mental disorders. In the symptom selection module, the user will see a user interface containing multiple symptom information, namely the first user interface. The user can use a mouse or touch operation to interact with the first user interface. The first user interface can display multiple different first symptom information belonging to multiple mental disorders, such as symptom text description information, such as displaying one first symptom information in sequence from top to bottom. Each mental disorder corresponds to at least one first symptom information and a corresponding relationship table can be pre-established for storage and use. The multiple mental disorders may include but are not limited to schizophrenia, paranoid disorder, phobia, etc.
[0051] In other embodiments, if the user clicks on a virtual button that selects "Register New ID," the system will guide the user through the registration process, collect personal information such as name, ID number, etc., and create a new user account, and then enter the personal home page.
[0052] In some embodiments, the personal main interface may include a virtual button for "Historical Query", and the user may click and select "Historical Query". The system will display all historical evaluation dates related to the patient who has logged in with the existing ID, and the user may click on any date to view detailed historical evaluation results.
[0053] Step S102: In response to the patient's selection operation on the target symptom information, the clinical characteristics of the symptoms corresponding to the target symptom information and at least one mental disorder information related to the target symptom information are displayed, and the target symptom information is one or more symptom information selected from the multiple different first symptom information.
[0054] Exemplarily, on the first user interface displayed on the screen of the electronic device, when the user clicks on any interface area where the first symptom information is displayed, the system may display a brief introduction describing the clinical characteristics of the symptom. When the user clicks on other parts of the first user interface displayed on the screen of the electronic device, such as a partial display area outside the symptom information display area, the introduction may disappear automatically. That is, the patient clicks on a symptom from the multiple different first symptoms displayed, which can trigger the display of the description information of the clinical characteristics of the symptom for the patient to view and understand. Afterwards, the user can select and confirm his own symptoms by double-clicking on the interface area where a certain first symptom information is located. Once the patient believes that he has selected and confirmed all his relevant symptoms, he can click the "Finish" button on the first user interface, and then click the "OK" button to confirm the selected symptoms. All symptom information selected by the patient will be stored in the corresponding date record under the patient ID for future query and analysis. Exemplarily, all stored symptom information can be stored in the form of a symptom list.
[0055] Afterwards, the system can call the symptom list, read all the symptom information stored therein, and display all the first symptom information selected by the patient, i.e., the target symptom information, on the first user interface. For each selected symptom information, the system will display one or more possibly related mental disorder information, each mental disorder information identifying a mental disorder. The correspondence between these mental disorder information and symptom information is pre-stored in the system database and determined based on medical knowledge. In this embodiment, different symptoms can be displayed and listed for patients to select and confirm, and a simple introduction can be provided so that patients can better understand their possible mental disorder problems.
[0056] Step S103: In response to the patient's second trigger operation on the second symptom information, the first multimedia information is played, wherein the first multimedia information is used to display and explain the biological mechanism corresponding to the symptom identified by the second symptom information, the second symptom information is any one of the target symptom information, and the symptom identified by the second symptom information corresponds to at least one biological mechanism.
[0057] Exemplarily, the second trigger operation may be a click operation. When the patient clicks on any one of the selected first symptom information, i.e., the target symptom information, the system will play and display a multimedia information, which may include an animation explaining the abnormal neurotransmitter corresponding to the symptom identified by the second symptom information; different second symptom information corresponds to different first multimedia information. The multimedia information may explain the biological mechanism corresponding to the selected symptom, such as abnormal neurotransmitter, that is, explain the possible cause behind the symptom, especially from the perspective of neurotransmitter changes, which helps patients understand their condition more intuitively. This animation is intended to help patients accurately understand the biological mechanism behind the symptom, i.e., the possible cause. After watching the animation of a symptom, the user can choose to return to view and understand the related animations of other symptoms. Since each symptom in the target symptom is different, each symptom may correspond to at least one biological mechanism and the corresponding relationship is predetermined and stored, so different symptoms correspond to a different multimedia information to explain the possible biological mechanism behind each symptom, such as the cause, so that patients can deeply view and understand their possible mental disorders.
[0058] Step S104: In response to the third trigger operation, the symptom integration result information is displayed and saved, wherein the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information ultimately selected and determined by the patient from the target symptom information.
[0059] For example, the first user interface may include an "Integrate" button. When the patient clicks the "Integrate" button, the system will display a symptom integration result message, summarizing the common points of all the symptoms selected by the user and indicating the possible biological mechanisms corresponding to these symptoms. For example, "You have symptoms 1 and 3, and the possible corresponding mechanisms are: a, b, c, d, among which a, c and d are related to symptoms 1 and 3, and b is related to symptom 3."
[0060] Specifically, integration is achieved by taking the intersection of the biological mechanisms corresponding to the symptoms selected by the patient. For example, symptom 1 may have the abc mechanism, symptom 2 has the bcd mechanism, and symptom 3 has the acd mechanism. The patient selected both symptom 1 and symptom 3, so the possible mechanism is abcd. Therefore, the symptom integration result information may include symptom 1, symptom 3, and mechanism abcd. Integration can show patients how these selected symptoms appear in different mental illnesses. Integrating the possible biological mechanisms behind different symptoms, such as abnormal neurotransmitters, by taking the intersection method can provide doctors with more precise information to facilitate accurate diagnosis results.
[0061] The above scheme of this embodiment can be executed by the patient himself. The first user interface displays multiple different symptom information belonging to multiple mental disorders. The patient selects the symptoms that he or she subjectively feels, namely the target symptom information. At this time, the clinical characteristics of the symptoms corresponding to the target symptom information and at least one related mental disorder information can be displayed. The patient can view and play multimedia information for each symptom information in the target symptom information. The multimedia information displays and explains the biological mechanism corresponding to the relevant symptoms, that is, explains the possible causes behind the symptoms. Finally, based on the clinical characteristics of the selected symptoms viewed by the patient and the multimedia information, the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by multiple symptom information finally determined from the target symptom information is determined to determine the symptom integration result information. In this way, an intuitive and highly interactive patient education program can be provided, and the education of patients with mental disorders can be efficiently realized, so that patients can accurately understand their condition, thereby effectively improving patients' compliance with treatment, and then improving the therapeutic effect of the rehabilitation process. At the same time, there is no need for oral explanations by doctors to educate patients, which reduces the workload of medical staff, avoids occupying medical resources, and realizes more efficient utilization of medical resources, filling the gap in the industry. In addition, determining the symptom integration result information, that is, integrating the possible common causes behind multiple different symptoms selected by the patient, can provide doctors with more precise information to facilitate accurate rehabilitation diagnosis results.
[0062] In one embodiment, the method also includes: displaying a second user interface in response to a fourth trigger operation, the second user interface displaying at least one diagnostic result, the at least one diagnostic result being determined based on the symptom integration result information; and saving the target diagnostic result in response to a doctor's selection operation of a target diagnostic result, the target diagnostic result being one or more of the at least one diagnostic result.
[0063] Exemplarily, after the patient completes symptom integration, he clicks the "Enter Diagnosis and Treatment Guidance" button on the first user interface to enter the diagnosis and treatment process. At this time, the second user interface can be displayed, and the second user interface displays at least one diagnosis result. In this interface, the system automatically lists at least one possible diagnosis result determined based on the symptom integration result. The doctor can select and confirm the target diagnosis result among these diagnosis results, and the selected target diagnosis result will be saved for subsequent reference. This can provide the doctor with at least one preliminary diagnosis result, and the doctor can then select and confirm the final target diagnosis result based on professional knowledge, so that a more accurate rehabilitation diagnosis result can be obtained.
[0064] In one embodiment, reference Figure 2 As shown, the method may further include the following steps:
[0065] Step S201: Based on the target diagnosis result, display at least one corresponding treatment plan, wherein the at least one treatment plan is determined based on the target diagnosis result;
[0066] Step S202: In response to the doctor's selection operation of the target treatment plan, the target treatment plan is saved, and the action mechanism corresponding to the target treatment plan is displayed, and the target treatment plan is one or more of the at least one treatment plan;
[0067] Step S203: determining a common mechanism of action of all treatment schemes based on the mechanism of action corresponding to each treatment scheme in the target treatment scheme;
[0068] Step S204: Match the common action mechanism with each biological mechanism in the mechanism intersection in the symptom integration result information, and display the symptoms and treatment plans corresponding to each biological mechanism in the matching results based on the matching results, as well as the side effects caused by the biological mechanisms that do not exist in the patient.
[0069] Specifically, according to the target diagnosis result determined by the doctor, a series of treatment plans such as drug treatment plans or other treatment plans can be displayed for the doctor to choose. The doctor can select one or more treatment plans as target treatment plans and save the selected target treatment plans.
[0070] In response to a doctor's triggering operation, such as a click operation, on any one of the target treatment plans, the electronic device plays second multimedia information, where the second multimedia information is used to demonstrate the specific mechanism of action of the treatment plan, and the second multimedia information includes animation.
[0071] That is, for the target treatment plan, the corresponding mechanisms of action, such as biological mechanisms, of the various treatment plans contained therein can be read and displayed. The doctor can click on any treatment plan, and the system will display the specific mechanism of action of the plan in an animated form for the doctor to understand. In some embodiments, an animated display of the treatment plan and the pathogenic mechanism can also be performed: click the "Next" training button, the system will read all previously stored symptoms and all integrated biological mechanisms corresponding to the patient ID, and animate how clicking on a selected treatment plan corresponds to these pathogenic mechanisms, that is, all integrated biological mechanisms and side effects. The doctor can return to select other treatment plans at any time, and the system will display the corresponding treatment mechanism animation.
[0072] Doctors can click the "Integrate" button, and the system will outline the common mechanisms of action of all treatment options and match them with all existing biological mechanisms of the patient. Based on the matching results, the system will mark the symptoms and treatment options corresponding to each mechanism, as well as the side effects that may be caused by the patient's non-existent mechanisms. For example, the mechanism of treatment option I is abe, and the mechanism of treatment option II is bcd, then the common mechanism of the treatment options is abcde, and the patient's existing mechanism is abcd. Then mark separately what symptoms and treatment options a corresponds to, what symptoms and treatment options b corresponds to..., and what problems such as side effects may be caused by the patient's non-existent mechanism e.
[0073] The scheme in this embodiment can display the mechanism of action of multiple treatment plans on the patient's neuropsychiatric system according to the multiple treatment plans selected by the doctor, determine the matching of the common mechanism of action with the patient's existing mechanism, and thus determine the symptoms of each treatment plan corresponding to the patient and the underlying mechanism and possible side effects, so as to assist the doctor in finally determining the appropriate treatment plan and thus improve the treatment effect of the rehabilitation process. In addition, the scheme in this embodiment can help non-psychiatric doctors to intuitively, deeply and accurately understand the psychiatric problems existing in patients with possible comorbidities in other departments, such as some patients with physical diseases such as cardiovascular diseases and endocrine diseases, so as to determine the appropriate treatment plan and improve the treatment effect.
[0074] In some embodiments, the doctor can further click the "End and Save" button, and the system will save the current diagnosis and treatment session and return to the main interface. In the main interface, the doctor can choose to conduct a new assessment or query the historical records. By clicking the "Switch User" button in any interface, the doctor can exit the current session and switch to an interface with the option to create a new ID or log in to an existing ID.
[0075] Based on any of the above embodiments, in one embodiment, reference Figure 3 As shown, the second symptom information may at least include symptom text description information. Accordingly, the method may also include: inputting the symptom text description information into a target generation model to obtain corresponding video content; wherein the target generation model is obtained by pre-training an original video generation model based on different symptom text description information of patients with different mental disorders; and using the video content as the first multimedia information.
[0076] Exemplarily, the second symptom information is any one of the target symptom information selected by the patient, and for each second symptom information, the biological mechanism behind the corresponding symptom is explained through multimedia information. However, each second symptom information selected by different patients is very likely to be different, because the individual differences of symptoms are strong, and the heterogeneity of mental illness shows that even for the same disease, the symptom manifestations and treatment responses of different patients may be very different. Therefore, when educating the biological mechanisms behind the symptoms selected by patients through multimedia information such as animation explanations, it is necessary to adapt to the specific needs and preferences of the patients. In this embodiment, customized educational content, i.e., the first multimedia information, is accurately generated according to the unique clinical symptoms selected by each patient, so as to accurately explain one or more biological mechanisms corresponding to each symptom, reduce erroneous interpretations, and thus provide personalized and accurate patient education, which helps patients with mental disorders to understand their condition more accurately, effectively improve patients' compliance with treatment, and thus improve the treatment effect.
[0077] Specifically, the original video generation model is iteratively trained based on different symptom text description information of different mental disorder patients in advance, such as updating the parameters of the original video generation model based on the first loss value, the first loss value identifies the difference between the symptom text description information and the symptom description information in the output video content, and the target generation model, i.e., the video generation model, is obtained by training in this way. The video generation model processes each symptom information, i.e., the symptom text description information, selected by the actual patient to generate corresponding video content, and the video content is used to display and explain one or more biological mechanisms corresponding to each corresponding symptom. In this way, accurate video content can be generated based on each symptom selected by the patient to accurately explain one or more biological mechanisms corresponding to each symptom, such as neurotransmitter abnormalities, genetics, etc., to reduce erroneous interpretations, thereby assisting patients with mental disorders to more accurately understand their own condition, effectively improve patients' compliance with treatment, and thus improve treatment effects.
[0078] In order to further improve the accuracy of generating customized educational content, i.e., the first multimedia information, based on the symptoms selected by the patient, to accurately explain the one or more biological mechanisms corresponding to each symptom, reduce misinterpretations, help patients with mental disorders understand their condition more accurately, effectively improve patients' compliance with treatment, and thus improve treatment effects. Based on the above embodiments, in one embodiment, the training process of the target generation model may also include: obtaining the biological mechanism description information corresponding to the different symptom text description information, and training the original video generation model based on the biological mechanism description information and the different symptom text description information.
[0079] Exemplarily, the biological mechanism description information may be text information, describing the working principle of at least one biological mechanism that may correspond to the corresponding symptom. During the training process of the target generation model, the biological mechanism description information can assist in adjusting the output results of the original video generation model so that the model can more accurately generate the corresponding video content, so as to more accurately explain the one or more biological mechanisms corresponding to each symptom, reduce erroneous interpretations, and thus assist patients with mental disorders to more accurately understand their own condition, effectively improve patients' compliance with treatment, and thus improve the treatment effect.
[0080] In one example, the original video generation model training process includes: selecting a symptom text description information and extracting a semantic feature vector of the symptom text description information; selecting a sample image that semantically matches the semantic feature vector from a human nervous system image library, and training the original video generation model based on the sample image and the symptom text description information to obtain a video generation model; and fine-tuning the video generation model based on the biological mechanism description information corresponding to the symptom text description information to obtain a target generation model.
[0081] Among them, fine-tuning mainly adjusts the description errors of the biological mechanism of a symptom corresponding to a symptom text description information in the video content output by the video generation model to make the description correct. For example, the second loss value is determined based on the feature vector extracted from the biological mechanism description information, and the second loss value identifies the difference between the biological mechanism description information and the biological mechanism description information in the output video content. The parameters of the video generation model can be updated based on the second loss value. By initially training the original video generation model and then fine-tuning the model based on the biological mechanism description information, the trained model can more accurately generate the corresponding video content, so as to more accurately explain the one or more biological mechanisms corresponding to each symptom, reduce erroneous interpretations, and thus assist patients with mental disorders to more accurately understand their own condition, effectively improve patients' compliance with treatment, and thus improve treatment effects.
[0082] Exemplarily, selecting sample images that semantically match the semantic feature vector from the nervous system image library includes: each image in the library has pre-labeled explanatory text information, extracting the semantic feature vector of the explanatory text information of each image, and then calculating the cosine distance with the extracted semantic feature vector of the symptom text description information, and selecting the image corresponding to the maximum cosine distance as the sample image. In this way, the most matching sample image can be selected for training, so that the trained model can more accurately generate the corresponding video content, so as to more accurately explain the one or more biological mechanisms corresponding to each symptom, reduce erroneous interpretations, and thus assist patients with mental disorders to more accurately understand their own condition, effectively improve patients' compliance with treatment, and thus improve the treatment effect.
[0083] It should be noted that, although the steps of the method in the present disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc. In addition, it is also easy to understand that these steps may be, for example, executed synchronously or asynchronously in multiple modules / processes / threads.
[0084] like Figure 4 As shown, the embodiment of the present disclosure provides a human-computer interaction patient education system for mental disorders, including:
[0085] The symptom display module 401 is used to display a first user interface in response to a first trigger operation, wherein the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information;
[0086] A symptom selection module 402 is used to display clinical characteristics of the symptoms corresponding to the target symptom information and at least one mental disorder information related to the target symptom information in response to the patient's selection operation on the target symptom information, wherein the target symptom information is one or more symptom information selected from the plurality of different first symptom information;
[0087] The symptom explanation module 403 is used to play the first multimedia information in response to the second trigger operation of the patient on the second symptom information, wherein the first multimedia information is used to display and explain the biological mechanism corresponding to the symptom identified by the second symptom information, wherein the second symptom information is any one of the target symptom information, and the symptom identified by the second symptom information corresponds to at least one biological mechanism;
[0088] The symptom determination module 404 is used to display and save the symptom integration result information in response to the third trigger operation, wherein the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information ultimately selected and determined by the patient from the target symptom information.
[0089] In one embodiment, the system may also include a diagnosis module for: displaying a second user interface in response to a fourth trigger operation, the second user interface displaying at least one diagnosis result, the at least one diagnosis result being determined based on the symptom integration result information; and saving the target diagnosis result in response to a doctor's selection operation of a target diagnosis result, the target diagnosis result being one or more of the at least one diagnosis result.
[0090] In one embodiment, the system may also include a treatment module, which is used to: display at least one corresponding treatment plan based on the target diagnosis result, and the at least one treatment plan is determined based on the target diagnosis result; save the target treatment plan in response to the doctor's selection operation of the target treatment plan, and display the mechanism of action corresponding to the target treatment plan, and the target treatment plan is one or more of the at least one treatment plan; determine the common mechanism of action of all treatment plans based on the mechanism of action corresponding to each treatment plan in the target treatment plan; match the common mechanism of action with each biological mechanism in the mechanism intersection in the symptom integration result information, and display the symptoms and treatment plans corresponding to each biological mechanism in the matching results based on the matching results, and display the side effects caused by the biological mechanism that does not exist in the patient.
[0091] In one embodiment, the treatment module displays the mechanism of action corresponding to the target treatment plan, which may specifically include: in response to the doctor's triggering operation on any one of the target treatment plans, playing a second multimedia information, wherein the second multimedia information is used to display the specific mechanism of action of the treatment plan.
[0092] In one embodiment, the first multimedia information may include an animation explaining the neurotransmitter abnormality corresponding to the symptom identified by the second symptom information; different second symptom information may correspond to different first multimedia information; or, the second multimedia information may include an animation.
[0093] In one embodiment, the second symptom information may at least include text description information of the symptoms; the system may also include a content generation module, which is used to: input the text description information of the symptoms into a target generation model to obtain corresponding video content; wherein the target generation model is pre-trained based on the original video generation model based on different text description information of symptoms of patients with different mental disorders; and use the video content as the first multimedia information.
[0094] In one embodiment, the training process of the target generation model further includes: obtaining biological mechanism description information corresponding to the different symptom text description information, and training the original video generation model based on the biological mechanism description information and the different symptom text description information.
[0095] In one example, the original video generation model training process includes: selecting a symptom text description information and extracting a semantic feature vector of the symptom text description information; selecting a sample image that semantically matches the semantic feature vector from a human nervous system image library, and training the original video generation model based on the sample image and the symptom text description information to obtain a video generation model; and fine-tuning the video generation model based on the biological mechanism description information corresponding to the symptom text description information to obtain a target generation model.
[0096] In one example, a sample image semantically matching the semantic feature vector is selected from a nervous system image library, including: each image in the library has pre-labeled explanatory text information, the semantic feature vector of the explanatory text information of each image is extracted, and then the cosine distance is calculated with the extracted semantic feature vector of the symptom text description information, and the image corresponding to the maximum cosine distance is selected as the sample image.
[0097] Regarding the system in the above embodiment, the specific manner in which each module performs operations and the corresponding technical effects brought about have been described in detail in the embodiment of the method, and will not be elaborated here.
[0098] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of a module or unit described above can be further divided into multiple modules or units for concretization. The components displayed as modules or units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. Those of ordinary skill in the art can understand and implement it without paying creative work.
[0099] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for educating patients with mental disorders through human-computer interaction according to any of the above-mentioned embodiments.
[0100] Exemplarily, the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
[0101] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.
[0102] The present disclosure also provides an electronic device, including a processor and a memory, wherein the memory is used to store a computer program, wherein the processor is configured to execute the human-computer interaction patient education method for mental disorder according to any of the above embodiments by executing the computer program.
[0103] Refer to the following Figure 5 The electronic device 600 according to this embodiment of the present invention is described. Figure 5 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0104] like Figure 5 As shown, the electronic device 600 is in the form of a general-purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640 such as a touch screen display, etc.
[0105] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above method embodiment section of this specification. For example, the processing unit 610 can perform the following steps: Figure 1 The steps of the method shown in .
[0106] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .
[0107] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.
[0108] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0109] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0110] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, or a network device, etc.) to execute the steps of the human-computer interaction patient education method for mental disorders according to the above-mentioned embodiments of the implementation methods of the present disclosure.
[0111] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0112] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for educating patients with mental disorders through human-computer interaction, characterized in that: The method is applied to an electronic device, comprising: In response to a first trigger operation, a first user interface is displayed, wherein the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information; In response to the patient's selection operation of target symptom information, displaying clinical characteristics of the symptom corresponding to the target symptom information and at least one mental disorder information related to the target symptom information, wherein the target symptom information is one or more symptom information selected from the plurality of different first symptom information; In response to a second trigger operation of the patient on second symptom information, the first multimedia information is played, the first multimedia information being used to display and explain a biological mechanism corresponding to a symptom identified by the second symptom information, the second symptom information being any one of the target symptom information, and the symptom identified by the second symptom information corresponding to at least one biological mechanism; In response to the third trigger operation, symptom integration result information is displayed and saved, wherein the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information ultimately selected and determined by the patient from the target symptom information.
2. The method according to claim 1, characterized in that: The method further includes: In response to a fourth trigger operation, a second user interface is displayed, wherein the second user interface displays at least one diagnosis result, and the at least one diagnosis result is determined based on the symptom integration result information; In response to the doctor's selection operation on the target diagnosis result, the target diagnosis result is saved, and the target diagnosis result is one or more of the at least one diagnosis result.
3. The method according to claim 2, characterized in that The method further includes: Based on the target diagnosis result, display at least one corresponding treatment plan, wherein the at least one treatment plan is determined based on the target diagnosis result; In response to the doctor's selection operation of the target treatment plan, the target treatment plan is saved, and the action mechanism corresponding to the target treatment plan is displayed, and the target treatment plan is one or more of the at least one treatment plan; Determine the common mechanism of action of all treatment options based on the mechanism of action corresponding to each treatment option in the target treatment option; The common action mechanism is matched with each biological mechanism in the intersection of the mechanisms in the symptom integration result information, and based on the matching results, the symptoms and treatment plans corresponding to each biological mechanism in the matching results are displayed, as well as the side effects caused by the biological mechanisms that do not exist in the patient.
4. The method according to claim 3, characterized in that The mechanism of action corresponding to the target treatment regimen is displayed, including: In response to the doctor's triggering operation on any one of the target treatment plans, the second multimedia information is played, where the second multimedia information is used to demonstrate the specific mechanism of action of the treatment plan.
5. The method according to claim 4, characterized in that The first multimedia information includes an animation that explains the neurotransmitter abnormality corresponding to the symptom identified by the second symptom information; different second symptom information corresponds to different first multimedia information; or, the second multimedia information includes an animation.
6. The method according to any one of claims 1 to 5, characterized in that: The second symptom information at least includes symptom text description information; the method further includes: The symptom text description information is input into a target generation model to obtain corresponding video content; wherein the target generation model is obtained by pre-training an original video generation model based on different symptom text description information of patients with different mental disorders; and the video content is used as the first multimedia information.
7. The method according to claim 6, characterized in that The training process of the target generation model also includes: obtaining biological mechanism description information corresponding to the different symptom text description information, and training the original video generation model based on the biological mechanism description information and the different symptom text description information.
8. A human-computer interactive education system for patients with mental disorders, characterized in that: include: A symptom display module, configured to display a first user interface in response to a first trigger operation, wherein the first user interface displays a plurality of different first symptom information belonging to a plurality of mental disorders; wherein each mental disorder corresponds to at least one first symptom information; a symptom selection module, configured to display, in response to a patient's selection operation of target symptom information, clinical characteristics of the symptom corresponding to the target symptom information and at least one mental disorder information related to the target symptom information, wherein the target symptom information is one or more symptom information selected from the plurality of different first symptom information; a symptom explanation module, configured to play first multimedia information in response to a second trigger operation of the patient on second symptom information, wherein the first multimedia information is used to display and explain a biological mechanism corresponding to a symptom identified by the second symptom information, wherein the second symptom information is any one of the target symptom information, and the symptom identified by the second symptom information corresponds to at least one biological mechanism; A symptom determination module is used to display and save symptom integration result information in response to a third trigger operation, wherein the symptom integration result information is determined based on the mechanism intersection of at least one biological mechanism corresponding to the symptoms identified by each symptom information in the third symptom information, and the third symptom information is one or more symptom information ultimately selected and determined by the patient from the target symptom information.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for educating patients with mental disorders through human-computer interaction as claimed in any one of claims 1 to 7 is implemented.
10. An electronic device, characterized in that: include: processor; as well as Memory for storing computer programs; Wherein, the processor is configured to execute the method for educating patients with mental disorders through human-computer interaction according to any one of claims 1 to 7 by executing the computer program.
