Generative artificial intelligence-based life history review multi-modal cognitive training method

Abstract

The invention discloses a life history review multi-mode cognitive training method based on generative artificial intelligence. The method comprises the following steps: step 1, determining a cognitive state; step 2, pre-measuring; step 3, performing intervention; 4, intervention feedback and post-test are carried out; 5, comparing effects; 6, iterative optimization is carried out; according to the life history review multi-mode cognitive training method based on the generative artificial intelligence, the artificial intelligence technology is used for assisting intervention, the training effect can be improved, the personalized requirement can be met, the cognitive function of participating old people can be improved by stimulating self-propagated body memory, life integration and completion can be achieved, and the method is suitable for popularization and application. The life quality is improved, time convenience, place convenience and personnel convenience are achieved, selectivity and flexibility of service personnel are expanded, medicine taking and nerve stimulation are not involved, physiological invasiveness is avoided, and worries of intervention objects and family members of the intervention objects on side effects are reduced.

Description

Technical Field

[0001] The present invention relates to the field of cognitive training, and in particular to a multimodal cognitive training method for reviewing life course based on generative artificial intelligence. Background Art

[0002] By the end of 2023, the number of elderly people over 60 years old in my country has exceeded 290 million, accounting for 21.1%. Actively responding to population aging has become one of the country's important strategies. Aging directly leads to an increase in the incidence of cognitive impairment. According to epidemiological estimates, by 2030, the total number of patients with cognitive impairment in my country will be nearly 22 million, ranking first in the world. Various types of cognitive impairment, including Alzheimer's disease, bring great social medical and personal family burdens. According to the "Chinese Expert Consensus on Cognitive Training" and "Chinese Guidelines for Cognitive Training (2022 Edition)", cognitive training is an important means of preventing and intervening in cognitive impairment diseases.

[0003] Multimodal cognitive training for life course review is an internationally cutting-edge non-drug intervention method that combines interventions in the social psychology field with the cognitive language field, and integrates the concepts and professional techniques of various therapies such as reminiscence therapy, narrative therapy, and multimodal stimulation. It helps the elderly review their life course based on a multimodal approach, trains different cognitive domains and cognitive processing processes, activates and improves autobiographical memory, and coordinates the coordination and integration of the "perceptual environment world, internal construction world, and language construction world" to enhance cognitive function, increase cognitive reserve, promote the elderly's positive mental and psychological state, achieve integration and perfection in old age, and improve their quality of life.

[0004] Multimodal cognitive training of life course review has been proven to be effective. Foreign countries have proven the effectiveness of multimodal cognitive training of life course review through methods such as life story books for elderly people with cognitive impairment. Elderly people at home or in nursing homes can benefit from it. The training effect is mainly manifested in four aspects: maintaining mental health, promoting social communication, improving quality of life and enhancing cognitive function. At the level of mental health, it can enhance the sense of meaning and self-esteem of the elderly, improve self-identity, effectively reduce depression, enrich emotional reactions, and promote a positive mental state; at the level of social communication, it can improve the elderly's enthusiasm for social participation, increase the elderly's communication opportunities with family members or other caregivers, improve interactive relationships, and also improve the caregivers' understanding and attitude towards the elderly; in terms of quality of life, it can improve the elderly's evaluation of the current quality of life and enhance their sense of happiness in life; in terms of cognitive function, it can improve the elderly's autobiographical memory, and improve cognitive domain functions such as logical semantic memory, time and space positioning, language expression, and executive function.

[0005] Cognitive intervention mainly refers to the direct or indirect treatment of cognitive function by non-drug intervention methods, which is mainly divided into three types, namely cognitive stimulation, cognitive rehabilitation and cognitive training. Among them, cognitive training adopts paper-pencil or computerized training forms to train different cognitive domains and cognitive processing processes to improve cognitive function and increase cognitive reserve. Its clinical application is becoming more and more extensive internationally. At present, the commonly used non-drug intervention methods for cognitive impairment in clinical practice in my country include non-invasive brain stimulation technology (transcranial magnetic stimulation technology therapy, hyperbaric oxygen therapy, etc.), traditional Chinese medicine treatment, art intervention methods, etc.

[0006] (1) Non-invasive brain stimulation technology: Neurology has a series of treatments for cognitive impairment, and common technologies include transcranial magnetic stimulation (TMS) and hyperbaric oxygen therapy (HBOT). TMS is a magnetic stimulation technology that uses a time-varying pulsed magnetic field to act on the central nervous system, changing the membrane potential of cortical nerve cells to generate induced currents, affecting brain metabolism and neural electrical activity, and thus causing a series of physiological and biochemical reactions. By changing its stimulation frequency, it can achieve the purpose of exciting or inhibiting local cerebral cortical function. Different intensities, frequencies, stimulation sites, and coil directions are required to achieve good treatment effects according to the brain function of different patients. TMS is a non-invasive operation, and the discomfort of the treated person is very small. It has a wide range of applications. It has been developed from being the most commonly used in the clinic for central nervous system injury diseases to the treatment of cognitive impairment. In the medical environment of a tertiary hospital, a TMS session takes about 30-45 minutes and costs about 150-200 yuan. The treatment cycle is usually more than 2 weeks or up to half a year. The treatment cycle is long and continuous treatment is required according to the specific situation, so the total cost is high. HBOT is a treatment method under an environmental pressure greater than one atmosphere. In recent years, HBOT has opened up a new treatment approach for the elderly, including the treatment of neurodegenerative diseases and the improvement of cognition and brain metabolism in patients with mild cognitive impairment. Depending on the brain function of different patients, the course of HBOT treatment ranges from 2 weeks to 2 months, and long-term follow-up is required according to the doctor's advice. The cost of a single treatment ranges from 100 to 300 yuan. Its user population has certain limitations, and patients with respiratory diseases are not recommended to use this treatment. In general, HBOT also requires a certain treatment cost.

[0007] (2) TCM treatment: Using traditional TCM diagnosis and treatment concepts, common treatment methods include acupuncture and moxibustion. Acupuncture can improve patients' cognitive function by regulating brain networks by increasing connectivity between cognitive-related areas. Commonly used acupuncture therapies include filiform needle and filiform needle penetrating therapy, electroacupuncture, and body acupuncture. A large number of related medical studies have confirmed that acupuncture can affect the release of neurotransmitters, prevent or alleviate neuronal damage, enhance the expression of brain-derived neurotrophic factor in brain tissue, and ultimately improve cognitive function. At present, acupuncture therapy is often combined with cognitive training, drug therapy, or moxibustion, which is more effective than single cognitive rehabilitation training or drug therapy. This method is simple, effective, has no toxic side effects, and can effectively improve the quality of life of patients with mild cognitive impairment. However, it requires professional doctors to operate and the treatment environment is relatively fixed. Moxibustion can effectively regulate related molecular proteins and activate their activity, effectively improving patients' symptoms. Since there is no specific treatment for mild cognitive impairment, and the side effects of Western medicine are relatively large, moxibustion has not only been proven to be effective in clinical practice by a large number of studies, but has also been widely used in clinical practice due to its safety, low cost, few side effects, and strong operability. However, it requires professional doctors to operate, and the treatment environment is relatively fixed.

[0008] (3) Art intervention methods: These are a series of non-drug intervention methods that use art (including painting, music, dance, sculpture and other art forms) as a medium for psychological counseling and treatment. This therapy bypasses the language part in its practice and has an intervention effect that traditional psychotherapy cannot achieve. Art therapy is based on respect for personal values ​​and beliefs and is provided by people who seek emotional, creative and spiritual growth. It is a creative process that uses art creation to improve and enhance the physical, mental and emotional health of individuals of all ages. Through art creation and reflection on art products and processes, people can enhance their awareness of themselves and others, cope with symptoms, stress and traumatic experiences; enhance cognitive abilities; and enjoy the joy of active life brought by creating art. Art therapy is an excellent intervention method for preventing or delaying the onset of cognitive impairment for people with normal cognition or mild cognitive impairment (especially those with subjective cognitive decline). In the process of enjoying or creating art, the corresponding brain areas will be better activated, maintaining brain health and cognitive health. However, for moderate patients with severe cognitive impairment, there is a certain degree of implementation difficulty, so there are certain limitations in the target population. At the same time, due to the great diversity of art forms, the corresponding equipment costs and tuition fees will also vary, and need to be determined according to the family's economic conditions, and are not very universal.

[0009] (4) Nostalgia therapy: also known as recollection therapy, through a series of common topics, such as going to the countryside and the Red Revolution, a group of elderly people are guided to recall some fragments of the past. It is mostly carried out in the form of group collective intervention. The implementation locations include collective activity rooms such as hospitals and nursing homes. Community elderly people need to take public transportation to the activity location, which costs time and money. This method can effectively improve some cognitive functions of elderly people with cognitive impairment and increase interactive communication among the elderly in the same group. Since each elderly person needs to speak around the theme and the host summarizes it, each activity lasts about 2 hours, which has a high time cost. At the same time, since it only revolves around some life fragments and does not consider the sequence of life stages, it lacks the structure and completeness of the review of life course. Furthermore, the collective intervention form cannot fully take into account the individual differences of the intervention subjects, nor can it generate a relatively complete life story book for the intervention subjects.

[0010] In summary, there is currently little research and development and promotion of cutting-edge intervention methods that fully utilize computer technologies such as generative artificial intelligence. Summary of the invention

[0011] The purpose of the invention is to provide a multimodal cognitive training method for reviewing life course based on generative artificial intelligence, which solves the problems in the background technology.

[0012] The present invention is implemented in this way: a multimodal cognitive training method for reviewing a life course based on generative artificial intelligence, the multimodal cognitive training method for reviewing a life course based on generative artificial intelligence comprises the following steps:

[0013] Step 1: Determine cognitive status;

[0014] Step 2: Pre-test;

[0015] Step 3: intervention implementation;

[0016] Step 4: Intervention feedback and post-test;

[0017] Step 5: Effect comparison;

[0018] Step 6: Iterative optimization.

[0019] A further technical solution of the present invention is: the determination of cognitive status described in step one is: based on demographic information such as age, gender, education level / years, through the evaluation results of the Chinese version of the Montreal Cognitive Assessment-Basic Scale (MoCA-B) and the Daily Living Activities Scale (ADL), after analysis and judgment by clinical medical experts, the cognitive status of the elderly is judged, and the elderly with cognitive improvement needs are determined to be included in the intervention group and the control group.

[0020] A further technical solution of the present invention is: the pre-test described in step 2 is: conducting a series of neuropsychological tests and language assessments for the elderly who have cognitive improvement needs.

[0021] A further technical solution of the present invention is: the intervention described in step three is implemented as follows: the participating elderly are divided into an intervention group and a control group; for the elderly in the intervention group, a life course review is conducted once a week for 6 weeks, each time for 1 hour, to guide the elderly to recall their life experiences in chronological order, especially key life nodes, and during the review, multimodal materials such as photos, images, and objects are collected based on the elderly's life story, and a digital life story book for the elderly is produced in combination with generative artificial intelligence technology; the elderly in the intervention group watch and share their digital life story books on a voluntary basis or with the support of their family members for a period of 6 weeks; the elderly in the control group only receive routine care.

[0022] A further technical solution of the present invention is: the intervention feedback and post-test described in step 4 are: conducting neuropsychological tests and language assessments for the elderly included in the intervention group and the control group.

[0023] A further technical solution of the present invention is: the effect comparison described in step five is: comparing the differences between the intervention group before and after the test, and the differences between the intervention group and the control group, to verify the improvement effect of the program on the cognitive function, language communication and social psychology of the elderly.

[0024] A further technical solution of the present invention is: the iterative optimization described in step six is: including the elderly in the previous control group into a new intervention group, establishing a new control group, repeating the process of steps two to five, iteratively optimizing the intervention plan, expanding the number of groups participating in the intervention, and improving the performance of intervention effect verification.

[0025] Beneficial effects of the present invention: The multimodal cognitive training method for life course review based on generative artificial intelligence of the present invention has the following advantages:

[0026] 1. Application of generative artificial intelligence technology: Most Chinese elderly people born in the 1950s or earlier have insufficient video records of their childhood, adolescence and early adulthood, which leads to a lack of materials when recording and restoring life experiences. Based on generative artificial intelligence technology, exclusive video materials can be generated based on the personal experiences of participating elderly people, so that autobiographical memory can be stimulated with more vivid materials and interesting processes. In addition, the "China Guide to Cognitive Training" (2022 edition) points out that the use of artificial intelligence technology to assist intervention can help improve training effects and meet personalized needs.

[0027] 2. Structured review of life course: Most of the contemporary Chinese elderly have witnessed the process from the founding of the country, reform and opening up to the rapid development in the 21st century, and have experienced epoch-making changes in the historical environment, with rich life experience and insights. A structured review of the complete life course in chronological order, especially the important life nodes, can reflect how individuals cope with and adapt to the constant changes in the social and cultural environment. This process can not only improve the cognitive function of the participating elderly by stimulating autobiographical memory, but also help achieve psychological integration and perfection, and improve the quality of life.

[0028] 3. Digital Life Storybook: Create a unique digital life storybook for each elderly person participating in the intervention, so that the intervention process leaves tangible results. The elderly and their families can watch it repeatedly and share it with others for appreciation. This result is not only helpful for the cognitive health of the elderly themselves, but also can promote their social interaction, and leave comfort and inheritable spiritual wealth for their families.

[0029] 4. Convenience: (1) Convenient time. The elderly can choose a time that suits them and are not restricted by the working hours of the elderly service unit or hospital. (2) Convenient location. The elderly can choose to carry out the work at home, in elderly service centers, community activity rooms, etc. without having to travel. (3) Convenient personnel. Except for the pre- and post-intervention tests, which require professional neuropsychological assessors, the multimodal review of life course and the production of digital life story books can be completed by trained professional volunteers, which expands the selectivity and flexibility of service personnel.

[0030] 5. Safety: It does not involve medication or nerve stimulation, is non-physiologically invasive, and reduces the concerns of the subjects and their families about side effects.

[0031] 6. Personalization: One-on-one multimodal cognitive training based on generative artificial intelligence is carried out for each elderly person on a life journey review basis. The life journey review process and the digital life story book production process are both personalized based on the unique life experience of each elderly person, while fully respecting individual differences. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a flowchart of a multimodal cognitive training method for reviewing life course based on generative artificial intelligence provided by the present invention;

[0033] Figure 2 It is a flow chart and key points of the multimodal review of life course in the intervention implementation stage of the multimodal cognitive training method for reviewing life course based on generative artificial intelligence provided by the present invention;

[0034] Figure 3This is the intervention implementation phase of the multimodal cognitive training method for reviewing the life course based on generative artificial intelligence provided by the present invention, and a flow chart for making a digital life storybook for the elderly based on generative artificial intelligence technology. DETAILED DESCRIPTION

[0035] Embodiment 1: Figure 1-Figure 3 A multimodal cognitive training method for life course review based on generative artificial intelligence is shown, including the following steps:

[0036] Step 1: Determine cognitive status;

[0037] Step 2: Pre-test;

[0038] Step 3: intervention implementation;

[0039] Step 4: Intervention feedback and post-test;

[0040] Step 5: Effect comparison;

[0041] Step 6: Iterative optimization.

[0042] To facilitate a better understanding of the purpose, technical route and advantages of the present invention, the present invention is further described in detail below in conjunction with a specific embodiment for an elderly person with mild cognitive impairment (MCI) in the intervention group and with reference to the accompanying drawings. The intervention trial has completed ethical review.

[0043] Figure 1 This is a flowchart of the multimodal cognitive training method for life course review based on generative artificial intelligence. The main steps are described as follows:

[0044] 1. Determine cognitive status

[0045] Basic demographic information was collected, and cognitive assessment and daily activities functional assessment were conducted.

[0046] Taking the elderly with mild cognitive impairment as an example, the inclusion criteria are as follows: (1) using the Chinese version of the Montreal Cognitive Assessment Basic Scale, the score range of cognitive assessment is: less than 6 years of education, 14-19 points; 7-12 years of education, 16-22 points; more than 12 years of education, 17-24 points; (2) Activities of Daily Living Scale (ADL, Zhang Mingyuan version) score ≤ 22 points; (3) no other neurological or psychiatric diseases that may affect cognitive status were reported; (4) hearing and visual functions met the requirements of the assessment.

[0047] 2. Neuropsychological testing and language assessment - pre-test

[0048] (1) Autobiographical memory assessment

[0049] (2) Logical Memory Assessment

[0050] (3) Analysis of discourse rhetorical structure

[0051] (4) Quality of life evaluation

[0052] (5) Self-efficacy evaluation

[0053] 3. Implementation of intervention

[0054] (1) A structured multimodal review of life course

[0055] Figure 2 The process and key points of multimodal review of the life course for the intervention implementation phase;

[0056] Conduct one-on-one life review for the elderly for 6 weeks, once a week, 1 hour each time. The elderly and their families can prepare corresponding multimodal materials such as photos, music, and physical objects in advance according to the content outline to assist in recalling. The first 4 reviews will review the important themes of each period in the chronological order of childhood, adolescence, adulthood, and old age. The last 2 reviews will focus on summarizing, evaluating, and integrating the past life journey.

[0057] (2) Production of digital life storybooks based on generative artificial intelligence technology

[0058] Figure 3 Flowchart of creating a digital life storybook for the elderly based on generative artificial intelligence technology during the intervention implementation phase.

[0059] 1) Video script and narration generation

[0060] ① Through automatic speech recognition tools, the recording of the elderly’s life review is transcribed into text.

[0061] ②According to the transcribed text, combined with Figure 2 content framework to generate a video script.

[0062] ③ Use AI dubbing technology to generate narration for the digital life storybook.

[0063] 2) Collection, generation and organization of multimodal materials

[0064] ①Digitalization of physical materials: The elderly or their family members provide multimodal resources related to their life experiences, such as photos, books, picture albums, handicrafts, etc., which are photographed or scanned to convert into digital resources.

[0065] ② Collection of online materials: Based on the information provided by the elderly and their families, search for relevant resources on the Internet: such as images of old cities, workplaces or schools.

[0066] ③ Artificial intelligence (AI) generates supplementary materials

[0067] Use the photo editor with AI-powered face age-changing effect to generate different looks of the elderly at different ages.

[0068] Through the Wenshengtu AI technology, image moments of key events with the elderly as the protagonists are generated, such as childhood games, teenage school sports, young people’s love and other milestone scenes in the life process.

[0069] With the help of image-generated video AI technology, dynamic effects of photos can be generated.

[0070] Through voice cloning, AI dubbing, and image-generated video technology, videos of important deceased relatives and friends speaking are generated.

[0071] 3) Generate a complete digital life storybook

[0072] With the help of AI video editing technology, a structured multimodal digital life storybook is generated that matches pictures and texts and follows the sequence of life journey.

[0073] 4. Intervention feedback and post-test

[0074] (1) Montreal Cognitive Assessment Basic Scale Chinese version

[0075] (2) Activities of Daily Living Scale

[0076] (3) Autobiographical memory assessment

[0077] (4) Logical memory assessment

[0078] (5) Analysis of discourse rhetorical structure

[0079] (6) Quality of life evaluation

[0080] (7) self-efficacy evaluation;

[0081] 5. Compare the improvement effects of the elderly’s cognitive function, language communication and social psychology before and after intervention.

[0082] The multimodal cognitive training method for life course review based on generative artificial intelligence of the present invention uses artificial intelligence technology to assist in intervention, which helps to improve the training effect and meet personalized needs. It can not only improve the cognitive function of participating elderly people by stimulating autobiographical memory, but also help achieve the integration and perfection of life and improve the quality of life. It is convenient in time, location and personnel, and the selectivity and flexibility of service personnel are expanded. It does not involve medication and nerve stimulation, is non-physiologically invasive, and reduces the concerns of the intervention subjects and their families about side effects.

[0083] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multimodal cognitive training method for life course review based on generative artificial intelligence, characterized by: The life course review multimodal cognitive training method based on generative artificial intelligence includes the following steps: Step 1: Determine cognitive status; Step 2: Pre-test; Step 3: intervention implementation; Step 4: Intervention feedback and post-test; Step 5: Effect comparison; Step 6: Iterative optimization.

2. The multimodal cognitive training method for life course review based on generative artificial intelligence according to claim 1 is characterized in that: The determination of cognitive status described in step 1 is: based on demographic information such as age, gender, education level / years, the cognitive status of the elderly is determined through the Chinese version of the Montreal Cognitive Assessment-Basic (MoCA-B) and the Activities of Daily Living (ADL) scale, and clinical medical experts analyze and judge the results to determine whether the elderly have cognitive improvement needs and include them in the intervention group and the control group.

3. The multimodal cognitive training method for life course review based on generative artificial intelligence according to claim 1 is characterized in that: The pre-test described in step 2 is: conducting a series of neuropsychological tests and language assessments for the elderly who have cognitive improvement needs.

4. The multimodal cognitive training method for life course review based on generative artificial intelligence according to claim 1 is characterized in that: The intervention described in step three is implemented as follows: the participating elderly are divided into an intervention group and a control group; for the elderly in the intervention group, a life review is conducted once a week for 6 weeks, each time for 1 hour, to guide the elderly to recall their life experiences in chronological order, especially the key life nodes. During the review, according to the elderly’s life story, their photos, videos, music, objects and other multimodal materials are collected, and a digital life story book is made for the elderly in combination with generative artificial intelligence technology; the elderly in the intervention group watch and share their digital life story books on a voluntary basis or with the support of their family members for a period of 6 weeks; the elderly in the control group only receive routine care.

5. The multimodal cognitive training method for life course review based on generative artificial intelligence according to claim 1 is characterized in that: The intervention feedback and post-test described in step 4 are: conducting neuropsychological tests and language assessments for the elderly included in the intervention and control groups.

6. The multimodal cognitive training method for life course review based on generative artificial intelligence according to claim 1 is characterized in that: The effect comparison described in step five is: comparing the differences between the pre- and post-tests of the intervention group, and the differences between the intervention group and the control group, to verify the improvement effect of the program on the cognitive function, language communication and social psychology of the elderly.

7. The multimodal cognitive training method for life course review based on generative artificial intelligence according to claim 1 is characterized in that: The iterative optimization described in step six is: include the elderly in the previous control group into the new intervention group, establish a new control group, repeat the process of steps two to five, iteratively optimize the intervention plan, expand the number of groups participating in the intervention, and improve the performance of intervention effect verification.

Images