Cognitive disorder nostalgic audio-video intervention therapy

Abstract

The invention discloses a cognitive disorder nostalgic audio-video intervention therapy method, which comprises the following steps of: building a scene containing nostalgic music art, classical movies and retro original sound, playing matched audio and visual materials to a patient, and guiding the patient to perform structured intervention activities such as puzzle, theme recall or emotion sharing. Therefore, memory is stimulated, cognition is exercised, and emotion expression is promoted; according to the invention, by integrating three layouts of audios of nostalgic music art, classical movies and retro original sounds with matched visual elements, a multi-scene nostalgic sensory environment is constructed, and auditory and visual channels of a patient can be synchronously stimulated; compared with single auditory or visual stimulation, the compound sensory stimulation can more effectively activate a plurality of brain areas related to memory and emotion in the brain, so that long-term memory of deep sleep is more intensively aroused, and the strength and awakening efficiency of reminiscence stimulation are greatly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of early non-drug intervention for cognitive disorders, and particularly relates to a nostalgic audio-visual intervention therapy for cognitive disorders. BACKGROUND

[0002] For the treatment of cognitive disorders, nostalgic therapy and sensory stimulation are common intervention means. Existing intervention means mostly adopt a single mode of stimulation, such as playing old music, displaying old photos or guiding patients to orally recall. Some systems attempt to combine music and pictures, present unified nostalgic materials to patients through a preset playlist, or use a universal nostalgic theme for discussion in group activities, so as to arouse the memory of patients and promote cognitive function.

[0003] The above stimulation mode is relatively single and fails to systematically integrate auditory, visual and interactive guidance, resulting in insufficient stimulation of multiple sensory channels of patients and difficulty in deeply activating relevant memory neural networks. At the same time, the intervention content often lacks personalized ways, cannot be adjusted according to the real-time response of patients, and is also difficult to gradually transition from simple memory recognition to complex scene recall and emotional expression, so that the depth and effect of the intervention process are limited. Moreover, existing methods mostly focus on cognitive exercise of patients themselves, ignoring the potential value of the intervention process in promoting intergenerational communication and relieving family care pressure, and failing to form a healing loop containing emotional output.

[0004] Therefore, in view of the above problems, the present application provides a nostalgic audio-visual intervention therapy for cognitive disorders. SUMMARY

[0005] In order to overcome the problems of single stimulation mode, lack of individualization in the intervention process and ignoring of family emotional connection in existing nostalgic intervention means, the present application provides a nostalgic audio-visual intervention therapy for cognitive disorders, which builds an immersive environment combining nostalgic art performances, classic movies and retro original sound, and implements intervention activities from memory recognition to emotional sharing, so as to improve the intervention effect and promote family communication ability.

[0006] The technical solution of the present application is: a nostalgic audio-visual intervention therapy for cognitive disorders, comprising the following steps: S1, a nostalgic audio-visual intervention scene is built, which contains at least three theme panels, namely a nostalgic art performance panel, a classic movie panel and a retro original sound panel, wherein each panel is provided with independent or integrated audio playback equipment and visual display elements corresponding to the theme; S2, for the nostalgic folk art section, set up audio recordings of operas that include at least Kunqu Opera and Peking Opera, and simultaneously display classic stills of the corresponding operas; for the classic movie section, set up audio clips or theme songs selected from "Liu Sanjie" and "Shajiabang", and simultaneously display classic stills of the movies; for the retro original sound section, set up ambient and everyday sound audio that includes at least two of the following: steam whistle sound, bicycle bell sound, scrap collector's cry and repairman's cry, and simultaneously display scene photos such as ferries, bicycle traffic and alley street scenes; S3, play a specific audio selected from any of the above sections to patients with cognitive impairment, and simultaneously display the matching visual elements during playback, thereby forming a multimodal sensory stimulus; S4, based on the combined audio and visual stimuli played, the facilitator guides the patient through intervention activities according to a pre-set structure. These intervention activities sequentially include: S401, ask the patient to identify and say the movie name, opera type or specific scene where the sound is played, corresponding to the audio being played. The facilitator gives positive voice feedback based on the patient's answer and can further reinforce the corresponding visual elements. S402, Based on the guessing activity, the facilitator guides the patient to recall and narrate personal experiences related to the voice through open-ended questions according to a personalized theme prepared in advance. The theme preferably includes adolescent love, key events in the career, school experience or special family anniversaries, so as to exercise the patient's episodic memory, logical organization and language expression ability. S403: After the main recall activity stimulates the patient's expression and emotional resonance, the facilitator encourages the patient to express the feelings or thoughts that they are usually unwilling or unable to express to their children and caregivers. The facilitator then records the patient's words using a recording device. After editing, a digital audio file is created and shared with the patient's children. This helps to rebuild the intergenerational emotional channel, deepen the children's understanding of the patient, and indirectly relieve the children's caregiving pressure. S5, build a time photo studio, based on the patient's personal history, restore old scenes of a specific stage of their life, and provide patients with clothing and props that conform to the characteristics of the times, carry out themed photography, restore at least one scene in their wedding, workplace, family old house living room or school classroom, and prepare corresponding period clothing, furniture and daily props. S501 guides patients to role-play or simulate daily behaviors in a reconstructed scenario, with facilitators conducting interviews and photographers taking pictures during the process, ultimately generating a set of nostalgic photos. S502, show the patient a nostalgic photo of themselves taken in the Time Photo Studio, or play audio from the audio-visual stimulation unit and ask about their direct feelings or basic identification information. S503, based on the photograph or audio, guide the patient to recall and recount in detail the personal story, relationships, and sequence of events related to the scene or sound; S504 records the emotional expressions that patients generate during narrative activities and combines them with corresponding nostalgic photos to create a shareable story archive.

[0007] Preferably, in step S1, some or all of the visual display elements are derived from old scene photos specially taken for the patient. These photos are taken at places with personal historical significance where the patient once lived or worked, and are integrated into the corresponding theme layout.

[0008] Preferably, in step S401, if the patient has difficulty recognizing the information, the guide will provide prompts in the form of multiple-choice questions, or play a longer audio clip containing key features to assist in the recognition.

[0009] Preferably, in step S402, the personalized theme is developed based on an assessment of the patient's prior life history and can be adjusted throughout the intervention process based on the patient's response and progress.

[0010] Preferably, in step S403, the digital audio file can be attached with nostalgic scene photos or old photos of the patient to form a multimedia nostalgic keepsake.

[0011] Preferably, the method evaluates the effectiveness after each intervention activity by using an observation record form or a simplified cognitive scale to assess at least two indicators of the patient's recall accuracy, language fluency, emotional engagement, and facial expression changes during the activity. This quantifies the intervention effect and provides a basis for adjusting subsequent intervention plans.

[0012] Preferably, the duration of the audio segment played in step S3 is between 15 and 90 seconds, in order to ensure the effectiveness of the stimulation and avoid distracting the patient.

[0013] The beneficial effects of this invention are: 1. This invention integrates audio and visual elements from three main sections—nostalgic folk arts, classic movies, and retro original soundtracks—to create a multi-scene nostalgic sensory environment. This environment can simultaneously stimulate the patient's auditory and visual channels, while also creating a nostalgic photo studio for the patient. This composite sensory stimulation is more effective than single auditory or visual stimulation in activating multiple brain regions related to memory and emotion, thereby more strongly evoking dormant long-term memories and significantly improving the intensity and efficiency of nostalgic stimulation.

[0014] 2. This invention designs and executes an intervention process that progresses from riddles to thematic recall and then to sharing, achieving a hierarchical and dynamic approach to intervention activities. This process can naturally transition from simple memory recognition to complex scenario narration and emotional expression based on the patient's cognitive level and real-time response. At the same time, it combines personalized themes customized based on the patient's personal life history, enabling the intervention process to precisely match each patient's unique experiences and cognitive abilities, thereby significantly improving patient participation and the pertinence of the intervention, and achieving deeper cognitive function training in memory, logical thinking, and language expression.

[0015] 3. This invention introduces a mechanism for creating and sharing audio archives, recording and editing the emotional expressions evoked in patients during the intervention process into digital audio archives, which are then shared with their children along with nostalgic photos. This design not only extends the beneficiaries of non-pharmacological interventions from individual patients to their family systems, but more importantly, it rebuilds a low-pressure emotional communication channel between patients and their children, enabling children to hear the deepest feelings of patients that are usually difficult to express, thereby enhancing understanding and alleviating anxiety and stress in caregiving, and reshaping close intergenerational emotional connections. Attached Figure Description

[0016] Figure 1 The diagram shown is a flowchart of the Time Capsule Museum method of the present invention; Figure 2 The diagram shown is a flowchart of the Time Photo Studio method of the present invention. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] Please see Figure 1 This invention provides an embodiment: a nostalgic audiovisual intervention therapy for cognitive impairment. First, let me explain the Time Capsule Museum: This invention is implemented in a specially designed intervention space that is quiet, warm, and free from obvious sources of disturbance, by dividing the space into three distinct areas on a main wall or through a large interactive touchscreen: a nostalgic folk art area, a classic movie area, and a retro original sound area.

[0019] (1) The nostalgic folk art section is recorded using professional recording equipment in an anechoic chamber or quiet theater. The content includes operas with distinctive regional and local characteristics, such as excerpts from Kunqu Opera "The Peony Pavilion: Strolling in the Garden" (approximately 2 minutes long), Zhuge Liang's aria from Peking Opera "The Empty City Stratagem" (approximately 1.5 minutes long), and excerpts from Yue Opera "The Butterfly Lovers". At the same time, each opera excerpt is accompanied by at least two high-definition digital stills, which showcase the classic costumes of the main actors and key scenes. For example, when playing "Strolling in the Garden", classic stills of Du Liniang and Chunxiang in the garden are displayed simultaneously.

[0020] (2) The classic film section selects classic film clips or theme songs from the 1950s to 1980s. For example, the folk song segment from the film "Liu Sanjie" (about 90 seconds long), the "battle of wits" segment from "Shajiabang" (about 2 minutes long), and the theme song "Ode to Heroes" from "Heroes and Daughters". It is also equipped with high-definition scans of classic scenes from the film or official posters. For example, when the "folk song" segment is played, a color still of Liu Sanjie singing with fishermen on the river is displayed on the screen.

[0021] (3) The retro original sound version was collected through outdoor recording, including the sound of the steam whistle of an old steamship (deep low frequency), the rumble and whistle of a green train entering and leaving the station, the crisp sound of an old bicycle bell and the sound of a Phoenix sewing machine pedal, as well as the shouts of "collecting scrap" from street vendors (with specific local accents), the shouts of sharpening scissors and knives, the shouts of neighbors calling their children home for dinner at dusk, and the chirping of cicadas and croaking of frogs in summer. The duration of each sound segment was controlled between 15 and 60 seconds. At the same time, the most representative historical photos were matched for each sound, for example, the steam whistle was matched with a photo of a ferry on the Huangpu River in Shanghai; the bicycle bell was matched with a black and white photo of bicycles passing through Chang'an Avenue in the early morning of the 1980s; and the shouts of collecting scrap were matched with a photo of a peddler pushing a bicycle to collect scrap in the alley.

[0022] (4) Intervention in the aforementioned nostalgic audio-visual scenarios: First, the guide selects and plays a specific audio clip from any section of nostalgic folk arts, classic movies, or retro original audio, while simultaneously displaying matching visual materials. Then, the guide immediately asks the patient, "Listen, what sound / opera / movie is this?" This directly stimulates the memory recognition function area of ​​the patient's brain. If the patient can answer quickly and accurately, the guide immediately provides positive verbal feedback (such as "You remember it so clearly!") and then follows up with details (such as "Where have you heard this Peking Opera before?"). To deepen recall, if the patient has difficulty recognizing the information, an auxiliary mode is activated. This involves providing multiple-choice questions with two or three options (such as "Is this Peking Opera or Huangmei Opera?") or playing an extended audio clip containing more obvious features to assist in recognition. This step can be detected and recorded using indicators, including "memory recognition accuracy" (the patient correctly identifies the information on their first attempt), "response latency" (measured from the end of playback to the patient's response), and "auxiliary dependence" (the number of times the auxiliary mode needs to be activated) to assess the ease of memory retrieval.

[0023] Immediately after the patient successfully completes the riddle-solving activity, the thematic recall activity begins. The facilitator, based on a pre-designed and dynamically updated "personal life history file" tailored to the patient, guides the conversation towards a pre-set personalized theme for in-depth recall and narration. For example, for a patient who was a former teacher, after identifying the "bicycle bell," the guiding theme would be, "What was the most memorable lesson you had when you rode your bicycle to school to teach?" During this process, the facilitator needs to skillfully use open-ended questioning techniques (such as "How?", "Why?", "And then?") and encouraging body language to motivate the patient to provide a coherent and detailed narrative around the theme, thereby exercising their ability to retrieve contextual memory, organize logical thinking, and express themselves verbally. This step is evaluated using quantifiable indicators, including a "narrative coherence score" assessed by the facilitator, a "detail density" based on the specific people, places, times, and actions provided by the patient in a single narrative, and a "language fluency" score that calculates the number of effective words per minute and records the number of pauses.

[0024] When the patient shows sincere emotions (such as smiling, moist eyes, or changes in tone) during the theme recall, the facilitator cuts in at the right time, connects a directional microphone to the recording device, and after obtaining the patient's informed consent, guides the patient to transform the inspired emotions and thoughts into direct words for their children or caregivers and records them. The guiding words are like "The story you just told is so touching. Your children must never have heard it. Is there anything you want to say to them? We can record it and give it to them as a special gift." After the recorded audio is edited later, a sound file is generated, and then this file can be directly shared with the patient's children, and relevant nostalgic scene photos can be attached to jointly form a "multimedia nostalgic souvenir."

[0025] Please refer to Figure 2 , for the description of the Time Photo Studio: (1) First, the present invention conducts in-depth life history interviews with the patient and their family members to identify key scenes that are of great significance and deeply memorable in the patient's life, such as the wedding scene in their youth, the workplace in middle age, or the old house courtyard where they lived in childhood. Based on this, a detailed scene restoration plan is formulated. The plan precisely arranges the required era background, spatial layout, furniture furnishings, clothing styles, and a list of props with a sense of age. For example, to restore a wedding scene in the 1970s, it is necessary to prepare red "double happiness" characters, enamel cups, old-fashioned radios, and clothing made of the popular dacron fabric at that time.

[0026] (2) Restore the target scene in a dedicated shooting venue, invite the patient to change into the prepared era clothing and use the props. The facilitator helps the patient get into the state by means of verbal descriptions and showing old photos. Then, when the patient has natural interactions or simulates specific actions in the restored scene, a professional photographer captures their expressions and interaction moments from multiple angles. During the shooting process, the facilitator will conduct gentle interviews to stimulate the patient's spontaneous memories and expressions, and finally generate a set of nostalgic photos.

[0027] (3) In the guiding and narrative stage of in-depth intervention using the shooting results, in subsequent intervention sessions, the facilitator shows the patient specific photos taken in the Time Photo Studio and uses the "5W1H" questioning method for guidance. For example, pointing at the photo and asking, "Where is this? What are you doing? How did you feel at that time? Who was beside you?" This encourages the patient to construct a detailed and coherent personal narrative around the photo, thereby exercising their ability to extract episodic memories, organize language, and logical thinking.

[0028] (4) Record the vivid stories told by the patient when viewing the photos with high quality, and integrate them artistically with the corresponding nostalgic photos. Appropriate background music, subtitles, and transition effects are added through video editing software to produce a short and emotionally contagious "story file," and the file is shared with their family members.

[0029] This invention provides Embodiment 1: Patient: Mr. Zhang, 72 years old, MMSE score of 22 (mild cognitive impairment), retired mechanical engineer, with a 30-year history of commuting by bicycle.

[0030] Intervention process: Guessing game: Play a bicycle bell. Mr. Zhang immediately answered: "That's a bicycle bell, a Forever brand!" (Reaction latency: 2 seconds, accurate).

[0031] Thematic Recollection Activity: Based on his professional background, the facilitator guided the discussion to the theme of "Commuting Experiences." Mr. Zhang recalled his daily commute by bicycle through Chaoyangmen to the factory, describing in detail how he repaired his bicycle using the factory's tools, mentioning his colleague "Old Li" and the time period "summer of 1976." (Narrative coherence score: 4 points; Detail density: High, including more than 5 specific details).

[0032] Sharing Activity: The facilitator guided Mr. Zhang to speak to his daughter. Mr. Zhang said into the microphone, "Sweetie, that old bicycle of yours used to take you to school and your mom to buy groceries... Now you both drive cars, that's great, it's safe..." (Emotional expression: mainly positive and nostalgic), and sent the recording to his daughter.

[0033] Three months after the intervention, Mr. Zhang's MMSE score stabilized at 22, without the expected decline. Meanwhile, his daughter's Zarit Caregiver Burden Scale score decreased from 38 (moderate burden) before the intervention to 32 (mild to moderate burden). She reported that she was very moved after listening to the recording, felt like she had rediscovered her father, and had new topics to talk about with him.

[0034] This invention provides Embodiment 2: Patient: Ms. Li, 78 years old, MoCA score 24 (mild cognitive impairment risk), retired primary school music teacher, loves traditional opera.

[0035] Intervention process: Guessing Game: An excerpt from the Peking Opera "The Drunken Beauty" is played. Ms. Li can identify it as a Peking Opera piece, but is unsure of the specific title. She must answer correctly after being given the option ("Farewell My Concubine" or "The Drunken Beauty"). (Assistance Dependence: 1 time).

[0036] Thematic recall: Guided to the theme of "Art and Teaching Career", she recalled organizing students to rehearse "The Red Lantern" at school. She could describe the main plot and the performance of two students, but her memory of some specific moments was vague. (Language fluency: 125 words / minute, with 2 slight pauses).

[0037] Archive of Shares: Ms. Li recorded a message of encouragement for her grandson: "Baby, you should be like your grandma and stick to your hobbies..." The recording was combined with a black and white photo of her performing in "The Red Lantern" when she was young to create a multimedia keepsake.

[0038] After 6 weeks of intervention, Ms. Li's delayed recall score on the "Audio-Vocabulary Learning Test" improved by 15% compared to before the intervention, and her MoCA scores for "Language Abstraction" and "Delayed Recall" improved by 1-2 points.

[0039] This invention provides a comparative example: This comparative study designed a 12-week controlled experiment, with the experimental group using the aforementioned invention and the comparative group employing conventional nostalgia therapy. The comparative group consisted of groups of 5-8 people, where a facilitator showed uniform old photos (such as ration coupons and vintage furniture) and played classic old songs (such as "Tian Mi Mi"), followed by open-ended group discussions. This was conducted once a week for 60 minutes each time.

[0040] This study recruited 60 patients with mild to moderate Alzheimer's disease (MMSE 15-26) who were randomly assigned to a control group and the present invention group, with 30 patients in each group. There were no differences between the two groups in terms of age, sex, years of education, and baseline MMSE scores.

[0041] This experiment assessed cognitive function using the Alzheimer's Disease Assessment Scale - Cognitive Section (ADAS-Cog), with lower scores being better. It also assessed psychosocial symptoms using the Neuropsychiatric Inventory (NPI), with lower scores being better. Quality of life was assessed using the Alzheimer's Disease Related Quality of Life Scale (QoL-AD), with higher scores being better. Caregiver burden was assessed using the Zarit Caregiver Burden Interview (ZBI), with lower scores being better. All scores were recorded after 12 weeks of the experiment.

[0042]

[0043] As shown in the table above, the cognitive function of patients in the comparative group deteriorated with the natural progression of the disease (ADAS-Cog increased), while patients in the invention group showed significant improvement in cognitive function (ADAS-Cog decreased). This indicates that the invention can effectively delay or even temporarily reverse cognitive decline.

[0044] As shown in the table above, the present invention is superior to conventional nostalgia therapy in improving patients' mood, reducing psychosocial symptoms (NPI), and enhancing subjective quality of life (QoL-AD). This demonstrates that the individualized themes and emotional sharing sessions deeply meet the psychological needs of patients.

[0045] As shown in the table above, the burden on caregivers in the invention group was reduced to a much greater extent than that in the control group. This demonstrates that family bonding mechanisms such as "voice files" are very effective in alleviating caregiving pressure by improving intergenerational relationships.

[0046] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention in any other way. Any person skilled in the art may make changes or modifications to the above-disclosed technical content to create equivalent embodiments that can be applied to other fields. However, any simple modifications, equivalent changes, and modifications made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the protection scope of the present invention.

Claims

1. A cognitive impairment nostalgia audio-visual intervention therapy characterized in that, The method comprises the following steps: S1, setting up a nostalgic audio-visual scene, which comprises at least three independent panels corresponding to nostalgic opera, classic movies and retro sound, wherein each panel is provided with audio playing equipment and visual display elements; S2, providing opera audio recordings and corresponding stills for the nostalgic opera panel, providing movie audio clips or theme songs and corresponding classic scenes for the classic movie panel, and providing old sound audio recordings and corresponding scene photos for the retro sound panel, wherein the old sound includes environmental sound, vehicle sound or hawking sound; S3, playing audio selected from the nostalgic opera, classic movie or retro sound panel to the patient with cognitive impairment; S4, guiding the patient to perform at least one intervention activity based on the played audio; S5, setting up a time photography studio, restoring old scenes of a specific life stage of the patient based on the patient's personal history, and providing the patient with costumes and props characteristic of the era, taking theme photos, restoring at least one of the patient's wedding, work position, family old home living room or school classroom, and preparing the corresponding era costumes, furniture and daily props.

2. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 1, characterized in that, The intervention activities include: a guessing activity, which requires the patient to guess the movie name, opera type or sound occurrence scene corresponding to the played audio, to stimulate brain recall; a theme recall activity, which guides the patient to recall personal experiences according to a preset theme, the theme including love, career, learning experience or special event, to exercise memory, logical thinking and language expression ability; a sharing activity, which guides the patient to express personal thoughts or feelings and records them as a sound archive for sharing with children or caregivers.

3. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 2, characterized in that: In the guessing activity of step S4, feedback is provided according to the patient's guess, and corresponding visual elements are displayed to enhance recall guidance.

4. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 3, characterized in that: In the theme recall activity of step S4, the preset theme is customized according to the patient's personal history, and the patient is guided to describe in detail through questioning.

5. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 4, characterized in that: In the sharing activity of step S4, the sound archive is edited and shared in digital form with the patient's children to rebuild emotional channels and relieve caregiver stress.

6. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 5, characterized in that: The setting up of the nostalgic audio-visual scene in step S1 also includes an old scene photo shooting link, which shoots photos of familiar nostalgic scenes of the patient as visual elements and integrates them into the corresponding panel.

7. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 6, characterized in that: The opera audio in step S2 includes Kunqu Opera and Peking Opera, the movie audio clips include "Liu Sanjie" and "Shajiabang", and the old sound includes siren sound, bicycle bell sound, scrap collecting hawking sound or repair hawking sound.

8. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 7, characterized in that: In step S3, the corresponding visual elements are displayed synchronously when the audio is played, to form a multi-modal sensory stimulation.

9. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 8, characterized in that: The intervention activities in step S4 are performed in sequence, first the guessing activity, then the theme recall activity, and finally the sharing activity, to gradually deepen cognitive stimulation.

10. The cognitive impairment nostalgia audiovisual intervention therapy according to claim 9, characterized in that: The method further comprises evaluating the patient's cognitive improvement indicators after the intervention activities, including recall accuracy, expression fluency or emotional response.

Images