Autism intervention treatment device and use method thereof

Abstract

The present invention discloses an autism intervention treatment device and a method of using the device, which relates to the field of autism intervention treatment, and includes a visual intervention device, a central control device, a first condition monitoring device, an auditory buffer device, and a second condition monitoring device. The visual intervention device is worn on the eyes, the first condition monitoring device is mounted on the bridge of the nose, and the auditory buffer device is worn on the ears. The present invention modifies the images seen by the patient and the sounds heard by the patient through the visual intervention device and the auditory buffer device, so that the patient can perform intervention treatment anytime and anywhere in real life, wherein the visual intervention device can modify the images seen by the patient, and the central control device matches the images with appropriate audio to reduce the pressure of the surrounding environment on the patient. The device can be used in various environments to prevent the patient from having emotions that are greatly different from those of others, and help the patient relax in social activities.

Description

Technical Field

[0001] The present invention relates to the technical field of autism intervention treatment, and in particular to an autism intervention treatment device and a use method thereof. Background Art

[0002] Autism, also known as autism, is a neurodevelopmental disorder with pervasive developmental disorders. Autism usually appears in early childhood and will have a significant impact on an individual's social interaction, communication skills, interests and behavior patterns. Its symptoms are complex and diverse, and the severity varies from person to person. Social disorders are one of the core symptoms of autism. Patients often lack attention to the presence of others, do not actively make eye contact with others, and rarely respond to the calls of others.

[0003] In real life, autistic patients often find it difficult to establish normal social relationships with others and lack the ability to communicate and interact with others. This often makes them isolated in interpersonal communication, difficult to understand and express their own emotions, and difficult to understand the feelings of others, resulting in a relatively poor emotional world and a strong sense of loneliness. In addition, autistic patients often have problems with repetitive stereotyped behaviors and narrow interests, which interfere with their normal life and learning. At the same time, they have poor adaptability to environmental changes and are prone to emotional problems such as anxiety, fear, and anger. They often have difficulty self-regulating and may cause self-harm or attack on others. In severe cases, autistic patients also have difficulties in taking care of themselves, such as dressing, washing, eating and other basic life skills. They are heavily dependent on the care of others. Early detection, early diagnosis, and early intervention can avoid irreversible damage to patients due to delayed diagnosis and treatment. Therefore, the diagnosis, treatment, and intervention of autism are of great significance.

[0004] In the prior art, for example, the "device for autism intervention treatment by floating method" with publication number CN113908399A includes a floating chamber, a water bath system, a lighting system and an electric control system. The floating chamber includes a floating chamber body, a floating chamber cover and a floating chamber cover bracket. The floating chamber body is an oblong bathtub structure. The water bath system consists of a salt water inlet, a salt water outlet and a constant temperature system. The lighting system consists of a lighting LED lamp group and a lighting switch. The electric control system consists of a central control system, a 12-204V lithium battery, a power socket and a power switch. The constant temperature system is connected to the central control system. The lighting LED lamp group and the lighting switch are respectively connected to the central control system and the 12-204V lithium battery. It uses the human body floating method to relieve muscle tension caused by pressure, release pressure, reduce loss and anxiety, and improve fatigue and sleep status to intervene in the treatment of patients with neurodevelopmental disorders such as autism. It has considerable requirements for the site, is not convenient to use at any time, and the treatment methods are relatively single. Summary of the invention

[0005] The purpose of the present invention is to provide an autism intervention treatment device and a method of using the same, so as to solve the problems raised in the above-mentioned background technology that the existing floating method intervention treatment for autism patients has considerable requirements for the venue, is not convenient to use at any time, and has relatively single treatment methods.

[0006] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: an autism intervention treatment device, comprising a visual intervention device, a central control device, a first condition monitoring device, an auditory buffer device, and a second condition monitoring device, wherein the visual intervention device and the auditory buffer device are set to an interactive control relationship through the central control device, the visual intervention device is used to modify the picture seen by the patient, the central control device controls the auditory buffer device according to the lighting, scene and picture in the visual intervention device, the first condition monitoring device and the second condition monitoring device are both connected to the central control device by Bluetooth, and the central control device determines the modification direction and adjustment range of the data according to the data monitored by the first condition monitoring device and the second condition monitoring device;

[0007] The visual intervention device includes a lens, a micro OLED display screen is embedded inside the lens to present key information on demand, and the central control device is fixedly mounted on one end of the lens.

[0008] Preferably, the central control device includes a glasses frame, a frame and an image sensor chip, the image sensor chip is embedded in the glasses frame, one end of the frame is fixedly connected to one end of the glasses frame, a fitting piece is fixedly installed at the junction of the glasses frame and the lens, and heat dissipation holes are opened inside the glasses frame.

[0009] Preferably, the first condition monitoring device includes a nose bridge support, a limit head and a temperature and humidity sensor, the limit head is fixedly installed at both ends of the nose bridge support, and the temperature and humidity sensor is fixedly installed on the inner side of the nose bridge support.

[0010] Preferably, the auditory buffer device includes a bone conduction earphone and a rubber plug, the rubber plug is sleeved on the bell mouth of the bone conduction earphone, the input end of the bone conduction earphone is fixedly connected to a data cable, the other end of the data cable is fixedly connected to the inside of the eyeglass frame, a connector is rotatably installed at the junction of the eyeglass frame and the data cable, a limit block is fixedly installed on the side of the frame, and the data cable is connected to the inside of the limit block.

[0011] Preferably, the second condition monitoring device includes a rubber sleeve, a positioning head, a pull-rope displacement sensor, a limiting rope, a tension spring and a connecting rod, the positioning head is fixedly mounted on one end of the rubber sleeve, one end of the pull-rope displacement sensor is fixedly connected to the positioning head, the other end of the pull-rope displacement sensor is fixedly connected to the other end of the rubber sleeve, the limiting rope and the pull-rope displacement sensor form a closed ring structure, one end of the tension spring is fixedly connected to one end of the pull-rope displacement sensor, the tension spring is sleeved on the outer wall of the limiting rope, the other end of the tension spring is fixedly connected to one end of the connecting rod, and one end of the connecting rod is slidably connected to the inside of the pull-rope displacement sensor.

[0012] Preferably, the central control device uses a control system, which includes a living environment calculation module, a motion trajectory calculation module, an object recognition and audio association judgment module, a behavior assessment and judgment module, a scenario analysis module, an audio output module, a health status monitoring module, an image replacement module and an audio adjustment module;

[0013] The living environment calculation module is used to obtain the surrounding environment information and evaluate the impact of the current environment on the patient;

[0014] The motion trajectory calculation module is used to estimate the moving route and next position of each object in the picture;

[0015] The object recognition and audio association judgment module is used to judge the matching degree between the object in the picture and the output content of the auditory buffer device;

[0016] The behavior assessment and judgment module is used to assess the behavior of the person in the picture and determine whether his behavior will affect the patient's emotions;

[0017] The scenario analysis module is used to analyze whether the current scenario matches the behavior of the characters in the picture;

[0018] The audio output module is used to control the output items of the auditory buffer device;

[0019] The health status monitoring module is used to monitor the patient's physical information in real time and select replacement content suitable for the visual intervention device and the auditory buffer device according to the health status. The health status monitoring module includes an autonomic nervous system reaction monitoring unit and a muscle tension and movement monitoring unit. The autonomic nervous system reaction monitoring unit monitors the patient's body temperature, breathing and sweat, and the muscle tension and movement monitoring unit monitors the patient's muscle contraction degree, movement and behavior;

[0020] The image replacement module is used to accurately control the specific adjustment content of the picture and ensure that the adjusted content can conform to the picture in the visual intervention device;

[0021] The audio adjustment module is used to adjust the content of the output item of the auditory buffer device.

[0022] Preferably, the image replacement module includes an image loading and preprocessing section, a target recognition and positioning section, an image segmentation section, a replacement material preparation section, an image replacement and fusion section, and a post-processing and optimization section:

[0023] The image loading and preprocessing section is used to decode image files of different formats, parse file information and image data, and read image data into memory to prepare for subsequent processing;

[0024] The target recognition and positioning module is used to identify specific objects, people, scenes and other elements in the image, and determine their location, size and category information, and identify the number of people in the image, their expressions, gestures, and the architectural and natural landscape features in the scene;

[0025] The image segmentation module is used to separate the target object from the source image background and divide the various components of the target object and the boundaries of different areas, laying the foundation for the subsequent image replacement and fusion modules;

[0026] The replacement material preparation section is used to fully process the replacement materials selected by the user and generated by the system to make them fit the target area to be replaced in the source image in terms of size, color and style;

[0027] The image replacement and fusion section is used to embed the replaced material into the target area that has been segmented in the source image, and use image fusion technology to achieve a natural transition and seamless connection between the replaced material and the background and surrounding areas of the source image in terms of color, texture, light and shadow;

[0028] The post-processing and optimization section is used to improve the quality and optimize the details of the replaced and fused images.

[0029] Preferably, the replacement material preparation section also includes the following contents:

[0030] A1. Image import unit: receives image data from different sources and converts it into a format that the system can process uniformly;

[0031] A2, target designation and recognition unit: determine the target objects or areas that need to be replaced in the source image, then locate and recognize these targets, and provide accurate target information for subsequent image replacement operations, including the location, shape, and category of the target;

[0032] A3. Material preparation unit: Comprehensively preprocess and optimize the materials to be used for image replacement, so that they match the source images in the subsequent replacement and fusion stages, and achieve a natural transition in terms of size, color, style, and texture;

[0033] A4, a replacement execution unit: according to the target information determined in step A1, step A2 and step A3 and the prepared replacement material, the material is accurately replaced to the corresponding target position in the source image, and an effective fusion technology is used to make the replacement area naturally connected with the surrounding part of the source image;

[0034] A5. Optimize output unit: Improve the quality and convert the format of the image after the replacement operation is completed.

[0035] Preferably, the image replacement and fusion section includes the following contents:

[0036] B1. Filter library and template management unit: Provide patients with a variety of image filter effects and image templates to enhance the visual expression of images after replacement to meet the needs of different scenarios;

[0037] B2, filter rendering and synthesis unit: apply filter effects to the image after image replacement, and synthesize multiple filter effects and the original elements in the image;

[0038] B3, Template Preset Unit: Create, store and manage image replacement templates, first define the layout, style and element combination of images in different scenes, and then directly use or make personalized modifications based on these templates in subsequent use to quickly generate images that meet specific needs;

[0039] B4, Lighting and shadow processing unit: Perform fine processing on the image after image replacement, analyze, simulate and adjust the lighting and shadow effects;

[0040] B5. Image fusion unit: Receives the source image from the image import unit and after processing, obtains its pixel matrix information, image size and color mode parameters, obtains the pixel matrix information, size and color mode of the replacement material image processed by the material preparation unit, and matches the source image in data format and basic properties. Based on the pixel value of the boundary of the target area in the source image as a constraint condition, gradually adjusts the pixel value of the replacement material in the target area to meet the boundary conditions and achieve natural gradient changes.

[0041] A method for using an autism intervention treatment device, comprising the following contents:

[0042] S1, wearing the visual intervention device on the eyes, attaching the first condition monitoring device to the bridge of the nose, then wearing the auditory buffer device on the ears, and wearing the second condition monitoring device on the wrists and ankles;

[0043] S2, the central control device simultaneously processes the information transmitted back by the visual intervention device, the first condition monitoring device, the auditory buffer device and the second condition monitoring device, and coordinates and controls subsequent operations;

[0044] S3, replacing the image and adding filters to the picture displayed in the lens, controlling the output content of the auditory buffer device, and monitoring the physical condition after the picture modification and audio adjustment in real time through the first condition monitoring device and the second condition monitoring device.

[0045] Compared with the prior art, the present invention has the following beneficial effects:

[0046] 1. In the present invention, the images seen by the patient and the sounds heard by the patient are modified through the visual intervention device and the auditory buffer device, so that the patient can undergo intervention treatment anytime and anywhere in real life, wherein the visual intervention device can modify the images seen by the patient, and the central control device matches the images with appropriate audio to reduce the pressure of the surrounding environment on the patient. This device can be used in various environments to prevent the patient from having emotions that are significantly different from those of others, and help the patient relax in social activities. In addition, the patient's mental state is monitored in real time during the intervention treatment, and the patient's physical and psychological reactions are monitored through the first state monitoring device and the second state monitoring device, providing more sufficient data for the operation of the central control device.

[0047] 2. In the present invention, the image replacement module can overlay the image mode that the patient prefers onto the actual picture, thereby improving the patient's comfort and reducing the patient's rejection of the environment. The audio adjustment module can adjust the audio played in the auditory buffer device in real time to reduce the patient's influence on the external environment. The combined use can greatly extend the time the patient stays in social occasions. The multi-dimensional monitoring of the health status monitoring module can specifically adjust the visual picture to a tranquil natural scenery and match it with soothing music when it is detected that the patient's muscle contraction and breathing are accelerated due to tension, so as to help the patient relax, make the intervention measures more in line with the patient's actual needs at the moment, and improve the effect and efficiency of rehabilitation treatment. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a schematic diagram of the three-dimensional structure of an autism intervention treatment device of the present invention;

[0049] Figure 2 It is a schematic diagram of the planar structure of a visual intervention device, a central control device and an auditory buffer device of an autism intervention treatment device of the present invention;

[0050] Figure 3 It is a schematic diagram of the three-dimensional structure of a first condition monitoring device of an autism intervention treatment device of the present invention;

[0051] Figure 4 A schematic diagram of the connection and structure of a central control device and an auditory buffer device of an autism intervention treatment device of the present invention;

[0052] Figure 5 For the present invention Figure 4 A schematic diagram of the structure of part A in the middle;

[0053] Figure 6 This is a schematic diagram of the structure disassembly of a second condition monitoring device of an autism intervention treatment device of the present invention;

[0054] Figure 7 A schematic diagram of a control system framework of a central control device of an autism intervention treatment device according to the present invention;

[0055] Figure 8 This is a schematic diagram of the framework of an image replacement module of an autism intervention treatment device of the present invention;

[0056] Fig. 9 A schematic diagram of a replacement material preparation section framework for an autism intervention treatment device of the present invention;

[0057] Fig.10 A schematic diagram of the framework of an image replacement and fusion module of an autism intervention treatment device according to the present invention;

[0058] Fig.11 This is a schematic diagram of the framework of a health status monitoring module of an autism intervention treatment device of the present invention.

[0059] In the figure: 1. Visual intervention device; 2. Central control device; 3. First condition monitoring device; 4. Auditory buffer device; 5. Second condition monitoring device; 6. Living environment calculation module; 7. Audio output module; 8. Health status monitoring module; 9. Situation analysis module; 10. Behavior assessment and judgment module; 11. Object recognition and audio association judgment module; 12. Movement trajectory calculation module; 13. Image replacement module; 14. Audio adjustment module; 15. Target recognition and positioning section; 16. Image segmentation section; 17. Replacement material preparation section; 18. Image replacement and fusion section ; 19. Post-processing and optimization section; 20. Image loading and pre-processing section; 101. Lens; 201. Glasses frame; 202. Frame; 203. Connector; 204. Limit block; 205. Data cable; 206. Fitting sheet; 207. Heat dissipation hole; 208. Image sensor chip; 301. Nose bridge support; 302. Limit head; 303. Temperature and humidity sensor; 401. Bone conduction earphone; 402. Rubber plug; 501. Rubber sleeve; 502. Positioning head; 503. Pull rope displacement sensor; 504. Limit rope; 505. Tension spring; 506. Connecting rod. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the implementation regulations described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0061] Example 1: Reference Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 and Figure 6 As shown: an autism intervention treatment device, comprising a visual intervention device 1, a central control device 2, a first condition monitoring device 3, an auditory buffer device 4 and a second condition monitoring device 5, wherein the visual intervention device 1 is worn on the eyes, the first condition monitoring device 3 is mounted on the bridge of the nose, the auditory buffer device 4 is worn on the ears, and the second condition monitoring device 5 is sleeved on the wrists and ankles. An interactive control relationship is set between the visual intervention device 1 and the auditory buffer device 4 through the central control device 2. The visual intervention device 1 is used to modify the image seen by the patient. The central control device 2 controls the auditory buffer device 4 according to the ambient light, scene and the image in the visual intervention device 1. The first condition monitoring device 3 and the second condition monitoring device 5 are both connected to the central control device 2 by Bluetooth. The central control device 2 determines the modification direction and adjustment range of the data according to the data monitored by the first condition monitoring device 3 and the second condition monitoring device 5;

[0062] The visual intervention device 1 includes a lens 101 , a micro OLED display screen is embedded inside the lens 101 , and a central control device 2 is fixedly mounted on one end of the lens 101 .

[0063] In this embodiment, when in use, the visual intervention device 1 is worn on the eyes, and the first condition monitoring device 3 is then attached to the bridge of the nose, and then the auditory buffer device 4 is worn on the ears, and the second condition monitoring device 5 is worn on the wrists and ankles. The visual intervention device 1 intervenes and adjusts the images seen by the patient, and the auditory buffer device 4 plays audio that can relax the patient. The first condition monitoring device 3 and the second condition monitoring device 5 monitor the patient's physical condition in real time, and when actually used, the central control device 2 controls the visual intervention device 1 and the auditory buffer device 4 according to the data monitored by the first condition monitoring device 3 and the second condition monitoring device 5;

[0064] A micro OLED display is embedded inside the lens 101 to present key information on demand. The central control device 2 uses a camera, a processor and an inertial sensor. The camera is a CMOS camera placed on both sides of the front end of the glasses frame 201 to ensure an ultra-wide viewing angle, capable of capturing a 180° panoramic view of the environment, adapting to different light conditions, and automatically turning on the infrared fill light in low light to ensure picture clarity. The processor is a RAM processor, and the inertial sensor has a built-in accelerometer, gyroscope and magnetometer to track the glasses' posture and head movement in real time, providing data support for picture stability and scene switching, and facilitating accurate positioning of the wearer's own position.

[0065] Embodiment 2: According to Figure 1 , Figure 2 , Figure 4 , Figure 5 , Figure 7 and Fig.11 As shown, the central control device 2 includes a glasses frame 201, a frame 202 and an image sensor chip 208. The image sensor chip 208 is embedded in the glasses frame 201. One end of the frame 202 is fixedly connected to one end of the glasses frame 201. A bonding sheet 206 is fixedly installed at the junction of the glasses frame 201 and the lens 101. A heat dissipation hole 207 is provided inside the glasses frame 201. The image sensor chip 208 is a CMOS image sensor chip. The glasses frame 201 is connected to the lens 101 through the bonding sheet 206.

[0066] The central control device 2 uses a control system, which includes a living environment calculation module 6, a motion trajectory calculation module 12, an object recognition and audio association judgment module 11, a behavior evaluation and judgment module 10, a scenario analysis module 9, an audio output module 7 and a health status monitoring module 8, an image replacement module 13 and an audio adjustment module 14;

[0067] The living environment calculation module 6 is used to obtain the surrounding environment information and evaluate the impact of the current environment on the patient;

[0068] The motion trajectory calculation module 12 is used to estimate the moving route and next position of each object in the picture;

[0069] The object recognition and audio association judgment module 11 is used to judge the matching degree between the object in the picture and the output content of the auditory buffer device 4;

[0070] The behavior assessment and judgment module 10 is used to assess the behavior of the person in the picture and determine whether his behavior will affect the patient's emotions;

[0071] The scene analysis module 9 is used to analyze whether the current scene matches the behavior of the characters in the picture;

[0072] The audio output module 7 is used to control the output items of the auditory buffer device 4;

[0073] The health status monitoring module 8 is used to monitor the patient's physical information in real time, and select replacement contents suitable for the visual intervention device 1 and the auditory buffer device 4 according to the health status. The health status monitoring module 8 includes an autonomic nervous system reaction monitoring unit and a muscle tension and movement monitoring unit. The autonomic nervous system reaction monitoring unit monitors the patient's body temperature, breathing and sweat, and the muscle tension and movement monitoring unit monitors the patient's muscle contraction degree, movement and behavior;

[0074] The image replacement module 13 is used to accurately control the specific adjustment content of the picture and ensure that the adjusted content can conform to the picture in the visual intervention device 1;

[0075] The audio adjustment module 14 is used to adjust the content of the output item of the auditory buffer device 4 .

[0076] In this embodiment, by evaluating the environmental impact through the living environment calculation module 6, a more suitable visual and auditory environment for the patient's recovery state can be created, the stimulation of adverse environmental factors can be reduced, and the emotional stability and recovery process can be promoted. For example, if the environmental information shows that the patient is in a noisy and bright environment, the visual and auditory content can be adjusted accordingly to soothe the patient's emotions;

[0077] The motion trajectory calculation module 12 helps to know the dynamics of the objects in the picture in advance, making the picture presented by the visual intervention device 1 more coherent and predictable, reducing the discomfort or confusion caused by the sudden change of the picture to the patient, enhancing the comfort and immersion of the visual experience, and having a positive soothing effect on emotions;

[0078] The object recognition and audio association judgment module 11 ensures that the image and the audio match and coordinate, avoiding conflicts or inconsistencies between visual and auditory information, making the multi-sensory information received by the patient more harmonious and unified, helping to improve their cognitive understanding ability and emotional stability, and avoiding emotional fluctuations such as irritability caused by information confusion;

[0079] The behavior assessment and judgment module 10 and the scenario analysis module 9 work together to accurately screen out the behaviors and scenarios that may affect the patient's emotions, and timely adjust the visual intervention content to prevent the patient from experiencing emotional fluctuations due to adverse visual stimulation, such as preventing the patient from seeing images or scenarios that may trigger negative emotions such as violence and sadness, thereby promoting emotional health and psychological recovery;

[0080] The multi-dimensional monitoring of the health status monitoring module 8, including the monitoring of the autonomic nervous system response and muscle tension and movement, can grasp the changes in the patient's physical state in real time and comprehensively, and select appropriate visual and auditory replacement content based on these precise health data, thus realizing personalized customization of medical intervention. For example, when it is monitored that the patient's muscle contraction is aggravated and breathing is accelerated due to tension, the visual image can be adjusted to a tranquil natural scenery with soothing music to help the patient relax, so that the intervention measures are more in line with the patient's actual needs at the moment, and the effectiveness and efficiency of rehabilitation treatment are improved.

[0081] The image replacement module 13 and the audio adjustment module 14 can accurately and flexibly adjust the visual and auditory content according to the analysis results of the above modules, ensuring that the output content, whether it is picture details or audio elements, can meet the needs of patients in specific health conditions and scenarios to the greatest extent, thereby improving the adaptability and effectiveness of the entire visual and auditory intervention system and providing patients with better quality and more accurate medical assistance services.

[0082] Embodiment 3: According to Figure 1 , Figure 2 and Figure 4 As shown, the auditory buffer device 4 includes a bone conduction earphone 401 and a rubber plug 402. The rubber plug 402 is sleeved on the bell mouth of the bone conduction earphone 401. The input end of the bone conduction earphone 401 is fixedly connected with a data cable 205. The other end of the data cable 205 is fixedly connected to the inside of the eyeglass frame 201. A connector 203 is rotatably installed at the intersection of the eyeglass frame 201 and the data cable 205. A limit block 204 is fixedly installed on the side of the frame 202, and the data cable 205 is connected to the inside of the limit block 204.

[0083] In this embodiment, the bone conduction earphone 401 is connected to the central control device 2 via a data cable 205. When worn, the data cable 205 is controlled by the connector 203 and the limit block 204 to improve the comfort of the patient when wearing it.

[0084] Embodiment 4: According to Figure 1 and Figure 6 As shown, the first condition monitoring device 3 includes a nose bridge support 301, a limit head 302 and a temperature and humidity sensor 303, the limit head 302 is fixedly installed at both ends of the nose bridge support 301, and the temperature and humidity sensor 303 is fixedly installed on the inner side of the nose bridge support 301;

[0085] The second condition monitoring device 5 includes a rubber sleeve 501, a positioning head 502, a pull-rope displacement sensor 503, a limiting rope 504, a tension spring 505 and a connecting rod 506. The positioning head 502 is fixedly mounted on one end of the rubber sleeve 501, one end of the pull-rope displacement sensor 503 is fixedly connected to the positioning head 502, the other end of the pull-rope displacement sensor 503 is fixedly connected to the other end of the rubber sleeve 501, the limiting rope 504 and the pull-rope displacement sensor 503 form a closed ring structure, one end of the tension spring 505 is fixedly connected to one end of the pull-rope displacement sensor 503, the tension spring 505 is sleeved on the outer wall of the limiting rope 504, the other end of the tension spring 505 is fixedly connected to one end of the connecting rod 506, and one end of the connecting rod 506 is slidably connected to the inside of the pull-rope displacement sensor 503.

[0086] In this embodiment, the nose bridge support 301 is connected to the nose bridge. When the patient has emotional fluctuations, the body temperature and heart rate will increase. The temperature increase will be directly detected by the temperature and humidity sensor 303. The heart rate increase will have different conditions according to the degree. The mild state has little effect on the patient and can be ignored. When the heart rate increases severely, more sweat will be secreted on the skin. When the temperature and humidity sensor 303 detects the increase of temperature and humidity at the same time, it means that the patient's current state is relatively bad.

[0087] The second condition monitoring device 5 is used to monitor the patient's physical reaction. When the patient has muscle tension or unnatural body movements, it means that the patient is very uncomfortable with the current environment. The rubber sleeve 501 directly adheres to the patient's skin surface and contacts the muscles. When the muscle tension changes, it will drive the tension spring 505. The limiting rope 504 is an elastic rope. When the shape of the tension spring 505 changes, it will drive the connecting rod 506 to move in the pull rope displacement sensor 503. The larger the movement, the higher the muscle tension, which means that the patient is more nervous at this time.

[0088] Embodiment 5: According to Figure 8 , Fig. 9 and Fig.10 As shown, the image replacement module 13 includes an image loading and preprocessing section 20, a target recognition and positioning section 15, an image segmentation section 16, a replacement material preparation section 17, an image replacement and fusion section 18, and a post-processing and optimization section 19:

[0089] The image loading and preprocessing section 20 is used to decode image files of different formats, parse the file information and image data part, and read the image data into the memory to prepare for subsequent processing;

[0090] The target recognition and positioning section 15 is used to recognize specific objects, people, scenes and other elements in the image, and determine their location, size and category information, and recognize the number of people in the image, their expressions, gestures, and the architectural and natural landscape features in the scene;

[0091] The image segmentation module 16 is used to separate the target object from the background of the source image and to divide the components of the target object and the boundaries of different regions, laying the foundation for the subsequent image replacement and fusion module 18;

[0092] The replacement material preparation section 17 is used to comprehensively process the replacement material selected by the user and generated by the system so that it is adapted to the target area to be replaced in the source image in terms of size, color and style;

[0093] The replacement material preparation section 17 also includes the following:

[0094] A1. Image import unit: receives image data from different sources and converts it into a format that the system can process uniformly;

[0095] A2, target designation and recognition unit: determine the target objects or areas that need to be replaced in the source image, then locate and recognize these targets, and provide accurate target information for subsequent image replacement operations, including the location, shape, and category of the target;

[0096] A3. Material preparation unit: Comprehensively preprocess and optimize the materials to be used for image replacement, so that they match the source images in the subsequent replacement and fusion stages, and achieve a natural transition in terms of size, color, style, and texture;

[0097] A4, a replacement execution unit: according to the target information determined in step A1, step A2 and step A3 and the prepared replacement material, the material is accurately replaced to the corresponding target position in the source image, and an effective fusion technology is used to make the replacement area naturally connected with the surrounding part of the source image;

[0098] A5. Optimize the output unit: improve the quality and convert the format of the image after the replacement operation is completed;

[0099] The image replacement and fusion section 18 is used to embed the replaced material into the target area that has been segmented in the source image, and use image fusion technology to achieve a natural transition and seamless connection between the replaced material and the background and surrounding area of ​​the source image in terms of color, texture, light and shadow;

[0100] Image Replacement and Fusion Section 18 includes the following:

[0101] B1. Filter library and template management unit: Provide patients with a variety of image filter effects and image templates to enhance the visual expression of images after replacement to meet the needs of different scenarios;

[0102] B2, filter rendering and synthesis unit: apply filter effects to the image after image replacement, and synthesize multiple filter effects and the original elements in the image;

[0103] B3, Template Preset Unit: Create, store and manage image replacement templates, first define the layout, style and element combination of images in different scenes, and then directly use or make personalized modifications based on these templates in subsequent use to quickly generate images that meet specific needs;

[0104] B4, Lighting and shadow processing unit: Perform fine processing on the image after image replacement, analyze, simulate and adjust the lighting and shadow effects;

[0105] B5. Image fusion unit: receives the processed source image from the image import unit, obtains its pixel matrix information, image size and color mode parameters, obtains the pixel matrix information, size and color mode of the replacement material image processed by the material preparation unit, matches and connects with the source image in data format and basic attributes, and gradually adjusts the pixel value of the replacement material in the target area based on the pixel value of the boundary of the target area in the source image as a constraint condition, so that it meets the boundary condition and realizes a natural gradient change;

[0106] The post-processing and optimization section 19 is used to improve the quality and optimize the details of the replaced and fused images.

[0107] In this embodiment, the image loading and preprocessing module 20 can process image files in various formats, ensuring that the system can widely accept various image resources;

[0108] The target recognition and positioning module 15 identifies the features of people, objects and scenes in the image in detail, including the expressions, gestures and details of various elements in the scene, which helps to select appropriate replacement strategies according to the specific needs and emotional state of the patient;

[0109] The image segmentation module 16 accurately separates the target object from the background and divides the boundaries and components, so that the replacement operation can be more carefully performed on the target area without affecting other irrelevant parts of the image, providing a clear definition of the operation area for image replacement and fusion, so that the subsequent fusion processing can be performed based on the accurate boundaries of the target object, ensuring a natural transition between the replacement material and the source image at the boundary, reducing splicing marks, and improving the coherence and consistency of the overall visual effect;

[0110] The replacement material preparation section 17 can perfectly match the replacement material with the target area of ​​the source image in terms of size, color, style, texture, etc. through the coordinated work of the image import unit, the target designation and identification unit, the material preparation unit, the replacement execution unit and the optimized output unit;

[0111] Image Replacement and Fusion Section 18 The filter library and template management unit provides a rich variety of filter effects and image templates. Before use, you can select appropriate filters according to different scenes and needs to enhance the artistic sense and expressiveness of the image, or apply templates to quickly generate images of a specific style. For example, when designing images for child patients, you can choose cartoon-style templates and colorful filters to increase the interest and attractiveness of the image. The lighting and shadow processing unit performs fine-grained lighting and shadow adjustments on the replaced image to achieve a natural match between the replacement material and the source image in terms of lighting conditions and shadow effects.

[0112] How to use and working principle of this device:

[0113] First, wear the visual intervention device 1 on the eyes, attach the first condition monitoring device 3 to the bridge of the nose, then wear the auditory buffer device 4 on the ears, and wear the second condition monitoring device 5 on the wrists and ankles;

[0114] The central control device 2 simultaneously processes the information transmitted back by the visual intervention device 1, the first condition monitoring device 3, the auditory buffer device 4 and the second condition monitoring device 5, and coordinates and controls the subsequent operations, specifically in the second embodiment and the fifth embodiment;

[0115] The image displayed in the lens 101 is replaced and a filter is added, the output content of the auditory buffer device 4 is controlled, and the physical condition after the image modification and audio adjustment is monitored in real time through the first condition monitoring device 3 and the second condition monitoring device 5.

[0116] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An autism intervention treatment device, characterized in that: The device comprises a visual intervention device (1), a central control device (2), a first condition monitoring device (3), an auditory buffer device (4) and a second condition monitoring device (5), wherein the visual intervention device (1) is worn on the eyes, the first condition monitoring device (3) is mounted on the bridge of the nose, the auditory buffer device (4) is worn on the ears, and the second condition monitoring device (5) is sleeved on the wrists and ankles. The visual intervention device (1) and the auditory buffer device (4) are set to an interactive control relationship through the central control device (2). The visual intervention device (1) is used to modify the image seen by the patient. The central control device (2) controls the auditory buffer device (4) according to the ambient light, scene and the image in the visual intervention device (1). The first condition monitoring device (3) and the second condition monitoring device (5) are both connected to the central control device (2) via Bluetooth. The central control device (2) determines the modification direction and adjustment range of the data according to the data monitored by the first condition monitoring device (3) and the second condition monitoring device (5); The visual intervention device (1) comprises a lens (101), wherein a micro OLED display screen is embedded inside the lens (101) to present key information as required, and the central control device (2) is fixedly mounted on one end of the lens (101); The second condition monitoring device (5) comprises a rubber sleeve (501), a positioning head (502), a pull-wire displacement sensor (503), a limit rope (504), a tension spring (505) and a connecting rod (506); the positioning head (502) is fixedly mounted on one end of the rubber sleeve (501); one end of the pull-wire displacement sensor (503) is fixedly connected to the positioning head (502); the other end of the pull-wire displacement sensor (503) is fixedly connected to the other end of the rubber sleeve (501); the limit rope (504) and the pull-wire displacement sensor (503) form a closed ring structure; one end of the tension spring (505) is fixedly connected to one end of the pull-wire displacement sensor (503); the tension spring (505) is sleeved on the outer wall of the limit rope (504); the other end of the tension spring (505) is fixedly connected to one end of the connecting rod (506); and one end of the connecting rod (506) is slidably connected to the inside of the pull-wire displacement sensor (503).

2. The autism intervention treatment device according to claim 1, characterized in that: The central control device (2) comprises a spectacle frame (201), a frame (202) and an image sensor chip (208); the image sensor chip (208) is embedded in the interior of the spectacle frame (201); one end of the frame (202) is fixedly connected to one end of the spectacle frame (201); a bonding sheet (206) is fixedly mounted at the junction of the spectacle frame (201) and the lens (101); and a heat dissipation hole (207) is provided inside the spectacle frame (201).

3. The autism intervention treatment device according to claim 2, characterized in that: The first condition monitoring device (3) comprises a nose bridge support (301), a limit head (302) and a temperature and humidity sensor (303), wherein the limit head (302) is fixedly mounted on both ends of the nose bridge support (301), and the temperature and humidity sensor (303) is fixedly mounted on the inner side of the nose bridge support (301).

4. The autism intervention treatment device according to claim 3, characterized in that: The hearing buffer device (4) comprises a bone conduction earphone (401) and a rubber plug (402), wherein the rubber plug (402) is sleeved on the bell mouth of the bone conduction earphone (401), the input end of the bone conduction earphone (401) is fixedly connected to a data cable (205), the other end of the data cable (205) is fixedly connected to the inside of a spectacle frame (201), a connector (203) is rotatably mounted at the intersection of the spectacle frame (201) and the data cable (205), a limit block (204) is fixedly mounted on the side of the spectacle frame (202), and the data cable (205) is inserted into the inside of the limit block (204).

5. The autism intervention treatment device according to claim 4, characterized in that: The central control device (2) uses a control system, which includes a living environment calculation module (6), a motion trajectory calculation module (12), an object recognition and audio association judgment module (11), a behavior evaluation and judgment module (10), a scenario analysis module (9), an audio output module (7), a health status monitoring module (8), an image replacement module (13) and an audio adjustment module (14); The living environment calculation module (6) is used to obtain surrounding environment information and evaluate the impact of the current environment on the patient; The motion trajectory calculation module (12) is used to estimate the moving route and next position of each object in the picture; The object recognition and audio association judgment module (11) is used to judge the matching degree between the object in the picture and the output content of the auditory buffer device (4); The behavior assessment and judgment module (10) is used to assess the behavior of the person in the picture and determine whether the behavior will affect the patient's emotions; The scene analysis module (9) is used to analyze whether the current scene matches the behavior of the characters in the picture; The audio output module (7) is used to control the output items of the auditory buffer device (4); The health status monitoring module (8) is used to monitor the patient's physical information in real time and select replacement content suitable for the visual intervention device (1) and the auditory buffer device (4) according to the health status. The health status monitoring module (8) includes an autonomic nervous system reaction monitoring unit and a muscle tension and movement monitoring unit. The autonomic nervous system reaction monitoring unit monitors the patient's body temperature, respiration and sweat, and the muscle tension and movement monitoring unit monitors the patient's muscle contraction degree, movement and behavior. The image replacement module (13) is used to accurately control the specific adjustment content of the picture and ensure that the adjusted content can conform to the picture in the visual intervention device (1); The audio adjustment module (14) is used to adjust the content of the output item of the auditory buffer device (4).

6. The autism intervention treatment device according to claim 5, characterized in that: The image replacement module (13) includes an image loading and preprocessing section (20), a target recognition and positioning section (15), an image segmentation section (16), a replacement material preparation section (17), an image replacement and fusion section (18) and a post-processing and optimization section (19); The image loading and preprocessing section (20) is used to decode image files of different formats, parse the file information and image data, and read the image data into the memory to prepare for subsequent processing; The target recognition and positioning module (15) is used to identify specific objects, people, and scene elements in the image, and determine their location, size, and category information, as well as the number of people in the image, their expressions, and their movements, as well as the architectural and natural landscape features in the scene; The image segmentation module (16) is used to separate the target object from the background of the source image and to divide the components of the target object and the boundaries of different regions, laying the foundation for the subsequent image replacement and fusion module (18); The replacement material preparation section (17) is used to comprehensively process the replacement material selected by the user and generated by the system so that it is adapted to the target area to be replaced in the source image in terms of size, color, and style; The image replacement and fusion section (18) is used to embed the replaced material into the target area that has been segmented in the source image, and use image fusion technology to achieve a natural transition and seamless connection between the replaced material and the background and surrounding areas of the source image in terms of color, texture, light and shadow; The post-processing and optimization section (19) is used to improve the quality and optimize the details of the replaced and fused images.

7. The autism intervention treatment device according to claim 6, characterized in that: The replacement material preparation section (17) also includes the following contents: A1. Image import unit: receives image data from different sources and converts it into a format that the system can process uniformly; A2, target designation and recognition unit: determine the target objects or areas that need to be replaced in the source image, then locate and recognize these targets, and provide accurate target information for subsequent image replacement operations, including the location, shape, and category of the target; A3. Material preparation unit: Comprehensively preprocess and optimize the materials to be used for image replacement, so that they match the source images in the subsequent replacement and fusion stages, and achieve a natural transition in terms of size, color, style, and texture; A4, a replacement execution unit: according to the target information determined in step A1, step A2 and step A3 and the prepared replacement material, the material is accurately replaced to the corresponding target position in the source image, and a fusion technology is used to make the replacement area naturally connected with the surrounding part of the source image; A5. Optimize output unit: Improve the quality and convert the format of the image after the replacement operation is completed.

8. The autism intervention treatment device according to claim 7, characterized in that: The image replacement and fusion section (18) includes the following contents: B1. Filter library and template management unit: Provide patients with a variety of image filter effects and image templates to enhance the visual expression of images after replacement to meet the needs of different scenarios; B2, filter rendering and synthesis unit: apply filter effects to the image after image replacement, and synthesize multiple filter effects and the original elements in the image; B3, Template Preset Unit: Create, store and manage image replacement templates, first define the layout, style and element combination of images in different scenes, and then directly use or make personalized modifications based on these templates in subsequent use to quickly generate images that meet specific needs; B4, Lighting and shadow processing unit: Perform fine processing on the image after image replacement, analyze, simulate and adjust the lighting and shadow effects; B5. Image fusion unit: Receives the source image from the image import unit and after processing, obtains its pixel matrix information, image size and color mode parameters, obtains the pixel matrix information, size and color mode of the replacement material image processed by the material preparation unit, and matches the source image in data format and basic properties. Based on the pixel value of the boundary of the target area in the source image as a constraint condition, gradually adjusts the pixel value of the replacement material in the target area to meet the boundary conditions and achieve natural gradient changes.

Images