AI sound-control false feeding system integrating audio-visual olfactory sensory stimulation

Abstract

The invention provides an AI (artificial intelligence) sound-control false feeding system integrated with audio-visual olfactory sensory stimulation, and relates to the field of intelligent medical treatment. The system comprises an interaction device, an auditory sense processing module, a visual sense processing module, an olfactory sense processing module and a smell eruption module which are in communication connection. The interaction device receives the control feedback signal and processes the control feedback signal into a visual signal, an auditory signal and an olfactory signal, and the visual signal, the auditory signal and the olfactory signal are respectively transmitted to the visual processing module, the auditory processing module and the olfactory processing module to be processed and then output; the system further comprises an operation handle and a voice recognition module, and the feedback signals are controlled to be sent out by the external operation handle or sent out through voice. According to the system, the authenticity and comfort of user experience are enhanced by fusing vision, hearing and smell systems.

Description

Technical Field

[0001] The present invention relates to the field of intelligent medical care, and more specifically, to an AI voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation. Background Art

[0002] Sham feeding refers to the phenomenon that after food enters the mouth, even if it does not reach the stomach, the color, aroma and other sensory organs of the food stimulate the vagus nerve in the brain and then stimulate the stomach and intestines to secrete gastric juice. Classic physiological experiments have shown that visual and auditory conditioned reflexes can actively mobilize the body's secretion of digestive juice. Studies have found that food-related images, smells, sounds, etc. stimulate brain neurons through multiple senses such as visual, auditory, and olfactory receptors, which can give the body a good eating experience, and directly or indirectly promote the release of gastric acid and gastrointestinal hormones through vagus nerve excitement, thereby regulating intestinal function, immune cell activity, and maintaining intestinal microecological balance. The current clinical sham feeding method is mainly chewing gum, but the taste of chewing gum is relatively single, and the chewing action may cause accidental swallowing and mandibular joint disorder. People with dentures cannot use it, and swallowing air during chewing may aggravate abdominal distension.

[0003] Virtual reality (VR) technology uses computer hardware and software and virtual reality equipment to form a three-dimensional virtual world, providing an immersive experience, which helps patients enjoy the multi-sensory stimulation of a variety of foods in a virtual dining environment. At present, there have been studies in the relevant medical fields at home and abroad on the use of multi-sensory VR to train patients with olfactory disorders and treat patients with post-traumatic stress disorder, but there are no reports on VR sham feeding devices that integrate visual, auditory and olfactory multi-sensory perception. In addition, the existing equipment does not take into account the personalized needs of users and changes in usage scenarios, which limits the high immersion and authenticity of the virtual reality experience, affects patients' compliance with sham feeding treatment, and thus affects the quality and effectiveness of patients' postoperative digestive function rehabilitation. Summary of the invention

[0004] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention aims to provide a highly immersive and personalized virtual experience, which integrates the visual, auditory and olfactory systems to achieve an adaptive feedback mechanism synchronized with the user's physiological response and situational adaptability, thereby enhancing the authenticity and comfort of the user's experience.

[0005] The present application discloses an AI voice-controlled fake feeding system integrating visual, auditory and olfactory sensory stimulation, the system comprising an interactive device, an auditory processing module, a visual processing module, an olfactory processing module and an odor spraying module in communication connection; the interactive device receives a control feedback signal and processes the control feedback signal into a visual signal, an auditory signal and an olfactory signal, the visual signal is transmitted to the visual processing module for processing and then output, the auditory signal is transmitted to the auditory processing module for processing and then output, the olfactory signal is transmitted to the olfactory processing module for processing and then output to the odor spraying module; the system also comprises an operating handle and a voice recognition module, the control feedback signal is issued by an external operating handle or by voice.

[0006] In some embodiments, the system also includes: a physiological signal monitoring module and a physiological monitoring processing module, which are communicatively connected to the above modules. The physiological signal monitoring module monitors the physiological signals of the subject. The physiological monitoring processing module monitors the physiological signals through physiological sensors, monitors the physiological state according to the monitored physiological signals and feeds back the physiological state to the physiological monitoring processing module. The physiological monitoring processing module sends a monitoring feedback signal to the interactive device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module. The interactive device receives the monitoring feedback signal and processes the monitoring feedback signal into a visual signal, an auditory signal and an olfactory signal. The visual signal or the monitoring feedback signal is transmitted to the visual processing module for processing and output, the auditory signal or the monitoring feedback signal is transmitted to the auditory processing module for processing and output, and the olfactory signal or the monitoring feedback signal is transmitted to the olfactory processing module for processing and output to the odor emission module.

[0007] In some embodiments, the physiological monitoring processing module optimizes the user model by: receiving and generating a monitoring feedback signal based on the fluctuation of the physiological signal to determine whether the sensory parameter output needs to be adjusted and clearly specify the sensory parameter to be adjusted; if adjustment is required, the monitoring feedback signal that needs to be adjusted is transmitted to the head display device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module to adjust the output of the visual and / or auditory and / or olfactory sensory parameters; if no adjustment is required, the current output is maintained.

[0008] In some embodiments, the method for optimizing the user model also includes: after adjusting the sensory parameter output, collecting the user's experience feedback information after the adjustment, analyzing the experience feedback information and outputting the user's preference and demand information; using the user's preference and demand information to update the user model and optimize the interaction strategy, and directly calling the information the next time the user uses it again.

[0009] In some embodiments, the odors released by the odor spraying module are different for different fake fed objects; if there is only one fake fed object, the odor spraying device receives an odor simulation command for one fake fed object, and releases a single odor corresponding to the fake fed object through the movement of the structure inside the odor spraying device; if the fake fed objects include at least two types, the odor spraying device receives odor simulation commands for at least two fake fed objects, and releases a mixed odor corresponding to the fake fed objects through the movement of the structure inside the odor spraying device.

[0010] In some embodiments, the display window in the interactive device displays different fake feeding objects in the virtual scene, and when the distance between the fake feeding object in the virtual scene and the subject's mouth exceeds a threshold, the olfactory signal is transmitted to the olfactory processing module for processing and then output to the odor emission module, and the odor emission module releases the odor; Optionally, the distance between the fake feeding object and the virtual subject's mouth in the virtual scene is the physical distance between the external handle and the subject's mouth.

[0011] In some embodiments, the system further includes: a data management module and a wireless network module in communication connection; the wireless network module is responsible for communication and data transmission, and the data management module manages data transmitted through the wireless network module.

[0012] Optionally, the system further comprises a knowledge base in communication with the above modules; and nutritional pairing recommendations are given based on the medical history background knowledge of the subject in the knowledge base.

[0013] In some embodiments, the system further includes a display device, a hearing device, and an odor spraying device that are communicatively connected; the visual processing module processes the visual data and outputs it to the display device, and the auditory processing module processes the auditory data and outputs it to headphones.

[0014] In some embodiments, the system also includes an operating handle and a voice recognition module, and the control feedback signal is issued by an external operating handle or through voice; the interactive device is provided with a control and feedback interface, and is connected to the operating handle through the control and feedback interface; the operating handle includes a real handle and a virtual handle simulated by gesture recognition.

[0015] In some embodiments, the interactive device, auditory processing module, visual processing module, olfactory processing module, odor spray module, data management module, wireless network module, display device, hearing device, and odor spray device module are connected and communicated with each other; the communication methods for connecting and communicating between each module include any one or more of the following: Bluetooth, wifi, and data cable.

[0016] Traditionally, VR devices have focused mainly on visual and auditory experiences, but rarely involve olfactory simulation, which limits the realism and immersion of the experience.

[0017] Traditional methods of solving problems and their flaws: 1. Limited to vision and hearing: Traditional VR devices mainly provide visual and auditory immersion through high-quality displays and stereo headphones. Although this method can provide rich visual and auditory details, it lacks olfactory elements, making the overall experience less comprehensive and difficult to achieve true full sensory immersion.

[0018] 2. Static sensory output: Many VR devices are designed without considering the user's individual needs and environmental changes. This means that no matter what environment the user is in, the device output is consistent, without considering individual differences or environmental factors such as light and noise, which may lead to a decrease in the quality of experience, especially in noisy or poorly lit environments.

[0019] 3. Lack of adaptive ability: Lack of mechanisms to automatically adjust output based on user feedback and physiological state. The output of most devices is fixed and does not adjust in real time based on the user's comfort or engagement, which may cause discomfort or an unsmooth experience for the user.

[0020] 4. Insufficient modularity: Early VR devices were usually integrated and did not allow users to replace or upgrade individual components, which meant that once a part had a problem or technology advanced, the entire device might need to be replaced, increasing costs and inconvenience.

[0021] 5. Cross-sensory conflict: When trying to integrate different sensory experiences, if there are inconsistencies in time or space between the inputs of different senses, it will lead to a break in the user experience and even cause confusion or discomfort.

[0022] Defect summary: Lack of immersion: The immersion is limited due to the lack of olfactory simulation and personalized adaptation.

[0023] Poor user experience: Fixed and non-adaptive output may cause user discomfort, especially under different environmental conditions.

[0024] Cost and maintenance issues: The modular design that cannot be replaced or upgraded increases long-term use costs and maintenance difficulties.

[0025] Technical limitations: Inconsistencies across senses can lead to a disjointed and unnatural experience.

[0026] In response to these problems, the patent proposed by this application attempts to overcome the above defects by integrating audio-visual and olfactory systems, adaptive learning, interactive feedback, modular design and situational adaptability, so as to provide a more personalized, adaptable and immersive VR experience. Compared with the prior art, the system of the present invention can provide a more personalized and adaptable virtual reality experience, reduce sensory conflicts, and improve the comfort and satisfaction of users.

[0027] In order to solve the above problems, the present invention provides the following technical solutions: 1. Multi-sensory fusion algorithm: Develop an algorithm that achieves real-time fusion of visual, auditory, and olfactory data to provide a seamless multi-sensory experience.

[0028] 2. Adaptive learning system: Integrates machine learning technology to enable the system to learn the user's preferences and reactions and automatically adjust sensory output.

[0029] 3. Interactive feedback mechanism: adjust the sensory experience according to the user's physiological reactions (such as heart rate, electromyography) to enhance the sense of immersion.

[0030] 4. Modular design: The modular design concept allows users to replace or upgrade individual sensory modules as needed.

[0031] 5. Cross-sensory consistency: Ensure that all sensory inputs are consistent in time and space to avoid sensory conflicts.

[0032] 6. Situational adaptability: The device can automatically adjust sensory output according to the usage scenario set by the user (such as day, night, quiet environment, noisy environment).

[0033] This adaptive multi-sensory VR fake feeding system integrating vision, hearing and smell can solve the above problems through real-time fusion of multiple senses, adaptive feedback synchronized with user preferences and physiological responses, and adaptability to usage scenarios. While bringing patients a wonderful eating experience, it also helps restore gastrointestinal function, ensures nutritional supply, and promotes body recovery. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0035] Figure 1 Schematic diagram of the overall structure of the fake feeding system provided by an embodiment of the present invention; Figure 2 is a flow chart of a multi-sensory fusion algorithm provided by an embodiment of the present invention; Figure 3 is a working principle diagram of the adaptive learning system provided by an embodiment of the present invention; Figure 4 is a working principle diagram of the interactive feedback mechanism provided by an embodiment of the present invention; Figure 5 It is a schematic diagram of components of a modular design provided by an embodiment of the present invention; Figure 6 is a flow chart of situational adaptive adjustment provided by an embodiment of the present invention; Figure 7 It is a schematic diagram of an operation interface in which the system displays three virtual scenes during use provided by an embodiment of the present invention; Figure 8 It is an exploded schematic diagram of the overall structure of the odor spraying device provided by an embodiment of the present invention; Fig. 9 is an enlarged schematic diagram of an inner sealing plate assembly of a scent box provided by an embodiment of the present invention; In the figure, 1, odor box assembly; 11, cotton swab; 12, spring; 13, first protective shell; 14, sealing ring; 2, outer shell; 3, main board; 4, battery; 5, odor box inner sealing plate assembly; 51, second protective shell; 52, oscillation wave plate; 53, bottom plate; 6, odor box top cover; 7, rubber plug; 8, Velcro; (1), cross recessed countersunk flat tail self-tapping screw; (2), cross recessed pan head flat tail self-tapping screw. DETAILED DESCRIPTION

[0036] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0037] In some of the processes described in the specification and claims of the present invention and the above-mentioned figures, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0039] The present application discloses an AI voice-controlled fake feeding system integrating visual, auditory and olfactory sensory stimulation, the system comprising an interactive device, an auditory processing module, a visual processing module, an olfactory processing module and an odor eruption module in communication connection; the interactive device receives a control feedback signal and processes the control feedback signal into a visual signal, an auditory signal and an olfactory signal, the visual signal is transmitted to the visual processing module for processing and then output, the auditory signal is transmitted to the auditory processing module for processing and then output, the olfactory signal is transmitted to the olfactory processing module for processing and then output to the odor eruption module; the display window in the interactive device displays different fake feeding objects in a virtual scene, when the distance between the fake feeding object in the virtual scene and the subject's mouth exceeds a threshold, the olfactory signal is transmitted to the olfactory processing module for processing and then output to the odor eruption module, and the odor eruption module releases the odor. Alternatively, the auditory processing module or the olfactory processing module receives the control feedback signal, processes it, and then outputs the control feedback signal; optionally, the system further comprises a control processing module, which receives the control signal, processes it into a control feedback signal, and transmits it to the interactive device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module; the system further comprises an odor control unit that is communicatively connected to the above modules, and the odor control unit manages the odor spraying module and releases the corresponding odor according to the signal; In some embodiments, the system further includes: a physiological signal monitoring module and a physiological monitoring processing module which are communicatively connected to the above modules, wherein the physiological signal monitoring module monitors the physiological signals of the subject, the physiological monitoring processing module monitors the physiological signals through physiological sensors, monitors the physiological state according to the monitored physiological signals and feeds back the physiological state to the physiological monitoring processing module, the physiological monitoring processing module sends a monitoring feedback signal to the interactive device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module, the interactive device receives the monitoring feedback signal and processes the monitoring feedback signal into a visual signal, an auditory signal and an olfactory signal, the visual signal or the monitoring feedback signal is transmitted to the visual processing module for processing and output, the auditory signal or the monitoring feedback signal is transmitted to the auditory processing module for processing and output, and the olfactory signal or the monitoring feedback signal is transmitted to the olfactory processing module for processing and output to the odor emission module. Optionally, the physiological signals include: heart rate, electromyography.

[0040] In some embodiments, the physiological monitoring processing module optimizes the user model by: receiving and generating a monitoring feedback signal based on the fluctuation of the physiological signal to determine whether the sensory parameter output needs to be adjusted and clearly specify the sensory parameter to be adjusted; if adjustment is required, the monitoring feedback signal that needs to be adjusted is transmitted to the head display device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module to adjust the output of the visual and / or auditory and / or olfactory sensory parameters; if no adjustment is required, the current output is maintained.

[0041] In some embodiments, the method for optimizing the user model also includes: after adjusting the sensory parameter output, collecting the user's experience feedback information after the adjustment, analyzing the experience feedback information and outputting the user's preference and demand information; using the user's preference and demand information to update the user model and optimize the interaction strategy, and directly calling the information the next time the user uses it again.

[0042] In some embodiments, the odors released by the odor spraying module are different for different fake fed objects; if there is only one fake fed object, the odor spraying device receives an odor simulation command for one fake fed object, and releases a single odor corresponding to the fake fed object through the movement of the structure inside the odor spraying device; if the fake fed objects include at least two types, the odor spraying device receives odor simulation commands for at least two fake fed objects, and releases a mixed odor corresponding to the fake fed objects through the movement of the structure inside the odor spraying device.

[0043] In some embodiments, the distance between the fake feeding object and the virtual subject's mouth in the virtual scene is the physical distance between the external handle and the subject's mouth.

[0044] In some embodiments, the system further includes: a data management module and a wireless network module in communication connection; the wireless network module is responsible for communication and data transmission, and the data management module manages data transmitted through the wireless network module.

[0045] Optionally, the system further comprises a knowledge base in communication with the above modules; and nutritional pairing recommendations are given based on the medical history background knowledge of the subject in the knowledge base.

[0046] In some embodiments, the system further includes a display device, a hearing device, and an odor spraying device that are communicatively connected; the visual processing module processes the visual data and outputs it to the display device, and the auditory processing module processes the auditory data and outputs it to headphones.

[0047] In some embodiments, the system also includes an operating handle and a voice recognition module, and the control feedback signal is issued by an external operating handle or through voice; the interactive device is provided with a control and feedback interface, and is connected to the operating handle through the control and feedback interface; the operating handle includes a real handle and a virtual handle simulated by gesture recognition.

[0048] In some embodiments, the interactive device, auditory processing module, visual processing module, olfactory processing module, odor spray module, data management module, wireless network module, display device, hearing device, and odor spray device module are connected and communicated with each other; the communication methods for connecting and communicating between each module include any one or more of the following: Bluetooth, wifi, and data cable. By setting multiple communication methods, the applicability of the device can be improved.

[0049] like Figure 1 As shown, it is a schematic diagram of the overall structure of the fake feeding system provided in an embodiment of the present invention; wherein the XR head display is the main visual and auditory output device. The operating handle (including a virtual handle simulated by gesture recognition) provides user input and control. The odor spray module is responsible for releasing simulated odors. The wireless network module is responsible for data transmission and communication. The vital signal monitoring module monitors the user's physiological signals, such as heart rate and electromyography. The user health monitoring system in some embodiments can also be combined with the data of wearable health monitoring devices, so that the device can more accurately monitor the user's physiological state during the virtual experience and make timely adjustments to avoid excessive stimulation or discomfort.

[0050] like Figure 2 As shown, a flowchart of a multi-sensory fusion algorithm provided by an embodiment of the present invention; wherein, from the "start" node, the system first receives input signals from the XR head display, the operating handle (including the virtual handle simulated by gesture recognition) and the odor spray module. Each signal is sent to the corresponding processing module (vision, hearing, smell, control) respectively. The control signal is processed separately to generate control feedback, which will be sent back to each processing module for adjustment. Visual, auditory and olfactory data are fused to synchronize multi-sensory data. An adaptive learning algorithm is applied to adjust the sensory output according to the user's historical data and preferences. The adjusted sensory output is sent to the corresponding module (display device, headphones, odor spray module). The system ends the entire process through feedback from the odor spray module. In some embodiments, a deep learning neural network can also be used to replace the traditional multi-sensory fusion algorithm to more efficiently process and fuse visual, auditory and olfactory data to achieve a more natural sensory fusion effect.

[0051] like Figure 3As shown, the working principle diagram of the adaptive learning system provided by an embodiment of the present invention; wherein, the system starts from the "start" node and first "collects user data", including user preferences, user feedback and physiological monitoring data. User preferences and feedback are analyzed separately to identify patterns and trends. Physiological monitoring data is used to evaluate the user's physiological responses. These analysis results are used to "update the user model", which helps to better understand the user's needs and preferences. According to the updated user model, the system "adjusts sensory parameters" to optimize the experience. The adjustment is applied to the device, and then the system "collects device responses" to evaluate performance. Based on the evaluation of device performance, the system may "optimize the learning algorithm" to improve future adjustments. Finally, the system determines whether further optimization is needed, and if so, returns to the optimization step, otherwise the loop ends. In some embodiments, it is also possible to consider using a reinforcement learning framework instead of a traditional machine learning algorithm to enhance the ability of the device to self-optimize based on user behavior and feedback, thereby providing a more personalized experience.

[0052] like Figure 4 As shown, the working principle diagram of the interactive feedback mechanism provided by the embodiment of the present invention; the working principle mainly includes: Start: the system starts and waits for user operation. User operation device: the user interacts with the system by operating the handle or other input device. Collect operation data: the system collects the user's operation data, such as the position of the handle, the moving speed, etc. Monitor physiological signals: the system monitors the user's physiological signals, such as heart rate, electromyography, etc. through the physiological monitoring module. Analyze physiological reactions: the system analyzes the user's physiological reactions to determine whether the user feels uncomfortable or needs to adjust the experience. Whether adjustment is required: the system determines whether the sensory output needs to be adjusted based on the analysis results. Yes: if adjustment is required, the system proceeds to the next step. No: if adjustment is not required, the system maintains the current output. Adjust sensory output: the system adjusts the visual, auditory or olfactory output based on the analysis results to optimize the user experience. Feedback to the user: the adjusted output is fed back to the user, and the user feels the change. Collect user feedback: the system collects the user's feedback on the adjusted experience. Analyze user preferences: the system analyzes the user's feedback to understand the user's preferences and needs. Update user model: the system updates the user model based on user feedback to better understand the user. Optimize interaction strategy: The system optimizes the interaction strategy based on the updated user model to improve the user experience. End and loop: The system completes an interactive feedback loop and is ready to enter the next loop. In some embodiments, a biofeedback training system can also be introduced to combine the user's brain wave data to enable the device to respond more directly to the user's attention and emotional state, further enhancing immersion and comfort.

[0053] like Figure 5As shown, a schematic diagram of components of a modular design provided by an embodiment of the present invention; wherein the XR head display is a device that the user directly interacts with, integrating a display and auditory module, a control and feedback interface, an olfactory module, wireless data transmission, and physiological signal monitoring. Visual processing unit: responsible for processing visual data and outputting it to a display device. Operating handle: sends control signals through the control processing unit to affect the visual, olfactory, and data management units. Odor spraying module: managed by the odor control unit, and releases corresponding odors according to the control signals. Wireless network module: responsible for the network communication of the device, managed by the data management unit. Vitality signal monitoring module: monitors the user's physiological state and feeds back information to the physiological monitoring processing unit, thereby affecting the visual, olfactory, and odor control units. In some embodiments, an open platform can also be developed to allow third-party developers and users to design and add new sensory modules on their own, which can accelerate the emergence of technological innovation and diversified experiences.

[0054] like Figure 6 As shown, a flow chart of situational adaptive adjustment provided by an embodiment of the present invention; wherein, start: the system starts and prepares for situational adaptive adjustment. Detecting the use environment: the system first detects the type of the initial simulated environment in which the user is located. Environment type: the system determines the type of environment based on the light and noise level of the environment. Daytime: if the environment is daytime, the system will adjust the brightness of the display device. Nighttime: if the environment is nighttime, the system will adjust the contrast of the display device. Quiet environment: if the environment is quiet, the system will maintain normal auditory output. Noisy environment: if the environment is noisy, the system will enhance the auditory noise reduction function. Synchronizing other sensory outputs: after adjusting the visual or auditory output, the system will synchronize other sensory outputs to maintain consistency. Collecting user feedback: the system collects user feedback on the current settings. Is the user satisfied?: the system asks the user whether he is satisfied with the current sensory output. Yes: if the user is satisfied, the system will maintain the current settings. No: if the user is not satisfied, the system will analyze the feedback and adjust the strategy. Analyzing feedback and adjusting the strategy: the system analyzes and formulates the adjustment strategy based on the user's feedback. Adjusting sensory parameters: the system adjusts the sensory parameters according to the strategy to optimize the user experience. End the simulation and monitor changes in environmental simulation requirements: The system ends the current adjustment and continues to monitor changes in the user's environmental requirements to make necessary adjustments. In some embodiments, environmental perception sensors and AI can also be used to allow the device to more intelligently identify the user's actual environment and dynamically adjust the virtual experience based on changes in the environment, rather than just based on the preset environment type.

[0055] In some embodiments, Figure 8 and Fig. 9As shown, the odor spraying device includes: a shell 2, a odor box assembly 1, an odor box inner sealing plate assembly 5, and a odor box top cover 6 (ABS); a placement space is reserved inside the shell 2, and the odor box inner sealing plate assembly 5 is placed in the placement space; the first side of the shell 2 is movably connected to the odor box top cover 6, and an opening is reserved on the second side of the shell 2 for the odor box assembly 1 to extend into, and the odor box assembly 1 is movably installed in the odor box inner sealing plate assembly 5 along the opening; the odor box assembly 1 includes: at least one cotton swab 11 soaked in liquids with different odors, a buffer member arranged at the first end of the cotton swab 11 and a first protective shell 13, and a sachet 13 is arranged inside the first protective shell 13 At least one first receiving groove for receiving a single cotton swab 11 and at least one second receiving groove for receiving a single buffer; the other end of the buffer is connected to the first protective shell 13; the cotton swab 11 extends out of the opening of the first receiving groove, and a sealing ring 14 is arranged at the position corresponding to the single cotton swab 11 at the opening end of the first receiving groove; the extended cotton swab 11 is connected to the sealing plate assembly 5 in the odor box; the sealing plate assembly 5 in the odor box includes an oscillation wave plate 52, and the vibration of the ultrasonic oscillation wave plate 52 atomizes the liquid in the cotton swab 11 into mist and releases it; the odor box is equipped with a cotton swab 11 filling hole and an oscillation wave plate, etc., to ensure that the odor can be released evenly and effectively; In some embodiments, Fig. 9 The figure shows an enlarged schematic diagram of the odor box inner sealing plate assembly 5, which includes: the odor box inner sealing plate assembly 5 also includes: a second protective shell 51 and a bottom plate 53 connected, the upper end of the second protective shell 51 is provided with an opening for the first protective shell 13 to extend into, and the opening of the second protective shell 51 is consistent in size with the opening of the outer shell 2; Optionally, the oscillating wave plate 52 is disposed on a bottom plate 53, and the bottom plate 53 is provided with a spray hole for releasing mist; Optionally, the number of the cotton swab 11, the sealing ring 14, and the oscillation wave plate 52 corresponds one to one; Optionally, the buffer member is configured as a spring 12 , the upper end of the spring 12 is connected to the interior of the first protective shell 13 , and the lower end of the spring 12 is connected to the upper end of the cotton swab 11 .

[0056] In some embodiments, fixed structures are respectively arranged at corresponding positions on both sides of the odor box assembly 1 and on both sides of the odor box inner sealing plate assembly 5; the fixed structures include: snap structures, sliding structures, hook structures; the fixed structures are not limited here, and can be snap structures, sliding structures, hook structures, etc. that can achieve the fixing effect.

[0057] In some embodiments, the odor box inner sealing plate assembly 5 is connected to the outer shell 2 via a fixing member; in a more specific embodiment, the fixing member comprises a screw, and the fixing member at the connection between the odor box inner sealing plate assembly 5 and the outer shell 2 is two cross-slot countersunk flat-tail self-tapping screws (1) made of stainless steel; In some embodiments, a fixing member is provided at the connection between the first side of the housing 2 and the top cover 6 of the odor box; in a more specific embodiment, the fixing member comprises a screw, and the fixing member at the connection between the first side of the housing 2 and the top cover 6 of the odor box is 7 cross-slot pan head flat tail self-tapping screws (2) made of stainless steel.

[0058] In some embodiments, a connector for connecting an interactive device is provided on the outside of the scent box top cover 6; the connector is configured as a 3M Velcro 8. In this embodiment, the interactive device is an XR head display device, and the function of the 3M Velcro 8 is to connect the XR head display device.

[0059] In some embodiments, decorative silicone rubber plugs 7 are respectively provided at the corners of the top cover 6 of the odor box.

[0060] In some embodiments, the placement space is provided with: a mainboard 3 (VRE100 mainboard), a battery 4; the components provided on the mainboard 3 include: a control chip, a CPU, a memory, a hard disk, and an odor detection sensor.

[0061] In some embodiments, the interactive device is an XR head-mounted display device. Specific embodiment:

[0063] The sham feeding operation steps of the device include: VR sham feeding is used to assist enteral nutrition for patients with enteral nutrition intolerance after VR pre-use nursing assessment and informed consent is signed, three times a day, 20 minutes each time, at 7:30-7:50; 12:00-12:20; 18:00-18:20. The specific operation process is as follows: 1.1 Patient Assessment: Check the patient's name, bed number, and hospital number; Assess the patient's physiological indicators, level of consciousness, whether the surgical incision is bleeding, etc., to ensure that the patient is in a stable and comfortable state and is qualified to use VR equipment; Assess the patient's cognitive ability and education level to determine whether they are able to operate and use VR equipment; Ensure that the patient or their legal guardian has signed a consent form for the use of VR equipment; Before use, introduce yourself to the patient and explain the purpose and precautions of the equipment.

[0064] 1.2 Preparation before use: a. Odor box: Add the corresponding odor liquid according to the name of the odor box, check whether the power of the sprayer is sufficient, and press the switch to start the spray. Only one sprayer can be turned on at a time, and the indicator light will be green after it is turned on. b. Network and connection: Connect the computer to the Wifi6 router (with or without network), find the Wifi connection in the VR helmet, and connect to the Wifi6 router at the same time. c. Open the Steam software on the computer, wait for the link to fail, and then select offline mode to start. d. Wirelessly connect to the computer. e. Run the enterprise connection in the wireless VR helmet application in offline state and wait for the device to search. After searching for the device, the gray two icon link status indicates that the link is successful. f. After the link is successful, click the VRE-100 icon on the desktop to enter the fake feeding software interface. g. Check whether the power of each device is sufficient and whether it can be used normally. Set the autonomous operating system to off, and then push the device to the patient's bedside.

[0065] 1.3 Steps for using the device: a. Assist the patient to wear the VR helmet and olfactory device, grab the handle, and instruct the patient to use the handle correctly; b. Use the VR device to enter the virtual food court scene, use the handle to control the patient to walk in the food court, and select a Chinese restaurant / fruit shop or dessert shop; Figure 7 The following is a schematic diagram of the operation interface of the system showing three virtual scenes during use; c. Enter the virtual restaurant scene and use the handle to click on the seat to let the patient sit down; d. The following are the operation procedures of the three scenes: (1) Chinese restaurants: Ordering: The Chinese restaurant menu is divided into two types: VR menu and external menu (after turning off the autonomous operation button, the VR menu will not pop up when entering the scene). The menu includes two categories: signature Chinese food and special cuisine. You can click to switch. Click the "+" sign to add a dish and the "-" sign to reduce a dish. You can order up to three servings of each dish and up to seven servings of all dishes. After clicking the Submit button, the corresponding food will be displayed on the table. The menu will pop up after approaching the waiter or clicking the bell on the table.

[0066] Eating: After ordering, walk to the table, pull the trigger to pick up the chopsticks, or pick up the food for the first time, and the chopsticks will automatically appear in your hand. Then use the chopsticks to touch the food, the food will show a yellow prompt, pull the trigger to pick up the food, and release the trigger to put the food down. Bring the food close to the helmet, the spray device starts to simulate eating and release the corresponding Chinese food smell.

[0067] (2) Fruit shop: In the fruit shop, patients do not need to check the menu. The external assistance system will help patients move to the tasting position. There are three rows of fruit racks in the tasting area. Patients only need to pull the trigger to grab the fruit and bring it close to the helmet to start simulating eating and release the corresponding fruit smell.

[0068] (3) Bakery: Ordering: There are two forms of pastry shop menus, VR menu and external menu (VR menu will not pop up after turning off the autonomous operation button and entering the scene). The menu includes two categories: desserts and drinks, which can be switched by clicking. Click the "+" sign to add a dish, and the "-" sign to reduce a dish. After clicking the Submit button, the corresponding food will be displayed on the table. Approach the waiter or click the bell on the table to make the menu pop up.

[0069] Eating: divided into drinks and desserts. When grabbing food, some food can be taken directly, and for the other part, a spoon will be added to the hand when it is first taken. It will automatically switch when grabbing different foods. When the food is close to the helmet, the spray device will start to simulate eating and release the corresponding drink or dessert smell.

[0070] The main operating components of the device: Trigger key (located at the index finger position), when the virtual hand touches an object, the object will light up, and pressing the trigger key can confirm picking up or dragging the object; additional auxiliary functions include: (requires external operators to be familiar with) Press the external auxiliary button to pop up the external auxiliary interface, and click again to hide the interface; in the external auxiliary interface, the VR operation guide interface can be turned on or off; the operation guide interface provides basic voice tutorial pictures of the VR handle; the perspective switching includes two modes: default and parallel to the ground. Click to switch the VR perspective. By default, the user can sit or stand. The parallel to the ground mode makes the direction of the virtual helmet parallel to the ground, which is suitable for use when lying down or lying on your back; the fast transmission function can be used by external personnel to teleport the virtual player to the front of the food by clicking different transmission points when the patient is not familiar with VR movement operations. The initial point is not around the food.

[0071] The device adopts a human-computer interaction mode. The operator can communicate and interact with the virtual waiter through the head-mounted device. The patient uses the handle to click on the menu and select his favorite dishes in the scene.

[0072] Users need to continue the experience until the meal is over.

[0073] Equipment maintenance: record intervention time and ask patients if they feel any discomfort; Arrange VR equipment: take out the scent box, disinfect the VR mask part with alcohol spray, and charge the scent box and VR.

[0074] After using the device, please turn off the power and charge it, disinfect it with alcohol wipes, and replace the consumed virtual scent cartridges.

[0075] 1.4 Post-operation evaluation: Evaluation time: after using VR virtual feeding assistance; 1.4.1 Post-operation equipment-related nursing assessment: assess the patient's vital signs, state of consciousness, whether the surgical wound is bleeding, etc., to ensure that the patient is safe and comfortable and able to wear and use VR; ask the patient how they feel after using VR virtual feeding and whether they experience adverse reactions such as dizziness, vomiting, and nausea.

[0076] 1.4.2 Post-operative disease-related nursing assessment: Assess the patient's enteral nutrition intolerance, including the degree and frequency of abdominal distension, nausea, vomiting and diarrhea; re-evaluate the patient's vital signs and consciousness state to see if they are normal, and whether there is any bleeding or exudate from the surgical wound; check that the patient's postoperative gastrointestinal decompression is within the normal range and the gastric tube is in the stomach, and confirm that the patient is in a safe and comfortable state.

[0077] 2.1 Key technologies of voice interaction module of artificial feeding intelligent nursing device integrating AI+VR: The user activates the AI ​​assistant through voice, and the VR program converts the voice into text and sends it to the general conversation AI. The general conversation AI determines the user's intention, obtains relevant information from the knowledge base, and generates an answer. The VR program converts the answer into an audio stream and performs a dialogue response action through a virtual character. The key technologies of this part are as follows: 2.1.1 Speech recognition and conversion: It is necessary to accurately recognize the user's voice commands and be able to handle different accents and speaking speeds.

[0078] 2.1.2 Knowledge base integration: AI assistants need to be able to access the knowledge base to obtain background knowledge of medical records and nutritional matching recommendations.

[0079] 2.1.3 User Intent Determination: General conversational AI needs to be able to accurately determine the user’s intent and provide corresponding feedback.

[0080] 2.1.4 Dish operation guidance: The AI ​​assistant needs to be able to guide users to perform operations such as rotating and picking up dishes.

[0081] 2.1.5 Conversation interface design: It is necessary to design a conversation interface that is easy to understand and operate, and display the interaction history and current conversation content.

[0082] 2.1.6 Audio stream playback: The VR program needs to be able to convert text responses into audio streams and drive the virtual character to perform corresponding dialogue response actions.

[0083] 2.2 Key technologies of precise odor emission algorithm for artificial feeding intelligent nursing device integrating AI+VR Through the olfactory scent box, gateway and simulated food odor perfume combined with AI spraying algorithm, the precise odor spraying of the artificial feeding intelligent nursing device integrating AI+VR is realized. The key technologies of the olfactory scent box include: 2.2.1 Sniffing intention recognition: when the user picks up food through the handle and brings it to his mouth, the olfactory odor box sprays the corresponding odor.

[0084] 2.2.2 Signal analysis and conversion: When the handle is 32 cm close to the head-mounted display device, the olfactory smell box converts the electrical signal that controls the smell spray into an oscillation signal and transmits it to the ultrasonic chip in the smell box; 2.2.3 Ultrasonic chip high-frequency atomization: The ultrasonic chip atomizes the odor into tiny odor particles of 1 to 5 μm through 2.4 MHz high-frequency oscillation; 2.2.4 Virtual reality scene linkage: Combining the virtual and the real, allowing users to taste food in the virtual reality world and smell the corresponding real food odors. During use, VR can help patients easily switch between various scenes, seamlessly experience different foods, and complete the nutritional supply process under nearly real audio-visual and olfactory stimulation.

[0085] 2.3 Key technologies for operating artificial feeding intelligent nursing devices integrating AI+VR: Based on the user intention determination of the general conversational AI function, more tasks are expanded to greatly improve the applicability of intelligent artificial feeding nursing products. The response intention includes dining intention, food picking action, health consultation, environmental interaction and emotional communication. Based on this, personalized services suitable for different patients can be constructed. The key technologies of this part are as follows: 2.3.1 Dining intention: The AI ​​assistant will recommend menus that match the user’s health status and nutritional recommendations.

[0086] 2.3.2 Intention to pick up food: The AI ​​assistant will guide actions in the virtual environment, such as rotating dishes or simulating the action of picking up food. For patients with limited mobility, voice instructions can be used to assist patients in eating.

[0087] 2.3.3 Health consultation: AI assistants will provide relevant health information and advice.

[0088] 2.3.4 Environmental interaction: If you adjust the lighting or music in the virtual environment, the AI ​​assistant will make corresponding environmental setting adjustments.

[0089] When users seek emotional communication, AI assistants provide emotional support and responses.

[0090] Based on the above key technologies, clinical applications are carried out in order to achieve the interaction between virtual smell and vision, so that patients can see the food in the virtual scene and smell the odor at the same time, and realize intelligent human-computer interaction with the equipment, stimulate the body's gastrointestinal digestive juice secretion, and promote the early recovery of gastrointestinal function, providing a basis for the operation technology of the integrated AI+VR fake feeding intelligent nursing device.

[0091] The user opens the application VR program, the VR program environment is initialized, the VR program obtains and returns the knowledge base medical record background knowledge, the VR program assembles virtual role-playing, obtains and returns nutritional matching suggestions, and the VR program assembles the role of medical staff; when the user inputs voice, the voice server receives the voice and converts it into text, and then returns the text content to the VR program. At this time, the VR program updates the conversation message with a historical record. The VR program sends the conversation message to the general conversation AI module, and the general conversation AI module determines the user's intention and transmits the activated answer to the VR program; the VR program receives the expression of dining intention and / or the expression of food picking intention. When receiving the expression of dining intention, the VR program recommends matching menus according to the feedback of dining intention; when receiving the expression of food picking intention, the VR program rotates the appropriate dish according to the feedback of food picking intention and asks to use it. The expression of dining intention and the expression of food picking intention can be performed at the same time; the VR program can convert the text answer into an audio stream and drive the virtual character to perform the corresponding dialogue response action. The above dialogue cycle can be repeated.

[0092] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0093] In general, various example embodiments of the present disclosure may be implemented in hardware or dedicated circuits, software, firmware, logic, or any combination thereof. Certain aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device. When various aspects of the disclosed embodiments are illustrated or described as block diagrams, flow charts, or using some other graphical representation, it will be understood that the blocks, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof as non-limiting examples.

[0094] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0095] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0096] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0097] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0098] The exemplary embodiments of the present disclosure described in detail above are merely illustrative and not restrictive. It should be understood by those skilled in the art that various modifications and combinations may be made to these embodiments or their features without departing from the principles and spirit of the present disclosure, and such modifications should fall within the scope of the present disclosure.

Claims

1. An AI voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation, characterized in that: The system includes an interactive device, an auditory processing module, a visual processing module, an olfactory processing module, and an odor spraying module that are communicatively connected; the interactive device receives a control feedback signal and processes the control feedback signal into a visual signal, an auditory signal, and an olfactory signal, the visual signal is transmitted to the visual processing module for processing and then output, the auditory signal is transmitted to the auditory processing module for processing and then output, and the olfactory signal is transmitted to the olfactory processing module for processing and then output to the odor spraying module; the system also includes an operating handle and a voice recognition module, and the control feedback signal is issued by an external operating handle or by voice.

2. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: The system further comprises: a physiological signal monitoring module and a physiological monitoring processing module which are communicatively connected with the above modules, wherein the physiological signal monitoring module monitors the physiological signals of the subject, the physiological monitoring processing module monitors the physiological signals through physiological sensors, monitors the physiological state according to the monitored physiological signals and feeds back the physiological state to the physiological monitoring processing module, the physiological monitoring processing module sends a monitoring feedback signal to the interactive device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module, the interactive device receives the monitoring feedback signal and processes the monitoring feedback signal into a visual signal, an auditory signal and an olfactory signal, the visual signal or the monitoring feedback signal is transmitted to the visual processing module for processing and then output, the auditory signal or the monitoring feedback signal is transmitted to the auditory processing module for processing and then output, and the olfactory signal or the monitoring feedback signal is transmitted to the olfactory processing module for processing and then output to the odor spraying module; Optionally, the physiological signals include: heart rate and electromyography.

3. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 2, characterized in that: The physiological monitoring processing module optimizes the user model by the following method: receiving and generating a monitoring feedback signal based on the fluctuation of the physiological signal to determine whether the sensory parameter output needs to be adjusted and to specify the sensory parameter to be adjusted; if adjustment is required, transmitting the monitoring feedback signal that needs to be adjusted to the head display device and / or the visual processing module and / or the auditory processing module and / or the olfactory processing module to adjust the output of the visual and / or auditory and / or olfactory sensory parameters; if adjustment is not required, maintaining the current output.

4. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 3, characterized in that: The method for optimizing the user model also includes: after adjusting the sensory parameter output, collecting the user's experience feedback information on the adjusted experience, analyzing the experience feedback information and outputting the user's preference and demand information; using the user's preference and demand information to update the user model and optimize the interaction strategy, and directly calling the information the next time the user uses it again.

5. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: For different fake fed objects, the odors released by the odor spraying module are different; if there is only one fake fed object, the odor spraying device receives an odor simulation command of one fake fed object, and releases a single odor corresponding to the fake fed object through the movement of the structure inside the odor spraying device; if the fake fed objects include at least two kinds, the odor spraying device receives odor simulation commands of at least two fake fed objects, and releases a mixed odor corresponding to the fake fed objects through the movement of the structure inside the odor spraying device.

6. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: The display window in the interactive device displays different fake feeding objects in the virtual scene. When the distance between the fake feeding object in the virtual scene and the mouth of the subject exceeds a threshold, the olfactory signal is transmitted to the olfactory processing module for processing and then output to the odor emission module, and the odor emission module releases the odor; Optionally, the distance between the fake feeding object and the virtual subject's mouth in the virtual scene is the physical distance between the external handle and the subject's mouth.

7. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: The system also includes: a data management module and a wireless network module in communication connection; the wireless network module is responsible for communication and data transmission, and the data management module manages data transmitted through the wireless network module.

8. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: The system also includes a display device, a hearing device, and an odor spraying device that are communicatively connected; the visual processing module processes the visual data and outputs it to the display device, and the hearing processing module processes the hearing data and outputs it to the earphone.

9. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: The interactive device is provided with a control and feedback interface, and is connected to an operating handle via the control and feedback interface; the operating handle includes a real handle and a virtual handle for gesture recognition simulation.

10. The AI ​​voice-controlled fake feeding system integrating visual, audio and olfactory sensory stimulation according to claim 1, characterized in that: The interactive device, the auditory processing module, the visual processing module, the olfactory processing module, the odor spraying module, the data management module, the wireless network module, the display device, the hearing device, and the odor spraying device module are connected and communicated with each other; the communication methods for connecting and communicating between each module include any one or more of the following: Bluetooth, WiFi, and data cable.

Images