Intelligent sensing and interaction intelligent wig based on multi-modal large model

By integrating multimodal sensors and interaction modules in intelligent perception and interactive smart wigs, using multimodal large models to fusion data, the problems of limited functions and single interaction methods of existing equipment are solved, and the elderly and chronic disease patients are realized. Accurate health monitoring and personalized management provide hidden and convenient health management solutions.

CN119092116APending Publication Date: 2024-12-06刘小明
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411081905.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-08
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Existing wearable devices have limited functions in health monitoring, especially for the elderly and chronic patients, which require more comprehensive and accurate health data monitoring. At the same time, the comfort and concealment of the equipment are insufficient, and the interaction method is single, so it cannot meet the individuality. Refine health management needs.

Method used

Using intelligent perception and interactive smart wigs based on multimodal large models, integrating environmental sensors, vital sign monitoring modules, cameras and microphones, fusing data through multimodal neural network models, generating health management solutions, and supporting voice, gestures and touch Interaction, self-learning ability, and optimize health advice.

Benefits of technology

It provides a hidden, convenient and efficient health management solution. Through multimodal data fusion and deep learning, it realizes accurate analysis and personalized management of user health status, improving the accuracy and user experience of health monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119092116A_ABST
    Figure CN119092116A_ABST
Patent Text Reader

Abstract

The invention discloses an intelligent sensing and interaction smart wig based on a multi-modal large model, and belongs to the technical field of intelligent interaction, and the wig comprises a data collection module which is used for collecting environment sensing information, vital sign information of a wearer and audio and video information; the data processing module is used for fusing the environment perception information, the vital sign information of the wearer and the audio and video information to obtain a fused data set; the data analysis module is used for constructing a multi-modal neural network model, calculating the fused data set through the multi-modal neural network model, and generating an analysis result; the regulation and control module is used for generating a health management scheme based on the analysis result; and the interaction module is used for controlling the wig based on the operation of the user. The invention provides a hidden, convenient and efficient health management solution for the user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of intelligent interaction technology, and in particular relates to an intelligent perception and interactive smart wig based on a multimodal large model. Background Art

[0002] With the continuous development of society and the advancement of science and technology, people's demand for health management is increasing. Although traditional health monitoring equipment, such as electrocardiographs, blood pressure monitors and blood glucose meters, are relatively complete in function, they are usually fixed or portable devices and are not suitable for long-term wear or carrying. In recent years, wearable devices such as smart bracelets and smart watches have become increasingly popular. These devices can monitor users' basic health data such as heart rate and number of steps in real time. However, the monitoring range of these devices is relatively limited, and wearing them in certain occasions may not be convenient or concealed enough.

[0003] For certain groups of people, such as the elderly, patients with chronic diseases or those who need special care, they may need more comprehensive and accurate health data monitoring. In addition, these groups have higher requirements for the comfort and concealment of the equipment. Therefore, how to seamlessly, continuously and concealedly monitor the health status of these people in daily life has become an urgent problem to be solved.

[0004] Most existing wearable devices rely on a single or a small number of sensors and cannot fully perceive the user's surrounding environment and vital signs data. This single-modality monitoring method limits the device's ability to conduct comprehensive analysis and early warning of the user's health status. At the same time, the interaction methods of existing devices are relatively single, and the user experience is limited, which cannot fully meet the user's needs for intelligent interaction and personalized health management. Summary of the invention

[0005] In order to solve the above technical problems, the present invention proposes an intelligent perception and interactive smart wig based on a multimodal large model to solve the problems existing in the above-mentioned prior art.

[0006] To achieve the above objectives, the present invention provides an intelligent perception and interactive smart wig based on a multimodal large model, comprising:

[0007] Data collection module, used to collect environmental perception information, wearer's vital signs information and audio and video information;

[0008] A data processing module, used to fuse the environmental perception information, the wearer's vital signs information and the audio and video information to obtain a fused data set;

[0009] A data analysis module, used to construct a multimodal neural network model, calculate the fused data set through the multimodal neural network model, and generate an analysis result;

[0010] A control module, used for generating a health management plan based on the analysis results;

[0011] The interactive module is used to control the wig based on the user's operation.

[0012] Preferably, the data acquisition module comprises:

[0013] Environmental sensors to detect temperature, humidity, light intensity, and noise levels;

[0014] Vital signs monitoring module, used to collect the wearer's heart rate, body temperature, blood oxygen and blood pressure;

[0015] Camera and microphone, used to collect video and audio information.

[0016] Preferably, the data processing module includes:

[0017] An edge computing module is used to perform feature extraction and fusion processing on the environmental perception information, the wearer's vital signs information, and the audio and video information locally to generate a fused data set;

[0018] The data storage module is used to store and synchronize the fused data set in the cloud.

[0019] Preferably, the data analysis module is also used to optimize the multimodal neural network model based on the long-term data accumulation of the user.

[0020] Preferably, the interaction module includes:

[0021] A voice control module, used to query health data, adjust wig settings, or get real-time environmental feedback through voice commands;

[0022] A gesture control module that recognizes the user's gestures and controls the wig;

[0023] Touch control module, various operations can be achieved by touching or sliding the surface of the wig.

[0024] Preferably, it also includes a wireless communication module for connecting with mobile devices based on Wi-Fi 6 and Bluetooth 5.0.

[0025] Preferably, it also includes an encryption module for performing advanced encryption processing on data during transmission and storage.

[0026] Compared with the prior art, the present invention has the following advantages and technical effects:

[0027] The invention demonstrates its innovation and practicality in the field of health monitoring and intelligent interaction. It successfully combines advanced health monitoring technology with daily-wear wigs, providing users with a concealed, convenient and efficient health management solution. In addition, the multimodal large model has self-learning capabilities. By continuously learning the user's behavior and health data, it continuously optimizes its own algorithms and analysis capabilities to improve the accuracy of health management services. The model can continuously adjust and optimize health recommendations based on the user's long-term data accumulation, providing more accurate and personalized services. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0029] Figure 1 This is a schematic diagram of an intelligent perception and interactive smart wig based on a multimodal large model according to an embodiment of the present invention. DETAILED DESCRIPTION

[0030] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0031] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0032] Embodiment 1

[0033] like Figure 1 As shown, this embodiment provides an intelligent perception and interactive smart wig based on a multimodal large model, including:

[0034] Data collection module, used to collect environmental perception information, wearer's vital signs information and audio and video information;

[0035] A data processing module, used to fuse the environmental perception information, the wearer's vital signs information and the audio and video information to obtain a fused data set;

[0036] A data analysis module, used to construct a multimodal neural network model, calculate the fused data set through the multimodal neural network model, and generate an analysis result;

[0037] A control module, used for generating a health management plan based on the analysis results;

[0038] The interactive module is used to control the wig based on the user's operation.

[0039] Further optimizing the scheme, the data acquisition module includes:

[0040] Environmental sensors to detect temperature, humidity, light intensity, and noise levels;

[0041] Vital signs monitoring module, used to collect the wearer's heart rate, body temperature, blood oxygen and blood pressure;

[0042] Camera and microphone, used to collect video and audio information.

[0043] The smart wig integrates a variety of environmental sensors and vital signs monitoring sensors, including but not limited to:

[0044] Environmental sensors: temperature sensor, humidity sensor, light sensor, noise sensor, accelerometer and gyroscope, used to detect the user's surrounding environment information in real time.

[0045] Vital sign monitoring sensors: heart rate sensor, body temperature sensor, blood oxygen sensor and blood pressure sensor, used to monitor the user's health status in real time.

[0046] Camera and microphone: used to collect video and audio information to further enrich multimodal data sources.

[0047] Further optimizing the scheme, the data processing module includes:

[0048] An edge computing module is used to perform feature extraction and fusion processing on the environmental perception information, the wearer's vital signs information, and the audio and video information locally to generate a fused data set;

[0049] The data storage module is used to store and synchronize the fused data set in the cloud.

[0050] Further optimizing the scheme, the data analysis module is also used to optimize the multimodal neural network model according to the long-term data accumulation of the user.

[0051] The core technology of this invention lies in multimodal data fusion, which generates a comprehensive user health portrait by fusing the environmental perception information collected by sensors and the user's vital signs information. Specifically, it includes:

[0052] Multimodal data acquisition: Environmental parameters (such as temperature, humidity, light intensity, noise level) and vital signs data (such as heart rate, body temperature, blood oxygen, blood pressure) are collected through a variety of sensors, and combined with video and audio information collected by cameras and microphones to form a multimodal data source.

[0053] Feature extraction: Extract features from various sensor data to extract key health parameters and environmental characteristics.

[0054] Data fusion: Use data fusion algorithms to fuse environmental perception information with user vital signs information to generate comprehensive health data.

[0055] Further optimizing the scheme, the interaction module includes:

[0056] A voice control module, used to query health data, adjust wig settings, or get real-time environmental feedback through voice commands;

[0057] A gesture control module that recognizes the user's gestures and controls the wig;

[0058] Touch control module, various operations can be achieved by touching or sliding the surface of the wig.

[0059] Further optimization solutions also include wireless communication modules for connecting to mobile devices based on Wi-Fi 6 and Bluetooth 5.0.

[0060] Further optimization solutions also include an encryption module for performing advanced encryption processing on data during transmission and storage.

[0061] The core technology of this invention lies in the application of a multimodal large model, which integrates the environmental perception information collected by sensors and the user's vital signs information, and uses deep learning and big data analysis technology to achieve comprehensive analysis and personalized management of the user's health status. Specifically, it includes:

[0062] Comprehensive analysis of large models: Use multimodal large models to conduct deep learning and comprehensive analysis of fused data to identify and understand complex information in specific scenarios, such as changes in users’ health status in different environments.

[0063] Health management suggestions: Based on the analysis results, personalized health management suggestions and warnings are generated to help users manage their health. For example, when comprehensive analysis of environmental data and vital signs data reveals that a user may be in an unwell state, the system will give timely suggestions or warnings.

[0064] Self-learning ability: The multimodal large model has the ability to self-learn. By continuously learning the user's behavior and health data, it continuously optimizes its own algorithms and analysis capabilities to improve the accuracy of health management services. The model can continuously adjust and optimize health recommendations based on the user's long-term data accumulation to provide more accurate and personalized services.

[0065] Embodiment 2

[0066] This embodiment provides an intelligent perception and interactive smart wig based on a multimodal large model, including:

[0067] Multimodal intelligent interactive system

[0068] The smart wig is equipped with an advanced intelligent interaction system that supports a variety of natural interaction methods, including:

[0069] Voice control: Supporting multi-language speech recognition and natural semantic understanding, users can query health data, adjust wig settings or get real-time environmental feedback through voice commands.

[0070] Gesture control: The built-in sensor recognizes the user's gestures to achieve convenient control of the wig.

[0071] Touch control: The wig surface is integrated with a touch sensor. Users can perform various operations by lightly touching or sliding the wig surface, such as switching modes, adjusting settings, etc., providing a more intuitive and convenient interactive experience.

[0072] Wireless communication and data security

[0073] Smart wigs use advanced wireless communication technology and data security measures to ensure efficient data transmission and security:

[0074] Wireless communication: Supports Wi-Fi 6 and Bluetooth 5.0 technologies to achieve seamless connection and data synchronization with mobile devices.

[0075] Data security: Data is processed with advanced encryption during transmission and storage to prevent unauthorized access and data leakage.

[0076] Edge computing and cloud storage

[0077] In order to improve data processing efficiency and protect user privacy, the present invention integrates an edge computing unit inside the wig to achieve preliminary processing and analysis of data:

[0078] Edge computing: Perform preliminary processing and analysis of sensor data locally to reduce dependence on central servers and reduce data transmission latency.

[0079] Cloud storage: Supports cloud storage and synchronization of data to ensure long-term preservation and in-depth analysis of data.

[0080] Self-learning and personalized health management

[0081] The multimodal large model of the present invention has the ability of self-learning. By continuously learning the user's behavior and health data, it continuously optimizes its own algorithms and analysis capabilities to provide personalized health management services:

[0082] Self-learning capability: The multimodal large model continuously improves the accuracy of health management recommendations by analyzing users’ long-term health data.

[0083] Personalized health management: Provide personalized health advice and warnings based on the user's environment and health data to improve the user's health management level.

[0084] Comfort and aesthetics

[0085] The present invention focuses on the comfort and aesthetics of the wig in design, ensuring that the user can still feel comfortable when wearing it for a long time:

[0086] Modular design: supports replacement and upgrading of internal components, and users can personalize the wig according to their needs.

[0087] Comfortable to wear: Made of breathable and soft material, it ensures a comfortable experience for the wig during long-term use.

[0088] The above are only preferred specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An intelligent perception and interactive smart wig based on a multimodal large model, characterized in that: include: Data collection module, used to collect environmental perception information, wearer's vital signs information and audio and video information; A data processing module, used to fuse the environmental perception information, the wearer's vital signs information and the audio and video information to obtain a fused data set; A data analysis module, used to construct a multimodal neural network model, calculate the fused data set through the multimodal neural network model, and generate an analysis result; A control module, used for generating a health management plan based on the analysis results; The interactive module is used to control the wig based on the user's operation.

2. The intelligent perception and interactive smart wig based on a multimodal large model according to claim 1 is characterized in that: The data acquisition module comprises: Environmental sensors to detect temperature, humidity, light intensity, and noise levels; Vital signs monitoring module, used to collect the wearer's heart rate, body temperature, blood oxygen and blood pressure; Camera and microphone, used to collect video and audio information.

3. The intelligent perception and interactive smart wig based on multimodal large model according to claim 1 is characterized in that: The data processing module comprises: An edge computing module is used to perform feature extraction and fusion processing on the environmental perception information, the wearer's vital signs information, and the audio and video information locally to generate a fused data set; The data storage module is used to store and synchronize the fused data set in the cloud.

4. The intelligent perception and interactive smart wig based on multimodal large model according to claim 1 is characterized in that: The data analysis module is also used to optimize the multimodal neural network model based on the long-term data accumulation of the user.

5. The intelligent perception and interactive smart wig based on multimodal large model according to claim 1 is characterized in that: The interaction module includes: A voice control module, used to query health data, adjust wig settings, or get real-time environmental feedback through voice commands; A gesture control module that recognizes the user's gestures and controls the wig; Touch control module, various operations can be achieved by touching or sliding the surface of the wig.

6. The intelligent perception and interactive smart wig based on multimodal large model according to claim 1 is characterized in that: It also includes a wireless communication module for connecting with mobile devices based on Wi-Fi 6 and Bluetooth 5.

0.

7. The intelligent perception and interactive smart wig based on multimodal large model according to claim 1 is characterized in that: It also includes an encryption module for advanced encryption of data during transmission and storage.