Intelligent glasses with intelligent sensing function

Abstract

The invention belongs to the technical field of intelligent glasses with intelligent perception, and particularly relates to intelligent glasses with intelligent perception, which comprise a glasses frame, a camera slot, two glasses support arms, two touch glasses legs and an intelligent control module. A high-definition lens, a display lens, a holographic AR information display lens and a protective cover are arranged in the glasses frame; a high-definition CMOS (Complementary Metal Oxide Semiconductor) camera is arranged in the camera slot, and low-light induction intensifiers are arranged in the induction slots on the two sides of the A lithium battery and a microphone are arranged in the glasses support arm, and the touch glasses leg is hinged to the tail end of the glasses support arm; the intelligent control module can project digital information to the display lens and the holographic AR information display lens to be superposed with reality. According to the glasses, through cooperation of all parts, a user can normally see objects in dark, smog, haze and other environments, light brightness is automatically adapted, eye stimulation is avoided, night vision full-color imaging is achieved, and the glasses are portable and easy to operate.

Description

Technical Field

[0001] This invention belongs to the field of virtual reality smart consumer device technology, and particularly relates to smart glasses with intelligent sensing capabilities. Background Technology

[0002] There are various types of virtual reality smart consumer devices, and smart glasses with intelligent sensing capabilities are one of them. Currently, smart glasses with intelligent sensing capabilities on the market primarily focus on information display, virtual reality experiences, image capture, and audio playback, but their visual perception range remains limited to the visible light domain. In low-light or completely dark environments, users often need to rely on handheld auxiliary devices such as mobile phone flashlights, or bulky and inconvenient professional night vision devices to expand their field of vision. However, these auxiliary tools generally suffer from problems such as cumbersome operation, limited field of view, inability to free up users' hands for other operations, and a lack of good interaction with the surrounding environment. Therefore, there is an urgent market demand for a convenient device that can naturally integrate into daily life scenarios and effectively improve users' visual perception capabilities under various lighting conditions. In view of this, this invention proposes smart glasses with intelligent sensing capabilities. Summary of the Invention

[0003] The purpose of this invention is to provide intelligent glasses with intelligent sensing capabilities to solve the problems mentioned in the background art.

[0004] In view of this, the present invention provides intelligent sensing smart glasses, comprising: An eyeglass frame, wherein eyeglass slots are symmetrically provided inside the eyeglass frame, a protective cover is fixedly installed inside the eyeglass slots, and a high-definition lens, a display lens and a holographic AR information display lens are fixedly installed inside the protective cover; A camera slot is provided on the front side of the eyeglass frame. A high-definition CMOS camera is fixedly installed in the camera slot. A sensing slot is provided on both sides of the front side of the eyeglass frame and located in the camera slot. A low-light sensor intensifier is fixedly installed in the sensing slot. Two eyeglass arms are fixedly installed on both sides of the eyeglass frame, and the eyeglass arms are provided with an energy storage slot and a sound receiving slot. A lithium battery is fixedly installed in the energy storage slot and a microphone is fixedly installed in the sound receiving slot. Two touch-sensitive temples, which are respectively hinged to the tail ends of two eyeglass arms; The intelligent control module is mounted on the eyeglass frame and projects digital information directly onto the display lens and the holographic AR information display lens, displaying it in the user's field of vision and superimposing it on the real world.

[0005] In the above technical solution, the intelligent control module further includes: The first groove is located at the top of the eyeglass frame and contains an ARM processor. The top of the eyeglass frame also contains a second, a third, a fourth, a fifth, a sixth, and a seventh groove. An integrated NPU processor and an uncooled infrared thermal imaging sensor are fixedly installed in the second and third grooves, respectively. An ambient light sensor and a gyroscope are fixedly installed in the fourth and fifth grooves, respectively. An accelerometer and a night vision enhancement annotation module are fixedly installed in the sixth and seventh grooves, respectively.

[0006] In this technical solution, by integrating an adapted NPU processor, an uncooled infrared thermal imaging sensor, an ambient light sensor, a gyroscope, an accelerometer, and a night vision enhancement annotation module, the integrated NPU processor is able to handle complex image fusion, AI recognition, and AR rendering captured by a high-definition CMOS camera, while controlling power consumption and ensuring low latency. The uncooled infrared thermal imaging sensor is a device specifically designed to detect mid-wave or long-wave infrared (wavelength approximately 3-14 micrometers). In a completely dark environment (0 Lux), low-light cameras are also ineffective. In this case, the thermal imaging sensor constructs an image by detecting temperature differences on the surface of an object. High-temperature areas are displayed in bright colors (such as white and red), while low-temperature areas are displayed in dark colors (such as black and blue). This allows the sensor to penetrate smoke, fog, and dust to a certain extent, ensuring the detection of infrared heat radiation emitted from object surfaces and converting invisible "heat" into a visible image, enabling users to "see" even in complete darkness, smoke, smog, or other environments where the naked eye is limited. An ambient light sensor detects the light intensity (illuminance) around the glasses in real time, allowing the ARM processor to automatically adjust the brightness of the display lens and the holographic AR information display lens based on the light intensity detected by the sensor. In bright light, it doesn't need to maintain maximum brightness continuously; in low light, it actively reduces brightness to ensure a clear display in any lighting environment, avoiding eye strain and fatigue caused by overly bright or dark screens. Maintaining low brightness in low light ensures uninterrupted user vision, which is crucial, especially when walking or driving. A gyroscope ensures that the high-definition CMOS camera can detect the unavoidable slight movements of the user's head and body when recording video or taking photos. The gyroscope can detect these minute jitters (changes in angular velocity) with extreme sensitivity. Based on the real-time jitter data provided by the gyroscope, the ARM processor reverse-drives the high-definition CMOS camera lens or uses algorithms to digitally crop and compensate the image, thus counteracting the jitter and outputting stable, smooth video. This ensures that the virtual information (such as navigation arrows, weather panels, and virtual pets) seen by the user through the display lens and holographic AR information display lens remains "fixed" in a specific position in the real world. The accelerometer measures linear motion and static angles, measuring the speed of linear motion (acceleration) of the entire device along the X, Y, and Z axes, including forward, backward, left, right, and up / down movements. It can sense sudden forward leans, rapid head shaking (including linear components), and up-and-down jerking while walking. The accelerometer enables imperceptible wear detection and intuitive head gesture control. The night vision enhancement annotation module is a crucial link in converting raw night vision images into actionable information, specifically designed to enhance the user's situational awareness and safety in low-light environments.

[0007] In the above technical solution, the ARM processor is further connected by wires to the integrated and adapted NPU processor, the uncooled infrared thermal imaging sensor, the ambient light sensor, the gyroscope, the accelerometer, and the night vision enhancement annotation module. The lithium battery is also connected by wires to the ARM processor, the integrated and adapted NPU processor, the uncooled infrared thermal imaging sensor, the ambient light sensor, the gyroscope, the accelerometer, and the night vision enhancement annotation module.

[0008] In this technical solution, during the startup and operation of the entire device, the ARM processor can process and summarize the mathematical information generated by the integrated and adapted NPU processor, uncooled infrared thermal imaging sensor, ambient light sensor, gyroscope, accelerometer, and night vision enhancement annotation module, and feed the resulting practical data back to the display lens and holographic AR information display lens. This ensures that the device is visible to the human eye, even at night, thus providing night vision capabilities. Simultaneously, the lithium battery provides a continuous and stable power supply to the ARM processor, integrated and adapted NPU processor, uncooled infrared thermal imaging sensor, ambient light sensor, gyroscope, accelerometer, and night vision enhancement annotation module.

[0009] In the above technical solution, the uncooled infrared thermal imaging sensor, ambient light sensor, gyroscope, accelerometer and night vision enhancement annotation module are all wired to the display lens and the holographic AR information display lens.

[0010] In this technical solution, the information generated by the uncooled infrared thermal imaging sensor, ambient light sensor, gyroscope, accelerometer, and night vision enhancement annotation module is processed, filtered, and optimized by the ARM processor and then fed back to the display lens and the holographic AR information display lens so that it can be viewed by the human eye.

[0011] In the above technical solution, the microphone, high-definition CMOS camera, low-light sensor intensifier, and touch-sensitive temple are all connected to the lithium battery wire, and the high-definition CMOS camera, low-light sensor intensifier, and touch-sensitive temple are all connected to the ARM processor wire.

[0012] In this technical solution, the lithium battery ensures that it can provide continuous and stable power to the microphone, high-definition CMOS camera, low-light sensor intensifier, and touch-sensitive temple, guaranteeing the normal operation of the microphone, high-definition CMOS camera, low-light sensor intensifier, and touch-sensitive temple. The shooting and recording of the high-definition CMOS camera and the opening and closing of the low-light sensor intensifier are all handled by the intelligent ARM processor.

[0013] In the above technical solution, one of the eyeglass arms is provided with a charging port at the bottom, and the charging port is connected to two lithium battery wires.

[0014] In this technical solution, it is ensured that the two lithium batteries can be charged through the charging port, thus guaranteeing that the lithium batteries can provide power to the entire device.

[0015] In the above technical solution, the display lens is further positioned between the high-definition lens and the holographic AR information display lens.

[0016] In this technical solution, the high-definition lens can protect the display lens and the holographic AR information display lens. The display lens automatically brightens the image in twilight or dim indoor environments, making the details clearer. The micro-waveguide projection system on the holographic AR information display lens projects digital information directly into the user's field of vision, superimposing it on the real world.

[0017] In the above technical solution, one of the touch screen temples is provided with a master power switch, and the other touch screen temple is provided with a control panel. The control panel and the master power switch are connected to the ARM processor by wires.

[0018] In this technical solution, it is ensured that turning on the main start switch will enable the entire device to start and operate, while the control panel can control the operation of the ARM processor, the integrated and adapted NPU processor, the uncooled infrared thermal imaging sensor, the ambient light sensor, the gyroscope, the accelerometer, the night vision enhancement annotation module, the touch-sensitive temples, the high-definition CMOS camera, and the low-light sensor intensifier.

[0019] The beneficial effects of this invention are: 1. This portable intelligent sensing smart glasses, through the combined use of a display lens, a holographic AR information display lens, an ARM processor, an integrated and compatible NPU processor, an uncooled infrared thermal imaging sensor, an ambient light sensor, a gyroscope, an accelerometer, a night vision enhancement annotation module, a high-definition CMOS camera, and a low-light sensor intensifier, enable users to "see" even in complete darkness, smoke, smog, or other environments where the naked eye is limited. In bright light, it doesn't need to maintain maximum brightness continuously; in low light, it actively reduces brightness to ensure clear display in any lighting environment, avoiding eye strain and fatigue caused by excessively bright or dark screens. It maintains low brightness in low light to prevent interference with the user's vision, allowing visibility even at night. It also features night vision capabilities and can convert raw night vision images into key operational information displayed on the display lens, specifically designed to enhance users' situational awareness and safety in low-light environments.

[0020] 2. These portable smart glasses with intelligent sensing capabilities, equipped with a lithium battery and charging port, ensure that the entire device can be easily carried to any location. Attached Figure Description

[0021] Figure 1This is one of the overall structural schematic diagrams of the present invention; Figure 2 This is the second schematic diagram of the overall structure of the present invention; Figure 3 This is a cross-sectional view of the eyeglass frame in this invention; Figure 4 This is a detailed internal structural diagram of the eyeglass frame in this invention.

[0022] The markings in the diagram are as follows: 1. Eyeglass frame; 11. Recess 1; 12. Recess 2; 13. Recess 3; 14. Recess 4; 15. Recess 5; 16. Recess 6; 17. Recess 7; 18. Camera slot; 181. Sensor slot; 19. Eyeglass slot; 2. Eyeglass arm; 21. Energy storage slot; 22. Sound receiver slot; 3. High-definition lens; 31. Display lens; 32. Holographic AR information display lens; 4. ARM processor; 5. Integrated NPU processor; 51. Uncooled infrared thermal imaging sensor; 52. Ambient light sensor; 6. Gyroscope; 61. Accelerometer; 62. Night vision enhancement annotation module; 7. Protective cover; 8. Touch-sensitive temples; 81. Control panel; 82. Master power switch; 9. High-definition CMOS camera; 91. Low-light sensor intensifier. Detailed Implementation

[0023] The following is in conjunction with the appendix Figures 1-4 This application will be described in further detail.

[0024] In this application, the terms "upper," "lower," "left," "right," "front," "rear," "top," "bottom," "inner," "outer," "middle," "vertical," and "horizontal," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. These terms are primarily for the purpose of better describing this application and its embodiments, and are not intended to limit the indicated device, element, or component to having a specific orientation, or to be constructed and operated in a specific orientation.

[0025] Example 1: This embodiment provides intelligent sensing smart glasses, including: a glasses frame 1, with symmetrically arranged glasses slots 19 inside the glasses frame 1, a protective cover 7 fixedly installed inside the glasses slots 19, and a high-definition lens 3, a display lens 31, and a holographic AR information display lens 32 fixedly installed inside the protective cover 7; a camera slot 18, located on the front side of the glasses frame 1, with a high-definition CMOS camera 9 fixedly installed inside the camera slot 18, and sensing slots on both sides of the front side of the glasses frame 1 and located on both sides of the camera slot 18, with low-light sensing intensifiers fixedly installed inside the sensing slots; and two glasses arms 2. Two eyeglass arms 2 are fixedly installed on both sides of the eyeglass frame 1, and the eyeglass arms 2 are provided with an energy storage slot 21 and a microphone slot 22. A lithium battery is fixedly installed in the energy storage slot 21 and a microphone is fixedly installed in the microphone slot 22. Two touch-sensitive temples 8 are respectively hinged to the tail ends of the two eyeglass arms 2. An intelligent control module is set on the eyeglass frame 1 and projects digital information directly onto the display lens 31 and the holographic AR information display lens 32 and displays it in the user's field of vision, superimposing it with the real world and also realizing the virtual reality experience effect.

[0026] The intelligent control module includes: a groove 11, which is located at the top of the eyeglass frame 1. An ARM processor 4 is fixedly installed in the groove 11. The top of the eyeglass frame 1 has grooves 12, 13, 14, 15, 16, and 17. An integrated AI image fusion NPU processor 5 and an uncooled infrared thermal imaging sensor 51 are fixedly installed in grooves 12 and 13, respectively. An ambient light sensor 52 and a gyroscope 6 are fixedly installed in grooves 14 and 15, respectively. An accelerometer 61 and a night vision enhancement annotation module 62 are fixedly installed in grooves 16 and 17, respectively.

[0027] The system incorporates an integrated AI image fusion NPU processor 5, an uncooled infrared thermal imaging sensor 51, an ambient light sensor 52, a gyroscope 6, an accelerometer 61, and a night vision enhancement annotation module 62. This ensures that the integrated AI image fusion NPU processor 5 can handle complex image fusion, AI recognition, and AR rendering between the images captured by the high-definition CMOS camera 9 and the thermal imaging data obtained by the uncooled infrared thermal imaging sensor 51, while precisely controlling power consumption to maintain low latency. The uncooled infrared thermal imaging sensor 51 is specifically designed to detect mid-wave or long-wave infrared light. In completely dark environments, where conventional cameras are ineffective, the thermal imaging sensor constructs an image by detecting temperature differences on the object's surface; high-temperature areas are displayed as bright colors, and low-temperature areas as dark colors. It can penetrate smoke, fog, and dust to a certain extent, accurately detect the infrared thermal radiation emitted by the surface of objects, and convert invisible heat into visible images, allowing users to see clearly even in environments where the naked eye is limited, such as complete darkness, smoke, and smog. The ambient light sensor 52 can detect the light intensity of the environment around the glasses in real time, allowing the ARM processor 4 to automatically adjust the brightness of the display lens 31 and the holographic AR information display lens 32 according to the light intensity detected by the ambient light sensor 52. In sufficient light, it does not need to maintain the highest brightness all the time; in low light, it actively optimizes the brightness parameters to ensure a clear display effect in any lighting environment, avoiding eye stimulation and fatigue caused by overly bright or dark screens, and ensuring comfortable low brightness in low light to ensure that the user's vision is not interfered with, which is especially important when walking or driving.

[0028] The gyroscope 6 ensures that the high-definition CMOS camera 9 can handle the unavoidable minor shakes of the human head and body when recording video or capturing images. It can detect these minor shakes with extreme sensitivity, and the ARM processor 4 uses algorithms to digitally crop and compensate the image based on the real-time shake data provided by the gyroscope 6, thereby canceling out the shake and outputting a stable and smooth image. This ensures that the virtual information seen by the person through the display lens 31 and the holographic AR information display lens 32 can be fixed in a certain position in the real world. The accelerometer 61 is used to measure linear motion and static angles, and can capture the overall device in the X, Y, and Z axes. The system can detect changes in the speed of linear motion along each axis, including forward, backward, left, right, and up and down movements. It can sense sudden forward leaning, rapid head shaking, and bouncing movements while walking, thereby achieving seamless wear detection and intuitive head gesture control. The night vision enhancement annotation module 62 is a key component in converting raw night vision images into actionable information, specifically designed to enhance the user's situational awareness and safety in low-light environments. The low-light sensor enhancer can capture and enhance weak light in the environment, working in conjunction with the high-definition CMOS camera 9 to further improve image acquisition in low-light environments, facilitating the realization of zero-light supplemental night vision full-color functionality.

[0029] The clear imaging methods of the display lens 31 and the holographic AR information display lens 32 are as follows: The display lens 31 adopts a composite structure of ultra-thin liquid crystal display layer + optical anti-reflection coating + flexible substrate. The core is a 0.3mm thick MEMS driving liquid crystal layer, and the upper and lower surfaces are coated with a 200nm thick magnesium fluoride anti-reflection coating. The substrate is a PC / PMMA blend material containing anti-ultraviolet agent. During imaging, the ambient light sensor 52 collects light data. The ARM processor 4 adjusts the deflection angle of the liquid crystal molecules according to the data to achieve continuous brightness adjustment. The AI ​​image fusion NPU processor 5 runs the noise reduction algorithm. The holographic AR information display lens 32 is an integrated structure of micro optical waveguide + holographic grating + anti-reflection coating. The optical waveguide substrate is borosilicate glass. The incident end integrates a 0.5-inch LCOS micro display chip. The outer surface is coated with a SiO2 / TiO2 double-layer anti-reflection coating. During imaging, the LCOS chip converts digital information into an optical image, which is transmitted through the coupling grating into the optical waveguide and then projected to the user's field of vision through diffraction by the holographic grating at the output end. The two work together to achieve clear display under different lighting conditions.

[0030] Example 2: This embodiment provides intelligent sensing smart glasses, which, in addition to the technical solutions of the above embodiments, also have the following technical features: the ARM processor 4 is wiredly connected to the integrated and adapted AI image fusion NPU processor 5, the uncooled infrared thermal imaging sensor 51, the ambient light sensor 52, the gyroscope 6, the accelerometer 61, and the night vision enhancement annotation module 62; the lithium battery is wiredly connected to the ARM processor 4, the integrated and adapted AI image fusion NPU processor 5, the uncooled infrared thermal imaging sensor 51, the ambient light sensor 52, the gyroscope 6, the accelerometer 61, and the night vision enhancement annotation module 62.

[0031] Specifically, to ensure the overall device operates smoothly, the ARM processor 4 can process and summarize the information generated by the integrated and adapted AI image fusion NPU processor 5, uncooled infrared thermal imaging sensor 51, ambient light sensor 52, gyroscope 6, accelerometer 61, and night vision enhancement annotation module 62, extracting practical data and feeding it back to the display lens 31 and holographic AR information display lens 32. This facilitates user observation and ensures clear vision even at night without supplemental lighting, giving the entire device a zero-supplementary-light night vision full-color effect. Simultaneously, the lithium battery provides continuous and stable power to the ARM processor 4, the integrated and adapted AI image fusion NPU processor 5, the uncooled infrared thermal imaging sensor 51, the ambient light sensor 52, the gyroscope 6, the accelerometer 61, and the night vision enhancement annotation module 62.

[0032] Example 3: This embodiment provides intelligent sensing smart glasses, which, in addition to the technical solutions of the above embodiments, also have the following technical features: the uncooled infrared thermal imaging sensor 51, the ambient light sensor 52, the gyroscope 6, the accelerometer 61, and the night vision enhancement annotation module 62 are all wired to the display lens 31 and the holographic AR information display lens 32.

[0033] Specifically, the information generated by the uncooled infrared thermal imaging sensor 51, ambient light sensor 52, gyroscope 6, accelerometer 61, and night vision enhancement annotation module 62 is processed, filtered, and optimized by the ARM processor 4, and then accurately fed back to the display lens 31 and the holographic AR information display lens 32 so that users can view it clearly.

[0034] Example 4: This embodiment provides intelligent sensing smart glasses, which, in addition to the technical solutions of the above embodiments, also have the following technical features: the microphone, high-definition CMOS camera 9, low-light sensor intensifier and touch-sensitive temple 8 are all connected to the lithium battery wire, and the high-definition CMOS camera 9, low-light sensor intensifier and touch-sensitive temple 8 are all connected to the ARM processor 4 wire.

[0035] Among them, the lithium battery ensures that it can provide a continuous and stable power to the microphone, high-definition CMOS camera 9, low light sensor intensifier and touch-sensitive temple 8, ensuring the normal operation of the microphone, high-definition CMOS camera 9, low light sensor intensifier and touch-sensitive temple 8. The shooting and recording of high-definition CMOS camera 9 and the working status of low light sensor intensifier are precisely controlled by intelligent ARM processor 4, so that clear acquisition in low light environment can be achieved without additional lighting operation.

[0036] Example 5: This embodiment provides intelligent sensing smart glasses, which, in addition to the technical solutions of the above embodiments, also have the following technical features: a charging port is provided at the bottom of one of the glasses arm 2, and the charging port is connected to two lithium battery wires.

[0037] This includes ensuring that the two lithium batteries can be fully charged through the charging port, guaranteeing that the lithium batteries can continuously provide stable power to the entire device, and ensuring the long-term operation of core functions such as zero-light night vision full color and AI interaction.

[0038] Example 6: This embodiment provides intelligent sensing smart glasses, which, in addition to the technical solutions of the above embodiments, also have the following technical features: the display lens 31 is located between the high-definition lens 3 and the holographic AR information display lens 32.

[0039] Among them, the high-definition lens 3 can provide reliable protection for the display lens 31 and the holographic AR information display lens 32. The display lens 31 can automatically brighten the picture in twilight and dim indoor environments to make the details clearer. The micro-waveguide projection system on the holographic AR information display lens 32 can directly project digital information into the user's field of vision and accurately superimpose it with the real world. Combined with AI image fusion technology, it can achieve an immersive interactive experience.

[0040] Example 7: This embodiment provides intelligent sensing smart glasses, which, in addition to the technical solutions of the above embodiments, also have the following technical features: one of the touch-sensitive temples 8 is provided with a master start switch 82, and the other touch-sensitive temple 8 is provided with a control panel 81, wherein the control panel 81 and the master start switch 82 are wired to the ARM processor 4.

[0041] Among them, the main power switch 82 ensures that the whole device can start and run when the user turns on the main power switch 82, while the control panel 81 can precisely control the operation of the ARM processor 4, the integrated and adapted AI image fusion NPU processor 5, the uncooled infrared thermal imaging sensor 51, the ambient light sensor 52, the gyroscope 6, the accelerometer 61, the night vision enhancement annotation module 62, the touch-sensitive temple 8, the high-definition CMOS camera 9 and the low light sensor intensifier, so as to realize functions such as AI mode switching and night vision parameter adjustment.

[0042] When the ambient light sensor 52 detects that the illuminance is below 10 Lux, it automatically sends a zero-supplement light night vision scene trigger signal to the ARM processor 4. The ARM processor 4 simultaneously activates the full-color image fusion algorithm of the uncooled infrared thermal imaging sensor 51, the high-definition CMOS camera 9, the low-light sensor intensifier, and the integrated and adapted AI image fusion NPU processor 5, so that the zero-supplement light night vision full-color mode can be started without any supplementary light operation. The uncooled infrared thermal imaging sensor 51 accurately collects temperature gradient data of objects in the environment and generates grayscale thermal imaging images. At the same time, the high-definition CMOS camera 9, with the assistance of the low light sensor intensifier, collects the original image under weak visible light environment. The two types of image data are transmitted to the ARM processor 4 simultaneously. The integrated AI image fusion NPU processor 5 calls the preset AI color mapping model and assigns accurate RGB color parameters to the grayscale thermal imaging image based on the object temperature difference fed back by the uncooled infrared thermal imaging sensor 51. At the same time, it performs AI detail extraction and deep noise reduction processing on the low-light image captured by the high-definition CMOS camera 9, and performs pixel-level fusion of color information and detail texture to generate a clear and delicate zero-light full-color night view image. Color parameters can be manually adjusted via control panel 81. When the user operates control panel 81 on the touch-sensitive temple 8, ARM processor 4 receives instructions in real time and synchronously adjusts the color mapping intensity of the integrated and adapted AI image fusion NPU processor 5 to achieve dynamic optimization of color saturation and contrast, thus meeting the visual preferences of different users. After the fused zero-light full-color night vision image is further optimized for edge sharpening by the ARM processor 4, it is transmitted to the display lens 31 and the holographic AR information display lens 32. The display lens 31 is responsible for the main display of the full-color image, and the holographic AR information display lens 32 overlays the AI ​​object label generated by the night vision enhancement labeling module 62. The label color forms a differential contrast with the color of the full-color image, which significantly improves the scene recognition. In the process of zero-light night vision full-color imaging, in addition to the regular image stabilization function, the gyroscope 6 feeds back head movement trajectory data to the ARM processor 4. The ARM processor 4 dynamically adjusts the display angle of the full-color image according to the trajectory to ensure that the full-color night vision image and the spatial position of the real scene remain synchronized when the user's head turns, thus avoiding image shift. Accelerometer 61 detects slight head movements of the user and triggers the switching between full-color and grayscale night vision modes. No additional buttons are required, achieving seamless operation. After the switching command is processed by ARM processor 4, the algorithm output of the integrated AI image fusion NPU processor 5 is adjusted simultaneously to quickly complete the imaging mode conversion. The ARM processor 4 dynamically adjusts the working frame rate of the uncooled infrared thermal imaging sensor 51, the high-definition CMOS camera 9 and the low-light sensor intensifier according to the remaining power of the lithium battery. When the power is above 50%, the frame rate is maintained at 30fps, and when the power is below 20%, the frame rate drops to 15fps. This maximizes the battery life while ensuring the clarity of the full-color imaging with zero supplementary light. The ambient light sensor 52 monitors changes in light in the night vision environment in real time and feeds the data back to the ARM processor 4. The ARM processor 4 synchronously adjusts the color gain parameters of the integrated and adapted AI image fusion NPU processor 5 to avoid color distortion of the full-color image caused by external light interference. At the same time, it precisely controls the brightness of the display lens 31 and the holographic AR information display lens 32 to ensure that the full-color image remains clear and visible in different low-light environments without excessively bright or dark visual stimulation.

[0043] On the one hand, by leveraging the temperature gradient data from the uncooled infrared thermal imaging sensor 51, the low-light image data from the high-definition CMOS camera 9, and the light enhancement effect of the low-light sensor intensifier, and through the deep fusion of the color mapping algorithm of the integrated and adapted AI image fusion NPU processor 5, it not only breaks through the limitation of traditional smart glasses night vision function being able to only present grayscale images, but also achieves full-color imaging under zero supplementary lighting conditions, allowing the image to simultaneously possess temperature differentiation and detail clarity, completely solving the dual pain points of blurry details in single infrared imaging and color loss and reliance on supplementary lighting in single low-light imaging; on the other hand, through the coordinated linkage of the ambient light sensor 52, gyroscope 6, accelerometer 61, and ARM processor 4, combined with the AI ​​image fusion technology and the auxiliary effect of the low-light sensor intensifier, the device enables full-color imaging under zero supplementary lighting conditions. In the full-color night vision mode with supplemental lighting, it features both adaptive adjustment and seamless interaction capabilities: the ambient light sensor 52 can dynamically optimize color gain according to sudden light to avoid color distortion; the gyroscope 6 can synchronously adjust the full-color image viewing angle to match head movements; the accelerometer 61 achieves full-color / grayscale mode switching through slight head movements, combined with the manual adjustment function of the control panel 81, forming a triple control logic of AI automatic adaptation + seamless interaction + manual fine-tuning, which not only ensures imaging stability in complex night vision scenarios, but also greatly improves the ease of operation; at the same time, through the dynamic control of the device frame rate by the ARM processor 4, it achieves advanced functions such as zero-supplemental-light full-color night vision and AI intelligent interaction while taking into account battery life, breaking the conventional understanding that function upgrades inevitably lead to a surge in power consumption, and realizing the synergistic optimization of function, experience and battery life.

[0044] The display lens 31 automatically brightens the image in dim indoor environments such as dusk, resulting in clearer details. This function collects real-time illumination data through the ambient light sensor 52. When the illumination level is detected to be between 1 Lux and 50 Lux for three consecutive times with a change rate ≤ 5 Lux / s, the automatic brightening program is triggered. The ARM processor 4 calls the brightness mapping algorithm to calculate the target brightness and drives the liquid crystal driving circuit of the display lens 31 through the PWM signal. The brightness is smoothly adjusted within 300ms. At the same time, the AI ​​image fusion NPU processor 5 starts the AI ​​detail enhancement algorithm to stretch the grayscale of dark areas and improve edge contrast. The color temperature of the display lens 31 is simultaneously optimized to 3500K~4500K. Tests show that the text recognition accuracy reaches 98% in a 10 Lux environment and the grayscale value of dark details is improved by 40% in a 5 Lux environment. Clear display needs in dim environments can be met without any supplemental lighting.

[0045] Breaking through the limitations of traditional smart glasses that are confined to visual perception in the visible light domain, this device combines an uncooled infrared thermal imaging sensor 51 with a high-definition CMOS camera 9 and a low-light sensor intensifier 91. Even in completely dark (0 Lux) or visually limited environments such as smoke or haze, it can construct images and capture low-light details by detecting temperature differences in objects without relying on handheld lighting devices or large professional instruments. Furthermore, through an AI image fusion algorithm integrated with a compatible NPU processor 5, it performs pixel-level fusion of thermal imaging data and low-light images, achieving full-color night vision imaging under zero-light conditions. This completely changes the conventional wisdom that "night vision must be grayscale," allowing objects in dark environments to not only be discernible but also to display rich colors and clear textures.

[0046] Breaking the technical dilemma that "functional upgrades inevitably come with high power consumption," the ARM processor 4, as the core control unit, works in conjunction with the ambient light sensor 52 to dynamically adjust the brightness of the display lens 31 and the holographic AR information display lens 32. It reduces power consumption when there is sufficient light and accurately adapts the brightness in low-light environments, avoiding eye irritation and saving energy. At the same time, it intelligently adjusts the working frame rate of the uncooled infrared thermal imaging sensor 51 and the high-definition CMOS camera 9 according to the remaining power of the lithium battery, adaptively switching between 30fps high-definition imaging and 15fps energy-saving mode. This achieves a balance between complex functions such as full-color night vision, AR overlay, and image stabilization and long battery life, breaking the conventional understanding that "high performance and long battery life cannot be achieved simultaneously" in smart wearable devices.

[0047] Overturning the traditional logic that "interaction in complex environments requires two-handed operation," the gyroscope 6 and accelerometer 61 work together to not only compensate for shake during high-definition CMOS camera 9 shooting, but also sense linear movements and angular changes in the head, enabling buttonless operation such as seamless wear detection and head gesture control. With the control panel 81 and master power switch 82 on the touch-sensitive temples 8, users can easily adjust AI image fusion parameters, switch night vision modes, and other functions, completely freeing their hands. This solves the pain points of traditional auxiliary observation equipment, such as "cumbersome operation and limited field of view," and achieves an immersive interactive experience of "wearing it means sensing, and movement means control" in complex environments. It breaks the technical perception that "functionality and convenience are difficult to balance" in special scenarios for smart glasses.

[0048] The embodiments of this application have been described above with reference to the accompanying drawings. Unless otherwise specified, the embodiments and features in the embodiments of this application can be combined with each other. This application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. Smart glasses with intelligent sensing capabilities, characterized in that, include: The eyeglass frame (1) has symmetrical eyeglass slots (19) inside. A protective cover (7) is fixedly installed inside the eyeglass slots (19). A high-definition lens (3), a display lens (31) and a holographic AR information display lens (32) are fixedly installed inside the protective cover (7). A camera slot (18) is provided on the front side of the eyeglass frame (1). A high-definition CMOS camera (9) is fixedly installed in the camera slot (18). A sensing slot (181) is provided on the front side of the eyeglass frame (1) and on both sides of the camera slot (18). A low-light sensing enhancer (91) is fixedly installed in the sensing slot (181). Two eyeglass arms (2) are fixedly installed on both sides of the eyeglass frame (1), and an energy storage slot (21) and a sound receiving slot (22) are provided in the eyeglass arms (2). A lithium battery is fixedly installed in the energy storage slot (21), and a microphone is fixedly installed in the sound receiving slot (22). Two touch-sensitive temples (8) are respectively hinged to the tail ends of two eyeglass arms (2); The intelligent control module is set on the eyeglass frame (1) and projects digital information directly onto the display lens (31) and the holographic AR information display lens (32) and displays it in the user's field of vision, superimposed on the real world.

2. The intelligent sensing glasses according to claim 1, characterized in that, The intelligent control module includes: The first groove (11) is located at the top of the eyeglass frame (1). An ARM processor (4) is fixedly installed in the first groove (11). The top of the eyeglass frame (1) is provided with the second groove (12), the third groove (13), the fourth groove (14), the fifth groove (15), the sixth groove (16), and the seventh groove (17). An integrated and adapted NPU processor (5) and an uncooled infrared thermal imaging sensor (51) are fixedly installed in the second groove (12) and the third groove (13), respectively. An ambient light sensor (52) and a gyroscope (6) are fixedly installed in the fourth groove (14) and the fifth groove (15), respectively. An accelerometer (61) and a night vision enhancement annotation module (62) are fixedly installed in the sixth groove (16) and the seventh groove (17), respectively.

3. The intelligent sensing glasses according to claim 2, characterized in that, The ARM processor (4) is wired to the integrated and adapted NPU processor (5), uncooled infrared thermal imaging sensor (51), ambient light sensor (52), gyroscope (6), accelerometer (61) and night vision enhancement annotation module (62), and the lithium battery is wired to the ARM processor (4), the integrated and adapted NPU processor (5), uncooled infrared thermal imaging sensor (51), ambient light sensor (52), gyroscope (6), accelerometer (61) and night vision enhancement annotation module (62).

4. The intelligent sensing glasses according to claim 2, characterized in that, The uncooled infrared thermal imaging sensor (51), ambient light sensor (52), gyroscope (6), accelerometer (61) and night vision enhancement annotation module (62) are all wired to the display lens (31) and the holographic AR information display lens (32).

5. The intelligent sensing glasses according to claim 1, characterized in that, The microphone, high-definition CMOS camera (9), low-light sensor (91) and touch-sensitive temple (8) are all connected to the lithium battery wires, and the high-definition CMOS camera (9), low-light sensor (91) and touch-sensitive temple (8) are all connected to the ARM processor (4) wires.

6. The intelligent sensing glasses according to claim 1, characterized in that, One of the eyeglass arms (2) has a charging port at its bottom, and the charging port is connected to two lithium battery wires.

7. The intelligent sensing glasses according to claim 1, characterized in that, The display lens (31) is located between the high-definition lens (3) and the holographic AR information display lens (32).

8. The intelligent sensing glasses according to claim 1, characterized in that, One of the touch-sensitive temples (8) is provided with a master power switch (82), and the other touch-sensitive temple (8) is provided with a control panel (81). The control panel (81) and the master power switch (82) are wired to the ARM processor (4).

Images