1277 results about "EyeTap" patented technology

The invention provides a smart glasses AI voice interaction method, which comprises the following steps: simultaneously acquiring a user gesture image and a voice signal, acquiring a user historical interaction record, extracting key point coordinates and pointing direction information of the gesture image, acquiring hand distance information, generating a gesture motion path, simultaneously extracting frequency spectrum information and an intonation peak value of the voice signal, and generating a gesture motion path; forming a voice beat sequence; extracting a spatial semantic mode of the gesture and voice fusion data, and recognizing a core object of a user pointing instruction according to pointing coordinates of a gesture motion path and an intonation peak value of a voice beat sequence; after the core object pointing to the instruction is recognized, the user intention is determined in combination with the spatial semantic mode and the historical interaction record of the user; and the complete intention analysis result is output to the intelligent glasses display module to execute corresponding operation, and is fed back to the acquisition module to adjust the next capture parameters including the acquisition frequency and the recognition sensitivity, so that the response speed and the accuracy are improved.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto a user's retina based on pupil position and size. The glasses comprise a frame, lenses with directed pixel layers, and sensors for tracking pupil movement. Each directed pixel may generate multiple virtual pixels by rapidly changing its emission angle. The glasses function as prescription lenses, virtual reality displays, and augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, and connectivity to peripheral devices. The glasses enable a seamless blend of virtual and real-world experiences, creating an immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

The invention relates to the technical field of augmented reality and industrial safety monitoring, in particular to an AR glasses dangerous state dynamic labeling method and system based on multi-source perception, and the method comprises the steps: synchronously collecting data such as a depth image and gas concentration through multi-source equipment such as a depth camera and a gas sensor; extracting rotation invariant point cloud features through an improved dangerous target detection model, and fusing multi-modal data to generate a dynamic danger level; based on VIO, realizing accurate spatial registration of annotation and a real scene, and generating a self-adaptive annotation style according to a danger level; and multi-device labeling pose synchronization is realized through an entropy weighting ICP algorithm, and labeling transparency and size are dynamically optimized in combination with a user fatigue value and environment illumination. According to the method, the comprehensiveness of danger identification and the accuracy of marking are improved, team collaborative operation is supported, the method is suitable for scenes such as electric power inspection and dangerous chemical transportation, and the operation safety and efficiency are guaranteed.

The invention relates to the technical field of workpiece assembly, in particular to a digital twinning and augmented reality guided man-machine cooperation assembly method and system, and the method comprises the steps: collecting a multi-view image, mechanical arm sensing data and a first person image of AR glasses; fusing the data, generating scene assembly information, and constructing a digital twin model; configuring an operation standard, a standard assembly unit space state and a standard hand action template of each assembly process stage, judging a current assembly process stage, identifying an operation intention, predicting a next process in combination with the current assembly stage and the operation standard, and generating a man-machine instruction and simulation data; three-dimensional action guidance is displayed through AR glasses, a mechanical arm is driven to execute planning actions, and a digital twin interface feeds back the assembly state, precision data and prediction animation in real time. According to the method, man-machine standardized cooperation and high-precision assembly are achieved, pre-stored parameters are adaptive to multi-variety production, and the process consistency is improved through real-time feedback.

The invention relates to the technical field of brain-computer interfaces, in particular to a multi-mode AI glasses vision-electroencephalogram cooperative control method, device and equipment. The method comprises the following steps: constructing a multi-modal data acquisition framework for acquiring a visual scene image and an electroencephalogram signal, generating an alignment data stream to identify a target feature, and generating an attention map; time sequence features are extracted, and intention features are recognized; constructing a feature matrix, performing modal alignment on the feature matrix, performing feature fusion based on an alignment result of modal alignment, and generating a unified representation; performing time sequence segmentation, extracting associated features, constructing a state sequence based on the associated features, marking conversion nodes by using the state sequence, and generating a dynamic mode according to the conversion nodes; performing information analysis by using a dynamic mode, determining a modal weight, performing feature selection based on the modal weight, performing classification mapping on a feature selection result, and generating a control sequence; and generating an interaction instruction according to the control sequence, and completing vision-electroencephalogram cooperative control of the multi-modal AI glasses.

The invention discloses an image processing method and system for intelligent glasses, and relates to the technical field of image recognition. The method comprises the following steps: synchronizing and preprocessing data collected by heterogeneous sensors in the intelligent glasses; constructing a global space-time coordinate system; a high-risk area is determined through dynamic saliency analysis, a high-resolution detection ROI is generated, full-pixel analysis is performed on a focus area, and an obstacle list with 3D positions, categories and danger levels is output; and generating a personalized safety path through a safety corridor generation algorithm based on the 3D position of the obstacle, the motion model of the visually impaired person and the real-time position. Data collected by heterogeneous sensors in the intelligent glasses are synchronized, a global space-time coordinate system is constructed, path planning is performed after obstacles are identified, high-frequency IMU angular velocity data and a self-adaptive optical flow correction network are fused, the image reverse compensation precision in a dynamic scene is improved, and navigation safety in a complex scene is guaranteed.

The invention relates to a visual transformer substation intelligent inspection system and method based on a multi-mode large language model, and belongs to the technical field of power system intelligence. The system obtains image, temperature, vibration and noise data of substation equipment in real time through a multi-modal data acquisition module, and performs preprocessing and fusion. A high-precision three-dimensional semantic model is constructed by using a three-dimensional dynamic modeling module, and the device attributes are automatically labeled by fusing LLM semantic understanding capability. A multi-modal large language model (LLM) engine is combined with cross-modal feature extraction, a dynamic knowledge base and a self-adaptive reasoning unit to realize accurate diagnosis of equipment faults. An augmented reality (AR) interaction module displays the real-time state of equipment through AR glasses and supports natural language interaction. The self-interpretation decision support module generates interpretable fault reports and maintenance suggestions, and the communication and feedback module is responsible for data uploading and remote alarm. According to the method, multi-dimensional perception, dynamic knowledge reasoning and self-adaptive decision support of the equipment state are realized, the intelligent level of substation inspection is remarkably improved, the inspection efficiency is improved by more than 40%, the omission ratio is reduced to less than 1%, and rapid diagnosis of more than 95% of novel faults is supported.

The invention discloses an AR glasses control system and method, and belongs to the field of artificial intelligence and AR glasses application, and the method comprises the steps: capturing a user face image, combining a voice assistant, collecting user voiceprint data, and carrying out the matching through a recurrent neural network; constructing a three-dimensional environment model, positioning and marking obstacles and interactive objects, and identifying objects in the environment; the method comprises the following steps of: tracking a gesture, acquiring a key point coordinate by adopting an OpenPose algorithm, identifying a predefined gesture by utilizing a support vector machine, and mapping the gesture into a specific operation instruction; analyzing the user intention based on natural language processing, and calling a corresponding function module according to an analysis result; acquiring a gazing direction of a user by using an eye movement tracking sensor, calculating a screen focus position through an algorithm, and dynamically highlighting options or displaying information according to a gazing point position; through multi-modal data fusion, gestures, voices and fixation point input are analyzed in a unified manner. By accurately understanding the intention of the user, the interaction precision of the AR glasses is improved, and the user experience is optimized.

The invention belongs to the technical field of project management and intelligent supervision, and discloses a project cost accounting management method and system for project supervision, and the method comprises the steps: inputting a preprocessing data packet into an edge calculation node, carrying out the dynamic data cleaning through employing a noise filtering matrix algorithm, and outputting a structured data set with a quality label; on the basis of the structured data set with the quality label, scanning a construction part through augmented reality glasses, comparing actual coordinates with building information model design coordinates in real time, and when a deviation accumulated value exceeds an early warning threshold value, generating an acceptance evidence chain which cannot be tampered; and accumulating the incremental cost of the plurality of standardized visa file packages, carrying out time sequence analysis through a long-short term memory prediction model, and outputting a project cost analysis report with a risk level. The problem of loss of acceptance evidence chains in traditional cost accounting is solved, and the strong dependence of a conventional prediction model on data distribution is broken through.

The invention relates to the technical field of computers, and discloses an interaction control method of intelligent glasses. The method comprises the following steps: synchronously acquiring multi-modal data such as eye movement, voice, gestures and head postures and environment and application context information; carrying out independent time sequence feature coding on each modal data; generating a modulation vector in combination with the context, and outputting probability distribution of user intentions through a cross-modal attention fusion network; and a unique execution instruction is determined through an instruction arbitration module based on rules and a state machine. The system comprises corresponding function modules. According to the method, the accuracy, robustness and naturalness of interaction are improved through multi-modal synchronous fusion and a context self-adaption mechanism.

A near-to-eye display system (1) and AR glasses (3). The near-to-eye display system (1) comprises an optical waveguide module (10), an optical engine module (20) and a metalens assembly (22). A first in-coupling grating region (111) and a first out-coupling grating region (112) are formed in the optical waveguide module (10). The optical engine module (20) comprises a light source assembly (21), which is arranged opposite the first in-coupling grating region (111), and the metalens assembly (22), which is arranged between the light source assembly (21) and the optical waveguide module (10), wherein the light source assembly (21) is used for outputting image optical signals to the metalens assembly (22), the image optical signals comprising at least two types of optical signals of different attributes, and the attributes comprising at least one of a wavelength, an emission angle and an emission position. The metalens assembly (22) comprises a substrate (221) and a metasurface structure (222) on the substrate (221), wherein the metasurface structure (222) is configured to receive the image optical signals and diffract the optical signals to the first in-coupling grating region (111). The optical signals which have the same emission position have the same diffraction angle. Thus, the volume and weight of a lens of the optical engine module (20) are reduced, and the design requirements for high image quality and a large field of view are also met.

The invention discloses an AR glasses blogger live video anti-shake processing method and processing system, and the method specifically comprises the steps: carrying out the calculation based on an original video stream and equipment motion data, and generating a preliminary stable frame sequence; based on the preliminary stable frame sequence, marking a key semantic region as a strong stability demand region, and segmenting a foreground main body and a background region; performing fine stabilization on the strong stability demand area and the foreground main body by applying non-rigid transformation, performing stabilization on the background area by applying rigid transformation and retaining the depth of the scene, and obtaining a frame sequence after partition correction; predicting a future multi-frame equipment motion track based on the frame sequence after partition correction, the equipment motion data and the segmentation information of the foreground main body / background region; and calculating and executing prospective canvas motion compensation in advance based on the future multi-frame equipment motion trail and the segmentation information of the foreground main body / background region. According to the invention, efficient anti-shake processing of the live video of the AR glasses is realized, and the stability of the live picture and the user experience are effectively improved.

The invention discloses a remote cooperation method and device based on a polymorphic large model, electronic equipment and a storage medium, and relates to the technical field of computers. The method comprises the following steps: acquiring a visual field video stream of a production field and voice data inquired by field personnel, wherein the visual field video stream is acquired by AR glasses worn by the field personnel in real time; analyzing the view video stream to obtain first record content; extracting character information in the voice data, and matching the character information with a pixel position of a target object to obtain second record content; and inputting the first record content and the second record content into a pre-trained polymorphic large model, generating multimedia summary response content, and feeding back the multimedia summary response content to a user terminal of the field personnel, and enabling the field personnel to perform field inspection according to the multimedia summary response content displayed by the user terminal. The remote cooperation efficiency can be improved.

The invention discloses an intelligent blind guiding glasses system based on a multi-mode large language model. The intelligent blind guiding glasses system comprises an image acquisition module, a voice acquisition module, a large language model module, a bone conduction sound transmission module, a navigation path planning module, a central processor module and a wireless communication module, the image acquisition module is used for acquiring a three-dimensional image of a front scene and providing three-dimensional space information; the voice acquisition module is used for acquiring a voice instruction of a user; the big language model module is used for generating character answers and converting the character answers into voice according to the voice instruction of the user by utilizing a big language model; the bone conduction sound transmission module is used for receiving and playing the voice generated by the large language model module; the navigation path planning module is used for planning a navigation path according to the user position and the destination; the functions of navigation positioning, line guiding, voice prompting and the like are provided for the blind, the glasses are adopted as a carrier, carrying is convenient, voice awakening and other instructions are adopted to replace keys, operation is easy, and practicability is high.

The invention discloses an intelligent interaction control method for AI glasses, and relates to the technical field of AI glasses, and the method comprises the following steps: synchronously collecting user input signals and environmental parameters through a multi-source sensor group built in the glasses, the sensor group at least comprising an IMU, a binocular camera, a microphone array and a physiological sensor; carrying out real-time fusion processing on the multi-modal input data by adopting a lightweight neural network to generate an interaction intention feature vector; based on real-time detection results of environmental noise intensity and illumination conditions, dynamically distributing weight coefficients of all interaction modes; generating a hierarchical response instruction according to the weight coefficient and a confidence threshold; and continuously optimizing the personalized interaction strategy of the user through a federal learning framework. According to the AI glasses intelligent interaction control method, through multi-modal weighted fusion, edge AI acceleration and federated learning optimization, the interaction success rate in a complex environment is improved to 93.6%; the end-to-end delay is controlled within 28ms; and a user-defined interaction strategy is supported.

The disclosure relates to augmented reality devices based on a curved waveguide. An augmented reality device is provided. The augmented reality device includes a projection system to project an undistorted image, an input optical compensator located on the path of light rays out-coupled from the projection system, a curved waveguide comprising an input diffractive optical element and an output diffractive optical element. The output diffractive optical element performs the function of an output optical compensator that converts the light beams of a distorted image at the output of the waveguide into parallel light beams to output an undistorted image. Augmented reality glasses comprising an augmented reality device are also proposed. There is provided the ability to project a virtual image without aberrations, distortions and doubling of the image.

The invention discloses an application development method, an application development device and XR equipment, and relates to the technical field of augmented reality, and the method comprises the steps: receiving a preset XR scene component dragged by a user to an XR scene template through a visual editor; in response to a user request, calling an AIGC model to generate an XR content material, and inserting the XR content material into a specified position of a current XR scene; and receiving the configuration of the user on the interaction logic, converting the current XR scene and the interaction logic into an executable format of the target XR glasses through the adaptation layer, and outputting an application package adaptive to the target XR glasses. Visual development and AIGC automatic content generation are combined, so that the XR content creation threshold is reduced, the development efficiency is improved, and diversified application scenes are supported.

The invention discloses a far-field imaging system, a metasurface grating and an imaging terminal, and relates to the technical field of image generation. Dynamic environment compensation and imaging quality optimization are realized through cooperation of multiple modules of the system: the environment temperature is read in real time, the refractive index of the metasurface grating is corrected according to a pre-stored mapping relation, and a target wavefront function is constructed and dispersed to obtain an initial phase distribution matrix; dividing a focusing area in combination with a user sight line, and compensating and regulating a phase distribution matrix by voltage gradient; based on the divided buffer and background regions, a multi-region sampling rate is configured to generate a mask, and the collection efficiency of the key region is improved; monitoring far-field information change in real time, and selecting an interpolation or total variation strategy to update the image; by means of image definition feedback, a secondary phase correction term is superposed to optimize a phase distribution matrix; the problems of traditional far-field imaging in the aspects of environment adaptation, dynamic focusing, data acquisition and imaging quality are solved, and the method is suitable for augmented reality glasses and the like.

The invention relates to the technical field of computer graphics and virtual reality, and discloses a meta-universe social space generation method and system. The method comprises the following steps: acquiring multi-modal input data of a user and constructing an intention vector; extracting social relation characteristics based on the intention vector, and generating a multi-dimensional scene constraint condition; generating a three-dimensional virtual environment and optimizing a topological structure by adopting a generative adversarial network according to a scene constraint condition; and fusing the scene data with the user social behavior data, and outputting a multi-terminal interactive rendering result. The system comprises a data acquisition and intention modeling module, a scene constraint mapping and environment generation module and a fusion rendering and interactive output module. According to the invention, multi-user immersive social space interaction can be realized on the VR head-mounted display, the AR glasses and the mobile terminal, and the method has the advantages of low delay, high simulation degree and cross-platform synchronization.

The invention relates to the technical field of brain-computer interfaces, in particular to an electroencephalogram signal feature extraction and dimension reduction method, device and equipment for intelligent glasses. The method comprises the steps that an electroencephalogram signal data set is acquired, time domain, frequency domain and time-frequency domain features are extracted, and an original feature set is generated; decomposing each feature vector in the original feature set to obtain a feature atom set, and based on the feature atom set, performing atomic-scale recombination on each feature vector in the original feature set to generate a recombined feature set; calculating a kernel matrix corresponding to the recombined feature set, mapping the kernel matrix to a high-dimensional kernel space, and performing principal component analysis according to the original feature set to obtain a kernel principal component projection matrix; and projecting the feature set to a low-dimensional space by using a kernel principal component projection matrix, and generating low-dimensional nonlinear feature representation in combination with the electroencephalogram signal data set to complete electroencephalogram signal feature extraction and dimensionality reduction of the intelligent glasses. And multi-scale characteristic decomposition and analysis domain division are realized.

The invention discloses a system for enhancing teleoperation welding process immediacy sense, which comprises a welding workbench for placing a weldment; the welding limb consists of a welding robot and a binocular vision camera fixed at the tail end of the welding robot; a welding gun is fixed at the tail end of the welding robot; the viewing limb consists of an auxiliary monitoring robot and two sets of molten pool vision cameras fixed at the tail end of the auxiliary monitoring robot; the tactile force feedback device is used for achieving action mapping between an operator and the welding robot and controlling the welding robot, the binocular vision camera, the molten pool vision camera and the VR glasses to be connected with the computer through teleoperation, and the computer converts pictures shot by the binocular vision camera into three-dimensional pictures to be displayed. Transmitting the data to the virtual reality glasses; and the virtual reality glasses are used for an operator to determine the arc starting position according to the displayed picture to carry out welding operation. The problem that teleoperation telepresence sense of welding operation is insufficient can be solved.

Systems, apparatus, and methods for a gesture-based augmented reality and / or extended reality (AR / XR) user interface. Conventional image processing scales quadratically based on image resolution. Processing complexity directly corresponds to memory size, power consumption, and heat dissipation. As a result, existing smart glasses solutions have short run-times (<1 hr) and may have battery weight and heat dissipation issues that are uncomfortable for continuous wear. The disclosed solution provides a system and method for low-power image processing via the use of scalable processing. In one specific implementation, gesture detection is divided into multiple stages. Each stage conditionally enables subsequent stages for more complex processing. By scaling processing complexity at each stage, high complexity processing can be performed on an “as-needed” basis.

The invention relates to the technical field of panoramic projection systems, in particular to an intelligent XR multi-mode interactive exhibition stadium panoramic projection system, which comprises an intelligent data terminal, a display interaction module in communication connection with the intelligent data terminal, a VR terminal comprising a user client, an action capture card and virtual reality glasses, an intelligent service background connected with the VR terminal through a network, and a display interaction module in communication connection with the intelligent data terminal. Comprising an action data processing module used for acquiring action and position data from an action capture card and decoding and processing the data; the virtual reality module is used for updating a virtual scene according to the action data; the data communication and control module is used for performing data communication with the VR terminal and controlling the display screen; the panoramic projection display system comprises a plurality of projectors and is used for forming a curved screen or a spherical screen in an exhibition hall; determining the content projected to the display screen according to the real-time action position of the user; the user experience is greatly improved, and the exhibition information transmission efficiency can be effectively improved.

An embodiment of an image recording apparatus includes an eyeglass frame, at least one first optical unit disposed on the eyeglass frame for capturing a main scene image, and at least one second optical unit disposed on the eyeglass frame for capturing an auxiliary scene image. The first and the second field of view of the user at least partially overlap. The image resolution of the main scene image is lower than the image resolution of the main scene image and the field of view of the main scene image is larger than the field of view of the auxiliary scene image. The image recording apparatus further includes at least one processor for receiving the main and the auxiliary scene images, and generating a modified resolution copy of the main scene image based on the auxiliary scene image.

The invention discloses a blogger live video AR glasses scenery labeling method and labeling system, and the method specifically comprises the steps: dynamically adjusting a knowledge graph retrieval strategy of a tourism live scene through a hot topic set and an emotion classification result, and obtaining a dynamic retrieval result; the method comprises the following steps: acquiring blogger head posture data based on an IMU (Inertial Measurement Unit) of AR (Augmented Reality) glasses, and constructing a 3D spatial topological map of a tourism live scene through an SLAM (Simultaneous Localization and Mapping) algorithm Spatial registration is carried out on the dynamic retrieval result and the 3D spatial topological map, and a scene enhancement labeling layer is generated through a NeRF algorithm; and displaying the video stream and the scene enhancement annotation layer in an overlapping manner, and dynamically adjusting the annotation visibility by adopting a self-adaptive transparency algorithm. According to the method, the video stream and the interaction data stream are collected in real time, dynamic annotation of the scene content of the AR glasses is achieved, live broadcast scene changes and audience interaction requirements can be responded in time, and the real-time performance and accuracy of live broadcast annotation are improved.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

The invention relates to the technical field of sign language intelligent communication, in particular to a deaf-mute sign language translation pronunciation system which comprises a data acquisition and preprocessing module, a sign language model recognition module, a dynamic gesture model module and a voice conversion module. According to the sign language translation pronunciation system for the deaf-mute, wide-angle camera intelligent glasses are adopted for visual collection, wearable equipment is not needed, video streams and thermodynamic diagrams are combined, visual information and key point probability distribution are complementary, the influence of single-mode noise is reduced, video space-time features are extracted through a 3D CNN, long-range dependence is captured in combination with a self-attention mechanism of Transform, and therefore the sign language translation pronunciation system for the deaf-mute is obtained. The sign language recognition precision is improved, an internal reference matrix and a distortion coefficient are calculated through a calibration board, wide-angle lens distortion is corrected, it is ensured that hand key points are accurately positioned, YOLOv8 is adopted to segment an interference object, background noise is prevented from affecting recognition, 21 key point thermodynamic diagrams are generated through MediaPipe, fault tolerance of low-confidence-coefficient key points is enhanced through Gaussian kernel diffusion, and the recognition accuracy is improved. And the model identification precision is improved.

The invention discloses an intelligent management and control system and method for AI glasses, and the system comprises an environment sensing layer which integrates a millimeter-wave radar, an infrared sensor and a UWB positioning module, and senses the information of the environment where the AI glasses are located; the biological characteristic layer is used for authenticating the identity of the user by adopting an iris recognition and gait analysis composite authentication mode; the strategy engine layer comprises a dynamic permission matrix, a compliance rule base and a risk prediction model, and formulates and executes a corresponding control strategy according to environment perception information and a biological characteristic authentication result; the data protection layer is composed of a trusted execution environment and a federated learning framework and is used for guaranteeing the data security in the AI glasses system; and the man-machine interaction layer is provided with a tactile feedback and bone conduction alarm device, interacts with a user and provides alarm information. Through cooperative work of the layers, comprehensive, intelligent and safe management and control of the AI glasses are realized, so that the AI glasses can stably operate in various complex environments, and more reliable services are provided for users.

The invention relates to the technical field of image processing, in particular to a dynamic privacy covering intelligent glasses image processing system which comprises a multi-mode sensing layer, a target detection module, a real-time covering layer and a self-adaptive adjustment module. Compared with the prior art which depends on a single timestamp or rough registration to cause the problems of insufficient space-time alignment precision, high probability of accumulative errors caused by multi-coordinate system conversion and single feature extraction mode, the method has the advantages that the synchronization precision is improved to a millisecond level and a sub-pixel level through a space-time alignment strategy of IMU (Inertial Measurement Unit) and visual feature fusion; constructing a unified coordinate conversion model based on internal reference and external reference, and eliminating heterogeneous errors of multiple sensors; a multi-modal fusion framework of thermal imaging biological characteristics, YOLOv5s-T target detection and Places365 environmental semantics is innovatively adopted, so that the target recognition rate in a complex scene is improved, the environmental adaptation efficiency is improved, meanwhile, the low-delay characteristic is kept, and leap-type improvement from accurate perception to intelligent analysis is achieved through sensor coupling calibration and multi-characteristic cooperation.

The invention relates to the field of intelligent glasses, and provides an image information acquisition method and device, intelligent glasses and a storage medium, and the method comprises the steps: obtaining an image view finding instruction; determining view-finding range information according to the image view-finding instruction, wherein the view-finding range information is used for indicating a view-finding area and a non-view-finding area in a view field range of the intelligent glasses; adjusting the light transmittance of the intelligent glasses lens based on the view-finding range information, so that the first light transmittance of the intelligent glasses lens and a first area corresponding to the view-finding area is greater than the second light transmittance of the intelligent glasses lens and a second area corresponding to the non-view-finding area; and obtaining target image information corresponding to the view finding area based on the image information obtaining instruction. The intelligent glasses display the view-finding area and the non-view-finding area in the view field range based on different light transmittances, so that a user can simply and visually distinguish the view-finding range of the camera of the intelligent glasses, the user can clearly know the picture captured by the camera, and the user experience of the intelligent glasses for image shooting is improved.