692 results about "EyeTap" patented technology

The invention relates to the technical field of computers, and discloses an interaction control method of intelligent glasses. The method comprises the following steps: synchronously acquiring multi-modal data such as eye movement, voice, gestures and head postures and environment and application context information; carrying out independent time sequence feature coding on each modal data; generating a modulation vector in combination with the context, and outputting probability distribution of user intentions through a cross-modal attention fusion network; and a unique execution instruction is determined through an instruction arbitration module based on rules and a state machine. The system comprises corresponding function modules. According to the method, the accuracy, robustness and naturalness of interaction are improved through multi-modal synchronous fusion and a context self-adaption mechanism.

The invention relates to the technical field of computer graphics and virtual reality, and discloses a meta-universe social space generation method and system. The method comprises the following steps: acquiring multi-modal input data of a user and constructing an intention vector; extracting social relation characteristics based on the intention vector, and generating a multi-dimensional scene constraint condition; generating a three-dimensional virtual environment and optimizing a topological structure by adopting a generative adversarial network according to a scene constraint condition; and fusing the scene data with the user social behavior data, and outputting a multi-terminal interactive rendering result. The system comprises a data acquisition and intention modeling module, a scene constraint mapping and environment generation module and a fusion rendering and interactive output module. According to the invention, multi-user immersive social space interaction can be realized on the VR head-mounted display, the AR glasses and the mobile terminal, and the method has the advantages of low delay, high simulation degree and cross-platform synchronization.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

The invention discloses a VR panoramic glasses data synchronization and transmission method based on multi-sensor fusion, and relates to the technical field of computer network and multimedia real-time transmission. Time alignment and unified modeling are carried out on various sensor data such as eye movement, inertia measurement, gestures and environment through extended Kalman filtering; a user head position, a posture, a sight line direction and a gesture action are coded into a single user behavior vector, so that a subsequent system does not face original sensor streams with different formats any more, but makes a decision based on a behavior space with a clear structure, thereby remarkably reducing posture jitter and sight line deviation accumulative errors; a long short-term memory network is introduced to carry out time sequence modeling on behavior vectors and environment contexts, interactive hotspot areas in a virtual scene are predicted, and hotspot distribution is mapped into priority weights of different data streams, so that sensor streams related to fast actions in areas near a sight line can still obtain a relatively high service level when the bandwidth is insufficient.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto user's retina based on pupil position and size. The glasses comprise frame, lenses with directed pixel layers, sensors for tracking pupil movement. Each directed pixel generates multiple virtual pixels by rapidly changing its emission angle. Each directed pixel with pupil's real-time tracking, provides automatic adjustments to virtual contents, ensuring accurate alignment of images with field of view of users while identifying vergence-accommodation conflict. The glasses function as prescription lenses, virtual reality displays, augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, connectivity to peripheral devices. The glasses enable seamless blend of virtual and real-world experiences, creating immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

The invention discloses infrared night vision AR (Augmented Reality) intelligent glasses based on multispectral fusion, and relates to the technical field of infrared intelligent application. High-precision scene perception in a low-light / light-free environment is realized by fusing dual-channel data of low-light imaging and infrared thermal imaging and combining cross-modal feature matching and dynamic pose compensation; an environment detail structure is restored by a low-light image enhancement technology, thermal feature targets such as organisms are accurately recognized through thermal imaging target segmentation, and a three-dimensional environment model with space geometric information and target attributes is constructed through heterogeneous feature fusion; and dynamically adjusting the display transparency of the key target in the AR view field through a virtual information layer adaptive mixing mechanism driven by a hot target attribute, and finally outputting a virtual-real fused enhanced view, thereby breaking through the illumination limitation of the traditional AR glasses, and improving the visual effect of the AR glasses. And immersive augmented reality experience with panoramic detail perception and hot target accurate positioning is provided for the user in a dark environment.

The invention belongs to the technical field of data processing and analysis, and particularly relates to a geomagnetic and inertial navigation fused glasses guide direction identification and content triggering system, which comprises a sensing compensation component, a calculation storage component, a guide resource component and a display component, the sensing compensation assembly comprises an inertial measurement unit, a geomagnetic sensor, an active magnetic compensation coil and a coil driving module; the calculation storage assembly comprises a control processor and a memory, and the control processor is used for driving the active magnetic compensation coil to obtain a coil compensation geomagnetic vector according to a phase coding zero-returning sequence, executing attitude propagation based on the inertial measurement unit, and executing course updating on the coil compensation geomagnetic vector based on Huber anti-outlier loss to obtain a head attitude. According to the invention, the influence of magnetic disturbance and attitude jitter on direction identification and content triggering can be effectively reduced, and the stability, consistency and practicability of the glasses guide system in a real use scene are improved.

The invention discloses a multi-machine collaborative three-dimensional map updating method based on mobile augmented reality, and belongs to the technical field of three-dimensional reconstruction, and the method comprises the following steps: carrying out the collection of initial collection data of a plurality of target regions through the wearing of AR glasses by a plurality of people; performing frame extraction on the original video image, and calculating to obtain a data grouping result; a sparse pairing list is generated by adopting a hybrid pairing strategy, and sparse point cloud data is obtained by combining incremental SfM calculation; performing distortion removal processing on the frame extraction image, and obtaining pure dense point cloud data through a multi-view solid geometry algorithm, a clustering algorithm and statistical filtering; a triangular mesh model is generated through Poisson surface reconstruction, and a high-precision three-dimensional model is obtained through Markov random field optimization view selection; and constructing a unified space-time reference conversion matrix to obtain a real-time AR visual navigation and map updating result. By adopting the method, the problems that the three-dimensional map is poor in current situation, virtual and real registration is misplaced, the modeling efficiency is low and the precision is insufficient are solved.

The invention provides a blind person navigation assisting method, device and equipment based on AI glasses and a storage medium. The method comprises the following steps: constructing a navigation path between a current position of a user and a destination; according to the image data and the sensing data, determining environment information in a preset range of the navigation path and a real-time pose of the user; generating navigation guidance information according to the environment information and the real-time pose of the user; and converting the navigation guidance information into a spatial audio signal, and carrying out traveling navigation based on spatial audio prompt on the user through the spatial audio signal. According to the method, the navigation guidance information related to the real-time pose of the user is generated by integrating the visual sensing data of the AI glasses, the pose information of the inertial sensor and the navigation path information, and the navigation guidance information is converted into the spatial audio signal for navigation; when the user is separated from the navigation path, the user can be guided to accurately judge the advancing direction through spatial audio prompt, and the appearance safety of the user is improved.

The invention provides a multi-camera-based AI glasses FOV extension method and system, and the method comprises the steps: transmitting a synchronization signal to a plurality of cameras, enabling the plurality of cameras to carry out the exposure at the same time, and obtaining a plurality of frames of original images at the same time; pre-processing the multiple frames of original images to obtain pre-processed images; key feature points of the preprocessed image are extracted through a feature point detection algorithm, and feature descriptors are generated; through a feature matching algorithm, feature point matching is carried out on the adjacent preprocessed images by utilizing the feature descriptors, and a local transformation matrix between the adjacent preprocessed images is calculated; based on the local transformation matrix, fusing the adjacent preprocessed images to obtain a fused image of the adjacent preprocessed images; and all the fused images are spliced to obtain a large-view-field-angle image covering the target view angle, so that the method has the advantages of effectively expanding the shooting view angle, eliminating image distortion and improving the image splicing naturalness.

The invention belongs to the technical field of relay protection practical training and evaluation of a power system, and particularly relates to a relay protection operation coach and evaluation system and method based on AR glasses, and the system comprises an AR intelligent glasses terminal which is worn by an operator and is used for collecting the depth visual flow data of a field environment in real time; an edge computing server which is in communication connection with the AR intelligent glasses terminal and is used for obtaining the visual flow information collected by the AR intelligent glasses terminal, constructing a state sensing model based on a power equipment topological relation and realizing direct semantic level identification of screen cabinet elements; meanwhile, generating a three-dimensional visual operation indicator, a dynamic safety early warning signal and real-time evaluation feedback information, and superposing the three-dimensional visual operation indicator, the dynamic safety early warning signal and the real-time evaluation feedback information in the visual field of the AR intelligent glasses terminal; the cloud management platform is in communication connection with the edge computing server and is used for performing user management, storage and updating of an operation instruction knowledge graph, storage and analysis of historical evaluation data and unified allocation of system resources; the defects of a traditional training and evaluation system are overcome.

The invention discloses a multi-mode cooperation method, device and equipment based on AR glasses and a robot dog, relates to the technical field of augmented reality and intelligent robots, and aims to solve the problem that the cooperative work effect of the AR glasses and the robot dog is poor. The method comprises the following steps: fusing real-time pose point cloud of a robot dog and laser point cloud data of AR glasses through a space matching algorithm to obtain a shared coordinate system; analyzing a multi-modal interaction intention of the user based on the shared coordinate system, generating a robot dog control instruction set, and collecting sensor data of a target space region; rendering the inspection data collected by the robot dog in response to the control instruction set into hierarchical visual data; and based on the risk identifier in the hierarchical visualization data, triggering a linkage response behavior of the robot dog and the AR glasses.

The invention relates to a data interaction system for AI glasses and a smart phone under intelligent scene perception, and relates to the technical field of data interaction, and the system comprises a scene perception module which is used for reading position data, direction data and attitude angle data of the AI glasses and executing scene data initialization of the smart phone; the perception processing module is used for activating a scene perception sensor of the AI glasses and carrying out scene perception; the judgment module is used for executing resource state sensing of the AI glasses and the smart phone and dynamically configuring a sensing task; and the interactive processing module is used for packaging and uploading the low-dimensional scene state vectors identified by the smart phone, and respectively executing scene identification processing. The technical problems that in the prior art, the cooperation efficiency of the AI glasses and the smart phone is low, resource utilization is unbalanced, and the real-time sensing and processing capacity is insufficient in a miscellaneous scene are solved, and the technical effects that efficient cooperation and dynamic load balancing of the AI glasses and the smart phone are achieved, and scene sensing real-time performance and energy efficiency are improved are achieved.

The present application provides a method and apparatus for low-power-consumption and simplified transmission of display data, a medium, a program product, and a terminal. By acquiring image data to be sent, extracting the same one or more types of channel image information from the data on the basis of a display mode of a receiving device and sorting the channel image information according to an extraction order to form a queue to be sent, and finally packing said queue in a preset mode to form a data packet and sending the data packet, the solution improves the flexibility of channel image information extraction, so that a user can select a single channel or multiple channels according to requirements. In addition, by sorting the channel image information according to an extraction order, the transmission efficiency is improved; and by means of a preset packing mode, the integrity and accuracy of data are ensured. In the present application, on the basis of existing MIPI interfaces and protocols, selective data extraction and low bandwidths are used during encoding and transmission by a front-end sender and during back-end decoding to implement efficient and low-power-consumption image data transmission, thereby meeting requirements of wearable devices such as AR glasses and headsets and VR glasses and headsets.

According to the AI glasses-based driver sight tracking and augmented reality early warning system and method provided by the invention, the attention focus of a driver is monitored in real time through deep fusion of a high-precision eyeball tracking technology and an AR display technology, and correlation analysis is carried out on the attention focus and environmental perception data of an intelligent driving system, so that the driver sight tracking and augmented reality early warning effect is improved. When a driver is found to be invisible to a key dangerous target, the attention of the driver can be actively and accurately guided, and key safety information is ensured to be effectively received and confirmed, so that the man-machine cooperation efficiency and the driving safety are remarkably improved. The problems that an existing early warning system is not visual in information transmission and cannot confirm whether a driver really receives information or not are solved, the driving safety and the man-machine interaction efficiency are remarkably improved through a closed-loop vehicle perception-driver cognition-danger confirmation mechanism, and more accurate, more visual and more efficient driving safety early warning is achieved.

The invention provides AI intelligent glasses which comprise a glasses body, a hardware system and a software system, the hardware system comprises a main control chip, a camera module, a microphone array, a loudspeaker, a display module, a communication module and a power supply module, and the software system comprises an image processing module, a visual analysis module and a semantic generation and multi-language module which are integrated on the main control chip. The system integrates visual AI, natural language processing, AR interaction and other technologies in an interdisciplinary manner, has the functions of image recognition, attribute analysis, knowledge reasoning, language generation and multi-language translation, realizes intelligent perception of any object in the real world, and enhances the understanding ability of a user for unknown objects; edge reasoning and real-time voice feedback are supported, the interaction efficiency is improved, and the intelligence and adaptability of visual auxiliary equipment are improved; the modular design is convenient to adapt to different languages and application scenes, and can be widely applied to scenes such as tourism, education, medical treatment and industry.

A machine learning model is constructed by machine learning based on image data that is obtained by imaging each portion provided in a substrate processing device and sound data of sounds emitted when the portions operate. As the sound data, both the data of a normal sound that is emitted when each portion operates normally and the data of an abnormal sound that is emitted when each portion is abnormally operated are collected. When abnormality detection is performed, an eye tracking function identifies a position that is being viewed by a worker wearing smart glasses in which a machine learning model is installed. An image of a region including the identified viewed position is captured, and a sound is collected in a state in which the worker is viewing the viewed position. The collected image data and sound data are input into the machine learning model.

The invention discloses a metering detection intelligent glasses system integrating artificial intelligence visual identification and a cloud platform, and relates to the technical field of computer software, the metering detection intelligent glasses system comprises an intelligent glasses driving module and adaptive hardware, and has the functions of dynamic scheduling, multi-thread processing, communication self-adaption and non-lagging AR rendering; the AI visual identification module supports batch identification, fine defect detection, off-line operation and incremental learning by using a lightweight model; the cloud platform software framework module adopts a distributed micro-service framework to realize data partition storage, real-time parallel analysis and the like and elastic capacity expansion and contraction; the interaction control module develops a multi-mode program and supports batch instructions and the like; and the system collaboration module realizes multi-module scheduling based on event driving, and ensures efficient collaboration of the whole detection process. According to the method, the precision, efficiency and environmental adaptability of measurement detection are remarkably improved, the batch processing capacity and the network fluctuation coping capacity are greatly enhanced, and efficient and reliable software support is provided for measurement detection.

A gaming system comprising at least one transparent display where at least two gamers are standing on opposite sides of the display. The first gamer is wearing a first pair of filtering glasses that limit the first gamer to seeing only a first stream A of images comprising video being emitted by the transparent display. The second gamer is wearing a second pair of filtering glasses that limit the second gamer to seeing only a second stream B of images comprising the emitted video. Each gamer perceives different augmentations of the opposing player as the game is operated causing the video comprising the A and B streams. The system further comprises an additional display functioning like the first display but separated to form an interior corridor, where a projector is running on rails within the corridor to create a movable ghost image via a pepper's mill apparatus.

1. Name of the product in this design: AR Host Box (BB). 2. Purpose of this design: For use in the main unit of AR glasses. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

The invention relates to a near-to-eye display optical system based on a laser light source and an LCOS modulation module, and belongs to the technical field of near-to-eye display. The invention aims to solve the technical problems that the existing near-to-eye display scheme is difficult to overcome speckle noise, chromatic dispersion, low luminous efficiency, overlarge size and the like at the same time. The system sequentially comprises a multi-mode laser light source module used for emitting low-initial speckle contrast imaging laser beams; the optical preprocessing module comprises a collimating lens group, a beam expanding prism and a phase perturber; the LCOS modulation module is used for simultaneously carrying out amplitude modulation on the light beam according to the image signal so as to load an image and carry out phase modulation so as to adjust wavefront, and reflecting and outputting an image light beam; the coupling module is used for carrying out light path coupling on the image light beam; and the near-to-eye display module is used for transmitting and projecting an image to human eyes. The system is mainly suitable for augmented reality glasses and other head-mounted display devices, and can realize high-image-quality and miniaturized near-to-eye imaging.

The application provides a control method and device of smart glasses and the smart glasses, and relates to the technical field of smart glasses. The control method of the smart glasses comprises the following steps: acquiring deformation data of a glasses frame, and determining a corresponding actual combined image distance based on the deformation data; determining a corresponding target projection image based on the actual combined image distance, so that the combined image distance corresponding to the target projection image is at a preset combined image distance. The application acquires the deformation data of the glasses frame, determines the actual combined image distance corresponding to the deformation data, determines the corresponding target projection image, so that the combined image distance corresponding to the target projection image is at the preset combined image distance, realizes offset compensation of the offset pixels of the smart glasses, optimizes the display effect, and enables the projection image to be completely presented when the head size of a user is large or small.

The invention belongs to the technical field of intelligent equipment, and particularly relates to four-camera AI intelligent glasses which comprise a glasses frame, glasses legs, and a first camera and a second camera which are used for shooting original images, and further comprise built-in chips installed in the glasses legs, and the built-in chips comprise data input interfaces which are used for connecting the first camera and the second camera; the encoder extracts a first feature in the original image through a CNN (Convolutional Neural Network); the aggregation module is used for aggregating the first features through an attention mechanism and outputting global features; the first decoder is used for aggregating into a panoramic image according to the global features in combination with the spatial tensor; and the angle correction module is used for monitoring the bending angle of the glasses leg. According to the invention, after a plurality of angle images are acquired by different cameras, time alignment is carried out to synthesize the panoramic image, different decoders are learned to be configured for the different angle images to realize adaptive updating, and an alarm is given when deformation reaches a fatigue limit or a bending angle limit.

An image processing device includes at least one processor (40), in which in a case in which, for at least one image of a real image visually recognized by a user through a transmission unit (20L, 20R) of a glasses-type information display device or a projected image projected onto the transmission unit and visually recognized by the user, a visibility change unit (28) that changes visibility by the user changes visibility of the real image, the processor generates an image simulating the real image after the change in visibility from a captured image obtained by imaging a real world with a camera (27) based on at least one of information indicating the change in visibility, model information on the glasses-type information display device, or model information on the camera.

This invention discloses a brain-computer interface (BCI) smart zoom glasses and a visual adaptive adjustment system, relating to the field of smart glasses technology. It includes an EEG signal acquisition module that attaches to the user's head to collect signals, extracts feature vectors after noise reduction, and transmits them to a core control module; a visual environment perception module that collects target and environmental data, generates structured data packets, and transmits them synchronously; a core control module that integrates multi-source data, identifies visual intent, and decides on adjustment parameters; a smart zoom execution module that adjusts the lens focal length and provides closed-loop feedback to calibrate accuracy; a visual adaptive adjustment module that adjusts lens parameters based on the environment and fatigue state; a human-computer interaction module that supports manual operation, status display, and vibration feedback; and a data storage and update module that stores data and iteratively optimizes the model. This invention achieves accurate visual intent recognition through brain-computer interaction; personalized modeling adapts to different user needs, meeting the product development and application requirements of the wearable smart device manufacturing field.

The invention discloses a fruit diameter measuring method, a fruit diameter measuring device, augmented reality glasses and a storage medium, and the method comprises the steps: carrying out the image collection of a to-be-measured fruit based on the augmented reality glasses, and obtaining a current fruit image; the current fruit image is input to a fruit diameter measurement model, a first fruit diameter corresponding to the current fruit image is obtained, and the fruit diameter measurement model is obtained by training a target detection model based on a historical fruit image marked with a historical fruit diameter; determining a second fruit diameter of the to-be-measured fruit according to depth information corresponding to the current fruit image and the first fruit diameter; marking the current fruit image based on the second fruit diameter to obtain a marked fruit image; and displaying the marked fruit image on a display interface of the augmented reality glasses. The method achieves the measurement of the fruit diameter of the to-be-measured fruit according to the current fruit image based on the fruit diameter measurement model, and improves the measurement accuracy of the measurement of the fruit diameter of the to-be-measured fruit.

The embodiment of the application discloses a video display method, a display device, a storage medium and a television. The video display method comprises the following steps: acquiring a target 3D signal, wherein the target 3D signal comprises a left eye frame and a right eye frame; controlling a 3D glasses to cyclically open a left eye lens and a right eye lens; when the left eye frame in the target 3D signal is displayed on a display screen, the 3D glasses is controlled to open the left eye lens; when the right eye frame in the target 3D signal is displayed on the display screen, the 3D glasses is controlled to open the right eye lens; and the opening frequency of the left eye lens and the opening frequency of the right eye lens are equal to half of the current refresh rate of the display screen. On the one hand, the television has a higher refresh rate, supports a larger size display, has a larger visual angle, and thus the 3D visual experience of a user can be improved; on the other hand, a user only needs to wear 3D glasses to better experience the 3D stereoscopic display effect through the television without spending a high cost to purchase a VR hardware device.

The invention relates to the technical field of XR operation, and discloses a WebXR-based panoramic immersive robot teleoperation system and method. The method comprises the following steps: carrying out distortion correction and splicing fusion on original images collected by a double-fisheye lens to obtain a panoramic image frame; encoding the panoramic image frame into a video code stream, transmitting the video code stream to a browser end, and decoding the video code stream at the browser end to obtain a panoramic video texture; mapping the panoramic video texture to the inner surface of a sphere, setting a virtual camera at the center of the sphere, and constructing a panoramic sphere rendering model; and converting the attitude quaternion of the VR head-mounted display into a sight decoupling rotation matrix, performing local GPU rendering on the panoramic sphere rendering model to obtain a real-time visual angle picture, and mapping a rocker shaft value of the gamepad into a control instruction to be sent to a robot dog end. In the whole view angle switching process, vertex transformation and texture sampling are completed at the browser end, no pan-tilt rotation instruction is generated or sent to the robot dog end through the network, and delay is reduced.

The application provides a blind guiding method and system based on real-time interaction and scene recognition, divides a route into path points and path lines, takes an entry point of a path line as a navigation focus, obtains scene information through a camera arranged on glasses, detects a current scene through software, interacts with local software through a button arranged on a blind stick when needed, and is silent for detection in most time, does not interfere with self detection and judgment of a user on a road, and has the advantages of simple structure, convenient use and low cost.