993 results about "EyeTap" patented technology

The invention provides a smart glasses AI voice interaction method, which comprises the following steps: simultaneously acquiring a user gesture image and a voice signal, acquiring a user historical interaction record, extracting key point coordinates and pointing direction information of the gesture image, acquiring hand distance information, generating a gesture motion path, simultaneously extracting frequency spectrum information and an intonation peak value of the voice signal, and generating a gesture motion path; forming a voice beat sequence; extracting a spatial semantic mode of the gesture and voice fusion data, and recognizing a core object of a user pointing instruction according to pointing coordinates of a gesture motion path and an intonation peak value of a voice beat sequence; after the core object pointing to the instruction is recognized, the user intention is determined in combination with the spatial semantic mode and the historical interaction record of the user; and the complete intention analysis result is output to the intelligent glasses display module to execute corresponding operation, and is fed back to the acquisition module to adjust the next capture parameters including the acquisition frequency and the recognition sensitivity, so that the response speed and the accuracy are improved.

The invention relates to a visual transformer substation intelligent inspection system and method based on a multi-mode large language model, and belongs to the technical field of power system intelligence. The system obtains image, temperature, vibration and noise data of substation equipment in real time through a multi-modal data acquisition module, and performs preprocessing and fusion. A high-precision three-dimensional semantic model is constructed by using a three-dimensional dynamic modeling module, and the device attributes are automatically labeled by fusing LLM semantic understanding capability. A multi-modal large language model (LLM) engine is combined with cross-modal feature extraction, a dynamic knowledge base and a self-adaptive reasoning unit to realize accurate diagnosis of equipment faults. An augmented reality (AR) interaction module displays the real-time state of equipment through AR glasses and supports natural language interaction. The self-interpretation decision support module generates interpretable fault reports and maintenance suggestions, and the communication and feedback module is responsible for data uploading and remote alarm. According to the method, multi-dimensional perception, dynamic knowledge reasoning and self-adaptive decision support of the equipment state are realized, the intelligent level of substation inspection is remarkably improved, the inspection efficiency is improved by more than 40%, the omission ratio is reduced to less than 1%, and rapid diagnosis of more than 95% of novel faults is supported.

The invention relates to the technical field of computers, and discloses an interaction control method of intelligent glasses. The method comprises the following steps: synchronously acquiring multi-modal data such as eye movement, voice, gestures and head postures and environment and application context information; carrying out independent time sequence feature coding on each modal data; generating a modulation vector in combination with the context, and outputting probability distribution of user intentions through a cross-modal attention fusion network; and a unique execution instruction is determined through an instruction arbitration module based on rules and a state machine. The system comprises corresponding function modules. According to the method, the accuracy, robustness and naturalness of interaction are improved through multi-modal synchronous fusion and a context self-adaption mechanism.

The invention discloses an AR glasses blogger live video anti-shake processing method and processing system, and the method specifically comprises the steps: carrying out the calculation based on an original video stream and equipment motion data, and generating a preliminary stable frame sequence; based on the preliminary stable frame sequence, marking a key semantic region as a strong stability demand region, and segmenting a foreground main body and a background region; performing fine stabilization on the strong stability demand area and the foreground main body by applying non-rigid transformation, performing stabilization on the background area by applying rigid transformation and retaining the depth of the scene, and obtaining a frame sequence after partition correction; predicting a future multi-frame equipment motion track based on the frame sequence after partition correction, the equipment motion data and the segmentation information of the foreground main body / background region; and calculating and executing prospective canvas motion compensation in advance based on the future multi-frame equipment motion trail and the segmentation information of the foreground main body / background region. According to the invention, efficient anti-shake processing of the live video of the AR glasses is realized, and the stability of the live picture and the user experience are effectively improved.

The disclosure relates to augmented reality devices based on a curved waveguide. An augmented reality device is provided. The augmented reality device includes a projection system to project an undistorted image, an input optical compensator located on the path of light rays out-coupled from the projection system, a curved waveguide comprising an input diffractive optical element and an output diffractive optical element. The output diffractive optical element performs the function of an output optical compensator that converts the light beams of a distorted image at the output of the waveguide into parallel light beams to output an undistorted image. Augmented reality glasses comprising an augmented reality device are also proposed. There is provided the ability to project a virtual image without aberrations, distortions and doubling of the image.

The invention discloses an application development method, an application development device and XR equipment, and relates to the technical field of augmented reality, and the method comprises the steps: receiving a preset XR scene component dragged by a user to an XR scene template through a visual editor; in response to a user request, calling an AIGC model to generate an XR content material, and inserting the XR content material into a specified position of a current XR scene; and receiving the configuration of the user on the interaction logic, converting the current XR scene and the interaction logic into an executable format of the target XR glasses through the adaptation layer, and outputting an application package adaptive to the target XR glasses. Visual development and AIGC automatic content generation are combined, so that the XR content creation threshold is reduced, the development efficiency is improved, and diversified application scenes are supported.

The invention relates to the technical field of computer graphics and virtual reality, and discloses a meta-universe social space generation method and system. The method comprises the following steps: acquiring multi-modal input data of a user and constructing an intention vector; extracting social relation characteristics based on the intention vector, and generating a multi-dimensional scene constraint condition; generating a three-dimensional virtual environment and optimizing a topological structure by adopting a generative adversarial network according to a scene constraint condition; and fusing the scene data with the user social behavior data, and outputting a multi-terminal interactive rendering result. The system comprises a data acquisition and intention modeling module, a scene constraint mapping and environment generation module and a fusion rendering and interactive output module. According to the invention, multi-user immersive social space interaction can be realized on the VR head-mounted display, the AR glasses and the mobile terminal, and the method has the advantages of low delay, high simulation degree and cross-platform synchronization.

The invention discloses a system for enhancing teleoperation welding process immediacy sense, which comprises a welding workbench for placing a weldment; the welding limb consists of a welding robot and a binocular vision camera fixed at the tail end of the welding robot; a welding gun is fixed at the tail end of the welding robot; the viewing limb consists of an auxiliary monitoring robot and two sets of molten pool vision cameras fixed at the tail end of the auxiliary monitoring robot; the tactile force feedback device is used for achieving action mapping between an operator and the welding robot and controlling the welding robot, the binocular vision camera, the molten pool vision camera and the VR glasses to be connected with the computer through teleoperation, and the computer converts pictures shot by the binocular vision camera into three-dimensional pictures to be displayed. Transmitting the data to the virtual reality glasses; and the virtual reality glasses are used for an operator to determine the arc starting position according to the displayed picture to carry out welding operation. The problem that teleoperation telepresence sense of welding operation is insufficient can be solved.

An embodiment of an image recording apparatus includes an eyeglass frame, at least one first optical unit disposed on the eyeglass frame for capturing a main scene image, and at least one second optical unit disposed on the eyeglass frame for capturing an auxiliary scene image. The first and the second field of view of the user at least partially overlap. The image resolution of the main scene image is lower than the image resolution of the main scene image and the field of view of the main scene image is larger than the field of view of the auxiliary scene image. The image recording apparatus further includes at least one processor for receiving the main and the auxiliary scene images, and generating a modified resolution copy of the main scene image based on the auxiliary scene image.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

The invention discloses a VR panoramic glasses data synchronization and transmission method based on multi-sensor fusion, and relates to the technical field of computer network and multimedia real-time transmission. Time alignment and unified modeling are carried out on various sensor data such as eye movement, inertia measurement, gestures and environment through extended Kalman filtering; a user head position, a posture, a sight line direction and a gesture action are coded into a single user behavior vector, so that a subsequent system does not face original sensor streams with different formats any more, but makes a decision based on a behavior space with a clear structure, thereby remarkably reducing posture jitter and sight line deviation accumulative errors; a long short-term memory network is introduced to carry out time sequence modeling on behavior vectors and environment contexts, interactive hotspot areas in a virtual scene are predicted, and hotspot distribution is mapped into priority weights of different data streams, so that sensor streams related to fast actions in areas near a sight line can still obtain a relatively high service level when the bandwidth is insufficient.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto user's retina based on pupil position and size. The glasses comprise frame, lenses with directed pixel layers, sensors for tracking pupil movement. Each directed pixel generates multiple virtual pixels by rapidly changing its emission angle. Each directed pixel with pupil's real-time tracking, provides automatic adjustments to virtual contents, ensuring accurate alignment of images with field of view of users while identifying vergence-accommodation conflict. The glasses function as prescription lenses, virtual reality displays, augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, connectivity to peripheral devices. The glasses enable seamless blend of virtual and real-world experiences, creating immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

The invention provides a surgical anatomy monitoring method and system based on AR glasses, and relates to the technical field of augmented reality, and the method comprises the steps: obtaining medical knowledge data through augmented reality equipment, and generating a digital data set containing a three-dimensional model, a text and a two-dimensional image; acquiring real-time image data from the surgical site, extracting corresponding anatomical structure data, and generating a three-dimensional model data set; presenting the three-dimensional model data set through augmented reality equipment, and superposing the surgical operation guidance data to generate an interactive display result; and receiving a voice control instruction, adjusting the three-dimensional model data set or the surgical operation guidance data, and generating adjusted display content. According to the method, the shielded organ structure in the image data can be analyzed, a complete anatomical structure is generated by combining database inference, and related information is automatically labeled. According to the system, by integrating medical knowledge, the augmented reality technology and image recognition analysis, visual and accurate visualization assistance is provided for an operation, and the operation precision and the teaching effect are improved.

The invention discloses infrared night vision AR (Augmented Reality) intelligent glasses based on multispectral fusion, and relates to the technical field of infrared intelligent application. High-precision scene perception in a low-light / light-free environment is realized by fusing dual-channel data of low-light imaging and infrared thermal imaging and combining cross-modal feature matching and dynamic pose compensation; an environment detail structure is restored by a low-light image enhancement technology, thermal feature targets such as organisms are accurately recognized through thermal imaging target segmentation, and a three-dimensional environment model with space geometric information and target attributes is constructed through heterogeneous feature fusion; and dynamically adjusting the display transparency of the key target in the AR view field through a virtual information layer adaptive mixing mechanism driven by a hot target attribute, and finally outputting a virtual-real fused enhanced view, thereby breaking through the illumination limitation of the traditional AR glasses, and improving the visual effect of the AR glasses. And immersive augmented reality experience with panoramic detail perception and hot target accurate positioning is provided for the user in a dark environment.

The invention relates to the technical field of crossing of augmented reality and intelligent manufacturing, and provides an intelligent assembly guiding and real-time quality inspection method and system for a narrow space. According to the method, multiple sensors are arranged in AR glasses to collect narrow space environment data in real time, high-precision matching of a virtual model and a real environment is realized based on a point cloud registration technology, and a dynamic assembly guide animation is generated; after the process is completed, triggering a quality inspection instruction through an AR interface gesture, and automatically shooting an assembly result by a depth camera carried by a mechanical arm; performing real-time feature comparison by adopting a deep learning algorithm to generate a visual detection report; and when the assembly deviation is detected, the system immediately provides error correction guidance on an AR interface and automatically restarts current process guidance to form an'operation-quality inspection-error correction 'real-time closed loop. The method effectively solves the technical problems that in narrow space assembly, blind area operation difficulty is large, quality verification lags behind, and the rework rate is high.

The invention provides a stadium scenic area intelligent explanation, guide and question-answering system based on multi-modal interaction, which belongs to the technical field of intelligent text travel and artificial intelligence and comprises a database operation system, an information request and response module, a multi-modal interaction agent, a front-end interface / peripheral device for user interaction and a user information management module. The method has the advantages that a multi-level database is constructed to collect and update data, scenic spots can be accurately positioned and matched, the multi-mode interaction agent supports voice, image and text input, personalized explanation is achieved in combination with user behavior habits, the intelligent glasses end and the mobile phone application end of a front-end interface work cooperatively, data interaction is achieved, and user experience is improved. The user information management module has card punching and sharing functions, and the system is additionally provided with user gesture recognition and off-line working functions, so that the system has the advantages of accurate and real-time data, accurate positioning, good interactive experience, strong individuation, stable operation, convenient sharing and the like, and the service quality of guide explanation of the scenic spot of the venue is effectively improved.

The invention belongs to the technical field of data processing and analysis, and particularly relates to a geomagnetic and inertial navigation fused glasses guide direction identification and content triggering system, which comprises a sensing compensation component, a calculation storage component, a guide resource component and a display component, the sensing compensation assembly comprises an inertial measurement unit, a geomagnetic sensor, an active magnetic compensation coil and a coil driving module; the calculation storage assembly comprises a control processor and a memory, and the control processor is used for driving the active magnetic compensation coil to obtain a coil compensation geomagnetic vector according to a phase coding zero-returning sequence, executing attitude propagation based on the inertial measurement unit, and executing course updating on the coil compensation geomagnetic vector based on Huber anti-outlier loss to obtain a head attitude. According to the invention, the influence of magnetic disturbance and attitude jitter on direction identification and content triggering can be effectively reduced, and the stability, consistency and practicability of the glasses guide system in a real use scene are improved.

The invention discloses a multi-machine collaborative three-dimensional map updating method based on mobile augmented reality, and belongs to the technical field of three-dimensional reconstruction, and the method comprises the following steps: carrying out the collection of initial collection data of a plurality of target regions through the wearing of AR glasses by a plurality of people; performing frame extraction on the original video image, and calculating to obtain a data grouping result; a sparse pairing list is generated by adopting a hybrid pairing strategy, and sparse point cloud data is obtained by combining incremental SfM calculation; performing distortion removal processing on the frame extraction image, and obtaining pure dense point cloud data through a multi-view solid geometry algorithm, a clustering algorithm and statistical filtering; a triangular mesh model is generated through Poisson surface reconstruction, and a high-precision three-dimensional model is obtained through Markov random field optimization view selection; and constructing a unified space-time reference conversion matrix to obtain a real-time AR visual navigation and map updating result. By adopting the method, the problems that the three-dimensional map is poor in current situation, virtual and real registration is misplaced, the modeling efficiency is low and the precision is insufficient are solved.

The invention provides a blind person navigation assisting method, device and equipment based on AI glasses and a storage medium. The method comprises the following steps: constructing a navigation path between a current position of a user and a destination; according to the image data and the sensing data, determining environment information in a preset range of the navigation path and a real-time pose of the user; generating navigation guidance information according to the environment information and the real-time pose of the user; and converting the navigation guidance information into a spatial audio signal, and carrying out traveling navigation based on spatial audio prompt on the user through the spatial audio signal. According to the method, the navigation guidance information related to the real-time pose of the user is generated by integrating the visual sensing data of the AI glasses, the pose information of the inertial sensor and the navigation path information, and the navigation guidance information is converted into the spatial audio signal for navigation; when the user is separated from the navigation path, the user can be guided to accurately judge the advancing direction through spatial audio prompt, and the appearance safety of the user is improved.

The invention provides a multi-camera-based AI glasses FOV extension method and system, and the method comprises the steps: transmitting a synchronization signal to a plurality of cameras, enabling the plurality of cameras to carry out the exposure at the same time, and obtaining a plurality of frames of original images at the same time; pre-processing the multiple frames of original images to obtain pre-processed images; key feature points of the preprocessed image are extracted through a feature point detection algorithm, and feature descriptors are generated; through a feature matching algorithm, feature point matching is carried out on the adjacent preprocessed images by utilizing the feature descriptors, and a local transformation matrix between the adjacent preprocessed images is calculated; based on the local transformation matrix, fusing the adjacent preprocessed images to obtain a fused image of the adjacent preprocessed images; and all the fused images are spliced to obtain a large-view-field-angle image covering the target view angle, so that the method has the advantages of effectively expanding the shooting view angle, eliminating image distortion and improving the image splicing naturalness.

The invention discloses an emotional diary intelligent glasses system driven by a multi-modal agent. The emotional diary intelligent glasses system comprises a multi-modal perception layer, a unified vector space processing layer and an agent collaborative decision-making layer. The multi-modal sensing layer constructs a full-dimensional sensing network by integrating a camera, a microphone array and an eye movement tracker, and collects image, sound and eye movement information; the unified vector space processing layer realizes cross-modal information unified representation by using a multi-modal large model; the agent collaborative decision-making layer comprises an emotion perception agent, a scene understanding agent, a diary generation agent and a personalized adaptive agent. According to the method, deep understanding of the emotional state and the environment scene of the user is realized through a multi-modal fusion perception and agent cooperation mechanism, the personalized emotional diary is generated in combination with chain thinking and reflection, and the content insight and the user experience are effectively improved.

The invention relates to the technical field of video communication, in particular to an intelligent AI glasses video call auxiliary system which comprises a visual adjustment module, a voice interaction module, a communication scheduling module, a posture recognition module and a feedback prompt module. According to the invention, by acquiring the eye movement track and the pupil diameter change, adjusting the image brightness and the color contrast in combination with the ambient light, relieving visual fatigue, enhancing the call comfort, analyzing the voice frequency band and matching the keywords, the accurate recognition of the operation intention is realized, the call response efficiency is improved, and the mistaken touch and delay are avoided; the call priority is judged according to the action state, the acceleration trend and the contact person weight, the task access accuracy is improved, the user intention is judged according to the head posture and the sight line trend, misoperation and repeated confirmation are avoided, interaction convenience is enhanced, meanwhile, the audio intensity and image prompt are regulated and controlled according to the task type and the prompt level, the multi-environment prompt requirement is met, and the user experience is improved. Information omission is reduced, and call experience is optimized.

Methods and apparatus for monitoring user performance in launching objects at sporting events are described. A described method includes capturing, with a camera on glasses worn by a player participating in a sporting event, a plurality of two-dimensional (2-D) images of an object launched by a player participating in the sporting event. The launched object is identified and tracked with the camera for which an orientation is determined using an accelerometer. Based on the tracking, a position of the launched object at a point along a trajectory relative to a stationary object is determined, and an output indicative of user performance is provided based on the determined position of the launched object.

The embodiment of the invention discloses a commodity settlement processing method and system and a computer program product. The commodity settlement processing method is applied to intelligent glasses provided by a physical store, after a consumer user completes commodity purchasing, the consumer user wears the intelligent glasses to perform commodity settlement processing on a purchased commodity, and the commodity settlement processing method comprises the steps of collecting a target image in a view range of the intelligent glasses in a process that the consumer user takes the purchased commodity to perform self-service settlement; if the target image comprises the first image content of holding the at least one commodity, commodity feature information of the at least one commodity is obtained from the target image through image analysis; and carrying out commodity identification according to the commodity feature information, adding at least one commodity which is successfully identified as a to-be-settled commodity into a to-be-settled commodity set until a settlement request submitted by the consumer user through the intelligent glasses is obtained, and carrying out settlement processing on the to-be-settled commodity. According to the scheme, the overall settlement efficiency of the offline physical store can be further optimized.

The invention discloses a data analysis method for intelligent police law enforcement glasses, and belongs to the technical field of data analysis, and the method comprises the steps: extracting a video stream from a multi-source data set for recognition, judging whether a recognition result meets a preset threshold value or not, taking a target feature as a video feature set if the recognition result meets the preset threshold value, if not, triggering supplementary data collection and obtaining a video feature set in combination with the original target features; performing space-time alignment on key elements in the video feature set and the voice instruction to obtain a comprehensive event description vector; performing sequence analysis on the comprehensive event description vector to obtain an event trend vector, and obtaining an event analysis result; converting the event analysis result according to the priority to obtain real-time voice feedback content; and generating a voice broadcast signal of the real-time voice feedback content. According to the data analysis method of the intelligent police law enforcement glasses, the problem that the efficiency and safety of the law enforcement process are difficult to guarantee due to information lag caused by insufficient data processing speed is solved.

An augmented reality headset system is provided. The AR headset includes a camera, a lens subsystem, a micro-display, and a central processing unit. The lens subsystem includes a transparent layer with a first surface and an opposed second surface, a reflective coating applied to the first surface of the transparent layer, and an alpha matte layer abutting the second surface of the transparent layer. The central processing unit is programmed to execute an algorithm including the steps of displaying differential images on the lenses according to the position of the user's eye and displaying a plurality of pixels opaque in the portion of the alpha matte layer aligning with the portion of the reflective coating onto which the differential images are projected, while pixels aligning with any portion of the reflective coating onto which no image is projected remains transparent.

The invention discloses a spectacle frame bending angle measuring method for pulse treatment spectacles, and relates to the related field of image processing and target detection, and the method comprises the steps: employing an industrial camera to shoot a spectacle frame image of the pulse treatment spectacles, and obtaining the multi-angle image data of the spectacle frame; the collected multi-angle image of the spectacle frame is preprocessed, so that the image quality is improved; inputting the preprocessed multi-angle image of the spectacle frame into a pre-trained target detection model, positioning a bent part of the spectacle frame, and further segmenting to obtain a bent part image; an image processing method is applied to extract linear features of the bent part, and the bending angle of the spectacle frame is calculated according to the linear features; and according to real-time measurement result feedback, the image acquisition angle and the model hyper-parameter are adjusted, and the measurement process of the bending angle of the mirror bracket is optimized. The technical problems of inaccurate positioning of the bent part of the spectacle frame and insufficient automation level of an existing measurement method are solved. And the precision and the efficiency of measuring the bending angle of the pulse treatment glasses frame are improved.

The invention belongs to the technical field of relay protection practical training and evaluation of a power system, and particularly relates to a relay protection operation coach and evaluation system and method based on AR glasses, and the system comprises an AR intelligent glasses terminal which is worn by an operator and is used for collecting the depth visual flow data of a field environment in real time; an edge computing server which is in communication connection with the AR intelligent glasses terminal and is used for obtaining the visual flow information collected by the AR intelligent glasses terminal, constructing a state sensing model based on a power equipment topological relation and realizing direct semantic level identification of screen cabinet elements; meanwhile, generating a three-dimensional visual operation indicator, a dynamic safety early warning signal and real-time evaluation feedback information, and superposing the three-dimensional visual operation indicator, the dynamic safety early warning signal and the real-time evaluation feedback information in the visual field of the AR intelligent glasses terminal; the cloud management platform is in communication connection with the edge computing server and is used for performing user management, storage and updating of an operation instruction knowledge graph, storage and analysis of historical evaluation data and unified allocation of system resources; the defects of a traditional training and evaluation system are overcome.

The invention discloses a multi-mode cooperation method, device and equipment based on AR glasses and a robot dog, relates to the technical field of augmented reality and intelligent robots, and aims to solve the problem that the cooperative work effect of the AR glasses and the robot dog is poor. The method comprises the following steps: fusing real-time pose point cloud of a robot dog and laser point cloud data of AR glasses through a space matching algorithm to obtain a shared coordinate system; analyzing a multi-modal interaction intention of the user based on the shared coordinate system, generating a robot dog control instruction set, and collecting sensor data of a target space region; rendering the inspection data collected by the robot dog in response to the control instruction set into hierarchical visual data; and based on the risk identifier in the hierarchical visualization data, triggering a linkage response behavior of the robot dog and the AR glasses.

The invention relates to a data interaction system for AI glasses and a smart phone under intelligent scene perception, and relates to the technical field of data interaction, and the system comprises a scene perception module which is used for reading position data, direction data and attitude angle data of the AI glasses and executing scene data initialization of the smart phone; the perception processing module is used for activating a scene perception sensor of the AI glasses and carrying out scene perception; the judgment module is used for executing resource state sensing of the AI glasses and the smart phone and dynamically configuring a sensing task; and the interactive processing module is used for packaging and uploading the low-dimensional scene state vectors identified by the smart phone, and respectively executing scene identification processing. The technical problems that in the prior art, the cooperation efficiency of the AI glasses and the smart phone is low, resource utilization is unbalanced, and the real-time sensing and processing capacity is insufficient in a miscellaneous scene are solved, and the technical effects that efficient cooperation and dynamic load balancing of the AI glasses and the smart phone are achieved, and scene sensing real-time performance and energy efficiency are improved are achieved.