1302 results about "Visual experience" patented technology

The invention discloses a global dynamic optimization system for an ultra-high-definition glass-based display screen. The operation process of the system specifically comprises the following steps: acquiring a real-time state data set of the display screen; generating an initial optimization parameter set based on a preset optimization strategy and the user behavior model; capturing a user interaction signal and an environment change signal in real time; generating a dynamic correction coefficient set according to the user interaction signal and the environment change signal; performing global parameter fusion based on the initial optimization parameter set and the dynamic correction coefficient set to generate a target optimization instruction set; and feeding back an optimization effect evaluation table based on the optimization effect. The method has the following advantages and effects: collaborative optimization and thermodynamic balance of global display parameters are realized, the system can balance visual experience improvement and thermal diffusion suppression requirements in real time through multi-dimensional data fusion and global parameter collaborative calculation, and the system can improve the visual experience while enhancing local contrast and optimizing color rendition. And actively inhibiting the temperature rise of the screen through thermodynamic equilibrium constraint.

The invention relates to the technical field of display control, in particular to a display self-monitoring method and system and a display, and the method comprises the following steps: collecting light intensity data, comparing and classifying ambient light as low light, strong light or reflected light with a preset standard, judging whether a real-time color temperature and a standard color temperature difference value exceed a threshold value, if yes, adjusting the color temperature and the brightness, and if not, adjusting the brightness; pixel RGB channel proportions are extracted frame by frame, a color gamut distribution diagram is generated, restoration instruction time features are recorded, the color temperature adjustment trend is counted, and a backlight gradient compensation mode is generated. In the invention, the light intensity around the display is monitored in real time, the light intensity is compared with the preset illumination condition, and the ambient light condition is automatically classified, so that the display can adjust the color temperature and the brightness according to different illumination environments, and the backlight drive of the display is adjusted in time by analyzing the coverage areas of the red, green and blue channels in the display frame frame by frame; the adaptive capacity and the long-term stability of the display under variable illumination conditions are improved, and more optimized visual experience is provided for users.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto a user's retina based on pupil position and size. The glasses comprise a frame, lenses with directed pixel layers, and sensors for tracking pupil movement. Each directed pixel may generate multiple virtual pixels by rapidly changing its emission angle. The glasses function as prescription lenses, virtual reality displays, and augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, and connectivity to peripheral devices. The glasses enable a seamless blend of virtual and real-world experiences, creating an immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

The invention discloses a short video intelligent editing method and system based on multi-modal analysis, and relates to the technical field of video editing. The method is used for improving editing efficiency and visual experience and comprises the following steps: extracting lip motion features of a character, visual saliency features of a commodity and a voice emotion intensity value from a target short video stream to form multi-modal time sequence data; afterwards, the voice stream is recorded, a product keyword timestamp is extracted, the alignment degree is calculated through dynamic time warping in combination with a visual saliency peak value, and a preliminary editing point set is generated through weighted evaluation in combination with an emotional intensity value; constructing an editing decision optimization model based on deep reinforcement learning, taking the multi-modal features as state input, adjusting the retention probability of editing points through a joint reward function, and selecting an optimal transition mode; and the lip movement and voice synchronization error before and after the editing point and the emotional and visual continuity of the transition section are analyzed, the discontinuous region is smoothed, and the edited finished product is output, so that precise short video intelligent editing is realized.

The invention relates to the technical field of panoramic image construction, in particular to a panoramic image reconstruction method and system based on multi-angle imaging. The method comprises the following steps: collecting a multi-angle original image based on a distributed multi-camera array, carrying out adaptive filtering denoising and adaptive panoramic imaging adjustment, and constructing a multi-angle imaging geometric constraint network; performing multi-view semantic information deviation elimination based on a multi-angle imaging geometric constraint network, and performing global semantic feature fusion to obtain a unified semantic space representation framework; identifying illumination feature information of different visual angles, performing multi-angle illumination corresponding compensation on the multi-angle original image, performing image semantic distortion correction based on a unified semantic space representation framework, and constructing a multi-angle illumination compensation image; and performing multi-scale texture structure analysis on the multi-angle illumination compensation image to generate a high-fidelity texture fusion image. According to the invention, a natural and seamless panoramic image is provided, a panoramic scene is perfectly presented, and the immersive visual experience of a user is improved.

The invention provides a self-adaptive color depth optimization method for a liquid crystal display screen, which comprises the following steps of: acquiring manual adjustment operations of a user on brightness, contrast and color parameters of the liquid crystal display screen in different use scenes to form a user preference data set; according to the user preference data set, a data classification method is adopted to classify manual adjustment operations in different use scenes, and features of ambient light and content types are extracted to determine preference feature distribution of a user in a specific scene, and a personalized color preference model is constructed; preliminary calibration is carried out in combination with a dynamic balance algorithm, and display parameters are optimized through a continuous learning mechanism and secondary calibration. The problem that in the prior art, color adjustment of a liquid crystal display screen lacks individuation and scene self-adaption capacity is solved, continuous self-adaption of the display effect is achieved, manual intervention of a user is reduced, and the individuation degree and comfort degree of visual experience are improved.

The invention discloses a liquid crystal display screen gray scale control method based on adaptive brightness compensation, which relates to the technical field of liquid crystal display screen control, and comprises the following steps: collecting environmental spectrum distribution information and a pixel gray scale voltage response curve of a liquid crystal display screen in real time, and carrying out fusion processing to form a time sequence joint feature vector; through multi-mode synchronous sampling and time sequence joint feature vector generation, ambient light and screen content changes are accurately captured, target adjustment values of backlight power and gray scale voltage are dynamically predicted, and response lag and overshoot are avoided. Through spectral domain balancing and a self-adaptive damping scheduling mechanism, cooperative control of backlight and gray scale is optimized, high-frequency oscillation is suppressed, and linear response of a low-frequency band is ensured. Meanwhile, Gamma mapping and global color gamut calibration are dynamically refreshed, accurate adjustment of area-level brightness and gray scale is achieved, and continuity of the display effect and visual experience of a user are improved.

The invention discloses a lightweight display interface rendering optimization system, which relates to the technical field of image processing, and comprises an acquisition module, an interface analysis module, a behavior analysis module and an attention analysis and rendering module, dynamically calculating an effective view radius by utilizing a visual tunneling effect; the interface analysis module performs character string fuzzy matching in combination with the context input by the user, identifies the search intention of the user and improves the weight of a corresponding component; the attention analysis module performs multi-modal weighted fusion on the physiological fixation data and the sparse content saliency thermodynamic diagram; according to the method, by recognizing the semantic intention and the physiological fixation point of the user, on the premise that core visual experience continuity is guaranteed, GPU load and video memory bandwidth occupation are remarkably reduced, and balance of high-performance display and low-power-consumption operation is achieved.

The invention discloses a city three-dimensional model rendering method, which comprises the following steps of: establishing a multi-level detail model system to create a plurality of three-dimensional models with different levels of detail for each building object in a city scene so as to form a continuous hierarchical structure from high precision to low precision; spatial distance, view angle factors and object importance are comprehensively considered, effective distance measurement from a view point to a target object is calculated, a continuous LOD switching function is established according to the effective distance measurement, and the distance is mapped into continuous detail level values; a smooth interpolation algorithm based on time is applied, progressive switching is carried out between adjacent LOD layers, and visual jump during switching is eliminated; visual jump of LOD switching in urban three-dimensional model rendering is remarkably reduced, the stability of rendering performance is improved, and smooth and continuous visual experience is achieved.

The invention discloses a control management method and system for an LED backlight source, and relates to the technical field of backlight source control. The video decoding module is used for analyzing an input video signal and extracting an image brightness distribution entropy value and a color gamut coverage degree; the backlight partition regulation and control unit is used for dynamically adjusting a backlight partition topological structure; the prediction compensation module is used for generating a future frame brightness change trend and correcting a current backlight driving signal by using a feedforward compensation coefficient; the photoelectric sensing array is used for measuring the reflection characteristic of ambient light in real time; and the collaborative dimming controller is used for acquiring the type information of the playing equipment and loading a differential dimming strategy library. By dynamically analyzing video content characteristics, ambient light conditions and equipment information source types and adjusting a backlight partition structure and brightness output in real time, the HDR scene switching response speed is remarkably improved, the dark field gray scale identification degree is enhanced, backlight instantaneous peak power consumption is reduced, the non-linear brightness requirement of streaming media content is met at the same time, and the real-time performance of the system is improved. And better visual experience is provided for the user, and energy consumption optimization is realized.

The invention relates to the technical field of big data analysis, and more particularly discloses a package design optimization system and method based on big data analysis, which analyze and optimize package design by using a product image and a package design image. The attractive force and the spreading effect of product packaging are improved in the modes of color adjustment, pattern optimization, information transmission improvement and the like, so that the high requirement of consumers for visual experience is met, and a packaging design scheme with better attractive force and information transmission effect is provided for the fields of beauty makeup commodities and the like.

The invention relates to an LED display screen environment interaction system based on multi-mode perception and a control method. The system comprises a multi-mode sensing module used for acquiring environment information of the LED display screen; the user position distribution comprises a user distribution hot area map, an area target vector and an interference index; the environment fusion sensing module is used for performing fusion reasoning according to the environment illumination intensity, the environment temperature state, the regional target vector and the interference index to obtain an environment state type; the display strategy control module is used for generating a dynamic control parameter based on the environment state type in combination with the user distribution hot area graph; the LED display screen driving module is used for obtaining an adjusting parameter and an adjusting instruction according to the dynamic control parameter; the adjustment parameters comprise an RGB current parameter, a brightness parameter and a color temperature parameter. By adopting the system, the dynamic change of the environment and the crowd is taken as a driving source, perception, analysis and execution driving are integrated, and the energy use efficiency is improved while the visual experience of a user is improved.

The invention discloses a multi-effect ultrastructure composite lens for preventing and delaying myopia, which comprises a lens main body, a functional area is arranged in the lens main body, and the functional area comprises a central optical correction area and an ultrastructure area which are arranged on the inner side. Compared with the prior art, the method has the advantages that the small central optical area is adopted to correct vision, and the prevention and control effect is enhanced. The ultramicro soft light area has prevention and control and visual transition effects. The ultra-micro lenses and the ultra-micro structure ring cylindrical lenses are alternately arranged on the outer side, due to the fact that the area is reduced, the number of the ultra-micro structures in the unit area is increased, the filling rate of the functional area of the whole lens is increased, the ultra-micro structures enable the brain to be not easy to perceive, visual perception is not easy to interfere, and the three ultra-micro structures have the effect of improving visual activity along with eyeball movement of visual activity. Signals entering the eyes are kept in dynamic change all the time, so that the visual experience is further improved while the prevention and control effect and imaging intervention are guaranteed, and long-term wearing is facilitated.

The invention discloses a display method and system of an intelligent wearable device, and the method specifically comprises the steps: detecting the light intensity data and color temperature data of a use environment of the intelligent wearable device in real time, and carrying out the dynamic adjustment of a first display parameter of the intelligent wearable device according to the light intensity data and the color temperature data; acquiring historical operation information of a user on the interface elements of the intelligent wearable device, and performing personalized adjustment on the layout of the interface elements of the intelligent wearable device according to the historical operation information; according to the characteristics and importance of the display content of the intelligent wearable device, a self-adaptive display algorithm is adopted to dynamically adjust second display parameters of all display areas of the display content, and the second display parameters comprise the resolution ratio and the refresh rate. According to the invention, the matching degree of the intelligent wearable device and the visual perception of the user is obviously improved, the visual fatigue is reduced, the information transmission efficiency is optimized, and more natural and efficient visual experience is provided for the user.

The invention discloses a diffractive optical waveguide and augmented reality display equipment. The diffractive optical waveguide comprises a waveguide substrate and a first grating and a second grating which are arranged on the waveguide substrate, the first grating is configured to couple input light carrying image information into the waveguide substrate and enable the input light to be propagated through total reflection, and the second grating comprises a diffractive relief structure and is configured to at least carry out pupil expansion on the light propagated to the second grating; the diffraction optical waveguide further comprises an optical film layer, the optical film layer at least covers the second grating and comprises a filling structure, and the filling structure fills gaps in the diffraction relief structure of the second grating and forms an overflow layer higher than the diffraction relief structure. The refractive index of the filling structure is larger than that of the environment medium and smaller than that of the second grating. According to the embodiment of the invention, the transmittance of ambient light in the grating area can be effectively improved, and the difference between the grating area and the non-grating area is reduced, so that the overall visual experience is improved.

The invention belongs to the technical field of computer graphics and virtual reality, and discloses a virtual-real fusion-based panoramic roaming construction method for a digital exhibition hall, which effectively solves the problems of easy drift and offset in a virtual environment in a traditional system through a multi-sensor fusion algorithm and a closed-loop optimization mechanism. Under the complex environment of people flow change, illumination fluctuation and the like in an exhibition hall, accurate alignment of virtual content and physical space can still be kept, it is ensured that a user obtains coherent and stable visual experience in the roaming process, and a reliable space reference is provided for virtual-real interaction; the light and shadow effect and the material performance of the virtual content are naturally fused with the physical environment through the physical rendering and multi-sensory interaction technology, and meanwhile, a multi-dimensional immersion sense is constructed in combination with the spatial sound effect and interaction feedback; when the user interacts with the virtual exhibit, sensory experience close to reality can be obtained, and the sense of substitution and attraction of the digital exhibition hall are remarkably improved.

The side light-emitting device comprises a frame extending in the vertical direction and a light source module arranged on the inner side of the frame, the light source module emits light in the direction parallel to the extending direction of the frame, a light distribution piece is arranged in a light emitting path of the light source module, and the side light-emitting device is arranged on the side light-emitting device. The light rays are refracted by the light distribution piece and then are emitted in the direction away from the frame. The side light-emitting device can simulate the effect of illuminating the frame on one side of the window when sunlight enters from one side of the window, and can form a virtual image and simulate the window shadow effect in cooperation with the light-emitting surface of the lamp, so that the display effect of the lamp is more vivid, and the visual experience of a user is improved.

The invention provides a landscape design identification method and system based on a neural network model. The method comprises the following steps: by acquiring landscape design data, lighting equipment data and energy supply network real-time load data in a target area, establishing an optical model to analyze a spatial attenuation effect of vegetation shielding and artificial structure reflectivity on a lighting beam; calculating an energy consumption mapping relation between the lamp power distribution and the energy network load based on an energy transfer model; generating a dynamic dimming strategy in combination with a spatial attenuation effect and an energy consumption mapping relation, coupling the dynamic dimming strategy with a tourist distribution thermodynamic diagram and environment illumination intensity data which are acquired in real time, inputting the dynamic dimming strategy into a neural network model for iterative optimization, and dynamically adjusting lamp power distribution, a light beam angle coverage range and a light source color temperature parameter; dynamic optimization of the landscape lighting effect and minimization of energy consumption are achieved, and meanwhile the visual experience and comfort of tourists are improved. The invention provides an intelligent dynamic optimization technical scheme of a landscape lighting effect.

The invention discloses an augmented reality and digital product fusion display system, which can identify preset identifiers such as a two-dimensional code, a graphic code and a radio frequency identification tag through an identifier identification module, is integrated on an intelligent terminal or augmented reality equipment, is convenient for a user to operate at any time, improves the use convenience, and improves the user experience. The three-dimensional model database stores appearance structures, internal components and interactive function data, provides comprehensive product information for users and meets diversified requirements, the scene fusion calculation module realizes accurate positioning and reasonable proportion zooming of a three-dimensional model in a real scene by means of a virtual reality fusion degree calculation formula, dislocation and disproportionality are avoided, and the user experience is improved. The interactive display module supports multi-mode interaction modes such as gestures, voice instructions and equipment sensors, rich and natural interactive experience is provided, the real-time interaction function enables a user to see the influence of operation on the model in real time, interactivity and feedback are enhanced, and the digital product display effect and the user experience are integrally improved.

The invention relates to the technical field of image fusion, in particular to a real-time image scene virtual-real fusion processing method, which comprises the following steps of: acquiring scene geometric change, illumination fluctuation and motion trail captured by a multi-modal sensor, identifying an illumination stable fragment and marking a position, acquiring a relationship between a rotation angle and a virtual object size, screening an embedded boundary, and performing real-time image scene virtual-real fusion processing. According to the method, accurate fusion of the virtual content and the real scene in the dynamic environment is realized through scene geometric structure change, illumination stability and reasonability of the embedding position of the virtual object, the virtual and real interference area is delimited, and the real and virtual scene fusion efficiency is improved. The fusion problem caused by unstable illumination or geometric change is avoided, the illumination consistency and visual coordination are ensured, the naturalness and consistency of virtual-real fusion are improved, the smoothness of the rendering effect is improved, and the visual experience and interactivity of the virtual-real fusion image are integrally enhanced.

The invention discloses a multi-camera imaging method and system for head-mounted equipment, and relates to the technical field of multi-camera imaging, and the system comprises an image data acquisition module, a weight acquisition module, an image fusion module, a feedback control module, a visual angle movement determination module and a preloading module. The gaze weight of the image is obtained by obtaining the gaze direction of the user, an image weighted fusion mode with the current visual attention area of the user as the core is achieved, the generated main view angle image better conforms to the actual view field of the user, and immersive visual experience is enhanced; inter-frame time sequence consistency loss is introduced in the fusion process, the pixel change of the fusion image between continuous frames is restrained through time sequence smoothing, the image flicker and jump phenomena are remarkably reduced, and the visual stability in a dynamic scene is improved.

The invention provides a display control method and system for a liquid crystal display screen, and the method comprises the steps: carrying out the nonlinear spectrum mapping processing of an input RGB drive value, and obtaining a theoretical emission spectrum through combining with the response characteristics of liquid crystal molecules; calculating a reflection spectrum component in the multilayer structure according to the ambient light spectrum, and superposing the reflection spectrum component with the theoretical emission spectrum to obtain an actual observation spectrum; calculating a difference value between the actual observation spectrum and the target spectrum, and converting the difference value into an RGB correction value through a constraint optimization algorithm to obtain an RGB driving value after ambient light compensation; and calculating actual white point color coordinates, and adjusting the actual white point color coordinates to a standard white point position through a progressive white point migration algorithm. Display parameters can be dynamically adjusted according to real-time ambient light conditions, the influence of ambient light reflection on colors is effectively compensated, meanwhile, color temperature consistency and color accuracy are ensured through white point correction, the display quality under different ambient lights is remarkably improved, and the visual experience of a user is improved.

The invention provides virtual reality-based dance teaching equipment and a teaching method thereof, and the equipment comprises a VR module which is used for providing multi-view immersive visual experience; the motion capture module is used for capturing the joint angle of the dancer in real time and the limb track feedback module and is used for simulating the ground counter-acting force in dancing through vibration or pressure, enhancing motion perception and providing a touch prompt for motion correction; the virtual scene module is used for creating a dance virtual scene; and the action analysis module analyzes the joint action deviation based on multiple view angles, generates an instant score according to the joint angle deviation and the rhythm synchronization rate, and records historical data to generate a progress curve. According to the method, the problems of resource shortage, feedback lag and other pain points in traditional dance teaching are solved, efficient, personalized and interesting dance learning experience is achieved through multi-modal interaction and a dynamic adjustment mechanism, and the application of the method is expected to promote dance education to develop in the intelligent and universal direction.

The invention discloses a high-quality multispectral demosaicing method based on residual error guidance, belongs to the technical field of image restoration, and aims to solve the problems that a large amount of high-frequency information is not effectively processed and RGB image chromaticity channel restoration is insufficient. The method comprises the following steps: step 1, designing nine-channel multispectral optical filter array arrangement; step 2, interpolating a dense sampling channel image; 3, preliminarily reconstructing a sparse sampling channel image; and 4, further restoring the sparse sampling channel image by using a residual interpolation method. According to the demosaicing method based on residual guidance, when pixels of other channels are reconstructed, interpolation is carried out on residual values, and the problems of key detail reservation, fuzziness and detail loss are emphasized. And the mutual influence between different spectrum channels is considered, so that more accurate color restoration is realized, and the visual perception and the practical application value of the image are improved. The reconstructed image is excellent in the aspect of recovering the chromaticity channel of the RGB image, and the real effect of the reconstructed image is closer to that of the original image.

The invention provides a sound scene regulation and control method and system for a virtual reality scene, and relates to the virtual reality technology, and the method comprises the steps: segmenting a VR audio / video into slices at equal time intervals; packaging the heart rate variability characteristic data and the VR audio and video into attribute data of slices according to a time sequence of the slices; randomly adjusting the audio attribute of the slice, and collecting heart rate data of different experiencers when experiencing the slice with the adjusted audio attribute; extracting heart rate variability characteristic data, inputting the data into an emotion recognition classifier, and recognizing an emotion state of the experiencer as training data; according to the target emotional state and the counted emotional response, calculating Juyden indexes of different audio attributes to determine an optimal threshold interval of the audio attributes; and according to the association degree between the audio attribute of the optimal threshold interval and the emotional state of the experiencer, whether the audio attribute needs to be adjusted is judged, so that sound scene self-adaptive regulation and control are realized, the problem that sound field creation is not matched with visual experience is solved, and the user experience is improved.

The embodiment of the invention discloses a Micro-LED display chip and a preparation method. The Micro-LED display chip comprises a driving panel, a plurality of LED units, a wavelength conversion layer, a lens unit and a plurality of light condensation layers. According to the Micro-LED display chip provided by the embodiment of the invention, the coverage area of the lens unit can be increased by arranging the at least two overlapped light condensation layers on the lens unit, and the lens unit can fully cover the whole pixel region of the Micro-LED display chip, so that the light condensation effect is improved. According to the utility model, more or all light rays are projected through the lens unit, and tiny light rays are collected and focused to a specific area, so that the brightness and definition of pixels are improved; meanwhile, the lens units can better adjust the angle and distribution of light rays, the color uniformity between pixels is improved, and a display picture is brighter and more vivid. Therefore, the contrast ratio of the Micro-LED display chip is improved, the glare and halo effects are reduced, and the Micro-LED display chip can provide clearer and more vivid visual experience.

The invention discloses high borosilicate optical lens glass and a preparation process thereof, and relates to the technical field of glass surface treatment.The preparation process of the high borosilicate optical lens glass comprises the following steps that raw materials are mixed, melted, formed and subjected to heat treatment, and the high borosilicate glass is obtained; and carrying out etching and sol coating to form an antireflection layer so as to obtain the optical lens glass. The preparation method comprises the following steps: preparing an antireflection layer on the surface of high borosilicate glass through etching and sol coating, during sol coating, firstly loading fluorine-containing POSS on the surface of the glass by utilizing hydrosilane to form a POSS modified layer, then preparing hollow silicon dioxide sol by taking a polymer of polyvinylpyrrolidone and fluorine-containing POSS as a template, and curing after coating to form a composite structure. The surface refractive index of the glass is greatly reduced, light reflection can be reduced, the light transmittance and definition of the glass are improved, and the visual experience is more comfortable and natural.

The invention discloses an aspheric keratoprosthesis lens column, a keratoprosthesis and an application method of the aspheric keratoprosthesis lens column, the whole lens column is cylindrical, the front surface of the lens column is a convex surface, the rear surface of the lens column is a concave surface, the rear surface of the lens column is a surface close to the retina, the front surface of the lens column is a surface far away from the retina, and the front surface and the rear surface of the lens column are both curved surfaces. And the spherical surfaces are rotationally symmetrical aspheric surfaces. The artificial cornea comprises a lens column and a support, and the lens column is installed on the support. The fixed position of the lens column is that the distance between the vertex of the rear surface of the lens column and the retina is 10-120mm, the focal plane is perpendicular to the optical axis, and the inclination angle of the focal plane is 0 degree. According to the lens column, spherical aberration and coma can be effectively corrected, and the imaging quality is improved; light scattering is reduced, the visual contrast at night and in a low-light environment is improved, and the visual experience of a patient is improved; the deviation tolerance of the implantation position is higher, and the operation difficulty and the risk of postoperative complications are reduced.

The invention belongs to the technical field of network live broadcast, and particularly relates to a multi-live-broadcast-room matrix cooperative control system and a control method, a global unified clock reference system is established, and a public time axis covering all participating nodes is generated in a distributed calibration mode, so that audio and video streams of all live broadcast rooms are collected and played based on the same time reference, and therefore, the collection efficiency is improved. The synchronization deviation caused by clock drift is fundamentally eliminated; and a dynamic topology sensing type transmission network is further constructed based on the public time axis, each node periodically detects a link state and generates a score, an optimal transmission path set is generated in real time, and adaptive scheduling of data streams is realized. Therefore, accurate alignment of multiple paths of media streams in the time dimension is ensured, the end-to-end transmission delay is remarkably reduced, the audio and video synchronization precision and transmission stability in a cross-live-broadcasting-room interaction scene are effectively improved, and the overall audio-visual experience of a user is improved.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto user's retina based on pupil position and size. The glasses comprise frame, lenses with directed pixel layers, sensors for tracking pupil movement. Each directed pixel generates multiple virtual pixels by rapidly changing its emission angle. Each directed pixel with pupil's real-time tracking, provides automatic adjustments to virtual contents, ensuring accurate alignment of images with field of view of users while identifying vergence-accommodation conflict. The glasses function as prescription lenses, virtual reality displays, augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, connectivity to peripheral devices. The glasses enable seamless blend of virtual and real-world experiences, creating immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.