A computer-implemented
system and method for
pupil-directed
retinal projection in a near-eye display is disclosed. The computer-implemented
system provides the smart glasses with directional physical pixels that project light beams / signals directly onto the
retina of the user based on the position and size of the
pupil. Eyeglasses include a frame, lenses having directional pixel
layers, and a sensor for tracking
pupil movement. Each directional pixel may generate a plurality of virtual pixels by rapidly changing its emission angle. Glasses are used as prescription lenses,
virtual reality displays, and
augmented reality devices without conventional optical systems. Additional features include depth sensors, cameras, and
connectivity with
peripheral devices. According to the glasses, seamless fusion of
virtual world experience and real world experience can be realized, so that an immersive mixverse environment is created. Various input methods, including
gesture recognition and brain-computer interface, allow for intuitive control and interaction.