Method for enhancing visual ability of human eyes based on MR glasses, system and equipment

Abstract

The invention belongs to the technical field of application of near-to-eye display equipment, and discloses a method for enhancing the visual ability of human eyes based on MR glasses, a system and equipment. The method comprises activating a telescopic mode according to the visual demand of a user, and capturing a long-distance scene in the front of the visual field of the user through a telephoto camera of the equipment; and after optimization or/and AI image enhancement are/is carried out on the image of an magnified fixation area, presenting the image to the user, so that the user can see the distant scene beyond the visual ability range clearly, and the visual ability of the user in looking at the distance is enhanced. The optical structure of a front camera on the existing MR glasses is improved by utilizing a light guide optical fiber, an optical waveguide or a periscope technology, so that the whole MR glasses are lighter and thinner. An eye movement tracking device and a head movement tracking device are used for selecting the focusing area of the image, the magnification power is determined through eye movement interaction and/or gesture interaction, a MR glasses display previews the photographing area in real time, and finally a picture is taken.

Description

technical field [0001] The invention belongs to the field of near-eye display device application technology, and in particular relates to a method, system and device for enhancing human visual ability based on MR glasses. Background technique [0002] At this stage, the technology and products of near-eye display devices relying on augmented reality (AR) and virtual reality (VR) are gradually becoming mature. As near-eye display devices become more and more intelligent, portable and low-cost, it will gradually Integrating into people's lives, it becomes an indispensable wearable smart hardware device for people's daily life, and it can even become an intelligent tool to help human beings to enhance certain capabilities. [0003] Near-eye display devices (HMDs) also include electronic displays and optical components. The HMD can be, for example, mixed reality (Mixed Reality)—MR glasses, augmented reality (Augmented Reality)—AR glasses, virtual reality (Virtual Reality)—VR gl...

AI Technical Summary

Problems solved by technology

[0006] (1) Existing intelligent near-eye display devices lack methods or systems and devices related to enhancing human visual ability

[0007] (2) The existing MR glasses do not propose a corresponding interaction scheme for enhancing the telephoto ability of the human eye. For example, it may be inconvenient for the user to interact with both hands in the scene where the device is used, so comfortable eye movement interaction / eye movement coordination is adopted Other interactions Use an application, or perform simple gestures to interact with the application, or use the silent language issued by the user to directly input instructions to the system

[0008] (3) The existing MR glasses do not pay much attention to the optimization of the front camera configuration, and most of them still use the traditional camera configuration, resulting in a very bloated hardware architecture

[0009] (4) The mainstream applications of existing MR glasses are still mainly for game entertainment or enterprise users, and they are almost only suitable for indoor use. Interaction, various factors deter many users, further leading to slow development of MR glasses industry

[0013] (3) Since most of the usage scenarios are outdoors, the current MR glasses cannot reduce the external light (such as sunlight), which will affect the imaging effect. Therefore, it is necessary to configure a module that can reduce the incidence of external light, for example, by controlling the opacity of the optical lens. block outside light

Images