Vision measurement method and near-to-eye display equipment
By setting marking points in the near-eye display device and automatically measuring the visual level by using the camera to capture the marking point position in the image, the problem of users needing to manually adjust the visual level in the prior art is solved, and the automatic adaptation of the device and user experience improvement is achieved .
Patent Information
- Application Number
- CN202310632611.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-31
- Publication Date
- 2024-12-03
AI Technical Summary
Existing near-eye display devices cannot automatically adapt to the user's near/fastest degree, resulting in the user requiring manual operation to obtain a clear image viewing, increasing the difficulty of operation and the weight, volume and cost of the device.
Set marking points in the near-eye display device, and automatically measure and adjust the visibility of the near-eye display module through the mapping relationship between the marking point position and the viewpoint in the image captured by the camera to match the user's eye degree.
It realizes automatic visual adaptation of near-eye display devices, improves user experience, and reduces the complexity and cost of the device.
Smart Images

Figure CN119065127A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of near-eye display technology, and in particular to a diopter measurement method and a near-eye display device. Background Art
[0002] Near-to-eye display devices, also known as head-mounted display devices or wearable display devices, are used to project images directly into people's eyes. By synthesizing virtual magnified images, near-to-eye display devices can solve the problem that people's naked eyes cannot focus on objects very close to the eyes. On the other hand, they can break through the restrictions of the display size on the field of view and provide a more immersive user experience.
[0003] However, for myopic / hyperopic users, directly wearing a near-eye display device cannot obtain the clearest image viewing experience. The user needs to manually operate to make the vision of the near-eye display device adapt to the user's myopia / hyperopia to obtain a clear image viewing experience. Summary of the invention
[0004] The present application provides a diopter measurement method and a near-eye display device, which can automatically measure the diopter of the near-eye display device.
[0005] In the first aspect, an embodiment of the present application provides a method for measuring diopter, which is applied to a near-eye display device, wherein the near-eye display device includes a near-eye display module and a first marking point, wherein the near-eye display module includes: a camera, wherein the position of the first marking point on the image captured by the camera has a mapping relationship with the diopter of the near-eye display module; the method includes: obtaining a first image captured by the camera; identifying a first position of the first marking point from the first image; and determining the diopter corresponding to the first position of the first marking point according to a mapping relationship between the position of the preset first marking point and the diopter, thereby obtaining the first diopter of the near-eye display module. In the method, a first marking point is set in the near-eye display module, and the diopter of the near-eye display module is obtained by the mapping relationship between the position of the first marking point in the image captured by the camera and the diopter, so that the near-eye display device can automatically detect the diopter of the near-eye display module.
[0006] In one possible implementation, the near-eye display module also includes a first optical element and a second optical element; wherein the position of the first optical element on the near-eye display device is fixed, the visual acuity of the near-eye display module changes with the movement of the second optical element along the optical axis direction of the near-eye display module, the camera is linked with the second optical element, the first mark point is located at the skirt position of the optical lens included in the first optical element or on the lens, and the first mark point can be photographed by the camera within the adjustment range of the camera.
[0007] In one possible implementation, the near-eye display module also includes a first optical element and a second optical element; wherein the positions of the first optical element and the camera on the near-eye display device are fixed, the visual acuity of the near-eye display module changes with the movement of the second optical element along the optical axis direction of the near-eye display module, the first marking point is located on the lens barrel of the near-eye display module or on the bracket of the display screen, and the image of the first marking point on the second optical element within the adjustment range of the second optical element can be captured by the camera.
[0008] In a possible implementation, the first marking point includes: a scale groove, a fluorescent marking point, an infrared marking point, or an LED light.
[0009] In one possible implementation, the first marking point includes: a fluorescent marking point, an infrared marking point, or an LED light, and identifying the first position of the first marking point from the first image includes: identifying a first area from the first image whose brightness exceeds a preset first brightness threshold; determining the coordinates of a specified pixel point in the first area as the first position of the first marking point.
[0010] In a possible implementation, identifying a first position of a first marking point from a first image includes: identifying a second area including a preset graphic from the first image; and determining coordinates of a specified pixel point in the second area as the first position of the first marking point.
[0011] In one possible implementation, the near-eye display device also includes: at least two second marking points, and the positions of the second marking points on the image captured by the camera have a mapping relationship with the visual acuity of the near-eye display module. The method also includes: determining the second marking point corresponding to the visual acuity range to which the first visual acuity belongs as the target marking point based on the correspondence between the preset visual acuity range and the second marking point; identifying the second position of the target marking point from the first image; determining the visual acuity corresponding to the second position of the target marking point based on the mapping relationship between the position of the preset target marking point and the visual acuity, and obtaining the second visual acuity of the near-eye display module.
[0012] In one possible implementation, the near-eye display device also includes: a third marker point, and the position of the third marker point on the image captured by the camera has a mapping relationship with the visual acuity of the near-eye display module. The method also includes: when the first position of the first marker point cannot be identified from the first image, identifying the third position of the third marker point from the first image; determining the visual acuity corresponding to the third position of the third marker point based on the mapping relationship between the position of the preset third marker point and the visual acuity, and obtaining the third visual acuity of the near-eye display module.
[0013] In one possible implementation, the near-eye display device also includes: a fourth marker point, and the method also includes: when the first position of the first marker point is not located in the preset image area, identifying the fourth position of the fourth marker point from the first image; determining the visual acuity corresponding to the fourth position of the fourth marker point based on a mapping relationship between the preset position of the fourth marker point and the visual acuity, and obtaining the fourth visual acuity of the near-eye display module.
[0014] In one possible implementation, the near-eye display device also includes: a fifth marker point, and the method also includes: identifying a fifth position of the fifth marker point from the first image; determining the diopter corresponding to the fifth position of the fifth marker point based on a preset mapping relationship between the position of the fifth marker point and the diopter, to obtain a fifth diopter of the near-eye display module; and calibrating the first diopter using the fifth diopter to obtain a sixth diopter of the near-eye display module.
[0015] In one possible implementation, the method also includes: when the difference between the visual acuity of the near-eye display module and the user's eye degree is greater than a preset first difference threshold, adjusting the visual acuity of the near-eye display module until the difference between the visual acuity of the near-eye display module and the user's eye degree is no greater than the first difference threshold.
[0016] In one possible implementation, adjusting the visual acuity of the near-eye display module includes: when the difference between the visual acuity of the near-eye display module and the eye degree of the user is greater than a preset second difference threshold, adjusting the visual acuity of the near-eye display module according to a first step length; when the difference between the visual acuity of the near-eye display module and the eye degree of the user is greater than the first difference threshold but not greater than the second difference threshold, adjusting the visual acuity of the near-eye display module according to a second step length; the first step length is greater than the second step length.
[0017] In a possible implementation, the near-eye display module further includes a first optical element and a second optical element; wherein the position of the first optical element on the near-eye display device is fixed, and the visual acuity of the near-eye display module changes as the second optical element moves along the optical axis direction of the near-eye display module;
[0018] Follow the first step to adjust the near-eye display module's visual acuity, including:
[0019] adjusting the distance of the second optical element relative to the first optical element on the optical axis of the near-eye display module according to a third step length;
[0020] Adjusting the visual acuity of the near-eye display module according to the second step length includes:
[0021] The distance of the second optical element relative to the first optical element on the optical axis of the near-eye display module is adjusted according to the fourth step length.
[0022] In a second aspect, an embodiment of the present application provides a near-eye display device, comprising: a near-eye display module, a first marker point, a processor, and a memory; the near-eye display module comprises: a camera; the position of the first marker point on the image taken by the camera has a mapping relationship with the visual acuity of the near-eye display module; wherein, one or more computer programs are stored in the memory, and when the computer program is executed by the processor, the near-eye display device executes any one of the methods of the first aspect.
[0023] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes any one of the methods of the first aspect.
[0024] In a fourth aspect, the present application provides a computer program, which, when executed by a computer, is used to execute any method of the first aspect.
[0025] In one possible design, the program in the fourth aspect may be stored in whole or in part on a storage medium packaged together with the processor, or may be stored in whole or in part on a memory not packaged together with the processor. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0027] Figure 1A A schematic diagram of a near-eye display device provided in an embodiment of the present application;
[0028] Figure 1B A schematic diagram of the structure of a near-eye display module provided in an embodiment of the present application;
[0029] Figure 2A A schematic diagram of the structure of a near-eye display device provided in an embodiment of the present application;
[0030] Figure 2B A schematic diagram of the software structure of a near-eye display device provided in an embodiment of the present application;
[0031] Figure 3 A schematic diagram of a coordinate system provided for an embodiment of the present application;
[0032] Figure 4 A schematic diagram of a first flow chart of a method for measuring visual acuity provided in an embodiment of the present application;
[0033] Figure 5AA schematic diagram of the position of the first marking point and the vision measurement principle provided in the embodiment of the present application;
[0034] Figure 5B A schematic diagram of the pixel distance between the pixel position of the first marking point and the center point of the image provided in an embodiment of the present application;
[0035] Figure 6 A schematic diagram of the position of the second first marking point and the vision measurement principle provided in an embodiment of the present application;
[0036] Figure 7 A schematic diagram of the position of the third first marking point and the vision measurement principle provided in an embodiment of the present application;
[0037] Figure 8 A schematic diagram of the position of the fourth first marking point and the visual acuity measurement principle provided in an embodiment of the present application;
[0038] Fig. 9 A second flow chart of the method for measuring visual acuity provided in an embodiment of the present application;
[0039] Fig.10 A third flow chart of the method for measuring visual acuity provided in an embodiment of the present application;
[0040] Fig.11 A fourth flow chart of the method for measuring visual acuity provided in an embodiment of the present application;
[0041] Fig.12 A fifth flow chart of the method for measuring visual acuity provided in an embodiment of the present application;
[0042] Fig.13 A sixth flow chart of the visual acuity measurement method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0043] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.
[0044] The near-eye display device in the embodiment of the present application may be a binocular display device or a monocular display device. The near-eye display device may be, for example, a virtual reality (VR) device with a straight optical path, a VR device with a pancake folded optical path, an augmented reality (AR) device with a birdbath optical path, etc.
[0045] The near-eye display device may be in the form of glasses, eye masks, helmets, or head-mounted displays, etc., and the embodiments of the present application are not limited thereto.
[0046] See also Figure 1A Taking the binocular display device in the form of glasses as an example, the near-eye display device may include two near-eye display modules, corresponding to the left and right eyes of the user, respectively. Figure 1A The near-eye display module 11 shown in the figure corresponds to the user's right eye, and the near-eye display module 12 corresponds to the user's left eye.
[0047] In one embodiment, see Figure 1B As shown, each near-eye display module 10 may include a first optical element 101 , a second optical element 102 , a display screen 103 and a camera 104 .
[0048] Optionally, the first optical element 101 may be disposed between the display screen 103 and the human eye plane, and the position includes but is not limited to the situation shown in the figure.
[0049] Optionally, the second optical element 102 may be disposed between the display screen 103 and the human eye plane, and the position includes but is not limited to the situation shown in the figure.
[0050] After the user puts on the near-eye display device, the eye (pupil 105) can be directed toward the near-eye display module 10, specifically, toward the first optical element 101, the second optical element 102 and the display screen 103. The image light beam generated by the display screen 103 can be refracted by the second optical element 102 and the first optical element 101 and then enter the pupil 104, so that the user can see a magnified virtual image.
[0051] Optionally, the camera 104 may be arranged in front of the human eye plane, and the position includes but is not limited to the position shown in the figure. Figure 1B It is assumed that the camera 104 is disposed between the display screen 103 and the human eye plane. The camera 104 may be an eye tracking camera for eye tracking. The camera 104 is used to capture an eye image so that the near-eye display device can perform eye tracking based on the eye image, for example, to determine the user's pupil position offset.
[0052] It should be noted that Figure 1B In the example, the first optical element includes one optical lens. In other embodiments, the first optical element may include multiple optical lenses. Figure 1B In the embodiment, it is taken that the second optical element includes one optical lens. In other embodiments, the second optical element may include multiple optical lenses.
[0053] The above-mentioned near-eye display device is designed for users with normal eyes. For near / farsighted users, directly wearing the near-eye display device cannot obtain the clearest image perception. There are currently two solutions.
[0054] One method is that the user manually adjusts the position of the second optical element 102 in the near-eye display module. Figure 1B As shown, the second optical element 102 in the near-eye display module can move in the direction of the optical axis of the near-eye display module. When the position of the second optical element 102 relative to the first optical element 101 is different, the diopter of the near-eye display module is different. The diopter mentioned in the embodiment of the present application may include: myopia degree and hyperopia degree. The diopter of the near-eye display module can be used to adapt to the user's eye degree. The eye degree here includes: myopia degree and hyperopia degree. The user manually adjusts the position of the second optical element 102 relative to the first optical element 101 to change the diopter of the near-eye display module so that the diopter of the near-eye display module adapts to the user's eye degree.
[0055] Another method is to add a myopia / hyperopia patch to the near-eye display module of the near-eye display device or to have the user wear the near-eye display module after wearing his or her own glasses, thereby adapting the user's eye degree through the myopia / hyperopia patch or the user's glasses.
[0056] In the first method mentioned above, users need to adjust manually, which is difficult to operate. In the second method mentioned above, additional accessories and spare parts are required, which increases the weight, volume and cost of the near-eye display device.
[0057] To this end, an embodiment of the present application provides a method for measuring diopter, setting a marking point for each near-eye display module included in a near-eye display device, wherein a marking point can be directly or indirectly captured by a camera of the near-eye display module, and the position of the marking point on the image captured by the camera changes with the diopter. In other words, there is a mapping relationship between the position of the marking point on the image captured by the camera and the diopter, so that at different diopters, the position of the marking point in the image captured by the camera is different, and the diopter of the near-eye display device can be measured through the mapping relationship between the position of the marking point in the image captured by the camera and the diopter.
[0058] Furthermore, in the vision measurement method of the embodiment of the present application, the near-eye display device can automatically adjust the vision of the near-eye display device to the user's eye degree according to the user's eye degree, so that the near-eye display device automatically adapts to the user's eye degree, providing the user with a clear image perception and a better user experience.
[0059] Figure 2A A structural schematic diagram of a near-eye display device 100 provided in an embodiment of the present application is shown.
[0060] The near-eye display device 100 may include a processor 110 , a memory 120 , a near-eye display module 130 , and a marker 140 . The near-eye display module 130 may include: a display screen 131 , a first optical element 132 , a second optical element 133 , a focusing component 134 , and a camera 135 .
[0061] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the near-eye display device 100. In other embodiments of the present application, the near-eye display device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0062] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0063] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0064] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0065] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0066] The memory 120 can be used to store computer executable program codes, which include instructions. The memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data (such as image data) created during the use of the near-eye display device 100, etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the memory 120 by running instructions stored in the memory 120, and / or instructions stored in a memory provided in the processor.
[0067] The display screen 131 is used to display images.
[0068] The first optical element 132 is disposed between the display screen 131 and the human eye plane. The first optical element 132 may include one or more optical lenses.
[0069] The second optical element 133 is disposed between the display screen 131 and the human eye plane, and is used to adjust the focal length of the near-eye display module 130. The second optical element 133 may include one or more optical lenses.
[0070] The focusing component 134 is used to adjust the position of the second optical element 133 to adjust the focal length of the near-eye display module 130 .
[0071] The camera 135 is used to capture static images or videos to realize the user's eye tracking function. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the near-eye display module 130 may include one or more cameras 135.
[0072] The marking point 140 may be a scale groove, a fluorescent marking point (such as an infrared marking point), or a light emitting diode (LED) lamp, etc. In some embodiments, there may be one or more marking points 140. The marking point 140 may be specifically set on the lens surface of the first optical element 132, the lens skirt of the first optical element 132, and other non-effective areas of the lens, or may be set on the lens barrel, camera bracket, or display screen bracket of the near-eye display module, etc. Each marking point 140 may correspond to one near-eye display module 130, and each near-eye display module 130 may correspond to one or more marking points. In some embodiments, the marking points corresponding to the near-eye display module 130 may also be integrated into the near-eye display module 130 as a part of the near-eye display module 130.
[0073] Figure 2B The figure shows a software structure block diagram of a near-eye display device provided by an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces.
[0074] The embodiment of the present application takes the Android system as an example to illustrate the software structure of the first electronic device of the Android system. In some embodiments, the Android system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (also called: system framework layer), the system library and Android runtime layer, the hardware abstraction layer (HAL) and the kernel layer.
[0075] The application layer may include several applications (hereinafter referred to as applications), such as camera, gallery, calendar, WLAN, etc.
[0076] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer, including various components and services to support developers' Android development. The application framework layer also includes some predefined functions. For example, the application framework layer may include a window manager, a content provider, a resource manager, a camera service, etc.
[0077] The system library and Android runtime layer include the system library and Android runtime. The system library can include multiple functional modules. For example: surface manager, two-dimensional graphics engine, three-dimensional graphics processing library (for example: OpenGLES), media library, font library, etc. Among them, the browser kernel is responsible for interpreting the syntax of the web page (such as an application HTML, JavaScript under the standard universal markup language) and rendering (displaying) the web page; the two-dimensional graphics engine is used to implement two-dimensional graphics drawing, image rendering, synthesis and layer processing, etc.; the three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, synthesis and layer processing, etc.; the media library is used to implement the input of different streaming media; the font library is used to implement the input of different fonts. The Android runtime is responsible for the scheduling and management of the Android system, specifically including the core library and the virtual machine. Among them, the core library contains two parts: one part is the function function that needs to be called by the Java language, and the other part is the core library of Android; the virtual machine is used to run Android applications developed using the Java language.
[0078] The HAL layer is an interface layer between the operating system kernel and the hardware circuit. The HAL layer includes but is not limited to: the audio hardware abstraction layer (Audio HAL) and the camera hardware abstraction layer (Camera HAL). Among them, the Audio HAL is used to process the audio stream, for example, to perform noise reduction, directional enhancement, etc. on the audio stream, and the Camera HAL is used to process the image stream.
[0079] The kernel layer is the layer between hardware and software. The kernel layer may include: camera driver, near-eye display module driver, vision calculation module, vision adjustment module, etc.
[0080] It should be noted that the above-mentioned visibility calculation module and visibility adjustment module may also be located in other layers of Android, such as the application layer or the framework layer.
[0081] In the following embodiments, the embodiments of the present application will be described in detail in combination with the structure of the above-mentioned near-eye display device.
[0082] First, the coordinate system used in the embodiments of the present application is exemplified.
[0083] See also Figure 3When a user wears a near-eye display device, the human eye's viewing direction is the positive direction of the Z axis, the pupil distance from the right eye to the left eye is the X axis, and the vertical upward direction is the positive direction of the Y axis.
[0084] Figure 4 It is a flow chart of the method for measuring the visual acuity in an embodiment of the present application. In an embodiment of the present application, it is assumed that the near-eye display device includes a near-eye display module and a first marking point, and the near-eye display module includes: a camera, and the near-eye display module can correspond to the right eye or the left eye of the user. The position of the above-mentioned first marking point on the image taken by the camera has a mapping relationship with the visual acuity of the near-eye display module. In some embodiments, the first marking point can also be integrated into the near-eye display module as a part of the near-eye display module.
[0085] like Figure 4 As shown, the method may include:
[0086] Step 401: Acquire a first image captured by a camera.
[0087] Combination Figure 2B In this step, the visual acuity calculation module can obtain the first image taken by the camera included in the near-eye display module from the camera driver.
[0088] Step 402: Identify a first position of a first marking point from a first image.
[0089] Combination Figure 2B , this step can be performed by the visibility calculation module.
[0090] Optionally, this step may include:
[0091] Identifying an image region of a first marker point from the first image;
[0092] The position of the marking point in the first image is determined according to the image area of the first marking point.
[0093] In a possible implementation, if the first marking point can emit light, for example, the first marking point includes: a fluorescent marking point, an infrared marking point, or an LED light, etc., the image area for identifying the first marking point from the first image may include:
[0094] Identifying pixels whose brightness exceeds a preset first threshold from the first image;
[0095] An image region of the first marking point in the first image is determined according to the identified pixel points.
[0096] The specific implementation of determining the image area of the first marking point in the first image according to the identified pixel points can be achieved by referring to relevant image processing technology, which will not be described in detail here.
[0097] In a possible implementation, if the first marking point has a specific shape, for example, the first marking point includes: a scale groove, a fluorescent marking point, an infrared marking point, or an LED light with a specific shape, the image area for identifying the first marking point from the first image may include:
[0098] An image region including a preset graphic is identified from the first image, and the identified image region is determined as the image region of the marking point in the first image.
[0099] The above-mentioned specific shape is not limited in the embodiment of the present application, and can be, for example, a circle, a square, a triangle, etc.
[0100] The specific implementation of identifying the image region including the preset graphic from the first image can be implemented by referring to relevant image processing technology, which will not be described in detail here.
[0101] It should be noted that, with reference to subsequent embodiments, under the conditions that the position of the first marking point is constant and the moving range of the second optical element is constant, the possible position range of the image of the first marking point in the first image can be calculated. Based on this, when identifying the image area of the first marking point from the first image, it is possible to identify only within the possible position range of the image of the first marking point in the first image, thereby improving the recognition efficiency and recognition accuracy of the image area of the first marking point.
[0102] Optionally, the position of the marking point in the first image may include: pixel coordinates (x, y) of a designated pixel point in the image area of the first marking point.
[0103] The selection of the designated pixel point in this step is related to the physical position point of the first marker point selected in advance when performing parameter calibration. Since the different distances of the center point of the marker point relative to the optical center of the camera on the Z axis are used as examples in the subsequent embodiments, the designated pixel point in this step can be, for example, the center point of the image area of the first marker point. If parameter calibration is performed based on other physical position points of the marker point (such as the upper left corner vertex of the rectangular marker point) in the subsequent embodiments, the designated pixel point in this step can be the pixel point corresponding to the above other physical position points in the image area of the marker point (such as the upper left corner vertex of the image area).
[0104] Step 403: According to a preset mapping relationship between the position of the first marking point and the diopter, the diopter corresponding to the first position of the first marking point is determined to obtain the first diopter of the near-eye display module.
[0105] Combination Figure 2B , this step can be performed by the visibility calculation module.
[0106] Among them, based on the different setting positions of the first marker point on the near-eye display device and its corresponding diopter calculation principle, the mapping relationship between the position of the first marker point preset in the near-eye display device and the diopter can be implemented differently, please refer to the exemplary description of the following embodiments for details.
[0107] The embodiments of the present application can quickly and accurately obtain the current visual acuity of the near-eye display module of the near-eye display device through an existing camera while slightly increasing the cost of the near-eye display device (only one marking point is added for each near-eye display module).
[0108] Moreover, the embodiments of the present application can compensate for tolerances and improve accuracy through calibration and other means, and measure high-precision vision, which is beneficial to subsequent software-side image processing and improvement of user visual experience.
[0109] Optionally, the present application can be adapted to current mainstream VR / AR near-eye display devices such as straight-through optical paths, pancake folded optical paths, and birdbath optical paths, and the added first marker points can be flexibly placed in various positions of the near-eye display devices.
[0110] In another embodiment provided in the present application, if the first marking point is a luminous marking point, such as an infrared marking point, an LED light, etc., before step 401, the following may also be included: lighting up the first marking point.
[0111] Combination Figure 2B In this step, the visual calculation module can send an instruction to the driver of the first marking point, so that the driver of the first marking point lights up the first marking point based on the instruction.
[0112] In another embodiment provided in the present application, the near-eye display device can adjust the size of the image displayed by the near-eye display module, anti-distortion parameters and other software rendering parameters by calculating the first visual acuity of the near-eye display module, so as to solve the problems of non-fusion, dizziness and so on caused by visual acuity mismatch of the user, provide the user with a clearer picture and visual experience, and enhance the user's viewing experience.
[0113] Figure 5A It is a schematic diagram of the position of a first marking point and the vision measurement principle provided in an embodiment of the present application.
[0114] See also Figure 5A, it is assumed that the first optical element 101 and the second optical element 102 are respectively implemented by an optical lens. In order from near to far from the user's eye 105 are the first optical element 101, the second optical element 102, and the display screen 103. The positions of the first optical element 101 and the display screen 103 on the near-eye display device remain unchanged. In other words, the positions of the first optical element 101 and the display screen 103 relative to the user's eye 105 remain unchanged, that is, the distance Da in the Z-axis direction between the first optical element 101 and the plane where the eye 105 is located remains unchanged, and the distance Dc in the Z-axis direction between the display screen 103 and the plane where the eye 105 is located remains unchanged. The second optical element 102 can move in the Z-axis direction. In other words, the distance Db in the Z-axis direction between the first optical element 101 and the plane where the eye 105 is located can change, thereby changing the diopter of the near-eye display module. The camera 104 can be linked with the second optical element 102. In other words, when the second optical element 102 moves in the Z-axis direction, the camera 104 moves in the Z-axis direction accordingly, and the moving distance of the camera 104 in the Z-axis direction is equal to the moving distance of the second optical element in the Z-axis direction.
[0115] In the embodiment of the present application, the first marking point 106 set for the near-eye display module is located at the skirt position of the lens included in the first optical element 101, and there is no obstruction between the camera 104 and the first marking point 106, and the camera 104 can directly capture the first marking point 106.
[0116] In the embodiment of the present application, the distance in the Y-axis direction between the optical center of the camera of the camera 104 and the center point of the first marking point 106 is set as H, and the distance in the Z-axis direction is set as D. The angle between the optical axis of the camera and the negative Z-axis direction in the YZ plane with the optical center of the camera as the origin is set as θ, which is also called the tilt angle θ of the camera in the embodiment of the present application. For the convenience of description, in the following embodiments, the optical center of the camera of the camera 104 will also be referred to as the optical center of the camera 104.
[0117] See Figure 5A , during the diopter adjustment process, the adjustable distance range of the second optical element 102 from the plane where the eye 105 is located in the Z-axis direction is assumed to be [Db1, Db2], Db1 < Db2. Correspondingly, the adjustable distance range of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction is [D1, D2], D1 < D2.
[0118] In the embodiment of the present application, different distances of the second optical element 102 relative to the first optical element 101 in the Z-axis direction correspond to different diopters of the near-eye display device. Accordingly, different distances of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction also correspond to different diopters of the near-eye display module. In other words, there is a mapping relationship between the distance D of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction and the diopters of the near-eye display module. Based on this, under the condition that the tilt angle of the camera 104 remains unchanged, the distance of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction is different, and the position of the image of the first marking point 106 in the image taken by the camera 104 (such as the above-mentioned first image) is different, and there is also a mapping relationship between the two. Therefore, based on the position of the image of the first marking point 106 in the image taken by the camera 104, the distance D of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction can be determined, and then the focal length of the near-eye display module and the corresponding diopters (myopia / hyperopia) can be calculated according to the distance D.
[0119] Specifically, the functional relationship between the position of the first marking point 106 on the image captured by the camera 104 and the distance D can be calculated by the following calculation method.
[0120] F≈θ+ArcTAN(H / D)
[0121] Wherein, F is the angle between the optical axis of the camera 104 and the line connecting the optical center of the camera 104 and the center point of the first marking point 106 when the distance between the optical center of the camera 104 and the center point of the first marking point 106 in the Z-axis direction is D.
[0122] ArcTAN represents an inverse tangent function, which can be specifically implemented using an ATAN function in a near-eye display device.
[0123] Assuming the focal length of the camera is f and the pixel size is σ, then,
[0124] Y=f*TAN(F)
[0125] Y represents the distance between the center point of the first marking point 106 and the center point of the image on the camera 104 when the distance between the optical center of the camera 104 and the center point of the first marking point 106 in the Z-axis direction is D.
[0126] Accordingly, based on the distance D of the optical center of the camera 104 in the Z-axis direction relative to the center point of the first marking point 106, the pixel distance n of the position coordinates (x, y) of the image of the first marking point 106 in the image captured by the camera 104 relative to the pixel of the center point of the image can be calculated:
[0127] n=Y / σ=f*TAN(θ+ArcTAN(H / D)) / σ.
[0128] See also Figure 5B In the image captured by the camera 104, based on the position coordinates (x, y) of the first marking point 106 in the image and the coordinates (x0, y0) of the center point of the image, the above pixel distance n can also be calculated:
[0129] n=((x0-x) 2 +(y y0) 2 ) 1 /
[0130] Thus, the functional relationship between the position coordinates (x, y) of the first marking point 106 in the image and the above distance D can be obtained as follows:
[0131] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(θ+ArcTAN(H / D)) / σ.
[0132] According to the above functional relationship, we can get the function D=f(x, y) of the distance D based on the variables x and y.
[0133] Taking the distance D of the optical center of the camera 104 in the Z-axis direction relative to the center point of the first marking point 106 as the minimum value D1 as an example, at this time, the functional relationship between the position of the first marking point 106 on the image taken by the camera 104 and the above D1 can be calculated by the following calculation method.
[0134] F1≈θ+ArcTAN(H / D1)
[0135] Y1=f*TAN(F1)
[0136] n 1=Y 1 / σ=f*TAN(θ+ArcTAN(H / D1)) / σ.
[0137] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(θ+ArcTAN(H / D1)) / σ.
[0138] Among them, F1 is the angle between the line between the optical center of camera 104 and the center point of the first marking point 106 and the optical axis of camera 104 when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D1; Y1 represents the distance between the center point of the first marking point 106 on the image of camera 104 and the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D1; n1 is the pixel distance of the position coordinates (x, y) of the image of the first marking point 106 in the image taken by camera 104 relative to the pixel of the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D1.
[0139] Taking the example that the distance D between the optical center of the camera 104 and the center point of the first marking point 106 in the Z-axis direction is the maximum value D2, at this time, the functional relationship between the position of the first marking point 106 on the image taken by the camera 104 and the above D2 can be calculated by the following calculation method.
[0140] F2≈θ+ArcTAN(H / D2)
[0141] Y2=f*TAN(F2)
[0142] n 2=Y 2 / σ=f*TAN(θ+ArcTAN(H / D2)) / σ.
[0143] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(θ+ArcTAN(H / D2)) / σ.
[0144] Among them, F2 is the angle between the line between the optical center of camera 104 and the center point of the first marking point 106 and the optical axis of camera 104 when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D2; Y2 represents the distance between the center point of the first marking point 106 on the image of camera 104 and the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D2; n2 is the pixel distance of the position coordinates (x, y) of the image of the first marking point 106 in the image taken by camera 104 relative to the pixel of the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D2.
[0145] In addition, under the condition determined by the near-eye display module in the near-eye display device, parameter calibration can be performed in advance based on the adjustable distance range [D1, D2] of the distance D and the adjustable visual acuity range [A1, A2] corresponding to the near-eye display module to obtain the functional relationship A=f(D) between the distance D and the visual acuity A of the near-eye display module. The functional relationship between the distance D and the visual acuity A of the near-eye display module can be called the mapping relationship between the distance D and the visual acuity A of the near-eye display module.
[0146] In one embodiment, the parameter calibration method may be, for example, measuring the visual acuity A of the near-eye display module corresponding to different distances D in the adjustable distance range [D1, D2], obtaining a curve of the visual acuity A based on the distance D, and then determining the above functional relationship A=f(D).
[0147] based on Figure 5A and Figure 5B The setting position and calculation principle of the first marking point 106 are shown. In step 403, the near-eye display device may preset the function D=f(x, y) of the distance D based on the variables x and y, and the function A=f(D) of the visual acuity based on the distance D for the near-eye display module; accordingly, step 403 may include:
[0148] Based on the function D=f(x, y) of the variables x, y based on the distance D preset in the near-eye display device, the distance D of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction is calculated using the position coordinates (x, y) of the first marking point in the first image;
[0149] Based on the above-mentioned function A=f(D) of the diopter A based on the distance D preset in the near-eye display device, the diopter A of the near-eye display module is calculated using the distance D.
[0150] When the near-eye display device adjusts the diopter so that the distance between the optical center of the camera and the center point of the first marking point 106 on the Z axis is between D1 and D2, the diopter of the near-eye display module can be directly determined by the position of the first marking point on the image taken by the camera, thereby realizing the diopter measurement of the near-eye display module, which is beneficial to subsequent software-side image processing and improvement of user visual experience.
[0151] Different from the above embodiment where the first marking point is located at the edge of the lens, in another embodiment, the first marking point 106 may be located on the lens of the optical lens included in the first optical element. Specifically, the first marking point 106 may be located at any position on the lens of the optical lens, for example Figure 6 The center position of the lens shown in , as long as the camera can directly capture the first marking point.
[0152] See also Figure 6Specifically, the functional relationship between the position of the first marking point 106 on the image captured by the camera 104 and the above distance D can be calculated by the following calculation method.
[0153] F≈ArcTAN(H / D)-θ
[0154] Y=f*TAN(F)
[0155] Wherein, F is the angle between the optical axis of the camera 104 and the line between the optical center of the camera 104 and the center point of the first marking point 106 when the distance in the Z-axis direction from the optical center of the camera 104 to the center point of the first marking point 106 is D. Y represents the distance of the center point of the first marking point 106 on the image of the camera 104 relative to the center point of the image when the distance in the Z-axis direction from the optical center of the camera 104 to the center point of the first marking point 106 is D.
[0156] Accordingly, based on the distance D of the optical center of the camera 104 in the Z-axis direction relative to the center point of the first marking point 106, the pixel distance n of the position coordinates (x, y) of the image of the first marking point 106 in the image captured by the camera 104 relative to the pixel of the center point of the image can be calculated:
[0157] n=Y / σ=f*TAN(ArcTAN(H / D)-θ) / σ.
[0158] Furthermore, based on the position coordinates (x, y) of the first marking point 106 in the image and the coordinates (x0, y0) of the center point of the image, the above-mentioned pixel distance n can also be calculated:
[0159] n=((x0-x) 2 +(y y0) 2 ) 1 /
[0160] Thus, the functional relationship between the position coordinates (x, y) of the first marking point 106 in the image and the above distance D can be obtained as follows:
[0161] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(ArcTAN(H / D)-θ) / σ.
[0162] According to the above functional relationship, we can get the function D=f(x, y) of the distance D based on the variables x and y.
[0163] Taking the distance D of the optical center of the camera 104 in the Z-axis direction relative to the center point of the first marking point 106 as the minimum value D1 as an example, at this time, the functional relationship between the position of the first marking point 106 on the image taken by the camera 104 and the above D1 can be calculated by the following calculation method.
[0164] F1≈ArcTAN(H / D1)-θ
[0165] Y1=f*TAN(F1)
[0166] n 1=Y 1 / σ=f*TAN(ArcTAN(H / D1)-θ) / σ.
[0167] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(ArcTAN(H / D1)-θ) / σ.
[0168] Among them, F1 is the angle between the line between the optical center of camera 104 and the center point of the first marking point 106 and the optical axis of camera 104 when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D1; Y1 represents the distance between the center point of the first marking point 106 on the image of camera 104 and the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D1; n1 is the pixel distance of the position coordinates (x, y) of the image of the first marking point 106 in the image taken by camera 104 relative to the pixel of the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D1.
[0169] Taking the example that the distance D between the optical center of the camera 104 and the center point of the first marking point 106 in the Z-axis direction is the maximum value D2, at this time, the functional relationship between the position of the first marking point 106 on the image taken by the camera 104 and the above D2 can be calculated by the following calculation method.
[0170] F2≈ArcTAN(H / D2)-θ
[0171] Y2=f*TAN(F2)
[0172] n 2=Y 2 / σ=f*TAN(ArcTAN(H / D2)-θ) / σ.
[0173] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(ArcTAN(H / D2)-θ) / σ.
[0174] Among them, F2 is the angle between the line between the optical center of camera 104 and the center point of the first marking point 106 and the optical axis of camera 104 when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D2; Y2 represents the distance between the center point of the first marking point 106 on the image of camera 104 and the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D2; n2 is the pixel distance of the position coordinates (x, y) of the image of the first marking point 106 in the image taken by camera 104 relative to the pixel of the center point of the image when the distance between the optical center of camera 104 and the center point of the first marking point 106 in the Z-axis direction is D2.
[0175] For other implementations, such as the specific implementation of step 403, please refer to Figure 5A and Figure 5B The relevant instructions are not repeated here.
[0176] In an embodiment of the present application, the position of the first mark point is placed on the optical lens. By increasing the distance H between the optical center of the camera lens and the center point of the first mark point 51 on the Y-axis, the position change of the first mark point in the image taken by the camera during the vision adjustment process is increased, thereby further improving the calibration accuracy and obtaining high-precision vision, which is beneficial to subsequent software-side image processing and improvement of user visual experience.
[0177] Different from the above embodiment in which the camera 104 directly photographs the first marking point, in another embodiment provided in the present application, the position of the first marking point 106 cannot be directly photographed by the camera 104, but the camera 104 can photograph the image of the first marking point on the reflective film of the second optical element 102. For ease of explanation, in the embodiment of the present application, the image of the first marking point 106 on the reflective film of the second optical element 102 is also referred to as the reflected image of the first marking point 106. The following is an exemplary description.
[0178] See also Figure 7, assume that the first optical element 101 and the second optical element 102 are respectively implemented by an optical lens. From near to far according to the distance from the user's eyes 105 are the first optical element 101, the second optical element 102, and the display screen 103. The positions of the first optical element 101, the display screen 103, and the camera 104 on the near-eye display device remain unchanged. In other words, the positions of the first optical element 101, the display screen 103, and the camera 104 relative to the user's eyes 105 remain unchanged. That is, the distance Da in the Z-axis direction between the first optical element 101 and the plane where the eyes 105 are located remains unchanged, the distance Dc in the Z-axis direction between the display screen 103 and the plane where the eyes 105 are located remains unchanged, and the distance in the Z-axis direction between the center point of the camera 104 and the plane where the eyes 105 are located also remains unchanged. The second optical element 102 can move in the Z-axis direction. In other words, the distance Db in the Z-axis direction between the first optical element 101 and the plane where the eyes 105 are located can change, thereby changing the diopter of the near-eye display module.
[0179] In the embodiment of the present application, the first marking point 106 set for the near-eye display module is located on the lens barrel of the near-eye display module. Although the first marking point 106 is not within the shooting range of the camera 104, that is, the camera 104 cannot directly shoot the first marking point 106, however, due to the presence of a reflective film on the surface of the second optical element 102, the camera 104 can shoot the image of the first marking point 106 formed on the reflective film of the second optical element 102, that is, the reflective image of the first marking point 106 on the second optical element 102 can be shot.
[0180] In the embodiment of the present application, the distance between the optical center of the camera 104 and the inner wall of the lens barrel of the near-eye display module is set as H', and the distance from the optical axis of the lens barrel of the near-eye display module is set as H; the distance in the Z-axis direction between the center point of the first marking point 106 and the first plane of the second optical element 102 is set as K, and the angle of the optical axis of the camera relative to the negative Z-axis direction in the YZ plane with the optical center of the camera as the origin is set as θ, which is called the tilt angle θ of the camera in the embodiment of the present application.
[0181] See Figure 7 , during the diopter adjustment process, the adjustable distance range of the second optical element 102 from the plane where the eyes 105 are located in the Z-axis direction is assumed to be [Db1, Db2], Db1 < Db2. Correspondingly, the adjustable distance range of the center point of the first marking point 106 from the first plane of the second optical element 102 in the Z-axis direction is [K1, K2], K1 < K2.
[0182] In the embodiment of the present application, different distances of the second optical element 102 relative to the first optical element 101 in the Z-axis direction correspond to different dioptrices of the near-eye display device. Correspondingly, different distances between the center point of the first marking point 106 and the first plane of the second optical element 102 in the Z-axis direction also correspond to different dioptrices of the near-eye display module. In other words, there is a mapping relationship between the distance K between the center point of the first marking point 106 and the first plane of the second optical element 102 in the Z-axis direction and the dioptrices of the near-eye display module. Based on this, under the condition that the tilt angle of the camera 104 remains unchanged, the distance K between the center point of the first marking point 106 and the first plane of the second optical element 102 in the Z-axis direction is different, and the position of the reflected image of the first marking point 106 in the image taken by the camera 104 (for example, the above-mentioned first image) is different, and there is also a mapping relationship between the two. Therefore, based on the position of the image of the reflected image of the first marking point 106 in the image taken by the camera 104, the distance K between the center point of the first marking point 106 and the first plane of the second optical element 102 in the Z-axis direction can be determined, and then the focal length of the near-eye display module and the corresponding diopter (myopia / hyperopia degree) can be calculated based on the distance K.
[0183] See also Figure 7 Specifically, the functional relationship between the position of the first marking point 106 on the image captured by the camera 104 and the above distance K can be calculated by the following calculation method.
[0184] Assume that the deviation angle of the position of the reflection image of the first mark point on the reflection film relative to the optical axis of the camera is E, that is, the deviation angle between the line connecting the position of the reflection image and the optical center of the camera 104 and the optical axis of the camera 104 is E.
[0185] Under certain conditions of the near-eye display module of the near-eye display device, the position of the first marking point is certain, the adjustable range of the second optical element 102 on the Z-axis is certain, the inclination angle of the camera 104 is certain, and the surface shape of the surface where the reflective film of the second optical element 102 is located is certain. Therefore, the deflection angle E can be determined in advance through parameter calibration as a function E=f(K) based on the above-mentioned distance K.
[0186] In one embodiment, the function E=f(K) of the deflection angle E based on the above-mentioned distance K can be achieved, for example, by the following parameter calibration method: within the adjustable range of the distance K, the deflection angles E corresponding to multiple different distances K are measured, thereby obtaining a curve of the deflection angle E based on the distance K, and based on the curve, the function E=f(K) of the deflection angle E based on the above-mentioned distance K can be determined.
[0187] Under the condition that the deflection angle E is determined based on the function E=f(K) of the above distance K, the following formula can be further obtained:
[0188] Y = f*TAN(f(K));
[0189] n=Y / σ;
[0190] n=((x0-x) 2 +(y y0) 2 ) 1 /
[0191] Wherein, Y represents the distance between the center point of the reflected image of the first marking point 106 and the first plane of the second optical element 102 in the Z-axis direction as K, and the center point of the reflected image of the first marking point 106 on the image of the camera 104 relative to the center point of the image; n represents the pixel distance of the position coordinates (x, y) of the image of the reflected image of the first marking point 106 in the image taken by the camera 104 relative to the pixel (x0, y0) of the center point of the image.
[0192] Based on the above formula, the functional relationship between the position coordinates (x, y) of the first marking point 106 in the image and the above distance K can be obtained as follows:
[0193] ((x0-x) 2 +(y y0) 2 ) 1 / =f*TAN(f(K)) / σ.
[0194] According to the above functional relationship, we can get the function K=f(x, y) where the distance K is based on the variables x and y.
[0195] In addition, under the condition determined by the near-eye display module in the near-eye display device, parameter calibration can be performed in advance based on the adjustable distance range [K1, K2] of the distance K and the adjustable visual acuity range [A1, A2] corresponding to the near-eye display module to obtain the functional relationship A=f(K) between the distance D and the visual acuity A of the near-eye display module.
[0196] Thus, based on Figure 7 The setting position and calculation principle of the first marking point 106 are shown. In step 403, the near-eye display device may preset the function K=f(x, y) of the distance K based on the variables x and y, and the function A=f(K) of the visual acuity based on the distance K for the near-eye display module; accordingly, step 403 may include:
[0197] Based on the function K=f(x, y) of the variables x, y based on the distance K preset in the near-eye display device, the distance K of the optical center of the camera 104 relative to the center point of the first marking point 106 in the Z-axis direction is calculated using the position coordinates (x, y) of the first marking point in the first image;
[0198] Based on the above-mentioned function A=f(K) of the diopter A based on the distance K preset in the near-eye display device, the diopter A of the near-eye display module is calculated using the distance K.
[0199] When the near-eye display device adjusts the diopter so that the distance between the optical center of the camera and the center point of the first marking point 106 on the Z axis is between K1 and K2, the diopter of the near-eye display module can be directly determined by the position of the first marking point on the image taken by the camera, thereby realizing the diopter measurement of the near-eye display module, which is beneficial to subsequent software-side image processing and improvement of user visual experience.
[0200] In an embodiment of the present application, a first marking point is placed on the lens barrel of a near-eye display module, and the reflection effect of a 50 / 50 reflection film of a folded optical path is utilized to measure the visual acuity of the near-eye display module. The visual acuity measurement method of an embodiment of the present application can be applied to a near-eye display module of a folded optical path, and is particularly suitable for situations where the skirt and surface of the lens are not suitable for placing marking points, thereby expanding the scope of application of the visual acuity measurement method of an embodiment of the present application.
[0201] Different from the above embodiment where the first marking point is located on the lens barrel, in another embodiment, the first marking point 106 may be located on a support of the camera 104 or a support of the display screen 103, see Figure 8 , taking the first marking point 106 being located on the bracket of the display screen 103 as an example.
[0202] based on Figure 8 The location of the first marking point and the principle of vision measurement can be referred to Figure 7 The corresponding instructions are not repeated here.
[0203] In an embodiment of the present application, a first marking point is placed on a display screen bracket, and the reflection effect of a 50 / 50 reflection film of a folded optical path is utilized to measure the visual acuity of a near-eye display module. The visual acuity measurement method of an embodiment of the present application can be applied to a near-eye display module of a folded optical path, and is particularly suitable for situations where the lens skirt of a first optical element, the lens surface, or the lens barrel of a near-eye display module is not suitable for placing a marking point, thereby expanding the scope of application of the visual acuity measurement method of an embodiment of the present application.
[0204] In the above embodiments, setting the first marking point for the near-eye display module is taken as an example. In other embodiments, at least two marking points may be set for each near-eye display module, as exemplified below.
[0205] In one embodiment, the first marking point can be used as the main marking point and the other marking points can be used as backup marking points, so that even if the first marking point has problems due to mechanical reasons such as falling, temperature changes, etc. after the near-eye display device leaves the factory, the near-eye display device can still accurately measure the visual acuity of the near-eye display module.
[0206] In another embodiment, the near-eye display device may further include: at least two second marking points, different second marking points are located at different positions of the near-eye display module, and the near-eye display device can measure the near-eye display module based on different second marking points. The visual range is at least partially different. Optionally, the at least two second marking points may also be integrated into the near-eye display module as a part of the near-eye display module.
[0207] The setting position of each second marking point can refer to the description of the setting position of the aforementioned first marking point. For example, the second marking point can be located on the first optical element 101 including the skirt position of the lens, on the lens, on the lens barrel of the near-eye display module, on the display screen bracket, on the bracket of the camera 104, etc.
[0208] In an embodiment of the present application, the near-eye display device can perform a preliminary measurement of the visual acuity of the near-eye display module based on a first marking point, and then perform a more accurate measurement based on the visual acuity range of the near-eye display module using a second marking point corresponding to the visual acuity range.
[0209] The visual acuity measurement method of the embodiment of the present application is particularly suitable for situations where a near-eye display device cannot accurately measure all the visual acuities within the adjustable visual acuity range of the near-eye display module through a single marking point.
[0210] For example, in certain scenarios, due to limitations such as the position of the marking point on the near-eye display device, although the near-eye display device can measure all the diopter within the adjustable diopter range of the near-eye display module based on the first marking point, the measurement accuracy is poor. The near-eye display device can only accurately measure the diopter within a part of the adjustable diopter range of the near-eye display module based on each second marking point, but cannot accurately measure all the diopter within the adjustable diopter range of the near-eye display module. The diopter measurement method of the embodiment of the present application can realize the accurate measurement of the diopter of the near-eye display module in the above-mentioned scenario.
[0211] Optionally, the visual acuity range of the near-eye display module measurable by the near-eye display module based on the first marking point may be the adjustable visual acuity range of the near-eye display module; the visual acuity range of the near-eye display module measurable by the near-eye display device based on each second marking point may be a subset of the near-eye display module; the union of the visual acuity ranges of the near-eye display module measurable by the near-eye display device based on different second marking points is the adjustable visual acuity range of the near-eye display module.
[0212] For example, assume there are a second marking point 1 and a second marking point 2, and the adjustable viewing range of the near-eye display module is [A1, A2]. Among them, the viewing range of the near-eye display module that can be measured by the near-eye display device based on the second marking point 1 can be, for example, [A1, A3], and the viewing range of the near-eye display module that can be measured by the near-eye display device based on the second marking point 2 can be, for example, [A4, A2], where A1 < A4 ≤ A3 < A2. Thus, the viewing range that can be measured by the near-eye display device based on multiple second marking points can cover the adjustable viewing range of the near-eye display module.
[0213] See Fig. 9 , the viewing degree measurement method of the embodiment of the present application relative to Figure 4 the method shown, after step 403, may further include:
[0214] Step 901: According to the corresponding relationship between the preset viewing range and the second marking point, determine the second marking point corresponding to the viewing range to which the first viewing degree belongs as the target marking point.
[0215] The above viewing range is a subset of the adjustable viewing range of the near-eye display module.
[0216] Optionally, the adjustable viewing range of the near-eye display module can be divided according to the viewing range that can be accurately measured by the near-eye display device based on each second marking point. Each divided viewing range corresponds to a second marking point, and the viewing range corresponding to each second marking point is the viewing range that can be accurately measured by the near-eye display device based on this second marking point or a subset of the viewing range that can be accurately measured by the near-eye display device based on this second marking point.
[0217] For example, continuing the previous example, the viewing range corresponding to the second marking point 1 can be preset as [A1, A3] in the near-eye display device, and the viewing range corresponding to the second marking point 2 can be (A3, A2]: Assume the first viewing degree is A5, and A5 is within the viewing range [A1, A3], then the second marking point corresponding to the viewing range to which the first viewing degree belongs is the second marking point 1, and the second marking point 1 is determined as the target marking point.
[0218] Step 902: Identify the second position of the target marking point from the first image.
[0219] The implementation of this step can refer to step 402.
[0220] Optionally, due to the different setting positions of the first marking point and the second marking point, the possible position ranges of the marking points in the first image are different. In this step, the image areas and positions of different marking points can be distinguished based on the different position ranges of different marking points in the first image; or, the above-mentioned first marking point, second marking point, etc. can have different shapes, so that the image of the marking point in the first image has different shapes, and the image areas and positions of different marking points can also be distinguished by the above-mentioned shapes.
[0221] Step 903: According to a preset mapping relationship between the position of the target marking point and the diopter, the diopter corresponding to the second position of the target marking point is determined to obtain the second diopter of the near-eye display module.
[0222] Continuing with the aforementioned distance, in step 901, the second marking point 1 is used as the target marking point. In this step, the visual acuity corresponding to the second position of the second marking point 1 can be determined based on the mapping relationship between the position of the second marking point 1 and the visual acuity, that is, the visual acuity corresponding to the second position of the target marking point is determined, and the second visual acuity of the near-eye display module is obtained.
[0223] It should be noted that the mapping relationship between the position of different second marking points in the image and the diopter can be preset in the near-eye display device. The mapping relationship between the position of the target marking point and the diopter in this step is also the mapping relationship between the position of the second marking point serving as the target marking point and the diopter.
[0224] In the embodiment of the present application, the second diopter can be used as the measured diopter of the near-eye display module. The second diopter is more accurate than the first diopter, thereby achieving more accurate diopter measurement for the near-eye display module.
[0225] In yet another embodiment, the near-eye display device may further include: a third marking point. Optionally, the third marking point may also be integrated into the near-eye display module as a part of the near-eye display module.
[0226] The setting position of the third marking point can refer to the description of the setting position of the first marking point mentioned above. For example, the third marking point can be located on the first optical element 101 including the skirt position of the lens, on the lens, on the lens barrel of the near-eye display module, on the display screen bracket, on the bracket of the camera 104, etc.
[0227] The first marking point and the third marking point may be located at different positions of the near-eye display device, for example, the first marking point is located at the lens skirt of the first optical element, the third marking point is located on the lens barrel, and so on.
[0228] In an embodiment of the present application, the visual range of the near-eye display module measurable by the near-eye display module based on the first marking point may be a subset of the adjustable visual range of the near-eye display module; the visual range of the near-eye display module measurable by the near-eye display device based on the third marking point may be the adjustable visual range of the near-eye display module or a subset of the adjustable visual range; the union of the visual range of the near-eye display module measurable by the near-eye display module based on the first marking point and the visual range of the near-eye display module measurable by the near-eye display device based on the third marking point is the adjustable visual range of the near-eye display module.
[0229] The visual acuity measurement method of the embodiment of the present application is particularly suitable for situations where the near-eye display device cannot measure all the visual acuities within the adjustable visual acuity range of the near-eye display module through the first marking point.
[0230] For example, in scenario one, due to limitations such as the position of the first marking point on the near-eye display device, the near-eye display device can only measure the visual acuity of a partial visual range (assuming visual acuity range 1) within the adjustable visual acuity range of the near-eye display module based on the first marking point, and the near-eye display device can only measure the visual acuity of a partial visual range (assuming visual acuity range 2) within the adjustable visual acuity range of the near-eye display module based on the third marking point, and the combination of visual acuity range 1 and visual acuity range 2 is the adjustable visual acuity range of the near-eye display module.
[0231] Alternatively, in scenario two, due to limitations such as the position of the marking point on the near-eye display device, the near-eye display device can only measure the visual acuity of a part of the adjustable visual acuity range of the near-eye display module (assuming it is visual acuity range 1) based on the first marking point, and although the near-eye display device can measure the visual acuity within the adjustable visual acuity range of the near-eye display module based on the third marking point, within visual acuity range 1, the visual acuity measured by the near-eye display device based on the third marking point is less accurate than the visual acuity measured based on the first marking point.
[0232] In the above scenario, the visual acuity measurement method of the embodiment of the present application can be used to measure the visual acuity within the visual acuity range 1 based on the first marking point, and to measure the visual acuity of the remaining visual acuity range within the adjustable visual acuity range based on the third marking point.
[0233] See also Fig.10 The visual acuity measurement method of the present application embodiment is relative to Figure 4 The method shown, after step 401, may further include:
[0234] Step 1001: When a first position of a first marking point cannot be identified from a first image, a third position of a third marking point is identified from the first image.
[0235] The implementation of this step may refer to step 902 and will not be described in detail here.
[0236] Step 1002: Determine the diopter corresponding to the third position of the third marking point according to a preset mapping relationship between the position of the third marking point and the diopter, and obtain the third diopter of the near-eye display module.
[0237] The implementation of step 1002 may refer to step 403 and will not be described in detail here.
[0238] Optionally, the ranges of the visual range 1 and the visual range 2 in the above scenario 1 may partially overlap. At this time, in other embodiments provided in the present application, the visual range 1 and the visual range 2 overlapping range may be measured based on the first marking point or based on the third marking point, and the specific implementation of the embodiments of the present application will not be repeated.
[0239] In yet another embodiment, the near-eye display device may further include: a fourth marking point. Optionally, the fourth marking point may also be integrated into the near-eye display module as a part of the near-eye display module.
[0240] The setting position of the fourth marking point can refer to the description of the setting position of the first marking point mentioned above. For example, the fourth marking point can be located at the skirt position of the first optical element 101 including the lens, on the lens, on the lens barrel of the near-eye display module, on the display screen bracket, on the bracket of the camera 104, etc.
[0241] The first marking point and the fourth marking point may be located at different positions of the near-eye display device, for example, the first marking point is located at the lens skirt of the first optical element, the fourth marking point is located on the lens barrel, and so on.
[0242] Examples of applicable scenarios of the vision measurement method in the embodiment of the present application are as follows:
[0243] In some scenarios, although the visual range of the near-eye display module measurable based on the first marking point and the fourth marking point may be the adjustable visual range of the near-eye display module, only the visual range of a part of the visual range within the adjustable visual range of the near-eye display module (hereinafter referred to as visual range 3) can be accurately measured, and the near-eye display device can only accurately measure the visual range of a part of the visual range within the adjustable visual range of the near-eye display module (hereinafter referred to as visual range 4) based on the fourth marking point, and the combination of visual range 3 and visual range 4 is the adjustable visual range of the near-eye display module.
[0244] At this time, see Fig.11 The visual acuity measurement method of the present application embodiment is relative to Figure 4 The difference of the method shown is that the following steps are added after step 402:
[0245] Step 1101: Determine whether the first position of the first marking point is located in a preset image area. If so, execute step 403; otherwise, execute step 1102.
[0246] Optionally, the preset image area can be determined according to the visual range 3. Since there is a mapping relationship between the visual range of the near-eye display module and the position of the first marking point in the first image, the image area can be determined based on the positions in the first image corresponding to the two end points of the visual range 3. For a specific determination method, please refer to the aforementioned Figure 5A to Figure 8 The corresponding instructions in are not repeated here.
[0247] Step 1102: Identify a fourth position of a fourth marking point from the first image.
[0248] The implementation of this step may refer to step 902 and will not be described in detail here.
[0249] Step 1103: Determine the diopter corresponding to the fourth position of the fourth marking point according to the preset mapping relationship between the position of the fourth marking point and the diopter, and obtain the fourth diopter of the near-eye display module.
[0250] The implementation of step 1103 may refer to step 403 and will not be described in detail here.
[0251] It should be noted that the above Fig.10 and Fig.11 The method shown can be extended to scenarios including 3 or more marking points, and the specific implementation of the embodiments of the present application will not be described in detail.
[0252] In another embodiment, the first diopter may be calibrated using the diopter measured based on other marking points to improve the measurement accuracy of the diopter of the near-eye display module by the near-eye display device.
[0253] Optionally, the near-eye display module may further include: a fifth marking point. The setting position of the fifth marking point may refer to the setting position of the first marking point in the aforementioned embodiment, for example, the fifth marking point may be located at the skirt position of the lens including the first optical element 101, on the lens, on the lens barrel of the near-eye display module, on the display screen bracket, on the bracket of the camera 104, etc.
[0254] Optionally, the fifth marking point may also be integrated into the near-eye display module as a part of the near-eye display module.
[0255] See also Fig.12 ,exist Figure 4 Based on the method shown, the visual acuity measurement method of the embodiment of the present application may further include, after step 401:
[0256] Step 1201: Identify a fifth position of a fifth marker point from the first image.
[0257] The implementation of this step may refer to step 902 and will not be described in detail here.
[0258] Step 1202: Determine the diopter corresponding to the fifth position of the fifth marking point according to the preset mapping relationship between the position of the fifth marking point and the diopter, and obtain the fifth diopter of the near-eye display module.
[0259] The implementation of this step may refer to step 403 and will not be described in detail here.
[0260] Step 1203: calibrate the first diopter according to the fifth diopter to obtain a sixth diopter of the near-eye display module.
[0261] The above calibration process may include, for example: determining an adjustment step according to the difference between the first and fifth diopter, adjusting the first diopter toward the fifth diopter according to the step to obtain the sixth diopter; or calculating the average of the first and fifth diopter as the sixth diopter; and so on.
[0262] Optionally, there is a proportional relationship between the difference between the first diopter and the fifth diopter and the step length, and the proportional coefficient is not limited in the embodiment of the present application.
[0263] In an embodiment of the present application, the near-eye display device can measure the visual acuity of the near-eye display module based on two marking points respectively, and calibrate the first visual acuity through the fifth visual acuity, so that the calibrated sixth visual acuity can be more accurate relative to the first visual acuity, thereby improving the measurement accuracy of the near-eye display device on the visual acuity of the near-eye display module.
[0264] Optionally, the first marking point and the fifth marking point may be set at different positions, and the first marking point and the fifth marking point may be set at different positions according to the above Figure 5A to Figure 8 Different setting positions are set, for example, the first marking point is set at the skirt position of the lens, the fifth marking point is set on the lens, on the lens barrel, or on the display screen bracket, etc., so as to further improve the measurement accuracy of the near-eye display device for the visual acuity of the near-eye display module.
[0265] It should be noted that the embodiment of the present application can be expanded from the above-mentioned first marking point and fifth marking point to 3 or more marking points. At this time, the first visual acuity can be calibrated using the visual acuity corresponding to the marking points other than the first marking point. The specific calibration method is not limited in the embodiment of the present application.
[0266] Fig.13 is a flow chart of a method for measuring visual acuity provided in an embodiment of the present application. Figure 4Based on the method shown, the near-eye display device can further adjust the diopter of the near-eye display module to the user's eye degree according to the diopter of the near-eye display module detected in real time, so that the diopter of the near-eye display module matches the user's eye degree, providing the user with a clear image perception and a better user experience.
[0267] See also Fig.13 , the method comprising:
[0268] Step 1301: The near-eye display device detects a trigger condition for adjusting the diopter of the near-eye display module.
[0269] Optionally, the user may input the eye degree in the near-eye display device, and then trigger the near-eye display device to adjust the diopter of the near-eye display module by confirming the operation, etc.; or the user successfully logs into the account in the near-eye display device, thereby triggering the near-eye display device to adjust the diopter of the near-eye display module. The user may log into the account in the near-eye display device in the way that includes but is not limited to: voice recognition, account name and password login, iris recognition, fingerprint recognition, etc.
[0270] Combination Figure 2B This step can be specifically performed by the vision adjustment module
[0271] Step 1302: The near-eye display device obtains the eye degree of the user corresponding to the near-eye display module.
[0272] Optionally, if the near-eye display module corresponds to the user's left eye, the degree of the user's left eye can be obtained in this step; if the near-eye display module corresponds to the user's right eye, the degree of the user's right eye can be obtained in this step.
[0273] Step 1303: The near-eye display device obtains the current visual acuity of the near-eye display module.
[0274] This step can be implemented by the visual acuity measurement method shown in the above embodiment.
[0275] Combination Figure 2B In this step, the vision adjustment module can specifically control the vision calculation module to perform real-time vision measurement and calculation, and obtain the current vision of the near-eye display module from the vision calculation module.
[0276] Step 1304: The near-eye display device calculates the difference between the current visual acuity of the near-eye display module and the visual acuity of the user's eyes, and when the difference is greater than a preset first difference threshold, executes step 1305.
[0277] Among them, when the difference is not greater than the preset first difference threshold, it means that the visual acuity of the near-eye display module matches the visual acuity of the user's eyes, and the near-eye display device may not perform the operation.
[0278] Combination Figure 2B This step can be specifically performed by the vision adjustment module.
[0279] Step 1305: The near-eye display device adjusts the diopter of the near-eye display module until the difference between the diopter of the near-eye display module and the diopter of the user's eyes is no greater than the first difference threshold.
[0280] In a possible implementation, the visual acuity of the near-eye display module may be adjusted according to different step sizes based on the size of the difference. For example, this step may include:
[0281] When the difference between the diopter of the near-eye display module and the diopter of the user's eyes is greater than a preset second difference threshold, adjusting the diopter of the near-eye display module according to the first step;
[0282] When the difference between the diopter of the near-eye display module and the diopter of the user's eyes is greater than a first difference threshold but not greater than a second difference threshold, the diopter of the near-eye display module is adjusted according to a second step length; the first step length is greater than the second step length.
[0283] Optionally, adjusting the visual acuity of the near-eye display module according to the first step may include:
[0284] The distance of the second optical element relative to the first optical element on the optical axis of the near-eye display module is adjusted according to the third step length.
[0285] Optionally, adjusting the visual acuity of the near-eye display module according to the second step length may include:
[0286] The distance of the second optical element relative to the first optical element on the optical axis of the near-eye display module is adjusted according to a fourth step length.
[0287] In another embodiment provided by the present application, each time the near-eye display device adjusts the diopter of the near-eye display module according to the step length, it can return to step 1303, measure the current diopter of the near-eye display module in real time, and then execute steps 1304 to 1305 until the difference between the diopter of the near-eye display module and the diopter of the user's eyes is not greater than the first difference threshold. Thus, the diopter adjustment accuracy of the near-eye display module can be improved.
[0288] Combination Figure 2B This step can be specifically performed by the diopter adjustment module. Specifically, the diopter adjustment module can send the determined step length (for example, the third step length or the fourth step length) to the near-eye display module driver, and the near-eye display module driver drives the focusing component 134 according to the received step length, so that the focusing component 134 adjusts the position of the second optical element 133 in the Z-axis direction according to the above step length.
[0289] An embodiment of the present application also provides a near-eye display device, comprising: a near-eye display module, a processor, a memory, and a first marker point; the near-eye display module comprises: a camera, and the position of the first marker point on the image taken by the camera has a mapping relationship with the visual acuity of the near-eye display module; wherein one or more computer programs are stored in the memory, and when the computer program is executed by the processor, the near-eye display device executes the method provided in the embodiment of the present application.
[0290] An embodiment of the present application also provides a near-eye display device, which includes a storage medium and a central processing unit. The storage medium may be a non-volatile storage medium, in which a computer executable program is stored. The central processing unit is connected to the non-volatile storage medium and executes the computer executable program to implement the method provided in the embodiment of the present application.
[0291] The embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the method provided by the embodiment of the present application.
[0292] The embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program is run on a computer, it enables the computer to execute the method provided by the embodiment of the present application.
[0293] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c can be single or multiple.
[0294] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0295] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0296] In several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as: ROM), random access memory (Random Access Memory; hereinafter referred to as: RAM), disk or optical disk, and other media that can store program codes.
[0297] The above is only a specific implementation of the present application. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for measuring visual acuity, characterized in that: Applied to a near-eye display device, the near-eye display device includes a near-eye display module and a first marking point, the near-eye display module includes: a camera, and the position of the first marking point on the image captured by the camera has a mapping relationship with the visual acuity of the near-eye display module; the method includes: Acquire a first image captured by the camera; Identifying a first position of the first marking point from the first image; According to a preset mapping relationship between the position of the first marking point and the diopter, the diopter corresponding to the first position of the first marking point is determined to obtain the first diopter of the near-eye display module.
2. The method according to claim 1, characterized in that The near-eye display module also includes a first optical element and a second optical element; wherein, the first optical element is fixed on the near-eye display device, and the visual acuity of the near-eye display module changes with the movement of the second optical element along the optical axis direction of the near-eye display module, the camera is linked with the second optical element, the first mark point is located at the skirt position of the optical lens included in the first optical element or on the lens, and the first mark point can be photographed by the camera within the adjustment range of the camera.
3. The method according to claim 1, characterized in that The near-eye display module also includes a first optical element and a second optical element; wherein, the positions of the first optical element and the camera on the near-eye display device are fixed, and the visual acuity of the near-eye display module changes with the movement of the second optical element along the optical axis direction of the near-eye display module, and the first marking point is located on the lens barrel of the near-eye display module or on the bracket of the display screen, and the image of the first marking point formed on the second optical element within the adjustment range of the second optical element can be captured by the camera.
4. The method according to any one of claims 1 to 3, characterized in that: The first marking point includes: a scale groove, a fluorescent marking point, an infrared marking point, or an LED light.
5. The method according to claim 4, characterized in that The first marking point includes: a fluorescent marking point, an infrared marking point, or an LED light, and the identifying a first position of the first marking point from the first image includes: Identifying, from the first image, a first area whose brightness exceeds a preset first brightness threshold; The coordinates of a designated pixel point in the first area are determined as a first position of the first marking point.
6. The method according to claim 4, characterized in that The step of identifying a first position of the first marking point from the first image includes: identifying a second area including a preset pattern from the first image; The coordinates of a designated pixel point in the second area are determined as a first position of the first marking point.
7. The method according to any one of claims 1 to 6, characterized in that: The near-eye display device further includes: at least two second marking points, and positions of the second marking points on the image captured by the camera have a mapping relationship with the visual acuity of the near-eye display module. The method further includes: According to the correspondence between the preset visual range and the second marking point, determining the second marking point corresponding to the visual range to which the first visual range belongs as the target marking point; Identifying a second position of the target marker from the first image; According to a preset mapping relationship between the position of the target marking point and the diopter, the diopter corresponding to the second position of the target marking point is determined to obtain the second diopter of the near-eye display module.
8. The method according to any one of claims 1 to 6, characterized in that: The near-eye display device further includes: a third marking point, wherein a position of the third marking point on the image captured by the camera has a mapping relationship with the visual acuity of the near-eye display module, and the method further includes: When the first position of the first marking point cannot be identified from the first image, identifying the third position of the third marking point from the first image; According to a preset mapping relationship between the position of the third marking point and the diopter, the diopter corresponding to the third position of the third marking point is determined to obtain the third diopter of the near-eye display module.
9. The method according to any one of claims 1 to 6, characterized in that: The near-eye display device further includes: a fourth marking point, and the method further includes: When the first position of the first marking point is not located in a preset image area, identifying a fourth position of the fourth marking point from the first image; According to a preset mapping relationship between the position of the fourth marking point and the diopter, the diopter corresponding to the fourth position of the fourth marking point is determined to obtain the fourth diopter of the near-eye display module.
10. The method according to any one of claims 1 to 6, characterized in that: The near-eye display device further includes: a fifth marking point, and the method further includes: identifying a fifth position of the fifth marking point from the first image; Determine the diopter corresponding to the fifth position of the fifth marking point according to a preset mapping relationship between the position of the fifth marking point and the diopter, and obtain the fifth diopter of the near-eye display module; The first diopter is calibrated using the fifth diopter to obtain a sixth diopter of the near-eye display module.
11. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: When the difference between the visual acuity of the near-eye display module and the user's eye degree is greater than a preset first difference threshold, the visual acuity of the near-eye display module is adjusted until the difference between the visual acuity of the near-eye display module and the user's eye degree is no greater than the first difference threshold.
12. The method according to claim 11, characterized in that The adjusting the visual acuity of the near-eye display module includes: When the difference between the diopter of the near-eye display module and the diopter of the user's eyes is greater than a preset second difference threshold, adjusting the diopter of the near-eye display module according to the first step; When the difference between the diopter of the near-eye display module and the diopter of the user's eyes is greater than the first difference threshold but not greater than the second difference threshold, the diopter of the near-eye display module is adjusted according to a second step length; the first step length is greater than the second step length.
13. The method according to claim 12, characterized in that The near-eye display module further includes a first optical element and a second optical element; wherein the position of the first optical element on the near-eye display device is fixed, and the visual acuity of the near-eye display module changes with the movement of the second optical element along the optical axis direction of the near-eye display module; The step of adjusting the visual acuity of the near-eye display module according to the first step comprises: Adjusting the distance of the second optical element relative to the first optical element on the optical axis of the near-eye display module according to a third step length; The step of adjusting the diopter of the near-eye display module according to the second step length includes: The distance of the second optical element relative to the first optical element on the optical axis of the near-eye display module is adjusted according to a fourth step.
14. A near-eye display device, characterized in that: include: A near-eye display module, a first marking point, a processor, and a memory; The near-eye display module comprises: a camera; the position of the first marking point on the image captured by the camera has a mapping relationship with the visual acuity of the near-eye display module; One or more computer programs are stored in the memory, and when the computer programs are executed by the processor, the near-eye display device executes the method according to any one of claims 1 to 13.
15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method according to any one of claims 1 to 13.
