Optical deviation correction method for virtual reality head-mounted display

Through the optical sensor and mathematical model of virtual reality head-mounted display, the image magnification and pixel layout are adjusted in real time, which solves the problems of user refractive errors and visual fatigue, improves the comfort and immersion of the experience, and adapts to the vision of different users. need.

CN118982972APending Publication Date: 2024-11-19QINGDAO VIRTUAL REALITY RES INST CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411363932.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-28
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

Virtual reality head-mounted displays lack personalized adjustment capabilities when dealing with user refractive errors and visual fatigue problems, resulting in visual discomfort and insufficient experience.

Method used

The user's refractive state data is obtained through built-in optical sensors, the image magnification or reduction rate is calculated using mathematical models, and the image pixel density and layout are adjusted based on the user's feedback and pupil distance data, and the visual effect is monitored and optimized in real time, combining eye tracking technology and personalized support for historical data analysis.

Benefits of technology

It significantly improves the comfort and immersion of the user experience, reduces visual fatigue and distortion, adapts to the visual needs of different users, and achieves continuous personalized visual support.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118982972A_ABST
    Figure CN118982972A_ABST
Patent Text Reader

Abstract

An optical correction method for a virtual reality head-mounted display relates to the technical field of virtual reality, and comprises the following steps: starting the virtual reality head-mounted display, and initializing an optical sensor; the optical sensor obtains refraction state data of the two eyes; transmitting the refraction state data to a processing unit, and calculating the magnification or the reduction ratio of the image; adjusting the pixel density according to the magnification or the reduction ratio, including changing the resolution and the pixel layout of the image; displaying the adjusted image in the virtual reality head-mounted display to ensure that the sizes and shapes of the images received by the two eyes of the user are consistent; detecting feedback of the user, if the user reports that visual discomfort still exists, returning, and readjusting the magnification or the reduction rate of the image; and recording the refractive state data of the user and the adjusted image parameters. According to the invention, the virtual reality head-mounted display can dynamically adjust the image according to the refractive state data of the user, and the visual experience of the user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to an optical deviation correction method for a virtual reality head mounted display. Background Art

[0002] In recent years, virtual reality (VR) technology has developed rapidly, especially in entertainment, education, medical, military and other fields. VR technology simulates real or imaginary three-dimensional environment, allowing users to immerse themselves in it and get an immersive feeling. This immersion mainly depends on high-resolution display technology, precise head tracking and high-quality audio system.

[0003] Although VR technology has made significant progress, there are still some problems in practical application, especially for those users with vision problems, who may encounter more challenges when using VR devices. These problems mainly include:

[0004] Visual discomfort caused by refractive error: Many users have different degrees of refractive error, such as myopia, hyperopia, astigmatism, etc. Traditional VR headsets usually do not have the function of personalized adjustment according to the user's refractive state, so when users wear VR headsets, they may feel visual discomfort due to blurred or distorted images.

[0005] Lack of dynamic adjustment capabilities: Even if some VR devices can be adjusted to a certain extent, these adjustments are often static and cannot respond in real time to the user's head movements or subtle eye movements, resulting in image misalignment or visual distortion in some cases.

[0006] Visual fatigue: Long-term use of VR equipment may cause visual fatigue, especially in low light or strong light conditions. This is because the user's eyes need to constantly adjust the focal length to adapt to the different depths in the virtual environment. If the device does not work well with the user's visual habits, it is easy to cause fatigue.

[0007] Insufficient personalized experience: Everyone's vision is unique, which means that the ideal VR experience should be customized for each user. However, most VR devices on the market currently fail to take this into account, thus limiting the quality of the user experience. Summary of the invention

[0008] In view of this, the technical problem to be solved by the present invention is: to provide an optical correction method for a virtual reality head-mounted display, which can enable the virtual reality head-mounted display to dynamically adjust the image according to the user's refractive state data to improve the user's visual experience.

[0009] In order to solve the above technical problems, the technical solution of the present invention is:

[0010] An optical correction method for a virtual reality head mounted display comprises the following steps:

[0011] S1. Start the virtual reality head-mounted display and initialize the built-in optical sensor;

[0012] S2. Acquire binocular refractive state data of the user through the optical sensor, wherein the binocular refractive state data at least includes spherical power, cylindrical power and astigmatism axis of the binoculars;

[0013] S3, transmitting the refractive state data to a processing unit, and calculating the image magnification or reduction ratio required for each eye using a preset mathematical model according to the data;

[0014] S4, adjusting the pixel density of the image presented to each eye in the virtual reality environment according to the magnification or reduction ratio, including changing the resolution and pixel layout of the image;

[0015] S5. Presenting the adjusted image in a virtual reality head mounted display to ensure that the size and shape of the image received by the two eyes of the user are consistent;

[0016] S6. Detect user feedback. If the user reports that visual discomfort still exists, return to S2 and readjust the image magnification or reduction ratio.

[0017] S7. Record the user's refractive state data and adjusted image parameters for subsequent personalized settings or data analysis.

[0018] Preferably, in S2, obtaining the binocular refractive status data of the user further includes monitoring the changes in the binocular refractive power of the user in real time through a built-in non-contact optical sensor, and storing the change data in a storage unit of the virtual reality head-mounted display; and, the optical sensor is used to detect the user's pupil reaction speed to evaluate the user's visual fatigue level.

[0019] Preferably, in S4, it also includes adjusting the position of the image displayed to each eye according to the user's pupil distance data to optimize the depth perception and stereoscopic visual effects in virtual reality and ensure that the image is aligned with the user's visual axis center; the pupil distance data is automatically acquired through a built-in sensor or manually input by the user, and the user's facial contour data is input during the adjustment process to further improve wearing comfort.

[0020] Preferably, in S4, the number of pixels required to be displayed for each eye is dynamically calculated by a pixel algorithm running in a virtual reality head-mounted display, and the resolution and pixel layout of the image in the virtual reality environment are adjusted accordingly; the pixel algorithm takes into account the user's refractive state data, pupil distance data, and the user's current position and direction in the virtual environment.

[0021] Preferably, in S4, the impact of the adjustment on the user experience, including the resulting visual distortion or aberration, is predicted based on a prediction algorithm, and optimization is performed according to the prediction results; the prediction algorithm can provide stable prediction results under different lighting conditions.

[0022] Preferably, in S6, real-time tracking of user eye movements is included, and image magnification is dynamically adjusted based on eye tracking data to accommodate slight movements of the user's head and eyes; eye tracking actions are achieved through a built-in camera or other sensing device, and the adjustment frequency is automatically adjusted according to the intensity of the user's activity.

[0023] Preferably, the eye tracking data is used in S5 to compensate for additional image distortion caused by head movement or eye rotation, ensuring that the user can obtain correct image size and position information at different viewing angles; the compensation mechanism includes but is not limited to image rotation and displacement adjustment, and personalized compensation is performed based on individual differences of users.

[0024] Preferably, in S7, the user's historical refractive state change trend is recorded to form historical data, and the refractive state in a future period is predicted based on the historical data, and the virtual reality display parameters are adjusted in advance to adapt to the user's vision changes; the historical data is stored in a local server or a cloud server, and analyzed and predicted by a machine learning algorithm to provide continuous personalized visual support.

[0025] After adopting the above technical solution, the beneficial effects of the present invention are:

[0026] In the present invention, an optical correction method for a virtual reality head-mounted display includes: starting the virtual reality head-mounted display and initializing a built-in optical sensor; obtaining binocular refractive state data of a user through the optical sensor, the refractive state data at least including the spherical power, cylindrical power and astigmatism axis of the binoculars; transmitting the refractive state data to a processing unit, and calculating the image magnification or reduction rate required for each eye according to the data using a preset mathematical model; adjusting the pixel density of an image presented to each eye in a virtual reality environment according to the magnification or reduction rate, including changing the resolution and pixel layout of the image; presenting the adjusted image in the virtual reality head-mounted display to ensure that the size and shape of the image received by the two eyes of the user are consistent; detecting user feedback, and if the user reports that visual discomfort still exists, returning to readjust the image magnification or reduction rate; and recording the user's refractive state data and adjusted image parameters for subsequent personalized settings or data analysis. The present invention can significantly improve the comfort and immersion of the experience by adjusting the image magnification in a personalized manner, monitoring the refractive state in real time and optimizing the stereoscopic visual effect. Moreover, by combining pupil distance data and eye tracking technology, it can effectively reduce visual fatigue and distortion and adapt to the visual needs of different users. In addition, by predicting refractive changes through historical data analysis, continuous personalized support is achieved, thereby enhancing the intelligence of the system and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0028] Figure 1 The present invention is a flowchart of an optical correction method for a virtual reality head mounted display according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0030] like Figure 1 As shown, the present invention comprises the following steps:

[0031] S1. Start the virtual reality head-mounted display and initialize the built-in optical sensor;

[0032] S2. Acquire binocular refractive state data of the user through the optical sensor, wherein the binocular refractive state data at least includes spherical power, cylindrical power and astigmatism axis of the binoculars;

[0033] S3, transmitting the refractive state data to a processing unit, and calculating the image magnification or reduction ratio required for each eye using a preset mathematical model according to the data;

[0034] S4, adjusting the pixel density of the image presented to each eye in the virtual reality environment according to the magnification or reduction ratio, including changing the resolution and pixel layout of the image;

[0035] S5. Presenting the adjusted image in a virtual reality head mounted display to ensure that the size and shape of the image received by the two eyes of the user are consistent;

[0036] S6. Detect user feedback. If the user reports that visual discomfort still exists, return to S2 and readjust the image magnification or reduction ratio.

[0037] S7. Record the user's refractive state data and adjusted image parameters for subsequent personalized settings or data analysis.

[0038] In S2, obtaining the binocular refractive status data of the user further includes monitoring the changes in the binocular refractive power of the user in real time through a built-in non-contact optical sensor, and storing the change data in a storage unit of the virtual reality head-mounted display; and, the optical sensor is used to detect the user's pupil reaction speed to evaluate the user's visual fatigue level.

[0039] In S4, it also includes adjusting the position of the image displayed to each eye according to the user's pupil distance data to optimize depth perception and stereoscopic vision effects in virtual reality and ensure that the image is aligned with the center of the user's visual axis; the pupil distance data is automatically obtained through a built-in sensor or manually input by the user, and the user's facial contour data is input during the adjustment process to further improve wearing comfort.

[0040] In S4, the number of pixels required to be displayed for each eye is dynamically calculated through a pixel algorithm running in the virtual reality head-mounted display, and the resolution and pixel layout of the image in the virtual reality environment are adjusted accordingly; the pixel algorithm takes into account the user's refractive state data, pupil distance data, and the user's current position and orientation in the virtual environment.

[0041] In S4, the impact of the adjustment on the user experience, including the resulting visual distortion or aberration, is predicted based on a prediction algorithm, and optimization is performed based on the prediction result; the prediction algorithm can provide stable prediction results under different lighting conditions.

[0042] In the S6, this includes real-time tracking of the user's eye movements, dynamically adjusting the image magnification based on the eye-tracking data to accommodate tiny movements of the user's head and eyes; eye-tracking actions are achieved through a built-in camera or other sensing device, and the adjustment frequency is automatically adjusted according to the intensity of the user's activity.

[0043] Eye tracking data is used in S5 to compensate for additional image distortion caused by head movement or eye rotation, ensuring that users can obtain correct image size and position information at different viewing angles; the compensation mechanism includes but is not limited to image rotation and displacement adjustment, and personalized compensation is performed based on individual differences of users.

[0044] In S7, the user's historical refractive state change trend is recorded to form historical data, and the refractive state in a future period is predicted based on the historical data, and the virtual reality display parameters are adjusted in advance to adapt to the user's vision changes; the historical data is stored in a local server or a cloud server, and analyzed and predicted through a machine learning algorithm to provide continuous personalized visual support.

[0045] The present invention can significantly improve the comfort and immersion of the experience by adjusting the image magnification in a personalized manner, monitoring the refractive state in real time and optimizing the stereoscopic visual effect. Moreover, by combining pupil distance data and eye tracking technology, it can effectively reduce visual fatigue and distortion and adapt to the visual needs of different users. In addition, by predicting refractive changes through historical data analysis, continuous personalized support is achieved, thereby enhancing the intelligence of the system and user experience.

[0046] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An optical correction method for a virtual reality head mounted display, It is characterized in that The steps include: S1. Start the virtual reality head-mounted display and initialize the built-in optical sensor; S2. Acquire binocular refractive state data of the user through the optical sensor, wherein the binocular refractive state data at least includes spherical power, cylindrical power and astigmatism axis of the binoculars; S3, transmitting the refractive state data to a processing unit, and calculating the image magnification or reduction ratio required for each eye using a preset mathematical model according to the data; S4, adjusting the pixel density of the image presented to each eye in the virtual reality environment according to the magnification or reduction ratio, including changing the resolution and pixel layout of the image; S5. Presenting the adjusted image in a virtual reality head mounted display to ensure that the size and shape of the image received by the two eyes of the user are consistent; S6. Detect user feedback. If the user reports that visual discomfort still exists, return to S2 and readjust the image magnification or reduction ratio. S7. Record the user's refractive state data and adjusted image parameters for subsequent personalized settings or data analysis.

2. The optical correction method for a virtual reality head mounted display according to claim 1, It is characterized in that In S2, obtaining the binocular refractive status data of the user further includes monitoring the changes in the binocular refractive power of the user in real time through a built-in non-contact optical sensor, and storing the change data in a storage unit of the virtual reality head-mounted display; and, the optical sensor is used to detect the user's pupil reaction speed to evaluate the user's visual fatigue level.

3. The optical correction method for a virtual reality head mounted display according to claim 1, It is characterized in that In S4, it also includes adjusting the position of the image displayed to each eye according to the user's pupil distance data to optimize depth perception and stereoscopic vision effects in virtual reality and ensure that the image is aligned with the center of the user's visual axis; the pupil distance data is automatically obtained through a built-in sensor or manually input by the user, and the user's facial contour data is input during the adjustment process to further improve wearing comfort.

4. The optical correction method for a virtual reality head mounted display according to claim 1, It is characterized in that In S4, the number of pixels required to be displayed for each eye is dynamically calculated through a pixel algorithm running in the virtual reality head-mounted display, and the resolution and pixel layout of the image in the virtual reality environment are adjusted accordingly; the pixel algorithm takes into account the user's refractive state data, pupil distance data, and the user's current position and orientation in the virtual environment.

5. The optical correction method for a virtual reality head mounted display according to claim 4, It is characterized in that In S4, the impact of the adjustment on the user experience, including the resulting visual distortion or aberration, is predicted based on a prediction algorithm, and optimization is performed based on the prediction result; the prediction algorithm can provide stable prediction results under different lighting conditions.

6. The optical correction method for a virtual reality head mounted display according to claim 1, It is characterized in that In the S6, this includes real-time tracking of the user's eye movements, dynamically adjusting the image magnification based on the eye-tracking data to accommodate tiny movements of the user's head and eyes; eye-tracking actions are achieved through a built-in camera or other sensing device, and the adjustment frequency is automatically adjusted according to the intensity of the user's activity.

7. The optical correction method for a virtual reality head mounted display according to claim 6, It is characterized in that Eye tracking data is used in S5 to compensate for additional image distortion caused by head movement or eye rotation, ensuring that users can obtain correct image size and position information at different viewing angles; the compensation mechanism includes but is not limited to image rotation and displacement adjustment, and personalized compensation is performed based on individual differences of users.

8. The optical correction method for a virtual reality head mounted display according to claim 1, It is characterized in that In S7, the user's historical refractive state change trend is recorded to form historical data, and the refractive state in a future period is predicted based on the historical data, and the virtual reality display parameters are adjusted in advance to adapt to the user's vision changes; the historical data is stored in a local server or a cloud server, and analyzed and predicted through a machine learning algorithm to provide continuous personalized visual support.

Citation Information

Cited By

  • Electronic apparatus and controlling method thereof

    WO2026221283A1