VR display and control method thereof
By using infrared sensors and electromagnet arrays in VR displays to dynamically adjust the light transmittance of the transparent cover, and combining the user eye data of the image sensor for intelligent display control, the brightness problem of VR displays under ambient light changes is solved, and the brightness problem of VR displays is achieved. Higher visual comfort and clarity.
Patent Information
- Application Number
- CN202411486110.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-23
- Publication Date
- 2025-02-07
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing VR displays have shortcomings in handling ambient light changes, resulting in unclear images in strong light environments and dazzling brightness in low light environments. Traditional brightness control methods cannot be adjusted in real time according to changes in ambient light.
The light transmittance of the transparent cover is dynamically adjusted to filter ambient light by utilizing infrared sensors and controllable electromagnet arrays for installation status evaluation and magnetic compensation correction. At the same time, the image sensor is used to collect user eye data, fine-tune the display brightness and contrast according to the user's visual status to achieve intelligent display control.
Effectively filter strong light and enhance low light, so that the light entering the VR display is always in the comfortable range, improving picture clarity, reducing visual fatigue, and improving the comfort and clarity of the user experience.
Smart Images

Figure CN119400094A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of display control technology, and in particular to a VR display and a control method thereof. Background Art
[0002] Virtual reality (VR) technology, as a computer simulation system that can create and experience a virtual world, has developed rapidly in recent years and has shown great application potential in the fields of gaming, entertainment, education and training, and medical health. As one of the core components of the VR system, the display effect of VR displays directly affects the user's sense of immersion and experience comfort. Most common VR displays on the market use liquid crystal displays (LCD) or organic light-emitting diode displays (OLED), which magnify the image on the screen through lenses and present it to the user, creating an immersive visual experience. These VR displays are insufficient in dealing with changes in ambient light, and are prone to fixing the screen brightness, leading to the following problems: The picture is not clear in strong light environments: When the user is in a strong light environment, such as outdoors or indoors with direct sunlight, if the screen brightness of the VR display is not high enough, the picture will be covered by the ambient light, making it difficult to see clearly, affecting the user experience. Brightness is dazzling in weak light environments: When the user is in a weak light environment, such as at night or in a dimly lit room, if the screen brightness of the VR display is too high, it will appear too dazzling, easily causing visual fatigue and even damage to eyesight. However, traditional VR display brightness control methods mainly rely on manual adjustment or preset modes, which cannot adjust the screen brightness in real time according to changes in ambient light, and it is difficult to meet users' needs for comfort. For example, some VR displays provide the option of manually adjusting brightness, but users need to operate frequently, affecting the smoothness of the experience; some VR displays provide preset brightness modes, such as "indoor mode" and "outdoor mode", but these modes cannot adapt to complex and changing ambient light conditions. Summary of the invention
[0003] Based on this, the present invention provides a VR display and a control method thereof to solve at least one of the above technical problems.
[0004] To achieve the above object, a method for controlling a VR display comprises the following steps:
[0005] Step S1: using an infrared sensor to evaluate the installation status of the detachable transparent cover, and using a controllable electromagnet array to perform magnetic force compensation correction processing to obtain cover correction status data;
[0006] Step S2: collecting the ambient light intensity according to the cover body correction state data, and performing temperature compensation calibration to generate real-time light intensity value compensation data; adjusting the transmittance of the detachable transparent cover according to the real-time light intensity value compensation data to generate transparent cover transmittance data;
[0007] Step S3: Initially map the brightness of the display screen of the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data;
[0008] Step S4: Initialize the viewing area according to the intelligent display control data, and perform pre-rendering process startup analysis to generate pre-rendering startup signal data; perform pre-rendering area priority rendering according to the pre-rendering startup signal data to obtain pre-rendering picture storage data;
[0009] Step S5: performing motion compensation processing on the pre-rendered image storage data, and using a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data;
[0010] Step S6: Evaluate the fatigue level based on the stable VR display image data, and adaptively adjust the eye protection mode to generate adaptive eye protection control data.
[0011] The present invention uses an infrared sensor and a controllable electromagnet array to evaluate the installation status and perform magnetic compensation correction on the detachable transparent cover, ensuring that the cover is in the best working state and can accurately collect the ambient light intensity. Through temperature compensation calibration, the accuracy of light intensity collection is further improved, and the transmittance of the transparent cover is dynamically adjusted according to the real-time light intensity value compensation data. This method of automatically adjusting the transmittance of the transparent cover according to the change of ambient light can effectively filter strong light and enhance weak light, so that the light entering the VR display is always within a comfortable range, thereby improving the clarity of the picture under different lighting environments, avoiding the problem of unclear picture under strong light and dazzling brightness under weak light. The image sensor is used to collect periodic images of the user's eyes to obtain information such as the user's pupil size. By analyzing the time-series user eye image data, the user's visual state can be accurately judged, and the display parameters can be fine-tuned according to the difference between the user's left and right eyes, so as to achieve independent brightness and contrast adjustment for the left and right eyes. This personalized display control method can better adapt to the user's visual needs, reduce visual fatigue, and improve the user's viewing comfort. Through pre-rendering technology, the area that the user is about to watch is rendered in advance, and the rendering results are stored. When the user's line of sight moves to this area, the stored rendering picture can be directly called to reduce rendering delay, improve picture smoothness, avoid freezes, smearing and other phenomena, and reduce picture jitter and delay by performing motion compensation processing on the pre-rendered picture, effectively alleviating the dizziness problems common in VR experience. According to the user's viewing time, pupil changes and other information, the user's fatigue level is evaluated, and the eye protection mode is adaptively adjusted, such as reducing the screen brightness, adjusting the color temperature, etc., so as to reduce the potential damage of the VR experience to the user's vision and ensure the user's vision health. Therefore, a control method for a VR display of the present invention evaluates and corrects the installation status of the transparent cover by using an infrared sensor and a controllable electromagnet array, and dynamically adjusts the transmittance of the transparent cover according to the ambient light intensity and the temperature compensation value, so as to achieve preliminary filtering and adjustment of the ambient light. The user's pupil information is further collected through the image sensor, and the display parameters of the left and right eyes are fine-tuned in combination with the transparent cover transmittance data and the basic brightness adjustment data, realizing intelligent display control of the VR display. This effectively solves the shortcomings of existing VR displays in handling changes in ambient light, significantly improves the comfort and clarity of the user experience, avoids the problems of unclear images in strong light, glaring brightness and dizziness in low light, and at the same time ensures the user's vision health.
[0012] Preferably, step S1 comprises the following steps:
[0013] Step S11: using the first infrared monitoring module to collect the real-time same-frequency distance of the display subject of the VR display, to obtain the same-frequency distance data of the display subject, and performing spatial coordinate calculation on the same-frequency distance data of the display subject to obtain the spatial positioning data of the display subject;
[0014] Step S12: Calculating the relative position of the detachable transparent cover using the second infrared monitoring module based on the display body spatial positioning data to obtain cover body deviation vector data;
[0015] Step S13: performing weighted calculation of installation fit of the detachable transparent cover according to the cover body deviation vector data using a preset transparent cover installation weight coefficient to generate installation fit data;
[0016] Step S14: the installation status of the installation fit data is evaluated through a preset installation status threshold range. When the installation fit data is at a high-level installation status threshold, it is fed back to the VR display display body for visual display to obtain the transparent cover successfully installed status data; when the installation fit data is at a low-level installation status threshold, the VR display display body is used to remind the user to reinstall the detachable transparent cover, and return to step S12 to calculate the relative position again; wherein the preset installation status threshold range includes a high-level installation status threshold, a medium-level installation status threshold and a low-level installation status threshold;
[0017] Step S15: When the installation fit data is at the middle-level installation state threshold, the cover body deviation vector data is used to perform control instruction correction processing to obtain installation correction instruction data; the controllable electromagnet array is used to perform magnetic force adaptive adjustment on the installation correction instruction data to obtain magnetic force compensation control data;
[0018] Step S16: adjusting the position of the transparent cover according to the magnetic force compensation control data, and confirming the successful calibration state according to the successful installation state data of the transparent cover, to obtain the calibration state data of the cover body.
[0019] The present invention uses a first infrared monitoring module to collect the distance between the VR display display body and the user in real time, and calculates the spatial positioning data of the display body. Based on this, the second infrared monitoring module can accurately calculate the position deviation of the detachable transparent cover relative to the display body, and use a preset weight coefficient to perform weighted calculation of the installation fit. By comparing the calculated installation fit data with the preset installation status threshold range, the display control unit can intelligently determine the installation status of the transparent cover. When the installation fit reaches the high-level threshold, the display control unit confirms that the transparent cover is successfully installed and performs a visual display prompt; when the installation fit is lower than the low-level threshold, the display control unit determines that the installation has failed and reminds the user to reinstall. When the installation fit is at the medium-level threshold, it is possible to generate a control instruction based on the calculated deviation vector data, and use a controllable electromagnet array to perform magnetic adaptive adjustment on the transparent cover to achieve accurate correction of the position of the transparent cover. This magnetic compensation correction mechanism can effectively make up for the deviations caused by manual installation by users, ensuring that the transparent cover fits perfectly with the display body. It can automatically correct when there are deviations in the installation, effectively avoiding problems such as reduced display effect and light leakage caused by improper installation. At the same time, it simplifies the user's operation process and improves the ease of use and reliability of the VR display.
[0020] Preferably, step S15 comprises the following steps:
[0021] Step S151: performing deviation type analysis according to the installation fit data to generate cover body deviation type data; wherein the cover body deviation type data includes plane parallelism deviation data, center alignment deviation data and edge gap uniformity deviation data;
[0022] Step S152: performing main deviation vector decomposition on the cover body deviation vector data by using the cover body deviation type data to obtain main deviation vector data;
[0023] Step S153: performing correction instruction encoding processing on the main deviation vector data to generate installation correction instruction data;
[0024] Step S154: optimizing the control instruction steps of the installation correction instruction data to obtain optimized correction instruction data;
[0025] Step S155: using a pressure sensor array to perform pressure sampling on an edge area of the detachable transparent cover to obtain edge pressure sampling data;
[0026] Step S156: performing edge area quadrant distribution processing on the edge pressure sampling data, and performing regional pressure balance calculation to obtain regional pressure balance data;
[0027] Step S157: using the regional pressure balance data to identify the stress value region of the edge pressure sampling data, and using the optimization correction instruction data to encode the stress correction requirement of the transparent cover to generate stress correction requirement encoding data;
[0028] Step S158: Based on the stress correction requirement coded data, the controllable electromagnet array is used to perform magnetic force adaptive adjustment on the detachable transparent cover to obtain magnetic force compensation control data.
[0029] The present invention conducts an in-depth analysis of the installation fit data of the transparent cover, and identifies different types of deviations such as plane parallelism deviation, center alignment deviation, and edge gap uniformity deviation. Then, the display control unit decomposes the cover deviation vector, extracts the main deviation vector that has the greatest impact on the installation effect, and encodes and optimizes the correction instruction for it to generate accurate optimization correction instructions. The edge area of the transparent cover is pressure sampled, and the stress condition of the edge of the transparent cover is accurately determined by calculating the regional pressure balance and identifying the stress value area. On this basis, the display control unit controls the controllable electromagnet array to perform magnetic adaptive adjustment on the transparent cover according to the optimization correction instruction and stress correction requirements, so as to realize the refined position and stress control of the transparent cover, which can effectively eliminate various deviations and stresses during the installation of the transparent cover, ensure that the transparent cover and the display are highly fitted, and avoid light leakage and display distortion caused by improper installation.
[0030] Preferably, step S2 comprises the following steps:
[0031] Step S21: monitoring the user's wearing. When the user has finished wearing, monitoring the startup status of the VR display main body to obtain the VR display startup status data;
[0032] Step S22: continuously collecting ambient light intensity from the ambient light sensor according to the VR display startup state data and the cover body calibration state data to obtain original light intensity digital signal data;
[0033] Step S23: using a temperature sensor to read the device temperature, obtaining device temperature data, and using the device temperature data to perform temperature compensation calibration on the original light intensity digital signal data, thereby generating real-time light intensity value compensation data;
[0034] Step S24: performing ambient light intensity classification on the real-time light intensity value compensation data to obtain ambient light level data;
[0035] Step S25: Calculating the target light transmittance using a preset light transmittance adjustment strategy according to the ambient light level data to generate target light transmittance data;
[0036] Step S26: reading the current transmittance of the detachable transparent cover, and calculating the transmittance difference according to the target transmittance data to obtain transmittance adjustment amount data;
[0037] Step S27: performing transmittance adjustment processing on the detachable transparent cover according to the transmittance adjustment amount data to generate transparent cover transmittance data.
[0038] The present invention monitors the user's wearing state and the VR display startup state to ensure that the display control unit starts the transmittance adjustment function when the user starts using the VR device. Subsequently, the display control unit uses the ambient light sensor to continuously collect the ambient light intensity, and uses the temperature sensor to obtain the device temperature data, performs temperature compensation calibration on the original light intensity data, eliminates the influence of temperature on the light intensity measurement, and improves the accuracy of the light intensity data. The display control unit grades the ambient light intensity according to the calibrated real-time light intensity value, and combines the classification result with the preset transmittance adjustment strategy to calculate the target transmittance. For example, in a strong light environment, the display control unit will reduce the target transmittance, reduce the light intensity entering the VR display, and avoid the picture being too bright or dazzling; in a weak light environment, the display control unit will increase the target transmittance, increase the light intensity entering the VR display, and improve the brightness and clarity of the picture. The display control unit calculates the transmittance adjustment amount by comparing the target transmittance and the current transmittance, and performs transmittance adjustment processing on the detachable transparent cover so that the transmittance of the transparent cover reaches the target value. This intelligent adjustment method of the transparent cover transmittance based on ambient light intensity and temperature compensation can automatically adjust the transmittance of the transparent cover according to the lighting conditions of the user's environment, effectively avoiding problems such as unclear picture under strong light and glaring brightness under weak light, and improving the user's visual comfort and display effects in different lighting environments.
[0039] Preferably, step S3 comprises the following steps:
[0040] Step S31: performing initial display screen brightness mapping on the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data;
[0041] Step S32: Initializing the display content according to the basic brightness adjustment data to obtain visual VR display content data;
[0042] Step S33: using an image sensor to collect periodic images of the user's eyes based on the visualized VR display content data to obtain time-series user eye image data;
[0043] Step S34: performing display parameter analysis according to the time-series user eye image data to obtain screen display parameter data; fine-tuning left and right eye display parameters on the screen display parameter data to obtain left and right eye display fine-tuning parameters;
[0044] Step S35: using the left and right eye display fine-tuning parameters to perform display screen driving processing on the VR display display body, and perform display screen synchronization processing to obtain intelligent display screen adjustment data;
[0045] Step S36: performing user visual comfort feedback processing on the intelligent display picture adjustment data to obtain user adaptability feedback data;
[0046] Step S37: performing display parameter feedback optimization according to the user fitness feedback data, thereby obtaining intelligent display control data.
[0047] The present invention performs initial mapping of the brightness of the VR display screen according to the transparent cover transmittance data, generates basic brightness adjustment data, and ensures that the brightness of the display screen matches the ambient light conditions. Subsequently, the display control unit uses an image sensor to periodically collect images of the user's eyes, obtains information such as the user's pupil size and blinking frequency, and analyzes the user's visual state, such as fatigue level, concentration level, etc., based on this information. Based on the user's visual state and basic brightness adjustment data, the display control unit fine-tunes the screen display parameters for the left and right eyes independently, such as adjusting the brightness, contrast, color temperature, etc., to generate left and right eye display fine-tuning parameters. Using these parameters, the display control unit drives the VR display screen and performs synchronous display image processing to ensure that the images seen by the left and right eyes are consistent and comfortable. The display control unit also performs user visual comfort feedback processing on the intelligent display image adjustment data, such as obtaining user fitness feedback data through user active adjustment or eye tracking. The display control unit performs feedback optimization on the display parameters based on the user feedback data, and continuously adjusts the display parameters to make the display effect more in line with the user's visual needs.
[0048] Preferably, step S34 includes the following steps:
[0049] Step S341: grayscale the time-series user eye image data to obtain grayscale eye image data;
[0050] Step S342: performing contrast enhancement processing on the grayscale eye image data to obtain enhanced eye image data;
[0051] Step S343: perform eye region detection based on the enhanced eye image data to obtain eye region image data; perform binarization processing on the eye region image data, and perform morphological operations to obtain candidate pupil region data.
[0052] Step S344: monitoring the pupil edge of the candidate pupil region data and performing ellipse fitting processing to obtain pupil response feature data;
[0053] Step S345: performing display parameter analysis according to pupil response characteristic data to obtain screen display parameter data;
[0054] Step S346: fine-tune the left and right eye parameters of the screen display parameter data using the human eye area image data and the user's sequential pupil monitoring data to obtain left and right eye display fine-tuning parameters.
[0055] The present invention performs grayscale processing and contrast enhancement processing on the time-series user eye image data to improve the image quality for subsequent feature extraction. Then, the display control unit uses the human eye area detection algorithm to extract the human eye area image data from the enhanced image, and removes noise and interference through binarization processing and morphological operations to obtain candidate pupil area data. In order to accurately extract pupil features, the display control unit monitors the pupil edge of the candidate pupil area data, and uses an ellipse fitting algorithm to fit the pupil edge to obtain pupil response feature data, such as pupil size, shape, position, etc. The system can analyze the user's visual state, such as fatigue level, concentration level, etc., and according to the user's visual state and human eye area image data, the screen display parameters are fine-tuned for the left and right eyes separately, such as adjusting brightness, contrast, color temperature, etc., to generate left and right eye display fine-tuning parameters, thereby achieving a more refined and personalized display effect adjustment.
[0056] Preferably, step S345 includes the following steps:
[0057] Step S3451: Calculate pupil diameter based on pupil response characteristic data to obtain time series pupil diameter data;
[0058] Step S3452: Statistically analyzing the time series pupil diameter data, determining the pupil diameter interval, and generating user pupil diameter interval data;
[0059] Step S3453: obtaining a preset pupil diameter-display parameter two-dimensional mapping table;
[0060] Step S3454: performing cell mapping matching on the user's pupil diameter interval data through a preset pupil diameter-display parameter two-dimensional mapping table to obtain target mapping cell data; determining the domain cell according to the target mapping cell data to obtain neighborhood mapping cell data;
[0061] Step S3455: performing cell weight processing on the target mapping cell data and the neighborhood mapping cell data to obtain cell weight data;
[0062] Step S3456: extracting display parameters of the target mapping cell data and the neighborhood mapping cell data, and performing weighted processing on the target display parameters using the cell weight data to obtain screen display parameter data, wherein the screen display parameter data includes screen brightness parameters and contrast parameters.
[0063] The present invention analyzes pupil response characteristic data, calculates time-series pupil diameter data, and determines the user's pupil diameter interval through statistical analysis. The display control unit pre-establishes a pupil diameter-display parameter two-dimensional mapping table, which maps different pupil diameter intervals to corresponding screen brightness and contrast parameter combinations. The display control unit performs cell mapping matching in the two-dimensional mapping table according to the user's pupil diameter interval data, finds the corresponding target mapping cell data, and determines its neighborhood mapping cell data. In order to make the display parameter adjustment smoother and more natural, the display control unit performs cell weight processing on the target mapping cell data and its neighborhood mapping cell data, and assigns different weights to different cells, for example, the closer the cell is to the target cell, the higher the weight. Finally, the display control unit extracts display parameters from the target mapping cell data and its neighborhood mapping cell data, and uses the cell weight data to perform weighted processing on the target display parameters to obtain the final screen brightness parameters and contrast parameters, which can automatically adjust the screen brightness and contrast parameters of the VR display according to the user's pupil diameter changes, and realize personalized customization of display parameters, thereby improving the user's visual comfort and immersion, and enhancing the realism and naturalness of the VR experience.
[0064] Preferably, step S346 includes the following steps:
[0065] Step S3461: Calculate the distance between the pupil centers of both eyes according to the user's time-series pupil monitoring data to generate user pupil distance data;
[0066] Step S3462: Calculate the distance between the eye corner and the pupil of the user's time-series pupil monitoring data through the human eye area image data to generate user eye distance data;
[0067] Step S3463: Calculate the left-eye and right-eye disparity coefficients according to the user pupil distance data and the user eye distance data to obtain the left-eye and right-eye disparity coefficients;
[0068] Step S3464: Use the left-eye and right-eye parallax coefficients to fine-tune the left-eye and right-eye display parameter data to obtain left-eye and right-eye display fine-tuning parameters.
[0069] The present invention obtains the user's pupil distance data by calculating the distance between the centers of the pupils of both eyes, reflecting the actual distance between the user's eyes. At the same time, the distance between the eye corner and the pupil is calculated using the image data of the human eye area to obtain the user's eye distance data, further describing the user's eye physiological characteristics. Combining the pupil distance and eye distance data, the left and right eye parallax coefficients are calculated to quantify the parallax difference between the two eyes when viewing the screen. The left and right eye parallax coefficients are used to fine-tune the screen display parameters to generate independent display parameters for the left and right eyes. This personalized display parameter can effectively compensate for the visual difference caused by binocular parallax, making the image information received by both eyes more consistent, thereby reducing the user's visual fatigue and improving visual clarity and stereoscopic perception.
[0070] Preferably, step S4 comprises the following steps:
[0071] Step S41: Initializing the viewing area of the VR display subject through intelligent display control data to obtain initial VR viewing area parameters;
[0072] Step S42: Dynamically track the user's eye movement to obtain eye gaze point coordinate data;
[0073] Step S43: judging whether the eyeball gaze point is within the viewing area based on the eyeball gaze point coordinate data and the initial VR viewing area parameters, and obtaining the gaze area state data;
[0074] Step S44: performing pre-rendering process start analysis according to the gaze area state data, and generating pre-rendering start signal data;
[0075] Step S45: determining the pre-rendering area according to the eye gaze point coordinate data based on the pre-rendering start signal data, and generating pre-rendering area parameters;
[0076] Step S46: performing pre-rendering area priority rendering based on the pre-rendering area parameters, and using a preset multi-level rendering cache mechanism to cache the pre-rendering picture to obtain pre-rendering picture storage data.
[0077] The present invention first initializes the VR viewing area, and obtains the coordinate data of the user's eye gaze point in real time through eye tracking technology. By judging whether the eye gaze point is located in the viewing area, the scene area currently being focused on by the user can be intelligently identified. When the user's gaze point is at the edge of the viewing area or is about to leave the viewing area, the display control unit starts the pre-rendering process according to the gaze area state data. The pre-rendering mechanism predicts the scene area that the user will focus on at the next moment based on the eye gaze point coordinate data, and renders the area preferentially, and caches the rendering results in a multi-level rendering cache. In this way, when the user's line of sight actually moves to the pre-rendering area, the display control unit can directly read the rendering results from the cache without real-time rendering, thereby significantly reducing the rendering delay and improving the smoothness and response speed of the picture. It can effectively reduce the rendering pressure of VR devices, reduce power consumption and heat, and extend battery life. At the same time, the pre-rendering mechanism can effectively eliminate problems such as screen freezes and delays, enhance the user's immersion and comfort, and bring users a smoother and more natural VR experience. Especially in complex VR scenes, the advantages of this solution are more obvious, which can effectively avoid the waste of rendering resources and improve the overall performance of VR devices.
[0078] Preferably, the present invention further provides a VR display, which includes a VR display display body, a detachable transparent cover, a display control unit, an infrared sensor, an ambient light sensor, a temperature sensor, an image sensor, and a pressure sensor array, wherein the detachable transparent cover is arranged on the display surface of the VR display display body, the display control unit is electrically connected to the VR display display body, the infrared sensor, the ambient light sensor, the temperature sensor, the image sensor, and the pressure sensor array are electrically connected to the display control unit via a data bus, the ambient light sensor and the temperature sensor are installed between the VR display display body and the detachable transparent cover, and the pressure sensor array is arranged around the VR display housing on which the detachable transparent cover can be installed, wherein the display control unit is used to execute the control method of the VR display as described above, and the display control unit includes the following modules:
[0079] A cover correction control module is used to evaluate the installation status of the detachable transparent cover using an infrared sensor and to perform magnetic force compensation correction processing using a controllable electromagnet array to obtain cover correction status data;
[0080] The light transmittance adjustment module is used to collect the ambient light intensity according to the cover body correction state data, and perform temperature compensation calibration to generate real-time light intensity value compensation data; the light transmittance of the detachable transparent cover is adjusted by the real-time light intensity value compensation data to generate the transparent cover transmittance data;
[0081] The display parameter adjustment module is used to perform initial display screen brightness mapping on the display body of the VR display through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data;
[0082] The pre-rendering start module is used to initialize the viewing area according to the intelligent display control data, and perform pre-rendering process start analysis to generate pre-rendering start signal data; perform pre-rendering area priority rendering according to the pre-rendering start signal data to obtain pre-rendering picture storage data;
[0083] The image stabilization processing module is used to perform motion compensation processing on the pre-rendered image storage data, and use a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data;
[0084] The eye protection mode adaptive module is used to evaluate the fatigue level based on the stable VR display image data, and to adaptively adjust the eye protection mode to generate adaptive eye protection control data. BRIEF DESCRIPTION OF THE DRAWINGS
[0085] Figure 1 A schematic diagram of the steps of the control method of the VR display of the present invention;
[0086] Figure 2 for Figure 1 Detailed implementation steps of step S2 in the flowchart;
[0087] Figure 3 for Figure 1 Detailed implementation steps of step S4 in FIG.
[0088] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0089] The technical method of the present invention is described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.
[0090] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. The functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor methods and / or microcontroller methods.
[0091] It should be understood that, although the terms "first", "second", etc. may be used herein to describe various units, these units should not be limited by these terms. These terms are used only to distinguish one unit from another unit. For example, without departing from the scope of the exemplary embodiments, the first unit may be referred to as the second unit, and similarly the second unit may be referred to as the first unit. The term "and / or" used herein includes any and all combinations of one or more of the listed associated items.
[0092] To achieve this, please refer to Figures 1 to 3 The present invention provides a method for controlling a VR display, comprising the following steps:
[0093] Step S1: using an infrared sensor to evaluate the installation status of the detachable transparent cover, and using a controllable electromagnet array to perform magnetic force compensation correction processing to obtain cover correction status data;
[0094] Step S2: collecting the ambient light intensity according to the cover body correction state data, and performing temperature compensation calibration to generate real-time light intensity value compensation data; adjusting the transmittance of the detachable transparent cover according to the real-time light intensity value compensation data to generate transparent cover transmittance data;
[0095] Step S3: Initially map the brightness of the display screen of the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data;
[0096] Step S4: Initialize the viewing area according to the intelligent display control data, and perform pre-rendering process startup analysis to generate pre-rendering startup signal data; perform pre-rendering area priority rendering according to the pre-rendering startup signal data to obtain pre-rendering picture storage data;
[0097] Step S5: performing motion compensation processing on the pre-rendered image storage data, and using a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data;
[0098] Step S6: Evaluate the fatigue level based on the stable VR display image data, and adaptively adjust the eye protection mode to generate adaptive eye protection control data.
[0099] In the embodiment of the present invention, reference Figure 1 The above is a schematic flow chart of the steps of the control method of the VR display of the present invention. In this embodiment, the control method of the VR display includes the following steps:
[0100] Step S1: using an infrared sensor to evaluate the installation status of the detachable transparent cover, and using a controllable electromagnet array to perform magnetic force compensation correction processing to obtain cover correction status data;
[0101] In an embodiment of the present invention, when a user installs a removable transparent cover on the VR display body, the pressure sensor array around the VR display housing will sense the pressure change and transmit the signal to the display control unit. The display control unit starts the infrared sensor and emits an infrared beam to detect the position and posture of the transparent cover. If it is detected that there is a deviation in the installation of the transparent cover, such as tilting or not fully fitting, the display control unit will control the controllable electromagnet array to generate a corresponding magnetic force and fine-tune the transparent cover to achieve the best installation state. For example, if it is detected that the left side of the transparent cover is slightly higher than the right side, the electromagnet on the left is controlled to increase the suction force, and the electromagnet on the right is controlled to weaken the suction force until the transparent cover is horizontal. Finally, the display control unit records the installation status data of the transparent cover to form the cover body correction status data.
[0102] Step S2: collecting the ambient light intensity according to the cover body correction state data, and performing temperature compensation calibration to generate real-time light intensity value compensation data; adjusting the transmittance of the detachable transparent cover according to the real-time light intensity value compensation data to generate transparent cover transmittance data;
[0103] In an embodiment of the present invention, after obtaining the correction state data of the cover body, the display control unit starts the ambient light sensor to collect the intensity of the surrounding ambient light. Assuming that the user uses the VR device outdoors in the sun, the ambient light sensor will detect a higher light intensity. At the same time, the temperature sensor measures the temperature inside the VR display, for example, 30°C. The display control unit calibrates the ambient light intensity according to the preset temperature compensation curve. For example, since the temperature increase will cause the sensor reading to be slightly higher, the display control unit will correct the light intensity value downward by 2% to generate real-time light intensity value compensation data. Then, the display control unit dynamically adjusts the transmittance of the detachable transparent cover according to the real-time light intensity value compensation data. For example, in a strong light environment, the display control unit will reduce the transmittance of the transparent cover to reduce the ambient light entering the VR display and prevent the picture from being covered by strong light; conversely, in a weak light environment, the display control unit will increase the transmittance of the transparent cover to ensure sufficient brightness and generate transparent cover transmittance data.
[0104] Step S3: Initially map the brightness of the display screen of the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data;
[0105] In an embodiment of the present invention, after the display control unit obtains the light transmittance data of the transparent cover, it takes it as an input parameter and calculates the initial brightness value of the display screen of the VR display through a preset mapping function. For example, if the light transmittance of the transparent cover is 50%, the display control unit will set the brightness of the display screen to 70%. This initial brightness value is called basic brightness adjustment data. At the same time, the image sensor will periodically collect user eye images. For example, take an eye photo every 1 second to record information such as the user's pupil size and blinking frequency. The display control unit analyzes the time-series user eye image data to determine the user's visual state. For example, if it is detected that the user's pupil is constricted, it means that the ambient light is strong, and the display control unit will fine-tune the basic brightness adjustment data and appropriately reduce the brightness of the display screen; if it is detected that the user's blinking frequency is accelerated, it means that the user has visual fatigue, and the display control unit will fine-tune the brightness again and generate left and right eye display fine-tuning parameters. Finally, the display control unit drives the display screen according to the left and right eye display fine-tuning parameters, and performs parameter feedback optimization according to the actual display effect to generate intelligent display control data.
[0106] Step S4: Initialize the viewing area according to the intelligent display control data, and perform pre-rendering process startup analysis to generate pre-rendering startup signal data; perform pre-rendering area priority rendering according to the pre-rendering startup signal data to obtain pre-rendering picture storage data;
[0107] In an embodiment of the present invention, the display control unit initializes the viewing area in the VR scene according to the intelligent display control data obtained in step S3, such as the user's gaze point position and head movement trajectory. For example, if the user is looking at the area to the left of the front, the area is set as the current viewing area. Next, the display control unit analyzes the user's head movement trend and the complexity of the VR scene, such as the user's head turning speed, the number and density of objects in the scene, etc., to determine whether it is necessary to start the pre-rendering process. If it is determined that pre-rendering needs to be started, pre-rendering start signal data is generated, such as the range and priority of the pre-rendering area. The display control unit preferentially renders a part of the scene content around the viewing area according to the pre-rendering start signal data, and stores the rendered picture data to form pre-rendered picture storage data. For example, if the user's head is turning to the right, the picture in the right area is preferentially rendered, and the picture data is stored in the cache so that the user can immediately see a clear picture when turning his head, reducing delays and freezes.
[0108] Step S5: performing motion compensation processing on the pre-rendered image storage data, and using a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data;
[0109] In an embodiment of the present invention, when the user's head rotates, the display control unit reads the pre-rendered image storage data generated in step S4, and performs motion compensation processing on the image according to the speed and direction of the user's head movement. For example, if the user's head turns to the right, the pre-rendered image is translated to the left to keep the image consistent with the user's perspective and reduce image jitter and blur. At the same time, the display control unit uses the optical properties of the detachable transparent cover, such as adjusting the transmittance or polarization angle of the transparent cover, to optimize the VR display image for vestibular-visual anti-vertigo. For example, when the user's head rotates quickly, the transmittance of the transparent cover can be reduced, reducing the intensity of light entering the eyes, thereby reducing the feeling of dizziness. After motion compensation and anti-vertigo optimization, stable VR display image data is generated.
[0110] Step S6: Evaluate the fatigue level based on the stable VR display image data, and adaptively adjust the eye protection mode to generate adaptive eye protection control data.
[0111] In an embodiment of the present invention, the display control unit analyzes the stable VR display screen data generated in step S5, such as the brightness, color, and flickering frequency of the screen, and evaluates the user's fatigue level in combination with the user's viewing time and eye status data, such as pupil size and blinking frequency. For example, if the screen brightness is too high, the color is too bright, or the flickering frequency is too fast, the user's viewing time is long and the blinking frequency is accelerated, it is judged that the user has visual fatigue. According to the fatigue level assessment result, the display control unit automatically adjusts the eye protection mode parameters of the VR display, such as reducing the screen brightness, adjusting the color temperature, or turning on the anti-blue light mode, to generate adaptive eye protection control data. For example, if it is judged that the user is in a state of mild fatigue, the screen brightness is reduced by 10% and the color temperature is adjusted to a warm tone; if it is judged that the user is in a state of severe fatigue, the anti-blue light mode is turned on, and the user is advised to rest for a while.
[0112] Preferably, step S1 comprises the following steps:
[0113] Step S11: using the first infrared monitoring module to collect the real-time same-frequency distance of the display subject of the VR display, to obtain the same-frequency distance data of the display subject, and performing spatial coordinate calculation on the same-frequency distance data of the display subject to obtain the spatial positioning data of the display subject;
[0114] Step S12: Calculating the relative position of the detachable transparent cover using the second infrared monitoring module based on the display body spatial positioning data to obtain cover body deviation vector data;
[0115] Step S13: performing weighted calculation of installation fit of the detachable transparent cover according to the cover body deviation vector data using a preset transparent cover installation weight coefficient to generate installation fit data;
[0116] Step S14: the installation status of the installation fit data is evaluated through a preset installation status threshold range. When the installation fit data is at a high-level installation status threshold, it is fed back to the VR display display body for visual display to obtain the transparent cover successfully installed status data; when the installation fit data is at a low-level installation status threshold, the VR display display body is used to remind the user to reinstall the detachable transparent cover, and return to step S12 to calculate the relative position again; wherein the preset installation status threshold range includes a high-level installation status threshold, a medium-level installation status threshold and a low-level installation status threshold;
[0117] Step S15: When the installation fit data is at the middle-level installation state threshold, the cover body deviation vector data is used to perform control instruction correction processing to obtain installation correction instruction data; the controllable electromagnet array is used to perform magnetic force adaptive adjustment on the installation correction instruction data to obtain magnetic force compensation control data;
[0118] Step S16: adjusting the position of the transparent cover according to the magnetic force compensation control data, and confirming the successful calibration state according to the successful installation state data of the transparent cover, to obtain the calibration state data of the cover body.
[0119] In an embodiment of the present invention, the first infrared monitoring module transmits a modulated infrared signal, which is received by the infrared receiver of the display body and transmitted to the display control unit. The display control unit calculates the distance between the display body and the first infrared monitoring module based on the flight time, and obtains the precise position and posture of the display body in three-dimensional space by combining algorithms such as triangulation positioning. Next, the display control unit uses the second infrared monitoring module to measure the distance between the transparent cover and the monitoring module through the same infrared ranging principle. Assuming that the second infrared monitoring module is located directly in front of the display body and the distance of the transparent cover is measured to be 2cm, the display control unit calculates the deviation vector of the transparent cover relative to the display body in combination with the spatial positioning data of the display body. For example, if the transparent cover is offset by 1mm to the left and 0.5mm upward, deviation vector data is generated. The display control unit evaluates the installation fit of the transparent cover according to a preset installation weight coefficient. The weight coefficient is used to measure the degree of influence of deviations in different directions. The horizontal deviation weight is set to 0.8, the vertical direction is 0.5, and the rotation direction is 0.2. The deviation vector data is multiplied by the weight coefficient and summed up to obtain the installation fit data. Assuming the calculated result is 1.05, the value falls into the medium-level threshold range (1-3), and the display control unit prompts the user that there is a slight deviation in the installation of the transparent cover and adjustment is required. If the installation fit data is less than 1, the transparent cover is considered to be well installed, and the display control unit will display a prompt message of successful installation, such as a green check mark icon. If the data is greater than 3, it indicates that there is a serious problem with the installation, and the display control unit will prompt the user to reinstall. For the medium-level installation status, the display control unit will generate a correction instruction. According to the deviation vector data, assuming that the transparent cover is offset by 1mm to the left and 0.5mm upward, the display control unit will instruct the controllable electromagnet array to adjust the magnetic force. For example, the left electromagnet increases the magnetic force by 10%, the right side decreases by 5%, and the top increases by 2%. The display control unit converts these adjustment instructions into magnetic compensation control data, adjusts the current or voltage change value, and then applies appropriate magnetic force to correct the position of the transparent cover. The display control unit will continuously monitor the position of the transparent cover and compare it with the high-level installation status threshold in real time. When the position of the transparent cover reaches the high-level threshold, the display control unit confirms that the correction is successful and the transparent cover is accurately installed. At this time, the display control unit records the correction status data, indicating that the transparent cover has been successfully in place.
[0120] Preferably, step S15 comprises the following steps:
[0121] Step S151: performing deviation type analysis according to the installation fit data to generate cover body deviation type data; wherein the cover body deviation type data includes plane parallelism deviation data, center alignment deviation data and edge gap uniformity deviation data;
[0122] Step S152: performing main deviation vector decomposition on the cover body deviation vector data by using the cover body deviation type data to obtain main deviation vector data;
[0123] Step S153: performing correction instruction encoding processing on the main deviation vector data to generate installation correction instruction data;
[0124] Step S154: optimizing the control instruction steps of the installation correction instruction data to obtain optimized correction instruction data;
[0125] Step S155: using a pressure sensor array to perform pressure sampling on an edge area of the detachable transparent cover to obtain edge pressure sampling data;
[0126] Step S156: performing edge area quadrant distribution processing on the edge pressure sampling data, and performing regional pressure balance calculation to obtain regional pressure balance data;
[0127] Step S157: using the regional pressure balance data to identify the stress value region of the edge pressure sampling data, and using the optimization correction instruction data to encode the stress correction requirement of the transparent cover to generate stress correction requirement encoding data;
[0128] Step S158: Based on the stress correction requirement coded data, the controllable electromagnet array is used to perform magnetic force adaptive adjustment on the detachable transparent cover to obtain magnetic force compensation control data.
[0129] In an embodiment of the present invention, the display control unit analyzes the installation fit data to determine the installation deviation type of the transparent cover. For example, if the installation fit data shows that the overall deviation is large and the edge deviation is uniform, the display control unit determines it as a plane parallelism deviation; if the central area deviation is large and the edge deviation is small, it is determined as a center alignment deviation; if some edge deviations are large, it is determined as an edge gap uniformity deviation. These analysis results will be recorded as cover body deviation type data, such as a plane parallelism deviation of 0.5mm, a center alignment deviation of 1mm, and an edge gap uniformity deviation of 0.2mm. Based on the cover body deviation type data, the display control unit decomposes the cover body deviation vector. If the main deviation type is a center alignment deviation, the display control unit decomposes the deviation vector into a vector pointing to the center of the display, the vector size indicates the degree of deviation, and the direction indicates the direction of the deviation. For example, if the vector points to the left side of the display by 1mm, the display control unit encodes the vector as an instruction to increase the magnetic force of the left electromagnet and reduce the magnetic force of the right electromagnet. The specific adjustment amount will be set according to the direction and size of the deviation, for example, the magnetic force of the left electromagnet is increased by 10% and the right side is reduced by 5%. These instructions are called installation correction instruction data. In order to adjust more accurately and smoothly, the display control unit optimizes the correction instructions. The original one-step adjustment instructions will be broken down into multiple small steps to gradually adjust the magnetic force of the electromagnet to avoid vibration or over-adjustment. In addition, according to the material and weight of the transparent cover, the display control unit will also fine-tune the instructions to generate optimized correction instruction data. When the transparent cover is installed on the VR display, the pressure sensor array in the edge area will collect pressure data at each contact point. For example, if the 8 pressure sensors measure the pressure values of [10kPa, 12kPa, 8kPa, 9kPa, 11kPa, 13kPa, 7kPa, 10kPa] respectively, these data are the edge pressure sampling data. The display control unit divides the edge area of the transparent cover into four quadrants and corresponds the data of every two sensors to each quadrant. Then, the display control unit calculates the average pressure value of each quadrant and compares the pressure differences in different quadrants to evaluate the pressure balance in the edge area of the transparent cover. For example, if the average pressures of the four quadrants are 10kPa, 9kPa, 12kPa, and 8kPa respectively, the pressure balance is 4kPa (the difference between the maximum and minimum values). Based on the regional pressure balance data, the display control unit identifies the high stress area at the edge of the transparent cover. If the pressure in a quadrant exceeds the preset threshold, the quadrant is marked as a high stress area. The display control unit combines this regional information with the optimization correction instruction data to generate stress correction requirement encoding data. For example, if the upper left quadrant is a high stress area, the display control unit will generate an instruction to reduce the pressure in the area, such as reducing the suction of a nearby electromagnet.Through the stress correction requirement encoding data, the display control unit controls the controllable electromagnet array to perform adaptive adjustments, reducing the magnetic force in the high stress area, thereby reducing the pressure of the transparent cover in this area, ensuring that the transparent cover is installed in an accurate position and with uniform force, and finally generating magnetic compensation control data to achieve stable installation.
[0130] As an example of the present invention, refer to Figure 2 As shown, Figure 1 Detailed implementation steps of step S2 in the embodiment are shown in the flowchart. In this embodiment, step S2 includes:
[0131] Step S21: monitoring the user's wearing. When the user has finished wearing, monitoring the startup status of the VR display main body to obtain the VR display startup status data;
[0132] In an embodiment of the present invention, the VR display is equipped with a proximity sensor or other sensors for detecting whether the user is wearing the device. When the sensor detects that the user is wearing the VR display, the display control unit will automatically start the VR display display body and record the startup status data. For example, the display control unit sets the startup status data to "started". At the same time, the display control unit checks the cover body correction status data generated in steps S1 to S16 to confirm that the transparent cover is correctly installed. Only after confirming that the user has worn the VR device and the transparent cover has been correctly installed, will the subsequent steps be entered.
[0133] Step S22: continuously collecting ambient light intensity from the ambient light sensor according to the VR display startup state data and the cover body calibration state data to obtain original light intensity digital signal data;
[0134] In the embodiment of the present invention, after the VR display is started and the transparent cover is installed and calibrated, the ambient light sensor starts to continuously collect the light intensity of the surrounding environment. The ambient light sensor converts the light signal into a digital signal and generates raw light intensity digital signal data. For example, the sensor collects light intensity once per second and transmits the data in digital form to the display control unit. For example, if the measured light intensity value is 500 lux, the raw light intensity digital signal data is "500".
[0135] Step S23: using a temperature sensor to read the device temperature, obtaining device temperature data, and using the device temperature data to perform temperature compensation calibration on the original light intensity digital signal data, thereby generating real-time light intensity value compensation data;
[0136] In an embodiment of the present invention, the temperature sensor monitors the temperature of the VR device in real time and transmits the measured temperature data to the display control unit. For example, the measured temperature is 25°C. The display control unit calibrates the original light intensity digital signal data obtained in step S22 according to a preset temperature compensation curve. For example, assuming that the reading of the ambient light sensor increases by 2% for every 1°C increase in temperature. Since the current temperature is 25°C and the reference temperature is 20°C, the temperature increases by 5°C, and the sensor reading needs to be corrected downward by 10%. Therefore, the real-time light intensity value compensation data is 500×(1-0.1)=450lux.
[0137] Step S24: performing ambient light intensity classification on the real-time light intensity value compensation data to obtain ambient light level data;
[0138] In an embodiment of the present invention, the display control unit converts the real-time light intensity value compensation data into the ambient light level data according to the preset light intensity level classification standard. For example, the preset light intensity level classification standard is: 0-100 lux is a weak light environment, 100-500 lux is a medium light environment, 500-1000 lux is a strong light environment, and 1000 lux or more is an extremely strong light environment. According to the real-time light intensity value compensation data of 450 lux calculated in step S23, the display control unit determines that the current environment is a medium light environment, and sets the ambient light level data to "medium".
[0139] Step S25: Calculating the target light transmittance using a preset light transmittance adjustment strategy according to the ambient light level data to generate target light transmittance data;
[0140] In the embodiment of the present invention, the display control unit presets the transmittance adjustment strategy corresponding to different ambient light levels. For example, in a weak light environment, the target transmittance is 90%; in a medium light environment, the target transmittance is 60%; in a strong light environment, the target transmittance is 30%; in an extremely strong light environment, the target transmittance is 10%. According to the medium light environment determined in step S24, the display control unit sets the target transmittance data to 60%.
[0141] Step S26: reading the current transmittance of the detachable transparent cover, and calculating the transmittance difference according to the target transmittance data to obtain transmittance adjustment amount data;
[0142] In the embodiment of the present invention, the display control unit reads the current transmittance of the detachable transparent cover. For example, the current transmittance is 80%. The display control unit compares the target transmittance data (60%) calculated in step S25 with the current transmittance (80%), and calculates the transmittance adjustment amount data. In this example, the transmittance adjustment amount data is -20%.
[0143] Step S27: performing transmittance adjustment processing on the detachable transparent cover according to the transmittance adjustment amount data to generate transparent cover transmittance data.
[0144] In an embodiment of the present invention, the display control unit performs transmittance adjustment processing on the detachable transparent cover according to the transmittance adjustment amount data. For example, the detachable transparent cover adopts an electrochromic material or a liquid crystal material, and adjusts the transmittance by changing the applied voltage or current. The display control unit adjusts the voltage or current applied to the transparent cover according to the transmittance adjustment amount data (-20%), so that its transmittance is reduced from 80% to 60%. Finally, the display control unit records the adjusted transmittance as the transparent cover transmittance data, that is, 60%.
[0145] Preferably, step S3 comprises the following steps:
[0146] Step S31: performing initial display screen brightness mapping on the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data;
[0147] Step S32: Initializing the display content according to the basic brightness adjustment data to obtain visual VR display content data;
[0148] Step S33: using an image sensor to collect periodic images of the user's eyes based on the visualized VR display content data to obtain time-series user eye image data;
[0149] Step S34: performing display parameter analysis according to the time-series user eye image data to obtain screen display parameter data; fine-tuning left and right eye display parameters on the screen display parameter data to obtain left and right eye display fine-tuning parameters;
[0150] Step S35: using the left and right eye display fine-tuning parameters to perform display screen driving processing on the VR display display body, and perform display screen synchronization processing to obtain intelligent display screen adjustment data;
[0151] Step S36: performing user visual comfort feedback processing on the intelligent display picture adjustment data to obtain user adaptability feedback data;
[0152] Step S37: performing display parameter feedback optimization according to the user fitness feedback data, thereby obtaining intelligent display control data.
[0153] In an embodiment of the present invention, the display control unit calculates the initial brightness value of the VR display screen through a preset mapping function according to the transparent cover transmittance data obtained in step S27. For example, the transparent cover transmittance is 60%, and the preset mapping function is: basic brightness = 200-100×transmittance. Then the calculated initial brightness value is 200-100×0.6=140nit. This initial brightness value is the basic brightness adjustment data. Based on the basic brightness adjustment data calculated in step S31, the display control unit initializes the VR display content. For example, the initial brightness of the VR game scene is set to 140nit. At this time, the VR display will display the initialized game screen, for example, a bright forest scene, and all objects and characters are rendered at a brightness of 140nit. These initialized display contents are the visualized VR display content data. The image sensor begins to periodically collect user eye images. For example, the image sensor collects two eye images per second to record information such as the user's pupil size, blinking frequency, and gaze point position. These collected image data sequences are time-series user eye image data. The display control unit analyzes the time-series user eye image data and extracts features related to the display parameters. For example, by analyzing the changes in pupil size, the user's adaptation to the current brightness can be determined; by analyzing the blinking frequency, it can be determined whether the user has visual fatigue. Assuming that the analysis results show that the user's pupil is slightly reduced and the blinking frequency is normal, the display control unit determines that the user is relatively adapted to the current brightness. Then, the display control unit fine-tunes the screen display parameters according to the analysis results, for example, increasing the left eye brightness by 5nit and the right eye brightness by 3nit. These fine-tuned parameters are the left and right eye display fine-tuning parameters. The display control unit adjusts the brightness of the left and right eye display screens of the VR display according to the left and right eye display fine-tuning parameters. For example, adjust the brightness of the left eye display screen from 140nit to 145nit, and the brightness of the right eye display screen from 140nit to 143nit. At the same time, the display control unit will perform display screen synchronization processing to ensure that the images seen by the left and right eyes are consistent, avoiding problems such as screen tearing or freezes. These adjusted display screen data are the intelligent display screen adjustment data. The display control unit collects user feedback on the current display effect in a variety of ways. For example, the display control unit can track the user's head movement to determine whether the user frequently adjusts the head position to obtain a clearer view; the display control unit can also use the built-in eye tracking module to analyze the changes in the user's gaze point and determine whether the user feels uncomfortable with the brightness of certain areas. After these feedback information is processed, user fitness feedback data is generated. For example, if the user's head movement is stable and the gaze point is concentrated in the center of the picture, the display control unit determines that the user's fitness is high. The display control unit further optimizes the display parameters based on the user fitness feedback data.For example, if the user's adaptability is high, the display control unit will keep the current display parameters unchanged; if the user's adaptability is low, the display control unit will adjust the display parameters according to the user's feedback information, for example, further adjust the brightness, contrast, color temperature, etc. These optimized parameters ultimately generate intelligent display control data, which is used to control the display effect of the VR display, thereby improving the user's visual comfort and immersion.
[0154] Preferably, step S34 includes the following steps:
[0155] Step S341: grayscale the time-series user eye image data to obtain grayscale eye image data;
[0156] Step S342: performing contrast enhancement processing on the grayscale eye image data to obtain enhanced eye image data;
[0157] Step S343: performing eye region detection according to the enhanced eye image data to obtain eye region image data; performing binarization processing on the eye region image data and performing morphological operations to obtain candidate pupil region data;
[0158] Step S344: monitoring the pupil edge of the candidate pupil region data and performing ellipse fitting processing to obtain pupil response feature data;
[0159] Step S345: performing display parameter analysis according to pupil response characteristic data to obtain screen display parameter data;
[0160] Step S346: fine-tune the left and right eye parameters of the screen display parameter data using the human eye area image data and the user's sequential pupil monitoring data to obtain left and right eye display fine-tuning parameters.
[0161] In an embodiment of the present invention, the display control unit converts the time-series user eye image data obtained in step S33 into a grayscale image. For example, the values of the three RGB channels of the color image can be converted into grayscale values using a weighted average method, and the formula is Gray=0.299R+0.587G+0.114B. In this way, each color pixel will be converted into a grayscale value, and finally the grayscale eye image data will be obtained. The purpose of this step is to simplify the image data and reduce the amount of calculation for subsequent processing. The display control unit performs contrast enhancement processing on the grayscale eye image data so as to more clearly distinguish the pupil area. For example, a histogram equalization method can be used to adjust the grayscale histogram of the image to a more uniform distribution, thereby improving the contrast of the image. By enhancing the contrast, the difference between the pupil area and the surrounding area can be made more obvious. The display control unit uses a human eye detection algorithm, such as a cascade classifier based on Haar features or a target detection model based on deep learning, to locate the human eye area in the enhanced eye image data. The detected human eye area will be marked to form human eye area image data. Then, the human eye area image data is binarized to convert the image into a black and white image, in which the pupil area is black and the other areas are white. In order to remove noise and minor interference, morphological operations such as corrosion and expansion operations are performed to finally obtain candidate pupil area data, which includes the black area of the pupil. The display control unit performs edge detection on the candidate pupil area data, for example, using the Canny edge detection algorithm to extract the edge information of the pupil. Then, an ellipse fitting algorithm, such as the least squares method, is used to fit the detected edge into an ellipse. The parameters of the fitted ellipse, such as the center coordinates of the ellipse, the length of the major and minor axes, the rotation angle, etc., are the pupil response feature data. These data can reflect the changes in the size and shape of the pupil. The display control unit analyzes the display parameters based on the pupil response feature data. For example, the pupil diameter can reflect the user's perception of the current brightness. If the pupil diameter is large, it means that the environment is dark or the user feels that the brightness is insufficient; if the pupil diameter is small, it means that the environment is bright or the user feels that the brightness is too high. The display control unit can adjust the screen brightness, contrast and other parameters according to the change in the pupil diameter to obtain the best display effect. The parameters obtained from these analyses are the screen display parameter data. The display control unit fine-tunes the left and right eye parameters of the screen display parameter data in combination with the human eye area image data and the user's sequential pupil monitoring data. For example, by analyzing the difference between the left and right pupils, the difference in vision between the user's left and right eyes can be determined, and the display parameters of the left and right eyes can be adjusted differently. For example, if the user's left eye pupil diameter is larger than the right eye pupil diameter, the display control unit can appropriately increase the brightness of the left eye display screen to compensate for the lack of vision of the left eye. These fine-tuned parameters are the left and right eye display fine-tuning parameters.
[0162] Preferably, step S345 includes the following steps:
[0163] Step S3451: Calculate pupil diameter based on pupil response characteristic data to obtain time series pupil diameter data;
[0164] Step S3452: Statistically analyzing the time series pupil diameter data, determining the pupil diameter interval, and generating user pupil diameter interval data;
[0165] Step S3453: obtaining a preset pupil diameter-display parameter two-dimensional mapping table;
[0166] Step S3454: performing cell mapping matching on the user's pupil diameter interval data through a preset pupil diameter-display parameter two-dimensional mapping table to obtain target mapping cell data; determining the domain cell according to the target mapping cell data to obtain neighborhood mapping cell data;
[0167] Step S3455: performing cell weight processing on the target mapping cell data and the neighborhood mapping cell data to obtain cell weight data;
[0168] Step S3456: extracting display parameters of the target mapping cell data and the neighborhood mapping cell data, and performing weighted processing on the target display parameters using the cell weight data to obtain screen display parameter data, wherein the screen display parameter data includes screen brightness parameters and contrast parameters.
[0169] In an embodiment of the present invention, the display control unit calculates the pupil diameter according to the pupil response characteristic data obtained in step S344. The pupil response characteristic data includes the length of the major and minor axes of the fitted ellipse, and the pupil diameter can be calculated based on these two values. Since the pupil shape is not a perfect circle, the average value of the major and minor axes can be taken as the pupil diameter. The display control unit will continue to track the changes in the pupil to obtain a series of pupil diameter data, which are arranged in chronological order to form time-series pupil diameter data, for example: [2.5mm, 2.6mm, 2.7mm, 2.8mm, 2.7mm, 2.6mm]. The display control unit performs statistical analysis on the time-series pupil diameter data collected over a period of time, such as calculating the average value, variance, maximum value and minimum value. Assume that the average value of the pupil diameter data collected over a period of time is 2.65mm, the maximum value is 2.8mm, and the minimum value is 2.5mm. The display control unit can determine the user's pupil diameter interval data based on these statistical results, for example, setting the pupil diameter interval to 2.5mm to 2.8mm. The display control unit pre-stores a pupil diameter-display parameter two-dimensional mapping table. The table uses pupil diameter as a row index and display parameters as a column index. Each cell in the table stores the recommended display parameter value for the corresponding pupil diameter. For example, a row in the table indicates that when the pupil diameter is 2.6 mm, the recommended screen brightness is 120 nit and the contrast is 80. The display control unit matches the user pupil diameter interval data obtained in step S3452 with the preset pupil diameter-display parameter two-dimensional mapping table. For example, if the user pupil diameter interval is 2.5 mm to 2.8 mm, the display control unit will find the cell corresponding to the interval in the mapping table, for example, find the cell corresponding to the pupil diameter of 2.6 mm as the target mapping cell data. At the same time, the display control unit will also determine the neighborhood mapping cell data around the target cell, such as the cells corresponding to the pupil diameters of 2.5 mm and 2.7 mm. The display control unit assigns a weight to each cell according to the degree of proximity between the target mapping cell and the neighborhood mapping cell and the user pupil diameter interval data. For example, the midpoint of the user's pupil diameter interval is 2.65mm, which is closest to 2.6mm, so the cell weight corresponding to 2.6mm is the highest, for example, set to 0.6; the distance to 2.7mm is second, so the cell weight corresponding to 2.7mm is the second highest, for example, set to 0.3; the distance to 2.5mm is farthest, so the cell weight corresponding to 2.5mm is the lowest, for example, set to 0.1. These weight values are the cell weight data. The display control unit extracts the corresponding display parameters, such as screen brightness and contrast, from the target mapping cell and the neighborhood mapping cell. Then, the cell weight data calculated in step S3455 is used to perform weighted averaging on these display parameters to obtain the final screen display parameter data.For example, the brightness of a 2.6mm cell is 120nit and the contrast is 80; the brightness of a 2.7mm cell is 115nit and the contrast is 75; the brightness of a 2.5mm cell is 125nit and the contrast is 85. The weighted average screen brightness parameter is 120×0.6+115×0.3+125×0.1=119nit, and the contrast parameter is 80×0.6+75×0.3+85×0.1=79.5.
[0170] Preferably, step S346 includes the following steps:
[0171] Step S3461: Calculate the distance between the pupil centers of both eyes according to the user's time-series pupil monitoring data to generate user pupil distance data;
[0172] Step S3462: Calculate the distance between the eye corner and the pupil of the user's time-series pupil monitoring data through the human eye area image data to generate user eye distance data;
[0173] Step S3463: Calculate the left-eye and right-eye disparity coefficients according to the user pupil distance data and the user eye distance data to obtain the left-eye and right-eye disparity coefficients;
[0174] Step S3464: Use the left-eye and right-eye parallax coefficients to fine-tune the left-eye and right-eye display parameter data to obtain left-eye and right-eye display fine-tuning parameters.
[0175] In an embodiment of the present invention, the display control unit obtains the coordinates of the left and right pupil centers in each frame of the image based on the time-series user pupil monitoring data. The distance between the left and right pupil center points is calculated using the coordinate calculation formula. For example, assuming that the coordinates of the left pupil center are (x1, y1) and the coordinates of the right pupil center are (x2, y2), the pupil center distance can be calculated using the distance formula: d = sqrt((x2-x1)^2+(y2-y1)^2). The calculation result is the user's pupil distance data, for example, the calculation result is 63mm. The display control unit uses the human eye area image data to identify and extract the position information of the eye corners. At the same time, the position information of the pupil center is obtained based on the user's time-series pupil monitoring data. The user's eye distance data is obtained by calculating the distance between the eye corner position and the pupil center position. For example, assuming that the coordinates of the left eye corner are (x3, y3) and the coordinates of the left pupil center are (x1, y1), the left eye distance can be calculated using the distance formula: d_left = sqrt((x3-x1)^2+(y3-y1)^2). Similarly, the right eye distance d_right can be calculated. Assume that the calculation result shows that the left eye distance is 32mm and the right eye distance is 31mm. The display control unit calculates the left and right eye disparity coefficients based on the user's pupil distance data and the user's eye distance data. The disparity coefficient can reflect the visual difference between the user's two eyes and is used to adjust the display parameters of the left and right eyes, thereby improving the user's visual comfort. A simple method for calculating the disparity coefficient is: left eye disparity coefficient = left eye distance / pupil distance, right eye disparity coefficient = right eye distance / pupil distance. For example, based on the previously calculated pupil distance of 63mm, the left eye distance of 32mm, and the right eye distance of 31mm, it can be calculated that the left eye parallax coefficient is 32 / 63≈0.51, and the right eye parallax coefficient is 31 / 63≈0.49. The display control unit uses the left and right eye parallax coefficients to fine-tune the screen display parameter data obtained in step S3456. For example, assume that the screen brightness parameter calculated in step S3456 is 119nit and the contrast parameter is 79.5. The display control unit can adjust the brightness and contrast according to the left and right eye parallax coefficients. For example, left eye brightness = screen brightness parameter × left eye parallax coefficient = 119×0.51≈60.7nit, right eye brightness = screen brightness parameter × right eye parallax coefficient = 119×0.49≈58.3nit. Similarly, the left and right eye contrast can be calculated. These adjusted parameters are the left and right eye display fine-tuning parameters, for example, left eye brightness 60.7nit, left eye contrast 40.5, right eye brightness 58.3nit, right eye contrast 39.0. By fine-tuning the left and right eye parameters, it can better adapt to the user's binocular vision differences and improve the comfort and immersion of the VR experience.
[0176] As an example of the present invention, refer to Figure 3 As shown, Figure 1Detailed implementation steps of step S4 in the embodiment are shown in the flowchart. In this embodiment, step S4 includes:
[0177] Step S41: Initializing the viewing area of the VR display subject through intelligent display control data to obtain initial VR viewing area parameters;
[0178] In an embodiment of the present invention, the display control unit initializes the viewing area of the VR display according to the intelligent display control data obtained in step S37. The intelligent display control data includes the user's visual parameters and preference settings, such as the user's pupil distance, vision, etc. The display control unit determines the initial VR viewing area parameters based on these parameters, such as the center position, size, and shape of the viewing area. Assume that the initial VR viewing area parameters are set to a circular area with a radius of 5 degrees centered on the user's gaze point.
[0179] Step S42: Dynamically track the user's eye movement to obtain eye gaze point coordinate data;
[0180] In an embodiment of the present invention, the display control unit uses eye tracking technology to track the user's eye movement in real time. Eye tracking technology can capture the image of the user's eye through an image sensor and analyze the feature points in the image, such as the pupil center, corneal reflection point, etc., to determine the position and gaze direction of the eye. The display control unit records the eye gaze point coordinates at each moment to form an eye gaze point coordinate data stream. For example, the eye gaze point coordinate data at a certain moment is (100, 200).
[0181] Step S43: judging whether the eyeball gaze point is within the viewing area based on the eyeball gaze point coordinate data and the initial VR viewing area parameters, and obtaining the gaze area state data;
[0182] In the embodiment of the present invention, the display control unit compares the eye gaze point coordinate data obtained in step S42 with the initial VR viewing area parameters determined in step S41 to determine whether the eye gaze point is within the viewing area. For example, if the eye gaze point coordinates (100, 200) fall within the initial VR viewing area (a circular area with a radius of 5 degrees and the user's initial gaze point as the center), the gaze area state data is "within the area"; otherwise, the gaze area state data is "outside the area".
[0183] Step S44: performing pre-rendering process start analysis according to the gaze area state data, and generating pre-rendering start signal data;
[0184] In an embodiment of the present invention, the display control unit performs a pre-rendering process startup analysis based on the gaze area status data. If the gaze area status data is "outside the area" and the eye movement speed exceeds a preset threshold, it is considered that the user is about to look at a new area, the pre-rendering process is started, and pre-rendering startup signal data is generated, for example, the pre-rendering startup signal data is set to "start". If the gaze area status data is "inside the area" or the eye movement speed is lower than the preset threshold, the pre-rendering process is not started, and the pre-rendering startup signal data is set to "not started".
[0185] Step S45: determining the pre-rendering area according to the eye gaze point coordinate data based on the pre-rendering start signal data, and generating pre-rendering area parameters;
[0186] In the embodiment of the present invention, when the pre-rendering start signal data is "start", the display control unit predicts the area that the user is about to gaze at based on the eye gaze point coordinate data and the eye movement direction, and determines the pre-rendering area parameters. For example, if the eye gaze point coordinate moves to the upper right, the display control unit will set the pre-rendering area parameters to a rectangular area to the upper right of the eye gaze point coordinate, and the size and position of the area are determined by the eye movement speed and direction.
[0187] Step S46: performing pre-rendering area priority rendering based on the pre-rendering area parameters, and using a preset multi-level rendering cache mechanism to cache the pre-rendering picture to obtain pre-rendering picture storage data.
[0188] In an embodiment of the present invention, the display control unit performs priority rendering on the pre-rendering area according to the pre-rendering area parameters. This means that the display control unit will allocate more computing resources to the rendering of the pre-rendering area to ensure the picture quality of the area. After the rendering is completed, the display control unit stores the rendering results in a preset multi-level rendering cache mechanism. The multi-level rendering cache mechanism can store the picture in different levels of cache according to the importance of the picture content. For example, the area that the user is about to look at will be stored in the highest level of cache, while the area far away from the point of gaze will be stored in a lower level of cache. This can effectively utilize the storage space and increase the loading speed of the picture. Finally, the display control unit obtains the pre-rendering picture storage data, which contains the rendering results of the pre-rendering area.
[0189] Preferably, the present invention further provides a VR display, which includes a VR display display body, a detachable transparent cover, a display control unit, an infrared sensor, an ambient light sensor, a temperature sensor, an image sensor, and a pressure sensor array, wherein the detachable transparent cover is arranged on the display surface of the VR display display body, the display control unit is electrically connected to the VR display display body, the infrared sensor, the ambient light sensor, the temperature sensor, the image sensor, and the pressure sensor array are electrically connected to the display control unit through a data bus, the ambient light sensor and the temperature sensor are installed between the VR display display body and the detachable transparent cover, and the pressure sensor array is arranged around the VR display housing on which the detachable transparent cover can be installed, wherein the display control unit is used to execute the control method of the VR display as described above, and the display control unit includes the following modules:
[0190] A cover correction control module is used to evaluate the installation status of the detachable transparent cover using an infrared sensor and to perform magnetic compensation correction processing using a controllable electromagnet array to obtain cover correction status data;
[0191] The light transmittance adjustment module is used to collect the ambient light intensity according to the cover body correction state data, and perform temperature compensation calibration to generate real-time light intensity value compensation data; the light transmittance of the detachable transparent cover is adjusted by the real-time light intensity value compensation data to generate the transparent cover transmittance data;
[0192] The display parameter adjustment module is used to perform initial display screen brightness mapping on the display body of the VR display through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data;
[0193] The pre-rendering start module is used to initialize the viewing area according to the intelligent display control data, and perform pre-rendering process start analysis to generate pre-rendering start signal data; perform pre-rendering area priority rendering according to the pre-rendering start signal data to obtain pre-rendering picture storage data;
[0194] The image stabilization processing module is used to perform motion compensation processing on the pre-rendered image storage data, and use a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data;
[0195] The eye protection mode adaptive module is used to evaluate the fatigue level based on the stable VR display image data, and to adaptively adjust the eye protection mode to generate adaptive eye protection control data.
[0196] The present application is to use an ambient light sensor to monitor the light intensity in real time, and to combine the temperature sensor for data compensation to ensure that the brightness of the display screen and the transmittance of the transparent cover can be dynamically adjusted in strong or weak light environments. This intelligent light adjustment mechanism effectively solves the problem that the picture of traditional VR devices is unclear or too dazzling when the light conditions are complex and changeable, and ensures that users can get a clear and comfortable visual experience in any environment. The image sensor regularly collects user eye data, especially information such as pupil size and blinking frequency, to achieve personalized adjustment of display brightness and contrast. This intelligent adjustment can optimize the display parameters in real time according to the user's eye state, which not only improves the user's visual comfort, but also effectively relieves the visual fatigue caused by long-term use and prolongs the use time. In addition, the independent display parameter fine-tuning function of the left and right eyes solves the visual discomfort problem caused by the difference between the left and right eyes of the user, making the VR experience more natural and smooth. The detachable transparent cover design provides additional light adjustment capabilities, especially in strong light environments, by adjusting the transmittance of the transparent cover to reduce the light entering the eyes, thereby avoiding the situation where the picture is covered by strong light. At the same time, the transparent cover can effectively cooperate with the vestibular-visual system to reduce the common feeling of dizziness during use, so that users can maintain a stable visual experience when their heads turn quickly or scenes switch. Combined with motion compensation processing, the system of the present invention greatly reduces the image jitter and lag in VR scenes, improves the overall display smoothness and user immersion. By monitoring the user's pupil changes and viewing time, the system can automatically adjust the screen's brightness, color temperature and other parameters to effectively reduce visual fatigue and protect the user's eye health. Therefore, it not only improves the adaptability of VR displays under complex lighting conditions, improves the clarity and stability of the displayed image, but also significantly enhances the safety of the device and the comfort of the user experience.
[0197] Therefore, the embodiments should be regarded as illustrative and non-restrictive from all points, and the scope of the present invention is limited by the appended claims rather than the above description, and it is therefore intended that all changes falling within the meaning and range of equivalent elements of the application documents are included in the present invention.
[0198] The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.
Claims
1. A method for controlling a VR display, characterized in that: Applied to a VR display, the VR display includes a VR display display body, a detachable transparent cover, a display control unit, an infrared sensor, an ambient light sensor, a temperature sensor, an image sensor, and a pressure sensor array, the detachable transparent cover is arranged on the display surface of the VR display display body, the display control unit is electrically connected to the VR display display body, the infrared sensor, the ambient light sensor, the temperature sensor, the image sensor, and the pressure sensor array are electrically connected to the display control unit via a data bus, and the control method of the VR display includes the following steps: Step S1: using an infrared sensor to evaluate the installation status of the detachable transparent cover, and using a controllable electromagnet array to perform magnetic force compensation correction processing to obtain cover correction status data; Step S2: collecting the ambient light intensity according to the cover body correction state data, and performing temperature compensation calibration to generate real-time light intensity value compensation data; adjusting the transmittance of the detachable transparent cover according to the real-time light intensity value compensation data to generate transparent cover transmittance data; Step S3: Initially map the brightness of the display screen of the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data; Step S4: Initialize the viewing area according to the intelligent display control data, and perform pre-rendering process startup analysis to generate pre-rendering startup signal data; perform pre-rendering area priority rendering according to the pre-rendering startup signal data to obtain pre-rendering picture storage data; Step S5: performing motion compensation processing on the pre-rendered image storage data, and using a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data; Step S6: Evaluate the fatigue level based on the stable VR display image data, and adaptively adjust the eye protection mode to generate adaptive eye protection control data.
2. The control method of the VR display according to claim 1, characterized in that: Four infrared sensors are arranged at the four corners of the edge of the VR display body as the first infrared monitoring module, and four infrared sensors are arranged at the four corners of the edge of the detachable transparent cover as the second infrared monitoring module. Step S1 includes the following steps: Step S11: using the first infrared monitoring module to collect the real-time same-frequency distance of the display subject of the VR display, to obtain the same-frequency distance data of the display subject, and performing spatial coordinate calculation on the same-frequency distance data of the display subject to obtain the spatial positioning data of the display subject; Step S12: Calculating the relative position of the detachable transparent cover using the second infrared monitoring module based on the display body spatial positioning data to obtain cover body deviation vector data; Step S13: performing weighted calculation of installation fit of the detachable transparent cover according to the cover body deviation vector data using a preset transparent cover installation weight coefficient to generate installation fit data; Step S14: the installation status of the installation fit data is evaluated through a preset installation status threshold range. When the installation fit data is at a high-level installation status threshold, it is fed back to the VR display display body for visual display to obtain the transparent cover successfully installed status data; when the installation fit data is at a low-level installation status threshold, the VR display display body is used to remind the user to reinstall the detachable transparent cover, and return to step S12 to calculate the relative position again; wherein the preset installation status threshold range includes a high-level installation status threshold, a medium-level installation status threshold and a low-level installation status threshold; Step S15: When the installation fit data is at the middle-level installation state threshold, the cover body deviation vector data is used to perform control instruction correction processing to obtain installation correction instruction data; the controllable electromagnet array is used to perform magnetic force adaptive adjustment on the installation correction instruction data to obtain magnetic force compensation control data; Step S16: adjusting the position of the transparent cover according to the magnetic force compensation control data, and confirming the successful calibration state according to the successful installation state data of the transparent cover, to obtain the calibration state data of the cover body.
3. The control method of the VR display according to claim 2, characterized in that: Step S15 includes the following steps: Step S151: performing deviation type analysis according to the installation fit data to generate cover body deviation type data; wherein the cover body deviation type data includes plane parallelism deviation data, center alignment deviation data and edge gap uniformity deviation data; Step S152: performing main deviation vector decomposition on the cover body deviation vector data by using the cover body deviation type data to obtain main deviation vector data; Step S153: performing correction instruction encoding processing on the main deviation vector data to generate installation correction instruction data; Step S154: optimizing the control instruction steps of the installation correction instruction data to obtain optimized correction instruction data; Step S155: using a pressure sensor array to perform pressure sampling on an edge area of the detachable transparent cover to obtain edge pressure sampling data; Step S156: performing edge area quadrant distribution processing on the edge pressure sampling data, and performing regional pressure balance calculation to obtain regional pressure balance data; Step S157: using the regional pressure balance data to identify the stress value region of the edge pressure sampling data, and using the optimization correction instruction data to encode the stress correction requirement of the transparent cover to generate stress correction requirement encoding data; Step S158: Based on the stress correction requirement coded data, the controllable electromagnet array is used to perform magnetic force adaptive adjustment on the detachable transparent cover to obtain magnetic force compensation control data.
4. The control method of the VR display according to claim 1, characterized in that: Step S2 includes the following steps: Step S21: monitoring the user's wearing. When the user has finished wearing, monitoring the startup status of the VR display main body to obtain the VR display startup status data; Step S22: continuously collecting ambient light intensity from the ambient light sensor according to the VR display startup state data and the cover body calibration state data to obtain original light intensity digital signal data; Step S23: using a temperature sensor to read the device temperature, obtaining device temperature data, and using the device temperature data to perform temperature compensation calibration on the original light intensity digital signal data, thereby generating real-time light intensity value compensation data; Step S24: performing ambient light intensity classification on the real-time light intensity value compensation data to obtain ambient light level data; Step S25: Calculating the target light transmittance using a preset light transmittance adjustment strategy according to the ambient light level data to generate target light transmittance data; Step S26: reading the current transmittance of the detachable transparent cover, and calculating the transmittance difference according to the target transmittance data to obtain transmittance adjustment amount data; Step S27: performing transmittance adjustment processing on the detachable transparent cover according to the transmittance adjustment amount data to generate transparent cover transmittance data.
5. The control method of the VR display according to claim 1, characterized in that: Step S3 includes the following steps: Step S31: performing initial display screen brightness mapping on the VR display main body through the transparent cover transmittance data to obtain basic brightness adjustment data; Step S32: Initializing the display content according to the basic brightness adjustment data to obtain visual VR display content data; Step S33: using an image sensor to collect periodic images of the user's eyes based on the visualized VR display content data to obtain time-series user eye image data; Step S34: performing display parameter analysis according to the time-series user eye image data to obtain screen display parameter data; fine-tuning left and right eye display parameters on the screen display parameter data to obtain left and right eye display fine-tuning parameters; Step S35: using the left and right eye display fine-tuning parameters to perform display screen driving processing on the VR display display body, and perform display screen synchronization processing to obtain intelligent display screen adjustment data; Step S36: performing user visual comfort feedback processing on the intelligent display picture adjustment data to obtain user adaptability feedback data; Step S37: performing display parameter feedback optimization according to the user fitness feedback data, thereby obtaining intelligent display control data.
6. The method for controlling a VR display according to claim 5, characterized in that: Step S34 includes the following steps: Step S341: grayscale the time-series user eye image data to obtain grayscale eye image data; Step S342: performing contrast enhancement processing on the grayscale eye image data to obtain enhanced eye image data; Step S343: performing eye region detection according to the enhanced eye image data to obtain eye region image data; performing binarization processing on the eye region image data and performing morphological operations to obtain candidate pupil region data; Step S344: monitoring the pupil edge of the candidate pupil region data and performing ellipse fitting processing to obtain pupil response feature data; Step S345: performing display parameter analysis according to pupil response characteristic data to obtain screen display parameter data; Step S346: fine-tune the left and right eye parameters of the screen display parameter data using the human eye area image data and the user's sequential pupil monitoring data to obtain left and right eye display fine-tuning parameters.
7. The method for controlling a VR display according to claim 6, characterized in that: Step S345 includes the following steps: Step S3451: Calculate pupil diameter based on pupil response characteristic data to obtain time series pupil diameter data; Step S3452: Statistically analyzing the time series pupil diameter data, determining the pupil diameter interval, and generating user pupil diameter interval data; Step S3453: obtaining a preset pupil diameter-display parameter two-dimensional mapping table; Step S3454: performing cell mapping matching on the user's pupil diameter interval data through a preset pupil diameter-display parameter two-dimensional mapping table to obtain target mapping cell data; determining the domain cell according to the target mapping cell data to obtain neighborhood mapping cell data; Step S3455: performing cell weight processing on the target mapping cell data and the neighborhood mapping cell data to obtain cell weight data; Step S3456: extracting display parameters of the target mapping cell data and the neighborhood mapping cell data, and performing weighted processing on the target display parameters using the cell weight data to obtain screen display parameter data, wherein the screen display parameter data includes screen brightness parameters and contrast parameters.
8. The method for controlling a VR display according to claim 6, characterized in that: Step S346 includes the following steps: Step S3461: Calculate the distance between the pupil centers of both eyes according to the user's time-series pupil monitoring data to generate user pupil distance data; Step S3462: Calculate the distance between the eye corner and the pupil of the user's time-series pupil monitoring data through the human eye area image data to generate user eye distance data; Step S3463: Calculate the left-eye and right-eye disparity coefficients according to the user pupil distance data and the user eye distance data to obtain the left-eye and right-eye disparity coefficients; Step S3464: Use the left-eye and right-eye parallax coefficients to fine-tune the left-eye and right-eye display parameter data to obtain left-eye and right-eye display fine-tuning parameters.
9. The method for controlling a VR display according to claim 1, characterized in that: Step S4 includes the following steps: Step S41: Initializing the viewing area of the VR display subject through intelligent display control data to obtain initial VR viewing area parameters; Step S42: Dynamically track the user's eye movement to obtain eye gaze point coordinate data; Step S43: judging whether the eyeball gaze point is within the viewing area based on the eyeball gaze point coordinate data and the initial VR viewing area parameters, and obtaining the gaze area state data; Step S44: performing pre-rendering process start analysis according to the gaze area state data, and generating pre-rendering start signal data; Step S45: determining the pre-rendering area according to the eye gaze point coordinate data based on the pre-rendering start signal data, and generating pre-rendering area parameters; Step S46: performing pre-rendering area priority rendering based on the pre-rendering area parameters, and using a preset multi-level rendering cache mechanism to cache the pre-rendering picture to obtain pre-rendering picture storage data.
10. A VR display, characterized in that: The VR display comprises a VR display main body, a detachable transparent cover, a display control unit, an infrared sensor, an ambient light sensor, a temperature sensor, an image sensor and a pressure sensor array, wherein the detachable transparent cover is arranged on the display surface of the VR display main body, the display control unit is electrically connected to the VR display main body, the infrared sensor, the ambient light sensor, the temperature sensor, the image sensor and the pressure sensor array are electrically connected to the display control unit via a data bus, the ambient light sensor and the temperature sensor are installed between the VR display main body and the detachable transparent cover, and the pressure sensor array is arranged around the VR display housing on which the detachable transparent cover can be installed, wherein the display control unit is used to execute the control method of the VR display according to claim 1, and the display control unit comprises the following modules: A cover correction control module is used to evaluate the installation status of the detachable transparent cover using an infrared sensor and to perform magnetic force compensation correction processing using a controllable electromagnet array to obtain cover correction status data; The light transmittance adjustment module is used to collect the ambient light intensity according to the cover body correction state data, and perform temperature compensation calibration to generate real-time light intensity value compensation data; the light transmittance of the detachable transparent cover is adjusted by the real-time light intensity value compensation data to generate the transparent cover transmittance data; The display parameter adjustment module is used to perform initial display screen brightness mapping on the display body of the VR display through the transparent cover transmittance data to obtain basic brightness adjustment data; use the image sensor to collect periodic images of the user's eyes to obtain time-series user eye image data; fine-tune the left and right eye display parameters of the basic brightness adjustment data through the time-series user eye image data to obtain left and right eye display fine-tuning parameters; perform display screen drive processing according to the left and right eye display fine-tuning parameters, and perform display parameter feedback optimization to obtain intelligent display control data; The pre-rendering start module is used to initialize the viewing area according to the intelligent display control data, and perform pre-rendering process start analysis to generate pre-rendering start signal data; perform pre-rendering area priority rendering according to the pre-rendering start signal data to obtain pre-rendering picture storage data; The image stabilization processing module is used to perform motion compensation processing on the pre-rendered image storage data, and use a detachable transparent cover to perform vestibular-visual anti-vertigo optimization to generate stable VR display image data; The eye protection mode adaptive module is used to evaluate the fatigue level based on the stable VR display image data, and to adaptively adjust the eye protection mode to generate adaptive eye protection control data.
Citation Information
Patent Citations
Head-mounted virtual reality apparatus and control method therefor based on mobile terminal
CN105224079A
Method and apparatus for rendering virtual reality on the basis of a head-mounted visual device
CN106652004A
Adaptive parallax adjustment method and virtual reality VR display system
CN107682690A
Augmented reality display system
CN111512211A
Wearable device
CN112147781A
Cited By
Method for improving detail display quality of VR equipment by using binocular difference mechanism
CN120111208A
VR display parameter adaptive setting method based on ambient light perception
CN121050103A