Focus adjustment method, system, controller and storage medium for virtual reality head display

Abstract

The present application relates to the field of virtual reality technology, and in particular to a focus adjustment method, system, controller and storage medium for a virtual reality head display. The method includes: displaying a virtual scene to a user; capturing the gaze line information of each eyeball of the user; analyzing and obtaining interaction point information about the gaze line interaction based on the gaze line information of each eyeball; and adjusting the focal length based on the object corresponding to the interaction point information in the virtual scene. The present application allows the user to observe the virtual scene, capture the gaze line information of the user's eyeball, and analyze the gaze line information to obtain the corresponding interaction point information. Then, the focal length is dynamically adjusted based on the interaction point information. In this way, when the user observes any object in the virtual scene, the present application adjusts the focal length accordingly based on the interaction point information obtained after capturing and analyzing, so that the user can obtain the experience of virtual scene observation and depth of field change, and it helps to reduce eye fatigue, facilitate long-term use, and optimize the use effect.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a focus adjustment method, system, controller and storage medium for a virtual reality head display. Background Art

[0002] Virtual reality refers to a technology that allows people to immerse themselves in virtual scenes through sensory experience. And virtual reality is mainly manifested by people wearing head-mounted displays. Head-mounted displays can also be referred to as virtual reality headsets. Their working principle is to use computers to calculate and simulate virtual scenes. Virtual scenes are mainly displayed through display screens that are close to the glasses. Since the virtual scenes display rich content, users often need to adjust their eyes to focus on the area they want to focus on in the scene in such a close distance. In the long run, it will cause fatigue to the user's eyes.

[0003] At present, relevant technologies cannot solve the defect that long-term use of virtual reality headsets will cause fatigue, which will affect the user's experience of using virtual reality headsets. The above problems need to be solved urgently. Summary of the invention

[0004] In order to solve the problem of eye fatigue that users currently experience when using a virtual reality head-mounted display, the present application provides a focus adjustment method, system, controller, and storage medium for a virtual reality head-mounted display.

[0005] In a first aspect, the present application provides a focus adjustment method for a virtual reality head display, comprising:

[0006] Displaying a virtual scene to a user;

[0007] Capture the gaze line information of each eye of the user;

[0008] Analyzing and obtaining interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball;

[0009] The focal length is adjusted according to the object corresponding to the interaction point information in the virtual scene.

[0010] By adopting the above scheme, after the user wears the virtual reality headset, the display of the virtual reality headset displays the virtual scene outwardly, so that the user can observe the virtual scene. In this process, the capture component of the virtual reality headset captures the gaze line information of the user's eyeball, and then analyzes the gaze line information through the controller of the virtual reality headset, that is, the corresponding interaction point information is obtained by analyzing the extended interaction of the gaze line. Then the adjustment component of the virtual reality headset dynamically adjusts the focal length according to the interaction point information. In this way, when the user observes any object in the virtual scene, the virtual reality headset can adjust the focal length accordingly according to the interaction point information obtained after the capture and analysis, so that the user can obtain the experience of virtual scene observation and depth of field change, and it helps to reduce eye fatigue, facilitate long-term use, and optimize the use effect.

[0011] Optionally, the specific steps of capturing the gaze line information of each eyeball of the user include:

[0012] Sending light control information to the light emitting device;

[0013] Acquiring reflected image information based on a reflection receiving camera, wherein the reflected image information is derived from the light emitted by the light emitting device being reflected by the user's eyeball;

[0014] The reflected image information is analyzed to determine the pupil position in the corresponding eyeball, and then the gaze line information of each eyeball of the user is obtained.

[0015] By adopting the above-mentioned scheme, the present application emits light to the user's eyeballs. Based on the fact that the brightness of the pupil area of ​​the eyeball is lower than that of other areas of the eyeball, it is convenient to obtain the position of the pupil from the acquired reflected image information, and then the gaze line information of the corresponding eyeball can be obtained based on the pupil position analysis.

[0016] Optionally, when the object is rendered close to the user's eyeball, the control adjustment member drives the optical light-transmitting member to move in a direction close to the user's eyeball;

[0017] or,

[0018] When the object is rendered away from the user's eyeball, the control adjustment component drives the optical light-transmitting component to move in a direction away from the user's eyeball.

[0019] By adopting the above solution, when the virtual distance between the object in the virtual scene and the user's eyeball changes, the controller of the virtual reality head display controls the adjustment member to drive the optical light-transmitting member to move, so as to correspond to the change in the distance between the optical light-transmitting member and the eyeball. The distance between the real object and the virtual distance of the object being watched in the virtual scene are adjusted synchronously, which helps to reduce the situation where the user needs to make adaptive adjustments to see the object clearly and reduces the user's fatigue.

[0020] Optionally, before displaying the virtual scene to the user, the following steps are also included:

[0021] Obtaining user's vision information;

[0022] According to the vision information, the voltage value applied to the liquid variable focus lens is adjusted accordingly to change the curvature radius of the liquid variable focus lens.

[0023] By adopting the above solution, after the user puts on the virtual reality headset, the controller of the virtual reality headset can change the curvature radius of the liquid zoom lens according to the user's vision information, so as to achieve the function of setting the degree according to the user's vision, which helps the user to use the virtual reality headset without wearing glasses, and helps the user reduce fatigue.

[0024] Optionally, the specific steps of obtaining the user's vision information include:

[0025] Displaying visual sign information to the user;

[0026] Acquire visual mark imaging information from the user's retinal reflective surface;

[0027] Based on the visual mark imaging information, the user's vision information is analyzed and obtained.

[0028] By adopting the above scheme, the present application displays the sight mark information on the display as a cursor image for optometry, and the user's retina forms a reflected image of the sight mark information. The controller obtains the user's specific degree based on the analysis of the sight mark imaging, thereby realizing the function of automatic optometry, which is convenient for the subsequent setting of the curvature radius of the liquid zoom lens according to the degree obtained by optometry.

[0029] Optionally, before capturing the gaze line information of each eyeball of the user, the method further includes the following steps: capturing the orientation information of the user's head.

[0030] By adopting the above solution, the virtual reality headset can capture the user's head orientation to adjust the virtual field display range accordingly, thereby improving the three-dimensional effect of the display.

[0031] In a second aspect, the present application provides a focus adjustment system for a virtual reality head display, comprising:

[0032] A display module, used to display a virtual scene to a user;

[0033] A capture module, used to capture the gaze line information of each eyeball of the user;

[0034] An analysis module, configured to analyze and obtain interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball;

[0035] The adjustment module is used to adjust the focal length according to the object corresponding to the interaction point information in the virtual scene.

[0036] In a third aspect, the present application provides a controller, comprising: a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes any of the focus adjustment methods for a virtual reality head display as described above.

[0037] In a fourth aspect, the present application provides a device, comprising: a display, a capture component, an adjustment component, and a controller for implementing the focus adjustment method of a virtual reality head display as described in any of the above items, wherein the display, the capture component, and the adjustment component are all coupled to the controller.

[0038] In a fifth aspect, the present application provides a readable storage medium storing a computer program that can be loaded by a processor and execute a focus adjustment method for a virtual reality head display as described in any of the above items.

[0039] In summary, this application includes the following beneficial technical effects:

[0040] 1. After the user wears the virtual reality headset, the display shows the user observing the virtual scene. At this time, the application captures the gaze line information of the user's eyeballs, analyzes the gaze line information to obtain the corresponding interaction point information. Then, the focal length is dynamically adjusted according to the interaction point information. In this way, when the user observes any object in the virtual scene, the application can adjust the focal length accordingly according to the interaction point information obtained after capture and analysis, so that the user can obtain the experience of virtual scene observation and depth of field changes, and it helps to reduce eye fatigue, facilitate long-term use, and optimize the use effect.

[0041] 2. When the virtual distance between the object in the virtual scene and the user's eyeball changes, the present application controls the adjustment member to drive the optical transparent member to move, so as to change the distance between the optical transparent member and the eyeball accordingly. The distance between the real object and the virtual distance of the object being watched in the virtual scene are adjusted synchronously, which helps to reduce the situation where the user needs to make adaptive adjustments to see the object clearly and reduces the user's fatigue.

[0042] 3. After the user puts on the virtual reality headset, the present application can change the radius of curvature of the liquid zoom lens according to the user's vision information to achieve the function of setting the degree according to the user's vision, which helps the user to use the virtual reality headset without wearing glasses, and helps the user reduce fatigue. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 This application discloses a flow chart of the steps of a focus adjustment method for a virtual reality head display.

[0044] Figure 2This is a simplified diagram of the working principle of the focus adjustment method of the virtual reality head display when the object described in this application is rendered close to the user's eyeball.

[0045] Figure 3 This is a simplified diagram of the working principle of the focus adjustment method of the virtual reality head display when the object described in this application is rendered far away from the user's eyeballs.

[0046] Figure 4 This is a simplified diagram of the position of the liquid zoom lens in the focus adjustment method of the virtual reality head display described in this application.

[0047] Figure 5 This is a schematic diagram of a focus adjustment module of a virtual reality head display in the present application.

[0048] Figure numerals: 1. display module; 2. capture module; 3. analysis module; 4. adjustment module; 5. eyeball; 6. display; 7. light emitting device; 8. reflection receiving camera; 9. liquid zoom lens; 10. optical transparent part; 11. adjustment part; 12. object. DETAILED DESCRIPTION

[0049] The following embodiments are combined Figure 1-Figure 5 This application is described in further detail.

[0050] Reference Figure 1 , a focus adjustment method for a virtual reality head display, comprising:

[0051] S1. Display a virtual scene to a user.

[0052] S2. Capture the gaze line information of each eyeball 5 of the user.

[0053] S3. Analyze and obtain interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball 5 .

[0054] S4. Adjust the focal length according to the object 12 corresponding to the interaction point information in the virtual scene.

[0055] Implementation principle: After the user puts on the virtual reality headset, the display 6 of the virtual reality headset displays the virtual scene to the user. In this process, the virtual reality headset captures the user's eyes to obtain the user's gaze line information, and obtains the interaction point information by analyzing the extended interaction of the gaze line as the basis for the user's current gaze on the corresponding object 12 in the virtual scene. Then, the focal length is adjusted dynamically in real time based on the interaction point information. In this way, when the user observes any object 12 in the virtual scene, the virtual reality headset can adjust the focal length accordingly based on the interaction point information obtained after capture and analysis, so that the user can obtain the experience of virtual scene observation and depth of field change, and it helps to reduce eye fatigue, facilitate long-term use, and optimize the use effect.

[0056] As one of the implementation methods, the virtual scene displayed to the user by the virtual reality head display is a three-dimensional stereoscopic picture. The source of the three-dimensional stereoscopic picture is based on the establishment of a scene database. The scene database stores a number of sliced ​​photos, and the sliced ​​photos include photos of all angles and all positions in the scene. When display is required, the sliced ​​photos are superimposed together to generate a three-dimensional picture, and when the user performs an action, the sliced ​​photos can be updated and switched with low latency based on intelligent computing or cloud computing technology, thereby presenting a three-dimensional sense and a virtual scene.

[0057] In this embodiment, the specific steps of capturing the gaze line information of each eyeball 5 of the user include:

[0058] S22 , sending light control information to the light emitting device 7 .

[0059] S23 , obtaining reflected image information based on the reflection receiving camera 8 , where the reflected image information comes from the light emitted by the light emitting device 7 reflected by the user's eyeball 5 .

[0060] S24, analyzing the reflected image information, determining the pupil position in the corresponding eyeball 5, and then obtaining the gaze line information of each eyeball 5 of the user.

[0061] The light emitting device 7 can be an infrared light emitting device, and the wavelength of the light emitted by the infrared light emitting device can be 710 nanometers to 900 nanometers, for example, the wavelength of the light can be 850 nanometers. This implementation allows the infrared light to be outside the visible spectrum of 390 nanometers to 700 nanometers, and the user's eyes will not sense the infrared light, but it can be captured by the infrared light camera preset in the virtual reality head display. This implementation helps not to affect the user's observation of the virtual scene. Specifically, based on the pupil tracking technology of infrared light, after the light emitting device 7 receives the light control information, it emits light to the outside, and the light uses infrared light, and then the infrared light will be reflected on the surface of the user's eyeball 5, and the reflection receiving camera 8 preset in the virtual reality head display receives the reflected light and obtains the reflected image information. Among them, the light from the pupil area of ​​the eyeball 5 will not enter the eye, and the reflection receiving camera 8 regards the pupil as a dark area, while other areas of the eyeball 5 are relatively brighter, thereby achieving an image effect in which the pupil is different from other areas of the eyeball 5, and the reflection receiving camera 8 obtains the reflected image information. The reflected image information can be analyzed by computer processing technology or intelligent mobile terminal processing technology to determine the position of the pupil and then derive the gaze direction of the eyeball 5, thereby obtaining the gaze line information of each eyeball 5 of the user.

[0062] As another implementation, eye muscle movement tracking technology may be used to capture the gaze line information of each eyeball 5 of the user, thereby achieving a rapid capture effect.

[0063] After the controller of the virtual reality head display obtains the gaze line information of each eyeball 5, it analyzes and obtains the interaction point information about the interaction of the gaze lines. The specific principle is: the vergence depth of the gaze lines of each eye is obtained by cloud computing or intelligent computing processing. The vergence depth refers to the virtual distance that the gaze line extends in the virtual scene. Combined with the geometric structure data of the virtual scene, the interaction point of the two gaze lines is calculated and estimated. The location of the interaction point is the object 12 that the user focuses on when observing the virtual scene. When the user observes the virtual scene, in order to reflect the three-dimensional sense of the virtual scene, one or more objects 12 in the virtual scene will also change accordingly. The form of change includes but is not limited to the change of the virtual distance of the object 12. The object 12 can be rendered on the display screen to enlarge or reduce its size to show the situation of the object 12 approaching or moving away. However, for example, when the object 12 shows a close picture, the distance between the actual user's eyes and the display 6 preset by the virtual reality head display has not decreased. At this time, the eyes need to adjust themselves to adapt to the changes in the object 12, which will cause fatigue or even nausea to the user in the long run. Therefore, in this embodiment,

[0064] Reference Figure 2 In this embodiment, according to the object 12 corresponding to the interaction point information in the virtual scene, the specific steps of adjusting the focal length include: when the object 12 is rendered close to the user's eyeball 5, controlling the adjusting member 11 to drive the optical transparent member 10 to move in the direction close to the user's eyeball 5. Specifically, after determining the object 12 that the user is looking at, if the object 12 is rendered to look like the user's eyeball 5 due to the change of the virtual scene, the controller of the virtual display head display controls the adjusting member 11 to drive the optical transparent member 10 to move in the direction close to the user's eyeball 5. The above steps utilize the adjusting member 11 to cooperate with the optical transparent member 10 to reduce the distance between the optical transparent member 10 and the eyeball 5, so that the optical transparent member 10 plays a role in reducing the focal length, and realizes the function of actively adjusting the focal length to cooperate with the user to observe the object 12 close, which helps to reduce the situation of the user's adaptive focusing observation, reduce the user's fatigue and prevent nausea.

[0065] Or, refer to Figure 3, when the object 12 is rendered away from the user's eyeball 5, the control adjusting member 11 drives the optical light-transmitting member 10 to move away from the user's eyeball 5. Specifically, after determining the object 12 that the user is looking at, if the object 12 is rendered to look like it is away from the user's eyeball 5 due to changes in the virtual scene, the controller of the virtual display head display controls the adjusting member 11 to drive the optical light-transmitting member 10 to move away from the user's eyeball 5. The above steps utilize the linkage between the adjusting member 11 and the optical light-transmitting member 10 to increase the distance between the optical light-transmitting member 10 and the eyeball 5, so that the optical light-transmitting member 10 plays a role in increasing the focal length, and realizes the function of actively adjusting the focal length to cooperate with the user to observe the object 12 away, which helps to reduce the situation of the user's adaptive focusing observation, reduce the user's fatigue and prevent nausea.

[0066] As one of the embodiments, the adjusting member 11 may adopt a miniature electrically driven displacement device for driving the optically transparent member 10 to move closer to or away from the eyeball 5, thereby achieving the function of adjusting the focal length by changing the distance between the optically transparent member 10 and the adjusting member 11.

[0067] Furthermore, different users have different vision conditions. Existing virtual reality headsets can only show users a three-dimensional visual effect, but cannot solve the problem that users cannot clearly see the virtual scenes displayed by the virtual reality headsets due to their vision conditions. The conventional method is to wear prescription glasses while wearing a virtual reality headset, but this method will over-compress the bridge of the nose, and long-term use will increase the user's fatigue. Therefore,

[0068] Reference Figure 4 In this embodiment, before displaying the virtual scene to the user, the following steps are also included:

[0069] S01. Obtaining user's vision information.

[0070] S02. According to the vision information, the voltage value applied to the liquid zoom lens 9 is correspondingly adjusted to change the curvature radius of the liquid zoom lens 9. As one implementation, the vision information of the user can be obtained by the user using an external input device such as a mobile terminal that has communicated with the virtual reality head display, or by the user inputting the corresponding vision information into the controller of the virtual display head display through a built-in input device such as a key.

[0071] As another implementation, obtaining the user's vision information may further include the following steps:

[0072] S011. Display visual sign information to the user.

[0073] S012. Obtain visual mark imaging information originating from the user's retinal reflective surface.

[0074] S013. Analyze and obtain the user's vision information based on the visual mark imaging information.

[0075] In this way, after the user puts on the virtual reality headset, the display 6 of the virtual reality headset displays the visual mark information to the user as the cursor image of the optometry. After the cursor image enters the user's glasses, it will be imaged on the reflective surface of the retina to form visual mark imaging information, and then the cloud computing technology or intelligent computing technology is used to analyze the clarity of the visual mark imaging information, judge the current user's vision, and thus obtain the user's vision information. It is convenient and fast, with a high degree of automation. Specifically, obtaining the visual mark imaging information from the reflective surface of the user's retina can be achieved by using a reflection receiving camera 8.

[0076] When no voltage is applied to the liquid variable focus lens 9, the radius of curvature is fixed; when voltage is applied to the liquid variable focus lens 9, the electric charge between the contact surfaces changes under the action of the electric field, thereby generating an external force. The external force affects the surface tension of the lens, thereby breaking the balance of the surface tension and changing the radius of curvature of the lens, thereby changing the corresponding degree setting of the lens.

[0077] Therefore, the controller of the virtual display head display can adjust the voltage value of the liquid zoom lens 9 according to the vision information, and thus change the curvature radius of the liquid zoom lens 9 accordingly, so that the degree setting of the liquid zoom lens 9 can be adjusted according to different vision information, which plays a role in correcting the diopter, so that the user can clearly observe the virtual scene after wearing the virtual reality head display without wearing glasses. The liquid zoom lens 9 can use a liquid zoom convex lens, which is suitable for users with farsightedness; or a liquid zoom concave lens, which is suitable for users with myopia; or a liquid zoom concave-convex lens, so as to improve the compatibility of use.

[0078] In this embodiment, before capturing the gaze line information of each eyeball 5 of the user, the following steps are also included: S1-2, capturing the orientation information of the user's head.

[0079] Since the virtual scene is more of a three-dimensional picture with a visual range of 90°-360°, such as 90°, 95°, 180° or 360°, the purpose of implementing the above steps is to determine which part of the virtual scene the user is currently viewing, which helps to subsequently determine the user's gaze object 12. The implementation method of capturing the user's head orientation information can use a gyroscope, a tracker, and an electromagnetic induction device that are all preset in the virtual reality head display and coupled to the controller of the virtual display head display. To achieve the capture of the user's head movement.

[0080] Reference Figure 5In a specific embodiment of the present application, a focus adjustment system for a virtual reality head display is provided, comprising:

[0081] Display module 1, used to display virtual scenes to users;

[0082] A capture module 2, used to capture the gaze line information of each eyeball 5 of the user;

[0083] An analysis module 3 is used to analyze and obtain interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball 5;

[0084] The adjustment module 4 is used to adjust the focal length according to the object 12 corresponding to the interaction point information in the virtual scene.

[0085] When used by the user, the display module 1 is used to display the virtual scene to the user. At this time, the capture module 2 is used to capture the user's eyes to obtain the user's gaze line information, and the analysis module 3 is used to analyze the extended interaction of the gaze line to obtain the interaction point information as the basis for the user's current gaze at the corresponding object 12 in the virtual scene. The adjustment module 4 is used to dynamically adjust the focal length in real time based on the interaction point information. This implementation allows the user to observe any object 12 in the virtual scene. The virtual reality headset can adjust the focal length accordingly based on the interaction point information obtained after capture and analysis, allowing the user to obtain the experience of virtual scene observation and depth of field changes, and helps to reduce eye fatigue, facilitate long-term use, and optimize the use effect.

[0086] In a specific embodiment of the present application, a controller is provided, including: a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the focus adjustment method of the virtual reality head display of the above embodiment:

[0087] S1. Displaying a virtual scene to a user;

[0088] S2, capturing the gaze line information of each eyeball 5 of the user;

[0089] S3, analyzing and obtaining interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball 5;

[0090] S4. Adjust the focal length according to the object 12 corresponding to the interaction point information in the virtual scene.

[0091] The controller includes a processor, a memory, a network interface and a database connected through a system bus. The processor of the controller is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store virtual scenes, gaze line information, interaction point information and focal length, etc. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a focus adjustment method for a virtual reality head display is implemented.

[0092] In a specific embodiment of the present application, a device is provided, including: a display 6, a capture component, an adjustment component and a controller for implementing the focus adjustment method of the virtual reality head display of the above embodiment, and the display 6, the capture component, and the adjustment component are all coupled to the controller.

[0093] The device implements the following steps when implementing the focus adjustment method of the virtual reality head display:

[0094] S1. Displaying a virtual scene to a user;

[0095] S2, capturing the gaze line information of each eyeball 5 of the user;

[0096] S3, analyzing and obtaining interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball 5;

[0097] S4. Adjust the focal length according to the object 12 corresponding to the interaction point information in the virtual scene.

[0098] Specifically, the capturing component includes a light emitting device 7 and a reflection receiving camera 8 both coupled to the controller.

[0099] The adjustment component includes a light-transmitting member and an adjustment member 11 for coupling with a controller, wherein the adjustment member 11 is movably connected with the light-transmitting member. The device also includes a liquid zoom lens 9 and a head capture component, both of which are coupled with the controller.

[0100] The present application also provides a readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0101] S1. Displaying a virtual scene to a user;

[0102] S2, capturing the gaze line information of each eyeball 5 of the user;

[0103] S3, analyzing and obtaining interaction point information about the interaction of the gaze lines according to the gaze line information of each eyeball 5;

[0104] S4. Adjust the focal length according to the object 12 corresponding to the interaction point information in the virtual scene.

[0105] When the processor executes the computer program, it can also execute the steps of the focus adjustment method of the virtual reality head display in any of the above embodiments.

[0106] The method steps described in the specification can be performed in a different order than that in the embodiments and still achieve the desired results. The step numbers are only for the purpose of simply distinguishing similar concepts. In addition, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. Multitasking and parallel processing are also possible or may be advantageous.

[0107] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory 111 bus dynamic RAM (RDRAM), etc.

[0108] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0109] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A focus adjustment method for a virtual reality head display, characterized in that: The virtual reality head display is provided with: a reflection receiving camera (8), a liquid zoom lens (9), an optical light-transmitting element (10), a control and adjustment element (11) for driving the optical light-transmitting element (10), and a display (6) in sequence along the gaze direction of the user, and the method comprises: Displaying a virtual scene to a user; wherein, when detecting that the user has performed an action, slice-type photos of all angles and all positions corresponding to the virtual scene are read from a scene database, wherein the scene database stores a plurality of slice-type photos; and updating and switching the slice-type photos with low latency on a display (6) to display the virtual scene to the user; Capturing the gaze line information of each eyeball (5) of the user; According to the gaze line information of each eyeball (5), analyzing and obtaining the interaction point information about the gaze line interaction; Adjusting the focal length according to the object (12) corresponding to the interaction point information in the virtual scene; The specific steps of capturing the gaze line information of each eyeball (5) of the user include: Light control information is sent to the light emitting device (7) so that the light emitting device (7) emits light according to the light control information, and the light is reflected on the surface of the user's eyeball. The reflection receiving camera (8) of the virtual reality head display receives the reflected light and obtains reflected image information, in which the pupil area is a dark area and other areas of the eyeball are brighter than the pupil area; the light emitting device is an infrared light emitting device, and the wavelength of the light emitted is 710nm-900nm; the reflected image information is obtained based on the reflection receiving camera (8), and the reflected image information comes from the light emitted by the light emitting device (7) reflected by the user's eyeball (5); Analyzing the reflected image information to determine the pupil position in the corresponding eyeball (5), and then obtaining the gaze line information of each eyeball (5) of the user; Before displaying the virtual scene to the user, the method further includes the following steps: Obtaining user's vision information; According to the visual information, the voltage value applied to the liquid variable focus lens (9) is correspondingly adjusted to change the curvature radius of the liquid variable focus lens (9); Before capturing the gaze line information of each eyeball (5) of the user, the method further includes the following steps: capturing the orientation information of the user's head; The effect of adjusting the virtual field display range according to the user's head orientation information.

2. The focus adjustment method of a virtual reality head display according to claim 1, characterized in that: The specific steps of adjusting the focal length according to the object (12) corresponding to the interaction point information in the virtual scene include: When the object (12) is rendered close to the user's eyeball (5), the control adjustment member (11) drives the optical light-transmitting member (10) to move in a direction close to the user's eyeball (5); or, When the object (12) is rendered away from the user's eyeball (5), the control adjustment member (11) drives the optical light-transmitting member (10) to move in a direction away from the user's eyeball (5).

3. The focus adjustment method of a virtual reality head display according to claim 1, characterized in that: The specific steps of obtaining the user's vision information include: Displaying visual sign information to the user; Acquire visual mark imaging information from the user's retinal reflective surface; Based on the visual mark imaging information, the user's vision information is analyzed and obtained.

4. A focus adjustment system for a virtual reality head display, characterized in that: The virtual reality head display is provided with: a reflection receiving camera (8), a liquid zoom lens (9), an optical light-transmitting element (10), a control and adjustment element (11) for driving the optical light-transmitting element (10), and a display (6) in sequence along the gaze direction of the user. The system comprises: A display module (1) is used to display a virtual scene to a user; when a user performs an action, slice-type photos of all angles and all positions corresponding to the virtual scene are read from a scene database, wherein the scene database stores a plurality of slice-type photos; and the slice-type photos are updated and switched with low latency on a display (6) to display the virtual scene to the user; A capture module (2) for capturing gaze line information of each eyeball (5) of the user; An analysis module (3) is used to analyze and obtain interaction point information about the interaction of the gaze lines based on the gaze line information of each eyeball (5); An adjustment module (4) for adjusting the focal length according to an object (12) corresponding to the interaction point information in the virtual scene; The specific steps of capturing the gaze line information of each eyeball (5) of the user include: Light control information is sent to the light emitting device (7), so that the light emitting device (7) emits light according to the light control information, the light is reflected on the surface of the user's eyeball, and the reflection receiving camera (8) of the virtual reality head display receives the reflected light to obtain reflected image information, in which the pupil area is a dark area, and other areas of the eyeball are brighter than the pupil area; the light emitting device is an infrared light emitting device, and the wavelength of the emitted light is 710nm-900nm; Acquiring reflected image information based on a reflection receiving camera (8), the reflected image information originating from the light emitted by the light emitting device (7) reflected by the user's eyeball (5); Analyzing the reflected image information to determine the pupil position in the corresponding eyeball (5), and then obtaining the gaze line information of each eyeball (5) of the user; Before displaying the virtual scene to the user, the method further includes the following steps: Obtaining user's vision information; According to the visual information, the voltage value applied to the liquid variable focus lens (9) is correspondingly adjusted to change the curvature radius of the liquid variable focus lens (9); Before capturing the gaze line information of each eyeball (5) of the user, the method further includes the following steps: capturing the orientation information of the user's head; The effect of adjusting the virtual field display range according to the user's head orientation information.

5. A controller, characterized in that: include: A memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes the focus adjustment method of the virtual reality head display as described in any one of claims 1 to 3.

6. A focus adjustment device for a virtual reality head display, characterized in that: include: A display (6), a capture component, an adjustment component and a controller for implementing the focus adjustment method of a virtual reality head display as described in any one of claims 1 to 3, wherein the display (6), the capture component and the adjustment component are all coupled to the controller.

7. A readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and executes the focus adjustment method of a virtual reality head display as described in any one of claims 1 to 3.

Images