Display method for user interface of virtual reality equipment and virtual reality equipment

Abstract

The embodiment of the invention provides a display method of a user interface of virtual reality equipment and the virtual reality equipment, and relates to the technical field of VR. The method includes: acquiring diopter and interpupillary distance of a user; according to the diopter and the interpupillary distance, determining a display distance and an interface size of a first user interface of the virtual reality device, the display distance being used for representing a distance between the first user interface and a user virtual viewpoint in a virtual environment constructed by the virtual reality device, the interface size is used for representing the spatial scale of the first user interface in the virtual environment; and displaying the first user interface in the virtual environment according to the display distance and the interface size. The embodiment of the invention is used for improving the visual comfort of the user and the universality of the VR equipment.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the field of virtual reality (VR) technology. More specifically, it relates to a display method of a user interface of a virtual reality device and the virtual reality device. BACKGROUND

[0002] VR technology is a computer technology that can create and experience a virtual world. It creates a simulated environment through a computer, immerses the user in the environment, and realizes real-time perception and interaction with the virtual world. The core of VR technology is to build an interactive three-dimensional virtual environment with the help of hardware devices and software systems, so that the user's visual, auditory, and tactile senses receive highly similar signals to the real scene, thereby producing an immersive feeling.

[0003] In VR technology, visual experience is a key element that determines user immersion and comfort, and its effect directly affects the user's perception and interaction experience in the virtual environment. Due to individual physiological differences, there are significant differences in eye individualization parameters of different users, which is a key factor affecting visual adaptation. Differences in eye individualization parameters will result in different levels of clear perception of VR pictures by users; mismatched parameters will cause the visual axes of both eyes to be difficult to accurately align, which can easily cause ghosting, eye fatigue, and other problems. Therefore, individualized adjustment of these parameters is a necessary prerequisite for improving VR visual experience. Currently, in the field of VR head-mounted devices, the adjustment means for user eye individualization parameters is relatively basic. For example, for the adaptation of related parameters, most devices use physical adjustment methods, such as changing the distance between the two screens through mechanical structures to achieve a preliminary alignment of the visual axes. However, the relevant data of eye individualization parameters have not been effectively applied to the display logic optimization of the user interface (UI) in the virtual scene, which can cause problems such as blurred content, difficulty in recognition, difficulty in visual focus, ghosting, eye fatigue, and other problems, limiting the universality of VR devices for users with different eye parameters. SUMMARY

[0004] Exemplary embodiments of the present application provide a display method of a user interface of a virtual reality device and the virtual reality device for improving user visual comfort and VR device universality.

[0005] The technical solutions provided by embodiments of the present application are as follows:

[0006] In a first aspect, the embodiments of the present application provide a display method of a user interface of a virtual reality device, comprising:

[0007] obtaining the refractive power and interpupillary distance of the user;

[0008] determine a display distance and an interface size of a first user interface of a virtual reality device according to the diopter and the interpupillary distance, the display distance being used to represent a distance between the first user interface and a virtual viewpoint of a user in a virtual environment constructed by the virtual reality device, and the interface size being used to represent a spatial scale of the first user interface in the virtual environment;

[0009] display the first user interface in the virtual environment according to the display distance and the interface size.

[0010] As an optional implementation of the embodiment of the present application, the determining of the display distance and the interface size of the first user interface of the virtual reality device according to the diopter and the interpupillary distance comprises:

[0011] obtaining a first distance correction coefficient according to the diopter, the first distance correction coefficient being negatively related to the diopter;

[0012] obtaining a second distance correction coefficient according to the interpupillary distance, the second distance correction coefficient being positively related to the interpupillary distance;

[0013] calculating a product of the first distance correction coefficient, the second distance correction coefficient and a standard display distance of the first user interface to obtain the display distance.

[0014] As an optional implementation of the embodiment of the present application, the determining of the display distance and the interface size of the first user interface of the virtual reality device according to the diopter and the interpupillary distance comprises:

[0015] obtaining the display distance according to the diopter, the interpupillary distance, a diopter compensation coefficient, a standard interpupillary distance, a standard display distance of the first user interface and a display distance calculation formula; the display distance calculation formula is:

[0016]

[0017] wherein, d UI is the display distance, D is the diopter, IPD is the interpupillary distance, d0 is the standard display distance of the first user interface, K d is the diopter compensation coefficient, and IPD0 is the standard interpupillary distance.

[0018] As an optional implementation of the embodiment of the present application, the determining of the display distance and the interface size of the first user interface of the virtual reality device according to the diopter and the interpupillary distance comprises:

[0019] obtaining a first size correction coefficient according to the diopter, the first size correction coefficient being negatively related to the diopter;

[0020] A second size correction coefficient is obtained based on the interpupillary distance, and the second size correction coefficient is positively correlated with the interpupillary distance;

[0021] The interface size is obtained by multiplying the first size correction factor, the second size correction factor, and the standard interface size of the first user interface.

[0022] As an optional implementation of this application, determining the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance includes:

[0023] The interface size is obtained based on the refractive power, the interpupillary distance, the standard interpupillary distance for readability, the standard interface size of the first user interface, and the interface size calculation formula; the interface size calculation formula is:

[0024]

[0025] Among them, S UI Where D is the interface size, IPD is the diopter, S0 is the standard interface size of the first user interface, and K is the diopter. s For readability, IPD0 is the standard interpupillary distance.

[0026] As an optional implementation of this application, the method further includes:

[0027] The virtual gaze direction is periodically obtained based on the user's virtual viewpoint and the display position of the first user interface, with a preset duration as the period.

[0028] Adjust the orientation of the first user interface so that the angle between the first user interface and the virtual line of sight is within a preset angle range, the center value of the preset angle range being 90°.

[0029] As an optional implementation of this application, the virtual reality device further includes at least one second user interface, and the method further includes:

[0030] Based on the display distance and / or interface size of the first user interface, the display distance and / or interface size of the at least one second user interface are determined respectively; the difference between the display distance of any second user interface and the display distance of the first user interface is less than a first threshold, and the difference between the interface size of any second user interface and the interface size of the first user interface is less than a second threshold.

[0031] Each second user interface is displayed in the virtual environment according to its display distance and / or display size.

[0032] In a second aspect, the embodiments of the present application provide a virtual reality device, comprising:

[0033] an acquisition unit, configured to acquire a diopter and an interpupillary distance of a user;

[0034] a processing unit, configured to determine a display distance and an interface size of a first user interface of the virtual reality device according to the diopter and the interpupillary distance, the display distance being used to represent a distance between the first user interface and a virtual viewpoint of the user in a virtual environment constructed by the virtual reality device, and the interface size being used to represent a spatial scale of the first user interface in the virtual environment;

[0035] a display unit, configured to display the first user interface in the virtual environment according to the display distance and the interface size.

[0036] As an optional implementation of the embodiments of the present application, the processing unit is specifically configured to acquire a first distance correction coefficient according to the diopter, the first distance correction coefficient being negatively correlated with the diopter; acquire a second distance correction coefficient according to the interpupillary distance, the second distance correction coefficient being positively correlated with the interpupillary distance; and calculate a product of the first distance correction coefficient, the second distance correction coefficient and a standard display distance of the first user interface to obtain the display distance.

[0037] As an optional implementation of the embodiments of the present application, the processing unit is specifically configured to acquire the display distance according to the diopter, the interpupillary distance, a diopter compensation coefficient, a standard interpupillary distance, a standard display distance of the first user interface and a display distance calculation formula.

[0038]

[0039] wherein, d UI is the display distance, D is the diopter, IPD is the interpupillary distance, d0 is the standard display distance of the first user interface, K d is the diopter compensation coefficient, and IPD0 is the standard interpupillary distance.

[0040] As an optional implementation of the embodiments of the present application, the processing unit is specifically configured to acquire a first size correction coefficient according to the diopter, the first size correction coefficient being negatively correlated with the diopter; acquire a second size correction coefficient according to the interpupillary distance, the second size correction coefficient being positively correlated with the interpupillary distance; and calculate a product of the first size correction coefficient, the second size correction coefficient and a standard interface size of the first user interface to obtain the interface size.

[0041] As an optional implementation of the embodiment of the present application, the processing unit is specifically configured to obtain the interface size according to the diopter, the interpupillary distance, the readability standard interpupillary distance, the standard interface size of the first user interface, and an interface size calculation formula.

[0042]

[0043] wherein S is the interface size, D is the diopter, IPD is the interpupillary distance, S0 is the standard interface size of the first user interface, K is the readability, and IPD0 is the standard interpupillary distance. UI s

[0044] As an optional implementation of the embodiment of the present application,

[0045] The processing unit is further configured to periodically obtain a virtual line-of-sight direction according to the user virtual viewpoint and the display position of the first user interface at a preset time length as a period.

[0046] The display unit is further configured to adjust the orientation of the first user interface, so that the included angle between the first user interface and the virtual line-of-sight direction is within a preset angle range, and the center value of the preset angle range is 90°.

[0047] As an optional implementation of the embodiment of the present application, the virtual reality device further comprises at least one second user interface; the processing unit is further configured to determine the display distance and / or the interface size of the at least one second user interface according to the display distance and / or the interface size of the first user interface; the difference between the display distance of any second user interface and the display distance of the first user interface is less than a first threshold value, and the difference between the interface size of any second user interface and the interface size of the first user interface is less than a second threshold value.

[0048] The display unit is further configured to display each second user interface in the virtual environment according to the display distance and / or the display size of each second user interface.

[0049] In a third aspect, the embodiments of the present application provide an electronic device, comprising: a memory configured to store a computer program; and a processor configured to execute the computer program to implement the display method of the user interface of the virtual reality device according to any optional implementation of the first aspect.

[0050] ​​In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program. When the computer program is executed by a computing device, the computer program causes the computing device to implement the method for displaying a user interface of a virtual reality device according to any one of the optional implementation manners of the first aspect.

[0051] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when running on a computer, causes the computer to implement the method for displaying a user interface of a virtual reality device according to any one of the optional implementation manners of the first aspect.

[0052] The method for displaying a user interface of a virtual reality device provided by the embodiments of the present application, when displaying a user interface of a virtual reality device, first acquires the diopter and the interpupillary distance of a user, then determines the display distance and the interface size of a first user interface of the virtual reality device according to the diopter and the interpupillary distance, and displays the first user interface in the virtual environment according to the display distance and the interface size. Since the display distance is used to represent the distance between the first user interface and the virtual viewpoint of the user in the virtual environment constructed by the virtual reality device, and the interface size is used to represent the spatial scale of the first user interface in the virtual environment, the method for displaying a user interface of a virtual reality device provided by the embodiments of the present application can adjust the distance between the first user interface and the virtual viewpoint of the user in the virtual environment constructed by the virtual reality device, and the spatial scale of the first user interface in the virtual environment according to the diopter and the interpupillary distance of the user, so that the first user interface can adapt to the eye physiological characteristics of different users, ensuring that the user can achieve clear focus without relying on additional correction means, and avoiding abnormal binocular vision fusion caused by mismatching of the interface size and the interpupillary distance. This personalized parameter adjustment can significantly reduce the visual fatigue of the user when using the device for a long time, and at the same time, the device does not need to be customized for users with specific diopter or interpupillary distance, thereby effectively improving the visual comfort of the user and the VR universality of the device. BRIEF DESCRIPTION OF DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present application or the implementation manners in the related art, the following will briefly introduce the drawings needed to be used in the embodiment or related art description. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art according to these drawings.

[0054] Figure 1 A step flowchart of a method for displaying a user interface of a virtual reality device is shown;

[0055] Figure 2A schematic diagram showing a physical button of a virtual reality device in some embodiments is shown.

[0056] Figure 3 A schematic diagram showing displaying an interaction interface in a virtual environment in some embodiments is shown.

[0057] Figure 4 A schematic diagram showing a first user interface in some embodiments is shown.

[0058] Figure 5 A schematic diagram showing a first user interface in some embodiments is shown.

[0059] Figure 6 A schematic diagram showing a first user interface in some embodiments is shown.

[0060] Figure 7 A schematic diagram showing a first user interface in some embodiments is shown.

[0061] Figure 8 A schematic diagram showing a first user interface in some embodiments is shown. DETAILED DESCRIPTION

[0062] For the purpose of making the objects, technical solutions and advantages of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings. Obviously, the described exemplary embodiments are only a part of the embodiments of the present application, but not all embodiments of the present application.

[0063] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0064] The terms "comprise" and "have" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that comprises a list of components does not have to be limited to only those components clearly listed, but can include other components not clearly listed or inherent to such products or devices.

[0065] Figure 1An exemplary flowchart of steps of a display method of a user interface of a virtual reality device provided by embodiments of the present application is shown. The execution subject of the display method of the user interface of the virtual reality device can be a head-mounted VR device, a standalone virtual reality headset, a PC-based virtual reality headset system, a mobile virtual reality headset, and a mixed reality (MR) headset integrated with VR functions, etc. Figure 1 As shown, the display method of the user interface of the virtual reality device provided by embodiments of the present application includes the following steps:

[0066] S11, obtaining the diopter and interpupillary distance of a user.

[0067] That is, when the virtual reality device detects the wearing behavior, the diopter and interpupillary distance of the current user are obtained.

[0068] In some embodiments, the implementation of the virtual reality device detecting the wearing behavior can include: detecting the distance outside the obstacle by a close-range inductive sensor, and determining that the wearing behavior is detected when the distance outside the obstacle is less than a preset threshold (for example, 5 cm).

[0069] In other embodiments, the virtual reality device can also detect the wearing behavior by a pressure sensor, a touch sensor, an optical image sensor, etc., which is not limited in the embodiments of the present application, as long as the wearing behavior of the user can be detected.

[0070] The diopter of the user refers to the total refractive ability of the eyeball optical system (mainly including cornea, aqueous humor, lens, vitreous body) of the user to light, in units of diopter (D), for describing the ability of light entering the eyeball to be focused, and is a core index for measuring the refractive state of the eyeball (such as emmetropia, myopia, hyperopia, astigmatism). Its value is equal to the reciprocal of the focal length (unit: meter) of the eyeball optical system, and when this value does not match the eye axis length, light cannot be accurately focused on the retina, resulting in ametropia (myopia, hyperopia, astigmatism, etc.). For example, 200 degrees of myopia, the diopter is -2; 400 degrees of myopia, the diopter is -4.

[0071] Interpupillary distance (IPD) refers to the horizontal distance between the centers of the pupils of both eyes, usually measured in millimeters (mm). The core principle of VR devices is to project images onto the left and right eyes through dual displays, which are then focused by an optical system (lenses) to create stereoscopic vision. If there is a mismatch between the IPD and the device's compatibility, the lines of sight of the left and right eyes cannot precisely align with the optical center of the display, which will cause problems such as ghosting and blurred edges, destroying the sense of stereoscopic effect and forcing the eyes to continuously adjust to adapt to the mismatch.

[0072] In some embodiments, obtaining a user's refractive error and interpupillary distance may include receiving the refractive error and interpupillary distance input by the user via physical buttons on a VR device.

[0073] For example, refer to Figure 2 As shown, the VR device is equipped with a first physical button 21 for inputting refractive power and a second physical button 22 for inputting interpupillary distance. Users can input refractive power and interpupillary distance into the VR device by operating the first physical button 21 and the second physical button.

[0074] In some embodiments, obtaining a user's refractive error and interpupillary distance may include receiving the refractive error and interpupillary distance input by the user through an interactive interface displayed on a VR device.

[0075] For example, refer to Figure 3 As shown, the VR device displays an interactive interface 300 in the constructed virtual environment. The interactive interface includes a first control 31 for setting the refractive power and a first control 32 for setting the refractive power. Users can operate the first control 31 and the first control 32 for setting the refractive power through interactive methods such as remote control, voice commands, physical buttons, eye-tracking automatic adaptation, and head posture sensing to input the refractive power and interpupillary distance.

[0076] In some embodiments, obtaining a user's refractive error and interpupillary distance may include: the VR device is equipped with a functional module for measuring refractive error and interpupillary distance, and the user's refractive error and interpupillary distance are obtained by measuring through the functional module for measuring refractive error and interpupillary distance.

[0077] S12. Determine the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance.

[0078] Wherein, the display distance is used to characterize the distance between the first user interface and the user's virtual viewpoint in the virtual environment constructed by the virtual reality device, and the interface size is used to characterize the spatial scale of the first user interface in the virtual environment.

[0079] The user virtual viewpoint refers to a virtual observation point simulated by the virtual reality device in a virtual environment constructed by the virtual reality device according to real-time states (such as head posture, eye position, etc.) of the user, which is equivalent to the eye position of the user in the virtual space and directly determines the picture angle and content range of the screen display of the virtual reality device. It can be understood as the real-time position of the eyes of the user in the virtual space.

[0080] According to the diopter and the interpupillary distance, the display distance and the interface size of the first user interface of the virtual reality device can enable the first user interface to be clearly focused, while avoiding abnormal binocular visual fusion caused by mismatching of the interface size and the interpupillary distance, thereby improving the visual comfort of the user and the universality of the VR device.

[0081] S13, displaying the first user interface in the virtual environment according to the display distance and the interface size.

[0082] In some embodiments, displaying the first user interface in the virtual environment according to the display distance and the interface size includes: displaying the first user interface in the virtual environment, and making the distance from the user virtual viewpoint to the first user interface be the display distance and the size of the first user interface be the interface size.

[0083] The display method of the user interface of the virtual reality device provided by the embodiments of the present application first acquires the diopter and the interpupillary distance of the user, then determines the display distance and the interface size of the first user interface of the virtual reality device according to the diopter and the interpupillary distance, and finally displays the first user interface in the virtual environment according to the display distance and the interface size. Since the display distance is used to represent the distance between the first user interface and the user virtual viewpoint in the virtual environment constructed by the virtual reality device, and the interface size is used to represent the spatial scale of the first user interface in the virtual environment, the display method of the user interface of the virtual reality device provided by the embodiments of the present application can adjust the distance between the first user interface and the user virtual viewpoint in the virtual environment constructed by the virtual reality device and the spatial scale of the first user interface in the virtual environment according to the diopter and the interpupillary distance of the user, so that the first user interface can adapt to the eye physiological characteristics of different users, ensuring that the user can clearly focus without relying on additional correction means, while avoiding abnormal binocular visual fusion caused by mismatching of the interface size and the interpupillary distance. This personalized parameter adjustment can significantly reduce the visual fatigue of the user when using the device for a long time, while the device does not need to be customized for users with specific diopter or interpupillary distance, thereby effectively improving the visual comfort of the user and the VR universality of the device.

[0084] As an extension and refinement of the above-mentioned embodiments, the application provides another display method of a user interface of a virtual reality device. Referring to FIG. 13, the display method of the user interface of the virtual reality device comprises the following steps: Figure 4

[0085] S401, obtaining the diopter and the interpupillary distance of the user.

[0086] The implementation of step S401 can refer to step S11 described above, and thus will not be repeated here.

[0087] S402, obtaining a first distance correction coefficient according to the diopter.

[0088] The first distance correction coefficient is negatively correlated with the diopter.

[0089] That is, the smaller the diopter, the larger the first distance correction coefficient; on the contrary, the larger the diopter, the smaller the first distance correction coefficient.

[0090] In some embodiments, the implementation of obtaining the first distance correction coefficient according to the diopter can comprise: obtaining the first distance correction coefficient according to the diopter, a diopter compensation coefficient, and a first distance correction coefficient calculation formula. The first distance correction coefficient calculation formula is shown in the following formula (1):

[0091] s d1 =1+K d *|D| (1)

[0092] Wherein, s d1 is the first distance correction coefficient, K d is the diopter compensation coefficient, and D is the diopter, which is a negative value.

[0093] In some embodiments, the value of the diopter compensation coefficient K d may be 0.1.

[0094] S403, obtaining a second distance correction coefficient according to the interpupillary distance.

[0095] The second distance correction coefficient is positively correlated with the interpupillary distance.

[0096] That is, the larger the interpupillary distance, the larger the second distance correction coefficient; on the contrary, the smaller the interpupillary distance, the smaller the second distance correction coefficient.

[0097] In some embodiments, the implementation of obtaining the second distance correction coefficient according to the interpupillary distance can comprise: obtaining the second distance correction coefficient according to the interpupillary distance, a standard interpupillary distance, and a second distance correction coefficient calculation formula. The second distance correction coefficient calculation formula is shown in the following formula (2): ​

[0098]

[0099] wherein s d2 is the second distance correction coefficient, IPD is the interpupillary distance, and IPD0 is the standard interpupillary distance.

[0100] In some embodiments, the value of the standard interpupillary distance IPD0 is 63 millimeters (mm).

[0101] S404, calculating the product of the first distance correction coefficient, the second distance correction coefficient, and the standard display distance of the first user interface to obtain the display distance.

[0102] That is, the implementation of obtaining the display distance includes obtaining the display distance by the following formula (3):

[0103] d UI = d0*s d1 *s d2 (3)

[0104] wherein d UI is the display distance, d0 is the standard display distance of the first user interface, s d1 is the first distance correction coefficient, and s d2 is the second distance correction coefficient.

[0105] In some embodiments, the standard display distance is a preset fixed value. For example, 2 meters (m).

[0106] In some embodiments, the standard display distance is a preset distance between the first user interface and the virtual viewpoint of the user.

[0107] S405, obtaining a first size correction coefficient according to the diopter.

[0108] wherein the first size correction coefficient is negatively correlated with the diopter.

[0109] That is, the smaller the diopter, the larger the first size correction coefficient; conversely, the larger the diopter, the smaller the first size correction coefficient.

[0110] In some embodiments, the implementation of obtaining the first size correction coefficient according to the diopter can include obtaining the first size correction coefficient according to the diopter, a legibility compensation coefficient, and a first size correction coefficient calculation formula. The first size correction coefficient calculation formula is shown in the following formula (4):

[0111] s s1 = 1 + K s *|D| (4)

[0112] wherein s s1 is the first size correction coefficient, K s is the readability compensation coefficient, and D is the diopter.

[0113] In some embodiments, the value of the readability compensation coefficient K s is 0.15.

[0114] S406, obtaining a second size correction coefficient according to the interpupillary distance.

[0115] wherein the second size correction coefficient is positively correlated with the interpupillary distance.

[0116] That is, the greater the interpupillary distance, the greater the second size correction coefficient; conversely, the smaller the interpupillary distance, the smaller the second size correction coefficient.

[0117] In some embodiments, the implementation manner of obtaining the second size correction coefficient according to the interpupillary distance can include: obtaining the second size correction coefficient according to the interpupillary distance, a standard interpupillary distance, and a second size correction coefficient calculation formula. The second size correction coefficient calculation formula is shown in the following formula (5):

[0118]

[0119] wherein s s2 is the second size correction coefficient, IPD is the interpupillary distance, and IPD0 is the standard interpupillary distance.

[0120] S407, calculating the product of the first size correction coefficient, the second size correction coefficient, and the standard interface size of the first user interface to obtain the interface size.

[0121] That is, the implementation manner of obtaining the display distance includes obtaining the display distance by the following formula (6):

[0122] S UI = S0*s s1 *s s2 (6)

[0123] wherein S UI is the interface size, S0 is the standard interface size of the first user interface, s s1 is the first size correction coefficient, and s s2 is the second size correction coefficient.

[0124] In some embodiments, S0 is the interface size of the first user interface with a preset value, which is determined by user interface design.

[0125] S408. Display the first user interface in the virtual environment according to the display distance and the interface size.

[0126] This application also provides another method for displaying the user interface of a virtual reality device, referring to... Figure 5 As shown, the method for displaying the user interface of this virtual reality device includes the following steps:

[0127] S501. Obtain the user's refractive error and interpupillary distance.

[0128] The implementation of step S501 can refer to step S11 above. To avoid redundancy, it will not be repeated here.

[0129] S502. Obtain the display distance based on the refractive power, the interpupillary distance, the refractive power compensation coefficient, the standard interpupillary distance, the standard display distance of the first user interface, and the display distance calculation formula.

[0130] The formula for calculating the display distance is shown in equation (7) below:

[0131]

[0132] d UI Where D is the display distance, IPD is the diopter, d0 is the standard display distance of the first user interface, and K is the diopter. d IPD0 is the refractive error compensation coefficient, and IPD0 is the standard pupillary distance.

[0133] S503. Obtain the interface size based on the refractive power, the interpupillary distance, the standard interpupillary distance for readability, the standard interface size of the first user interface, and the interface size calculation formula.

[0134] The interface size calculation formula (8) is shown below:

[0135]

[0136] S UI Where D is the interface size, IPD is the diopter, S0 is the standard interface size of the first user interface, and K is the diopter. s For readability, IPD0 is the standard interpupillary distance.

[0137] S504. Display the first user interface in the virtual environment according to the display distance and the interface size.

[0138] In some embodiments, the display method of the user interface of the virtual reality device further comprises: periodically obtaining a virtual line-of-sight direction according to the user virtual viewpoint and the display position of the first user interface at a preset time length; and adjusting the orientation of the first user interface so that the included angle between the first user interface and the virtual line-of-sight direction is within a preset angle range, and the central value of the preset angle range is 90°.

[0139] For example, the preset time length can be 0.5 seconds, 1 second, etc. The longer the preset time length is, the less frequently the data is obtained and the virtual line-of-sight direction is calculated within a unit time, the lower the performance overhead of the VR device is, and the longer the interval between adjacent two virtual line-of-sight direction acquisitions is, and the timeliness of the virtual line-of-sight direction adjustment decreases. Conversely, the shorter the preset time length is, the more frequently the data is obtained and the virtual line-of-sight direction is calculated within a unit time, the higher the performance overhead of the VR device is, and the shorter the interval between adjacent two virtual line-of-sight direction acquisitions is, and the timeliness of the virtual line-of-sight direction adjustment is higher. Therefore, the preset time length can be set to balance the performance overhead of the VR device and the timeliness of the virtual line-of-sight direction adjustment.

[0140] For example, the preset angle range can be (82°, 95°).

[0141] In some embodiments, the implementation manner of obtaining the user virtual line-of-sight direction according to the posture of the virtual reality device comprises: collecting three-dimensional posture data (such as pitch angle, yaw angle, and roll angle) in real time through an inertial measurement unit such as a built-in gyroscope and acceleration sensor of the device; and fusing the device posture data and environmental space features through technologies such as Simultaneous Localization and Mapping (SLAM) and Visual SLAM (VSLAM), analyzing the motion trajectory of the device in the physical space and the relative position relationship of the environmental feature points, and combining the space-time calibration of the sensor data to finally solve the virtual viewpoint position of the user in the virtual space.

[0142] For example, as shown in FIG. 6A, the user virtual viewpoint is located at position a in the virtual environment, and the display position of the first user interface 600 is position b in the virtual environment. Therefore, the virtual line-of-sight direction obtained according to the user virtual viewpoint a and the display position b of the first user interface 600 is Figure 6 The first user interface 600 is perpendicular to the virtual line-of-sight direction, and the distance from the first user interface 600 to the position of the user virtual viewpoint a is the display distance.

[0143] ​​The above embodiments can periodically obtain the virtual line-of-sight direction of the user according to the posture of the virtual reality device, and control the first user interface to be perpendicular to the virtual line-of-sight direction, so that the target interface can always be presented in a posture facing the user when the user turns the head to change the virtual line-of-sight direction, thereby facilitating the user to interact with the VR device and view information.

[0144] In some embodiments, the virtual reality device further comprises at least one second user interface. That is, the virtual reality device needs to display multiple user interfaces (the first user interface and the at least one second user interface) in the virtual environment. When the virtual reality device further comprises at least one second user interface, the method for displaying the user interface of the virtual reality device provided by the embodiments of the present application further comprises: determining the display distance and / or the interface size of each second user interface according to the display distance and / or the interface size of the first user interface; and displaying each second user interface in the virtual environment according to the display distance and / or the display size of each second user interface. Wherein, the difference between the display distance of any second user interface and the display distance of the first user interface is less than a first threshold value, and the difference between the interface size of any second user interface and the interface size of the first user interface is less than a second threshold value.

[0145] For example, the first threshold value is 2m. That is, the difference between the display distance of each second user interface and the display distance of the first user interface is within 2m.

[0146] For example, the second threshold value is 200 pixel points. That is, the difference between the interface size of each second user interface and the interface size of the first user interface is within 200 pixel points.

[0147] In some embodiments, determining the display distance and / or the interface size of each second user interface according to the display distance and / or the interface size of the first user interface comprises: setting the display distance of each second user interface to be the same as the display distance of the first user interface, and setting the interface size of each second user interface to be the same as the interface size of the first user interface.

[0148] For example, the interface size of each second user interface can be set to be the same as the interface size of the first user interface, and then each second user interface can be displayed on a circle with the virtual viewpoint of the user as the center and the display distance of the first user interface as the radius, and the angle between the second user interface and the virtual line-of-sight can be set to be different, so as to ensure that the second user interfaces do not overlap on the virtual line-of-sight and avoid mutual blocking between the second user interfaces.

[0149] When multiple user interfaces are included, setting the distance and / or size of other user interfaces according to the distance and / or size of one user interface can make the gaze distance difference of different user interfaces smaller, thereby avoiding frequent adjustment of the gaze distance and reducing the visual fatigue of the user.

[0150] Based on the same inventive concept, as an implementation of the above method, the embodiments of the present application also provide a virtual reality device, which corresponds to the foregoing method embodiments. For ease of reading, the details of the foregoing method embodiments will not be described one by one in the present embodiment, but it should be clear that the virtual reality device in the present embodiment can correspondingly implement all the contents in the foregoing method embodiments.

[0151] The embodiments of the present application provide a virtual reality device, Figure 7 The structural schematic diagram of the virtual reality device is shown in Figure 7 The virtual reality device 700 includes:

[0152] The acquisition unit 71 is configured to acquire the diopter and the interpupillary distance of the user.

[0153] The processing unit 72 is configured to determine the display distance and the interface size of a first user interface of the virtual reality device according to the diopter and the interpupillary distance, wherein the display distance is used to represent the distance between the first user interface and the virtual viewpoint of the user in a virtual environment constructed by the virtual reality device, and the interface size is used to represent the spatial scale of the first user interface in the virtual environment.

[0154] The display unit 73 is configured to display the first user interface in the virtual environment according to the display distance and the interface size.

[0155] As an optional implementation of the embodiments of the present application, the processing unit 72 is specifically configured to acquire a first distance correction coefficient according to the diopter, wherein the first distance correction coefficient is negatively correlated with the diopter; acquire a second distance correction coefficient according to the interpupillary distance, wherein the second distance correction coefficient is positively correlated with the interpupillary distance; and calculate the product of the first distance correction coefficient, the second distance correction coefficient, and the standard display distance of the first user interface to obtain the display distance.

[0156] As an optional implementation of the embodiments of the present application, the processing unit 72 is specifically configured to acquire the display distance according to the diopter, the interpupillary distance, a diopter compensation coefficient, a standard interpupillary distance, a standard display distance of the first user interface, and a display distance calculation formula; and the display distance calculation formula is:

[0157]

[0158] wherein d is the display distance, D is the diopter, P is the interpupillary distance, Dc is the diopter compensation coefficient, P0 is the standard interpupillary distance, d0 is the standard display distance of the first user interface, and a, b, c, and d are correction coefficients.UI S is the display distance, D is the diopter, IPD is the interpupillary distance, S0 is the standard display distance of the first user interface, K d is the diopter compensation coefficient, IPD0 is the standard interpupillary distance.

[0159] As an optional implementation of the embodiment of the application, the processing unit 72 is specifically configured to: acquire a first size correction coefficient according to the diopter, the first size correction coefficient being negatively correlated with the diopter; acquire a second size correction coefficient according to the interpupillary distance, the second size correction coefficient being positively correlated with the interpupillary distance; and calculate a product of the first size correction coefficient, the second size correction coefficient and a standard interface size of the first user interface to acquire the interface size.

[0160] As an optional implementation of the embodiment of the application, the processing unit 72 is specifically configured to acquire the interface size according to the diopter, the interpupillary distance, a readability standard interpupillary distance, a standard interface size of the first user interface and an interface size calculation formula; and the interface size calculation formula is:

[0161]

[0162] wherein, S UI S is the display distance, D is the diopter, IPD is the interpupillary distance, S0 is the standard display distance of the first user interface, K s is the diopter compensation coefficient, IPD0 is the standard interpupillary distance.

[0163] As an optional implementation of the embodiment of the application,

[0164] The processing unit 72 is further configured to periodically acquire a virtual line-of-sight direction according to a posture of a virtual reality device at a preset time length as a period.

[0165] The display unit 73 is further configured to adjust an orientation of the first user interface, so that an included angle between the first user interface and the virtual line-of-sight direction is within a preset angle range, a central value of the preset angle range being 90°.

[0166] As an optional implementation of the embodiment of the application, the processing unit 72 is further configured to acquire spatial occupancy information of the virtual environment.

[0167] The display unit 73 is further configured to adjust a position of the first user interface according to the spatial occupancy information of the virtual environment.

[0168] The virtual reality device provided in the embodiments of the present application can execute the display method of the user interface of the virtual reality device provided in any of the above embodiments, and the implementation principle and technical effects are similar, which will not be repeated here.

[0169] Based on the same inventive concept, the embodiments of the present application also provide an electronic device. Figure 8 The structural schematic diagram of the electronic device provided in the embodiments of the present application is shown in Figure 8 The electronic device provided in the embodiments of the present application includes a memory 801 and a processor 802, the memory 801 is configured to store a computer program, and the processor 802 is configured to execute the display method of the user interface of the virtual reality device provided in the above embodiments when executing the computer program.

[0170] Based on the same inventive concept, the embodiments of the present application provide a computer readable storage medium, the computer readable storage medium stores a computer program, and when the computer program is executed by a computing device, the computing device implements the display method of the user interface of the virtual reality device provided in any of the above embodiments.

[0171] Based on the same inventive concept, the embodiments of the present application provide a computer program product, when the computer program product runs on a computer, the computer implements the display method of the user interface of the virtual reality device provided in any of the above embodiments.

[0172] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system or a computer program product. Therefore, the present application can be in the form of a completely hardware embodiment, a completely software embodiment or an embodiment combining software and hardware aspects. Moreover, the present application can be in the form of a computer program product implemented on one or more computer usable storage media including computer usable program code.

[0173] The processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0174] Memory can include non-persistent memory, Random Access Memory (RAM), and / or non-volatile memory, such as read only memory (ROM) or flash memory, in a computer readable medium. Memory is an example of computer readable media.

[0175] Computer readable media includes permanent and non-permanent, removable and non-removable storage media. Storage media can be implemented by any method or technology for storing information, which can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technologies, compact disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device. According to the definition herein, computer readable media does not include transitory media, such as modulated data signals and carriers.

[0176] Finally, it should be noted that the above various embodiments are only used to illustrate the technical solutions of the present application, and not to limit it. Although the present application has been described in detail with reference to the foregoing various embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing various embodiments, or make equivalent replacement for part or all of the technical features. The modification or replacement does not make the essence of the corresponding technical solution deviate from the scope of the technical solutions of the various embodiments of the present application.

Claims

1. A method for displaying the user interface of a virtual reality device, characterized in that, include: Obtain the user's refractive error and interpupillary distance; Based on the refractive power and the interpupillary distance, the display distance and interface size of the first user interface of the virtual reality device are determined. The display distance is used to characterize the distance between the first user interface and the user's virtual viewpoint in the virtual environment constructed by the virtual reality device, and the interface size is used to characterize the spatial scale of the first user interface in the virtual environment. The first user interface is displayed in the virtual environment according to the display distance and the interface size.

2. The method according to claim 1, characterized in that, Determining the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance includes: A first distance correction coefficient is obtained based on the refractive power, and the first distance correction coefficient is negatively correlated with the refractive power; A second distance correction coefficient is obtained based on the interpupillary distance, and the second distance correction coefficient is positively correlated with the interpupillary distance; The display distance is obtained by calculating the product of the first distance correction factor, the second distance correction factor, and the standard display distance of the first user interface.

3. The method according to claim 1, characterized in that, Determining the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance includes: The display distance is obtained based on the refractive power, the interpupillary distance, the refractive power compensation coefficient, the standard interpupillary distance, the standard display distance of the first user interface, and the display distance calculation formula; the display distance calculation formula is: Where, d UI Where D is the display distance, IPD is the diopter, d0 is the standard display distance of the first user interface, and K is the diopter. d IPD0 is the refractive error compensation coefficient, and IPD0 is the standard pupillary distance.

4. The method according to claim 1, characterized in that, Determining the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance includes: A first size correction coefficient is obtained based on the refractive power, and the first size correction coefficient is negatively correlated with the refractive power; A second size correction coefficient is obtained based on the interpupillary distance, and the second size correction coefficient is positively correlated with the interpupillary distance; The interface size is obtained by multiplying the first size correction factor, the second size correction factor, and the standard interface size of the first user interface.

5. The method according to claim 1, characterized in that, Determining the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance includes: The interface size is obtained based on the refractive power, the interpupillary distance, the standard interpupillary distance for readability, the standard interface size of the first user interface, and the interface size calculation formula; the interface size calculation formula is: Among them, S UI Where D is the interface size, IPD is the diopter, S0 is the standard interface size of the first user interface, and K is the diopter. s For readability, IPD0 is the standard interpupillary distance.

6. The method according to claim 1, characterized in that, The method further includes: The virtual gaze direction is periodically obtained based on the user's virtual viewpoint and the display position of the first user interface, with a preset duration as the period. Adjust the orientation of the first user interface so that the angle between the first user interface and the virtual line of sight is within a preset angle range, the center value of the preset angle range being 90°.

7. The method according to claim 1, characterized in that, The virtual reality device further includes at least one second user interface, and the method further includes: Based on the display distance and / or interface size of the first user interface, the display distance and / or interface size of the at least one second user interface are determined respectively; the difference between the display distance of any second user interface and the display distance of the first user interface is less than a first threshold, and the difference between the interface size of any second user interface and the interface size of the first user interface is less than a second threshold. Each second user interface is displayed in the virtual environment according to its display distance and / or display size.

8. A virtual reality device, characterized in that, include: The acquisition unit is used to acquire the user's refractive error and interpupillary distance; The processing unit is configured to determine the display distance and interface size of the first user interface of the virtual reality device based on the refractive power and the interpupillary distance. The display distance is used to characterize the distance between the first user interface and the user's virtual viewpoint in the virtual environment constructed by the virtual reality device, and the interface size is used to characterize the spatial scale of the first user interface in the virtual environment. The display unit is used to display the first user interface in the virtual environment according to the display distance and the interface size.

9. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the method for displaying the user interface of the virtual reality device according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the method for displaying the user interface of the virtual reality device according to any one of claims 1 to 7.

Images