A virtual reality device control method and apparatus, a terminal device, and a storage medium

Abstract

The application discloses a virtual reality device control method and device, a terminal device and a storage medium, and belongs to the field of virtual device control. The method is as follows: controlling a virtual reality device to simultaneously and independently display an optotype image in left and right eye display channels; according to a preset prism degree adjustment scheme, sequentially controlling the optotype images in the left and right eye display channels to simultaneously perform horizontal offset, so as to simulate an equivalent prism deflection effect, and collecting binocular gaze data of a wearer; and according to the binocular gaze data, controlling the virtual reality device to output binocular convergence flexibility of the wearer. Therefore, by implementing the application, the problem of how to realize standardized, objective and automatic binocular convergence flexibility evaluation of a tester can be solved.

Description

Technical Field

[0001] This application relates to the field of virtual device control, and more particularly to a virtual reality device control method, apparatus, terminal device, and storage medium. Background Technology

[0002] Vergence flexibility can be used to evaluate the flexibility and response speed of binocular convergence systems.

[0003] Existing methods for testing convergence flexibility typically rely on optical instruments such as physical prisms and synoptophores. This involves manually changing the prism power or adjusting the optical path to induce binocular visual axis shift, with professionals observing or recording the subject's subjective feedback. These methods are not only characterized by large equipment and complex operation, but also limit the detection of fusion responses to fixed distances. Furthermore, they are highly dependent on the operator's skill level, making standardization and automation difficult.

[0004] Therefore, how to achieve standardized, objective, and automated assessment of binocular convergence and divergence flexibility in test subjects has become a technical problem that needs to be solved. Summary of the Invention

[0005] This application provides a virtual reality device control method, apparatus, terminal device, and storage medium, which can solve the problem in the prior art of how to achieve standardized, objective, and automated assessment of binocular convergence and divergence flexibility of test subjects.

[0006] Some embodiments of this application provide a virtual reality device control method, including: Control the virtual reality device to display visual target images independently and simultaneously in the left and right eye display channels; According to the preset prism power adjustment scheme, the visual target images in the left and right eye display channels are controlled to be horizontally shifted simultaneously to simulate the equivalent prism deflection effect and collect the wearer's binocular fixation data. Based on the binocular gaze data, the virtual reality device is controlled to output the wearer's binocular convergence and divergence flexibility.

[0007] Compared to existing technologies, the above embodiments have the following beneficial effects: This application utilizes the independent control capability of the left and right eye display channels of a virtual reality device to simultaneously display a target image containing the target, and simulates an equivalent prism deflection effect by horizontally shifting the target image. This achieves controllable induction of binocular visual axis shift without the need for a physical prism or synoptophore, significantly reducing hardware size and operational complexity. Furthermore, by collecting the wearer's binocular gaze data during prism adjustment and outputting binocular convergence flexibility accordingly, the evaluation results are based on objective gaze behavior rather than subjective feedback, effectively reducing the impact of human intervention and differences in operator experience on the results. Therefore, this application can achieve a standardized, objective, and automated method for evaluating binocular convergence flexibility, overcoming the shortcomings of existing technologies that rely on physical optical equipment, are complex to operate, and are difficult to standardize.

[0008] Furthermore, the preset prism power adjustment scheme includes at least two prism power adjustment operations with opposite adjustment directions; the step of sequentially controlling the visual target images in the left and right eye display channels to simultaneously perform horizontal shifts to simulate an equivalent prism deflection effect includes: The virtual reality device is controlled to sequentially execute all the prism adjustment operations in a loop. After each prism power adjustment operation is performed, the wearer is assessed based on the binocular fixation data to determine whether the target fusion under the current prism power adjustment operation has been completed. If the target fusion under the current prism adjustment operation is completed, the virtual reality device is controlled to perform the next prism adjustment operation; otherwise, the virtual reality device is controlled to prompt the wearer to continue the target fusion under the current prism adjustment operation.

[0009] Compared with the prior art, the above embodiments have the following beneficial effects: by setting at least two prism power adjustment operations with opposite adjustment directions in the preset prism power adjustment scheme, and controlling the virtual reality device to execute each prism power adjustment operation in a loop, and judging whether the wearer has completed the visual target fusion under the current prism power based on binocular fixation data, it is possible to simulate the process of alternating positive and negative prism stimulation in the traditional convergence flexibility test, and control the test process by automatically judging the completion of fusion, effectively avoiding rhythm inconsistencies or judgment errors caused by manual intervention, and improving the continuity, stability and automation of the convergence flexibility assessment process.

[0010] Furthermore, the binocular fixation data includes: the fixation direction corresponding to each of the wearer's eyes; the step of determining whether the wearer has completed target fusion under the current prism power adjustment operation based on the binocular fixation data includes: Calculate the angle between the gaze directions of the wearer's eyes based on the gaze directions of each of the wearer's eyes; When the angle between the gaze directions of the two eyes is less than a preset angle threshold for a first preset time, it is determined that the wearer has completed the target fusion under the current prism adjustment operation.

[0011] Compared to existing technologies, the above embodiments have the following advantages: By specifically decomposing binocular fixation data into fixation direction vectors for each eye, and calculating the angle between the fixation directions based on geometric relationships, the determination of binocular fusion state is directly based on the real spatial relationship of the visual axes. Since the essence of equivalent prism stimulation is to change the convergence or divergence angle of the binocular visual axes, using the fixation direction angle as the determination criterion can accurately reflect whether the eyes have completed convergence and divergence adjustment under the corresponding prism power from a physical perspective. Furthermore, by introducing a joint determination mechanism of angle threshold and duration threshold, misjudgments caused by micro-jerking of eye movements, instantaneous saccades, or brief overlap of fixations can be effectively filtered out, ensuring that fusion determination is only confirmed when the binocular visual axes stably reach a fusion state, thereby significantly improving the accuracy and stability of fusion recognition.

[0012] Furthermore, controlling the virtual reality device to output the wearer's eye convergence and divergence flexibility based on the binocular gaze data includes: Within a second preset time period, the number of cycles in which the wearer completes all the prism power adjustment operations within the aforementioned lens power adjustment scheme and the corresponding visual target fusion is counted, and the number of cycles is used as the output of the virtual reality device to control the binocular convergence and divergence flexibility.

[0013] Compared to existing technologies, the above embodiments have the following advantages: By statistically analyzing the effective fusion cycles corresponding to the switching of each convergence / divergence state in the prism power adjustment scheme within a preset time window, the binocular convergence / divergence flexibility is transformed from a single-state judgment of "whether fusion is possible" into a quantitative indicator reflecting the convergence / divergence response capability per unit time. This method can simultaneously and comprehensively reflect the wearer's speed, continuity, and stability in completing the convergence / divergence response, avoiding the random influence brought about by relying solely on the result of a single fusion attempt. Since the statistics of the number of cycles are based on the completion status of the fusion event automatically determined by the system, the comparability of results between different subjects and different test batches can be achieved while ensuring a consistent evaluation rhythm, thereby improving the objectivity and repeatability of the convergence / divergence flexibility evaluation results.

[0014] Furthermore, each of the left and right eye display channels corresponds to a display screen, and each display screen displays one of the visual targets; the execution method of the prism power adjustment operation includes: According to the required prism power adjustment operation, the target image is controlled to be horizontally shifted simultaneously in the display screens corresponding to the left and right eye display channels; or according to the required prism power adjustment operation, the display screens corresponding to the left and right eye display channels are controlled to be horizontally shifted simultaneously.

[0015] Compared to existing technologies, the above embodiments offer the following advantages: By providing two methods for adjusting prism power—one based on the horizontal offset of the target image and the other based on the overall horizontal offset of the left and right eye display screens—the equivalent prism deflection effect can be achieved either through pure display control or through the physical displacement of the display structure. This design allows the method to adapt to different types of virtual reality device architectures: for devices with fixed screen structures, image offset can be used to achieve equivalent prism stimulation; for devices with movable display units, the light emission angle can be directly changed through screen offset. Therefore, without altering the convergence and divergence detection principle and process, the compatibility and scalability of the solution across different hardware platforms are improved.

[0016] Furthermore, the step of controlling the display screens corresponding to the left and right eye display channels to simultaneously perform a horizontal shift according to the required prism diopter adjustment operation includes: The horizontal magnification of the display screen is determined based on the device parameters of the virtual reality device; The first offset distance of the virtual image corresponding to each target image in the virtual reality device is determined according to the required adjustment of the prism diopter; Based on the offset distance and the horizontal magnification, determine and control the corresponding display screen to simultaneously perform a second horizontal offset distance.

[0017] Compared to existing technologies, the above embodiments have the following beneficial effects: By introducing specific optical parameters of the virtual reality device and using lateral magnification to inversely map the virtual image offset distance corresponding to the target prism power to the actual offset distance of the display screen, a clear and calculable correspondence is established between the clinically commonly used stimulus quantity of prism power and the physical control quantity in the virtual reality system. This ensures that, under a fixed virtual image distance, the convergence and divergence requirements introduced by different prism powers can be accurately reproduced, thereby avoiding stimulus quantity deviations caused by differences in device size, optical structure, or display parameters. Therefore, the equivalent prism deflection effect has repeatable and calibrable characteristics, providing a fundamental guarantee for the consistency and accuracy of convergence and divergence flexibility assessment results.

[0018] Furthermore, the visual target image includes several visual targets; before controlling the virtual reality device to display the visual target image independently in the left and right eye display channels simultaneously, the method further includes: controlling the virtual reality device to display visual targets of different sizes in sequence, and receiving feedback information returned by the wearer after each display of the visual target, and determining the display size of the visual target based on all the feedback information.

[0019] Compared to existing technologies, the above embodiments have the following beneficial effects: By controlling the virtual reality device to display visual targets of different sizes before the convergence-divergence flexibility test and determining the final display size of the visual targets based on the wearer's feedback, subsequent convergence-divergence stimuli are based on the premise that the wearer can stably identify the visual targets. Since visual target discernibility directly affects whether the eyes can complete the fusion response, this scheme can effectively avoid recognition difficulties caused by visual targets that are too small, or fusion that is too easy caused by visual targets that are too large, thereby reducing the interference of non-convergence-divergence factors on the test results. Based on this, the fusion behavior reflected in the subsequent convergence-divergence flexibility assessment process can more realistically reflect the wearer's convergence-divergence accommodation ability, improving the individual fit and reliability of the test results.

[0020] Another embodiment of this application provides a virtual reality device control device, including: a first control module, a second control module, and a third control module; The first control module is used to control the virtual reality device to display visual target images independently and simultaneously in the left and right eye display channels; The second control module is used to control the visual target images in the left and right eye display channels to be horizontally shifted simultaneously according to a preset prism diopter adjustment scheme, so as to simulate the equivalent prism deflection effect and collect the wearer's binocular fixation data. The third control module is used to control the virtual reality device to output the wearer's eye convergence and divergence flexibility based on the eye gaze data.

[0021] Another embodiment of this application also provides a terminal device, including: a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the steps of the virtual reality device control method of this application.

[0022] Another embodiment of this application also provides a computer-readable storage medium item, including: a stored computer program, which, when the computer program is running, controls the device where the computer-readable storage medium is located to perform the steps of the virtual reality device control method of this application. Attached Figure Description

[0023] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0024] Figure 1 This is a flowchart illustrating a virtual reality device control method provided in some embodiments of this application; Figure 2This is a schematic diagram of a virtual reality device provided in some embodiments of this application; Figure 3 This is a schematic diagram illustrating the determination of target size in some embodiments of this application; Figure 4 This is a schematic diagram of horizontal offset of a target image provided in some embodiments of this application; Figure 5 This is a schematic diagram of the structure of a virtual reality device control device provided in some embodiments of this application. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0026] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the application; the terms “comprising” and “having”, and any variations thereof, in the specification, claims, and foregoing description of the drawings are intended to cover non-exclusive inclusion.

[0027] In the description of the embodiments of this application, technical terms such as "first" and "second" are used only to distinguish different objects and should not be construed as indicating or implying relative importance or implicitly specifying the number, specific order, or primary and secondary relationship of the indicated technical features. In the description of the embodiments of this application, "multiple" means two or more, unless otherwise explicitly defined.

[0028] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0029] In the description of the embodiments in this application, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0030] In the description of the embodiments of this application, the term "multiple" refers to two or more (including two), similarly, "multiple sets" refers to two or more (including two sets), and "multiple pieces" refers to two or more (including two pieces).

[0031] In the description of the embodiments of this application, unless otherwise expressly specified and limited, technical terms such as "installation," "connection," "joining," and "fixing" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components. For those skilled in the art, the specific meaning of the above terms in the embodiments of this application can be understood according to the specific circumstances.

[0032] Existing methods for testing convergence flexibility typically rely on optical instruments such as physical prisms and synoptophores. This involves manually changing the prism power or adjusting the optical path to induce binocular visual axis shift, with professionals observing or recording the subject's subjective feedback. These methods are not only characterized by large equipment and complex operation, but also limit the detection of fusion responses to fixed distances. Furthermore, they are highly dependent on the operator's skill level, making standardization and automation difficult.

[0033] Please refer to Figure 1 To address the problem of how to achieve standardized, objective, and automated assessment of binocular convergence and divergence flexibility in existing technologies, this application provides a virtual reality device control method, including steps S101 to S103, specifically: S101: Controls the virtual reality device to display visual target images independently and simultaneously in the left and right eye display channels.

[0034] Preferably, in some embodiments of this application, the virtual reality device includes, but is not limited to, head-mounted virtual reality devices and non-head-mounted virtual reality devices. The virtual reality device includes at least an eye-tracking module for collecting the user's eye gaze data.

[0035] refer to Figure 2 The diagram below is a schematic of a head-mounted virtual reality device provided in some embodiments of this application. In this diagram, BI refers to a base-in prism and BO refers to a base-out prism, which are used to describe the base direction of the prism and to induce binocular convergence and divergence responses in different directions.

[0036] Preferably, in some embodiments of this application, before displaying the optotype image, the size mapping relationship between the optotypes in the physical eye chart and the optotypes displayed in the virtual reality device is first determined, specifically including: What users see through virtual reality devices is a virtual image (a virtual image is an image formed when light rays do not actually converge in space, but the human eye perceives the light as originating from a certain location by following the backward extension of the light rays). To ensure that the visual targets seen through the virtual reality device have the same visual effect as those seen on the physical visual chart, a relative mapping is needed based on the actual size of the visual targets on the physical chart. The specific mapping relationship is: Escreen-size(S) = S * size of the visual target on the screen / size of the visual target on the virtual image = S * object distance / image distance. Where S is the size of the visual target on the physical visual chart; the object distance is calculated using the distance from the eye to the lens and the focal length of the virtual reality device, combined with the lens formula; Escreen-size(S) refers to the size of the visual target in the visual target image; and the image distance is the distance from the eye to the virtual image.

[0037] For example, refer to Figure 3 Assuming that in this embodiment of the application, when displaying a visual target image through a virtual reality device, the image is displayed 400mm in front of the user's eyes, the focal length of the virtual reality device is 40mm, and the distance from the eyes to the lens is 15mm, then the distance from the lens to the virtual image is 400-15=385mm. At this point, according to the lens formula... The object distance can be calculated. It is 36.24mm, of which, Focal length Let S be the image distance. Further, based on the above mapping relationship, we can obtain Escreen-size(S) = S * 36.24 / 400.

[0038] Furthermore, in some embodiments of this application, the target image includes a plurality of targets. (See reference) Figure 4 The diagram shown illustrates the horizontal offset of the target image, with the targets arranged according to a preset pattern.

[0039] Furthermore, in some embodiments of this application, before controlling the virtual reality device to display visual targets images independently and simultaneously in the left and right eye display channels, the method further includes: controlling the virtual reality device to sequentially display visual targets of different sizes, receiving feedback information returned by the wearer after each display of the visual target, and determining the display size of the visual target based on all the feedback information.

[0040] Understandably, the generated visual target image needs to ensure that the visual targets in the image are clearly recognizable to the user in order to prevent the impact of low visual target recognition on the flexibility of subsequent convergence and divergence. Therefore, before generating the visual target image, the user's vision level is first tested through virtual reality equipment, and the display size of the visual targets in the visual target image is determined based on the user's vision level.

[0041] This application, by controlling the display of visual targets of different sizes on a virtual reality device before the convergence-divergence flexibility test and determining the final display size of the visual targets based on the wearer's feedback, ensures that subsequent convergence-divergence stimulation is based on the wearer's ability to stably identify the visual targets. Since visual target discernibility directly affects whether the eyes can complete a fusion response, this approach effectively avoids recognition difficulties caused by visual targets that are too small, or fusion that is too easy due to visual targets that are too large, thereby reducing interference from non-convergence-divergence factors on the test results. Based on this, the fusion behavior reflected in the subsequent convergence-divergence flexibility assessment more accurately reflects the wearer's convergence-divergence accommodation ability, improving the individual fit and reliability of the test results.

[0042] S102: According to the preset prism adjustment scheme, the visual target images in the left and right eye display channels are simultaneously horizontally shifted to simulate the equivalent prism deflection effect and collect the wearer's binocular fixation data.

[0043] Furthermore, in some embodiments of this application, the preset prism power adjustment scheme includes at least two prism power adjustment operations with opposite adjustment orientations.

[0044] Preferably, refer to Figure 2 The preset prism power adjustment scheme includes two different adjustment positions: 1.5BI and 6BO. 1.5BI refers to 1.5ΔBI, where Δ refers to the prism power, and 1Δ means the ability to cause a 1-centimeter shift in light at a distance of 1 meter. Similarly, 6BO refers to 6ΔBO. By simulating the alternating stimulation process of positive and negative prisms in traditional convergence and divergence flexibility testing, the testing process is automated.

[0045] Furthermore, in some embodiments of this application, each of the left and right eye display channels corresponds to a display screen, and each display screen displays one of the target images; the execution method of the prism power adjustment operation includes: According to the required prism power adjustment operation, the target image is controlled to be horizontally shifted simultaneously in the display screens corresponding to the left and right eye display channels; or according to the required prism power adjustment operation, the display screens corresponding to the left and right eye display channels are controlled to be horizontally shifted simultaneously.

[0046] Preferably, in other embodiments of this application, when the visual target image is controlled to simultaneously shift horizontally in the display screens corresponding to the left and right eye display channels according to the required prism adjustment operation, the virtual reality device further includes at least: control software that controls the horizontal movement of the visual target image on the real screen. Equivalent prism stimulation is achieved by dynamically adjusting the horizontal angle of the left and right eye visual target images.

[0047] Preferably, in some embodiments of this application, when the target image is controlled to be horizontally offset simultaneously in the display screens corresponding to the left and right eye display channels according to the required prism power adjustment operation, since 1Δ is defined as the ability to cause light to shift by 1 centimeter at a distance of 1 meter, the horizontal offset angle of the target image is determined based on the formula Δθ ≈ prism power / 100, thereby realizing the prism power adjustment operation.

[0048] For example, for a prism power adjustment of 1.5ΔBI, 1.5ΔBI ≈ 1.5 / 100 = 0.015 rad ≈ 0.86°, therefore the corresponding target image is shifted outward by 0.86° on the display screen. Similarly, for a prism power adjustment of 6ΔBO, 6ΔBO ≈ 6.0 / 100 = 0.06 rad ≈ 3.44°, therefore the corresponding target image is shifted inward by 3.44° on the display screen.

[0049] Preferably, in some embodiments of this application, when the display screens corresponding to the left and right eye display channels are simultaneously horizontally offset according to the required prism adjustment operation, the virtual reality device further includes at least: a display screen capable of horizontally moving left and right at a fixed virtual image distance, and a high-precision motor for driving the display screen to move. By horizontally moving the independent display screens of the left and right eyes, the light emission angle is changed, thereby generating an equivalent horizontal displacement on the fixed virtual image plane, accurately simulating the prism effect.

[0050] This application provides two methods for adjusting prism power: one based on the horizontal offset of the target image, and the other based on the overall horizontal offset of the left and right eye display screens. This allows the equivalent prism deflection effect to be achieved either through pure display control or through the physical displacement of the display structure. This design enables the method to adapt to different types of virtual reality device architectures: for devices with fixed screen structures, image offset can be used to achieve equivalent prism stimulation; for devices with movable display units, the light emission angle can be directly changed through screen offset. Therefore, without altering the convergence and divergence detection principle and process, the compatibility and scalability of the solution across different hardware platforms are improved.

[0051] Furthermore, in some embodiments of this application, controlling the display screens corresponding to the left and right eye display channels to simultaneously perform a horizontal shift according to the required prism power adjustment operation includes: The horizontal magnification of the display screen is determined based on the device parameters of the virtual reality device; The first offset distance of the virtual image corresponding to each target image in the virtual reality device is determined according to the required adjustment of the prism diopter; Based on the offset distance and the horizontal magnification, determine and control the corresponding display screen to simultaneously perform a second horizontal offset distance.

[0052] Preferably, in some embodiments of this application, the device parameters include: object distance, image distance, and distance from the lens to the virtual image. The formula for calculating the lateral magnification M is M = distance from the lens to the virtual image / object distance. The formula for calculating the first offset distance d is d = prism power * image distance / 1000. The formula for calculating the second offset distance s is s = d / M.

[0053] For example, assuming the object distance of the virtual reality device is 36.24mm, the image distance is 400mm, and the distance from the lens to the virtual image is 385mm, then M = 385 / 36.24 = 10.62. Furthermore, for a prism power adjustment operation of 1.5ΔBI, the left eye's display screen shifts to the left by s = 1.5 * 400 / (1000 * 10.62) = 0.0565mm, and similarly, the right eye's display screen shifts to the right by 0.0565mm. Further, for a prism power adjustment operation of 6ΔBO, according to the above calculation logic, the left eye's display screen shifts to the right by 0.226mm, and the right eye's display screen shifts to the left by 0.226mm.

[0054] This application introduces specific optical parameters of virtual reality devices and uses lateral magnification to inversely map the virtual image offset distance corresponding to the target prism power to the actual offset distance of the display screen. This establishes a clear and calculable correspondence between prism power, a commonly used clinical stimulus quantity, and the physical control quantity in the virtual reality system. This ensures that, under a fixed virtual image distance, the convergence and divergence requirements introduced by different prism powers can be accurately reproduced, thus avoiding stimulus quantity deviations caused by differences in device size, optical structure, or display parameters. Consequently, the equivalent prism deflection effect possesses repeatable and calibrable characteristics, providing a fundamental guarantee for the consistency and accuracy of convergence and divergence flexibility assessment results.

[0055] Furthermore, in some embodiments of this application, the step of sequentially controlling the visual target images in the left and right eye display channels to simultaneously perform horizontal shifts to simulate an equivalent prism deflection effect includes: The virtual reality device is controlled to sequentially execute all the prism adjustment operations in a loop. After each prism power adjustment operation is performed, the wearer is assessed based on the binocular fixation data to determine whether the target fusion under the current prism power adjustment operation has been completed. If the target fusion under the current prism adjustment operation is completed, the virtual reality device is controlled to perform the next prism adjustment operation; otherwise, the virtual reality device is controlled to prompt the wearer to continue the target fusion under the current prism adjustment operation.

[0056] For example, taking a preset prism power adjustment scheme consisting of 1.5ΔBI and 6ΔBO as an example, after the wearer is equipped with the virtual reality device, the virtual reality device displays a target image and adjusts the target image according to the prism power adjustment operation corresponding to 1.5ΔBI. At this time, the wearer gazes at the target image and performs target fusion. The eye-tracking module collects the wearer's binocular gaze data in real time to determine whether the wearer has completed the target fusion operation. When the wearer completes target fusion, the target image is immediately adjusted according to the prism power adjustment operation corresponding to 6ΔBO, and it is determined whether the wearer has completed the target fusion operation. If the wearer has completed target fusion, the prism power adjustment operation corresponding to 1.5ΔBI is switched back, and the preset prism power adjustment scheme is executed cyclically. If, after a preset time, the wearer cannot complete target fusion after a certain prism power adjustment operation, the virtual reality device prompts the wearer to continue the test of the current prism power adjustment operation or pause the test.

[0057] This application sets at least two prism power adjustment operations with opposite adjustment directions in a preset prism power adjustment scheme, and controls the virtual reality device to execute each prism power adjustment operation in a loop. At the same time, it judges whether the wearer has completed the visual target fusion under the current prism power based on binocular fixation data. This can simulate the process of alternating positive and negative prism stimulation in traditional convergence and divergence flexibility tests. By automatically judging the completion of fusion, the test process is controlled, which effectively avoids the inconsistency of rhythm or judgment error caused by human intervention, and improves the continuity, stability and automation of the convergence and divergence flexibility assessment process.

[0058] Furthermore, in some embodiments of this application, the binocular fixation data includes: the fixation direction corresponding to each of the wearer's eyes; the step of determining whether the wearer has completed target fusion under the current prism power adjustment operation based on the binocular fixation data includes: Calculate the angle between the gaze directions of the wearer's eyes based on the gaze directions of each of the wearer's eyes; When the angle between the gaze directions of the two eyes is less than a preset angle threshold for a first preset time, it is determined that the wearer has completed the target fusion under the current prism adjustment operation.

[0059] Preferably, in some embodiments of this application, the gaze direction is represented by a gaze direction vector, which is a three-dimensional unit vector pointing from the pupil of the eye corresponding to the gaze direction in the spatial direction of the subject's gaze. The gaze direction vector is acquired by an eye-tracking module in a virtual reality device.

[0060] Preferably, in some embodiments of this application, the formula for calculating the angle between the gaze directions of the two eyes is: ; in, The angle between the directions of gaze of both eyes; This is the gaze direction vector of the left eye; is the gaze direction vector of the right eye.

[0061] It should be noted that the preset angle threshold is used to determine whether the eyes have completed the convergence and divergence fusion of the visual targets. When the angle between the gaze directions of the eyes is less than the preset angle threshold, it indicates that the lines of sight of the eyes are close enough, and it can be considered that the eyes have completed the visual target fusion action. The specific value of the preset angle threshold can refer to the conventional understanding of the fusion range in binocular visual physiology, and this application embodiment does not specifically limit the value.

[0062] This application decomposes binocular fixation data into separate fixation direction vectors for each eye and calculates the angle between these directions based on geometric relationships. This allows the determination of binocular fusion state to be directly based on the actual spatial relationship of the visual axes. Since the essence of equivalent prism stimulation is to change the convergence or divergence angle of the binocular visual axes, using the angle between the fixation directions as the criterion can accurately reflect whether the eyes have completed convergence or divergence accommodation under the corresponding prism power from a physical perspective. Furthermore, by introducing a joint determination mechanism of angle threshold and duration threshold, misjudgments caused by micro-jerks, momentary saccades, or brief fixation overlap can be effectively filtered out. This ensures that fusion determination is only confirmed when the binocular visual axes have stably reached a fusion state, thereby significantly improving the accuracy and stability of fusion recognition.

[0063] S103: Based on the binocular gaze data, control the virtual reality device to output the wearer's binocular convergence and divergence flexibility.

[0064] Furthermore, in some embodiments of this application, controlling the virtual reality device to output the wearer's binocular convergence and divergence flexibility based on the binocular gaze data includes: Within a second preset time period, the number of cycles in which the wearer completes all the prism power adjustment operations within the aforementioned lens power adjustment scheme and the corresponding visual target fusion is counted, and the number of cycles is used as the output of the virtual reality device to control the binocular convergence and divergence flexibility.

[0065] For example, taking the preset prism power adjustment scheme consisting of 1.5ΔBI and 6ΔBO as an example, when the wearer completes the target fusion test corresponding to 1.5ΔBI and 6ΔBO in sequence, it is considered that one cycle has been completed. The number of times the above complete cycle is completed within the second preset time is counted as the final result of binocular convergence and divergence flexibility.

[0066] This application transforms binocular convergence flexibility from a single-state judgment of "whether fusion is possible" into a quantitative indicator reflecting the convergence-fusion response capability per unit time by statistically analyzing the effective fusion cycles corresponding to each convergence / divergence state switch in the prism power adjustment scheme within a preset time window. This method can simultaneously and comprehensively reflect the wearer's speed, continuity, and stability in completing the convergence / divergence response, avoiding the randomness caused by relying solely on the result of a single fusion attempt. Since the cycle count is based on the completion status of the fusion event automatically determined by the system, the comparability of results between different subjects and different test batches can be achieved while ensuring a consistent evaluation rhythm, thereby improving the objectivity and repeatability of the convergence flexibility evaluation results.

[0067] It is understood that the virtual reality device control method provided in this application can not only be used to test the convergence and divergence flexibility of the wearer's eyes, but also guide the subject to repeatedly perform convergence-fusion eye coordination movements by programmatically and alternately presenting equivalent parallax stimuli of preset prism power adjustment schemes such as 1.5ΔBI and 6ΔBO, thereby activating and strengthening the neuromuscular response ability of the wearer's convergence system.

[0068] In summary, the virtual reality device control method provided in this application has the following advantages compared to the prior art: This application utilizes the independent control capability of the left and right eye display channels of the virtual reality device to synchronously display a target image containing the target, and simulates an equivalent prism deflection effect by horizontally shifting the target image. This achieves controllable induction of binocular visual axis shift without the need for a physical prism or synoptophore, significantly reducing hardware size and operational complexity. Furthermore, by collecting the wearer's binocular gaze data during prism adjustment and outputting binocular convergence flexibility accordingly, the evaluation result is based on objective gaze behavior rather than subjective feedback, effectively reducing the impact of human intervention and differences in operator experience on the results. Therefore, this application can achieve a standardized, objective, and automated binocular convergence flexibility evaluation method, overcoming the shortcomings of existing technologies that rely on physical optical equipment, are complex to operate, and are difficult to standardize.

[0069] like Figure 5As shown, based on the above-described method embodiments, this application provides a virtual reality device control device, including: a first control module 201, a second control module 202, and a third control module 203; wherein, the first control module 201 is used to control the virtual reality device to simultaneously and independently display visual target images in the left and right eye display channels; the second control module 202 is used to sequentially control the visual target images in the left and right eye display channels to simultaneously perform horizontal shifts according to a preset prism adjustment scheme, so as to simulate an equivalent prism deflection effect, and to collect the wearer's binocular fixation data; the third control module 203 is used to control the virtual reality device to output the wearer's binocular convergence and divergence flexibility based on the binocular fixation data.

[0070] Further, in some embodiments of this application, the preset prism power adjustment scheme includes at least two prism power adjustment operations with opposite adjustment directions; the second control module 202 includes: a first control unit, a judgment unit, and a second control unit; the second control module 202 is used to sequentially control the visual target images in the left and right eye display channels to simultaneously perform horizontal shifts to simulate an equivalent prism deflection effect, including: the first control unit is used to control the virtual reality device to cyclically execute all the prism power adjustment operations in sequence; the judgment unit is used to determine, based on the binocular fixation data, whether the wearer has completed visual target fusion under the current prism power adjustment operation after each execution of the prism power adjustment operation; the second control unit is used to control the virtual reality device to execute the next prism power adjustment operation if visual target fusion under the current prism power adjustment operation is completed; otherwise, control the virtual reality device to prompt the wearer to continue visual target fusion under the current prism power adjustment operation.

[0071] Furthermore, in some embodiments of this application, the binocular fixation data includes: the fixation direction corresponding to each of the wearer's eyes; the determination unit is used to determine whether the wearer has completed the target fusion under the current prism power adjustment operation based on the binocular fixation data, including: calculating the angle between the wearer's binocular fixation directions based on the fixation direction corresponding to each of the wearer's eyes; when the angle between the binocular fixation directions is less than a preset angle threshold for a first preset time, it is determined that the wearer has completed the target fusion under the current prism power adjustment operation.

[0072] Furthermore, in some embodiments of this application, the third control module 203 is used to control the virtual reality device to output the binocular convergence flexibility of the wearer based on the binocular gaze data, including: within a second preset time period, counting the number of cycles in which the wearer completes the fusion of the corresponding visual targets for all the prism power adjustment operations within the power adjustment scheme, and using the number of cycles as the binocular convergence flexibility to control the output of the virtual reality device.

[0073] Furthermore, in some embodiments of this application, each of the left and right eye display channels corresponds to a display screen, and each display screen displays a target image; the execution method of the prism power adjustment operation includes: according to the required prism power adjustment operation, controlling the target image to be horizontally shifted simultaneously in the display screens corresponding to the left and right eye display channels; or according to the required prism power adjustment operation, controlling the display screens corresponding to the left and right eye display channels to be horizontally shifted simultaneously.

[0074] Furthermore, in some embodiments of this application, the step of controlling the display screens corresponding to the left and right eye display channels to simultaneously perform horizontal offset according to the required prism adjustment operation includes: determining the horizontal magnification of the display screens according to the device parameters of the virtual reality device; determining a first offset distance of the virtual image corresponding to each visual target image in the virtual reality device according to the required prism adjustment; and determining and controlling the corresponding display screens to simultaneously perform horizontal offset according to the offset distance and the horizontal magnification.

[0075] Furthermore, in some embodiments of this application, the visual target image includes a plurality of visual targets; before controlling the virtual reality device to display the visual target image independently and simultaneously in the left and right eye display channels, the method further includes: controlling the virtual reality device to display visual targets of different sizes in sequence, and receiving feedback information returned by the wearer after each display of the visual target, and determining the display size of the visual target based on all the feedback information.

[0076] It is understood that the above-described device embodiments correspond to the method embodiments of this application, and can implement the virtual reality device control method provided by any of the above-described method embodiments of this application.

[0077] It should be noted that the device embodiments described above are merely illustrative, and some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the device embodiments provided in this application, the connection relationships between modules indicate that they have communication connections, which can specifically be implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0078] In summary, the virtual reality device control device provided in this application has the following advantages compared to the prior art: This application utilizes the independent control capability of the left and right eye display channels of the virtual reality device to synchronously display a target image containing the target, and simulates an equivalent prism deflection effect by horizontally shifting the target image. This achieves controllable induction of binocular visual axis shift without the need for a physical prism or synoptophore, significantly reducing hardware size and operational complexity. Furthermore, by collecting the wearer's binocular gaze data during prism adjustment and outputting binocular convergence flexibility accordingly, the evaluation result is based on objective gaze behavior rather than subjective feedback, effectively reducing the impact of human intervention and differences in operator experience on the results. Therefore, this application can achieve a standardized, objective, and automated binocular convergence flexibility evaluation method, overcoming the shortcomings of existing technologies that rely on physical optical equipment, are complex to operate, and are difficult to standardize.

[0079] Based on the above embodiments of the virtual reality device control method, another embodiment of this application provides a terminal device, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the virtual reality device control method of any embodiment of this application.

[0080] For example, in this embodiment, the computer program can be divided into one or more modules, which are stored in the memory and executed by the processor to complete this application. The one or more module units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the terminal device.

[0081] The terminal device may be a desktop computer, laptop, handheld computer, or cloud server, etc. The terminal device may include, but is not limited to, a processor and a memory.

[0082] The processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor. The processor is the control center of the terminal device, connecting all parts of the terminal device via various interfaces and lines.

[0083] Based on the above-described method embodiments, another embodiment of this application provides a computer-readable storage medium including a stored computer program, wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to execute the virtual reality device control method described in any of the above-described method embodiments of this application.

[0084] The modules / units integrated in the device / terminal equipment, if implemented as software functional units and sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

Claims

1. A method for controlling a virtual reality device, characterized in that, include: Control the virtual reality device to display visual target images independently and simultaneously in the left and right eye display channels; According to the preset prism power adjustment scheme, the visual target images in the left and right eye display channels are controlled to be horizontally shifted simultaneously to simulate the equivalent prism deflection effect and collect the wearer's binocular fixation data. Based on the binocular gaze data, the virtual reality device is controlled to output the wearer's binocular convergence and divergence flexibility.

2. The virtual reality device control method as described in claim 1, characterized in that, The preset prism power adjustment scheme includes at least two prism power adjustment operations with opposite adjustment directions; The step of sequentially controlling the visual target images in the left and right eye display channels to simultaneously perform horizontal shifts to simulate an equivalent prism deflection effect includes: The virtual reality device is controlled to sequentially execute all the prism adjustment operations in a loop. After each prism power adjustment operation is performed, the wearer is assessed based on the binocular fixation data to determine whether the target fusion under the current prism power adjustment operation has been completed. If the target fusion under the current prism adjustment operation is completed, the virtual reality device is controlled to perform the next prism adjustment operation; otherwise, the virtual reality device is controlled to prompt the wearer to continue the target fusion under the current prism adjustment operation.

3. The virtual reality device control method as described in claim 2, characterized in that, The binocular fixation data includes: the fixation direction of each of the wearer's eyes; the step of determining whether the wearer has completed target fusion under the current prism power adjustment operation based on the binocular fixation data includes: Calculate the angle between the gaze directions of the wearer's eyes based on the gaze directions of each of the wearer's eyes; When the angle between the gaze directions of the two eyes is less than a preset angle threshold for a first preset time, it is determined that the wearer has completed the target fusion under the current prism adjustment operation.

4. The virtual reality device control method as described in claim 2, characterized in that, The step of controlling the virtual reality device to output the wearer's binocular convergence and divergence flexibility based on the binocular gaze data includes: Within a second preset time period, the number of cycles in which the wearer completes all the prism power adjustment operations within the aforementioned lens power adjustment scheme and the corresponding visual target fusion is counted, and the number of cycles is used as the output of the virtual reality device to control the binocular convergence and divergence flexibility.

5. The virtual reality device control method as described in claim 2, characterized in that, Each of the left and right eye display channels corresponds to a display screen, and each display screen displays one of the visual targets images; The execution method of the prism diopter adjustment operation includes: According to the required prism power adjustment operation, the target image is controlled to be horizontally shifted simultaneously in the display screens corresponding to the left and right eye display channels; Alternatively, depending on the required prism adjustment operation, the display screens corresponding to the left and right eye display channels may be controlled to simultaneously shift horizontally.

6. The virtual reality device control method as described in claim 5, characterized in that, The step of controlling the display screens corresponding to the left and right eye display channels to simultaneously shift horizontally according to the required prism diopter adjustment operation includes: The horizontal magnification of the display screen is determined based on the device parameters of the virtual reality device; The first offset distance of the virtual image corresponding to each target image in the virtual reality device is determined according to the required adjustment of the prism diopter; Based on the offset distance and the horizontal magnification, determine and control the corresponding display screen to simultaneously perform a second horizontal offset distance.

7. The virtual reality device control method according to any one of claims 1 to 6, characterized in that, The visual target image includes several visual targets; before controlling the virtual reality device to display the visual target image independently in the left and right eye display channels simultaneously, the method further includes: controlling the virtual reality device to display visual targets of different sizes in sequence, and receiving feedback information returned by the wearer after each display of the visual target, and determining the display size of the visual target based on all the feedback information.

8. A virtual reality device control device, characterized in that, include: The first control module, the second control module, and the third control module; The first control module is used to control the virtual reality device to display visual target images independently and simultaneously in the left and right eye display channels; The second control module is used to control the visual target images in the left and right eye display channels to be horizontally shifted simultaneously according to a preset prism diopter adjustment scheme, so as to simulate the equivalent prism deflection effect and collect the wearer's binocular fixation data. The third control module is used to control the virtual reality device to output the wearer's eye convergence and divergence flexibility based on the eye gaze data.

9. A terminal device, characterized in that, The device includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor, when executing the computer program, implements a virtual reality device control method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program, wherein, when the computer program is executed, it controls the device on which the computer-readable storage medium is located to perform a virtual reality device control method as described in any one of claims 1 to 7.

Images