Test system and method for head-mounted display devices
By rigidly connecting the inertial measurement unit and optical sensor detection device to the head-mounted display device and moving synchronously, the problem of accurately measuring MTP time in existing technologies is solved, achieving accurate measurement without damaging the device. This method is applicable to head-mounted display devices manufactured by any company.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- GOERTEK INC
- Filing Date
- 2024-12-03
- Publication Date
- 2026-06-05
Smart Images

Figure CN122151349A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of head-mounted display devices, and more specifically, to a testing system and method for head-mounted display devices. Background Technology
[0002] For head-mounted devices such as AR, VR, and XR glasses, image refresh is directly related to movement. Movement results in changes in posture, and different postures correspond to different images. Therefore, the latency between posture changes and image refresh directly determines the user experience. Latency can affect a player's attention, and significant latency can cause motion sickness, commonly known as car sickness or seasickness. The principle behind this is that the visual perception of one's own body state is inconsistent with the vestibular system in the middle ear, which is responsible for perceiving the body's state; the central nervous system's feedback to this state is nausea.
[0003] To measure the latency from a change in pose to an image refresh, MTP (Motion-To-Photon Latency) is defined as the total time taken from the start of a player's head movement to the point where a rendered image using those motion parameters becomes visible on the screen. Currently, there are many methods for testing MTP time, but accurately measuring it without damaging the device is relatively difficult. Summary of the Invention
[0004] One object of this disclosure is to provide a test system for head-mounted displays that can measure their MTP time without damaging the head-mounted display.
[0005] According to a first aspect of this disclosure, a testing system for a head-mounted display device is provided, the testing system comprising:
[0006] A connecting mechanism is used to rigidly connect the detection device and the head-mounted display device so that the detection device and the head-mounted display device move synchronously, wherein the head-mounted display device displays a target image when motion is detected;
[0007] The detection device includes an inertial measurement unit and an optical sensor. The detection device detects a first moment of motion of the detection device through the inertial measurement unit and a second moment of displaying a target image on the head-mounted display device through the optical sensor, and determines the difference between the second moment and the first moment as the MTP time of the head-mounted display device.
[0008] Optionally, the inertial measurement unit detects that the frequency of the motion of the detection device is greater than a first threshold.
[0009] Optionally, the head-mounted display device and the detection device use the same motion detection method to detect whether they are moving.
[0010] Optionally, detecting the second moment when the head-mounted display device displays the target image via the light sensor includes:
[0011] Determine the third moment when the optical sensor detects the target image;
[0012] The second time is determined based on the third time and the interrupt response time of the optical sensor, wherein the second time is the difference between the third time and the interrupt response time.
[0013] Optionally, detecting a second moment when the head-mounted display device displays the target image via the light sensor includes: determining a third moment when the light sensor detects the target image;
[0014] The second time is determined based on the third time, the interrupt response time of the light sensor, and the screen refresh cycle of the head-mounted display device, wherein the second time is the difference between the third time and the first sum, and the first sum is the sum of the interrupt response time and 0.5 times the screen refresh cycle.
[0015] According to a second aspect of this disclosure, a head-mounted display device is provided that is rigidly connected to a testing device and moves synchronously based on the rigid connection. The detection device includes an inertial measurement unit and a light sensor. The head-mounted display device displays a target image upon detecting motion. The method includes:
[0016] The first moment of motion of the detection device is determined by the inertial measurement unit;
[0017] The second moment when the head-mounted display device displays the target image is determined by the light sensor;
[0018] The difference between the second time point and the first time point is determined as the MTP time of the head-mounted display device.
[0019] Optionally, the inertial measurement unit detects that the frequency of the motion of the detection device is greater than a first threshold.
[0020] Optionally, the head-mounted display device and the detection device use the same motion detection method to detect whether they are moving.
[0021] Optionally, determining the second moment when the head-mounted display device displays the target image via the light sensor includes:
[0022] Determine the third moment when the optical sensor detects the target image;
[0023] The second time is determined based on the third time and the interrupt response time of the optical sensor, wherein the second time is the difference between the third time and the interrupt response time.
[0024] Optionally, determining the second moment when the head-mounted display device displays the target image via the light sensor includes:
[0025] Determine the third moment when the optical sensor detects the target image;
[0026] The second time is determined based on the third time, the interrupt response time of the light sensor, and the screen refresh cycle of the head-mounted display device, wherein the second time is the difference between the third time and the first sum, and the first sum is the sum of the interrupt response time and 0.5 times the screen refresh cycle.
[0027] One technical advantage of this disclosure is that it provides a testing system for head-mounted displays. This system can fix the head-mounted display and a detection device to a fixture base, causing them to move synchronously. The detection device can then detect the timing of its own movement as the moment the head-mounted display moves. During this movement, the head-mounted display displays a target image, and the detection device's light sensor detects the moment the target image is displayed. Based on these two moments, the MTP (Mean Time Per Hour) of the head-mounted display is determined. Through this method, the testing system can measure the MTP of head-mounted displays from any manufacturer without damaging the device, increasing the system's versatility and practicality.
[0028] Other features and advantages of the embodiments of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0029] The accompanying drawings, which form part of this specification, illustrate embodiments of the present disclosure and, together with the specification, serve to explain the principles of the embodiments of the present disclosure.
[0030] Figure 1 This is a schematic diagram of the structure of the test system for the head-mounted display device provided in this application;
[0031] Figure 2 This is a schematic diagram of the test system for the head-mounted display device provided in this application;
[0032] Figure 3 This is a schematic diagram of various moments in the MTP time process of the test head-mounted display device provided in this application;
[0033] Figure 4 This is a flowchart of the testing method for the head-mounted display device provided in this application. Detailed Implementation
[0034] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values of the components and steps set forth in these embodiments do not limit the scope of the invention.
[0035] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.
[0036] Technologies and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such technologies and equipment should be considered part of the specification.
[0037] In all the examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.
[0038] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.
[0039] This application provides a testing system 100 for a head-mounted display device. The testing system includes: a connecting mechanism 101 for rigidly connecting a detection device and a head-mounted display device, enabling synchronous movement of the two devices, wherein the head-mounted display device displays a target image upon detecting movement; and a detection device 102, comprising an inertial measurement unit and a light sensor. The detection device detects a first moment of movement of the detection device via the inertial measurement unit and a second moment of displaying the target image via the light sensor, and determines the difference between the second moment and the first moment as the MTP time of the head-mounted display device.
[0040] In this embodiment, the head-mounted display device can be a device such as AR, XR, or VR glasses. This head-mounted display device can be pre-programmed to display a target image when its inertial measurement unit detects movement—that is, movement or rotation in any direction. In this example, the target image can be a pure white image or other easily detectable image.
[0041] In one example, a first program can be pre-installed on the head-mounted display device before testing. This program acquires inertial data from the head-mounted display device and determines whether the device has moved based on this data. After determining that the device has moved, the program controls the head-mounted display device to switch from displaying no image to displaying the target image.
[0042] In this embodiment, the connecting mechanism is used to fix the detection device and the head-mounted display device, ensuring a stable connection and precise positioning between them. This achieves a rigid connection between the detection device and the head-mounted display device, allowing them to move synchronously under user control or control via other devices. This effectively avoids loosening or displacement that may occur during movement, thereby ensuring the accuracy and reliability of the test results.
[0043] In one example, the testing system may also include a tooling base, on which the connecting mechanism can be fixed during testing. Figure 2 For example, when performing MTP time testing on a head-mounted display device, the testing device and the head-mounted display device can be mounted on a connecting mechanism, which is then fixed to a fixture base. During testing, the fixture base can drive the testing device and the head-mounted display device to move synchronously. For instance, when simulating lateral head movements, the fixture base ensures that both move laterally at the same speed.
[0044] In this embodiment, the detection device is equipped with an inertial measurement unit and an optical sensor. The inertial measurement unit can detect the pose data of the detection device itself and determine whether the detection device has moved by the pose data. When the detection device moves, the inertial measurement unit can determine the time when the device starts to move.
[0045] In this embodiment, when the detection device and the head-mounted display device are fixed on the connecting mechanism, the light sensor of the detection device can be directly facing the display unit of the head-mounted display device in order to determine the display time of the target image.
[0046] In one example, when the tooling base moves the detection device and the head-mounted display device, such as Figure 3 As shown, the detection device and the head-mounted display device detect their own motion at times T1 and T2 simultaneously or within a very short interval. At this time, the head-mounted display device begins rendering to display the target image at time T3, and the light sensor detects the target image displayed by the head-mounted display device at time T4. Since times T1 and T2 are the same or substantially the same, and times T3 and T4 are substantially the same, the detection device can use the difference between the second time T4 and the first time T1 as the MTP time of the head-mounted display device, which is T3-T2.
[0047] In this example, a testing system for a head-mounted display device is provided. This system uses a fixture base to fix the head-mounted display device and a detection device, causing them to move synchronously. The detection device then detects its own movement time as the moment the head-mounted display device moves. During this movement, the head-mounted display device displays a target image, and the detection device's light sensor detects the moment the target image is displayed. Based on these two moments, the MTP (Mean Time Per Hour) of the head-mounted display device is determined. In this way, the testing system can measure the MTP of head-mounted displays from any manufacturer without damaging the device, increasing the system's versatility and practicality.
[0048] In one example of this embodiment, the inertial measurement unit detects that the frequency of the motion of the detection device is greater than a first threshold.
[0049] In this example, the detection frequency of the inertial measurement unit in the detection device can be set to a relatively high value. Since the MTP time is approximately in the millisecond range, the first threshold can be set to a value such as 1000Hz or 2000Hz to ensure that the detection error of the inertial measurement unit is within the millisecond range.
[0050] In one example of this embodiment, the head-mounted display device and the detection device use the same motion detection method to detect whether they are moving.
[0051] In one example of this embodiment, the head-mounted display device and the detection device can use the same motion detection method to avoid differences in detection speed caused by different detection methods, which would increase the error between time T1 and time T2 and reduce the accuracy of the final MTP time. In this example, the same motion detection method not only means that the detection methods of the two are the same, but also that the threshold or threshold range for determining motion is the same, the resting time is the same, and the method of determining the threshold is the same.
[0052] For example, motion detection methods might involve first keeping the device stationary for 10 seconds, during which the magnitudes of the pose data from the IMU sensor along the X, Y, and Z axes are calculated, and the maximum value among these magnitudes is set as a threshold for the stationary state. Then, under conditions where the device may be affected by external vibrations or its own movement, the magnitudes of the pose data are monitored in real-time to determine whether the device has moved. Alternatively, motion detection could involve keeping the device stationary for 10 seconds, then determining the maximum and minimum values of the pose data along each axis within those 10 seconds, using these values as a range for a preset threshold. If the pose data is detected to exceed this range, it indicates that the device has moved.
[0053] The above motion detection method can effectively avoid changes in pose data caused by minor vibrations of the equipment or tooling, which could lead the inertial measurement unit to mistakenly believe that the equipment has started to move, thus improving the accuracy of detection.
[0054] In one example of this embodiment, detecting a second moment when the head-mounted display device displays a target image via a light sensor includes: determining a third moment when the light sensor detects the target image; and determining the second moment based on the third moment and the interrupt response time of the light sensor, wherein the second moment is the difference between the third moment and the interrupt response time.
[0055] In this embodiment, since the light sensor triggers an interrupt response process after detecting a light signal, the influence of the interrupt response must be removed from the time T4 detected by the light sensor and the time T3 when the head-mounted display actually displays the target image. Therefore, the second time can be determined as the difference between the third time and the interrupt response time. In this example, the interrupt response time of the light sensor can be preset or acquired. In this way, a more accurate MTP time of the head-mounted display is obtained.
[0056] In one example of this embodiment, a third moment is determined when the light sensor detects the target image; a second moment is determined based on the third moment, the interrupt response time of the light sensor, and the screen refresh cycle of the head-mounted display device, wherein the second moment is the difference between the third moment and the first sum, and the first sum is the sum of the interrupt response time and 0.5 times the screen refresh cycle.
[0057] In this embodiment, since the light sensor triggers an interrupt response process after detecting a light signal, and the screen refresh cycle of the head-mounted display device also has an impact, for example, if the screen refresh cycle is 11.11ms, when the instruction to display the target image is issued at the beginning of a cycle, the head-mounted display device still needs to wait 11.11ms before it can refresh the target image. When the instruction to display the target image is issued at the end of a cycle, the head-mounted display device does not need to wait and can directly display the target image. Therefore, the influence of the interrupt response and the screen refresh cycle must be removed between the time T4 detected by the light sensor and the time T3 when the head-mounted display device actually displays the target image.
[0058] In this example, the median screen refresh rate, which is the average of the longest and shortest times, can be taken as the effect of the screen refresh rate to be removed at time T4. Simultaneously, the impact of interrupt response time can also be removed. Therefore, the second time point can be determined as the third time point minus the interrupt response time minus 0.5 times the screen refresh rate. In this example, the screen refresh rate and the interrupt response time of the light sensor can be preset or obtained. This method yields a more accurate MTP time for the head-mounted display device.
[0059] In one example of this embodiment, a testing method for a head-mounted display device is also provided. The head-mounted display device is rigidly connected to a detection device and moves synchronously based on this rigid connection. The detection device includes an inertial measurement unit and a light sensor. The head-mounted display device displays a target image upon detecting motion, such as... Figure 4 As shown, the method includes:
[0060] Step S11: Determine the first moment of motion of the detection device using the inertial measurement unit;
[0061] Step S12: Determine the second moment when the head-mounted display device displays the target image using the light sensor;
[0062] Step S13: Determine the difference between the second time point and the first time point as the MTP time of the head-mounted display device.
[0063] This example provides a testing method for head-mounted displays. The head-mounted display and a detection device are rigidly connected, causing them to move synchronously. The detection device then detects its own movement time as the moment the head-mounted display moves. During this movement, the head-mounted display displays a target image, and the detection device's light sensor detects the moment the target image is displayed. Based on these two moments, the MTP (Mean Time To Value) of the head-mounted display is determined. This method allows for accurate measurement of the MTP of head-mounted displays from any manufacturer without damaging the device.
[0064] Optionally, the inertial measurement unit detects that the frequency of the motion of the detection device is greater than a first threshold.
[0065] Optionally, the head-mounted display device and the detection device use the same motion detection method to detect whether they are moving.
[0066] Optionally, determining the second moment when the head-mounted display device displays the target image via the light sensor includes:
[0067] Determine the third moment when the optical sensor detects the target image;
[0068] The second time is determined based on the third time and the interrupt response time of the optical sensor, wherein the second time is the difference between the third time and the interrupt response time.
[0069] Optionally, determining the second moment when the head-mounted display device displays the target image via the light sensor includes:
[0070] Determine the third moment when the optical sensor detects the target image;
[0071] The second time is determined based on the third time, the interrupt response time of the light sensor, and the screen refresh cycle of the head-mounted display device, wherein the second time is the difference between the third time and the first sum, and the first sum is the sum of the interrupt response time and 0.5 times the screen refresh cycle.
[0072] This application also provides an electronic device, including a processor and a memory. The memory stores computer instructions. When the computer instructions are executed by the processor, they implement any one of the above-described test method embodiments for head-mounted display devices and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0073] This application also provides a storage medium storing computer instructions. When the computer instructions are executed by a processor, they implement any one of the above-described test method embodiments for the head-mounted display device and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0074] The various embodiments in this disclosure are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and apparatus embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0075] The foregoing has described specific embodiments of this disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired results. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0076] Embodiments of this disclosure may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the embodiments of this disclosure.
[0077] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.
[0078] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.
[0079] Computer program instructions used to perform the operations of embodiments of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on a user's computer, partially on a user's computer, as a standalone software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of embodiments of this disclosure.
[0080] Various aspects of embodiments of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0081] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0082] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0083] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are equivalent.
[0084] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. A testing system for head-mounted display devices, characterized in that, The testing system includes: A connecting mechanism is provided for rigidly connecting the detection device and the head-mounted display device so that the detection device and the head-mounted display device move synchronously, wherein the head-mounted display device displays a target image when motion is detected; The detection device includes an inertial measurement unit and an optical sensor. The detection device detects a first moment of motion of the detection device through the inertial measurement unit and a second moment of displaying a target image on the head-mounted display device through the optical sensor, and determines the difference between the second moment and the first moment as the MTP time of the head-mounted display device.
2. The testing system according to claim 1, characterized in that, The inertial measurement unit detects that the frequency of the motion of the detection device is greater than a first threshold.
3. The testing system according to claim 2, characterized in that, The head-mounted display and the detection device use the same motion detection method to detect whether they are moving.
4. The testing system according to claim 1, characterized in that, Detecting a second moment when the head-mounted display device displays the target image via the light sensor includes: Determine the third moment when the optical sensor detects the target image; The second time is determined based on the third time and the interrupt response time of the optical sensor, wherein the second time is the difference between the third time and the interrupt response time.
5. The testing system according to claim 1, characterized in that, Detecting a second moment when the head-mounted display device displays the target image via the light sensor includes: Determine the third moment when the optical sensor detects the target image; The second time is determined based on the third time, the interrupt response time of the light sensor, and the screen refresh cycle of the head-mounted display device, wherein the second time is the difference between the third time and the first sum, and the first sum is the sum of the interrupt response time and 0.5 times the screen refresh cycle.
6. A testing method for head-mounted display devices, characterized in that, The head-mounted display device is rigidly connected to the testing device and moves synchronously based on the rigid connection. The detection device includes an inertial measurement unit and a light sensor. The head-mounted display device displays a target image when motion is detected. The method includes: The first moment of motion of the detection device is determined by the inertial measurement unit; The second moment when the head-mounted display device displays the target image is determined by the light sensor; The difference between the second time point and the first time point is determined as the MTP time of the head-mounted display device.
7. The test method according to claim 6, characterized in that, The inertial measurement unit detects that the frequency of the motion of the detection device is greater than a first threshold.
8. The test method according to claim 7, characterized in that, The head-mounted display and the detection device use the same motion detection method to detect whether they are moving.
9. The test method according to claim 6, characterized in that, Determining the second moment when the head-mounted display device displays the target image via the light sensor includes: Determine the third moment when the optical sensor detects the target image; The second time is determined based on the third time and the interrupt response time of the optical sensor, wherein the second time is the difference between the third time and the interrupt response time.
10. The test method according to claim 6, characterized in that, The step of determining the second moment when the head-mounted display device displays the target image via the light sensor includes: Determine the third moment when the optical sensor detects the target image; The second time is determined based on the third time, the interrupt response time of the light sensor, and the screen refresh cycle of the head-mounted display device, wherein the second time is the difference between the third time and the first sum, and the first sum is the sum of the interrupt response time and 0.5 times the screen refresh cycle.