Method, device and equipment for measuring perspective time delay of video of head-mounted display equipment

Abstract

The invention provides a method, a device and equipment for measuring video perspective time delay of head-mounted display equipment, and relates to the technical field of performance optimization of the head-mounted display equipment, and the method comprises the steps: obtaining a first timestamp of an external flickering light source during each flickering within a preset duration through the head-mounted display equipment, obtaining a second timestamp of each flicker of the flicker light source on the head-mounted display device, wherein the flicker light source can be displayed for other continuously changing contents; calculating a time difference between the first timestamp and the second timestamp; and determining the video perspective time delay of the head-mounted display device according to the time difference. The technical effect of the invention is that the video perspective time delay of the head-mounted display device can be accurately measured.

Description

Technical Field

[0001] The present application relates to the technical field of head-mounted display device performance optimization, and in particular to a method, apparatus, device and storage medium for measuring video perspective delay of a head-mounted display device. Background Art

[0002] With the rapid development of virtual reality and augmented reality technologies, head-mounted display devices have been widely used in various application scenarios. However, in these devices, the accurate measurement and compensation of video perspective delay is a key technical issue to ensure user experience. Video perspective delay refers to the time delay from the camera capturing the real scene to the scene being displayed on the display. If the delay is too large, the virtual content will be out of sync with the real scene, causing discomfort to the user and even affecting the actual application effect.

[0003] In the prior art, in order to measure the video perspective delay of head-mounted display devices, a measurement method based on synchronization signals is usually used. These methods measure the delay by synchronizing external signals with internal signals of the device. Although they solve the measurement problem of video perspective delay to a certain extent, additional delays may be introduced during the transmission and processing of synchronization signals, thus affecting the accuracy of the measurement results. Summary of the invention

[0004] The present application provides a method, apparatus and device for measuring video perspective delay of a head-mounted display device, which are used to accurately measure the video perspective delay of a head-mounted display device.

[0005] In a first aspect, the present application provides a method for measuring the video perspective delay of a head-mounted display device, the method comprising: obtaining a first timestamp each time a flashing light source flashes within a preset duration, and obtaining a second timestamp each time the flashing light source appears on the head-mounted display device, where the flashing light source can be used to display other continuously changing content; calculating the time difference between the first timestamp and the second timestamp; and determining the video perspective delay of the head-mounted display device based on the time difference.

[0006] By adopting the above technical solution, the measurement deviation caused by human error or external interference can be effectively reduced through accurate timestamp recording. By using direct time difference calculation, the delay performance of the device can be quickly evaluated and real-time processing can be achieved. This not only helps to optimize the response speed of the device, but also provides accurate data support for further performance improvements, thereby accurately measuring the video perspective delay of the head-mounted display device.

[0007] Optionally, the flashing light source is controlled to change its state according to a preset frequency; a first time point when the flashing light source is in a preset state is obtained, and the first time point is recorded as a first timestamp; a display screen image of a head-mounted display device is obtained, and the state of the flashing light source in the display screen image is identified; a second time point when the state of the flashing light source in the display screen image changes to the preset state is obtained, and the second time point is recorded as a second timestamp.

[0008] By adopting the above technical solution, by controlling the flashing light source to change state according to a preset frequency, the first time point when the flashing light source is in a preset state is obtained, and it is recorded as the first timestamp. At the same time, the display screen image of the head-mounted display device is obtained, the state of the flashing light source therein is identified, the second time point when the state changes to the preset state is obtained, and it is recorded as the second timestamp. This process realizes the accurate measurement of the device delay. By controlling the flashing light source at a preset frequency, the regularity and predictability of the state change are ensured, thereby improving the accuracy of timestamp acquisition. Identifying the change of the light source state in the display screen image can accurately capture the second timestamp and reduce the influence of human errors and external interference.

[0009] Optionally, acquiring a display screen image of a head-mounted display device and identifying a state of the flickering light source in the display screen image includes: acquiring reference images of the flickering light source in different states; preprocessing the display screen image to identify and extract a focus area corresponding to the flickering light source; performing feature extraction on the image of the focus area to obtain a feature vector; calculating the similarity between the feature vector and a feature vector of the reference image of the flickering light source in different states to obtain a similarity score; and determining the state corresponding to the reference image with the highest similarity score as the state of the flickering light source in the display screen image.

[0010] By adopting the above technical solutions, background interference is reduced and recognition accuracy is improved through preprocessing and extraction of the focus area. Feature extraction and similarity calculation enable the system to effectively distinguish the subtle differences between different states, ensuring the accuracy of state recognition. This process has a high degree of automation, reducing the possibility of human interference and misjudgment, and ensuring the reliability of delay measurement data. Ultimately, the performance analysis capability of the equipment is improved, providing a solid data foundation for optimization and improvement, and improving user experience and the market competitiveness of the equipment.

[0011] Optionally, determining the video perspective delay of the head-mounted display device based on the time difference includes: performing statistical processing on the time difference to obtain a statistical characteristic value of the time difference, the statistical characteristic value including at least one of a maximum value, a minimum value, a median, and a standard deviation; determining the video perspective delay of the head-mounted display device based on the statistical characteristic value.

[0012] By adopting the above technical solution, the data distribution of time difference can be comprehensively analyzed through the calculation of statistical characteristic values. The maximum and minimum values ​​provide the extreme performance of delay, the median reflects the typical delay situation, and the standard deviation reveals the volatility of delay. This method effectively improves the accuracy and reliability of delay measurement. By comprehensively analyzing different statistical characteristic values, device performance can be more accurately evaluated, potential performance bottlenecks can be identified, and a clear direction can be provided for optimization.

[0013] Optionally, after determining the video perspective delay of the head-mounted display device, it also includes: comparing the video perspective delay with a preset threshold; if the video perspective delay is greater than the preset threshold, generating perspective delay abnormal prompt information; sending the perspective delay abnormal prompt information to the terminal device to prompt the user that the video perspective delay of the head-mounted display device exceeds the expected range.

[0014] By adopting the above technical solution, the device performance can be monitored in real time by comparing it with the preset threshold to ensure that it operates in an ideal state. The generation and transmission of abnormal prompt information enables users to detect performance problems in time and take corresponding measures to prevent the experience from being degraded.

[0015] Optionally, after determining the video perspective delay of the head-mounted display device, the method further includes: uploading the video perspective delay to a cloud server, and receiving a perspective delay compensation parameter updated by the cloud server for the head-mounted display device according to a preset strategy.

[0016] By adopting the above technical solution, by obtaining the first timestamp and the second timestamp and calculating the time difference, the multiple sets of time differences obtained can more accurately reflect the actual perspective delay. The method of dynamically adjusting the flicker frequency can effectively reduce the variance of the time difference and ensure the accuracy and reliability of the measurement results. On this basis, the video perspective delay data is uploaded to the cloud server, and the perspective delay compensation parameters updated according to the preset strategy are received, realizing comprehensive compensation and optimization of the video perspective delay.

[0017] Optionally, before obtaining the first timestamp of each flashing of the flashing light source within a preset duration, the method also includes: obtaining environmental parameters of the environment in which the head-mounted display device is located, the environmental parameters including at least one of ambient light intensity, ambient temperature and ambient humidity; judging whether the environmental parameters meet preset conditions, and if not, outputting environmental warning information, the warning information including information prompting the user to adjust the measurement environment.

[0018] By adopting the above technical solution, by obtaining the first timestamp and the second timestamp and calculating the time difference, the actual perspective delay can be reflected more accurately. The method of dynamically adjusting the flicker frequency is adopted to ensure the accuracy and reliability of the measurement results. On this basis, by real-time monitoring of environmental parameters and outputting early warning information, the environmental adaptability of the measurement process and the accuracy of the data are further guaranteed.

[0019] In a second aspect, the present application provides a device for measuring a video perspective delay of a head-mounted display device, the device comprising: an acquisition module, a calculation module and a determination module; wherein the acquisition module is used to obtain a first timestamp each time a flashing light source flashes within a preset duration, and to obtain a second timestamp each time the flashing light source flashes on the head-mounted display device, and the flashing light source can be other continuously changing content display; the calculation module is used to calculate the time difference between the first timestamp and the second timestamp; the determination module is used to determine the video perspective delay of the head-mounted display device based on the time difference.

[0020] In a third aspect, the present application provides an electronic device, adopting the following technical solution: including a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes a computer program such as any of the above-mentioned methods for measuring the video perspective delay of a head-mounted display device.

[0021] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution: storing a computer program that can be loaded by a processor and execute any of the above-mentioned methods for measuring video perspective delay of a head-mounted display device.

[0022] In summary, the present application includes at least one of the following beneficial technical effects: 1. Through accurate timestamp recording, measurement deviations caused by human error or external interference can be effectively reduced. Using direct time difference calculation, the latency performance of the device can be quickly evaluated and real-time processing can be achieved. This not only helps to optimize the response speed of the device, but also provides accurate data support for further performance improvements, thereby accurately measuring the video perspective latency of head-mounted display devices.

[0023] 2. By obtaining the first timestamp and the second timestamp and calculating the time difference, the actual perspective delay can be reflected more accurately. The method of dynamically adjusting the flicker frequency is adopted to ensure the accuracy and reliability of the measurement results. On this basis, by real-time monitoring of environmental parameters and output of early warning information, the environmental adaptability of the measurement process and the accuracy of the data are further guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a VST delay analysis system of an HMD provided in an embodiment of the present application; Figure 2 It is a flowchart of a method for measuring video perspective delay of a head mounted display device provided in an embodiment of the present application; Figure 3 It is a structural schematic diagram of a device for measuring video perspective delay of a head-mounted display device provided in an embodiment of the present application; Figure 4 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application.

[0025] Description of reference numerals: 1000, electronic device; 1001, processor; 1002, communication bus; 1003, user interface; 1004, network interface; 1005, memory. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0027] In the description of the embodiments of the present application, words such as "illustrative", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "illustrative", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "illustrative", "for example" or "for example" is intended to present related concepts in a concrete way.

[0028] Figure 1 It is a VST delay analysis system for an HMD provided in an embodiment of the present application; in the figure, the flashing light source can be a marquee, or it can be other continuously changing content display, and the marquee is used as an example for illustration. The HMD device is fixed on a simulation head, the position of the simulation head corresponds to two eyes, and the positions of the two eyes are respectively installed with a brightness sensor and a high-speed camera. The brightness sensor is used to detect ambient light, and the high-speed camera is used to capture the content on the display screen in real time.

[0029] When starting the test, the ticker changes at a frequency of at least 500Hz as a synchronization signal source. The drive command module controls the opening of the ticker and starts the camera to shoot the displayed content. The image analysis module records the images obtained by the camera and compares the timestamp of the ticker with the timestamp of the image data. By calculating the difference between the two, the VST delay of the HMD device is obtained, and finally the analysis report module outputs the results.

[0030] Each module is closely connected through the transmission of signals and data. The drive instruction module is responsible for synchronously starting the ticker and the camera, while the image analysis module processes the captured images and calculates the delay. This design ensures high-precision delay testing and can adjust the ticker frequency as needed to optimize the test results.

[0031] Figure 2 is a flow chart of a method for measuring the video perspective delay of a head mounted display device provided in an embodiment of the present application. It should be understood that although Figure 2 The steps in the flowchart are shown in sequence as indicated by the arrows, but the steps are not necessarily executed in the order indicated by the arrows; unless otherwise specified in this document, there is no strict order restriction for the execution of the steps, and the steps may be executed in other orders; and Figure 2 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0032] The present application discloses a method for measuring the video perspective delay of a head mounted display device, such as Figure 2 As shown, the method includes S101-S103.

[0033] S101, obtaining a first timestamp when a flashing light source flashes each time within a preset duration, and obtaining a second timestamp when each flash of the flashing light source appears on a head mounted display device.

[0034] In the process of measuring the video see-through (VST) latency of head-mounted display (HMD), flickering light source and head-mounted display are two key components. In order to better understand their role and how to use them, the following is a detailed explanation of these two parts.

[0035] A flashing light source refers to a light source device that can flash periodically at a high frequency. In this measurement process, the flashing light source (such as a marquee) acts as a synchronization signal source, providing a clear time reference point, and obtaining an accurate timestamp by recording its flashing moment. The flashing frequency of the flashing light source is usually set at at least 500HZ to ensure sufficient time resolution, thereby improving measurement accuracy. The flashing pattern of the flashing light source needs to be very stable and consistent to ensure that the timing of each flash is repeatable and predictable. In conjunction with a high-precision timer, it can accurately record the moment when each flash starts and provide the first timestamp.

[0036] A head-mounted display (HMD) is a display device worn on the head and is widely used in the fields of virtual reality (VR), augmented reality (AR) and mixed reality (MR). HMD displays virtual or enhanced environmental information to users through its display screen. HMD needs to display the external environment or virtual content in real time, so the latency (delay) of its display system is an important factor affecting the user experience. HMD is usually equipped with multiple functional modules such as cameras and sensors to achieve accurate environmental perception and user interaction.

[0037] In one example, by obtaining a first timestamp when a flashing light source flashes each time within a preset duration, and obtaining a second timestamp when each flash of the flashing light source appears on a head-mounted display device, the video see-through (VST) latency of the HMD device can be accurately measured. The specific implementation steps are as follows: First, the HMD device under test is fixed on the head model of the test bench, and a brightness sensor and a high-speed camera are installed at the positions of the two eyes of the simulation head. Then, the test is started in the analysis system, and the start of the marquee is controlled by the drive instruction module. The marquee flashes frequently at a frequency of at least 500Hz, and the start time of each flash is the first timestamp. In order to ensure the accuracy of the acquired timestamp, a high-precision timer is used for recording.

[0038] At the same time, the high-speed camera starts to shoot the screen display content of the HMD device, and the image analysis module records the time when each time the marquee flashes on the HMD screen, which is the second timestamp. The image analysis module compares the captured image frame with the preset flashing pattern to accurately identify the time when each flash occurs, thereby obtaining the second timestamp.

[0039] Based on the above embodiment, as an optional implementation manner, obtaining a second timestamp of each flash of the flashing light source appearing on the head mounted display device specifically includes S10-S13: S10, controlling the flashing light source to change state according to a preset frequency.

[0040] In one example, you first need to set the frequency of the flashing light source so that it switches states steadily at a certain time interval. A control module can be used to manage the on-off cycle of the light source, ensuring that the light source accurately records timestamps at the beginning and end of each cycle. At this point, the image captured by the head-mounted display device's camera will show the changing state of the light source.

[0041] S11, obtaining a first time point when the flashing light source is in a preset state, and recording the first time point as a first timestamp.

[0042] In one example, the state change of a light source is monitored. When the light source reaches a preset state (such as from off to on), the moment is immediately recorded as the first timestamp. This process detects the state of the light source through a sensor and synchronizes it with a timer to ensure that the recorded time point has high accuracy and reliability.

[0043] S12, obtaining a display screen image of the head mounted display device, and identifying a state of a flickering light source in the display screen image.

[0044] In one example, a high-speed camera is required to continuously capture the display screen of a head-mounted display device. The camera needs to have a high frame rate to ensure that no changes in the flickering state are missed. The image analysis module then processes the acquired image sequence. This module analyzes each frame of the image using advanced image processing algorithms to identify changes in the state of the flickering light source.

[0045] The recognition process involves comparing each frame of the image with the preset flicker pattern, extracting the characteristic information in the image, and determining whether the light source is turned on. Through this analysis, the time point when each flicker appears on the display can be accurately recorded, that is, the second timestamp.

[0046] Based on the above embodiment, as an optional implementation manner, in S12, obtaining a display screen image of a head mounted display device, and identifying a state of a flashing light source in the display screen image specifically includes: Acquire reference images of a flickering light source in different states; preprocess the display screen image to identify and extract a focus area corresponding to the flickering light source; perform feature extraction on the image of the focus area to obtain a feature vector; calculate the similarity between the feature vector and the feature vector of the reference image of the flickering light source in different states to obtain a similarity score; determine the state corresponding to the reference image with the highest similarity score as the state of the flickering light source in the display screen image.

[0047] In this optional embodiment, step S12 is further detailed to improve the accuracy of identifying the state of the flickering light source in the display screen image. By acquiring reference images of the flickering light source in different states and performing multi-step image processing and similarity calculation, the state of the light source can be determined more accurately.

[0048] First, obtaining reference images of the flickering light source in various states is to provide a benchmark to make subsequent state recognition more reliable. The reference image contains the visual features of the light source in different states as the basis for comparison.

[0049] Next, the display image is preprocessed, which includes identifying and extracting the region of interest corresponding to the flickering light source. The preprocessing step ensures that only the relevant part of the image is analyzed, reducing noise and interference, and improving recognition accuracy.

[0050] Then, feature extraction is performed on the extracted area of ​​interest to generate a feature vector. This step uses image processing algorithms to extract key visual features and form a feature vector for comparison. A feature vector is a set of numbers that represents an abstract representation of key features in an image. It is used to capture and describe key information of an image, such as edges, colors, textures, etc. By converting an image into a feature vector, efficient comparison and recognition can be performed to help determine the object or state in the image.

[0051] Afterwards, the similarity between the feature vector and the feature vector of the reference image under different states of the flickering light source is calculated to obtain a similarity score. Through this similarity analysis, the similarity between the display screen image and the reference image can be quantified.

[0052] Finally, the state corresponding to the reference image with the highest similarity score is determined as the state of the flickering light source in the display screen image. This method ensures the accuracy of state recognition because the reference state that is most similar to the current image is selected.

[0053] S13, obtaining a second time point when the state of the flashing light source in the display screen image changes to a preset state, and recording the second time point as a second timestamp.

[0054] In one example, a high-speed camera is used to continuously shoot the display screen of a head-mounted display device. The image analysis module processes these images and identifies changes in the state of the light source by comparing each frame with a preset flickering pattern. The recognition process relies on an image processing algorithm that can quickly extract feature information in the image to determine whether the light source has reached a preset state (such as from off to on). When the light source state changes to a preset state, the preset state generally refers to a specific state of the flickering light source, such as from off to on or from on to off. This is a known and stable state used to mark the time point for subsequent delay calculations, and the moment is recorded as a second timestamp. This recording process needs to be synchronized with the first timestamp to ensure the accuracy and consistency of the time point.

[0055] S102: Calculate the time difference between the first timestamp and the second timestamp.

[0056] In one example, a preset flashing light source flashes multiple times within a predetermined time period, and a first timestamp is recorded each time it flashes, the first timestamp indicating a light signal emitted by the flashing light source at a specific time point. At the same time, a camera on a head mounted display device (HMD) captures an image of the flashing light source and displays it on a display screen, and a second timestamp is recorded, the second timestamp indicating the time point when the image of the flashing light source appears on the HMD display screen.

[0057] Next, the time difference of each flash is calculated by subtracting the corresponding first time stamp from the second time stamp of each flash. These time differences reflect the delay time from the flashing light source emitting a light signal to the HMD display screen displaying the signal.

[0058] VST latency refers to the delay in the entire process from when the real-world image is captured by the camera, processed, and displayed on the HMD. Excessive VST latency will cause the virtual content in augmented reality (AR) to not match the dynamics of the real world, affecting the user experience. By calculating multiple sets of time differences, detailed data on VST latency can be obtained, providing an important basis for optimizing the hardware and software of the HMD.

[0059] During the specific operation, the HMD device needs to be equipped with a high-precision timestamp recording system to ensure that the first and second timestamps of each flash are recorded accurately. In addition, the flashing light source used should have a stable flashing frequency and intensity to ensure the reliability and consistency of each measurement. By statistically analyzing multiple groups of time differences, key parameters such as the average, maximum, and minimum values ​​of the VST delay can be obtained. These parameters can not only reflect the performance of the current HMD device, but also guide subsequent optimization work.

[0060] S103: Determine a video perspective delay of the head mounted display device according to the time difference.

[0061] In one example, the video see-through latency of a head-mounted display device is determined based on the time difference, which is the ultimate goal of the entire measurement process. By accurately calculating the time difference from the flashing of a light source to the appearance of its image on the display, the latency performance of the device can be accurately evaluated.

[0062] In the specific implementation, first obtain the first timestamp and the second timestamp recorded previously. The first timestamp marks the moment when the flashing light source reaches a preset state, and the second timestamp records the moment when the state is recognized on the display screen. By calculating the difference between the two timestamps, the video perspective delay of the device can be obtained.

[0063] This calculation process requires high-precision time synchronization and recording mechanisms to ensure the accuracy of the time difference. The use of high-precision timers and synchronization algorithms can effectively reduce errors and ensure the reliability of measurement results.

[0064] The effect of this is to provide an accurate video perspective latency value, allowing device manufacturers to identify and optimize system latency. This is critical to improving the real-time performance of devices, ultimately improving the smoothness and naturalness of the user experience. Accurate latency measurements can also be used to debug and improve device designs to ensure their optimal performance in a variety of usage scenarios.

[0065] Based on the above embodiment, as an optional implementation, in S103, the video perspective delay of the head-mounted display device is determined according to the time difference, including: performing statistical processing on the time difference to obtain a statistical characteristic value of the time difference, the statistical characteristic value including at least one of a maximum value, a minimum value, a median, and a standard deviation; determining the video perspective delay of the head-mounted display device according to the statistical characteristic value.

[0066] In one example, in step S103, statistical processing is performed on the time difference to more comprehensively determine the video perspective delay of the head mounted display device. This method can provide richer data analysis and help optimize device performance.

[0067] In the specific implementation, firstly, the time difference data of the state changes of multiple flashing light sources are collected. These data come from multiple measurements to ensure the representativeness and accuracy of the sample. Then, these time differences are statistically processed to calculate their statistical characteristic values, including at least one of the maximum value, minimum value, median and standard deviation.

[0068] By calculating the maximum and minimum values, we can understand the upper and lower limits of system latency; the median provides the central trend of the data, and the standard deviation reflects the degree of dispersion of the data. These statistical characteristic values ​​provide an important basis for analyzing the latency performance of the device under different conditions.

[0069] Based on these statistical feature values, the video perspective latency can be determined more accurately. For example, the median may represent the latency under typical usage, while the maximum and standard deviation can help identify potential performance bottlenecks or instabilities.

[0070] After determining the video perspective delay of the head-mounted display device, it also includes: comparing the video perspective delay with a preset threshold; if the video perspective delay is greater than the preset threshold, generating perspective delay abnormal prompt information; sending the perspective delay abnormal prompt information to the terminal device to prompt the user that the video perspective delay of the head-mounted display device exceeds the expected range.

[0071] In one example, video see-through latency of a head mounted display device is determined and subsequently processed to ensure the device operates within an expected performance range.

[0072] First, the video perspective delay of the device is obtained by calculating the time difference between two timestamps. Then, these time differences are statistically processed to calculate the maximum value, minimum value, median and standard deviation. This allows a comprehensive evaluation of the device's delay characteristics.

[0073] Once the video perspective delay is determined, it is compared to a preset threshold. This threshold is set based on performance requirements and user experience standards and represents the maximum delay that the system can accept. If the video perspective delay exceeds the preset threshold, a perspective delay anomaly prompt message is generated. This information is used to notify the user that there may be performance issues with the device and that attention should be paid.

[0074] Subsequently, the abnormal prompt information is sent to the user through the communication module of the terminal device. This instant feedback mechanism ensures that the user can receive the warning information in time and take prompt measures to avoid affecting the user experience due to excessive delay.

[0075] After determining the video perspective delay of the head mounted display device, the method further includes: uploading the video perspective delay to a cloud server, and receiving the perspective delay compensation parameter updated by the cloud server for the head mounted display device according to a preset strategy.

[0076] In one example, after determining the video perspective delay of the head-mounted display device, it also includes uploading and parameter updating to optimize the device performance. First, the calculated video perspective delay is uploaded to the cloud server through a network connection. The cloud server has powerful data processing capabilities and can centrally analyze data from a large number of devices. After uploading the data, the cloud server processes the delay data according to preset strategies. These strategies may include machine learning algorithms or big data analysis to identify optimization space for device performance. Subsequently, the cloud server generates updated perspective delay compensation parameters. These parameters are designed to adjust the delay performance of the device to make it closer to the ideal state. Then, the device receives the updated compensation parameters from the cloud server and automatically applies them to the system.

[0077] Before obtaining the first timestamp of each flashing of the flashing light source within a preset duration, the method further includes: Obtain environmental parameters of the environment in which the head mounted display device is located, the environmental parameters including at least one of ambient light intensity, ambient temperature and ambient humidity; determine whether the environmental parameters meet preset conditions, and if not, output environmental warning information, the warning information including information prompting the user to adjust the measurement environment.

[0078] In one example, before obtaining the first timestamp of each flash of the flashing light source, the environmental parameters of the environment in which the head-mounted display device is located need to be obtained. These parameters include at least one of ambient light intensity, ambient temperature, and ambient humidity. This step is to ensure the stability and accuracy of the measurement conditions. First, use environmental sensors to collect light intensity, temperature, and humidity data of the current environment. These data help determine whether the environment is suitable for accurate delay measurement. Next, compare the obtained environmental parameters with the preset conditions. The preset conditions are based on the device's usage specifications and measurement accuracy requirements to ensure that environmental factors do not interfere with the measurement results.

[0079] If the environmental parameters do not meet the preset conditions, an environmental warning message is generated and output. This message contains suggestions to guide the user to adjust the measurement environment, such as adjusting the light, temperature or humidity, to achieve ideal measurement conditions.

[0080] By following these steps, you can ensure the suitability of the measurement environment and reduce the interference of external factors on the measurement results. This not only improves the accuracy of latency measurement, but also provides a more reliable basis for evaluating and optimizing device performance. By adjusting environmental conditions in a timely manner, users can obtain more accurate device performance data and improve the overall user experience.

[0081] Based on the above method, the present application also discloses a device for measuring the video perspective delay of a head mounted display device, such as Figure 3 As shown, Figure 3 1 is a schematic diagram of the structure of a device for measuring a video perspective delay of a head-mounted display device provided in an embodiment of the present application, the device comprising: an acquisition module, a calculation module and a determination module; wherein the acquisition module is used to obtain a first timestamp when a flickering light source flickers each time within a preset duration, and to obtain a second timestamp when each flicker of the flickering light source appears on the head-mounted display device; the calculation module is used to calculate a time difference between the first timestamp and the second timestamp; and the determination module is used to determine the video perspective delay of the head-mounted display device according to the time difference.

[0082] In one example, the acquisition module is also used to control the flashing light source to change its state according to a preset frequency; obtain the first time point when the flashing light source is in the preset state, and record the first time point as a first timestamp; obtain a display screen image of the head-mounted display device, and identify the state of the flashing light source in the display screen image; obtain the second time point when the state of the flashing light source in the display screen image changes to the preset state, and record the second time point as a second timestamp.

[0083] In one example, the acquisition module is also used to acquire reference images of the flickering light source in different states; preprocess the display screen image to identify and extract the focus area corresponding to the flickering light source; perform feature extraction on the image of the focus area to obtain a feature vector; calculate the similarity between the feature vector and the feature vector of the reference image of the flickering light source in different states to obtain a similarity score; and determine the state corresponding to the reference image with the highest similarity score as the state of the flickering light source in the display screen image.

[0084] In one example, the determination module is also used to perform statistical processing on the time difference to obtain a statistical characteristic value of the time difference, wherein the statistical characteristic value includes at least one of a maximum value, a minimum value, a median, and a standard deviation; based on the statistical characteristic value, the video perspective delay of the head-mounted display device is determined.

[0085] In one example, the above-mentioned device is also used to compare the video perspective delay with a preset threshold; if the video perspective delay is greater than the preset threshold, a perspective delay abnormality prompt information is generated; the perspective delay abnormality prompt information is sent to the terminal device to prompt the user that the video perspective delay of the head-mounted display device exceeds the expected range.

[0086] In one example, the above-mentioned device is also used to upload the video perspective delay to a cloud server, and the cloud server updates the perspective delay compensation parameters for the head-mounted display device according to a preset strategy.

[0087] In one example, the above-mentioned device is also used to obtain environmental parameters of the environment in which the head-mounted display device is located, and the environmental parameters include at least one of ambient light intensity, ambient temperature and ambient humidity; determine whether the environmental parameters meet preset conditions, and if the preset conditions are not met, output environmental warning information, and the warning information includes information prompting the user to adjust the measurement environment.

[0088] It should be noted that: when the device provided in the above embodiment realizes its function, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0089] See also Figure 4 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown, the electronic device 1000 may include: at least one processor 1001 , at least one network interface 1004 , a user interface 1003 , a memory 1005 , and at least one communication bus 1002 .

[0090] The communication bus 1002 is used to realize the connection and communication between these components.

[0091] The user interface 1003 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 1003 may also include a standard wired interface and a wireless interface.

[0092] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0093] Among them, the processor 1001 may include one or more processing cores. The processor 1001 uses various interfaces and lines to connect various parts in the entire server, and executes various functions of the server and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 1005, and calling data stored in the memory 1005. Optionally, the processor 1001 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1001 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1001, and it can be implemented separately through a chip.

[0094] Among them, the memory 1005 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1005 may optionally also be at least one storage device located away from the aforementioned processor 1001. As Figure 4 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for a method for measuring a video perspective delay of a head mounted display device.

[0095] exist Figure 4In the electronic device 1000 shown, the user interface 1003 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 1001 can be used to call an application program stored in the memory 1005 for a method for measuring the video perspective delay of a head-mounted display device. When executed by one or more processors, the electronic device executes one or more of the methods described in the above embodiments.

[0096] An electronic device readable storage medium stores instructions, which, when executed by one or more processors, enable the electronic device to execute one or more of the methods described in the above embodiments.

[0097] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for the present application.

[0098] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0099] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0100] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0101] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0102] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, mobile hard drives, magnetic disks or optical disks.

[0103] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of other embodiments of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are only regarded as exemplary, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A method for measuring video perspective delay of a head mounted display device, characterized in that: The method comprises: Obtaining a first timestamp when a flashing light source flashes each time within a preset duration, and obtaining a second timestamp when each flash of the flashing light source appears on a head mounted display device, wherein the flashing light source may be other continuously changing content display; Calculating a time difference between the first timestamp and the second timestamp; A video perspective delay of the head mounted display device is determined according to the time difference.

2. The method for measuring the video perspective delay of a head mounted display device according to claim 1, characterized in that: The step of obtaining a second timestamp of each flash of the flashing light source occurring on the head mounted display device comprises: Controlling the flashing light source to change state according to a preset frequency; Acquire a first time point at which the flashing light source is in a preset state, and record the first time point as a first timestamp; Acquire a display screen image of a head mounted display device, and identify a state of the flashing light source in the display screen image; A second time point at which the state of the flashing light source in the display screen image changes to the preset state is acquired, and the second time point is recorded as a second timestamp.

3. The method for measuring the video perspective delay of a head mounted display device according to claim 2, characterized in that: The acquiring a display screen image of a head mounted display device and identifying a state of the flashing light source in the display screen image includes: Acquire reference images of the scintillation light source in different states; Preprocessing the display screen image to identify and extract the focus area corresponding to the flickering light source; Extracting features from the image of the focus area to obtain a feature vector; Calculating the similarity between the feature vector and the feature vector of the reference image of the flickering light source in different states to obtain a similarity score; The state corresponding to the reference image with the highest similarity score is determined as the state of the flashing light source in the display screen image.

4. The method for measuring the video perspective delay of a head mounted display device according to claim 1, characterized in that: Determining the video perspective delay of the head mounted display device according to the time difference includes: Performing statistical processing on the time difference to obtain a statistical characteristic value of the time difference, wherein the statistical characteristic value includes at least one of a maximum value, a minimum value, a median, and a standard deviation; The video perspective delay of the head mounted display device is determined according to the statistical characteristic value.

5. The method for measuring the video perspective delay of a head mounted display device according to claim 1, characterized in that: After determining the video perspective delay of the head mounted display device, the method further includes: Comparing the video perspective delay with a preset threshold; If the video perspective delay is greater than the preset threshold, generating perspective delay abnormal prompt information; The perspective delay abnormal prompt information is sent to the terminal device to prompt the user that the video perspective delay of the head-mounted display device exceeds the expected range.

6. The method for measuring the video perspective delay of a head mounted display device according to claim 1, characterized in that: After determining the video perspective delay of the head mounted display device, the method further includes: The video perspective delay is uploaded to a cloud server, and the cloud server updates the perspective delay compensation parameters for the head mounted display device according to a preset strategy.

7. The method for measuring the video perspective delay of a head mounted display device according to claim 1, characterized in that: Before obtaining the first timestamp of each flashing of the flashing light source within the preset duration, the method further includes: Acquire environmental parameters of the environment in which the head mounted display device is located, where the environmental parameters include at least one of ambient light intensity, ambient temperature, and ambient humidity; It is determined whether the environmental parameters meet the preset conditions. If the preset conditions are not met, an environmental warning message is output, wherein the warning message includes information prompting the user to adjust the measurement environment.

8. A device for measuring the perspective delay of a head mounted display device, characterized in that: The device comprises: an acquisition module, a calculation module and a determination module; wherein, The acquisition module is used to acquire a first timestamp when a flashing light source flashes each time within a preset duration, and to acquire a second timestamp when each flash of the flashing light source appears on a head mounted display device. The flashing light source may be other continuously changing content display; The calculation module is used to calculate the time difference between the first timestamp and the second timestamp; The determination module is used to determine the video perspective delay of the head mounted display device according to the time difference.

9. An electronic device, characterized in that: It includes a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes the method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 7.

Images