Delay test method and system for MR all-in-one machine

Abstract

The invention provides a delay test method for an MR all-in-one machine, and the method comprises the steps: setting a signal source capable of triggering color change in a darkroom environment, and enabling the signal source and the MR all-in-one machine to be located in the same shooting field of view; the high-speed camera is started, the frame rate is set to be not lower than 1000 fps, and the high-speed camera is used for synchronously recording the signal source color switching process and the content displayed on the screen of the MR all-in-one machine; analyzing a start frame of signal source color change of the recorded high-frame-rate video frame by frame and an end frame of color display corresponding to the screen of the MR all-in-one machine, and calculating the delay time of the MR all-in-one machine according to the number of frames between the start frame and the end frame and the frame rate of the high-speed camera; and performing multi-scene repetition and averaging processing. The method has the beneficial effect that the delay of the whole link of the MR all-in-one machine can be accurately and objectively measured.

Description

Technical Field

[0001] This invention relates to the field of delay testing technology, and in particular to a delay testing method for an MR all-in-one machine. Background Technology

[0002] MR (Mixed Reality) all-in-one devices are wearable devices that deeply integrate virtual content with the real environment. Unlike purely virtual MR or simple AR overlays, they enable real-time interaction and spatial anchoring between virtual and real objects. These devices have built-in computing units and can operate independently without connecting to a mobile phone or PC, hence the name "all-in-one device".

[0003] MR all-in-one machines integrate virtual reality (VR) and augmented reality (AR) functions, and the real-time performance of their video see-through (VST) and projection functions is a key indicator affecting user experience. Currently, tests for VST and projection latency mostly rely on subjective evaluation or partial link measurements, both of which have limitations, such as: 1. Subjective judgment method: It relies on the tester's personal perception, cannot provide objective and quantitative data, and the results vary from person to person with poor repeatability.

[0004] 2. Timing-based testing: This method measures the time consumption of a portion of the process by inserting timestamps at the application or system layer. However, this method typically cannot cover the entire chain from the generation of physical motion signals to the final on / off state of pixels, and it is particularly difficult to accurately capture the final display time on the screen. Therefore, it is not a purely end-to-end latency measurement.

[0005] 3. IMU Data Calculation Method: This method approximates the latency by monitoring the time it takes for inertial measurement unit (IMU) data to change. This method primarily measures the time from hardware motion to IMU data reporting, but it does not include the latency generated by subsequent critical processes such as attitude prediction, six-degree-of-freedom (6DOF) localization, data fusion, rendering pipeline, post-processing, and final on-screen display.

[0006] Existing testing methods struggle to fully and accurately cover the entire latency chain, leading to discrepancies between measurement results and the actual latency perceived by users. While some existing technologies offer testing solutions for motion latency in MR devices, they do not cover latency scenarios based on external visual signal input, such as VST and screen projection. Furthermore, they lack a unified and reusable testing system and an objective, end-to-end, quantifiable testing method. Therefore, there is an urgent need for a testing method capable of accurately and objectively measuring the entire latency chain of an MR all-in-one device. Summary of the Invention

[0007] To address the problems in existing technologies, this invention provides a latency testing method for MR all-in-one machines. By setting up a test environment, synchronously triggering and recording signals, analyzing videos and calculating latency, and performing repeated and averaging tests on multiple scenes, this method can accurately and objectively measure the latency of the entire MR all-in-one machine. This solves the problems of lack of objective quantification, incomplete test links, and inconsistent test methods in existing technologies for latency testing of MR all-in-one machines.

[0008] The delay testing method for an MR all-in-one machine of the present invention includes the following steps: Step 1: Set up the test environment. In a dark room, set up a signal source that can trigger color changes and place it in the same shooting field of view as the MR all-in-one machine. For the VST latency test, fix the signal source with a tripod and let its light spot cover the VST camera of the MR all-in-one machine. For the screen projection latency test, the signal source is a monitor, which displays a solid color image and establishes a screen projection connection with the MR all-in-one machine. Step 2, Signal Synchronization Triggering and Recording: Start the high-speed camera, set the frame rate to no less than 1000fps, adjust the shooting angle to simultaneously capture the color change of the signal source and the content displayed on the MR all-in-one machine screen, trigger the signal source color switching through external control, and continuously record video during the switching process by the high-speed camera. Use the high-speed camera to synchronously record the signal source color switching process and the content displayed on the MR all-in-one machine screen. Step 3, Video Analysis and Delay Calculation: Import the recorded high frame rate video into the video analysis tool. Analyze the starting frame of the signal source color change and the ending frame of the corresponding color display on the MR all-in-one machine screen frame by frame. Calculate the delay time of the MR all-in-one machine based on the number of frames between the starting and ending frames and the frame rate of the high-speed camera. Step 4: Repeat and average the test in multiple scenarios. Repeat the above test in full brightness, full darkness or different screen casting modes. Perform each color test at least 5 times and take the average value as the final delay result.

[0009] The present invention is further improved in that, in step 1, the signal source is an RGB tri-color LED or a high refresh rate PC monitor. The RGB tri-color LED is used for VST latency testing, and the high refresh rate PC monitor is used for screen projection latency testing.

[0010] In a further improvement to the present invention, during the VST latency test, the MR all-in-one machine needs to enable the VST function and adjust it to the highest brightness.

[0011] In a further improvement to this invention, during the screen projection latency test, the MR all-in-one machine and the PC need to establish a wired or wireless screen projection connection, and the frame rate of the high-speed camera is not less than 1000fps.

[0012] The present invention is further improved in that, in step 3, the formula for calculating the delay time of the MR all-in-one machine is: delay time T = N / F, where N is the number of frames between the start frame and the end frame, and F is the frame rate of the high-speed camera.

[0013] In a further improvement to this invention, in step 3, the video frame-by-frame analysis is performed using a tool that supports frame-by-frame playback, and the start and end frames are located using shortcut keys.

[0014] The present invention also provides a system for implementing the testing method described in any of the above claims, characterized in that it comprises: A signal generator used to generate color switching signals; A high-speed camera device is used to simultaneously record signals with the MR all-in-one machine screen; A mounting device for stably placing the signal source and the MR unit; A screen projection connection device is used to establish a screen projection connection between the MR all-in-one machine and the display. Video analytics device used to calculate latency.

[0015] The beneficial effects of this invention are as follows: The latency testing method for an MR all-in-one machine provided by this invention, through test environment setup, test program deployment, synchronous recording, and latency analysis, can accurately and objectively measure the latency of the entire MR all-in-one machine link, completely covering the entire MR display link, realizing true end-to-end latency measurement, and the results are more consistent with the user's actual perception; it can quantify the performance of VST, measure the VST latency of competing machines, and form data comparison. This method can be used to design a latency testing method for MR projection, which is cost-controllable, has a clear process, and is easy to implement and promote. It solves the problems of lack of objective quantification, incomplete test link, and inconsistent test methods in the latency testing of MR all-in-one machines in the prior art. Attached Figure Description

[0016] Figure 1 This is a flowchart of a delay testing method for an MR all-in-one machine according to the present invention. Detailed Implementation

[0017] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments.

[0018] Please see Figure 1 The delay testing method for an MR all-in-one machine of the present invention includes the following steps: Step 1: Test Environment Setup. In a darkroom environment, set up a signal source that can trigger color changes, placing it in the same field of view as the MR all-in-one device. For the VST latency test, fix the signal source with a tripod, ensuring its light spot covers the VST camera of the MR all-in-one device. For the screen projection latency test, the signal source is a monitor displaying a solid color image and establishing a screen projection connection with the MR all-in-one device. The signal source can be an RGB tri-color LED or a high refresh rate PC monitor; the RGB tri-color LED is used for the VST latency test, and the high refresh rate PC monitor is used for the screen projection latency test. In the VST latency test, the MR all-in-one device needs to have its VST function enabled and adjusted to maximum brightness. In the screen projection latency test, the MR all-in-one device and the PC need to establish a wired or wireless screen projection connection, and the high-speed camera's frame rate should be no less than 1000fps.

[0019] Step 2, Signal Synchronization Triggering and Recording: Start the high-speed camera, set the frame rate to no less than 1000fps, adjust the shooting angle to simultaneously capture the color change of the signal source and the content displayed on the MR all-in-one machine screen, trigger the color switching of the signal source through external control, and continuously record video during the switching process using the high-speed camera. Use the high-speed camera to synchronously record the color switching process of the signal source and the content displayed on the MR all-in-one machine screen.

[0020] Step 3, Video Analysis and Latency Calculation: Import the recorded high frame rate video into a video analysis tool. Analyze the video frame by frame, comparing the starting frame (where the signal source's color changes) with the ending frame (where the corresponding color is displayed on the MR all-in-one machine's screen). Calculate the MR all-in-one machine's latency based on the number of frames between the starting and ending frames and the high-speed camera's frame rate. The formula for calculating the MR all-in-one machine's latency is: Latency T = N / F, where N is the number of frames between the starting and ending frames, and F is the high-speed camera's frame rate. Frame-by-frame video analysis is performed using a tool that supports frame-by-frame playback, with the starting and ending frames located via keyboard shortcuts.

[0021] Step 4: Repeat and average the test in multiple scenarios. Repeat the above test in full brightness, full darkness, or different projection modes. Each color test should be performed at least 5 times, and the average value is taken as the final latency result. In this embodiment, for the VST latency test, fix the MR all-in-one machine (such as EM_A863) on a horizontal frame and adjust the RGB three-color lights so that their light spots cover the front camera of the device. Enable the VST function and set the system to the highest brightness. Use a high-speed camera (1000fps) to aim at the lights and the screen, manually switch the RGB light colors, record the video, and then use PotPlayer to analyze frame by frame to calculate the frame difference from the light color change to the corresponding color displayed on the screen, and calculate the latency according to the formula. For the projection latency test, establish a projection connection between the MR all-in-one machine and a high refresh rate PC through VisionCast software. The PC cycles through red, green, and blue pure color images, and the high-speed camera simultaneously records the PC monitor and the MR all-in-one machine screen. During video analysis, start with the first frame of the color change on the PC screen and end with the first frame of the color synchronously displayed on the MR all-in-one machine screen, calculate the frame difference and convert it into latency. It can accurately and objectively measure the latency of the entire MR all-in-one machine, fully covering the entire MR display link, realizing true end-to-end latency measurement, and the results are more consistent with the user's actual perception; it can quantify the performance of VST, measure the VST latency of competing machines, form data comparison, and this method can be used to design latency testing methods for MR projection, which are cost-controllable, have a clear process, and are easy to implement and promote.

[0022] Please see Figure 1 The present invention also provides a system for implementing the testing method of any of the above claims, characterized in that it includes: A signal generator used to generate color switching signals; A high-speed camera device is used to simultaneously record signals with the MR all-in-one machine screen; A mounting device for stably placing the signal source and the MR unit; A screen projection connection device is used to establish a screen projection connection between the MR all-in-one machine and the display. Video analytics device used to calculate latency.

[0023] As can be seen from the above, the beneficial effects of the present invention are as follows: The latency testing method for an MR all-in-one machine provided by the present invention, through test environment setup, test program deployment, synchronous recording, and latency analysis, can accurately and objectively measure the latency of the entire MR all-in-one machine link, completely covering the entire MR display link, realizing true end-to-end latency measurement, and the results are more consistent with the user's actual perception; it can quantify the performance of VST, measure the VST latency of competing machines, and form data comparison. This method can be used to design a latency testing method for MR projection, which is cost-controllable, has a clear process, and is easy to implement and promote. It solves the problems of lack of objective quantification, incomplete test link, and inconsistent test methods in the latency testing of MR all-in-one machines in the prior art.

[0024] The specific embodiments described above are preferred embodiments of the present invention and are not intended to limit the specific scope of the present invention. The scope of the present invention includes, but is not limited to, these specific embodiments. All equivalent changes made in accordance with the present invention are within the protection scope of the present invention.

Claims

1. A delay testing method for an MR all-in-one machine, characterized in that, Includes the following steps: Step 1: Set up the test environment. In a dark room, set up a signal source that can trigger color changes and place it in the same shooting field of view as the MR all-in-one machine. For the VST latency test, fix the signal source with a tripod and let its light spot cover the VST camera of the MR all-in-one machine. For the screen projection latency test, the signal source is a monitor, which displays a solid color image and establishes a screen projection connection with the MR all-in-one machine. Step 2, Signal Synchronization Triggering and Recording: Start the high-speed camera, set the frame rate to no less than 1000fps, adjust the shooting angle to simultaneously capture the color change of the signal source and the content displayed on the MR all-in-one machine screen, trigger the signal source color switching through external control, and continuously record video during the switching process by the high-speed camera. Use the high-speed camera to synchronously record the signal source color switching process and the content displayed on the MR all-in-one machine screen. Step 3, Video Analysis and Delay Calculation: Import the recorded high frame rate video into the video analysis tool. Analyze the starting frame of the signal source color change and the ending frame of the corresponding color display on the MR all-in-one machine screen frame by frame. Calculate the delay time of the MR all-in-one machine based on the number of frames between the starting and ending frames and the frame rate of the high-speed camera. Step 4: Repeat and average the test in multiple scenarios. Repeat the above test in full brightness, full darkness or different screen casting modes. Perform each color test at least 5 times and take the average value as the final delay result.

2. The delay testing method for the MR all-in-one machine as described in claim 1, characterized in that: In step 1, the signal source is an RGB tri-color LED or a high refresh rate PC monitor. The RGB tri-color LED is used for VST latency testing, and the high refresh rate PC monitor is used for screen projection latency testing.

3. The delay testing method for the MR all-in-one machine as described in claim 2, characterized in that: In the VST latency test, the MR all-in-one machine needs to enable the VST function and adjust to the highest brightness.

4. The delay test method for the MR all-in-one machine as described in claim 3, characterized in that: In the screen projection latency test, the MR all-in-one machine and the PC need to establish a wired or wireless screen projection connection, and the frame rate of the high-speed camera is not less than 1000fps.

5. The delay test method for the MR all-in-one machine as described in claim 4, characterized in that: In step 3, the formula for calculating the delay time of the MR all-in-one machine is: delay time T = N / F, where N is the number of frames between the start frame and the end frame, and F is the frame rate of the high-speed camera.

6. The delay testing method for the MR all-in-one machine as described in claim 5, characterized in that: In step 3, the video is analyzed frame by frame using a tool that supports frame-by-frame playback, and the start and end frames are located using shortcut keys.

7. A system for implementing the test method as described in any one of claims 1 to 6, characterized in that, include: A signal generator used to generate color switching signals; A high-speed camera device is used to simultaneously record signals with the MR all-in-one machine screen; A mounting device for stably placing the signal source and the MR unit; A screen projection connection device is used to establish a screen projection connection between the MR all-in-one machine and the display. Video analytics device used to calculate latency.

Images