Method, device and system for detecting device delay

Abstract

The present application relates to a method, device, and system for detecting device delay. The method includes: receiving a detection signal, where the detection signal is a level signal triggered by a measured device and a sensing device according to a test frame sequence, and the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, and M is an integer greater than 1; when the detection signal is a test level signal sent by the measured device, determining a first playback time according to the test level signal; when the detection signal is an actual level signal sent by the sensing device, determining a second playback time according to the actual level signal; and determining a delay result corresponding to the measured device according to the first playback time and the second playback time. This method can accurately measure the delay generated by device hardware, which is beneficial to more accurate optimization and improvement.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a method, device, and system for detecting device delay. Background Art

[0002] With the development and popularization of computer technology, cloud applications have penetrated into various application scenarios in all industries. Among them, applications such as cloud conferencing and cloud gaming provide users with convenient and portable work or entertainment experiences. Currently, audiovisual applications based on cloud technology such as cloud conferencing or cloud gaming mainly use the server to perform information processing and calculations according to the instructions of the user terminal, and push the information flow to the client through the Internet for interaction.

[0003] In such applications, delay is a key indicator to ensure user experience. Currently, for measuring delay, the method of recording the daily time at different running nodes of the application is usually used to statistically calculate the stage delay.

[0004] However, when facing the delay caused by the handover between software and hardware due to problems with the user terminal hardware itself, this method cannot accurately evaluate whether the delay is caused by software or mainly affected by hardware, resulting in inaccurate analysis of the cause of the delay and being unfavorable for the optimization and improvement of the application. Summary of the Invention

[0005] Based on the above technical problems, this application provides a configuration method for approval services, so as to accurately measure the delay generated by device hardware, thereby accurately analyzing the cause of the delay, which is beneficial to more accurate optimization and improvement.

[0006] Other features and advantages of this application will become apparent through the following detailed description, or be learned in part through the practice of this application.

[0007] According to one aspect of the embodiments of this application, a method for detecting device delay is provided, including:

[0008] Receiving a detection signal, where the detection signal is a level signal triggered by a measured device and a sensing device according to a test frame sequence, where the test frame sequence includes M test frames, and at least the target test frame is included in the M test frames, and M is an integer greater than 1;

[0009] When the detection signal is a test level signal sent by the measured device, determining a first playback moment according to the test level signal, where the test level signal is a level signal triggered when the measured device plays the target test frame;

[0010] When the detection signal is the actual level signal sent by the sensing device, determine a second playback time according to the actual level signal, where the actual level signal is the level signal triggered when the sensing device detects that the device under test plays the target test frame;

[0011] Determine the delay result corresponding to the device under test according to the first playback time and the second playback time.

[0012] According to one aspect of the embodiments of the present application, there is provided a device delay detection device, including:

[0013] A receiving module, configured to receive a detection signal, where the detection signal is a level signal triggered by the device under test and the sensing device according to a test frame sequence, where the test frame sequence includes M test frames, and at least the target test frame is included in the M test frames, and M is an integer greater than 1;

[0014] A first determination module, configured to determine a first playback time according to the test level signal when the detection signal is the test level signal sent by the device under test, where the test level signal is the level signal triggered when the device under test plays the target test frame;

[0015] A second determination module, configured to determine a second playback time according to the actual level signal when the detection signal is the actual level signal sent by the sensing device, where the actual level signal is the level signal triggered when the sensing device detects that the device under test plays the target test frame;

[0016] A delay determination module, configured to determine the delay result corresponding to the device under test according to the first playback time and the second playback time.

[0017] In some embodiments of the present application, based on the above technical solutions, the device delay detection device further includes:

[0018] A test frame acquisition module, configured to acquire a target test frame and M - 1 test frames, where the attribute value of the target test frame is set to be higher than a preset attribute threshold, and the attribute values of the M - 1 test frames are set to be lower than the attribute threshold, where the attribute value corresponds to an attribute that the sensing device can detect;

[0019] A sequence generation module, configured to generate the test frame sequence according to the target test frame and the M - 1 test frames.

[0020] In some embodiments of the present application, based on the above technical solutions, the sequence generation module includes:

[0021] A video sequence generation unit, configured to add the target video frame to a random position in the sequence of the M-1 test video frames to obtain the test frame sequence.

[0022] In some embodiments of the present application, based on the above technical solutions, the sensing device is a photosensitive sensor, and the actual level signal is a level signal generated when the photosensitive sensor detects that the brightness of the video frame played by the device under test is higher than the preset brightness value; the second determination module includes:

[0023] A video playback time determination unit, configured to, when the detection signal is a high-level signal, determine that the detection signal is the actual level signal and determine the current time as the second playback time.

[0024] In some embodiments of the present application, based on the above technical solutions, the sequence generation module includes:

[0025] An audio sequence generation unit, configured to add the target audio frame to a random position in the sequence of the M-1 test audio frames to generate the test frame sequence.

[0026] In some embodiments of the present application, based on the above technical solutions, the sensing device is a sound-sensitive sensor, and the actual level signal is a level signal generated when the sound-sensitive sensor detects that the vibration frequency of the audio frame played by the device under test is higher than the preset vibration frequency; the second determination module includes:

[0027] An audio playback time determination unit, configured to, when the detection signal is a high-level signal, determine that the detection signal is the actual level signal and determine the current time as the second playback time.

[0028] In some embodiments of the present application, based on the above technical solutions, the test frame acquisition module includes:

[0029] In response to a user operation on the device under test, acquire a target data frame and M-1 test data frames, where the target data frame is used to cause the device under test to vibrate at a first frequency, and the M-1 test data frames are used to cause the device under test to vibrate at a second frequency, the first frequency being higher than a preset frequency threshold, and the second frequency being lower than the preset frequency threshold;

[0030] The sequence generation module includes:

[0031] An audio sequence generation unit, configured to add the target data frame to the first frame of the sequence of the M-1 test data frames to obtain the test frame sequence.

[0032] In some embodiments of the present application, based on the above technical solutions, the sensing device is a vibration sensor, and the actual level signal is a level signal generated when the vibration sensor detects that the vibration frequency of the device under test is higher than the preset frequency threshold; the second determination module includes:

[0033] A vibration moment determination unit, configured to, when the detection signal is a high-level signal, determine that the detection signal is the actual level signal, and determine the current moment as the second playback moment.

[0034] In some embodiments of the present application, based on the above technical solutions, the device delay detection device further includes:

[0035] A delay result acquisition module, configured to acquire a plurality of the delay results of the device under test;

[0036] A data calculation module, configured to calculate a delay jitter, a delay average value, and a delay fluctuation variance according to the plurality of delay results;

[0037] A report generation module, configured to generate a delay result report according to the plurality of delay results and the delay jitter, the delay average value, and the delay fluctuation variance.

[0038] According to one aspect of the embodiments of the present application, a method for device delay detection is provided, including:

[0039] Playing a test frame sequence, where the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, and M is an integer greater than 1;

[0040] When playing the target test frame, sending a test level signal as the detection signal to the detection device, so that the detection device determines a first playback moment according to the test level signal;

[0041] When detecting the playback of the target test frame, sending an actual level signal as the detection signal to the detection device, so that the detection device determines a second playback moment according to the actual level signal and determines a delay result according to the first playback moment and the second playback moment.

[0042] According to one aspect of the embodiments of the present application, a device delay detection device is provided, including:

[0043] A playback module, configured to play a test frame sequence, where the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, and M is an integer greater than 1;

[0044] A first sending module, configured to send a test level signal to the detection device as the detection signal when playing the target test frame, so that the detection device determines a first playing moment according to the test level signal;

[0045] A second sending module, configured to send an actual level signal to the detection device as the detection signal when detecting the playing of the target test frame, so that the detection device determines a second playing moment according to the actual level signal and determines a delay result according to the first playing moment and the second playing moment.

[0046] According to one aspect of the embodiments of the present application, a device delay detection system is provided, including: a device under test and a detection device;

[0047] The device under test is configured to play a test frame sequence, the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, where M is an integer greater than 1;

[0048] The device under test is further configured to send a test level signal to the detection device as the detection signal when playing the target test frame;

[0049] The detection device is configured to determine a first playing moment according to the test level signal when the detection signal is the test level signal sent by the device under test;

[0050] The device under test is further configured to send an actual level signal to the detection device as the detection signal when detecting the playing of the target test frame;

[0051] The detection device is further configured to determine a second playing moment according to the actual level signal when the detection signal is the actual level signal sent by the sensing device;

[0052] The detection device is further configured to determine a delay result corresponding to the device under test according to the first playing moment and the second playing moment.

[0053] According to one aspect of the embodiments of the present application, an electronic device is provided, the electronic device includes: a processor; and a memory for storing executable instructions of the processor; wherein, the processor is configured to execute the method for detecting device delay in the above technical solution by executing the executable instructions.

[0054] According to one aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the method for detecting device delay in the above technical solution is implemented.

[0055] According to one aspect of the embodiments of the present application, there is provided a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for detecting device delay provided in the above various alternative implementations.

[0056] In an embodiment of the present application, a detection signal is received, and two playback times are respectively determined according to the level signal generated before the target test frame is played by the device under test and the level signal generated by the sensing device when the device under test actually plays the target test frame, and then the delay of the device under test is determined by the time difference between the playback times. Since the time point before playing a frame of data and the time point of actual playback are captured by the device under test and the sensing device, the delay generated by the device hardware can be accurately measured, and thus the cause of the delay can be accurately analyzed, which is beneficial to more accurate optimization and improvement.

[0057] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. Obviously, the accompanying drawings in the following description are only some embodiments of the present application, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts.

[0059] In the drawings:

[0060] Figure 1 is a schematic diagram of the composition architecture of an application scenario applicable to the present application;

[0061] Figure 2 shows a schematic diagram of a module for detecting device delay in an embodiment of the present application;

[0062] Figure 3 shows a schematic flowchart of a method for detecting device delay in an embodiment of the present application;

[0063] Figure 4 shows a schematic flowchart of a method for detecting device delay in an embodiment of the present application;

[0064] Figure 5 is a schematic diagram of the solution process in an embodiment of the present application;

[0065] Figure 6The flowchart of a device delay detection method in an embodiment of the present application is shown;

[0066] Figure 7 The block diagram of an approval service configuration device in an embodiment of the present application is schematically shown;

[0067] Figure 8 The structural diagram of a computer system of an electronic device suitable for implementing the embodiments of the present application is shown. Detailed implementation manners

[0068] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art.

[0069] In addition, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present application. However, those skilled in the art will recognize that the technical solutions of the present application can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. can be used. In other cases, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the present application.

[0070] The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0071] The flowcharts shown in the drawings are only illustrative and do not necessarily include all the content and operations / steps, nor do they necessarily need to be executed in the described order. For example, some operations / steps can be decomposed, while some operations / steps can be combined or partially combined, so the actual execution order may change according to the actual situation.

[0072] It should be understood that the solution of the present application can be applied to measuring the physical latency of various terminal devices operating in various remote audio-visual connection scenarios such as cloud gaming, cloud conferencing, or cloud office work, and can also be applied to the physical latency of an interactive device to provide feedback on user operations. Physical latency refers to the latency caused by the problems of the terminal device itself. For example, in the cloud gaming scenario, due to reasons such as the processing power of devices such as TVs or set-top boxes or hardware aging, the playback progress of the game screen recorded in the game application does not match the actual playback progress on the TV, resulting in latency. For instance, in the game application, the player character controlled by the player has passed point A and reached point B, while on the TV screen, the player character has just reached point A. Specifically, in remote scenarios such as cloud gaming, cloud conferencing, or cloud office work, the solution of the present application can be used to measure the playback latency of the terminal device for game videos, conference audio-visuals, or desktop operation actions. In the interactive device scenario, the solution of the present application can be used to measure the feedback speed of the interactive device to user operations. For example, it can measure the response latency of the handle vibration to user key presses, or the response latency of the mobile phone key feedback to user input, etc.

[0073] Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables lightweight devices (thin clients) with relatively limited graphics processing and data computing capabilities to run high-quality games. In the cloud gaming scenario, the game does not run on the player's game terminal, but on the cloud server, and the cloud server renders the game scene into a video and audio stream, which is transmitted to the player's game terminal through the network. The player's game terminal does not need to have powerful graphics computing and data processing capabilities, but only needs to have basic streaming media playback capabilities and the ability to obtain player input commands and send them to the cloud server.

[0074] Cloud conferencing is an efficient, convenient, and low-cost conferencing form based on cloud computing technology. Users only need to perform simple and easy operations through the Internet interface to quickly and efficiently synchronously share voice, data files, and videos with teams and customers around the world, and complex technologies such as data transmission and processing during the conference are operated by cloud conferencing service providers to assist users.

[0075] Currently, domestic cloud conferencing mainly focuses on service contents in the form of SaaS (Software as a Service), including service forms such as telephone, network, and video. Video conferencing based on cloud computing is called cloud conferencing.

[0076] In the era of cloud conferencing, the transmission, processing, and storage of data are all handled by the computer resources of video conferencing manufacturers. Users no longer need to purchase expensive hardware and install cumbersome software. They only need to open a browser and log in to the corresponding interface to conduct efficient remote meetings.

[0077] The cloud conferencing system supports multi-server dynamic cluster deployment and provides multiple high-performance servers, greatly enhancing the stability, security, and availability of meetings. In recent years, video conferencing has been welcomed by many users because it can significantly improve communication efficiency, continuously reduce communication costs, and bring about an upgrade in internal management level. It has been widely applied in various fields such as government, transportation, finance, operators, education, and enterprises. There is no doubt that after video conferencing uses cloud computing, it has stronger attraction in terms of convenience, speed, and ease of use, and will surely trigger a new upsurge in the application of video conferencing.

[0078] For the sake of easy understanding, the solution of this application is illustrated by taking the scenario of cloud gaming as an example. Please refer to Figure 1 , Figure 1 which is a schematic diagram of the composition architecture of an application scenario applicable to this application.

[0079] It can be seen from Figure 1 that this scenario includes a client 110, a communication network 120, a proxy server 130, and a cloud gaming server 140.

[0080] The client 110 can specifically include terminal devices such as the TVs, mobile phones, tablets, or computers used by users. Users access cloud games through the client 110 via the proxy server 130 for playing. The client 110 communicates with the cloud gaming server 140 and sends game operations to the cloud gaming server 140. The cloud gaming server 140 performs operations on game content according to the user's game operations, and then pushes the operation results to the proxy server 130 in the form of a video stream. The proxy server 130 pushes the video stream to the client 110 through the Internet 120 to display the game process.

[0081] During the game process, game latency is a very important indicator for the game experience. Usually, in order to optimize game latency, it is necessary to conduct segmented analysis on the game link, for example, divide it into segments between the cloud gaming server 140 and the proxy server 130 and segments between the proxy server 130 and the client 110. The latency of these segments can be statistically analyzed by the cloud gaming software by logging at different stages of the link. However, the latency of the terminal device running the client 110 itself cannot be statistically analyzed. The solution of this application can be used to test the latency of the terminal device running the client 110. If it is found that the latency of the terminal device is too high, a report on the device latency can be sent to the manufacturer of the terminal device for further cause investigation and optimization.

[0082] It is understandable that Figure 1 the scenarios shown are only example scenarios to which the solutions of the present application are applied. The actual application scenarios can adopt any other suitable structures, and the present application places no restrictions thereon.

[0083] Figure 2 Fig. shows a schematic diagram of a module for device delay detection in an embodiment of the present application. As Figure 2 shown, the television 210 is connected to the test circuit 220 board through a general-purpose input / output interface. Specifically, an interface is led out from the main board of the television 210 and directly connected to the test circuit 220 through an electric wire. A sensing device 230 is installed on the television 210. The sensing device 230 samples the playback behavior of the television 210. For example, video sampling is performed on the screen of the television or audio sampling is performed on the speaker of the television, and is connected to the test circuit 220 through a line for sending a detection level signal. Correspondingly, the sensing device 230 can be a photosensitive sensor or a sound-sensitive sensor. The photosensitive sensor generates different levels by detecting the different brightness of the picture played on the television screen, while the sound-sensitive sensor generates different levels by detecting the vibration of the sound played by the television speaker. The television 210 and the sensing device 230 generate a high-level signal according to the solution of the present application and send it to the test circuit 220. The computer 240 is connected to the test circuit 220 and collects information on the level signal from the test circuit 220 for delay analysis.

[0084] It should be noted that Figure 2 for ease of understanding, the present application is described by taking the application to a television as an example. When performing device delay detection for other terminal devices, only the Figure 2 television in the shown scenario needs to be replaced with the corresponding device, and the scenario is similar and will not be elaborated here. In addition, Figure 2 the shown module structure is only an example. The test circuit and the computer can also be combined into the same device, and the sensing device can also be integrated with the television into the same device. The present application places no restrictions thereon.

[0085] The following will make a detailed description of the technical solutions provided by the present application in conjunction with specific embodiments.

[0086] Please refer to Figure 3 , Figure 3 Fig. shows a schematic flowchart of a device delay detection method in an embodiment of the present application. The method of this embodiment can be applied to the module structure described above and is executed by a terminal device. The method of this embodiment can include the following steps S301 to step S304:

[0087] Step S301: Receive a detection signal, which is a level signal triggered by the device under test and the sensing device according to a test frame sequence. The test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, where M is an integer greater than 1.

[0088] Among them, the device under test is usually a TV or an electronic display of this type. The detection terminal will send the pre-generated test frame sequence to the device under test, or the test frame sequence can be pre-stored in the device under test. After receiving the test frame sequence, the device under test will play the received test frame sequence to interact with the user, such as playing a game. Then, the device under test and the sensing device will detect the test frame sequence played by the device under test, generate a detection signal and send it to the detection device. The detection device then receives the detection signal sent by the device under test and the sensing device. The test frame sequence is usually media data. For example, it can be a video segment, an audio segment, or a video and audio media segment. For example, for a video, the test frame sequence can consist of a pure black test frame and a pure white target test frame. For audio, the test frame sequence can consist of a silent or low-frequency audio test frame and a high-frequency audio target test frame. For a video and audio media segment, the test frame sequence can consist of a pure black and silent or low-frequency audio test frame and a pure white and high-frequency audio target test frame. In some embodiments, the test frame sequence can also be a data frame sequence for sending instructions, such as a continuous operation of a user.

[0089] The test frame sequence includes a target test frame, which is used to test the hardware delay of the device under test. Specifically, if playing other test frames in the test frame sequence by the device under test will produce a specific effect, then playing the target test frame by the device under test will produce another effect different from the characteristic effect. For example, for a TV playing a video, other test frames can be pure black frames, and the target test frame can be a pure white frame. Then, when playing the pure white frame, the brightness of the TV screen will increase significantly, thus producing a different effect.

[0090] The target test frame can usually be set at a fixed position in the test frame sequence. For example, for a 1000-frame video, it can be fixed at the 100-frame position.

[0091] The detection device can directly send the test frame sequence to the device under test, or send the test frame sequence to a remote server, and then trigger the device under test to obtain the test frame sequence from the remote server through another playback action. The test frame sequence can also be pre-stored in the device under test and directly played by the device under test.

[0092] It can be understood that when the detection device sends a test frame sequence to the device under test, it will also send relevant information of the test frame sequence to the device under test, such as the length and the position of the target test frame. In one embodiment, the device under test can also obtain such relevant information by detecting the test frame sequence.

[0093] Step S302, when the detection signal is a test level signal sent by the device under test, determine a first playback moment according to the test level signal, where the test level signal is a level signal triggered when the device under test plays the target test frame.

[0094] Specifically, the test level signal is a level signal triggered and sent to the detection device by the program running on the device under test at a time point before the device under test plays the target test frame. Therefore, the first playback moment can be understood as the moment before the device under test performs the playback action on the target test frame. The device under test will send the level signal to the detection device through the line connected to the general-purpose input / output interface. When the detection device receives the level signal, it will determine the current moment as the first playback moment. Here, in this embodiment, the general-purpose input / output interface in the device under test is an interface for device delay detection, and it is configured to send high and low level signals to the detection device. The function of this general-purpose input / output interface can be set to output a low level or a high level according to the playback instruction of the device under test by programming or configuring the device under test, so that the detection device can detect the playback of the target test frame.

[0095] Step S303, when the detection signal is an actual level signal sent by the sensing device, determine a second playback moment according to the actual level signal, where the actual level signal is a level signal triggered when the sensing device detects that the device under test plays the target test frame.

[0096] Specifically, the actual level signal is a level signal triggered and sent to the detection device by the change caused when the sensing device detects that the device under test plays the target test frame. For example, for a video frame, the actual level signal can be a level signal triggered when the sensing device detects the picture of the target video frame played by the TV. Therefore, the second playback moment can be understood as the moment when the device under test performs the playback action on the target test frame. The sensing device sends the triggered level signal to the detection device through the line connected to the detection device. When the detection device receives the level signal, it takes the moment when the signal is received as the second playback moment.

[0097] Step S304, determine the delay result corresponding to the device under test according to the first playback moment and the second playback moment.

[0098] Specifically, the detection device determines the time difference between the second playback moment and the first playback moment as the delay result corresponding to the device under test. Depending on the timing accuracy of the device under test and the sensitivity of the sensing device, the delay result can be accurate to the millisecond level. This delay result represents the delay between the playback of the target test frame by the device under test and the detection of the playback result of the target test frame, that is, the delay taken by the device under test to perform the playback action of a test frame.

[0099] In one embodiment, due to reasons such as detection accuracy and signal transmission, the high-level signal generated by the sensing device may not be received or recognized by the detection device. In response to such a situation, the detection device will set a detection timer. After receiving the high-level signal sent by the device under test, the detection timer starts timing. If the detection device still does not receive the high-level signal triggered by the sensing device after the detection timer expires, it is determined that this detection fails and no delay result is generated.

[0100] In the embodiment of the present application, a detection signal is received, and two playback moments are respectively determined according to the level signal generated before the device under test plays the target test frame and the level signal generated by the sensing device when detecting the actual playback of the target test frame by the device under test. Then, the delay of the device under test is determined by the time difference between the playback moments. Since the time point before playing a frame of data and the time point of actual playback are captured by the device under test and the sensing device, the delay generated by the device hardware can be accurately measured, and thus the cause of the delay can be accurately analyzed, which is beneficial for more accurate optimization and improvement.

[0101] In one embodiment of the present application, in order to generate a test frame sequence, specifically, it can be as Figure 4 shown. Before step S301 of receiving the detection signal, the method may further include the following steps S401 and S402, which are described in detail as follows:

[0102] Step S401, obtain a target test frame and M - 1 test frames. The attribute value of the target test frame is set to be higher than a preset attribute threshold, and the attribute values of the M - 1 test frames are set to be lower than the attribute threshold, where the attribute value corresponds to an attribute that the sensing device can detect;

[0103] Step S402, generate a test frame sequence according to the target test frame and the M - 1 test frames.

[0104] Specifically, the detection device obtains a target test frame and M - 1 test frames according to a predetermined rule. Here, the attribute value is an attribute that the test frame has, which can be detected by the sensing device, and the detection device can generate different level signals according to different attribute values. The attribute threshold is set so that the difference between the attribute value of the target test frame and the attribute values of other test frames can be detected by the sensing device. For example, if the attribute value is brightness, it is sufficient that the difference in brightness between the target test frame and other test frames is recognizable by the sensing device.

[0105] The detection device inserts the target test frame into the M - 1 test frames to form a test frame sequence including M test frames. The detection device can insert the target test frame at any position in the test frame sequence. It can be understood that in a test frame sequence, usually only one target test frame is included. When playing the target test frame, the playback program of the device under test will output a test level signal. However, the duration of this test level signal can be longer than the duration of the target test frame, that is, after the target test frame finishes playing, the device under test can continue to send the test level signal to the detection device so that the detection device can clearly receive this test level signal.

[0106] In subsequent steps, the device under test generates a test level signal when playing the target test frame, and the sensing device generates an actual level signal when detecting that a white video frame is played. And the delay in the video playback process of the device under test is determined according to the time difference between the test level signal and the actual level signal.

[0107] In the embodiment of the present application, test frames with different attribute values are generated as the target test frame and other test frames, so as to be able to test the display delay of the device under test. And the position of the target video frame is randomly determined, which can prevent the situation of missing the detection of the delay change of the device under test over time and improve the accuracy of delay detection.

[0108] In an embodiment of the present application, the M - 1 test frames are M - 1 test video frames, the target test frame is a target video frame, and the attribute value is the brightness value of the video frame; to generate a test frame sequence, step S402, generating a test frame sequence according to the target test frame and the M - 1 test frames may include the following steps, which are described in detail as follows:

[0109] Add the target video frame to a random position in the sequence of M - 1 test video frames to obtain a test frame sequence.

[0110] Specifically, the detection device obtains a target video frame and M - 1 test video frames according to a predetermined rule, where the brightness of the target video frame is higher than a preset brightness value, and the brightness of the M - 1 test video frames is lower than the preset brightness value. For example, the picture of the target video frame is a video frame with pure white, while the other M - 1 test video frames are video frames with pure black, or other colors can also be used, as long as the difference in brightness between the target video frame and the test video frames is sufficient to be recognized by the sensing device.

[0111] Subsequently, the detection device inserts the target video frame into the M - 1 test video frames to form a test frame sequence including M video frames. The detection device can insert the target video frame at any position in the test frame sequence. It can be understood that in a test frame sequence, usually only one white video frame is included. When playing this white video frame, the playback program of the device under test will output a test level signal. However, the duration of this test level signal can be longer than the duration of the white frame, that is, after the white video frame is played, the device under test can continue to send the test level signal to the detection device so that the detection device can clearly receive this test level signal.

[0112] In subsequent steps, the device under test generates a test level signal when playing the white video frame, and the sensing device generates an actual level signal when detecting that the white video frame is being played. And the delay of the video playback process of the device under test is determined according to the time difference between the test level signal and the actual level signal.

[0113] In the embodiments of the present application, video frames with different brightness are generated as the target video frame and the test video frames, so as to be able to test the display delay of the device under test, and the position of the target video frame is randomly determined, which can prevent the situation that the delay of the device under test changing with time is missed and improve the accuracy of delay detection.

[0114] In an embodiment of the present application, the sensing device is a photosensitive sensor, and the actual level signal is the level signal generated when the photosensitive sensor detects that the brightness of the video frame played by the device under test is higher than the preset brightness value; in order to determine the second playback moment, in step S303, when the detection signal is the actual level signal sent by the sensing device, determining the second playback moment according to the actual level signal may include the following steps, which are described in detail as follows:

[0115] When the detection signal is a high - level signal, it is determined that the detection signal is the actual level signal, and the current moment is determined as the second playback moment.

[0116] Specifically, in order to determine the playback time of the white video frame, the sensing device is set as a photosensitive sensor. The photosensitive sensor can be attached to the display screen of the device under test or built into the device under test. When the brightness of the picture played on the screen is detected to be higher than the preset brightness value, the photosensitive sensor will raise the level of the output signal, thereby generating a high-level signal as the actual level signal.

[0117] During the testing process, when the device under test starts playing the first frame of the test frame sequence, the device under test starts sending a low-level signal as the test level signal to the detection device, while the sensing device detects the black video frame played by the device under test and sends a low-level signal as the actual level signal to the detection device, that is, the detection device starts receiving low-level signals from the device under test and the sensing device from the start of playing the video.

[0118] When the photosensitive sensor detects the playback of the white video frame, it raises the level of the output signal to a high-level signal. When the detection device detects that the actual level signal is a high-level signal, it determines the current moment as the second playback time to calculate the specific delay of the device under test.

[0119] The following describes the process of the solution of the present application in combination with this video frame scenario. Specifically, please refer to Figure 5 , Figure 5 which is a schematic diagram of the solution process in the embodiment of the present application. As Figure 5 shown, after the detection device receives the detection signal, the device under test first reads the video frame in the received test frame sequence, and then decodes the video frame to obtain the video picture. Then, the device under test sends the video picture to the display for playback in sequence. Assume that the white video frame is the 100th frame. Then, during the process from the 1st frame to the 99th frame, the screen will display a black picture, and the brightness of the black picture is lower than the preset brightness threshold. Therefore, the photosensitive sensor will send a low-level signal as the detection signal to the detection device, and the device under test also sends a low-level signal as the detection signal to the detection device. Before playing the 100th frame, the device under test raises the level of the output signal to a high-level signal as the test level signal and continuously outputs a high-level signal within a predetermined time. For example, it outputs a high-level signal within 100 frames, and at the 200th frame, it lowers the level signal to a low-level signal. When the detection device receives the test level signal output by the device under test as a high-level signal, it determines the current moment T1 as the first playback time. After the device under test plays the white video frame, the photosensitive sensor outputs a high-level signal as the actual level signal to the detection device. When the detection device receives the actual level signal as a high-level signal, it determines the current moment T2 as the second playback time. Subsequently, the detection device determines the delay of the device under test according to the time difference between the T2 moment and the T1 moment.

[0120] In an embodiment of the present application, the brightness of a target video frame is recognized by a photosensitive sensor, and a high-level signal is generated according to the brightness of the target video frame being higher than a brightness threshold, so as to determine a second playback time. The second playback time is determined by the high-level signal generated by the photosensitive sensor, and a specific detection method for detecting video playback delay is specifically disclosed, improving the operability of the solution.

[0121] In an embodiment of the present application, in order to generate a test frame sequence, M - 1 audio frames are M - 1 test audio frames, the target test frame is a target audio frame, and the attribute value is the vibration frequency of the audio frame; Step S402, generating a test frame sequence according to the target test frame and M - 1 test frames may include the following steps, which are described in detail as follows:

[0122] Add the target audio - video to a random position in the sequence of M - 1 test audio frames to generate a test frame sequence.

[0123] Specifically, the detection device obtains the target audio frame and M - 1 test audio frames according to a predetermined rule, where the vibration frequency of the target audio frame is higher than a preset vibration frequency, and the vibration frequencies of the M - 1 test audio frames are lower than the preset vibration frequency. For example, the sound of the target audio frame is soprano, while the other M - 1 test audio frames are bass, or other methods can also be used. For example, the sound of the target audio frame is a high - frequency sound, while the M - 1 test audio frames are in a mute state, as long as the difference in the vibration frequencies between the target audio frame and the test audio frames is sufficient to be recognized by the sensing device.

[0124] Subsequently, the detection device inserts the target audio frame into the M - 1 test audio frames to form a test frame sequence including M audio frames. The detection device can insert the target audio frame at any position in the test frame sequence. It can be understood that in a test frame sequence, usually only one audio frame with a high pitch is included. When playing this audio frame with a high pitch, the playback program of the device under test will output a test level signal. However, the duration of this test level signal can be longer than the duration of the audio frame with a high pitch. That is, after the audio frame with a high pitch finishes playing, the device under test can continue to send the test level signal to the detection device so that the detection device can clearly receive this test level signal.

[0125] In subsequent steps, the device under test generates a test level signal when playing the audio frame with a high pitch, and the sensing device generates an actual level signal when detecting that the audio frame with a high pitch is played. And the delay in the audio playback process of the device under test is determined according to the time difference between the test level signal and the actual level signal.

[0126] In one embodiment, the audio test can be combined with the test of video frames described above. That is, the first playback moment is determined by the high-level signal generated when playing the target video frame. The second playback moment is determined according to the high-level signal sensed by the photosensitive sensor. Then, the video delay is determined according to the first playback moment and the second playback moment. Next, the third playback moment is determined by the high-level signal generated when playing the target audio frame. The fourth playback moment is determined according to the high-level signal sensed by the sound-sensitive sensor. The audio delay is determined according to the third playback moment and the fourth playback moment. Whether there are problems such as audio-video out-of-sync in the device can be determined according to whether the video delay and the audio delay are consistent.

[0127] In an embodiment of the present application, audio frames with different vibration frequencies are generated as the target audio frame and the test audio frame, so as to be able to test the audio playback delay of the device under test, improving the diversity of the solution.

[0128] In an embodiment of the present application, the sensing device is a sound-sensitive sensor, and the actual level signal is the level signal generated when the sound-sensitive sensor detects that the vibration frequency of the audio frame played by the device under test is higher than the preset vibration frequency; in order to determine the second playback moment, in step S303, when the detection signal is the actual level signal sent by the sensing device, determining the second playback moment according to the actual level signal may include the following steps, which are described in detail as follows:

[0129] When the detection signal is a high-level signal, it is determined that the detection signal is the actual level signal, and the current moment is determined as the second playback moment.

[0130] Specifically, in order to determine the playback moment of the high-pitched audio frame, the sensing device is set as a sound-sensitive sensor. The sound-sensitive sensor can be attached to the speaker opening of the device under test or built into the device under test. When the vibration frequency of the audio played by the speaker is detected to be higher than the preset vibration frequency, the sound-sensitive sensor will raise the level of the output signal, thereby generating a high-level signal as the actual level signal.

[0131] During the test process, when the device under test starts playing the first frame of the test frame sequence, the device under test starts sending a low-level signal as the test level signal to the detection device according to the low-pitched audio frame, and the sensing device detects the low-pitched audio frame played by the device under test and sends a low-level signal as the actual level signal to the detection device, that is, the detection device starts receiving low-level signals from the device under test and the sensing device from the start of audio and video.

[0132] When the sound-sensitive sensor detects the playback of the high-pitched audio frame, the output level signal is raised to a high-level signal. When the detection device detects that the actual level signal is a high-level signal, the current moment is determined as the second playback moment for calculating the specific delay of the device under test.

[0133] The solution process for detecting audio delay is similar to the solution process introduced above for the video frame scenario. Just replace the devices used for video detection with audio accordingly, and it will not be elaborated here.

[0134] In an embodiment of the present application, a photosensitive sensor is used to identify the vibration frequency of a high - pitched audio frame, and a high - level signal is generated according to the vibration frequency of the high - pitched audio frame being higher than a preset vibration frequency threshold, so as to determine the second playback moment, thereby being able to determine the specific playback moment of a single audio frame, which is beneficial to accurately determining the audio delay and improving the accuracy of delay detection.

[0135] In an embodiment of the present application, the M - 1 test frames are M - 1 test data frames, and the target test frame is the target data frame; to generate a test frame sequence, step S401, obtaining the target test frame and M - 1 test frames, may include the following steps:

[0136] In response to a user operation on the device under test, obtain the target data frame and M - 1 test data frames. The target data frame is used to make the device under test vibrate at a first frequency, and the M - 1 test data frames are used to make the device under test vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold;

[0137] Step S402, generating a test frame sequence according to the target test frame and M - 1 test frames, may include the following steps:

[0138] Add the target data frame to the first frame of the sequence of M - 1 test data frames to obtain the test frame sequence.

[0139] In this embodiment, the solution of the present application can also be applied to the vibration feedback speed of the test device for user operations. The device under test can be a control device for user operations, such as a game controller or a TV remote control, etc. During the test, a user operation can be triggered on the device under test through a detection device or directly by the user, such as a direction operation or a button operation, and the device under test will vibrate according to the user operation, thereby giving the user a key feedback or an operation feedback. The detection device can generate a target data frame and M - 1 test data frames according to the user operation to be performed on the device under test. The data frame is control information for making the device under test vibrate. The target data frame is used to make the device under test vibrate at a first frequency, and the M - 1 test data frames are used to make the device under test vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold.

[0140] Subsequently, the detection device inserts the target data frame into M - 1 test data frames to form a test frame sequence including M data frames. The target data frame is located in the first frame of the test frame sequence to detect the response speed of the device under test. It can be understood that usually only one target data frame is included in a test frame sequence. When playing the test frame sequence, the device under test vibrates at different frequencies according to the target data frame. Before vibrating according to the target data frame, the playback program of the device under test will output a test level signal and continuously output this test level signal for a subsequent period of time so that the detection device can determine the start time of the vibration according to the target data frame.

[0141] In subsequent steps, the device under test generates a test level signal before vibrating at a high frequency according to the target data frame, and the sensing device generates an actual level signal when detecting the high - frequency vibration. Subsequently, the delay of the vibration feedback process of the device under test is determined according to the time difference between the test level signal and the actual level signal.

[0142] In the embodiments of the present application, a test frame sequence is generated in response to a user's operation. By generating different data frames, the device under test vibrates at different frequencies, so as to determine the feedback of the device under test to the user's operation according to the detection of the vibration frequency, improving the diversity of the solution.

[0143] In an embodiment of the present application, the sensing device is a vibration sensor, and the actual level signal is the level signal generated when the vibration sensor detects that the vibration frequency of the device under test is higher than a preset frequency threshold; to determine the second playback moment, in step S303, when the detection signal is the actual level signal sent by the sensing device, determining the second playback moment according to the actual level signal may include the following steps, which are described in detail as follows:

[0144] When the detection signal is a high - level signal, it is determined that the detection signal is the actual level signal, and the current moment is determined as the second playback moment.

[0145] Specifically, to determine the playback moment of the target data frame, the sensing device is set as a vibration sensor. The vibration sensor can be attached to the vibrator of the device under test or built into the device under test to vibrate with the device under test. When the vibration frequency of the vibrator is detected to be higher than the preset frequency threshold, the vibration - sensitive sensor will raise the level of the output signal, thereby generating a high - level signal as the actual level signal.

[0146] During the testing process, when the device under test starts playing the first frame of the test frame sequence, the device under test will send a high-level signal to the detection device as a test level signal according to the target data frame, and the vibration sensor detects that the device under test vibrates at a frequency higher than the preset frequency threshold and sends a high-level signal to the detection device as the actual level signal. When the detection device detects that the actual level signal is a high-level signal, it determines the current moment as the second playback moment to calculate the specific delay of the device under test.

[0147] The scheme process for detecting the vibration feedback delay is similar to the scheme process introduced above for the video frame scenario. The only difference is that since the target data frame is the first frame in the test frame sequence, the first playback moment represents the time when the user performs an operation, which will not be elaborated here.

[0148] In the embodiments of the present application, the vibration frequency of the device under test is identified by the vibration sensor, and a high-level signal is generated according to the vibration frequency of the device under test being higher than the preset frequency threshold, thereby determining the second playback moment. Since a data frame will be generated according to the user operation and the target data frame is the first frame in the test frame sequence, the feedback delay of the device under test for the user operation can be accurately measured, improving the diversity of the scheme.

[0149] In an embodiment of the present application, in order to generate a test frame sequence, specifically, as Figure 6 shown, in step S304, after determining the delay result corresponding to the device under test according to the first playback moment and the second playback moment, the method may further include the following steps S501 and S503, which are described in detail as follows:

[0150] Step S501, obtaining multiple delay results of the device under test;

[0151] Step S502, calculating the delay jitter, delay mean, and delay fluctuation variance according to the multiple delay results;

[0152] Step S503, generating a delay result report according to the multiple delay results and the delay jitter, delay mean, and delay fluctuation variance.

[0153] Specifically, after receiving the test frame sequence, the device under test can play the test frame sequence in a loop. The detection device can collect a delay result each time in the loop, thus obtaining multiple delay results. According to the obtained multiple delay results, the detection device can calculate relevant information such as the delay jitter, delay mean, and delay fluctuation variance according to the multiple delay results. According to the calculated delay jitter, delay mean, and delay fluctuation variance and other information and the multiple delay results, a delay result report can be generated. Specifically, the delay result can be in the form of charts, curves, and statistical reports, etc.

[0154] The delay result report can be provided to assist in the delay evaluation of the entire link and accurately evaluate the accurate delay of the link related to the device under test. At the same time, the delay result report can also be provided to the manufacturer of the device under test for hardware optimization of the device under test.

[0155] In an embodiment of the present application, the delay situation of the device under test is analyzed based on multiple delay results, so as to generate a delay result report. Combining multiple delay detection results can more accurately evaluate the delay situation of the device under test and improve the accuracy of the solution.

[0156] According to one aspect of the embodiments of the present application, a method for detecting device delay is provided, including:

[0157] Playing a test frame sequence, the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, where M is an integer greater than 1;

[0158] When playing the target test frame, sending a test level signal to the detection device as the detection signal, so that the detection device determines a first playing moment according to the test level signal;

[0159] When it is detected that the target test frame is played, sending an actual level signal to the detection device as the detection signal, so that the detection device determines a second playing moment according to the actual level signal and determines a delay result according to the first playing moment and the second playing moment.

[0160] It can be understood that this method is the method executed by the device under test in the above detection method, and its execution content corresponds to the method executed in the detection device. In this embodiment, the device under test plays a test frame sequence, and the test frame sequence can be media content such as video and audio stored locally or content received from a remote server. When playing the target test frame, the device under test sends a test level signal to the detection device as the detection signal. When the sensing device in the device under test detects that the device under test plays the target test frame, when playing the target test frame, it sends an actual level signal to the detection device as the detection signal. Taking the target test frame as a white video frame as an example, when the device under test plays a white video frame, it sends a high level signal as a test level signal to the detection device through the general-purpose input / output port. When the photosensitive sensor in the device under test detects the white video frame displayed by the device under test, the device under test sends a high level signal as an actual level signal to the detection device through the photosensitive sensor. The detection device then determines the first playing moment and the second playing moment according to the moments when the test level signal and the actual level signal are received, and further determines the delay result according to the time difference between the first playing moment and the second playing moment.

[0161] It should be noted that although the various steps of the method in this application are described in a specific order in the accompanying drawings, this does not require or imply that these steps must be executed in that specific order, or that all the steps shown must be executed to achieve the desired result. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc.

[0162] The following introduces the device embodiments of this application, which can be used to execute the configuration method of the approval service in the above embodiments of this application. Figure 7 The block diagram of the device delay detection device in the embodiments of this application is schematically shown. As Figure 7 shown, the device delay detection 600 mainly may include:

[0163] A receiving module 610, configured to receive a detection signal, where the detection signal is a level signal triggered by the device under test and the sensing device according to a test frame sequence, where the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, and M is an integer greater than 1;

[0164] A first determination module 620, configured to determine a first playback moment according to the test level signal when the detection signal is a test level signal sent by the device under test, where the test level signal is a level signal triggered when the device under test plays the target test frame;

[0165] A second determination module 630, configured to determine a second playback moment according to the actual level signal when the detection signal is an actual level signal sent by the sensing device, where the actual level signal is a level signal triggered when the sensing device detects that the device under test plays the target test frame;

[0166] A delay determination module 640, configured to determine a delay result corresponding to the device under test according to the first playback moment and the second playback moment.

[0167] In some embodiments of this application, based on the above technical solutions, the device delay detection device 600 further includes:

[0168] A test frame acquisition module, configured to acquire a target test frame and M - 1 test frames, where the attribute value of the target test frame is set to be higher than a preset attribute threshold, and the attribute values of the M - 1 test frames are set to be lower than the attribute threshold, where the attribute value corresponds to an attribute that the sensing device can detect;

[0169] A sequence generation module, configured to generate the test frame sequence according to the target test frame and the M - 1 test frames.

[0170] In some embodiments of the present application, based on the above technical solutions, the sequence generation module includes:

[0171] A video sequence generation unit, configured to add the target video frame to a random position in the sequence of the M-1 test video frames to obtain the test frame sequence.

[0172] In some embodiments of the present application, based on the above technical solutions, the sensing device is a photosensitive sensor, and the actual level signal is a level signal generated when the photosensitive sensor detects that the brightness of the video frame played by the device under test is higher than the preset brightness value; the second determination module 630 includes:

[0173] A video playback time determination unit, configured to, when the detection signal is a high-level signal, determine that the detection signal is the actual level signal and determine the current time as the second playback time.

[0174] In some embodiments of the present application, based on the above technical solutions, the sequence generation module includes:

[0175] An audio sequence generation unit, configured to add the target audio frame to a random position in the sequence of the M-1 test audio frames to generate the test frame sequence.

[0176] In some embodiments of the present application, based on the above technical solutions, the sensing device is a sound-sensitive sensor, and the actual level signal is a level signal generated when the sound-sensitive sensor detects that the vibration frequency of the audio frame played by the device under test is higher than the preset vibration frequency; the second determination module 630 includes:

[0177] An audio playback time determination unit, configured to, when the detection signal is a high-level signal, determine that the detection signal is the actual level signal and determine the current time as the second playback time.

[0178] In some embodiments of the present application, based on the above technical solutions, the test frame acquisition module includes:

[0179] In response to a user operation on the device under test, obtain a target data frame and M-1 test data frames, where the target data frame is used to vibrate the device under test at a first frequency, and the M-1 test data frames are used to vibrate the device under test at a second frequency, the first frequency being higher than a preset frequency threshold, and the second frequency being lower than the preset frequency threshold; the sequence generation module includes:

[0180] An audio sequence generation unit, configured to add the target data frame to the first frame of the sequence of the M-1 test data frames to obtain the test frame sequence.

[0181] In some embodiments of the present application, based on the above technical solutions, the sensing device is a vibration sensor, and the actual level signal is a level signal generated when the vibration sensor detects that the vibration frequency of the device under test is higher than the preset frequency threshold; The second determination module 630 includes:

[0182] A vibration moment determination unit, configured to, when the detection signal is a high-level signal, determine that the detection signal is the actual level signal, and determine the current moment as the second playback moment.

[0183] In some embodiments of the present application, based on the above technical solutions, the device delay detection device 600 further includes:

[0184] A delay result acquisition module, configured to acquire a plurality of the delay results of the device under test;

[0185] A data calculation module, configured to calculate delay jitter, delay mean, and delay fluctuation variance according to the plurality of delay results;

[0186] A report generation module, configured to generate a delay result report according to the plurality of delay results and the delay jitter, delay mean, and delay fluctuation variance.

[0187] According to one aspect of the embodiments of the present application, a device delay detection device is provided, including:

[0188] A playback module, configured to play a test frame sequence, where the test frame sequence includes M test frames, and at least one of the M test frames is a target test frame, and M is an integer greater than 1;

[0189] A first sending module, configured to, when playing the target test frame, send a test level signal to the detection device as the detection signal, so that the detection device determines a first playback moment according to the test level signal;

[0190] A second sending module, configured to, when detecting that the target test frame is played, send an actual level signal to the detection device as the detection signal, so that the detection device determines a second playback moment according to the actual level signal and determines a delay result according to the first playback moment and the second playback moment.

[0191] It should be noted that the device provided in the above embodiment and the method provided in the above embodiment belong to the same concept. The specific manners in which each module performs operations have been described in detail in the method embodiment, and will not be elaborated herein.

[0192] In one aspect of the embodiments of the present application, a device delay detection system is further provided, including: a device under test and a detection device;

[0193] The device under test is used to play a test frame sequence, the test frame sequence includes M test frames, and at least the target test frame is included in the M test frames, where M is an integer greater than 1;

[0194] The device under test is further configured to, when playing the target test frame, send a test level signal to the detection device as the detection signal;

[0195] The detection device is configured to, when the detection signal is the test level signal sent by the device under test, determine a first playback moment according to the test level signal;

[0196] The device under test is further configured to, when detecting the playback of the target test frame, send an actual level signal to the detection device as the detection signal;

[0197] The detection device is further configured to, when the detection signal is the actual level signal sent by the sensing device, determine a second playback moment according to the actual level signal;

[0198] The detection device is further configured to determine a delay result corresponding to the device under test according to the first playback moment and the second playback moment.

[0199] It should be noted that the device delay detection system and the method provided in the above embodiment belong to the same concept. The specific manners in which each module performs operations have been described in detail in the method embodiment, and will not be elaborated here.

[0200] Figure 8 The structure diagram of a computer system of an electronic device suitable for implementing the embodiments of the present application is shown.

[0201] It should be noted that Figure 8 The computer system 700 of the electronic device shown is only an example, and should not bring any limitation to the functions and usage scope of the embodiments of the present application.

[0202] Such as Figure 8As shown, computer system 700 includes a Central Processing Unit (CPU) 701, which can perform various appropriate actions and processes according to programs stored in a Read-Only Memory (ROM) 702 or programs loaded from a storage section 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for system operations are also stored. The CPU 701, ROM 702, and RAM 703 are connected to each other via a bus 704. An Input / Output (I / O) interface 705 is also connected to the bus 704.

[0203] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including, for example, a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), etc. and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed so that a computer program read from it can be installed into the storage section 708 as needed.

[0204] In particular, according to an embodiment of the present application, the processes described in each method flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 709, and / or installed from the removable medium 711. When the computer program is executed by a Central Processing Unit (CPU) 701, various functions defined in the system of the present application are executed.

[0205] It should be noted that the computer-readable medium shown in the embodiments of the present application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device. In the present application, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, and this computer-readable medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0206] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of code, and the above module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks can occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and the combination of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0207] It should be noted that although several modules or units of a device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more of the above-described modules or units can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0208] From the description of the above embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (such as a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0209] After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily conceive of other embodiments of the present application. The present application is intended to cover any variations, uses, or adaptations of the present application, which follow the general principles of the present application and include well-known knowledge or conventional technical means in the technical field not disclosed in the present application.

[0210] It should be understood that the present application is not limited to the exact structures already described and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A method for detecting device delay, characterized in that, it includes: In response to a user operation on the device under test, obtaining a target data frame and M-1 test data frames, where the target data frame is used to make the device under test vibrate at a first frequency, and the M-1 test data frames are used to make the device under test vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold. M is an integer greater than 1. Before the device under test vibrates according to the target data frame, the playback program of the device under test outputs a test level signal and continuously outputs the test level signal for a subsequent period of time; Adding the target data frame to the first frame of the sequence of the M-1 test data frames to obtain a test frame sequence; Receiving a detection signal, where the detection signal is a level signal triggered by the device under test and the sensing device according to the test frame sequence; When the detection signal is the test level signal sent by the device under test, determining a first playback moment according to the test level signal, where the test level signal is a level signal triggered when the device under test plays the target data frame; When the detection signal is the actual level signal sent by the sensing device, determining a second playback moment according to the actual level signal, where the actual level signal is a level signal triggered when the sensing device detects that the device under test plays the target data frame; Determining a delay result corresponding to the device under test according to the first playback moment and the second playback moment.

2. The method according to claim 1, characterized in that, The sensing device is a vibration sensor, and the actual level signal is a level signal generated when the vibration sensor detects that the vibration frequency of the device under test is higher than the preset frequency threshold; The step of when the detection signal is the actual level signal sent by the sensing device, determining a second playback moment according to the actual level signal includes: When the detection signal is a high-level signal, determining that the detection signal is the actual level signal and determining the current moment as the second playback moment.

3. The method according to claim 1, characterized in that, After determining the delay result corresponding to the device under test according to the first playback moment and the second playback moment, the method further includes: Obtaining multiple delay results of the device under test; Calculating delay jitter, delay mean, and delay fluctuation variance according to the multiple delay results; Generating a delay result report according to the multiple delay results and the delay jitter, delay mean, and delay fluctuation variance.

4. A method for detecting device delay, characterized in that, it includes: Play a test frame sequence, where the test frame sequence is generated based on a target data frame and M - 1 test data frames. The target data frame and the M - 1 test data frames are obtained by a detection device in response to a user operation on a device under test. The target data frame is used to cause the device under test to vibrate at a first frequency, and the M - 1 test data frames are used to cause the device under test to vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold. M is an integer greater than 1. Before the device under test vibrates according to the target data frame, the playback program of the device under test outputs a test level signal and continuously outputs the test level signal for a subsequent period of time; When playing the target data frame, send a test level signal to the detection device as a detection signal, so that the detection device determines a first playback moment according to the test level signal; When it is detected that the target data frame is being played, send an actual level signal to the detection device as the detection signal, so that the detection device determines a second playback moment according to the actual level signal and determines a delay result according to the first playback moment and the second playback moment.

5. A device delay detection device, Characterized in that, Comprising: A test frame acquisition module, configured to acquire a target data frame and M - 1 test data frames in response to a user operation on a device under test. The target data frame is used to cause the device under test to vibrate at a first frequency, and the M - 1 test data frames are used to cause the device under test to vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold. M is an integer greater than 1. Before the device under test vibrates according to the target data frame, the playback program of the device under test outputs a test level signal and continuously outputs the test level signal for a subsequent period of time; A sequence generation module, configured to add the target data frame to the first frame of the sequence of the M - 1 test data frames to obtain a test frame sequence; A receiving module, configured to receive a detection signal sent by a device under test, where the detection signal is a level signal triggered by the device under test or a sensing device during the process of the device under test playing the test frame sequence; A first determination module, configured to determine a first playback moment according to the test level signal when the detection signal is the test level signal sent by the device under test, where the test level signal is a level signal triggered when the device under test plays the target data frame; A second determination module, configured to determine a second playback moment according to the actual level signal when the detection signal is the actual level signal sent by the sensing device, where the actual level signal is a level signal triggered when the sensing device detects that the device under test plays the target data frame; A delay determination module, configured to determine a delay result corresponding to the device under test according to the first playback moment and the second playback moment.

6. A device delay detection device, Characterized in that, Comprising: A playback module, configured to play a test frame sequence, where the test frame sequence is generated based on a target data frame and M - 1 test data frames. The target data frame and the M - 1 test data frames are obtained by a detection device in response to a user operation on the device under test. The target data frame is used to cause the device under test to vibrate at a first frequency, and the M - 1 test data frames are used to cause the device under test to vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold. M is an integer greater than 1. Before the device under test vibrates according to the target data frame, the playback program of the device under test outputs a test level signal and continuously outputs the test level signal for a subsequent period of time; A first sending module, configured to send a test level signal to the detection device as a detection signal when playing the target data frame, so that the detection device determines a first playback moment according to the test level signal; A second sending module, configured to send an actual level signal to the detection device as the detection signal when it is detected that the target data frame is being played, so that the detection device determines a second playback moment according to the actual level signal and determines a delay result according to the first playback moment and the second playback moment.

7. A device delay detection system, characterized in that, it includes: a device under test, a sensing device and a detection device; The detection device is configured to, in response to a user operation on the device under test, obtain a target data frame and M - 1 test data frames. The target data frame is used to cause the device under test to vibrate at a first frequency, and the M - 1 test data frames are used to cause the device under test to vibrate at a second frequency. The first frequency is higher than a preset frequency threshold, and the second frequency is lower than the preset frequency threshold. M is an integer greater than 1. Before the device under test vibrates according to the target data frame, the playback program of the device under test outputs a test level signal and continuously outputs the test level signal for a subsequent period of time; The detection device is configured to add the target data frame to the first frame of the sequence of the M - 1 test data frames to obtain a test frame sequence; The device under test is configured to play a test frame sequence, where the test frame sequence includes M test frames, and at least one of the M test frames is a target data frame. M is an integer greater than 1; The device under test is further configured to send a test level signal to the detection device as a detection signal when playing the target data frame; The detection device is configured to determine a first playback moment according to the test level signal when the detection signal is the test level signal sent by the device under test; The sensing device is configured to send an actual level signal to the detection device as the detection signal when it is detected that the target data frame is being played; The detection device is further configured to determine a second playback moment according to the actual level signal when the detection signal is the actual level signal sent by the sensing device; The detection device is further configured to determine a delay result corresponding to the device under test according to the first playback moment and the second playback moment.

8. An electronic device, characterized in that, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute the device delay detection processing method according to any one of claims 1 to 4 by executing the executable instructions.

9. A computer-readable medium having a computer program stored thereon, characterized in that, when the computer program is executed by a processor, the device delay detection processing method according to any one of claims 1 to 4 is implemented.

10. A computer program product, characterized in that, the computer program product includes computer instructions, the computer instructions are stored in a computer-readable storage medium, a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the device delay detection processing method according to any one of claims 1 to 4.

Images