Image frame loss detection method, device, storage medium, and computer program product

Abstract

A method for detecting image frame loss comprises: acquiring first coding data corresponding to each of a plurality of first image frames and a color signal corresponding to each of at least one second image frame; performing a conversion on the color signal corresponding to each of at least one second image frame to acquire second coding data corresponding to each of at least one second image frame; and comparing the first coding data corresponding to each of a plurality of first image frames with the second coding data corresponding to each of at least one second image frame to determine whether a frame loss situation exists, wherein the first coding data corresponding to each of a plurality of first image frames and the second coding data corresponding to each of at least one second image frame include color coding data corresponding to each of M image blocks, and each image block has one color within the image frame.

Description

Technology Field

[0001] Related applications

[0002] This application claims priority to Chinese patent application No. 2021101054579, titled “METHOD, APPARATUS, DEVICE, AND STORAGE MEDIUM FOR DETECTING IMAGE FRAME LOSS,” filed with the Chinese Intellectual Property Office on January 26, 2021, which is incorporated herein by reference in its entirety.

[0003] The embodiments of this application relate to the field of artificial intelligence technology, in particular, to a method, device, storage medium, and computer program product for detecting image frame loss. Background Technology

[0004] With the continuous advancement of image processing technology, in order to meet the high requirements of users for the smoothness of the display of terminal devices, it is necessary to detect whether frame loss occurs in image frames displayed on terminal devices.

[0005] In the existing method, each of the multiple display target image frames is assigned a color. By performing a round-robin method on the multiple image frames according to different colors, it is determined whether frame loss occurs for the image frame displayed on the terminal device by comparing it with the multiple display target image frames.

[0006] However, when a relatively small number of image frames are used in a round-robin method, it is assumed that the number of image frames in the round-robin method is n. When n frames or a number of frames that are multiples of n are lost when comparing an image frame displayed on a terminal device with a plurality of target image frames, the actual image frame currently received by the terminal device is the same as the image frame that should have been received when no frame loss occurred. Therefore, the terminal device cannot detect frame loss, which causes low accuracy in frame loss detection.

[0007] Embodiments of this application provide a method, apparatus, device, storage medium, and computer program product for detecting image frame loss.

[0008] According to a first aspect, an image frame loss detection method applicable to a test device is provided, the method comprising: acquiring first coded data corresponding to each of a plurality of first image frames; acquiring a color signal corresponding to each of at least one second image frame, wherein the at least one second image frame is acquired by a terminal device by performing image rendering on the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames; converting the color signal corresponding to each of the at least one second image frame to acquire second coded data corresponding to each of the at least one second image frame; and comparing the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame to acquire a frame loss detection result; wherein each of the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of the at least one second image frame comprises color-coded data corresponding to each of M image blocks, wherein M is an integer greater than 1, and each image block has color within the image frame.

[0009] According to a second aspect, an image frame loss detection method applicable to a terminal device is provided, the method comprising: acquiring first coded data corresponding to each of a plurality of first image frames; performing image rendering for a plurality of first image frames based on the first coded data corresponding to each of a plurality of first image frames; displaying at least one second image frame acquired by rendering; collecting a color signal corresponding to each of at least one second image frame by means of an arranged photosensitive sensor; and transmitting the color signal corresponding to each of at least one second image frame to a test device, wherein the test device acquires second coded data corresponding to each of at least one second image frame based on the color signal, and compares the first coded data corresponding to each of a plurality of first image frames with the second coded data corresponding to each of at least one second image frame to obtain a frame loss detection result. Each of the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of at least one second image frame includes color-coded data corresponding to each of M image blocks, where M is an integer greater than 1, and each image block has color within the image frame.

[0010] According to a third aspect, an image frame loss detection method applicable to a server is provided, the method comprising: acquiring first coded data corresponding to each of a plurality of first image frames; transmitting the first coded data corresponding to each of a plurality of first image frames to a terminal device, wherein the terminal device performs image rendering for a plurality of first image frames based on the first coded data corresponding to each of a plurality of first image frames, displays at least one second image frame obtained by rendering, and collects a color signal corresponding to each of at least one second image frame by a photosensitive sensor arranged in the terminal device while displaying each of the at least one second image frames; and transmitting the first coded data corresponding to each of a plurality of first image frames to a test device, wherein after acquiring the color signal, the test device acquires second coded data corresponding to each of at least one second image frame based on the color signal collected by the photosensitive sensor, and compares the first coded data corresponding to each of a plurality of first image frames with the second coded data corresponding to each of at least one second image frame to obtain a frame loss detection result. Each of the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of at least one second image frame includes color-coded data corresponding to each of M image blocks, where M is an integer greater than 1, and each image block has color within the image frame.

[0011] According to a fourth aspect, a test device is provided, and the test device includes a first acquisition unit, a second acquisition unit, a conversion unit, and a comparison unit. The first acquisition unit is configured to acquire first coded data corresponding to each of a plurality of first image frames. The second acquisition unit is configured to acquire a color signal corresponding to each of at least one second image frame, and at least one second image frame is acquired by a terminal device by performing image rendering on the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames. The conversion unit is configured to convert the color signal corresponding to each of the at least one second image frame in order to acquire second coded data corresponding to each of the at least one second image frame. The comparison unit is configured to compare the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame in order to acquire a frame loss detection result; Each of the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of at least one second image frame includes color-coded data corresponding to each of M image blocks, where M is an integer greater than 1, and each image block has color within the image frame.

[0012] According to the fifth aspect, a terminal device is provided, and the terminal device includes an acquisition unit, a rendering unit, and a display unit. The acquisition unit is configured to acquire first coded data corresponding to each of a plurality of first image frames from a server. The rendering unit is configured to perform image rendering for a plurality of first image frames based on the first coded data corresponding to each of a plurality of first image frames. The display unit is configured to display at least one second image frame acquired by rendering; to collect a color signal corresponding to each of the at least one second image frame by means of an arranged photosensitive sensor; and to transmit the color signal corresponding to each of the at least one second image frame to a test device—the test device acquires second coded data corresponding to each of the at least one second image frame based on the color signal, and compares the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame to obtain a frame loss detection result—; Each of the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of at least one second image frame includes color-coded data corresponding to each of M image blocks, where M is an integer greater than 1, and each image block has color within the image frame.

[0013] According to the sixth aspect, a server is provided, and the server includes an acquisition unit and a transmission unit. The acquisition unit is configured to acquire first coded data corresponding to each of a plurality of first image frames. The transmission unit is configured to transmit the first coded data corresponding to each of a plurality of first image frames to a terminal device—the terminal device performs image rendering for a plurality of first image frames based on the first coded data corresponding to each of a plurality of first image frames, displays at least one second image frame acquired by rendering, and collects a color signal corresponding to each of at least one second image frame by a photosensitive sensor arranged in the terminal device while displaying each of the at least one second image frames—; and to transmit the first coded data corresponding to each of a plurality of first image frames to a test device—the test device, after acquiring the color signal, acquires second coded data corresponding to each of at least one second image frame based on the color signal collected by the photosensitive sensor, and compares the first coded data corresponding to each of a plurality of first image frames with the second coded data corresponding to each of at least one second image frame to obtain a frame loss detection result; Each of the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of at least one second image frame includes color-coded data corresponding to each of M image blocks, where M is an integer greater than 1, and each image block has color within the image frame.

[0014] According to the seventh aspect, a computer device is provided, the computer device comprises one or more processors and memory, the memory is configured to store computer-readable instructions, and one or more processors are configured to call and operate computer-readable instructions stored in memory to perform the steps of the method in the embodiments of this application.

[0015] According to the eighth aspect, one or more computer-readable storage media configured to store computer-readable instructions are provided, and the computer-readable instructions cause a computer to perform a step of the method in an embodiment of this application.

[0016] According to the ninth aspect, a computer program product comprising computer-readable instructions is provided, wherein the computer-readable instructions cause a computer to perform a step of the method in an embodiment of this application. Brief explanation of the drawing

[0017] To more clearly explain the technical solution in the embodiments of this application, the following is a brief introduction to the accompanying drawings required to describe the embodiments. Clearly, the accompanying drawings in the following description merely illustrate some embodiments of this application, and a person skilled in the art can still derive other drawings from these accompanying drawings without creative effort. FIG. 1 is a schematic diagram of an image frame loss detection system according to an embodiment of this application. FIG. 2 is a schematic diagram of an image frame loss detection system according to an embodiment of this application. FIG. 3 is a schematic flowchart of an image frame loss detection method according to an embodiment of this application. FIG. 4 is a schematic diagram of the interaction process of an image frame loss detection method according to an embodiment of this application. FIG. 5 is a schematic block diagram of a test device according to an embodiment of this application. FIG. 6 is a schematic block diagram of a terminal device according to an embodiment of this application. FIG. 7 is a schematic block diagram of a server according to an embodiment of this application. FIG. 8 is a schematic structural diagram of a computer device according to an embodiment of this application. Specific details for implementing the invention

[0018] The following describes the technical solution of the embodiments of this application with reference to the attached drawings in the embodiments of this application. Clearly, the described embodiments are only a part, not all, of the embodiments of this application. With respect to the embodiments of this application, all other embodiments obtained by a person skilled in the art without creative effort will fall within the scope of protection of this application.

[0019] Currently, multiple image frames in a round-robin manner are transmitted to a terminal device via a cloud server. The multiple image frames in the round-robin manner include multiple image frames of different colors. For example, five color image frames including red, blue, yellow, white, and black are transmitted in a round-robin manner, thereby enabling the terminal device to render and display image frames of different colors; subsequently, to determine whether frame loss has occurred, the image frames rendered by the terminal device are compared with the image frames transmitted by the server. However, a relatively small number of image frames in the round-robin manner easily causes errors in frame loss detection. For example, when the round-robin method is performed on image frames according to five colors including red, blue, yellow, white, and black, it is assumed that after the terminal device renders and displays each image frame, five frames are effectively lost following the red image frame. In this case, the terminal device must acquire the blue image frame in the next round through rendering. In this case, the frame loss that occurred cannot be detected.

[0020] Based on the foregoing, current frame loss detection technology cannot guarantee the accuracy of frame loss detection. To solve this technical problem, in this application, an image frame is partitioned into a plurality of image blocks, and each image block has color within a single image frame, thereby each image frame has rich color, and thereby the accuracy of frame loss detection is improved.

[0021] FIG. 1 is a schematic diagram of an image frame loss detection system according to an embodiment of this application. As illustrated in FIG. 1, the image frame loss detection system (100) includes a server (110), a terminal device (120), and a test device (130). The server (110) is connected to the terminal device (120) and the test device (130), respectively, via a wired or wireless method. The terminal device (120) is connected to the test device (130) via a wired or wireless method. For example, one or more photosensitive sensors (121) may be arranged on the terminal device (120), and the photosensitive sensors (121) are connected to the test device (130).

[0022] The server (110) may be a cloud server. In different application scenarios, the server (110) may be configured to implement different functions. For example, in a cloud gaming scenario, the server (110) may be a cloud gaming server. In this embodiment, the server (110) is configured to code the color of an image block in which a plurality of display target image frames are partitioned, acquire coded data corresponding to each of the plurality of image frames, and continuously transmit the coded data corresponding to each of the plurality of image frames to a terminal device (120) and / or a test device (130).

[0023] Cloud gaming, also referred to as gaming on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables thin clients with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud gaming scenario, the game runs on a cloud server rather than on the player's game terminal, and the cloud server renders game scenes into video and audio streams and transmits these streams over a network to the player's game terminal. The player's game terminal is not required to possess powerful graphics computing and data processing capabilities, but is only required to have basic streaming media playback capabilities and the ability to acquire commands entered by the player and transmit those commands to the cloud server.

[0024] Based on the technical means above, in a cloud gaming scenario, game images generated on the server end must be transmitted to a terminal device for display. In addition to this, the server may further transmit other images, such as stored video images, read video images from online programs, acquired live video images, etc., to the terminal device for real-time display. In the process where the server transmits multiple image frames corresponding to game images, video images, etc., to the user's terminal device in real-time for display, frame loss is caused by network jitter, the coding and decoding efficiency of the terminal device, and the transmission efficiency for display, which results in a cold and non-live viewing experience for the user. Therefore, a set of quantifiable indicators is required to collect statistics on frame loss.

[0025] The solution of this application is not limited to applications for cloud gaming test scenarios, but may additionally be applications for other scenarios where frame loss is required to be tested for terminal devices.

[0026] For example, the terminal device (120) may be any terminal device having a display function, such as a mobile phone, pad, computer, TV, virtual reality (VR) terminal device, augmented reality (AR) terminal device, terminal device related to industrial control, terminal device related to autonomous driving, terminal device related to telemedicine, terminal device related to a smart city, terminal device related to a smart home, etc. The terminal device in this embodiment of this application may also be a wearable device. A wearable device may also be referred to as a wearable smart device and is a collective term for wearable devices developed by intelligently designing for daily wear based on wearable technology, e.g., glasses, gloves, watches, clothing, and shoes. A wearable device is a portable device that is worn directly by the human body or integrated into the user's clothing or accessories. In some embodiments, the terminal device (120) may additionally be only a display device, e.g., a display. The display may be a flexible display, and the display may be further arranged to have a non-rectangular irregular shape, i.e., a special-shape display. The display may be a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, etc. The terminal device (120) may be stationary or movable.

[0027] The terminal device (120) receives coded data of a plurality of display target image frames transmitted by the server (110), performs image rendering based on the coded data of the plurality of image frames, and then displays at least one rendered image frame.

[0028] For example, a photosensitive sensor (121) arranged on a terminal device (120) is configured to acquire a color signal of an image block on an image frame displayed on the terminal device (120). For example, the photosensitive sensor (121) has a one-to-one correspondence with an image block within each image frame. In other words, each photosensitive sensor (121) is arranged on an area where the image block is displayed on the display of the terminal device.

[0029] FIG. 2 is a schematic structural diagram of an image frame loss detection system according to an embodiment of this application. As illustrated in FIG. 2, an image frame displayed on a terminal device (120) comprises six image blocks. A photosensitive sensor (121) is arranged in an area where each image block is displayed on the display of the terminal device (120). Each photosensitive sensor (121) is connected to a test device (130) via a wired or wireless method. Each photosensitive sensor (121) is configured to collect a light signal displayed on the corresponding image block, and the test device (130) is configured to convert the light signal into a color signal corresponding to the image block.

[0030] In an embodiment, the photosensitive sensors are arranged so as to correspond to an area where each image block is displayed on the display of a terminal device. A color signal corresponding to each second image frame includes a color signal corresponding to each image block within the second image frame. After a light signal is collected by the corresponding photosensitive sensor, the color signal corresponding to each image block is obtained by converting the light signal displayed on the image block.

[0031] It should be understood that FIG. 2 illustrates an example only. Each image frame may contain more or fewer image blocks, and a corresponding number of photosensitive sensors are arranged according to the number of image blocks. Additionally, each image block has one color within each image frame, and the area corresponding to each image block has N colors.

[0032] Referring to FIG. 1, the test device (130) receives coded data corresponding to at least one rendered image frame transmitted by the terminal device (120). For example, the test device (130) receives a color signal corresponding to at least one image frame transmitted by the photosensitive sensor (121) and converts the color signal corresponding to each image frame into corresponding coded data.

[0033] This application is described in detail below using several embodiments.

[0034] FIG. 3 is a schematic diagram of the interaction process of an image frame loss detection method according to an embodiment of this application. As illustrated in FIG. 3, the method comprises the following steps.

[0035] S301: The server acquires first coded data corresponding to each of the multiple first image frames.

[0036] S302: The server transmits first coded data corresponding to each of the plurality of first image frames to the terminal device.

[0037] S303: The server transmits first coded data corresponding to each of the multiple first image frames to the test device.

[0038] S304: The terminal device performs image rendering for a plurality of first image frames based on first coded data corresponding to each of a plurality of first image frames.

[0039] S305: The terminal device displays at least one second image frame obtained by rendering.

[0040] S306: The photosensitive sensor collects a color signal corresponding to each of at least one second image frame.

[0041] S307: The test device acquires a color signal corresponding to at least one second image frame collected by a photosensitive sensor.

[0042] S308: In order to acquire second coded data corresponding to each of at least one second image frame, the test device converts a color signal corresponding to each of at least one second image frame collected by a photosensitive sensor.

[0043] S309: To obtain a frame loss detection result, the test device compares first coded data corresponding to each of a plurality of first image frames from a server with second coded data corresponding to each of at least one second image frame.

[0044] First coded data corresponding to each of the plurality of first image frames may be generated by a server, or first coded data corresponding to each of the plurality of first image frames may be received by a server from another server.

[0045] The test device may also acquire a color signal corresponding to at least one second image frame in a different way, and the color signal corresponding to at least one second image frame is not limited to being collected and transmitted by a photosensitive sensor.

[0046] In the conventional method, when the number of colors of a plurality of first image frames transmitted to a terminal device in a round-robin manner by a server is relatively small, for example, when five first image frames of colors including red, blue, yellow, white, and black are transmitted in a round-robin manner, after the terminal device renders and displays each of the first image frames, for example, after five frames are effectively lost after the red image frame, the terminal device still displays the blue image frame. In this way, the test device cannot detect the frame loss that has occurred. When the number of colors of a plurality of first image frames transmitted to a terminal device in a round-robin manner by a server is large, there is a small color difference between adjacent first image frames. That is, the values ​​of the color signals are small and easy to overlap, and frame loss cannot be accurately detected.

[0047] Based on the foregoing, in order to obtain more accurate detection results and reduce detection errors, in this embodiment of the application, the server may partition each of a plurality of first image frames into M image blocks. Accordingly, the coded data corresponding to each first image frame includes color-coded data corresponding to each of the M image blocks, where M is an integer greater than 1. It should be understood that each image block has a color within the first image frame. In the embodiment, the region corresponding to each image block has N color options, where N is an integer greater than 1. Therefore, an M*N color image frame can be set in a round-robin manner across a plurality of first image frames, and it is not necessary to set an excessive number of colors. In this way, rich color variation between a plurality of first image frames can be ensured, thereby improving the accuracy of frame loss detection.

[0048] It should be understood that each color option corresponds to a value of color-coded data, and N color options correspond to different values ​​of color-coded data. In other words, there is a one-to-one correspondence between the color options and the color-coded data. For example, the color-coded data corresponding to each color option has the same length, and for example, the color-coded data occupies 1 bit.

[0049] For example, as illustrated in FIG. 2, the server partitions each first image frame into six image blocks, and the color of each image block is one of three color options. In the current image frame, the colors of different image blocks may be the same or different. The server sets a corresponding value for color-coded data for each image block. For example, the value of color-coded data corresponding to white is 1, the value of color-coded data corresponding to red is 2, and the value of color-coded data corresponding to black is 3. For example, the first coded data corresponding to each of the plurality of first image frames may have values ​​of 111111 for the first image frame, 11112 for the second image frame, 111113 for the third image frame, 111121 for the fourth image frame, 111122 for the fifth image frame, and 11123 for the sixth image frame.

[0050] It should be understood that when each image frame is partitioned into M image blocks and the region corresponding to each image block has N color options, in this case, there are a total of M*N color coding combinations, and more image blocks to which the first image frame is partitioned result in more accurate image frame loss detection. However, more photosensitive sensors corresponding to the number of image blocks are available, which results in higher complexity of acquisition and computing for the test device and higher test costs. The number of photosensitive sensors can be specifically configured according to actual application scenarios.

[0051] Any second image frame is obtained by rendering the first image frame. Therefore, each second image frame contains M image blocks, each image block has a color within the second image frame, and the color of each image block within the second image frame must be the same as the color of each image block within the corresponding first image frame. For example, the region corresponding to each image block within the second image frame has N color options.

[0052] For example, any one of a plurality of first image frames or at least one second image frame includes three or six image blocks. The area corresponding to each image block may include three color options: black, white, and gray. However, to improve detection accuracy, N color options having large differences between color signals may be assigned, for example, two of the N color options may have the largest difference between all possible colors, e.g., black and white, and for example, three color options may be black, white, and red, or black, white, and blue, etc.

[0053] Steps (S304 and S305) are described as follows.

[0054] In an embodiment, the rendering frame rate of the terminal device may be 60 frames per second.

[0055] It should be understood that due to network jitter, frame loss may occur for a plurality of first image frames received by a terminal device compared with a plurality of first image frames transmitted by a server. Alternatively, due to the influence of rendering capability, frame loss may occur for at least one second image frame obtained by rendering each received image frame by the terminal device compared with a plurality of first image frames transmitted by a server or a plurality of first image frames received by the terminal device.

[0056] In an embodiment, the terminal device renders each first image frame based on first coded data corresponding to each first image frame according to the sequence in which each first image frame is received.

[0057] In an embodiment, before the terminal device performs image rendering for a plurality of first image frames, the coded data corresponding to each received first image frame is decoded to obtain a decoding result, and the first image frame is rendered and displayed according to the decoding result.

[0058] Step (S306) is described as follows.

[0059] In conventional technology, when acquiring a second image frame rendered by a terminal device and comparing the second image frame with a first image frame transmitted by a server to determine whether frame loss occurs, the following two methods are often used. Method I: Using a detection tool, such as a log capture tool (named Systrace) provided by the Android system, to capture system logs and acquire logs of the terminal device, and analyzing the captured logs via a script to obtain information about the second image frame displayed on the terminal device. Method II: Continuously capturing information about the image frame displayed on the terminal device via system commands of the terminal device, such as the performance test tool PerfDog. However, the detection tool in Method I is complex to use, requires a technician very familiar with the system to analyze the results, and the analysis process takes a long time, which is not suitable for testing a large number of devices. In Method II, due to consideration of security issues, system commands of the terminal device are clipped, and command information cannot be collected on the terminal device, which may result in the inability to detect frame loss of the terminal device.

[0060] In conclusion, the frame loss detection method provided in the related technology has the problem of low frame loss detection efficiency. To solve this technical problem, this application may arrange a photosensitive sensor on a terminal device. The color signal of an image frame displayed on the terminal device may be collected by the photosensitive sensor, and the test device may convert the color signal to obtain second coded data of the image frame. Finally, the second coded data of the obtained image frame is compared with the first coded data of the image frame obtained from the server, thereby enabling frame loss detection and improving the efficiency of frame loss detection.

[0061] The photosensitive sensors can be arranged in each of the regions corresponding to M image blocks of the terminal device.

[0062] For example, for any second image frame among the above-mentioned at least one second image frame, M photosensitive sensors each output a color signal of an area corresponding to each image block within the second image frame. The color signal may be a brightness value of at least one color channel. For example, the color signal is (255, 255, 255) in terms of three RGB color channels.

[0063] It should be understood that, regarding step (S308), in order to determine through comparison whether at least one second image frame rendered and displayed on a terminal device corresponds to a plurality of first image frames transmitted by a server, a color signal corresponding to each of at least one second image frame is required to be converted into second coded data corresponding to each of at least one second image frame, and frame loss detection is performed by comparing the second coded data corresponding to each of at least one second image frame with the first coded data corresponding to each of the plurality of first image frames transmitted by the server.

[0064] For example, a color signal is used to represent the color of each image block. For example, for a grayscale image having a single color channel, the color is black when the brightness value of the color channel is 0, the color is white when the brightness value is 255, and the color is gray when the brightness value is 100 to 150. In another example, for an RGB image having three color channels, the brightness value (0, 0, 0) for the three color channels represents black, the brightness value (255, 0, 0) for the three color channels represents red, the brightness value (255, 255, 255) for the three color channels represents white, and so on.

[0065] Additionally, the color-coded data of each image block can be determined based on the color signal. For example, the value of the color-coded data corresponding to the color signal can be determined according to the correspondence between the color signal and the value of the color-coded data.

[0066] For example, when the second image frame is a grayscale image and the brightness value is 255, the corresponding value of the color-coded value is determined to be 1. When the brightness value is between 100 and 150, the corresponding value of the color-coded data is determined to be 2. When the brightness value is 0, the corresponding value of the color-coded data is determined to be 3. Additionally, second coded data corresponding to each of at least one second image frame is obtained.

[0067] For example, it is assumed that each of the plurality of first image frames and at least one second image frame includes six image blocks, and the region corresponding to each image block has three color options, and the second coded data corresponding to each of the at least one second image frame is continuously converted to have values ​​of 111111, 11112, and 111123 by using the collected color signal.

[0068] For example, in this embodiment, during the determination of corresponding color-coded data based on a color signal, the corresponding color signal may be determined as the corresponding color based on a preset error value. For example, when the color signal corresponds to white having a brightness value that is different from 0 by ±10, i.e., [-10, +10], the value of the color-coded data corresponding to white is 1, and 10 is the preset error value. When the number of color channels is 2 or more, each color channel must be assigned a corresponding error value.

[0069] In step (S309), the frame loss detection result includes determining whether frame loss occurs and the lost frame when frame loss occurs.

[0070] For example, assuming that the values ​​of the second coded data corresponding to each of at least one second image frame determined based on a color signal collected by a photosensitive sensor are consecutively 111111, 11112, and 111123, in the above-described embodiment, it can be learned that the second coded data corresponding to each of at least one second image frame is identical to the first coded data corresponding to the first image frame, the second image frame, and the sixth image frame, among the plurality of first image frames transmitted by the server, through comparison with the values ​​of the first coded data corresponding to each of the plurality of first image frames, namely 111111 for the first image frame, 11112 for the second image frame, 111113 for the third image frame, 111121 for the fourth image frame, 111122 for the fifth image frame, and 11123 for the sixth image frame. In other words, a total of three image frames, including the third to fifth image frames, are lost. Therefore, the frame loss is determined to occur in at least one second image frame displayed on the terminal device.

[0071] In this embodiment of the application, whether frame loss occurs is determined by comparing first coded data corresponding to each of a plurality of first image frames from a server with second coded data corresponding to each of at least one second image frame rendered and displayed on a terminal device. Each of the first coded data corresponding to each of a plurality of first image frames and the second coded data corresponding to each of at least one second image frame includes color-coded data corresponding to each of M image blocks, where M is an integer greater than 1, and each image block has color within the image frame. Since each image frame is partitioned into a plurality of image blocks, the problem of low frame loss detection accuracy during image frame loss detection is not caused by a relatively small number of image frames in a round-robin manner.

[0072] Additionally, in this application, a photosensitive sensor can collect a color signal of at least one image frame, and coded data corresponding to each of at least one image frame is obtained by converting the corresponding color signal. Compared to a solution that determines whether frame loss occurs through script analysis, the technical solution of this application has a relatively simple process, thereby improving the frame loss detection efficiency.

[0073] During the transmission of image frames, frame loss is easily caused by the influence of network quality or the rendering capabilities of the terminal device when performing image rendering. When a relatively small number of frames are lost, the impact on the user's viewing experience is less significant. However, when a relatively large number of frames are lost, freezing and unsmoothness can be perceived as obvious, which has a major impact on the user's viewing experience.

[0074] In order to prevent the user from feeling cold or non-active while watching, in this embodiment, the frame loss situation is further analyzed and determined, and based on the image frame loss rate and the preset frame loss rate, it is determined whether the requirements for the frame rate are satisfied.

[0075] FIG. 4 is a schematic flowchart of an image frame loss detection method according to an embodiment of this application.

[0076] Based on the above-described embodiment, in this embodiment of the application, after it is determined that frame loss occurs, whether a frame rate requirement is satisfied is determined according to coded data corresponding to each of a plurality of image frames from a server and coded data corresponding to each of at least one image frame. Specifically, the process illustrated in FIG. 4 is as follows.

[0077] S401: The test device determines an image frame loss rate based on first coded data corresponding to each of a plurality of first image frames and second coded data corresponding to each of at least one second image frame.

[0078] S402: The test device determines that the frame rate requirement is not satisfied when the image frame loss rate exceeds a preset frame loss rate.

[0079] S403: The test device determines that the frame rate requirement is satisfied when the image frame loss rate is less than or equal to a preset frame loss rate.

[0080] For step (S401), the test device can determine the number of image frames in which at least one second image frame is less than the number of first image frames transmitted by the server by comparing the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame from the server. The ratio of the number of missing image frames to the number of the plurality of first image frames transmitted by the server is used as the image frame loss rate.

[0081] It should be understood that different preset frame loss rates can be set according to actual application scenarios and detection requirements. In the embodiment, the preset frame loss rate is 10%.

[0082] Based on any one of the above-described embodiments, in this embodiment of the application, when it is determined that frame loss occurs, first indication information is generated to indicate that frame loss occurs in at least one second image frame.

[0083] In an embodiment of this application, when it is determined that the frame rate requirement is not satisfied, second instruction information is generated to indicate that the frame rate requirement is not satisfied.

[0084] In an embodiment, the test device may transmit the first instruction information to any device having a display function for displaying the first instruction information to a user, or the test device may directly display the first instruction information.

[0085] In an embodiment, the test device may transmit the second instruction information to any device having a display function for displaying the second instruction information to a user, or the test device may directly display the second instruction information.

[0086] In this embodiment of the application, the test device determines an image frame loss rate based on first coded data corresponding to each of a plurality of first image frames and second coded data corresponding to each of at least one second image frame, which are from a server. When the image frame loss rate exceeds a preset frame loss rate, it is determined that the frame rate requirement is not satisfied, and when the image frame loss rate is less than or equal to the preset frame loss rate, it is determined that the frame rate requirement is satisfied. Identifying whether the frame rate requirement is satisfied helps to effectively identify the impact of the frame rate on the user's viewing experience.

[0087] The steps in the flowchart of the embodiment are displayed sequentially according to the commands of the arrows, but these steps are not necessarily performed sequentially according to the order commanded by the arrows. Unless otherwise explicitly specified in this specification, the execution of the steps is not strictly limited, and the steps may be performed in a different order. Additionally, at least some of the steps in the flowchart of the embodiment described above may include multiple steps or multiple stages. Steps or stages are not necessarily performed at the same moment but may be performed at different moments. Steps or stages are not necessarily performed sequentially but may be performed in turn, or alternately with another step, or at least some of the steps, or stages of another step.

[0088] Referring to FIGS. 3 and FIGS. 4, the foregoing describes in detail an example of a method of this application. Referring to FIGS. 5 through 7, an example of a device of this application will be described in detail. It should be understood that the example of a device corresponds to an example of a method, and that for similar descriptions, reference is made to the example of a method.

[0089] FIG. 5 is a schematic block diagram of a test device according to an embodiment of this application. As shown in FIG. 5, the test device comprises the following:

[0090] A first acquisition unit (510) configured to acquire first coded data corresponding to each of a plurality of first image frames;

[0091] A second acquisition unit (520) configured to acquire a color signal corresponding to at least one second image frame, wherein at least one second image frame is acquired by a terminal device by performing image rendering on a plurality of first image frames based on first coded data corresponding to a plurality of first image frames.

[0092] A conversion unit (530) configured to convert a color signal corresponding to at least one second image frame in order to obtain second coded data corresponding to at least one second image frame; and

[0093] A comparison unit (540) configured to compare first coded data corresponding to each of a plurality of first image frames with second coded data corresponding to each of at least one second image frame in order to obtain a frame loss detection result.

[0094] Each of the first image frames and each of at least one second image frame is partitioned into M image blocks. The first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame. The second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, where M is an integer greater than 1. Each image block has color within the corresponding image frame.

[0095] In the embodiment, the region corresponding to each image block has N color options, N is an integer greater than 1, and the color of each image block is one of the N color options.

[0096] In the embodiment, each of the N color options corresponds to a value of color-coded data, and different color options correspond to different values ​​of color-coded data.

[0097] In the example, the color-coded data corresponding to each of the N color options has the same length.

[0098] In an embodiment, the test device further includes a determination unit (550) configured to perform a frame rate test according to first coded data corresponding to each of a plurality of first image frames and second coded data corresponding to each of at least one second image frame when the comparison unit (540) determines that frame loss is occurring.

[0099] In an embodiment, the determination unit (550) is further configured to determine an image frame loss rate according to first coded data corresponding to each of a plurality of first image frames and second coded data corresponding to each of at least one second image frame; to determine that the frame rate requirement is not satisfied when the image frame loss rate exceeds a preset frame loss rate; and to determine that the frame rate requirement is satisfied when the image frame loss rate is less than or equal to a preset frame loss rate.

[0100] In an example, the color signal includes a brightness value of at least one color channel.

[0101] FIG. 6 is a schematic block diagram of a terminal device (600) according to an embodiment of this application. As illustrated in FIG. 6, the terminal device (600) comprises the following:

[0102] An acquisition unit (610) configured to acquire first coded data corresponding to each of a plurality of first image frames;

[0103] A rendering unit (620) configured to perform image rendering for a plurality of first image frames based on first coded data corresponding to each of a plurality of first image frames; and

[0104] A display unit (630) configured to display at least one second image frame obtained by rendering; collect a color signal corresponding to each of at least one second image frame by means of an arranged photosensitive sensor; and transmit a color signal corresponding to each of at least one second image frame to a test device - the test device obtains second coded data corresponding to each of at least one second image frame based on the color signal, and compares first coded data corresponding to each of a plurality of first image frames with second coded data corresponding to each of at least one second image frame to obtain a frame loss detection result.

[0105] Each of the first image frames and each of at least one second image frame is partitioned into M image blocks. The first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame. The second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, where M is an integer greater than 1. Each image block has color within the corresponding image frame.

[0106] In the embodiment, the region corresponding to each image block has N color options, and N is an integer greater than 1.

[0107] In an embodiment, each of the N color options corresponds to a value of color-coded data, and the N color options correspond to different values ​​of color-coded data.

[0108] In the example, the color-coded data corresponding to each of the N color options has the same length.

[0109] In an embodiment, the photosensitive sensor is arranged on an area corresponding to each image block within at least one second image frame.

[0110] FIG. 7 is a schematic block diagram of a server (700) according to an embodiment of this application. As illustrated in FIG. 7, the server (700) comprises the following:

[0111] An acquisition unit (710) configured to acquire first coded data corresponding to each of a plurality of first image frames; and

[0112] A transmission unit (720) configured to transmit first coded data corresponding to each of a plurality of first image frames to a terminal device - the terminal device performs image rendering for a plurality of first image frames based on first coded data corresponding to each of a plurality of first image frames, displays at least one second image frame obtained by rendering, and while displaying each of the at least one second image frame, collects a color signal corresponding to each of the at least one second image frame by a photosensitive sensor arranged in the terminal device.

[0113] The transmitting unit (720) is further configured to transmit first coded data corresponding to each of a plurality of first image frames to a test device, thereby, after acquiring a color signal, the test device acquires second coded data corresponding to each of at least one second image frame based on the color signal collected by a photosensitive sensor, and in order to obtain a frame loss detection result, compares the first coded data corresponding to each of a plurality of first image frames with the second coded data corresponding to each of at least one second image frame.

[0114] Each of the first image frames and each of at least one second image frame is partitioned into M image blocks. The first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame. The second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, where M is an integer greater than 1. Each image block has color within the corresponding image frame.

[0115] In the embodiment, the region corresponding to each image block has N color options, and N is an integer greater than 1.

[0116] In an embodiment, each of the N color options corresponds to a value of color-coded data, and the N color options correspond to different values ​​of color-coded data.

[0117] In the example, the color-coded data corresponding to each of the N color options has the same length.

[0118] In an embodiment, the acquisition unit (710) partitions each of a plurality of first image frames into M image blocks; codes the colors of the M image blocks to acquire color-coded data corresponding to each of the M image blocks; and is further configured to combine the color-coded data corresponding to each of the M image blocks to acquire first coded data corresponding to the first image frame.

[0119] The server provided in the above-described embodiment can implement the technical solution on the server side in the above-described method embodiment. Its implementation principles and technical effects are similar. Details are not described again in this specification.

[0120] FIG. 8 is a schematic diagram of a computer device (800) according to an embodiment of this application. The test device illustrated in FIG. 8 includes one or more processors (810), and one or more processors (810) can call and operate computer-readable instructions from memory, thereby enabling the implementation of the method in an embodiment of this application.

[0121] In an embodiment, as illustrated in FIG. 8, the computer device (800) may further include memory (820). One or more processors (810) may call a computer-readable instruction from the memory (820) and execute the computer-readable instruction so as to implement the method in the embodiment of this application.

[0122] The memory (820) may be a component independent of one or more processors (810) or may be integrated into one or more processors (810).

[0123] In an embodiment, as illustrated in FIG. 8, the test device (800) may further include a transceiver (830). One or more processors (810) may control the transceiver (830) to communicate with another device. Specifically, the transceiver may transmit information or data to another device or receive information or data transmitted by another device.

[0124] The transceiver (830) may include a transmitter and a receiver. The transceiver (830) may further include an antenna, and the number of antennas may be one or more.

[0125] In an embodiment, the computer device (800) may be a test device, and a process corresponding to the test device may be implemented in the method of the embodiment of this application.

[0126] In an embodiment, the computer device (800) may be a terminal device, and a process corresponding to the terminal device may be implemented in the method of the embodiment of this application.

[0127] In an embodiment, the computer device (800) may be a server, and a process corresponding to the server may be implemented in the method of the embodiment of this application.

[0128] It should be understood that one or more processors in this embodiment of this application may be integrated circuit chips having signal processing capabilities. In the implementation process, the steps in the method embodiment described above may be implemented by using hardware-integrated logic circuits within one or more processors, or by using instructions in the form of software. The one or more processors described above may be one or more general-purpose processors, one or more digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The one or more processors may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of this application. The one or more general-purpose processors may be one or more microprocessors, or the one or more processors may be any one or more conventional processors, etc. The steps of the method disclosed with reference to the embodiments of this application may be performed and completed directly by using one or more hardware decoding processors, or may be performed and completed by using a combination of hardware and software modules within one or more decoding processors. Software modules may be stored in storage media mature in the art, such as RAM, flash memory, read-only memory (ROM), programmable ROM, electrically erasable programmable memory, or registers. The storage medium is located within the memory. One or more processors read information within the memory and, in combination with their hardware, complete the steps of the method described above.

[0129] It may be understood that the memory in the embodiments of this application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory may be read-only memory (ROM), programmable read-only memory (RPOM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may be random access memory (RAM) used as an external cache. By way of example rather than by limiting description, many forms of RAM, e.g., Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DR RAM) may be used. The memory in the system and method described in this specification is intended to include these and any other suitable type of memory, but is not limited thereto.

[0130] It should be understood that memory is an example, but is not intended to be limited. For example, memory in the embodiments of this application may alternatively be static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), direct rambus random access memory (DR RAM), etc. That is, the memory described in this embodiment of this application is intended to include memory and any other suitable type of memory, but is not limited thereto.

[0131] An embodiment of this application further provides one or more computer-readable storage media configured to store computer-readable instructions.

[0132] In the embodiments, a computer-readable storage medium may be applied to an electronic device in the embodiments of this application, and a computer-readable command causes a computer to perform a corresponding procedure in various methods in the embodiments of this application. For brevity, details are not described again herein.

[0133] An embodiment of this application further provides a computer-readable instruction product comprising computer-readable instructions.

[0134] In the embodiments, a computer program product may be applied to an electronic device in the embodiments of this application, and a computer-readable instruction causes a computer to perform a corresponding procedure in the method in the embodiments of this application. For brevity, details are not described further herein.

[0135] A person skilled in the art will recognize, in combination with the examples of unit and algorithm steps described in the embodiments disclosed herein, that this application may be implemented using electronic hardware, or a combination of computer software and electronic hardware. Whether a function is executed in a mode of hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art may use different methods to implement the described function for each specific application, but such implementations should not be considered outside the scope of this application.

[0136] For the purpose of convenient and simple explanation, regarding the detailed operation process of the above-described device, apparatus, and unit, reference is made to the corresponding process in the above-described method example, and it will be clearly understood by those skilled in the art that details are not described again in this specification.

[0137] It should be understood that in some of the embodiments provided in this application, the disclosed devices, apparatuses, and methods may be implemented in different ways. For example, the described apparatus is merely exemplary. For example, a unit partitioning is merely a logical functional partitioning and may be different during actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not performed. Additionally, the mutual coupling or direct coupling or communication connection shown or discussed may be implemented through some interfaces. Indirect coupling or communication connection between devices or units may be implemented electronically, mechanically, or in other forms.

[0138] The unit described as a separate part may or may not be physically separate, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in a single position or distributed across multiple network units. Some or all of the units may be selected according to practical requirements to achieve the purpose of the solution in the embodiment.

[0139] Additionally, the functional units in the embodiments of this application may be integrated into a single processing unit, each unit may exist physically independently, or two or more units may be integrated into a single unit.

[0140] When a function is implemented in the form of a software function unit and is sold or used as an independent product, the function may be stored within a computer-readable storage medium. With this understanding, the technical solution of this application, or parts contributing to the related technology, or parts of the technical solution may be implemented in the form of a software product. The software product is stored within a storage medium and includes some instructions for instructing a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method described in the embodiments of this application. The said storage medium includes any medium capable of storing program code, such as a USB flash disk, a removable hard disk, read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk.

[0141] The foregoing description is merely a specific embodiment of this application, but is not intended to limit the scope of protection of this application. Any modification or substitution readily derived by a person skilled in the art within the technical scope disclosed in this application will fall within the scope of protection of this application. Therefore, the scope of protection of this application will be subject to the scope of protection of the appended claims.

Claims

Claim 1 A method for detecting image frame loss applicable to a test device, comprising: a step of acquiring first coded data corresponding to each of a plurality of first image frames; a step of acquiring a color signal corresponding to each of at least one second image frame, wherein the at least one second image frame is acquired by a terminal device by performing image rendering on the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames; and a step of converting the color signal corresponding to each of the at least one second image frame in order to acquire second coded data corresponding to each of the at least one second image frame. A method for detecting image frame loss, comprising the step of comparing the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame in order to obtain a frame loss detection result, wherein each of the first image frames and each of the at least one second image frame are partitioned into M image blocks, the first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame, and the second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, wherein M is an integer greater than 1, and each image block has color within the corresponding image frame. Claim 2 A method for detecting image frame loss according to claim 1, wherein the region corresponding to each of the image blocks has N color options, N is an integer greater than 1, and the color of each of the image blocks is one of the N color options. Claim 3 An image frame loss detection method according to paragraph 2, wherein each of the N color options corresponds to a value of the color-coded data, and different color options correspond to different values ​​of the color-coded data. Claim 4 An image frame loss detection method according to paragraph 2, wherein the color-coded data corresponding to each of the N color options has the same length. Claim 5 An image frame loss detection method according to claim 1, further comprising the step of performing a frame rate test according to the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of the at least one second image frame when the frame loss detection result indicates that frame loss has occurred. Claim 6 In claim 5, the step of performing a frame rate test according to the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of the at least one second image frame comprises: determining an image frame loss rate according to the first coded data corresponding to each of the plurality of first image frames and the second coded data corresponding to each of the at least one second image frame; determining that a frame rate requirement is not satisfied when the image frame loss rate exceeds a preset frame loss rate; and determining that a frame rate requirement is satisfied when the image frame loss rate is less than or equal to the preset frame loss rate. Claim 7 A method for detecting image frame loss according to claim 1, wherein a corresponding photosensitive sensor is arranged on an area where each of the image blocks is displayed on a display of the terminal device, and the color signal corresponding to each second image frame includes a color signal corresponding to each of the image blocks within the second image frame, and after a light signal is collected by the corresponding photosensitive sensor, the color signal corresponding to each of the image blocks is obtained by converting the light signal displayed on the image block. Claim 8 A method for detecting image frame loss applicable to a terminal device comprises: acquiring first coded data corresponding to each of a plurality of first image frames; performing image rendering on the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames; displaying at least one second image frame obtained by the rendering; collecting a color signal corresponding to each of the at least one second image frame by means of an arranged photosensitive sensor; and transmitting the color signal corresponding to each of the at least one second image frame to a test device - wherein the test device acquires second coded data corresponding to each of the at least one second image frame based on the color signal, and compares the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame to obtain a frame loss detection result - wherein each of the first image frames and each of the at least one second image frames are partitioned into M image blocks, and the first coded data corresponding to the first image frame is the M within the first image frame An image frame loss detection method comprising color-coded data corresponding to each of an image block, wherein the second coded data corresponding to a second image frame comprises color-coded data corresponding to each of the M image blocks within the second image frame, M is an integer greater than 1, and each image block has color within the corresponding image frame. Claim 9 A method for detecting image frame loss according to claim 8, wherein a corresponding photosensitive sensor is arranged on an area corresponding to each image block within at least one second image frame, the color signal corresponding to each second image frame includes a color signal corresponding to each image block within the second image frame, and after a light signal is collected by the corresponding photosensitive sensor, the color signal corresponding to each image block is obtained by converting the light signal displayed on the image block. Claim 10 A method for detecting image frame loss applicable to a server, comprising: acquiring first coded data corresponding to each of a plurality of first image frames; transmitting the first coded data corresponding to each of the plurality of first image frames to a terminal device; wherein the terminal device performs image rendering for the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames, displays at least one second image frame obtained by the rendering, and collects a color signal corresponding to each of the at least one second image frame by a photosensitive sensor arranged in the terminal device while each of the at least one second image frames is displayed.A method for detecting image frame loss, comprising the step of transmitting the first coded data corresponding to each of the plurality of first image frames to a test device; wherein the test device, after acquiring the color signal, acquires the second coded data corresponding to each of the at least one second image frame based on the color signal collected by the photosensitive sensor, and compares the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame to obtain a frame loss detection result; wherein each of the first image frames and each of the at least one second image frames are partitioned into M image blocks, the first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame, and the second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, wherein M is an integer greater than 1, and each image block has color within the corresponding image frame. Claim 11 In claim 10, the step of acquiring first coded data corresponding to each of the plurality of first image frames comprises: partitioning each of the plurality of first image frames into M image blocks; coding the colors of the M image blocks to acquire color-coded data corresponding to each of the M image blocks; and combining the color-coded data corresponding to each of the M image blocks to acquire the first coded data corresponding to the first image frame. Claim 12 As a test device, a first acquisition unit configured to acquire first coded data corresponding to each of a plurality of first image frames; a second acquisition unit configured to acquire a color signal corresponding to each of at least one second image frame - the at least one second image frame is acquired by a terminal device by performing image rendering on the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames -; and a conversion unit configured to convert the color signal corresponding to each of the at least one second image frame in order to acquire second coded data corresponding to each of the at least one second image frame; A test device comprising, for obtaining a frame loss detection result, a comparison unit configured to compare the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame, wherein each of the first image frames and each of the at least one second image frame are partitioned into M image blocks, the first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame, and the second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, wherein M is an integer greater than 1, and each image block has color within the corresponding image frame. Claim 13 As a terminal device, the device comprises: an acquisition unit configured to acquire first coded data corresponding to each of a plurality of first image frames from a server; a rendering unit configured to perform image rendering on the plurality of first image frames based on the first coded data corresponding to the plurality of first image frames; and a display unit configured to display at least one second image frame acquired by the rendering, collect a color signal corresponding to each of the at least one second image frame by means of an arranged photosensitive sensor, and transmit the color signal corresponding to each of the at least one second image frame to a test device - the test device acquires second coded data corresponding to each of the at least one second image frame based on the color signal, and compares the first coded data corresponding to each of the plurality of first image frames with the second coded data corresponding to each of the at least one second image frame to obtain a frame loss detection result - wherein each of the first image frames and each of the at least one second image frames are partitioned into M image blocks, and the first coded data corresponding to the first image frame is the M images within the first image frame A terminal device comprising color-coded data corresponding to each of the blocks, wherein the second coded data corresponding to the second image frame comprises color-coded data corresponding to each of the M image blocks within the second image frame, M is an integer greater than 1, and each image block has color within the corresponding image frame. Claim 14 As a server, the acquisition unit is configured to acquire first coded data corresponding to each of a plurality of first image frames; and the transmission unit is configured to transmit the first coded data corresponding to each of the plurality of first image frames to a terminal device, wherein the terminal device performs image rendering for the plurality of first image frames based on the first coded data corresponding to each of the plurality of first image frames, displays at least one second image frame acquired by the rendering, and collects a color signal corresponding to each of the at least one second image frame by a photosensitive sensor arranged in the terminal device while displaying each of the at least one second image frame. The transmission unit is further configured to transmit the first coded data corresponding to each of the plurality of first image frames to a test device, wherein after acquiring the color signal, the test device acquires second coded data corresponding to each of the at least one second image frame based on the color signal collected by the photosensitive sensor, and to acquire a frame loss detection result, the first coded data corresponding to each of the plurality of first image frames is... A server that compares with second coded data, wherein each of the first image frame and each of the at least one second image frame are partitioned into M image blocks, the first coded data corresponding to the first image frame includes color-coded data corresponding to each of the M image blocks within the first image frame, the second coded data corresponding to the second image frame includes color-coded data corresponding to each of the M image blocks within the second image frame, M is an integer greater than 1, and each image block has color within the corresponding image frame. Claim 15 A computer device comprising one or more processors and memory, wherein the memory is configured to store computer-readable instructions, and the one or more processors are configured to call and operate the computer-readable instructions stored in the memory, and perform the image frame loss detection method according to any one of claims 1 to 11. Claim 16 One or more computer-readable storage media configured to store computer-readable instructions, wherein the computer-readable instructions enable a computer to perform the image frame loss detection method according to any one of claims 1 to 11. Claim 17 A computer program stored in a computer-readable storage medium, wherein the computer program comprises computer-readable instructions, and the computer-readable instructions, when executed by one or more processors, implement the image frame loss detection method according to any one of claims 1 to 11.

Images