Display device test method and apparatus

Abstract

Disclosed are a display device test method and apparatus, which relate to the technical field of multimedia. The method comprises: acquiring display information of when a display device plays a video stream, and then on the basis of the display information, determining the display effect of the display device, wherein the video stream comprises N video frames, N being an integer greater than or equal to 2; each of the N video frames comprises a color block, and colors of the color blocks in different video frames are periodically arranged; and the display information comprises the color of a color block displayed by the display device and a corresponding test time. Compared with the case where the test data is video data obtained by means of a high-speed camera performing secondary recording, and the data volume is relatively large, in the present application, test data (i.e. display information) comprises only the color of a color block displayed by a display device and a corresponding test time, and thus the amount of data processing is reduced, and on the basis of the test data, the process of obtaining the display effect of the display device can be accelerated, thereby improving the test efficiency.

Description

Display device detection method and device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on January 22, 2024, with application number 202410092697.3 and application name “A Display Device Detection Method and Apparatus”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of multimedia technology, and in particular to a display device detection method and apparatus. Background Art

[0003] Display device testing involves using software or hardware to test the display performance of a display device, such as contrast, brightness, and frame rate. This testing helps quantify the user experience. For example, when contrast, brightness, or frame rate are within a certain range, the user experience is better.

[0004] Current methods for display device testing include: playing a pre-recorded video (such as ultra-high frame rate video or ultra-high definition video) on the display device, and then using a high-speed camera to capture the playback image of the display device to obtain test data (video data). Subsequently, this test data is analyzed and processed to obtain the test results. However, this test data is obtained by recording the playback image twice with a high-speed camera, and the data volume of the test data is large. Therefore, the processing time for analyzing and processing the test data to obtain the test results is also long, which leads to low test efficiency. Summary of the Invention

[0005] The present application provides a display device detection method and apparatus to solve the problem of low efficiency in detecting the display effect of the display device using the detection data recorded by a high-speed camera when the detection data has a large amount of data.

[0006] This application adopts the following technical solution.

[0007] In the first aspect, the present application provides a display device detection method. The display device detection method is executed by a computing device or a chip in the computing device, such as the computing device can refer to a computer or a detection device, etc. Exemplarily, the method includes: the computing device obtains display information when the display device plays a video stream, and then determines the display effect of the display device based on the display information. The video stream includes N video frames, N is an integer greater than or equal to 2, each of the N video frames includes a color block, and the colors of the color blocks of different video frames are arranged periodically, and the display information includes the color of the color block displayed by the display device and the corresponding detection time.

[0008] Compared with the detection data, which is the video data obtained by secondary recording of a high-speed camera, the data volume is larger. In this application, the detection data (i.e., display information) only includes the color of the color block displayed by the display device and the corresponding detection time, which reduces the data processing volume. Then, the computing device can speed up the display effect of the display device based on the detection data, thereby improving the detection efficiency.

[0009] Furthermore, each video frame in the video stream played by the display device includes a color block. The colors of the color blocks in different video frames are arranged periodically, so that the color of the color block changes continuously according to the playback of the video stream. Furthermore, the computing device can only detect the corresponding area of ​​the color block on the display device, and obtain the color of the color block displayed by the display device and the corresponding detection time, thereby reducing the amount of data collected. In other words, further reducing the amount of data processing and improving detection efficiency.

[0010] In one possible implementation, N video frames are divided into M groups of video frames, where M is an integer greater than or equal to 1, and the color sequence arrangement of any group of video frames in the M groups of video frames is: the color block in the first frame is the first color, and the color block in the N / Mth frame is the N / Mth color.

[0011] Exemplarily, when N is 2 and M is 1, the color sequence arrangement of a group of video frames is: the color block in the first frame is the first color (such as red), and the color block in the second frame is the second color (such as green).

[0012] When N is 6 and M is 2, the color sequence arrangement of any group of video frames in the two groups of video frames is: the color block in the first frame is the first color (such as red), the color block in the second frame is the second color (such as green), and the color of the color block in the third frame is the third color (such as blue).

[0013] It is worth noting that the above-mentioned first frame, second frame, and third frame are the order in a group of video frames.

[0014] In the present application, N video frames are divided into M groups of video frames, and the color sequence arrangement of each group of video frames in the M groups of video frames is the same, that is, the color of the color block in the first frame is the first color, and the color block in the N / Mth frame is the N / Mth color, which is conducive to achieving the continuous periodic change of the color block at the same position according to the playback of the video stream. Furthermore, the computing device can only detect the area where the display device displays the color block and obtain the display message, thereby reducing the amount of data collection, thereby reducing the amount of data processing and improving the detection efficiency. In addition, the periodic change of the color of the color block in the video stream is conducive to determining the jitter (also known as frame skipping) when the display device plays the video stream, thereby improving the accuracy of detecting the display effect of the display device.

[0015] In a possible implementation, each of the N video frames includes a color block, and the color block is at the same position in the video frame.

[0016] For example, the color block is located at the upper left corner or the lower left corner of the video frame.

[0017] In one possible implementation, each of the N video frames includes a color block, and the positions of the color blocks in any group of the M groups of video frames are arranged as follows: the color block in the first frame is located at the first position in the first frame, and the color block in the N / Mth frame is located at the N / Mth position in the N / Mth frame.

[0018] For example, when N is 2 and M is 1, the positions of the color blocks in a group of video frames are arranged as follows: the color block in the first frame is located at the first position in the first frame (such as the upper left corner), and the color block in the second frame is located at the second position in the second frame (such as the upper right corner).

[0019] When N is 6 and M is 2, the color sequence arrangement of any group of video frames in the two groups of video frames is: the color block in the first frame is located at the first position in the first frame (such as the upper left corner), the color block in the second frame is located at the second position in the second frame (such as the upper right corner), and the color block in the third frame is located at the third position in the third frame (such as the lower right corner).

[0020] In a possible implementation, each of the N video frames includes at least two color blocks, and each of the at least two color blocks has a fixed position in the video frame.

[0021] Exemplarily, each video frame includes two color blocks, and the two color blocks are fixedly located at the upper left corner and the upper right corner of the video frame.

[0022] In the present application, when a video frame has at least two color blocks, multi-region detection of the display device can be implemented to obtain the display effects of the multiple regions, which is conducive to partitioning detection of the display device and improves the accuracy of detection of the display device.

[0023] In one possible implementation, each of the N video frames includes at least two color blocks, and the positions of the first color blocks in any group of video frames in the M groups of video frames are arranged as follows: the first color block in the first frame is located at the first position in the first frame, and the first color block in the N / Mth frame is located at the N / Mth position in the N / Mth frame, and the first color block is any one of the at least two color blocks.

[0024] In a possible scenario, the first position and the N / Mth position corresponding to each color block in at least two color blocks are different.

[0025] Exemplarily, each video frame includes two color blocks, and the positions of the two color blocks within a group of video frames vary periodically. For example, a group of video frames includes two video frames, and color block a of the two color blocks is located at the upper left corner in the first frame and at the lower left corner in the second frame, and color block b is located at the upper right corner in the second frame and at the lower right corner in the second frame.

[0026] In the present application, when a video frame has at least two color blocks, multi-region detection of the display device can be implemented to obtain the display effects of the multiple regions, which is conducive to partitioning detection of the display device and improves the accuracy of detection of the display device.

[0027] In one possible implementation, a computing device determines a display effect of a display device based on display information, including determining a first display duration of a video frame in a video stream based on the earliest and latest detection times of color blocks of the same color. Furthermore, the computing device compares the first display duration with the inverse of the frame rate of the video stream or the second display duration of the video frame in the video stream to obtain the display effect of the display device.

[0028] For example, the display effects include still frames, freezes, jitters, etc.

[0029] In the present application, the computing device compares the first display duration of the video frame actually determined with the frame rate or second display duration that the video frame should have, thereby obtaining the difference between the quality of the video stream played by the display device and the quality that the video stream should have, and obtains the display effect of the display device based on the difference, which is conducive to improving the accuracy of the display effect.

[0030] In one possible implementation, the computing device determines the display effect of the display device based on the display information, including: the computing device determines the first display duration of the video frame in the video stream based on the earliest detection time and the latest detection time of the color blocks of the same color, and then compares the color of the color block when the display device displays the video frame with the color of the color block in the video frame included in the video stream to obtain the display effect of the display device.

[0031] For example, the display effect includes color display accuracy (or color display quality), black screen, etc.

[0032] In the present application, a computing device compares the color of a color block in an actually determined video frame with the color of the color block that the video frame should have, thereby obtaining the difference between the quality of the color actually displayed by the display device and the color quality that the color block in the video frame should have, and obtains the display effect of the display device based on the difference, which is conducive to improving the accuracy of the display effect.

[0033] In one possible implementation, the display device detection method further includes: the computing device determining, in response to a user's operation instruction, a first time at which an operation instruction is received, where the operation instruction is used to control the display device to change a device state. The display effect includes a response latency of the display device. The computing device determining the display effect of the display device based on the display information includes: the computing device obtaining a second time at which the display device performs the operation in response to the operation instruction, and then determining the response latency of the display device using the first time and the second time. The second time is later than the first time, and the detection time includes the second time.

[0034] In this application, a computing device determines the display device's response latency to an operation instruction based on a first time when the operation instruction is received and a second time when the operation is performed. Because the second time is determined based on the color of a color block in the display device and the corresponding detection time, it accurately reflects the time it takes for the display device to perform the operation corresponding to the operation instruction. This improves the accuracy of determining the second time, thereby improving the accuracy of the response latency calculated by the computing device based on the first and second times.

[0035] In one possible implementation, if the first color in the color block appears for the first time, the earliest detection time of the color block of the first color is used as the second time. If the color at the same position in the color block switches from the second color to the third color, the earliest detection time of the color block of the third color is used as the second time. If the fourth color in the color block appears last, the latest detection time of the color block of the fourth color is used as the second time.

[0036] In one possible implementation, the display device detection method further includes: a computing device acquiring an original video stream, decoding the original video stream to obtain N first video frames, sequentially superimposing color blocks on the N first video frames to obtain N second video frames. The computing device then encodes the N second video frames to obtain a video stream; the video stream has the same frame rate as the original video stream, or the display duration of each video frame in the video stream is the same as the display duration of each video frame in the original video stream.

[0037] In this application, a computing device processes an original video stream to ensure that each of N video frames includes a color block. The color block is located at the same position in the video frame, and the colors of the color blocks in different video frames are arranged periodically. The computing device can then obtain the color of the color block and the corresponding detection time when the display device plays the aforementioned video stream. Based on the color of the color block and the corresponding detection time, the computing device can reduce the amount of data processing and improve detection efficiency.

[0038] In a possible implementation, the above display effects include: one or more of: still frame, freeze, frame drop, frame rate switching, black screen and jitter.

[0039] In one possible implementation, a computing device obtains display information when a display device displays a video stream, including: the computing device detects the reflection intensity of light reflected by a color block within the three wavelength ranges of red, green, and blue during the process of the display device playing the video stream, and then determines the color of the color block based on the reflection intensity within the three wavelength ranges of red, green, and blue.

[0040] In this application, since most colors can be synthesized from the three primary colors (red, green, and blue), the computing device can accurately determine the color of the color block based on the intensity of the light reflected by the color block in the three wavelength ranges of red, green, and blue, thereby improving the accuracy of obtaining the color of the color block in the video frame, thereby improving the accuracy of detecting the display effect of the display device.

[0041] In a second aspect, the present application also provides a display device detection device. The display device detection device is applied to a computer system or a computing device that supports the computer system to implement the display device detection method. The display device detection device includes various modules for executing the display device detection method in the first aspect or any optional implementation of the first aspect. For example, the display device detection device includes: an acquisition module and a first determination module. Among them,

[0042] An acquisition module is configured to acquire display information when a display device plays a video stream. The video stream includes N video frames, where N is an integer greater than or equal to 2. Each of the N video frames includes a color block, and the colors of the color blocks in different video frames are periodically arranged. The display information includes the color of the color block displayed by the display device and the corresponding detection time.

[0043] The first determining module is used to determine the display effect of the display device according to the display information.

[0044] For more detailed implementation details of the display device detection apparatus, reference may be made to the description of any implementation method in the first aspect above, as well as the contents of the following specific implementation methods, which will not be elaborated here.

[0045] In a third aspect, the present application provides a chip comprising: a processor and a power supply circuit; the power supply circuit is configured to supply power to the processor, and the processor is configured to execute the method in the first aspect or any possible implementation of the first aspect.

[0046] In a fourth aspect, the present application provides a computing device. The computing device includes a memory and a processor. The memory is used to store computer instructions. When the processor executes the computer instructions, it implements the method described in the first aspect or any possible implementation of the first aspect. In one possible scenario, the computing device may also include a light sensing device and / or a signal receiving device.

[0047] In a fifth aspect, the present application provides a computer-readable storage medium having a computer program or instructions stored therein, which, when executed by a processing device, implements the method of the first aspect or any possible implementation of the first aspect.

[0048] In a sixth aspect, the present application provides a computer program product. The computer program product includes a computer program or instructions, and when the computer program or instructions are executed by a processing device, the method in the first aspect or any possible implementation of the first aspect is implemented.

[0049] The beneficial effects of the second to sixth aspects above can be referred to the first aspect or any possible implementation of the first aspect, and will not be described in detail here. Based on the implementations provided in the above aspects, this application can also be further combined to provide more implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] FIG1 is a schematic diagram of a detection system provided by the present application;

[0051] FIG2 is a flow chart of a video stream processing method provided by the present application;

[0052] FIG3 is a first schematic diagram of a second video frame provided by the present application;

[0053] FIG4 is a second schematic diagram of a second video frame provided by the present application;

[0054] FIG5 is a third schematic diagram of a second video frame provided by the present application;

[0055] FIG6 is a fourth schematic diagram of a second video frame provided by the present application;

[0056] FIG7 is a fifth schematic diagram of a second video frame provided by the present application;

[0057] FIG8 is a schematic flow chart of a display device detection method provided by the present application;

[0058] FIG9 is a flow chart of a method for determining a time delay provided by the present application;

[0059] FIG10 is a first structural diagram of a display device detection apparatus provided by the present application;

[0060] FIG11 is a second structural diagram of the display device detection apparatus provided by the present application;

[0061] FIG12 is a schematic diagram of the structure of a computing device provided in this application. DETAILED DESCRIPTION

[0062] The present application provides a display device detection method. The display device detection method includes: obtaining display information when the display device displays a video stream, and then determining the display effect of the display device based on the display information. The video stream includes N video frames, where N is an integer greater than or equal to 2. Each of the N video frames includes a color block, and the colors of the color blocks of different video frames are arranged periodically. The display information includes the color of the color block displayed by the display device and the corresponding detection time.

[0063] Compared with the video data obtained by the secondary recording of the detection data by a high-speed camera, the data volume is large. In this application, the detection data (i.e., display information) only includes the color of the color block displayed by the display device and the corresponding detection time, which reduces the data processing volume. Based on the detection data, the display effect of the display device can be obtained faster, thereby improving the detection efficiency.

[0064] Furthermore, each video frame in the video stream played by the display device includes a color block. The colors of the color blocks in different video frames are arranged periodically, so that the color of the color block changes continuously according to the playback of the video stream. Furthermore, only the corresponding area of ​​the color block on the display device can be detected to obtain the color of the color block displayed by the display device and the corresponding detection time, thereby reducing the amount of data collected. In other words, further reducing the amount of data processing and improving detection efficiency.

[0065] The terms used in the embodiments of this application are only used to explain the specific embodiments of this application and are not intended to limit this application. The following is a brief introduction to some concepts that may be involved in this application.

[0066] Video encoding: The process of compressing multiple frames of video into a bit stream.

[0067] Video decoding: The process of restoring the bitstream into multiple frames of reconstructed images according to specific syntax rules and processing methods.

[0068] A light-sensing device, also known as a photosensitive device, is a device capable of sensing light, light intensity, or color. These devices can utilize the photoelectric effect, optical sensors, or other technologies to sense and measure light parameters. Examples of light-sensing devices include photoresistors, photodiodes / transistors, and spectrometers.

[0069] In order to make the description of the following embodiments clear and concise, an introduction to related technologies is first given.

[0070] Figure 1 is a schematic diagram of the detection system provided by the present application. The video processing process may include but is not limited to: video acquisition, video encoding, video transmission, video decoding and playback.

[0071] The detection system in FIG1 includes a display device 110 and a detection device 120. The detection device 120 is deployed in front of the display screen of the display device 110 to detect the display effect of the display device 110.

[0072] In a possible scenario, during the process of detecting the display device, the display device 110 and the detection device 120 may communicate via a wired or wireless manner.

[0073] For example, the video stream played by the display device 110 is the video stream transmitted to the display device 110 in real time by the detection device 120 .

[0074] The display device 110 and the detection device 120 can communicate with each other through wired means, such as Ethernet, optical fiber, and a peripheral component interconnect express (PCIe) bus provided in a computer system for connecting the light sensing device 121 and the computing device 123, or an extended industry standard architecture (EISA) bus, a unified bus (Ubus or UB), a compute express link (CXL), a cache coherent interconnect for accelerators (CCIX), etc.; or they can communicate through wireless means, such as the Internet, wireless fidelity (WIFI), and ultra wide band (UWB) technology.

[0075] In another possible scenario, during the process of detecting the display device 110 , the display device 110 is not connected to the detection device 120 .

[0076] For example, the video stream played by the display device 110 has been stored in the display device 110 .

[0077] The detection device 120 includes a light sensing device 121 , a signal receiving device 122 and a computing device 123 .

[0078] Display device 110 is the device under test, which can be a device with a display screen or display function, such as a television, tablet computer, monitor, or mobile phone. Display device 110 plays a video stream, and light sensor 121 acquires display information from the video stream played by display device 110. This display information includes at least one of light intensity, color, and the duration of each frame display.

[0079] In one possible scenario, the light sensing device 121 may be disposed directly in front of the display screen of the display device 110. For example, the light sensing device 121 may be in close contact with the display screen of the display device 110. The light sensing device 121 may be a photoresistor, a photodiode / transistor, or a spectrometer.

[0080] The signal receiving device 122 is used to receive commands sent by the user to the display device 110 via a remote control or other means, such as playback pause commands, playback start commands, and device power-on commands. In other words, when a user sends a command to the display device 110 via a remote control or other means, not only the display device 110 receives the command, but also the signal receiving device 122. The aforementioned other methods include users sending commands to the display device 110 using devices such as mobile phones or tablets. The signal receiving device 122 can be a Bluetooth / infrared receiving and decoding device, etc.

[0081] In one possible scenario, the signal receiving device 122 records the time when the instruction is received.

[0082] The calculation device 123 is used to determine the display effect of the display device 110 according to the display information and / or the time when the signal receiving device 122 receives the instruction.

[0083] The computing device 123 includes a memory, a processor, and a communication interface. For a description of the internal structure of the computing device 123, reference may be made to the content shown in FIG12 below, which will not be described in detail here.

[0084] The light sensing device 121, the signal receiving device 122, and the computing device 123 may communicate via wired or wireless means, and the computing device 123 may communicate via wired or wireless means with the display device 110. For details regarding wired or wireless communication, refer to the description of wired or wireless communication between the display device 110 and the detection device 120, and are not further elaborated here.

[0085] In one possible example, the computing device 123 is not connected to the display apparatus 110 .

[0086] In the above embodiment, the light sensing device 121, the signal receiving device 122, and the computing device 123 are all integrated into the detection device 120. In another embodiment of the present application, the light sensing device 121, the signal receiving device 122, and the computing device 123 are all provided separately. In other words, the system shown in FIG1 includes the display device 110, the light sensing device 121, the signal receiving device 122, and the computing device 123.

[0087] It is worth noting that the above system architecture is only an example and should not be construed as limiting the present application. The above system may further include more or fewer devices or components, such as multiple light sensing devices.

[0088] In order to achieve better detection of the display effect of the display device, the present application also processes the video stream played by the display device. The video stream played by the display device is described in detail below with reference to FIG. 2 .

[0089] As shown in Figure 2, Figure 2 is a schematic flow chart of the video stream processing method provided by this application. The content shown in Figure 2 can be executed by a processing device 200, which can be the detection device 120 in Figure 1. In one possible scenario, the processing device 200 can be the computing device 123 included in the detection device 120 in Figure 1. The video stream processing method can include the following steps S210-S240.

[0090] S210: The processing device 200 obtains an original video stream.

[0091] The original video stream may be video data captured by an electronic device such as a video camera, a camera, a mobile phone, or a watch, or video data output by a rendering engine.

[0092] In a first possible example, the processing device 200 may obtain video data from a memory.

[0093] In a second possible example, the processing device 200 obtains video data transmitted by an electronic device such as a video camera, a camera, a mobile phone, or a watch.

[0094] In a third possible example, the processing device 200 obtains video data output by the rendering engine.

[0095] It should be noted that the above content is only an example provided by the present application and should not be understood as limiting the present application. In other examples of the present application, the processing device 200 can also shoot a video by itself to obtain video data.

[0096] S220: The processing device 200 decodes the original video stream to obtain N first video frames.

[0097] The processing device 200 selects a corresponding decoder based on the encoding format of the video stream. The decoder can be implemented in hardware or software, and common decoders include Fmpeg, VLC, GStreamer, etc. The encoding format of the aforementioned video stream can be determined from the metadata of the video stream, which indicates the encoding format of the video stream.

[0098] The processing device 200 transmits the video stream to the decoder, which parses the video stream and converts it into the original image sequence. This results in N consecutive first video frames, or N consecutive first video frame images. The decoder can be deployed inside the processing device 200. In other embodiments of the present application, the decoder can also be deployed outside the processing device 200, and the decoder is communicatively connected to the processing device 200.

[0099] It should be noted that the following description is made by taking N first video frames and N first video frames in N first video frame images as an example.

[0100] Regarding the decoder parsing the content of the video stream, the following provides a possible example.

[0101] The decoder includes an entropy decoder, an inverse quantizer, an inverse transformer, a filter unit, a memory, an inter-frame predictor, and an intra-frame predictor.

[0102] The inverse quantizer and inverse transformer apply inverse quantization and inverse transformation, respectively, to reconstruct a residual block in the pixel domain, for example, for later use as a reference block of a reference image. The encoder adds the reconstructed residual block to the prediction block produced by the inter-frame predictor or intra-frame predictor to produce a reconstructed image or reconstructed image block.

[0103] The filter unit can be applied to the reconstructed image block to reduce distortion, such as block artifacts. The reconstructed image or reconstructed image block is then stored in a memory as a reference block (or referred to as a first decoded image) and can be used by an inter-frame predictor as a reference block to perform inter-frame prediction on blocks in subsequent video frames or images.

[0104] The decoder uses an entropy decoder, an inverse quantizer, and an inverse transformer to obtain a residual block or residual value, and decodes the video stream to determine whether the current image block uses intra-frame prediction or inter-frame prediction. If it is intra-frame prediction, the intra-frame predictor uses the pixel values ​​of the pixels in the surrounding reconstructed area to construct prediction information according to the intra-frame prediction method used. If it is inter-frame prediction, the inter-frame predictor needs to parse the motion information and use the parsed motion information to determine the reference block in the reconstructed image. The pixel values ​​of the pixels in the block are used as prediction information. The prediction information is combined with the residual information and filtered to obtain the first video frame.

[0105] S230: The processing device 200 sequentially superimposes color blocks on the N first video frames to obtain N second video frames.

[0106] In a possible embodiment, after the processing device 200 sequentially superimposes color blocks in N first video frames, each of the N second video frames includes a color block, the color block is at a fixed position in the video frame, and the colors of the color blocks in different video frames are arranged periodically.

[0107] It is worth noting that the size (height * width) of the color block is smaller than the size of the first video frame. The color block can be superimposed at any position in the video frame, and this application does not limit this. For example, the color block can be superimposed at any corner of the first video frame, or at the center of the first video frame. The area in the second video frame where the color block is superimposed will only display the image corresponding to the color block.

[0108] In one possible implementation, the above-mentioned N video frames can be divided into M groups of video frames, where M is an integer greater than or equal to 1, and the color sequence arrangement of any group of video frames in the M groups of video frames is: the color block in the first frame is the first color, and the color block in the N / Mth frame is the N / Mth color.

[0109] For example, when a group of video frames includes two video frames, the color sequence arrangement of any group of video frames in the M groups of video frames is: the first frame is a first color (e.g., red), and the second frame is a second color (green). The colors of the color blocks of each video frame in the N video frames can be red, green, red, green, etc., that is, red and green are arranged alternately.

[0110] When a group of video frames includes three video frames, the color sequence of any of the M groups of video frames is arranged as follows: the first frame is a first color (e.g., red), the second frame is a second color (e.g., green), and the third frame is a third color (e.g., blue). The colors of the color blocks of each of the N video frames can be red, green, blue, red, green, blue, etc., i.e., red, green, and blue are arranged alternately in this order.

[0111] It should be noted that the first frame and the N / Mth frame are the first frame and the N / Mth frame in each group of video frames, and N / M is an integer.

[0112] Regarding the periodic arrangement of the colors of the color blocks in different video frames, three possible scenarios are provided below.

[0113] In a first possible scenario, the color block is an image with only one color, and the processing device 200 periodically and sequentially superimposes color blocks with at least two different colors onto the first video frame to obtain N second video frames.

[0114] As shown in Figure 3, which is a schematic diagram of the second video frame provided by the present application, the processing device 200 periodically and sequentially superimposes color blocks of red, green and blue onto the first video frame, and each video frame includes only one color block.

[0115] 3 , the processing device 200 superimposes a red color block on the first frame of the N first video frames, superimposes a green color block on the second frame of the N first video frames, superimposes a blue color block on the third frame of the N first video frames, and superimposes a red color block on the fourth frame of the N first video frames. This process repeats until all the video frames of the N first video frames are superimposed with color blocks.

[0116] In the second possible scenario, as shown in Figure 4, Figure 4 is a second schematic diagram of the second video frame provided by the present application. The color block is an image with multiple colors, such as red, green and blue on a color block, or red and green on a color block. The processing device 200 rotates the color block by an angle and superimposes it on a first video frame until each of the N first video frames is superimposed with a color block. Among them, the color sequence arrangement of any group of video frames in a group of video frames after superimposing the color blocks is the same, such as the colors of the corresponding color blocks in the detection area of ​​multiple video frames in a group of video frames are red, green and blue or red and green in sequence. The detection area is the area where the light sensing device in the detection device is deployed on the display device, that is, the area where the light sensing device is attached.

[0117] In this case, each video frame includes only one color block.

[0118] In Example 1, as shown in FIG4(a), a color block has two colors, red and green, with each color occupying half of the color block. The processing device 200 superimposes the unrotated color block on the first frame of N first video frames, rotates the color block 180° and superimposes it on the second frame of the N first video frames, then rotates the color block 180° and superimposes it on the third frame of the N first video frames, and repeats this process until all of the N first video frames are superimposed with the color block.

[0119] In Example 2, as shown in FIG4(b), a color block has two colors, red, green, and blue, and each color occupies half of the color block. The three colors are arranged 60° apart. The processing device 200 superimposes the unrotated color block on the first frame of N first video frames, rotates the color block 60° and then superimposes it on the second frame of the N first video frames, rotates the color block 120° and then superimposes it on the third frame of the N first video frames, rotates the color block 180° and then superimposes it on the fourth frame of the N first video frames, and repeats this process until all video frames of the N first video frames are superimposed with the color block.

[0120] It is worth noting that the above examples are all illustrated using regular color blocks as examples and should not be construed as limiting the present application. In other embodiments of the present application, the color blocks may be irregular. The direction of the above rotation may be either clockwise or counterclockwise, and this is not limited by the present application. Furthermore, the positions of the above color blocks superimposed on the video frame are the same, such as both being in the fixed upper left corner of the video frame, or both being in the fixed upper right corner of the video frame.

[0121] Since the colors of the color blocks superimposed in the two adjacent second video frames at the same position are different, when N second video frames are displayed in sequence, the colors of the color blocks at the same position change according to the changes of the video frames.

[0122] In a third possible scenario, a video frame includes at least two color blocks, and each of the at least two color blocks has a fixed position in the video frame, and the color of each of the at least two color blocks shows periodic changes in different video frames.

[0123] As shown in Figure 5, Figure 5 is a third schematic diagram of the second video frame provided by this application. A video frame includes two color blocks, the two color blocks have fixed positions, and the colors of the two color blocks show periodic changes in different video frames.

[0124] Continuing with Figure 5 , the color block in the upper left corner of the first frame is red, and the color block in the upper right corner of the first frame is green. The color block in the upper left corner of the second frame is green, and the color block in the upper right corner of the second frame is red. The color block in the upper left corner of the third frame is red, and the color block in the upper right corner of the third frame is green. This process repeats until the Nth frame has two color blocks.

[0125] For other examples of each color block in this case, reference may be made to the contents of Example 1 and Example 2 in the second possible case, which will not be described in detail here.

[0126] In the present application, when a video frame has at least two color blocks, multi-region detection of the display device can be implemented to obtain the display effects of the multiple regions, which is conducive to partitioning detection of the display device and improves the accuracy of detection of the display device.

[0127] In a second possible embodiment, after the processing device 200 sequentially superimposes color blocks in N first video frames, each of the N second video frames includes a color block, the color blocks have different positions in the video frames, and the colors of the color blocks in different video frames are periodically arranged.

[0128] In one possible scenario, each of the N video frames includes a color block, and the positions of the color blocks in any group of the M groups of video frames are arranged as follows: the color block in the first frame is located at the first position in the first frame, and the color block in the N / Mth frame is located at the N / Mth position in the N / Mth frame.

[0129] The positions of the color blocks in each of the M groups of video frames are arranged periodically. As shown in Figure 6, which is a fourth schematic diagram of the second video frame provided by this application. Each of the M groups of video frames includes three video frames, with the color block in the first frame located in the upper left corner, the color block in the second frame located in the upper right corner, the color block in the third frame located in the lower right corner, and the color block in the fourth frame located in the upper left corner. This process repeats until the Nth frame contains a color block.

[0130] In one possible example, the colors of the color blocks in each of the M groups of video frames are also arranged periodically. For example, the color block in the first frame is red, the color block in the second frame is green, the color block in the third frame is blue, and the color block in the fourth frame is red.

[0131] For other examples of each color block in this case, reference may be made to the contents of Example 1 and Example 2 in the second possible case, which will not be described in detail here.

[0132] In another possible scenario, each of the N video frames includes at least two color blocks, and the positions of the first color blocks in any group of video frames in the M groups of video frames are arranged as follows: the first color block in the first frame is located at the first position in the first frame, and the color block in the N / Mth frame is located at the N / Mth position in the N / Mth frame.

[0133] It is worth noting that the first positions corresponding to the at least two color blocks are different.

[0134] As shown in Figure 7, Figure 7 is a fifth schematic diagram of the second video frame provided by this application. Each of the M groups of video frames includes three video frames, and each video frame includes two color blocks. In the first frame, color block a is located in the upper left corner, and color block b is located in the upper right corner. In the second frame, color block b is located in the lower left corner, and color block b is located in the upper right corner. In the third frame, color block a is located in the upper left corner, and color block b is located in the upper right corner. This process repeats until the Nth frame has two color blocks.

[0135] In one possible example, the colors of the first color blocks in each of the M groups of video frames are also arranged periodically. For example, color block a in the first frame is red, color block a in the second frame is green, and color block a in the third frame is red. Color block b in the first frame is red, color block b in the second frame is green, and color block b in the third frame is red.

[0136] It is worth noting that the above content is merely an example and should not be construed as limiting the present application. In other embodiments of the present application, the color block may have other colors, such as yellow or gold, and the color block may be positioned in the center, lower center, or upper center of the video frame.

[0137] In the present application, when a video frame has at least two color blocks, multi-region detection of the display device can be implemented to obtain the display effects of the multiple regions, which is conducive to partitioning detection of the display device and improves the accuracy of detection of the display device.

[0138] 2 , the video stream processing method provided in the embodiment of the present application further includes the following step S240 .

[0139] S240: The processing device 200 encodes the N second video frames to obtain a video stream.

[0140] The frame rate of the video stream is the same as that of the original video stream, or the display duration of each video frame in the video stream is the same as that of the original video stream.

[0141] The processing device 200 encodes N second video frames using the same encoding algorithm, encoding parameters, etc. as the original video stream to obtain a video stream. This ensures that the frame rate of the video stream is the same as that of the original data stream or the display duration of each video frame in the video stream is the same as that of each video frame in the original video stream. The above encoding algorithms include but are not limited to H.264, high efficiency video coding (HEVC), etc. The above encoding parameters may include: bit rate, group of picture (GOP) or quantization parameter, etc. Among them, GOP is used to identify the distance between two I frames in the code stream.

[0142] In one possible implementation, the processing device 200 encodes the N second video frames using an encoder to obtain a video stream. The encoder can be deployed inside or outside the processing device 200, and the processing device 200 is communicatively connected to the encoder.

[0143] In this application, the processing device 200 processes the original video stream to ensure that each of the N video frames includes a color block. The color block is located at the same position in the video frame, and the colors of the color blocks in different video frames are arranged periodically. Furthermore, the processing device 200 can obtain the color of the color block and the corresponding detection time when the display device plays the aforementioned video stream. Based on the color of the color block and the corresponding detection time, the processing amount is reduced and the detection efficiency is improved.

[0144] Regarding the processing device 200 encoding N second video frames through an encoder to obtain content of a video stream, a possible example is provided below.

[0145] The encoder includes an inter-frame predictor, an intra-frame predictor, a transformer, a quantizer, and an entropy encoder.

[0146] After the inter-frame predictor and intra-frame predictor in the N second video frames generate a prediction block for the current image block, the encoder subtracts the prediction block from the current image block to be encoded to form a residual image block. The residual video data in the residual block can be contained in one or more transform units (TUs) and applied to a transformer. The transformer transforms the residual video data into residual transform coefficients using a transform such as a discrete cosine transform or a conceptually similar transform. The transformer can convert the residual video data from a pixel value domain to a transform domain, such as a frequency domain.

[0147] The transformer may send the resulting transform coefficients to a quantizer. The quantizer quantizes the transform coefficients to further reduce the bit rate. In some examples, the quantizer may then perform a scan of the matrix containing the quantized residual transform coefficients. Alternatively, an entropy encoder may perform the scan.

[0148] After quantization, an entropy encoder performs entropy encoding on the quantized transform coefficients to obtain a video stream.

[0149] For example, the entropy encoder may perform context-adaptive variable-length coding (CAVLC), context-adaptive binary arithmetic coding (CABAC), syntax-based context-adaptive binary arithmetic coding (SBAC), probability interval partitioning entropy (PIPE) coding, or another entropy coding method or technique. After entropy coding by the entropy encoder, the encoded video stream may be sent to a video decoder or archived for later transmission or retrieval by a video decoder. The entropy encoder may also entropy encode syntax elements for the current image block to be encoded.

[0150] In one possible scenario, the encoder further comprises: an inverse quantizer, an inverse transformer, a filter unit, and a memory. The inverse quantizer and the inverse transformer apply inverse quantization and inverse transformation, respectively, to reconstruct a residual block in the pixel domain, for example, for later use as a reference block of a reference image. The encoder adds the reconstructed residual block to the prediction block generated by the inter-frame predictor or the intra-frame predictor to produce a reconstructed image or a reconstructed image block. The filter unit can be applied to the reconstructed image block to reduce distortion, such as block artifacts. The reconstructed image or reconstructed image block is then stored in the memory as a reference block (or referred to as a first decoded image) and can be used by the inter-frame predictor as a reference block to perform inter-frame prediction on blocks in subsequent video frames or images.

[0151] After obtaining the video stream as shown in FIG. 2 to FIG. 7 , the display device is detected using the video stream to implement the display device detection method shown in FIG. 8 below.

[0152] The following describes in detail the implementation of the display device detection method provided by the embodiment of the present application with reference to the accompanying drawings.

[0153] Here, the display device detection method of an embodiment of the present application is illustrated by the display device 110 and the detection device 120 shown in Figure 1 as an example, and Figure 8 is a flow chart of a display device detection method provided by the present application. Among them, the display device 810 is used to implement the function of the display device 110, and the detection device 820 is used to implement the function of the detection device 120, that is, to implement the functions of the light sensing device 121, the signal receiving device 122 and the computing device 123 in Figure 1. In this embodiment, in the video stream played by the display device 810, the colors of the color blocks of different video frames are arranged periodically, and the detection device 820 can be deployed directly in front of the display screen of the display device 810. The display device detection method includes the following steps S810-S830.

[0154] S810: The display device 810 plays the video stream.

[0155] The display device 810 obtains the video stream from the memory, or receives the video stream transmitted by the detection device 820. The video stream is obtained by processing the method shown in Figures 2 to 7 above. The specific content can be referred to the description of Figures 2 to 7 above and will not be repeated here.

[0156] The display device 810 decodes the video stream and plays it. For the content of the video stream decoded by the display device 810, reference can be made to the description of the original video stream decoding shown in S220 above, which will not be described in detail here.

[0157] Since the colors of the color blocks of different video frames in the video stream are arranged periodically, the color of the area where the color block is located will change continuously as the video stream is played, that is, it will change continuously as the video frame changes.

[0158] S820: The detection device 820 obtains display information when the display device 810 plays the video stream.

[0159] The display information includes the color of the color block displayed by the display device and the corresponding detection time.

[0160] Exemplarily, the detection device 820 periodically detects the display device 810 to obtain the color of the color block displayed by the display device and the corresponding detection time during each detection.

[0161] Since the detection device 820 is deployed in front of the display device 810 and the light sensing device 121 in the detection device 820 can sense light, light intensity or color, the detection device 820 can obtain display information when the display device 810 displays a video stream.

[0162] In a possible implementation, the light sensing device 121 in the detection device 820 periodically detects the color of the color block and the corresponding detection time during the process of the display device 810 displaying the video stream.

[0163] For example, light sensing device 121 in detection device 820 detects the content displayed by display device 810 (e.g., a color block in a video stream) at preset intervals (e.g., 0.001s) to determine the reflection intensity of light reflected from display device 810 within the red, green, and blue wavelength ranges when the color block is displayed. Furthermore, detection device 820 determines the color of the color block at the current detection time based on the reflection intensity within the red, green, and blue wavelength ranges. The light is emitted by light sensing device 121.

[0164] For example, since most colors can be synthesized from the three primary colors (red, green, and blue), the color of the color block can be determined based on the reflection intensity of the light reflected by the color block within the three wavelength ranges of red, green, and blue. Red wavelength range: approximately 620 nanometers (nanometer, nm) to 750 nm, green wavelength range: approximately 495 nm to 570 nm, blue wavelength range: approximately 450 nm to 495 nm. When the display device displays a color block, the light sensing device 121 obtains the reflection intensity value of the light reflected back from the light sensing device 121 within the aforementioned three wavelength ranges, and then calculates the color coordinate value based on the reflection intensity value. For example, according to the theory of three primary colors, the color coordinate value can be calculated using the following formula: X = kR*Rx, Y = kG*Gx, Z = kB*Bx.

[0165] Where Rx, Gx, and Bx represent the reflectance of red, green, and blue, respectively; kR, kG, and kB are constant coefficients whose values ​​depend on the light source and color space used and are predetermined. X, Y, and Z are color coordinates. Reflectance is the reflection intensity divided by the incident intensity, which is the intensity of the light beam emitted by the light sensing device 121 within the aforementioned three wavelength ranges.

[0166] The detection device 820 then converts the color coordinate values ​​into coordinates in another color space (such as RGB, printing color mode (CMYK), HSV (Hue, Saturation, Value), etc.) to determine the color of the current color block. The detection device 820 may use triangulation to convert the color coordinate values ​​into coordinates in another color space.

[0167] The triangulation method is based on the linear transformation relationship between color spaces. It realizes the color space conversion by establishing a triangle containing three known color points (color coordinate values) and calculating the position of the color point to be converted in the triangle.

[0168] In a possible scenario, when the detection device 820 periodically detects the color of the color block, it records the current detection time.

[0169] Illustratively, the display information (the color of the color block and the corresponding detection time) obtained by the detection device 820 through the above detection method may be: 2023-12-20 17:56:31:920 blue; 2023-12-20 17:56:31:921 red…; 2023-12-20 17:56:32:001 red; 2023-12-20 17:56:32:002 red; 2023-12-20 17:56:32:003 green.

[0170] Based on the color change in the displayed information, detection device 820 can determine that the video stream played by display device 810 has switched from video frame a to video frame b, and can then determine the colors of the corresponding color blocks in video frames a and b. For example, detection device 820 can determine that the color block in the frame from 2023-12-20 17:56:32:601 ​​to 2023-12-20 17:56:32:002 is red.

[0171] In the present application, since most colors can be synthesized from the three primary colors (red, green, and blue), the detection device 820 can accurately determine the color of the color block according to the intensity of the light reflected by the color block in the three wavelength ranges of red, green, and blue, thereby improving the accuracy of the color of the color block in the video frame, thereby improving the accuracy of the display effect of the detection display device.

[0172] In one possible scenario, as shown in FIG8 , the light-sensing device 121 in the detection device 820 can be directly attached to the detection area on the display screen of the display device 810. The detection area on the display device 810 will display the color block. In other words, the light-sensing device 121 only needs to detect the color change of the color block during the video stream playback to determine the above-mentioned display information. Exemplarily, the detection area can be the upper left corner of the display device 810. For example, the detection area is the upper left corner of the color block display area on the display device 810, that is, the triangular area a. For each color block included in the video frame in the video stream, a light-sensing device 121 will be attached to the display area corresponding to the color block.

[0173] In a possible embodiment, if the display device 810 displays a black screen, is powered off, or has the screen off, the detection device 820 will also periodically detect the color of the detection area on the display device 810. In other words, after starting the detection, the detection device 820 will continue to detect the display content of the display device 810 to obtain display information.

[0174] For example, when the display device 810 is turned off, on, or paused, the detection device 820 will detect the display device 810 to obtain display information. For example, when the display device 810 is turned off, the detected display information is 2023-12-20 17:56:33:921 black.

[0175] S830: The detection device 820 determines the display effect of the display device according to the display information.

[0176] In a possible embodiment, the display effect may include one or more of still frames, freezes, frame drops, frame rate switching, black screens, and jitters.

[0177] The following provides five possible implementations for the detection device 820 to determine the display effect of the display device according to the display information.

[0178] In a first possible implementation, the detection device 820 determines a first display duration of the video frame based on the earliest and latest detection times of color blocks of the same color. The first display duration is then compared with the inverse of the frame rate of the video stream to determine a freeze or freeze effect.

[0179] For example, the earliest detection time corresponding to red in the above results is 2023-12-20 17:56:31:920, and the latest detection time is 2023-12-20 17:56:32:002. Therefore, the detection device 820 can determine that the first display duration of this frame is 81 milliseconds. The detection device 820 can also determine that the color of the color block corresponding to this frame is red.

[0180] In one possible scenario, because a color block only has a limited number of colors, such as red, green, and blue, the display device 810 periodically displays each of the three colors (red, green, and blue) when playing the video stream. Therefore, each color is associated with a significant amount of time, distributed in a segmented manner. To avoid using the detection times of different video frames with the same color block to calculate the display duration of a video frame, only one color is detected at the same location in the color block between the earliest and latest detection times.

[0181] For example, the existing displayed information is: 2023-12-20 17:56:31:920 blue; 2023-12-20 17:56:32:921 red; …; 2023-12-20 17:56:32:001 red; 2023-12-20 17:56:32:002 red; 2023-12-20 17:56:32:003 green; …; 2023-12-20 17:56:32:080 green; 2023-12-20 17:56:32:160 blue; …; 2023-12-20 17:56:32:240 blue; 2023-12-20 17:56:32:300 red. The detection device 820 uses the earliest detection time 2023-12-20 17:56:32:921 red; ...; 2023-12-20 17:56:32:001 red; 2023-12-20 17:56:32:002 red in this display information to calculate the display duration of the video frame, such as 81 milliseconds.

[0182] In the present application, since most colors can be synthesized from the three primary colors (red, green, and blue), the detection device 820 can accurately determine the color of the color block based on the intensity of the reflection relationship of the color block in the three wavelength ranges of red, green, and blue, thereby improving the accuracy of the display time of the video frame, thereby improving the accuracy of the display effect of the detection display device.

[0183] For example, the detection device 820 can determine the frame rate of the video stream from the metadata of the video stream, such as 60 frames or 120 frames. The reciprocal of the frame rate of the video stream is the second display duration that each video frame in the video stream should have. The detection device 820 compares the first display duration with the second display duration to determine whether the video frame has a frozen frame or a stuck state.

[0184] If the first display duration of a video frame detected is greater than the expected second display duration of a video frame, the video frame will be frozen / stuttered. If the first display duration of a video frame detected is equal to the expected second display duration of a video frame, the video frame is normal.

[0185] It is worth noting that the above description only uses one video frame as an example. In the actual processing process, each frame in the video stream can be compared to determine whether each video frame in the video stream has a still frame / stuttering / jittering situation.

[0186] In a second possible implementation, the detection device 820 determines the first display duration of the video frame based on the earliest detection time and the latest detection time of the color blocks of the same color, and then compares the first display duration with the second display duration of the video frame in the video stream to obtain a still frame or frame rate switching situation in the display effect.

[0187] Exemplarily, if the detection device 820 obtains the display duration of each video frame from the metadata of the video stream, the first display duration is compared with the second display duration to determine whether a still frame occurs in the video frame.

[0188] For the content of the above example, reference may be made to the description of the first possible implementation method in S530, which will not be elaborated here.

[0189] In a third possible implementation, the detection device 820 determines the frame rate a of the video played by the display device 810 based on the first display duration of each video frame. The detection device 820 obtains the frame rate b of the video stream from metadata of the video stream, or determines the frame rate b of the video stream based on the display duration of each video frame recorded in the metadata.

[0190] The detection device 820 compares the frame rate a of the video played by the display device 810 with the frame rate b of the video stream to determine the frame rate switching status.

[0191] If the frame rate a is different from the frame rate b, the detection device 820 determines that a frame rate switching occurs when the display device 810 plays the video stream.

[0192] If the frame rate a is the same as the frame rate b, the detection device 820 determines that a frame rate switching occurs when the display device 810 plays the video stream.

[0193] In one possible scenario, if the frame rate a is less than the frame rate b, the detection device 820 may determine that the display device 810 has lost frames when playing the video stream.

[0194] In a fourth possible implementation, the detection device 820 compares the color of the color block when the display device 810 displays each video frame with the color of the color block in each video frame in the video stream to obtain a display effect.

[0195] In one possible example, the detection device 820 compares the color a of the color block detected in the video frame with the actual color b of the color block in each video frame in the video stream to determine the color display accuracy, black screen, etc. of the display device 810.

[0196] For example, the detection device 820 determines whether the color a of the color block displayed by the display device 810 is accurate, that is, the color display accuracy, based on the color coordinate value of color a and the color coordinate value of color b.

[0197] If the detection device 820 detects that color a is black, and since the color block does not include black, such as the color block only has red, green and blue colors, it is determined that the display device 810 is currently in a black screen state.

[0198] In the present application, the above-mentioned implementation methods are all based on the color of the color block determined by the light sensing device 121 in the detection device 820 and the corresponding detection time to determine the display effect of the display device. The color of the color block and the corresponding detection time reduce the amount of data processing compared to the video data in the prior art. Therefore, based on the detection data, the display effect of the display device can be obtained faster, thereby improving the detection efficiency.

[0199] In a fifth possible implementation, the detection device 520 determines the color of the color block in each video frame based on the display information, compares the color of the color block in each video frame with the color that the color block in each video frame should have, and determines the jitter problem in the display effect.

[0200] For example, the detection device 820 can determine the color of the color block in the video frame based on the earliest detection time and the latest detection time of the color block of the same color, and compare it with the color that the video frame should have, so as to determine the jitter problem.

[0201] Regarding the content of determining the color of the color block, reference may be made to the description of the first possible implementation method in S530 above, and will not be repeated here. When the video stream is obtained by processing the content shown in FIG. 2 , the color that each video frame should have in the video stream may be stored in the computing device 123, so that the detection device 820 can obtain it from the memory of the computing device 123.

[0202] Exemplarily, the detection device 820 determines that the color block in the second frame is blue, while the color of the color block in the second frame in the video stream should be green. Due to the difference in color, the detection device 820 determines that jitter occurs when the display device 810 plays the video stream, that is, frame skipping.

[0203] In a possible embodiment, after each light sensing device 121 obtains the color of the color block and the corresponding detection time, the detection device 820 will perform a determination process such as S830 to obtain the display effect of the corresponding detection area of ​​the light sensing device 121.

[0204] When the detection device 820 includes multiple light sensing devices 121 , while obtaining the display effects of the detection areas corresponding to the multiple light sensing devices 121 , the display effects of the multiple detection areas will also be summarized to determine the display effect of the display device 810 .

[0205] For example, based on the jitter problems corresponding to the four light-sensing devices 121, for example, detection area a is jittering, detection area a is not jittering, detection area c is not jittering, and detection area d is not jittering, the detection device 820 determines that 25% of the areas in the display device 810 are jittering.

[0206] In one possible embodiment, based on the content shown in FIG8 above, this embodiment further provides a method for determining a time delay. As shown in FIG9 , FIG9 is a flow chart of a method for determining a time delay provided by this application. The method for determining a time delay includes the following steps S910-S930.

[0207] S910 : The detection device 820 determines the first time of receiving the operation instruction in response to the user's operation instruction.

[0208] The operation instruction is used to control the display device 810 to change the device state.

[0209] In one possible scenario, a user can send operating instructions to the display device 810 via a remote control or other operating device to control the display device 810 to power on, power off, pause, play after pausing, change channels, etc. Since the signal receiving device 122 in the detection device 820 is deployed directly in front of the display device 810, the signal receiving device 122 in the detection device 820 can also receive the operating instructions sent by the remote control or other operating device, and thus determine the first time the operating instructions were received, such as 2023-12-20 17:56:31:950.

[0210] Exemplarily, the signal receiving device 122 in the detection device 820 is deployed near the device for receiving signals in the display device 810 to reduce the time difference between the time when the display device 810 receives the signal and the time when the detection device 820 receives the signal, that is, to reduce the delay and improve the accuracy of detection.

[0211] In a possible example, the signal receiving device 122 in the detection device 820 can parse the received operation instruction and identify the action indicated by the operation instruction, such as power on, power off, pause, play after pause, change channels, etc.

[0212] S920: The detection device 820 obtains a second time when the display device 810 performs an operation in response to the operation instruction.

[0213] The second time is later than the first time, and the above detection time includes the second time.

[0214] In a possible implementation, after a first time, the display device 810 responds to the operation instruction and performs a corresponding operation, and the detection device 820 obtains a second time when the display device 810 performs the corresponding operation.

[0215] With respect to the above implementation, three possible examples are provided below.

[0216] In Example 1, in a scenario where the operation instruction is used to control the display device 810 to power on, since the detection device 820 periodically detects the color and detection time of the color block when the display device 810 displays the video stream, the detection device 820 uses the earliest detection time of the first appearance of the color block of the first color as the second time.

[0217] In the display device 810 startup scenario, the display device 810 plays the video stream immediately after startup. The detection device 820 uses the earliest detection time when the color block of the first color first appears as the second time, which can accurately reflect the startup performance of the display device, that is, the startup time.

[0218] For example, the color of the color block in the first frame included in the video stream is red, the first color of the color block detected for the first time by the detection device 820 is red, and the earliest detection time corresponding to red is used as the second time.

[0219] When the displayed information is 2023-12-20 17:56:32:001 in red; 2023-12-20 17:56:32:002 in red, the detection device 820 uses 2023-12-20 17:56:32:001 as the second time.

[0220] In Example 2, in a switching scenario such as controlling display device 810 to change channels, play after pausing, switch interfaces, slide, or perform playback control, detection device 820 periodically detects the color of a color block when display device 810 displays a video stream, and the detection time. If detection device 820 detects that the color at the same position of a color block switches from a second color to a third color, the earliest detection time of the color block of the third color is used as the second time.

[0221] In the switching scenario, the video stream played by the display device 810 will switch from the current frame to other frames, and the color of the color block will change during the switching process. The detection device 820 uses the earliest time when the color of the color block changes as the second time to determine the delay of the display device 810 in the switching scenario.

[0222] For example, when the display device 810 pauses playing the video stream, the detection device 820 detects that the second color of the color block currently displayed by the display device 810 is red. After receiving the operation instruction to control the display device 810 to pause playback, the display device 810 resumes playing the video stream. After the detection device 820 detects that the color block displayed by the display device 810 changes from red to green, the earliest detection time of the green color block is used as the second time.

[0223] When the displayed information is 2023-12-20 17:56:32:001 in red, 2023-12-20 17:56:32:002 in red, and 2023-12-20 17:56:32:003 in green, the detection device 820 uses 17:56:32:003 as the second time.

[0224] In Example 3, in a scenario where the operation instruction is used to control the display device 810 to shut down, since the detection device 820 periodically detects the color and detection time of the color blocks when the display device 810 displays the video stream, the detection device 820 uses the latest detection time of the color block with the fourth color as the second time.

[0225] In the shutdown scenario, the display device 810 changes from a playback state to a black screen state, i.e., the detection device 820 changes from being able to detect the color blocks to only detecting black. The latest detection time of the color block with the fourth color appearing is then used as the second time to determine the latency of the display device 810 in the shutdown scenario. The fourth color is the color of the color block pre-superimposed on the video stream, such as one of red, green, and blue.

[0226] For example, the color and time of the area corresponding to the color block on the display screen detected by the detection device 820 are: 2023-12-20 17:56:32:001 red; 2023-12-20 17:56:32:002 red; 2023-12-20 17:56:32:003 black; 2023-12-20 17:56:32:004 black, then 2023-12-20 17:56:32:002 is used as the second time.

[0227] For the above example, the detection device 820 periodically detects the color of the color block and the detection time when the display device 810 displays the video stream. The content of the detection device 820 determining the implementation method of the display effect of the display device 810 based on the display information in S520 can be referred to, and will not be repeated here.

[0228] S930 : The detection device 820 determines the response delay of the display device 810 by using the first time and the second time.

[0229] The detection device 820 compares the first time and the second time in each scenario to determine the time difference between the first time and the second time, thereby obtaining the response delay of the display device 810 in each scenario. The aforementioned scenarios include: power on, power off, pause, play after pause, channel change, network disconnection recovery, exit response, sliding interface, standby, play control, standby, etc.

[0230] For example, in the switching scenario, the first time the computing device 123 in the detection device 820 receives the operation instruction is 2023-12-20 17:56:31:950, and the determined second time is 2023-12-20 17:56:32:001. Therefore, the response delay of the display device 810 in the switching scenario is determined to be 51ms.

[0231] In the present application, the detection device 820 determines the response delay of the display device to the operation instruction based on the first time of receiving the operation instruction and the second time of performing the operation. Since the second time is determined based on the color of the color block in the display device 810 and the corresponding detection time, it accurately reflects the time when the display device 810 performs the operation corresponding to the operation instruction. Therefore, the accuracy of determining the second time is improved, thereby improving the accuracy of the response delay obtained by the detection device 820 based on the first time and the second time.

[0232] It is understood that in order to implement the functions in the above embodiments, the processor includes hardware structures and / or software modules corresponding to the execution of each function. It should be readily apparent to those skilled in the art that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0233] The display device detection method provided by the present application has been described in detail above with reference to Figures 1 to 9 . The display device detection apparatus provided by the present application will now be described with reference to Figure 10 , which is a schematic diagram of the structure of the display device detection apparatus provided by the present application. Display device detection apparatus 1000 can be used to implement the functions of detection device 820 in the above-described method embodiment, thereby also achieving the beneficial effects of the above-described method embodiment.

[0234] As shown in FIG10 , the display device detection apparatus 1000 includes an acquisition module 1010 and a first determination module 1020. The display device detection apparatus 1000 is used to implement the functions of the detection device 820 in the method embodiments corresponding to FIG2 to FIG9 . In one possible example, the specific process of the display device detection apparatus 1000 for implementing the above display device detection method includes the following process:

[0235] Acquisition module 1010 is configured to acquire display information when a display device plays a video stream. The video stream includes N video frames, where N is an integer greater than or equal to 2. Each of the N video frames includes a color block, and the colors of the color blocks in different video frames are periodically arranged. The display information includes the color of the color block displayed by the display device and the corresponding detection time.

[0236] The first determining module 1020 is configured to determine a display effect of the display device according to the display information.

[0237] To further implement the functions of the method embodiments shown in Figures 2 to 9 above, the present application also provides a display device detection device, as shown in Figure 11. Figure 11 is a second structural schematic diagram of the display device detection device provided by the present application, and the display device detection device 1000 further includes: a second determination module 1030 and a video processing module 1040.

[0238] The second determining module 1030 is configured to determine a first time when an operation instruction is received in response to an operation instruction of a user, wherein the operation instruction is used to control the display device to change a device state.

[0239] The video processing module 1040 is configured to obtain an original video stream, decode the original video stream to obtain N first video frames, sequentially superimpose color blocks on the N first video frames to obtain N second video frames, and encode the N second video frames to obtain a video stream; the video stream has the same frame rate as the original video stream, or the display duration of each video frame in the video stream is the same as the display duration of each video frame in the original video stream.

[0240] It should be understood that the display device detection device 1000 of the embodiment of the present invention can be implemented by a processor (central processing unit, CPU), or by an integrated circuit (application-specific integrated circuit, ASIC), or a programmable logic device (PLD), wherein the PLD can be a complex programmable logical device (CPLD), a field programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. When the display device detection device 1000 implements the display device detection method shown in any of Figures 2 to 9 through software, the display device detection device 1000 and its various modules can also be software modules.

[0241] The display device detection apparatus 1000 shown in FIG10 or FIG11 is merely an example provided in this embodiment. In some cases, the display device detection apparatus 1000 may include more or fewer software units, and this application is not limited thereto. A more detailed description of the display device detection apparatus 1000 can be directly obtained by referring to the relevant descriptions of the embodiments shown in FIG2 to FIG9 above, and will not be repeated here.

[0242] For example, when the display device detection apparatus 1000 is implemented by hardware, the hardware can be implemented by a chip. The chip includes an interface circuit and a control circuit. The interface circuit is used to receive signals from devices other than the processor and transmit them to the control circuit, such as obtaining display information, or sending signals from the control circuit to devices other than the processor.

[0243] The control circuit is used to implement the method of any possible implementation method in the above embodiments through a logic circuit or executing code instructions. The beneficial effects can be found in the description of any possible implementation method in the above embodiments, which will not be repeated here.

[0244] The present application also provides a detection system. The detection system may include the aforementioned light sensing device 121, signal receiving device 122, and computing device 123. The light sensing device 121 is used to obtain display information when the display device 810 plays a video stream, and to obtain a second time when the display device 810 performs an operation in response to an operation instruction. The signal receiving device 122 is used to determine the first time when the operation instruction is received in response to the user's operation instruction. The computing device 123 is used to determine the display effect of the display device 810 based on the display information.

[0245] In a possible scenario, the computing device 123 may also be configured to determine a response delay of the display device 810 using the first time and the second time.

[0246] For more possible implementations of the light sensing device 121 , the signal receiving device 122 and the computing device 123 , please refer to the contents shown in FIG. 1 to FIG. 9 above, which will not be described in detail here.

[0247] The present application also provides a computing device. As shown in Figure 12, Figure 12 is a schematic diagram of the structure of a computing device provided by the present application, and the computing device 1200 includes: a bus 1202, a processor 1204, a memory 1206 and a communication interface 1208. The processor 1204, the memory 1206 and the communication interface 1208 communicate with each other through the bus 1202. The computing device 1200 can be a server or a terminal device, and the computing device 1200 can include the above-mentioned computing device 123. In one possible scenario, the computing device 1200 also includes the above-mentioned light sensing device 121 and the signal receiving device 122. It is worth noting that the present application does not limit the number of processors and memories in the computing device 1200.

[0248] In one possible scenario, the computing device 1200 may be the aforementioned processing device 200 or detection device 820 .

[0249] The bus 1202 may be, but is not limited to, a peripheral component interconnect express (PCIe) bus, a universal serial bus (USB), an inter-integrated circuit bus (I2C), an EISA (extended industry standard architecture) bus, a unified bus (UB or Ubus), a compute express link (CXL), a cache coherent interconnect for accelerators (CCIX), and the like. The bus 1202 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, FIG12 shows only one line, but this does not mean that there is only one bus or one type of bus. The bus 1202 may include a path for transmitting information between various components of the computing device 1200 (e.g., the memory 1206, the processor 1204, and the communication interface 1208).

[0250] Processor 1204 may include a CPU, a graphics processing unit (GPU), an embedded neural-network processing unit (NPU), a microprocessor (MP), a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof.

[0251] The memory 1206 may include volatile memory, such as random access memory (RAM). The memory 1206 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).

[0252] The memory 1206 stores executable program codes, and the processor 1204 executes the executable program codes to respectively implement the functions of the aforementioned acquisition module and determination module, thereby implementing the aforementioned display device detection method.

[0253] The communication interface 1208 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 1200 and other devices or a communication network.

[0254] The present application also provides a computer program product including instructions. This computer program product may be software or a program product including instructions that can be run on a computing device or stored on any available medium. When the computer program product is run on at least one computing device, it causes the at least one computing device to execute the display device detection method.

[0255] The present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center that contains one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid-state drive). The computer-readable storage medium includes instructions that instruct the computing device to execute the display device detection method.

[0256] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in RAM, flash memory, ROM, PROM, EPROM, EEPROM, registers, hard disk, mobile hard disk, CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device or a terminal device. Of course, the processor and storage medium can also exist in a computing device as discrete components.

[0257] In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are performed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable device. The computer program or instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another. For example, the computer program or instructions can be transferred from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium, such as a floppy disk, hard disk, or tape; it can also be an optical medium, such as a DVD; or it can be a semiconductor medium, such as an SSD.

[0258] In the various embodiments of the present application, unless otherwise specified or logically conflicting, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships. The various numerical numbers involved in the embodiments of the present application are only for the convenience of description and are not intended to limit the scope of the embodiments of the present application. The size of the sequence number of each of the above processes does not mean the order of execution. The order of execution of each process should be determined by its function and inherent logic.

Claims

1. A display device detection method, characterized in that, The method includes: Obtaining display information when the display device plays a video stream; Wherein, the video stream includes N video frames, N is an integer greater than or equal to 2, each of the N video frames includes color blocks, and the colors of the color blocks in different video frames are arranged periodically. The display information includes the colors of the color blocks displayed by the display device and the corresponding detection times; Determining the display effect of the display device according to the display information.

2. The method according to claim 1, wherein The N video frames are divided into M groups of video frames, M is an integer greater than or equal to 1. The color sequence arrangement of any one group of video frames in the M groups of video frames is: the color block in the first frame is the first color, and the color block in the N / M-th frame is the N / M-th color.

3. The method according to claim 1 or 2, characterized in that, Each of the N video frames includes a color block, and the color block is at the same position in the video frame.

4. The method according to claim 2, characterized in that, Each of the N video frames includes a color block. The position arrangement of the color blocks in any one group of video frames in the M groups of video frames is: the color block in the first frame is at the first position in the first frame, and the color block in the N / M-th frame is at the N / M-th position in the N / M-th frame.

5. The method according to claim 1 or 2, characterized in that, Each of the N video frames includes at least two color blocks, and each of the at least two color blocks has a fixed position in the video frame.

6. The method according to claim 2, characterized in that Each of the N video frames includes at least two color blocks. The position arrangement of the first color block in any one group of video frames in the M groups of video frames is: the first color block in the first frame is at the first position in the first frame, and the first color block in the N / M-th frame is at the N / M-th position in the N / M-th frame. The first color block is any one of the at least two color blocks.

7. The method according to any one of claims 1 to 6, characterized in that, The determining the display effect of the display device according to the display information includes: Determining a first display duration of the video frames in the video stream according to the earliest detection time and the latest detection time of the color blocks of the same color; between the earliest detection time and the latest detection time, only one color is detected at the same position of the color blocks; Comparing the first display duration with the reciprocal of the frame rate of the video stream or a second display duration of the video frames in the video stream to obtain the display effect of the display device; and / or; Comparing the colors of the color blocks when the display device displays the video frames with the colors of the color blocks in the video frames included in the video stream to obtain the display effect of the display device.

8. The method according to any one of claims 1 to 7, characterized in that The method further includes: Responding to a user's operation instruction to determine a first time when the operation instruction is received; the operation instruction is used to control the display device to change the device state; The display effect includes the response latency of the display device. The determining the display effect of the display device according to the display information includes: Obtaining a second time when the display device executes an operation in response to the operation instruction, the second time is later than the first time, and the detection time includes the second time; Using the first time and the second time to determine the response latency of the display device.

9. The method according to claim 8, characterized in that, If the first color in the color block appears for the first time, the earliest detection time of the color block of the first color is used as the second time; If the color at the same position in the color block switches from the second color to the third color, the earliest detection time of the color block of the third color is used as the second time; If the fourth color in the color block appears last, the latest detection time of the color block of the fourth color is used as the second time.

10. The method according to any one of claims 1 to 9, characterized in that, Before obtaining the display information when the display device displays the video stream, the method further includes: Obtaining an original video stream; Decoding the original video stream to obtain N first video frames; Sequentially superimposing color blocks on the N first video frames to obtain N second video frames; Encoding the N second video frames to obtain the video stream; the frame rate of the video stream is the same as that of the original video stream, or the display duration of each video frame in the video stream is the same as the display duration of each video frame in the original video stream.

11. The method according to any one of claims 1 to 10, characterized in that, The display effects include one or more of: still frame, stutter, dropped frame, frame rate switching, black screen, and jitter.

12. The method according to any one of claims 1 to 11, characterized in that, The obtaining the display information when the display device displays the video stream includes: Detecting the reflection intensities of the light reflected by the color blocks in the three wavelength ranges of red, green, and blue respectively during the process of the display device playing the video stream; Determining the color of the color block according to the reflection intensities in the three wavelength ranges of red, green, and blue.

13. A display device detection apparatus, characterized in that, The device includes: An obtaining module, configured to obtain the display information when the display device plays the video stream; Wherein, the video stream includes N video frames, N is an integer greater than or equal to 2, each of the N video frames includes a color block, and the colors of the color blocks in different video frames are arranged periodically, and the display information includes the color of the color block displayed by the display device and the corresponding detection time; A first determination module, configured to determine the display effect of the display device according to the display information.

14. The device according to claim 13, characterized in that, The N video frames are divided into M groups of video frames, M is an integer greater than or equal to 1, and the color sequence arrangement of any group of video frames in the M groups of video frames is: the color block in the first frame is the first color, and the color block in the N / M-th frame is the N / M-th color.

15. The device according to claim 13 or 14, characterized in that, Each of the N video frames includes a color block, and the color block is at the same position in the video frame.

16. The device according to claim 14, characterized in that, Each of the N video frames includes a color block, and the position arrangement of the color blocks in any group of video frames in the M groups of video frames is: the color block in the first frame is at the first position in the first frame, and the color block in the N / M-th frame is at the N / M-th position in the N / M-th frame.

17. The device according to claim 13 or 14, characterized in that Each of the N video frames includes at least two color blocks, and each of the at least two color blocks has a fixed position in the video frame.

18. The device according to claim 14, wherein Each of the N video frames includes at least two color blocks. The position arrangement of the first color block in any one of the M groups of video frames is as follows: the first color block in the first frame is located at the first position in the first frame, and the first color block in the N / M-th frame is located at the N / M-th position in the N / M-th frame. The first color block is any one of the at least two color blocks.

19. The device according to any one of claims 13 to 18, characterized in that, The first determination module is specifically configured to determine the first display duration of the video frames in the video stream according to the earliest detection time and the latest detection time of the color blocks of the same color; within the range between the earliest detection time and the latest detection time, only one color is detected at the same position of the color blocks; compare the first display duration with the reciprocal of the frame rate of the video stream or the second display duration of the video frames in the video stream to obtain the display effect of the display device; and / or; compare the color of the color blocks when the display device displays each video frame with the color of the color blocks in each video frame in the video stream to obtain the display effect of the display device.

20. The device according to any one of claims 13 to 19, characterized in that, The device further includes: A second determination module, configured to determine the first time when the operation instruction is received in response to a user's operation instruction; the operation instruction is used to control the display device to change the device state. The display effect includes the response latency of the display device. The first determination module is specifically configured to obtain the second time when the display device executes an operation in response to the operation instruction. The second time is later than the first time, and the detection time includes the second time; and use the first time and the second time to determine the response latency of the display device.

21. The device according to claim 20, characterized in that, If the first color in the color block appears for the first time, the earliest detection time of the color block of the first color is used as the second time. If the color at the same position of the color block switches from the second color to the third color, the earliest detection time of the color block of the third color is used as the second time. If the fourth color in the color block appears last, the latest detection time of the color block of the fourth color is used as the second time.

22. The device according to any one of claims 13 to 21, characterized in that, The device further includes: A video processing module, configured to obtain an original video stream; decode the original video stream to obtain N first video frames; sequentially superimpose color blocks on the N first video frames to obtain N second video frames; encode the N second video frames to obtain the video stream; the frame rate of the video stream is the same as that of the original video stream, or the display duration of each video frame in the video stream is the same as the display duration of each video frame in the original video stream.

23. The device according to any one of claims 13 to 22, characterized in that, The display effect includes one or more of: still frame, stutter, dropped frame, frame rate switching, black screen, and jitter.

24. The device according to any one of claims 13 to 23, characterized in that, The acquisition module is specifically configured to detect the reflection intensities of the light reflected by the color blocks within the three wavelength ranges of red, green, and blue respectively during the process of the display device playing the video stream; and determine the color of the color blocks according to the reflection intensities within the three wavelength ranges of red, green, and blue.

25. A computing device, characterized in that, It includes a memory and a processor, where the memory is used to store computer instructions; when the processor executes the computer instructions, the method described in any one of claims 1 to 12 is implemented.

26. A computer-readable storage medium, characterized in that, A computer program or instructions are stored in the storage medium, and when the computer program or instructions are executed by a processing device, the method described in any one of claims 1 to 12 is implemented.

27. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processing device, the method described in any one of claims 1 to 12 is implemented.

Images