IPTV and OTT set-top box testing method and testing device with consistency comparison function

Abstract

The present invention proposes an IPTV and OTT set-top box testing method and device with consistency comparison function, and the method steps are as follows: S1, configuring a virtual remote control model and a set-top box test task; S2, collecting remote control infrared signals to perform key learning of the virtual remote control model; S3, using the virtual remote control model to execute the set-top box test task and obtain the test result; S4, analyzing the test result based on the image matching algorithm, and performing video data consistency comparison. The device includes a box body and a box cover, the front panel of the box body is provided with a network interface, the rear panel of the box body is provided with a power input port, a power output port, an HDMI input port and an HDMI output port, and the box body is provided with a switching module, an HDMI three-way module, an HDMI male head, an HDMI female head and a relay. The method and device of the present invention have low testing cost, simple testing configuration, the testing environment is consistent with the user environment, the test results are closer to the actual perception of the user, and the testing accuracy is high.

Description

Technical Field

[0001] The invention relates to a set-top box testing method and a testing device for testing IPTV and OTT video service quality, belonging to the technical field of video service quality testing. Background Art

[0002] IPTV / OTT services rely on IP network transmission, and video service traffic is large. As users' requirements for video experience increase, ultra-high-definition and 4K videos are becoming more and more popular, and the requirements for IPTV / OTT service quality assurance are becoming higher and higher. Various testing technologies and testing instruments based on IPTV / OTT service content consistency comparison, network quality, service quality, security protection, user behavior analysis, etc. have emerged. Existing IPTV / OTT service quality-related testing instruments have the following defects:

[0003] (1) Install test software on the set-top box, and analyze the user behavior and quality of each sampling period on the set-top box by sampling and capturing packets and issuing network test tasks. Although this method can meet the needs of collecting and analyzing the quality of a large number of set-top box terminal data, since network quality indicators are relatively sensitive, the fluctuation of indicators in the test may not completely correspond to the actual viewing experience of users. Therefore, a large number of data samples are required to be analyzed in combination with information such as the operator's network architecture, video resolution, video content, and set-top box terminal model, resulting in high monitoring costs.

[0004] (2) Deploy professional monitoring instruments on the upper network of the set-top box, and use the monitoring instruments to simulate the user's video playback behavior and perform full packet capture analysis. Since the detection equipment needs to support a large number of concurrent test requests, the equipment configuration is much higher than the set-top box equipment, and there are differences in the hardware and network environment of the set-top box terminal equipment. There are differences in the monitoring results, and only the overall quality trend can be evaluated. Summary of the invention

[0005] In view of the problems that the monitoring cost of existing IPTV / OTT video service testing methods is too high and the monitoring results of testing instruments are not accurate enough, the present invention proposes an IPTV and OTT set-top box testing method and testing device with consistency comparison function. The device of the present invention is directly connected between the TV network, the set-top box and the TV display, uses a virtual remote control to send remote control commands, performs test operations, collects video source data and set-top box data, performs video consistency comparison in real time, and tests video service quality.

[0006] In order to solve the above technical problems, the present invention adopts the following technical means:

[0007] A method for testing an IPTV and OTT set-top box with a consistency comparison function, specifically comprising the following steps:

[0008] S1. Configure a virtual remote control model and set-top box test task on the human-machine operation interface;

[0009] S2, collecting infrared signals of the physical remote control and learning the buttons of the virtual remote control model;

[0010] S3, using the learned virtual remote control model to perform a set-top box test task, and obtain and store the test results;

[0011] S4. Analyze the test results based on the image matching algorithm and compare the consistency of the program source side data with the set-top box user side data.

[0012] Furthermore, the specific operation of configuring the virtual remote control model on the human-machine operation interface is:

[0013] The remote control model is retrieved from the remote control model library according to the set-top box manufacturer, remote control manufacturer and remote control model. When the remote control model is retrieved, it is determined whether the remote control model meets the requirements. If it meets the requirements, the remote control model is used as the virtual remote control model. When the model is not retrieved or the retrieved model does not meet the requirements, the name, position and button shape of each button are configured on the blank remote control model to generate a virtual remote control model.

[0014] Furthermore, the specific operation of configuring the set-top box test task on the human-machine operation interface is:

[0015] According to the test requirements, select test indicators, remote control buttons and test operations in sequence to generate a set-top box test task; the test indicators include the total power-on time of the set-top box, the response time of the set-top box channel, the channel switching time of the set-top box, the page poster loading time, and the set-top box output video; the remote control buttons include button names and button sequences; the test operations include video recording, screenshots, data capture, and test anomaly analysis.

[0016] Furthermore, the specific operations of step S2 are as follows:

[0017] S21, selecting a button on the virtual remote control model for button learning;

[0018] S22, pressing a corresponding button on the physical remote control, using an infrared receiving device to receive an infrared signal emitted by the physical remote control, and converting the infrared signal into an electrical signal;

[0019] S23, performing detection, shaping, and amplification operations on the electrical signal, and then performing data sampling on the electrical signal, and storing the binary data of each sampling point in a unit of 8 bits in a database;

[0020] S24, repeating steps S21 to S23 until the key learning of all keys on the virtual remote control model is completed, and a remote control command library corresponding to the virtual remote control model is obtained.

[0021] Furthermore, the specific operations of step S3 are:

[0022] Select a set-top box test task, obtain the test indicators, remote control buttons and test operations of the set-top box test task, use the remote control buttons and the remote control command library to send virtual remote control commands, control the set-top box to perform test operations, use software to obtain test indicators, and use the test device to extract video data on the program source side and video data on the set-top box side, and store the test indicators and collected video data as test results.

[0023] Furthermore, the specific operation of step S4 is:

[0024] A plurality of test points are set in the test device according to the time coordinate, and a screenshot test operation is configured for the infrared probe of each test point. The test device is used to capture images of the video data on the program source side and the video data on the set-top box side in turn to obtain multiple groups of screenshot data. The image on the program source side and the image on the set-top box side in each group of screenshot data are matched based on the image matching algorithm to determine whether the image on the program source side is consistent with the image on the set-top box user side.

[0025] An IPTV and OTT set-top box testing device with a consistency comparison function comprises a box body and a box cover, wherein a network interface is arranged on the front panel of the box body, a power input port, a power output port, an HDMI input port and an HDMI output port are arranged on the rear panel of the box body, and a switching module, an HDMI three-way module, two HDMI male heads, two HDMI female heads and a relay are arranged inside the box body; the switching module is installed on the inner side of the front panel of the chassis, and the switching module is sequentially connected to the network interface on the front panel, the HDMI three-way module and the two HDMI male heads are respectively fixedly installed on the bottom panel of the box body, and the two HDMI female heads are respectively installed on the rear panel of the box body, the input end and the output end of the HDMI three-way module are respectively connected to one end of the two HDMI male heads, the other ends of the two HDMI male heads are respectively connected to one end of the two HDMI female heads, and the other ends of the two HDMI female heads are respectively connected to the HDMI input port and the HDMI output port on the rear panel, the relay is fixedly installed on the bottom panel of the box body, and the two ends of the relay are respectively connected to the power input port and the power output port; the power input port is connected to an external direct current power supply.

[0026] Furthermore, a mainboard fixing bracket is installed inside the box, and a device mainboard is fixed on the mainboard fixing bracket. A memory, a CPU fan, a CPU heat sink and a LAN port are installed on the device mainboard. The CPU fan and the CPU heat sink are fixed on one side of the memory, and the CPU heat sink is distributed around the CPU fan. The LAN port is connected to the switching module via a cable.

[0027] Furthermore, an IR interface is provided on the rear panel of the box, and a USB-IR line connected to the IR interface is provided inside the box.

[0028] Furthermore, a DC-DC conversion module is installed inside the box, one end of the DC-DC conversion module is connected to the power input port, and the other end of the DC-DC conversion module is respectively connected to the relay, the switching module and the power output port.

[0029] The following advantages can be obtained by using the above technical means:

[0030] The present invention proposes an IPTV and OTT set-top box testing method and testing device with consistency comparison function. The method of the present invention uses a virtual remote control model and a set-top box test task to automatically perform a test operation, and realizes the IPTV / OTT video service quality test and consistency comparison during the set-top box video playback through image recognition and packet capture analysis. Since the video data of the program source side and the set-top box side are directly collected for comparison, the test environment is consistent with the actual user environment, and the test result is accurate and reliable. The advantages of the device of the present invention are as follows: (1) It has many functions and has the functions of network forwarding, infrared learning, infrared emission, test script recording and execution, test result analysis, etc.; (2) The device is small in size and easy to deploy. The front and rear panels are provided with a power interface, a network interface, an HDMI interface and other interfaces, which can meet the connection requirements of network, power supply, display and other devices during the set-top box automation test, realize the set-top box connection function without adding additional interfaces and hardware devices, and realize the video service quality test; (3) The device is more efficient, and only needs to perform a remote control configuration and a test task configuration once, and can realize full-automatic and uninterrupted testing with the script. The method and device of the present invention have low testing cost, simple testing configuration, consistent testing environment with user environment, test results that are closer to actual user perception, and higher testing accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 The present invention is a flowchart of the steps of an IPTV and OTT set-top box testing method with a consistency comparison function.

[0032] Figure 2The present invention is a structural diagram of an IPTV and OTT set-top box testing device with a consistency comparison function; wherein (a) is a structural diagram of the internal structure of the device, (b) is a structural diagram of the front panel of the box, (c) is a structural diagram of the rear panel of the box, (d) is a structural diagram of the mainboard of the device in the device, and (e) is a structural diagram of the mainboard fixing bracket in the device.

[0033] Figure 3 It is a schematic diagram of the connection between the device and the TV network, set-top box, and TV display in an embodiment of the present invention.

[0034] In the figure, 1 is the box body, 2 is the box cover, 3 is the switching module, 4 is the HDMI three-way module, 5 is the HDMI male connector, 6 is the HDMI female connector, 7 is the relay, 8 is the USB-IR cable, 9 is the USB module, 10 is the cooling fan, 11 is the cable, 12 is the mesh cooling port, 13 is the mounting ears, 14 is the network interface, 15 is the power input port, 16 is the power output port, 17 is the HDMI input port, 18 is the HDMI output port, 19 is the power switch, 20 is the serial port, 21 is the USB port, 22 is the IR interface, 23 is the device motherboard, 24 is Memory, 25 is the CPU fan, 26 is the CPU heat sink, 27 is the LAN port, 28 is the SATA-PWR port, 29 is the SATA port, 30 is the ATX port, 31 is the SYS-FAN port, 32 is the motherboard fixing bracket, 33 is the screw hole, 34 is the switching module heat sink, 35 is the fixing plate, 36 is the DC-DC conversion module, 37 is the TV network, 38 is the set-top box, 39 is the TV display, 40 is the external power supply, 41 is the upper device, 42 is the set-top box power interface, 43 is the HDMI port, and 44 is the set-top box LAN port. DETAILED DESCRIPTION

[0035] The technical solution of the present invention is further described below in conjunction with the accompanying drawings:

[0036] A method for testing IPTV and OTT set-top boxes with consistency comparison function, such as Figure 1 As shown, the specific steps include:

[0037] S1. Configure the virtual remote control model and set-top box test task on the human-machine operation interface; the human-machine operation interface is generally a page configured on the computer side. The human-machine operation interface can not only be used to configure the virtual remote control model and set-top box test task, but also to send test task execution instructions, display test results, etc.

[0038] For the commonly used set-top boxes on the market, the data of the set-top box remote control can be collected first, the corresponding remote control model can be established, and stored in the remote control model library. Each remote control model in the remote control model library corresponds to the manufacturer and model information. In addition, the remote control model library is also provided with a blank remote control model, that is, a model with only an empty shell and no specific buttons. The remote control model library is linked to a button library, and a variety of button shapes are stored in the button library. When it is necessary to configure a virtual remote control model, first access the remote control model library from the human-machine operation interface, and retrieve the remote control model in the remote control model library according to the set-top box manufacturer, remote control manufacturer and remote control model. When the remote control model is retrieved, the remote control model is displayed on the human-machine operation interface. It can be manually or by machine to determine whether the remote control model meets the requirements, that is, whether the remote control model is the same as the physical remote control. If it meets the requirements, the remote control model is used as the virtual remote control model. When no model is retrieved or the retrieved model does not meet the requirements, the blank remote control model can be retrieved, and the button shape is selected from the linked button library according to the physical remote control. The name, position and button shape of each button are configured on the blank remote control model to generate a virtual remote control model.

[0039] On the human-machine interface, select test indicators, remote control buttons and test operations in turn according to test requirements to generate a set-top box test task; test indicators include total set-top box power-on time, set-top box channel response time, set-top box channel switching time, page poster loading time, set-top box output video, etc. Remote control buttons include button names, button sequences, etc. Test operations include video recording, screenshots, data capture, test anomaly analysis, etc. For example, the test indicator of a set-top box test task is the set-top box channel switching time, and the corresponding remote control buttons include power-on button, channel switching case and confirmation button. The button sequence is the first step, click the power-on button, the second step, click the confirmation case to enter the first channel, the third step, click the channel switching button, and the fourth step, click the confirmation button to enter the next channel. The corresponding test operations are video recording and time data capture.

[0040] S2. Collect infrared signals from the physical remote control and learn the buttons of the virtual remote control model. The specific operations are as follows:

[0041] S21. Select a button on the virtual remote control model for button learning.

[0042] S22. Press the corresponding button on the physical remote control. The physical remote control will use an infrared light emitting diode to transmit the button information using infrared light as a carrier, use an infrared receiving device to receive the infrared signal emitted by the physical remote control, and convert the infrared signal into an electrical signal.

[0043] S23, performing detection, shaping and amplification operations on the electrical signal, and then performing data sampling on it, and storing the binary data of each sampling point in a database in units of 8 bits.

[0044] S24. Repeat steps S21 to S23 until the key learning of all keys on the virtual remote control model is completed, and a remote control command library corresponding to the virtual remote control model is obtained. The remote control command library includes key names and digital remote control instructions corresponding to the keys. Even if no key operations are performed on the physical remote control, the set-top box can be controlled by calling the remote control instructions.

[0045] S3, using the learned virtual remote control model to perform the set-top box test task, obtain and store the test results; the specific operations are:

[0046] Select a set-top box test task, obtain the test indicators, remote control buttons and test operations of the set-top box test task, use the remote control buttons and the remote control command library to send virtual remote control commands, control the set-top box to perform test operations, use software to obtain test indicators, and use the test device to extract video data on the program source side and video data on the set-top box side, and store the test indicators and collected video data as test results.

[0047] S4. Analyze the test results based on the image matching algorithm and compare the consistency of the data on the program source side and the data on the set-top box user side. The specific operations are as follows:

[0048] A plurality of test points are set in the test device according to the time coordinate, and a screenshot test operation is configured for the infrared probe of each test point. The test device is used to capture images of the video data on the program source side and the video data on the set-top box side in turn to obtain multiple groups of screenshot data. The image on the program source side and the image on the set-top box side in each group of screenshot data are matched based on the image matching algorithm to determine whether the image on the program source side is consistent with the image on the set-top box user side.

[0049] When configuring a set-top box test task, the method of the present invention can set the time interval for executing the test task and the duration of each execution. In this way, after the set-top box test task is selected in step S3, the set-top box test task can be automatically and repeatedly executed according to the time interval and the execution duration, and the test results can be continuously updated to ensure the timeliness and accuracy of the test results.

[0050] In addition, the method of the present invention only needs to stagger the execution time of different set-top box test tasks to automatically execute multiple set-top box test tasks, thereby achieving comprehensive and reliable video service quality testing.

[0051] An integrated set-top box test device, such as Figure 2 , 3As shown, the device includes a box body 1 and a box cover 2. Both sides of the box cover are provided with protruding fixing plates 35. Screw holes 33 are provided on the fixing plates and the tops of the two side panels of the box body. The box cover is covered on the box body, and the box cover and the box body can be fixed together by bolts matching the screw holes. Upper ears 13 are respectively installed on both sides of the box body, and screw holes are provided on the upper ears. The device can be fixed to a cabinet, a wall, etc. by using the upper ears and matching bolts.

[0052] Three network interfaces 14 are arranged on the front panel of the box, two of which are used to connect to the TV network 37 and the set-top box LAN port 44 on the set-top box 38 respectively, and the other network interface is an Ethernet management port, which is used to connect to the upper-level device 41 to perform operations such as test device management, virtual remote control template recording task issuance, set-top box test task issuance, and test result reporting. A power input port 15, a power output port 16, an HDMI input port 17, an HDMI output port 18, a power switch 19, a serial port 20, a USB port 21 and an IR interface 22 are arranged on the rear panel of the box. The power input port can be connected to an external power supply 40 via a matching data cable to provide power for the test device; the power output port is connected to a set-top box power interface 42 via a matching data cable to transmit the power connected to the power input port to the set-top box to power the set-top box; the HDMI input port is connected to the HDMI port 43 of the set-top box, and the HDMI output port is connected to a TV display 39; the power switch is connected to the power input port and the power output port respectively, the serial port and the USB port are used to connect external devices for data transmission, and the IR interface can receive infrared signals.

[0053] Inside the box, there are a switching module 3, an HDMI three-way module 4, two HDMI male connectors 5, two HDMI female connectors 6, a relay 7, a USB-IR line 8, a USB module 9 and a cable 11. The switching module is used for network video service switching. The switching module is installed on the inner side of the front panel of the chassis and connected to the network interface on the front panel. The switching module receives the TV network signal through the network interface, converts the signal and transmits it to the set-top box through the network interface. The specific model of the switching module in the embodiment of the present invention is DYR-S5QI-003. A switching module heat sink 34 is fixedly installed next to the switching module to dissipate heat when the switching module is working to prevent the switching module from being damaged by excessive temperature. The HDMI three-way module and two HDMI male connectors are fixedly mounted on the bottom panel of the box, and two HDMI female connectors are mounted on the rear panel of the box. The input end and one output end of the HDMI three-way module are connected to one end of the two HDMI male connectors, respectively. The other ends of the two HDMI male connectors are connected to one end of the two HDMI female connectors, respectively. The other ends of the two HDMI female connectors are connected to the HDMI input port and the HDMI output port on the rear panel, respectively. The HDMI three-way module, the HDMI male connector, the HDMI female connector, the HDMI input port and the HDMI output port jointly realize the function of transferring video data from the set-top box to the TV display. The specific model of the HDMI three-way module in the embodiment of the present invention is eKLUH02. The relay is fixedly mounted on the bottom panel of the box, and the relay is connected to the power input port, the power output port and the power switch, respectively. The relay and the power switch jointly control the power on and off of the device. When the power supply is abnormal, the relay can disconnect the circuit in time to protect the internal electrical components of the device. In the embodiment of the present invention, the relay adopts LCUS-2 type 2-way. The USB-IR line is installed on the inner side of the rear panel of the box and connected to the IR interface on the rear panel. The USB-IR line can transmit the infrared signal received by the IR interface to the upper device. The model of the USB-IR line in the embodiment of the present invention is AUL01. The USB module is fixedly installed above the USB-IR line and connected to the USB port on the rear panel. When the USB port is connected to an external device, the USB module can realize bidirectional data transmission.

[0054] Since the device contains a large number of electronic devices, when the device is powered on, these electronic devices will generate a certain amount of heat. If the heat in the box cannot be discharged in time, the temperature in the box will be too high, causing safety hazards. A heat dissipation fan 10 is arranged on one side of the box, and mesh heat dissipation ports 12 are provided on both sides of the box. After the device is powered on, the heat dissipation fan starts to work and discharges the heat in the box from the mesh heat dissipation ports, which can effectively reduce the temperature inside the box and prevent the components from being damaged by excessive temperature.

[0055] The power input port of the device is usually connected to a 12V voltage. In order to ensure the normal operation of various electronic devices inside the device, a DC-DC conversion module 36 is installed inside the box. One end of the DC-DC conversion module is connected to the power input port, and the other end of the DC-DC conversion module is respectively connected to the power output port, the switching module, the relay, the cooling fan and other equipment. The DC-DC conversion module can convert the connected 12V voltage into a 5V voltage for use by the equipment.

[0056] A mainboard fixing bracket 32 ​​is also installed inside the box, and the mainboard fixing bracket surface is provided with screw holes. A mounting plate is provided on both sides of the mainboard fixing bracket, and screw holes are opened on the mounting plate. The mainboard fixing bracket is fixed in the box by bolts and is spaced a certain distance from the bottom panel of the box. The device mainboard is fixed on the mainboard fixing bracket by studs. The device mainboard is installed with memory 24, CPU fan 25, CPU heat sink 26, USB port 21, LAN port 27, SATA-PWR port 28, SATA port 29, ATX port 30 and SYS-FAN port 31. The LAN port of the device mainboard is connected to the switching module through a cable, and the USB port is connected to the USB module and the USB-IR line. The device mainboard is also connected to the other output end of the HDMI three-way module through a cable. The memory of the device mainboard is fixed on one side of the mainboard, the CPU fan and the CPU heat sink are fixed in the middle of the mainboard and located on one side of the memory, and the CPU heat sink is evenly distributed around the CPU fan. The device mainboard can obtain video data of the TV network and set-top box video data through the switching module and the HDMI three-way module.

[0057] The working principle of the device of the present invention is as follows: the TV network and the set-top box network port are connected respectively through the network interface on the front panel of the box, the external power supply is connected through the power input port on the rear panel of the box, the power output port is connected to the set-top box power port, the HDMI input port is connected to the HDMI port of the set-top box, and the HDMI output port is connected to the display of the TV. After the power is turned on, according to the virtual remote control model key learning task, the IR interface receives the infrared signal of the physical remote control, and the device mainboard analyzes the received infrared signal to complete the key learning. The switching module obtains the video data of the TV network from the network interface, and at the same time transfers the network video data to the set-top box through the network interface. The HDMI female head obtains the video data of the set-top box through the HDMI input port, and transmits the data to the TV display through the HDMI output port. The device mainboard is connected to the switching module and the HDMI three-way module through a cable. According to the set-top box test task, the device mainboard obtains the program source side video data, the set-top box side video data and the test indicators transmitted by the TV network, and compares the consistency of the program source side video data and the set-top box side video data to complete the video service quality test.

[0058] The method and device of the present invention are tested based on the actual playback effect of the set-top box terminal, and can obtain the actual viewing experience of the user on the set-top box terminal device, and realize the video service quality test during the set-top box video playback and EPG browsing by means of image recognition + packet capture analysis, and can compare the data on the program source side and the set-top box user side to realize the consistency comparison function of IPTV / OTT video service. The device has the characteristics of integration and portability, and can improve the test environment deployment efficiency of the equipment. Compared with the prior art, the device deployment cost is low, the video test cost is low, the test configuration is simple, the test content is wide, the test environment is consistent with the user environment, and the test results are closer to the actual perception of the user.

[0059] The embodiments of the present invention are described in detail above with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge scope of ordinary technicians in the field without departing from the purpose of the present invention.

Claims

1. A method for testing IPTV and OTT set-top boxes with consistency comparison function, characterized in that: The following steps are involved: S1. Configure a virtual remote control model and set-top box test task on the human-machine interface; S2, collecting infrared signals of the physical remote control and performing button learning of the virtual remote control model; S3, using the learned virtual remote control model to perform a set-top box test task, and obtain and store the test results; S4, analyzing the test results based on the image matching algorithm, and performing consistency comparison between the data on the program source side and the data on the set-top box user side; The specific operation of configuring the virtual remote control model on the human-machine operation interface is: Retrieve a remote control model from a remote control model library according to the set-top box manufacturer, remote control manufacturer and remote control model. When a remote control model is retrieved, determine whether the remote control model meets the requirements. If it meets the requirements, use the remote control model as a virtual remote control model. When no model is retrieved or the retrieved model does not meet the requirements, configure the name, position and button shape of each button on a blank remote control model to generate a virtual remote control model. The specific operations of configuring the set-top box test task on the human-machine operation interface are: According to the test requirements, test indicators, remote control buttons and test operations are selected in sequence to generate a set-top box test task; the test indicators include the total boot time of the set-top box, the response time of the set-top box channel, the channel switching time of the set-top box, the page poster loading time, and the set-top box output video; the remote control buttons include button names and button sequences; the test operations include video recording, screenshots, data capture, and test anomaly analysis; The specific operations of step S2 are as follows: S21, selecting a button on the virtual remote control model for button learning; S22, pressing a corresponding button on the physical remote control, using an infrared receiving device to receive an infrared signal emitted by the physical remote control, and converting the infrared signal into an electrical signal; S23, performing detection, shaping, and amplification operations on the electrical signal, and then performing data sampling on the electrical signal, and storing the binary data of each sampling point in a unit of 8 bits in a database; S24, repeating steps S21 to S23 until the key learning of all keys on the virtual remote control model is completed, and a remote control command library corresponding to the virtual remote control model is obtained; The specific operations of step S3 are: Select a set-top box test task, obtain the test index, remote control buttons and test operation of the set-top box test task, use the remote control buttons and remote control command library to send virtual remote control commands, control the set-top box to perform test operations, use software to obtain test indexes, and use the test device to extract video data on the program source side and video data on the set-top box side, and store the test indexes and collected video data as test results; The specific operations of step S4 are: A plurality of test points are set in the test device according to the time coordinate, and a screenshot test operation is configured for the infrared probe of each test point. The test device is used to capture images of the video data on the program source side and the video data on the set-top box side in turn to obtain multiple groups of screenshot data. The image on the program source side and the image on the set-top box side in each group of screenshot data are matched based on the image matching algorithm to determine whether the image on the program source side is consistent with the image on the set-top box user side.

Images