Automatic test method, system, device and equipment for remote controller and medium

Abstract

The invention relates to the technical field of automatic testing, in particular to an automatic testing method, system, device and equipment for a remote controller and a medium. According to the method, firstly, a manual control function test item of the remote controller is generated, a manual control function is that the remote controller is manually operated to realize a control function of the remote controller, and the manual control function test item is an item for testing the control function; an original image of the remote controller is collected, a manual control area on the remote controller is determined by identifying the original image, then a probe is automatically controlled to complete the manual control function test item in the manual control area, a response result of the remote controller based on the test item is obtained, and finally a test result of the remote controller is obtained according to the response result. According to the analysis, the manual control area of the remote controller can be automatically positioned through the image recognition technology, the manual control function test item is completed in the manual control area through the automatic control probe, the purpose of automatically testing the remote controller is achieved, and therefore the test speed is increased.

Description

Technical Field

[0001] The present invention relates to the field of automated testing technology, and in particular to a remote control automated testing method, system, device, equipment and medium. Background Art

[0002] Smart TVs, set-top boxes, air conditioners, and light bulbs that can adjust the color gamut and brightness all require remote control. Existing remote controls have the characteristics of multiple styles, multiple functions, and wide coverage. Although the remote control is small in size, it has multiple functions such as Bluetooth, infrared, voice, and NFC. In order to ensure the factory quality of the remote control, the quality of the remote control needs to be tested. The existing technology uses manual detection of the remote control, that is, manually pressing each button on the remote control to test whether the remote control will send the corresponding control command, and manual testing will reduce the test speed.

[0003] In summary, the prior art reduces the testing speed of the remote controller.

[0004] Therefore, the prior art still needs to be improved and enhanced. Summary of the invention

[0005] In order to solve the above technical problems, the present invention provides a remote control automatic testing method, system, device, equipment and medium, which solves the problem that the prior art reduces the remote control testing speed.

[0006] To achieve the above object, the present invention adopts the following technical solutions:

[0007] In a first aspect, the present invention provides a remote control automated testing method, comprising:

[0008] Generate test items for the remote control's manual control function;

[0009] Acquiring an original image of the remote control, and identifying each hand-controlled area on the remote control based on the original image;

[0010] The automatic control probe completes the manual control function test item at the manual control area, and obtains the response result of the remote controller, and obtains the test result of the manual control function test item according to the response result.

[0011] In one implementation, generating a test item for the hand control function of the remote controller includes:

[0012] Acquiring original design data of the remote controller, and identifying functional design data related to the hand control function from the original design data;

[0013] Based on the functional design data, a manual control function test item is generated.

[0014] In one implementation, the hand control area includes a button area and a touch screen area, and identifying each hand control area on the remote controller based on the original image includes:

[0015] Determining a depth image of the original image;

[0016] Performing edge extraction on the original image to obtain an edge image of the original image;

[0017] According to the depth image and the edge image, pixel points whose depth values ​​are less than a threshold and which enclose a closed area are obtained, and according to the positions of the pixel points on the original image, a key area is obtained;

[0018] Pixels whose depth values ​​are greater than a threshold and form a closed area are obtained according to the depth image and the edge image, and a touch area is obtained according to the positions of the pixels on the original image.

[0019] In one implementation, the hand control function test items include a button pressing test item and a touch test item. The automatic control probe completes the hand control function test items at the hand control area and obtains a response result of the remote controller. According to the response result, the test result of the hand control function test item is obtained, including:

[0020] Guiding the probe to the key area, controlling the probe to press the key area, collecting the pressing force applied by the probe to the key area, and obtaining the key response result of the remote controller under the pressing force;

[0021] Obtaining, according to the pressing force and the key response result, pressing response analysis data of the key of the remote control to different pressing forces;

[0022] guiding the probe to reach the touch area, controlling the probe to move within the touch area, and collecting the moving speed of the probe and the touch response result of the remote controller;

[0023] According to the moving speed and the touch response result, obtaining touch response analysis data of the touch area of ​​the remote controller to different moving speeds;

[0024] The press response analysis data and the touch response analysis data are used as test results of the hand control function test item.

[0025] In one implementation, the method further includes:

[0026] Generate a voice function test item of the remote controller;

[0027] Sending a voice command related to the voice function test item to the remote controller, and collecting a feedback result of the remote controller based on the voice command;

[0028] Based on the feedback result, the test result of the voice function test item is obtained.

[0029] In one implementation, the remote controller is a verified remote controller, and the verification of the remote controller includes:

[0030] Switching to the reference coordinate system, capturing a panoramic image of the remote controller;

[0031] Obtaining coordinate positions of feature points of the remote controller in the reference coordinate system according to the panoramic image;

[0032] According to the coordinate positions of the feature points, it is verified whether the remote controller is the remote controller to be tested.

[0033] In a second aspect, an embodiment of the present invention further provides a remote control automatic testing system, comprising:

[0034] A fixing part, used for fixing the remote control;

[0035] An image collector, used to collect the original image of the remote control;

[0036] A probe, used to simulate a user's operation on the remote controller;

[0037] The control machine is electrically connected to the remote control, the image collector and the probe respectively, and is used to identify each hand-controlled area on the remote control based on the original image, and automatically control the probe to complete the hand-controlled function test item at the hand-controlled area, and obtain the response result of the remote control, and obtain the test result of the hand-controlled function test item based on the response result.

[0038] In a third aspect, an embodiment of the present invention further provides a remote control automatic testing device, wherein the device comprises the following components:

[0039] A test item generation module is used to generate a test item for the hand control function of the remote controller;

[0040] A recognition module, used to collect an original image of the remote control and recognize each hand-controlled area on the remote control based on the original image;

[0041] The test analysis module is used to automatically control the probe to complete the hand control function test item in the hand control area, and obtain the response result of the remote control, and obtain the test result of the hand control function test item according to the response result.

[0042] In a fourth aspect, an embodiment of the present invention further provides a terminal device, wherein the terminal device includes a memory, a processor, and a remote control automation test program stored in the memory and executable on the processor, and when the processor executes the remote control automation test program, the steps of the above-mentioned remote control automation test method are implemented.

[0043] In a fifth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a remote control automation testing program is stored. When the remote control automation testing program is executed by a processor, the steps of the remote control automation testing method described above are implemented.

[0044] Beneficial effect: The present invention first generates a manual control function test item for the remote control. The manual control function is to manually operate the remote control to realize the control function it has, and the manual control function test item is an item that tests the control function. Then, the original image of the remote control is collected, and the manual control area on the remote control is determined by identifying the original image. Then, the probe is automatically controlled to complete the above-mentioned manual control function test item in the manual control area, and the response result of the remote control based on the test item is obtained. Finally, the test result of the remote control is obtained according to the response result. From the above analysis, it can be seen that the present application can automatically locate the manual control area of ​​the remote control through image recognition technology, and complete the above-mentioned manual control function test item in the manual control area by automatically controlling the probe, so as to achieve the purpose of automatic testing of the remote control, thereby improving the test speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 It is the overall flow chart of the present invention;

[0046] Figure 2 Schematic diagram of a remote control, a fixture, a camera, a probe, and a PC in an embodiment of the present invention;

[0047] Figure 3 is a flow chart of testing a remote control on a fixture in an embodiment of the present invention;

[0048] Figure 4 A structural diagram of the remote control automation testing device provided by the present invention;

[0049] Figure 5 This is a block diagram of the internal structure principle of the terminal device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0050] The following is a clear and complete description of the technical solution of the present invention in combination with the embodiments and the accompanying drawings. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0051] According to research, smart TVs, set-top boxes, air conditioners, and light bulbs that can adjust the color gamut and brightness all require remote controls. Existing remote controls have the characteristics of multiple styles, multiple functions, and wide coverage. Although the remote control is small in size, it has multiple functions such as Bluetooth, infrared, voice, and NFC. In order to ensure the factory quality of the remote control, the quality of the remote control needs to be tested. The existing technology uses manual detection of the remote control, that is, manually pressing each button on the remote control to test whether the remote control will send the corresponding control command, and manual testing will reduce the test speed.

[0052] In order to solve the above technical problems, the present invention provides a remote control automatic testing method, system, device, equipment and medium, which solves the problem that the prior art reduces the remote control testing speed.

[0053] The remote control automatic testing method of this embodiment can be applied to a terminal device, which can be a terminal product with a control function, such as a computer. Figure 1 As shown in , the remote control automatic testing method specifically includes the following steps:

[0054] S100, generating a test item for the hand control function of the remote controller;

[0055] S200, collecting an original image of the remote control, and identifying each hand-controlled area on the remote control based on the original image;

[0056] S300, the automatic control probe completes the manual control function test item in the manual control area, and obtains the response result of the remote controller, and obtains the test result of the manual control function test item according to the response result.

[0057] Embodiment 1: This embodiment provides a remote control automatic testing system for implementing steps S100, S200 and S300. The automatic testing system includes the following components:

[0058] A fixing part, used for fixing the remote control;

[0059] An image collector, used to collect the original image of the remote control;

[0060] A probe, used to simulate a user's operation on the remote controller;

[0061] The control machine is electrically connected to the remote controller, the image collector and the probe respectively.

[0062] like Figure 2As shown, the fixing part is a jig of a box structure, and a clamp for clamping and fixing the remote control is provided on the jig. The fixing part can also be a fixing plate of a groove, and the size of the groove is equal to the size of the remote control. The image collector is a camera fixed on the jig, and the probe is located below the camera to ensure that the camera can capture the remote control. The control machine is a PC, and the PC is provided with a test tool. The PC is connected to the camera and the probe through a communication cable or wireless or USB communication method to drive the camera to capture the image of the remote control and receive the image, and drive the probe to press the button of the remote control, and receive the response result of the remote control after the button is pressed, wherein the PC establishes a communication connection with the remote control receiver through USB or wireless or other communication methods to obtain the above-mentioned response result of the remote control.

[0063] Embodiment 2, based on embodiment 1, step S100 of this embodiment generates not only a manual control function test item, but also a voice function test item, wherein the manual control function test item is an item for testing the manual control function of the remote control, and the manual control function is to manually operate the remote control to realize its control function; the voice function test item is an item for testing the voice control function of the remote control. This embodiment includes the following specific steps: obtaining the original design data of the remote control, and identifying the functional design data related to the manual control function and the functional design data related to the voice function from the original design data; based on the functional design data, generating the manual control function test item and the voice function test item.

[0064] The original design data includes remote control design drawing data and function specification file data. Function design data related to the manual control function is selected from the original design data. The function design data includes the function corresponding to each button, the function corresponding to pressing two buttons at the same time, and the function corresponding to multiple combination buttons, such as the functions corresponding to the four combination buttons of up, down, left, and right. The manual control function test item is an item that tests the above functions of the remote control, that is, by automatically controlling the probe to press a single button or press two buttons at the same time or press a combination button to test whether the remote control can achieve the corresponding function. Figure 3 As shown, when testing a single key, the probe repeatedly presses the single key 100 times, with an interval of 5 seconds between each press, to test whether the function of the single key is reliable.

[0065] Functional design data related to voice functions include enabling the remote control to have Bluetooth function through voice control. The voice function test item is to test whether the remote control can be controlled to connect to Bluetooth through voice. During each test, Bluetooth needs to be connected for 10 seconds, then disconnected, and reconnected after 30 seconds.

[0066] This embodiment also includes an infrared test item and an NFC test item. The infrared test item is to test whether the remote control has a function of emitting infrared rays, and the NFC test item is to test whether the remote control has an NFC function.

[0067] Before testing the remote control, that is, before executing step S200, this embodiment first needs to confirm whether the remote control placed on the fixture corresponds to the original design data input into the PC, that is, whether the remote control to be tested is the remote control that provides the original design data. Figure 3 In the detection management on the system, perform device calibration to calibrate whether it is the remote control that needs to be tested. Verify the remote control through the following specific steps: switch to the reference coordinate system and capture a panoramic image of the remote control; based on the panoramic image, obtain the coordinate position of the feature point of the remote control in the reference coordinate system; based on the coordinate position of the feature point, verify whether the remote control is the remote control that needs to be tested.

[0068] The local coordinate system and the reference coordinate system are saved on the PC (controller), where the local coordinate system is a coordinate system established with the remote control as a reference, that is, the center of the remote control is the origin of the local coordinate system, and the two mutually perpendicular center lines of the remote control are the ordinate and vertical coordinates of the local coordinate system, respectively; the reference coordinate system is a three-dimensional coordinate system, which is a coordinate system established with the square structure fixture as a reference, that is, one of the vertices of the fixture is the origin of the reference coordinate system, and the three sides where the vertex is located are the horizontal coordinate, vertical coordinate and vertical coordinate of the reference coordinate system, respectively.

[0069] Before testing the remote control, a panoramic image of the remote control is collected, and the three-dimensional coordinate positions of each feature point of the remote control are identified through the panoramic image. Each three-dimensional coordinate position is compared with each three-dimensional reference coordinate position of the remote control to be measured stored in the control machine to verify whether the remote control currently placed on the fixture is the remote control to be tested. The feature points include the inflection points of the remote control.

[0070] After verification, step S200 is started, and step S200 includes the following specific steps: determining the depth image of the original image; performing edge extraction on the original image to obtain the edge image of the original image; obtaining pixel points whose depth values ​​are less than a threshold and form a closed area based on the depth image and the edge image, and obtaining the key area based on the position of the pixel points on the original image; obtaining pixel points whose depth values ​​are greater than a threshold and form a closed area based on the depth image and the edge image, and obtaining the touch area based on the position of the pixel points on the original image.

[0071] The depth image records the distance between each pixel on the original image and the camera. When the camera is located directly above the remote control to collect its original image, since the buttons protrude from the surface of the remote control, the distance between the pixels where the buttons are located and the camera is relatively small. Therefore, the depth image can be used to identify the area where the buttons are located (i.e., the button area). The edge image records the edge position of the buttons. Therefore, the combination of the depth image and the edge image can improve the accuracy of the calculated button area. In this embodiment, the control machine switches the coordinate system to the local coordinate system, and then calculates the position of the button area in the local coordinate system. Since the local coordinate system has greater accuracy than the reference coordinate system, the position accuracy of the button area can be improved.

[0072] When the numbers on the keys are silk-screen numbers, the key area can also be located through digital recognition technology.

[0073] In this embodiment, the touch area of ​​the remote controller is a groove, so the distance between the pixel point of the touch area and the camera is relatively large, that is, the depth value is relatively large.

[0074] In this embodiment, step S300 includes the following specific steps: guiding the probe to the button area, controlling the probe to press the button area, collecting the pressing force applied by the probe to the button area, and obtaining the button response result of the remote control under the pressing force; obtaining the pressing response analysis data of the button of the remote control to different pressing forces based on the pressing force and the button response result; guiding the probe to the touch area, controlling the probe to move within the touch area, collecting the moving speed of the probe and the touch response result of the remote control; obtaining the touch response analysis data of the touch area of ​​the remote control to different moving speeds based on the moving speed and the touch response result; using the pressing response analysis data and the touch response analysis data as the test results of the hand control function test item.

[0075] The test button is Figure 3 In the detection item 1, the command to press the button sent to the probe is Figure 3 Instruction 1 in the control unit, when the probe receives the instruction, it presses the button 50 times at an interval of 5 seconds. After each press, the control unit collects the pressing force of the probe and the response result of the remote control to analyze how much force is needed to press the button to make the remote control respond, and compares the pressing force with the reference pressing force to test whether the remote control is qualified.

[0076] The control probe moves within the touch area to simulate a user operating the remote control through the touch area to realize its touch function, such as simulating a user's finger moving within the touch area to drive the remote control to adjust the TV volume.

[0077] like Figure 3 As shown, the probe moves from the starting coordinate to the ending coordinate in the touch area, repeatedly moving 50 times, with a time interval of 5 seconds between each movement, thereby simulating the movement of the user's finger in the touch area.

[0078] In summary, the present invention automatically identifies standardized test items and test standards by importing the function button design drawing and function specifications of the remote control into the remote control test system. The coordinate position of the remote control in the fixture box and the coordinate distribution position of the remote control buttons are automatically obtained through the machine vision and image recognition of the camera, and the identified results are automatically checked with the imported remote control function button design drawing; after checking that there is no problem with the remote control silk screen, the probe is automatically driven to detect whether the remote control key value is consistent with the specification according to the function rules of the remote control. If it is consistent, the function test is performed according to the detection item detection plan of the function specification.

[0079] This embodiment also provides a remote control automatic testing device, such as Figure 4 As shown, the device comprises the following components:

[0080] The test item generation module 01 is used to generate a test item for the hand control function of the remote controller;

[0081] The recognition module 02 is used to collect the original image of the remote control and recognize each hand control area on the remote control based on the original image;

[0082] The test analysis module 03 is used to automatically control the probe to complete the hand control function test item in the hand control area, and obtain the response result of the remote control, and obtain the test result of the hand control function test item according to the response result.

[0083] Based on the above embodiments, the present invention further provides a terminal device, whose principle block diagram can be shown as follows: Figure 5 As shown. The terminal device includes a processor, a memory, a network interface, and a display screen connected through a system bus. Among them, the processor of the terminal device is used to provide computing and control capabilities. The memory of the terminal device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the terminal device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a remote control automatic testing method is implemented. The display screen of the terminal device can be a liquid crystal display screen or an electronic ink display screen.

[0084] Those skilled in the art will understand that Figure 5The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present invention, and does not constitute a limitation on the terminal device to which the scheme of the present invention is applied. The specific terminal device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0085] In one embodiment, a terminal device is provided. The terminal device includes a memory, a processor, and a remote control automation test program stored in the memory and executable on the processor. When the processor executes the remote control automation test program, the following operation instructions are implemented:

[0086] Generate test items for the remote control's manual control function;

[0087] Acquiring an original image of the remote control, and identifying each hand-controlled area on the remote control based on the original image;

[0088] The automatic control probe completes the manual control function test item at the manual control area, and obtains the response result of the remote controller, and obtains the test result of the manual control function test item according to the response result.

[0089] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0090] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A remote control automated testing method, characterized in that: include: Generate test items for the remote control's manual control function; Acquiring an original image of the remote control, and identifying each hand-controlled area on the remote control based on the original image; The automatic control probe completes the manual control function test item at the manual control area, and obtains the response result of the remote controller, and obtains the test result of the manual control function test item according to the response result.

2. The remote control automated testing method according to claim 1, wherein: The generating of the hand control function test items of the remote controller includes: Acquiring original design data of the remote controller, and identifying functional design data related to the hand control function from the original design data; Based on the functional design data, a manual control function test item is generated.

3. The remote control automated testing method according to claim 1, wherein: The hand control area includes a button area and a touch screen area. Based on the original image, identifying each hand control area on the remote controller includes: Determining a depth image of the original image; Performing edge extraction on the original image to obtain an edge image of the original image; According to the depth image and the edge image, pixel points whose depth values ​​are less than a threshold and which enclose a closed area are obtained, and according to the positions of the pixel points on the original image, a key area is obtained; Pixels whose depth values ​​are greater than a threshold and form a closed area are obtained according to the depth image and the edge image, and a touch area is obtained according to the positions of the pixels on the original image.

4. The remote control automated testing method according to claim 3, characterized in that: The hand control function test items include a button pressing test item and a touch test item. The automatic control probe completes the hand control function test items at the hand control area and obtains the response result of the remote controller. According to the response result, the test result of the hand control function test item is obtained, including: guiding the probe to reach the key area, controlling the probe to press the key area, collecting the pressing force applied by the probe to the key area, and obtaining the key response result of the remote controller under the pressing force; Obtaining, according to the pressing force and the key response result, pressing response analysis data of the key of the remote control to different pressing forces; guiding the probe to reach the touch area, controlling the probe to move within the touch area, and collecting the moving speed of the probe and the touch response result of the remote controller; According to the moving speed and the touch response result, obtaining touch response analysis data of the touch area of ​​the remote controller to different moving speeds; The press response analysis data and the touch response analysis data are used as test results of the hand control function test item.

5. The remote control automated testing method according to claim 1, wherein: Also includes: Generate a voice function test item of the remote controller; Sending a voice command related to the voice function test item to the remote controller, and collecting a feedback result of the remote controller based on the voice command; Based on the feedback result, the test result of the voice function test item is obtained.

6. The remote control automatic testing method according to any one of claims 1 to 5, characterized in that: The remote controller is a verified remote controller, and the verification of the remote controller includes: Switching to the reference coordinate system, capturing a panoramic image of the remote controller; Obtaining coordinate positions of feature points of the remote controller in the reference coordinate system according to the panoramic image; According to the coordinate positions of the feature points, it is verified whether the remote controller is the remote controller to be tested.

7. A remote control automatic testing system, characterized in that: include: A fixing part, used for fixing the remote control; An image collector, used to collect the original image of the remote control; A probe, used to simulate a user's operation on the remote controller; The control machine is electrically connected to the remote control, the image collector and the probe respectively, and is used to identify each hand-controlled area on the remote control based on the original image, and automatically control the probe to complete the hand-controlled function test item at the hand-controlled area, and obtain the response result of the remote control, and obtain the test result of the hand-controlled function test item based on the response result.

8. A remote control automatic testing device, characterized in that: The device comprises the following components: A test item generation module is used to generate a test item for the hand control function of the remote controller; A recognition module, used to collect an original image of the remote control and recognize each hand-controlled area on the remote control based on the original image; The test analysis module is used to automatically control the probe to complete the hand control function test item in the hand control area, and obtain the response result of the remote control, and obtain the test result of the hand control function test item according to the response result.

9. A terminal device, characterized in that: The terminal device includes a memory, a processor, and a remote control automation test program stored in the memory and executable on the processor. When the processor executes the remote control automation test program, the steps of the remote control automation test method as described in any one of claims 1-6 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a remote control automation test program, and when the remote control automation test program is executed by the processor, the steps of the remote control automation test method according to any one of claims 1 to 6 are implemented.

Images