Controller automatic test tool based on feature recognition and test method thereof

By integrating image acquisition and electromechanical execution systems into an automated testing fixture for controllers, the problem of low efficiency in traditional manual testing has been solved. This enables efficient and reliable automated testing of different controller models, improving the consistency and security of test results.

CN120848453APending Publication Date: 2025-10-28NINGBO HUIWUXING INTELLIGENT DRIVE CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202510957199.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-07-11
Publication Date
2025-10-28

AI Technical Summary

Technical Problem

Traditional manual testing methods are inefficient and prone to errors, and the differences in screen UI and button positions of different controller models increase testing complexity and costs.

Method used

An automated test fixture for controllers based on feature recognition is adopted, which integrates image acquisition and electromechanical execution systems to realize automatic recognition of the controller screen display status and function operation. It includes image acquisition unit, electromechanical execution unit, control unit, etc., and can automatically identify the model and execute the corresponding test logic.

Benefits of technology

It improves testing efficiency and consistency of test results, enhances compatibility with different controller models, reduces equipment adjustment complexity and cost, and ensures operational safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120848453A_ABST
    Figure CN120848453A_ABST
Patent Text Reader

Abstract

The invention discloses a controller automatic test tool based on feature recognition and a test method thereof, and relates to the technical field of automatic test. The controller automation test tool comprises an image acquisition unit used for capturing display content of a controller screen; the electromechanical execution unit comprises a base positioning mechanism, a top pressing mechanism, a rear side butt joint mechanism, a key triggering mechanism set and a vibration mechanism. The control unit is respectively in communication connection with the image acquisition unit and the electromechanical execution unit, and is used for controlling the action of the electromechanical execution unit and receiving and analyzing the image information captured by the image acquisition unit; and the double-starting switch is connected with the control unit and needs to be synchronously triggered to start a test program. By integrating image acquisition and an electromechanical execution system, automatic identification of the display state of the controller screen and automatic execution of function operation are realized, and the consistency of the test efficiency and the test result is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of automated testing technology, and in particular to an automated testing fixture and testing method for controllers based on feature recognition. Background Technology

[0002] Traditional manual testing methods rely on people observing the screen and manually pressing buttons. This method is not only inefficient, but also prone to errors due to worker fatigue, making it difficult to guarantee the reliability of test results.

[0003] In addition, different controller models have different screen UIs and button positions, which makes it necessary to frequently adjust the entire fixture to adapt to different controller models, increasing the complexity and cost of the testing process. Summary of the Invention

[0004] To address the aforementioned issues, this application provides an automated testing fixture for controllers based on feature recognition. By integrating image acquisition and electromechanical execution systems, it achieves automatic recognition of the controller's screen display status and automated execution of functional operations, thereby improving testing efficiency and the consistency of test results. Correspondingly, a testing method is also provided, which can be applied to automated testing fixtures for controllers under different conditions.

[0005] The first technical solution adopted in this application is: providing an automated testing fixture for controllers based on feature recognition, comprising:

[0006] Image acquisition unit, used to capture the content displayed on the controller screen;

[0007] Electromechanical actuator, including:

[0008] The base positioning mechanism is used to support and position the controller under test;

[0009] A top clamping mechanism is positioned above the base positioning mechanism and is used to vertically and downwardly clamp the controller under test.

[0010] The rear docking mechanism is located behind the base positioning mechanism and is used to horizontally push the interface plug to dock with the corresponding interface on the controller under test.

[0011] The button triggering mechanism group includes multiple independently driven triggering components for simulating pressing the physical buttons of the controller under test;

[0012] A vibration mechanism is used to apply mechanical vibration to the controller under test;

[0013] The control unit is communicatively connected to the image acquisition unit and the electromechanical execution unit, respectively, and is used to control the operation of the electromechanical execution unit and receive and analyze the image information captured by the image acquisition unit.

[0014] A dual-start switch, connected to the control unit, needs to be triggered synchronously to start the test program.

[0015] In an optional embodiment, the rear docking mechanism includes a push plate and a cylinder that drives the push plate. The push plate and the driving end of the cylinder are assembled through a floating connection structure, so that the interface plug can adaptively deflect the angle.

[0016] In an optional embodiment, the image acquisition unit is an industrial camera; the control unit has a built-in library of screen display feature templates for various controller models and is configured as follows:

[0017] By matching the images captured by the industrial camera with the feature template library, the model of the current controller under test is identified, and the test logic corresponding to that model is invoked.

[0018] In an optional embodiment, the top clamping mechanism is cylinder-driven; the end of the top clamping cylinder is integrated with a pressure feedback device, and the control unit is configured to dynamically adjust the output force of the top clamping cylinder based on real-time pressure data provided by the pressure feedback device.

[0019] In an optional embodiment, the button triggering mechanism group includes at least three independently driven triggering components, each corresponding to a different physical button position on the controller under test.

[0020] In an optional embodiment, the dual start switch is connected to an emergency stop protection circuit, which is configured to immediately send an interrupt signal to the control unit or directly cut off the drive power of the electromechanical actuator when either of the two buttons of the dual start switch is released, so as to interrupt the test process.

[0021] The second technical solution adopted in this application is: a testing method based on the testing fixture described in any of the above claims is provided, comprising the following steps:

[0022] S1: Synchronously trigger the dual start switch to start the test program;

[0023] S2: Control the top pressing mechanism to press the controller under test, and control the rear docking mechanism to push the interface plug to complete the docking with the motor interface and power interface of the controller under test;

[0024] S3: The screen image of the controller under test is captured by the image acquisition unit, and the control unit performs image recognition to determine whether the screen displays a preset reset mark; if the preset reset mark is recognized, the subsequent test steps continue; otherwise, an abnormality is determined and an alarm or termination process is executed.

[0025] In an optional embodiment, after determining in step S3 that a preset reset flag is displayed, the method further includes:

[0026] S4: Control the button triggering mechanism group to press the specified button combination synchronously to activate the full-brightness test program of the digital tube of the controller under test;

[0027] S5: The image acquisition unit captures the screen image in the fully lit state, and the control unit performs image analysis to detect whether there is a segment defect in the digital tube;

[0028] S6: Control the button triggering mechanism group to press the lifting button of the controller under test in sequence, and verify whether its control function is normal by monitoring the output of the controller under test or the response of the connected motor.

[0029] In an optional embodiment, in step S3, if the control unit recognizes the height value information displayed on the screen through image recognition, it determines that there is a program error, terminates the test process, and triggers an alarm device.

[0030] In an optional embodiment, after activating the up button in step S6, the vibration mechanism is controlled to apply a preset mode of mechanical vibration to the controller under test; at the same time, the screen image is captured by the image acquisition unit, and the control unit performs image recognition to determine whether the screen outputs a preset fault code, so as to verify the fault detection function of the built-in attitude sensor of the controller under test.

[0031] Due to the adoption of the above technical solution, this application has at least one of the following beneficial effects compared with the prior art:

[0032] 1. By integrating image acquisition and electromechanical execution systems, the automatic recognition of the controller screen display status and the automated execution of functional operations are realized, improving testing efficiency and the consistency of test results.

[0033] 2. The control unit has a built-in screen display feature template library for various controller models, and can automatically identify the model of the controller under test based on the captured image information, and then call the corresponding test logic, which enhances the compatibility with different controller models.

[0034] 3. The top clamping mechanism is equipped with a pressure feedback device, which can dynamically adjust the output force according to real-time pressure data to avoid equipment damage or testing errors caused by excessive or insufficient pressure.

[0035] 4. The dual-start switch design requires synchronous triggering to start the test program. Combined with the emergency stop protection circuit, it greatly improves the safety of operation. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] in:

[0038] Figure 1 A schematic diagram of the framework of an automated test fixture for a controller provided in an embodiment of this application;

[0039] Figure 2 This is a flowchart illustrating a testing method provided in one embodiment of this application. Detailed Implementation

[0040] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are only for explaining this application and not for limiting it. Furthermore, it should be noted that, for ease of description, only the parts related to this application are shown in the accompanying drawings, not all structures. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0041] The terms "first," "second," etc., used in this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0042] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0043] This application provides an automated testing fixture for controllers based on feature recognition. By integrating image acquisition and electromechanical execution systems, it achieves automatic recognition of the controller's screen display status and automated execution of functional operations, improving testing efficiency and the consistency of test results. Figure 1-2 As shown, Figure 1 This is a schematic diagram of the framework of an automated controller testing fixture provided in an embodiment of this application. The automated controller testing fixture includes:

[0044] An image acquisition unit is used to capture the content displayed on the controller screen. The unit is a high-resolution industrial camera, ensuring that all details displayed on the controller screen are clearly captured. The camera is mounted on a multi-directionally adjustable bracket to allow for angle and height adjustments to accommodate controller screens of different sizes and types.

[0045] Electromechanical actuator, including:

[0046] The base positioning mechanism is used to support and position the controller under test. By precisely adjusting the position of the controller under test, it ensures that its screen and other interfaces are accurately aligned with the image acquisition unit and the rear docking mechanism, thereby improving the accuracy of the entire testing process.

[0047] The top clamping mechanism, located above the base positioning mechanism, is used to vertically clamp the controller under test downwards. By clamping the controller under test downwards, a stable and precise connection between the controller and the interface plug in the rear docking mechanism can be ensured.

[0048] The rear docking mechanism, located behind the base positioning mechanism, is used to horizontally push the interface plug to dock with the corresponding interface on the controller under test. By precisely controlling the downward pressure, the top clamping mechanism ensures a tight contact between the controller and the interface plug, effectively preventing data transmission errors caused by looseness or poor contact, and improving the reliability and accuracy of the test.

[0049] The button triggering mechanism assembly includes multiple independently driven triggering components for simulating the pressing of physical buttons on the controller under test. By using independently driven triggering components to automatically execute button operations, the time and workload of manual intervention can be significantly reduced, making the entire testing process more efficient. Compared to manual pressing, automated button operation can complete a series of preset operation steps at a faster speed, thereby accelerating the testing process.

[0050] A vibration mechanism is used to apply mechanical vibration to the controller under test (DUT). By applying mechanical vibration, various dynamic conditions that the controller may encounter during actual use can be simulated. This helps to verify the stability and reliability of the controller under these conditions, ensuring that it can operate normally in various environments.

[0051] The control unit is communicatively connected to both the image acquisition unit and the electromechanical execution unit. It controls the actions of the electromechanical execution unit and receives and analyzes the image information captured by the image acquisition unit. The control unit centrally manages and coordinates the work of each subsystem, simplifying the complexity of the overall system and improving the continuity and efficiency of the testing process.

[0052] By working closely with the image acquisition unit and the electromechanical actuation unit, the control unit can react quickly based on the information acquired in real time. For example, it can immediately stop the test process or issue a warning signal when an abnormality is detected, thereby effectively preventing further damage.

[0053] The dual-start switch connects to the control unit and must be triggered synchronously to start the test program. For operational safety, both start buttons must be pressed simultaneously to activate the test program. If only one button is pressed or the time difference between the two buttons exceeds a preset threshold (e.g., 0.5 seconds), the test process will not be triggered, and an error message will be displayed.

[0054] In summary, the automated controller testing fixture of this embodiment includes: an image acquisition unit for capturing the display content of the controller screen; an electromechanical execution unit including a base positioning mechanism, a top clamping mechanism, a rear docking mechanism, a button triggering mechanism group, and a vibration mechanism; a control unit, communicatively connected to both the image acquisition unit and the electromechanical execution unit, for controlling the actions of the electromechanical execution unit and receiving and analyzing the image information captured by the image acquisition unit; and a dual-start switch connected to the control unit, which needs to be triggered synchronously to start the test program. By integrating the image acquisition and electromechanical execution systems, automatic recognition of the controller screen display status and automated execution of functional operations are achieved, improving testing efficiency and the consistency of test results.

[0055] The rear docking mechanism includes a push plate and a cylinder that drives the push plate. The push plate and the driving end of the cylinder are assembled through a floating connection structure, so that the interface plug can adapt to the deflection angle.

[0056] The floating connection structure allows the push plate to freely adjust its angle and position within a certain range to accommodate minor deviations in the interface positions of different controller models. The floating connection structure can employ a ball joint or a spring-loaded mechanism, enabling the push plate to adaptively deflect its angle and ensure good contact during docking.

[0057] Because it can adapt to different interface position offsets, the rear docking mechanism does not need to customize a dedicated docking device for each specific model of controller, which greatly enhances the versatility and flexibility of the system and reduces the cost and complexity of equipment adjustment.

[0058] The image acquisition unit is an industrial camera; the control unit has a built-in library of screen display feature templates for various controller models and is configured as follows:

[0059] By matching images captured by industrial cameras with a feature template library, the model of the current controller under test is identified, and the test logic corresponding to that model is invoked.

[0060] The control unit has a built-in database containing screen display characteristics of various controller models. These characteristics include, but are not limited to, startup screens, error codes, and function interface layouts. Each model has its unique screen display characteristics, which are stored in a template library as identification criteria.

[0061] Once the industrial camera captures a screen image of the controller under test (DUT), the control unit runs a specially designed image processing algorithm to preprocess the captured image, extract key features, and match them with data in a template library. By comparing similarity scores, the system can accurately identify the specific model of the DUT. Based on the similarity score, the control unit then calls the test program that matches the model from a pre-set test logic library.

[0062] The top clamping mechanism is cylinder driven; the end of the top clamping cylinder is integrated with a pressure feedback device, and the control unit is configured to dynamically adjust the output force of the top clamping cylinder according to the real-time pressure data provided by the pressure feedback device.

[0063] By monitoring and dynamically adjusting the output force of the top clamping cylinder in real time, it can be ensured that the contact between the controller under test and the interface plug is both firm and not over-compressed, thereby ensuring a good electrical connection while avoiding physical damage. The pressure feedback device allows the control system to flexibly adjust the pressure according to the actual situation, which can prevent poor contact due to insufficient pressure, and also avoid damage to the controller or other components due to excessive pressure, effectively protecting the safety of the device under test.

[0064] The button triggering mechanism group contains at least three independently driven triggering components, each corresponding to a different physical button position on the controller under test. By precisely controlling the action parameters of each triggering component, the consistency and accuracy of each button operation can be ensured, thereby improving the reliability of the test results.

[0065] Because each triggering component can independently adjust its position and travel, the button triggering mechanism can flexibly adapt to a variety of controllers of different specifications; there is no need to redesign the hardware for each new controller, which greatly enhances the versatility and flexibility of the system.

[0066] The dual start switch is connected to an emergency stop protection circuit, which is configured to immediately send an interrupt signal to the control unit or directly cut off the drive power of the electromechanical actuator when either of the two buttons on the dual start switch is released, thereby interrupting the test process.

[0067] The dual-start switch includes two physical buttons located on the control panel for easy pressing with both hands simultaneously. Each button is connected to the control unit via an independent signal line, ensuring the stability and reliability of signal transmission.

[0068] When any button is released, the emergency stop protection circuit immediately sends an interrupt signal to the control unit. This signal triggers the control unit to execute preset safety measures, such as suspending the operation of all electromechanical actuators and saving the current data state.

[0069] To provide additional safety, the emergency stop protection circuit can also directly cut off the drive power of the electromechanical actuator; it can stop all mechanical movements in the shortest possible time and avoid further potential dangers.

[0070] This application also provides a testing method based on an automated test fixture for controllers. Figure 2 A flowchart illustrating a testing method provided in an embodiment of this application includes the following steps:

[0071] S1: Synchronously trigger the dual start switch. After the control unit confirms that the two buttons are triggered at the same time, the test program is started.

[0072] S2: Control the top clamping mechanism to clamp the controller under test, and dynamically adjust the output force through the pressure feedback device to ensure safe clamping; and control the rear docking mechanism to push the interface plug to complete the docking with the motor interface and power interface of the controller under test;

[0073] S3: The screen image of the controller under test is captured by the image acquisition unit, and the control unit performs image recognition to determine whether the screen displays a preset reset mark; if the preset reset mark is recognized, the subsequent test steps continue; otherwise, an abnormality is determined and an alarm or termination process is executed.

[0074] After determining the display of the preset reset flag in step S3, the process also includes:

[0075] S4: Control the button trigger mechanism group to press the specified button combination synchronously to activate the test program of the digital tube of the controller under test to light up all the way;

[0076] S5: The image acquisition unit captures the screen image in the fully lit state, and the control unit performs image analysis to detect whether there are any missing segments in the digital tube;

[0077] S6: The control button trigger mechanism group presses the lifting and lowering buttons of the controller under test in sequence, and verifies whether its control function is normal by monitoring the output of the controller under test or the response of the connected motor.

[0078] In step S3, if the control unit recognizes the height value information displayed on the screen through image recognition, it determines that there is a program error, terminates the test process, and triggers the alarm device.

[0079] After activating the up button in step S6, the vibration mechanism is controlled to apply a preset mechanical vibration to the controller under test; at the same time, the screen image is captured by the image acquisition unit and the control unit performs image recognition to determine whether the screen outputs a preset fault code, so as to verify the fault detection function of the built-in attitude sensor of the controller under test.

[0080] From startup, clamping, interface docking, image recognition to functional verification, the entire process requires no manual intervention, significantly shortening the single test time and improving production cycle and capacity; the dual start switch + emergency stop protection circuit design ensures that all actions can be stopped immediately in an emergency; the pressure feedback system prevents over-clamping from causing equipment damage; abnormal image recognition automatically terminates the process, avoiding misjudgment and the expansion of potential risks.

[0081] In the several embodiments provided in this application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0082] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0083] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0084] The above description is only an implementation method of the present application and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An automated testing fixture for controllers based on feature recognition, characterized in that, include: Image acquisition unit, used to capture the content displayed on the controller screen; Electromechanical actuator, including: The base positioning mechanism is used to support and position the controller under test; A top clamping mechanism is positioned above the base positioning mechanism and is used to vertically and downwardly clamp the controller under test. The rear docking mechanism is located behind the base positioning mechanism and is used to horizontally push the interface plug to dock with the corresponding interface on the controller under test. The button triggering mechanism group includes multiple independently driven triggering components for simulating pressing the physical buttons of the controller under test; A vibration mechanism is used to apply mechanical vibration to the controller under test; The control unit is communicatively connected to the image acquisition unit and the electromechanical execution unit, respectively, and is used to control the operation of the electromechanical execution unit and receive and analyze the image information captured by the image acquisition unit. A dual-start switch, connected to the control unit, needs to be triggered synchronously to start the test program.

2. The automated testing fixture for the controller according to claim 1, characterized in that, The rear docking mechanism includes a push plate and a cylinder that drives the push plate. The push plate and the driving end of the cylinder are assembled through a floating connection structure, so that the interface plug can adaptively deflect the angle.

3. The automated testing fixture for the controller according to claim 1, characterized in that, The image acquisition unit is an industrial camera; the control unit has a built-in screen display feature template library for various controller models and is configured as follows: By matching the images captured by the industrial camera with the feature template library, the model of the current controller under test is identified, and the test logic corresponding to that model is invoked.

4. The automated testing fixture for the controller according to claim 1, characterized in that, The top clamping mechanism is cylinder driven; the end of the top clamping cylinder is integrated with a pressure feedback device, and the control unit is configured to dynamically adjust the output force of the top clamping cylinder according to the real-time pressure data provided by the pressure feedback device.

5. The automated testing fixture for controllers according to claim 1, characterized in that, The button triggering mechanism group includes at least three independently driven triggering components, each corresponding to a different physical button position on the controller under test.

6. The automated testing fixture for the controller according to claim 1, characterized in that, The dual-start switch is connected to an emergency stop protection circuit, which is configured to immediately send an interrupt signal to the control unit or directly cut off the drive power of the electromechanical actuator when either of the two buttons on the dual-start switch is released, thereby interrupting the test process.

7. A testing method based on the testing fixture according to any one of claims 1-6, characterized in that, The steps include: S1: Synchronously trigger the dual start switch to start the test program; S2: Control the top pressing mechanism to press the controller under test, and control the rear docking mechanism to push the interface plug to complete the docking with the motor interface and power interface of the controller under test; S3: The screen image of the controller under test is captured by the image acquisition unit, and the control unit performs image recognition to determine whether the screen displays a preset reset mark; if the preset reset mark is recognized, the subsequent test steps continue; otherwise, an abnormality is determined and an alarm or termination process is executed.

8. The test method according to claim 7, characterized in that, After determining the display of the preset reset flag in step S3, the process also includes: S4: Control the button triggering mechanism group to press the specified button combination synchronously to activate the full-brightness test program of the digital tube of the controller under test; S5: The image acquisition unit captures the screen image in the fully lit state, and the control unit performs image analysis to detect whether there is a segment defect in the digital tube; S6: Control the button triggering mechanism group to press the lifting button of the controller under test in sequence, and verify whether its control function is normal by monitoring the output of the controller under test or the response of the connected motor.

9. The test method according to claim 7, characterized in that, In step S3, if the control unit recognizes the height value information displayed on the screen through image recognition, it determines that there is a program error, terminates the test process, and triggers the alarm device.

10. The test method according to claim 8, characterized in that, After activating the up button in step S6, the vibration mechanism is controlled to apply a preset mechanical vibration to the controller under test; at the same time, the screen image is captured by the image acquisition unit, and the control unit performs image recognition to determine whether the screen outputs a preset fault code, so as to verify the fault detection function of the built-in attitude sensor of the controller under test.

Citation Information

Cited By

  • Controller power-on test equipment, test method and manufacturing system

    CN121857659A

  • Controller manufacturing system, control method and controller

    CN121879331A