A method and system for testing a trackball controller

By using image recognition and bus message processing, the automated simulation of trackball operation solves the bottleneck of manual operation in the testing of display and control processors, realizes fully automated testing of display and control systems, and improves testing efficiency and quality.

CN119782066BActive Publication Date: 2025-11-21XIAN AIRCRAFT DESIGN INST OF AVIATION IND OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411873347.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-18
Publication Date
2025-11-21
Estimated Expiration
2044-12-18

AI Technical Summary

Technical Problem

Existing technology cannot automate the control operation of a trackball, resulting in low testing efficiency of the display and control processor and disrupting the fully automated testing chain.

Method used

This paper provides a test method and system for a display and control processor that simulates trackball operation. The method obtains the cursor position and direction through image recognition, calculates the trackball displacement, and sends bus messages to the display and control processor to realize the automated operation of the trackball.

Benefits of technology

It enables fully automated testing of the display and control processor, improving testing efficiency and quality, and supports automated testing of airborne display and control systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119782066B_ABST
    Figure CN119782066B_ABST
Patent Text Reader

Abstract

The application belongs to the technical field of display control processor testing, and particularly relates to a display control processor testing method and system for simulating trackball operation, which can automatically simulate the human-computer interaction operation process through a trackball, support full-automatic testing of a display control processor, and be applied to testing of an airborne display control system, and can significantly improve the development efficiency and development quality of the display control processor, and is simple, novel and has high application value.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of display control processor testing, and particularly relates to a display control processor testing method and system for simulating trackball operation. BACKGROUND

[0002] The trackball is one of the commonly used human-computer interaction control devices in the cockpit of an airplane, and mainly provides a control function for a cursor on a display, which is similar to a "mouse" in the cockpit of an airplane.

[0003] The trackball has a style as shown in the figure Figure 1 , wherein A is a selection and confirmation button, B is a scroll wheel, which provides a page up and down operation for a picture where a cursor is located, C is a scroll ball, which provides a moving operation for the cursor in horizontal and vertical directions, and D is a "switch" button, which provides a control function for sequentially switching a display area where the cursor is located.

[0004] The trackball is connected to an airborne display control processor through an airborne bus, and the trackball realizes a control function for the system by sending a bus message to the display control processor (embedded display control software), and the content of the sent bus message usually includes a scroll wheel change amount, a scroll ball X displacement, a scroll ball Y displacement, and a button word, wherein the vector formed by the combination of the X displacement and the Y displacement represents a moving speed and direction of the cursor in a display picture.

[0005] In order to improve the research and development efficiency and quality of an airplane system, an automatic test technical means is usually adopted, and the automatic test of the display control processor of a display control system is more complex, and usually involves automatic identification and determination of a display picture and simulation of a pilot operation, for which, a current airplane system automatic test device based on image recognition is constructed, which can support automatic test of the display control system based on image recognition, but cannot simulate the control operation of the trackball, and when a trackball related human-computer interaction test case is executed, manual operation is necessary, which breaks the automatic test chain, and leads to low test efficiency of the display control processor, and therefore, the application is proposed. SUMMARY

[0006] The application aims to provide a display control processor testing method and system for simulating trackball operation, so as to automatically simulate a trackball control related human-computer interaction operation process and support full-automatic test of a display control system.

[0007] The technical scheme of the application is:

[0008] In one aspect, a display control processor testing method for simulating trackball operation is provided, comprising:

[0009] An operation requirement extraction step: according to a display control processor test requirement, an operation requirement is extracted;

[0010] Soft button interaction area position coordinate acquisition step: according to the operation requirement, mark the display picture, and acquire the position coordinate of the interaction area of the corresponding soft button in the display picture;

[0011] Cursor position coordinate acquisition step: acquire the position coordinate (Xcursor, Ycursor) of the cursor in the display picture;

[0012] Cursor moving direction calculation step: according to the position coordinate of the cursor in the display picture and the position coordinate of the interaction area of the soft button, calculate the moving direction of the cursor;

[0013] Trackball X-Y direction displacement calculation step: according to the moving direction of the cursor, calculate the displacement of the trackball in the X-Y direction;

[0014] Trackball moving simulation step: according to the calculated displacement of the trackball in the X-Y direction and the moving direction of the cursor, control the cursor to move in the display picture, simulate the trackball controlling the cursor to move to the interaction area of the soft button, and continuously send the bus message corresponding to the trackball movement to the display control processor;

[0015] Real-time cursor position coordinate acquisition and judgment step: acquire the position coordinate (Xcursor, Ycursor) of the cursor in the display picture in real time, judge whether the cursor enters the interaction area of the soft button, if not, repeat the cursor moving direction calculation step, the trackball X-Y direction displacement calculation step, and the trackball moving simulation step until the cursor enters the interaction area of the soft button;

[0016] Trackball key operation simulation step: according to the operation requirement, send the bus message corresponding to the trackball key to the display control processor, and simulate the key operation of the trackball.

[0017] According to at least one embodiment of the present application, in the above-mentioned display control processor test method for simulating trackball operation, in the cursor position coordinate acquisition step, the position coordinate (Xcursor, Ycursor) of the cursor in the display picture is acquired through image recognition.

[0018] According to at least one embodiment of the present application, in the above-mentioned display control processor test method for simulating trackball operation, in the cursor moving direction calculation step, the moving direction of the cursor is calculated, and the calculation is specifically as follows:

[0019] X' = (Xmin + Xmax) / 2 - Xcursor;

[0020] Y' = (Ymin + Ymax) / 2 - Ycursor;

[0021] Wherein:

[0022] (X', Y') is the vector representation of the moving direction of the cursor.

[0023] According to at least one of the embodiments of the present application, in the simulation trackball operation display control processor test method, in the trackball X-Y direction displacement calculation step, the displacement of the trackball in the X-Y direction is calculated, specifically:

[0024] X=S;

[0025] Y=S*(Y' / X');

[0026] wherein:

[0027] S is a simulation quantity reference value for the trackball to control the cursor movement;

[0028] X and Y are the displacement of the trackball in the X-Y direction.

[0029] According to at least one of the embodiments of the present application, in the simulation trackball operation display control processor test method, in the trackball movement simulation step, the bus message corresponding to the trackball movement is continuously sent to the display control processor, and specifically, the displacement of the trackball in the X-Y direction is calculated.

[0030] According to at least one of the embodiments of the present application, in the simulation trackball operation display control processor test method, in the cursor position coordinate real-time acquisition and judgment step, the position coordinates (X_cursor, Y_cursor) of the cursor in the display picture are acquired in real time through image recognition.

[0031] According to at least one of the embodiments of the present application, in the simulation trackball operation display control processor test method, in the cursor position coordinate real-time acquisition and judgment step, if XminX_cursorXmax and YminY_cursorYmax, it is judged that the cursor enters the interactive area of the soft button.

[0032] In another aspect, a simulation trackball operation display control processor test system is provided, comprising:

[0033] An operation requirement extraction module is configured to extract operation requirements according to display control processor test requirements;

[0034] A soft button interactive area position coordinate acquisition module is configured to mark a display picture according to operation requirements, and acquire the position coordinates of the interactive area of a corresponding soft button in the display picture;

[0035] A cursor position coordinate acquisition module is configured to acquire the position coordinates (X_cursor, Y_cursor) of the cursor in the display picture;

[0036] A cursor movement direction calculation module is configured to calculate the movement direction of the cursor according to the position coordinates of the interactive area of the soft button in the display picture and the position coordinates of the cursor;

[0037] The trajectory ball X-Y direction displacement calculation module is configured to calculate the displacement of the trajectory ball in the X-Y direction according to the moving direction of the cursor.

[0038] The trajectory ball moving simulation module is configured to control the cursor to move in the display control picture according to the calculated displacement of the trajectory ball in the X-Y direction and the moving direction of the cursor, simulate the trajectory ball to control the cursor to move to the interactive region of the soft button, and continuously send the bus message corresponding to the trajectory ball movement to the display control processor.

[0039] The cursor position coordinate real-time acquisition and judgment module is configured to acquire the position coordinates (X_cursor, Y_cursor) of the cursor in the display picture in real time, judge whether the cursor enters the interactive region of the soft button, and repeatedly call the cursor moving direction calculation module, the trajectory ball X-Y direction displacement calculation module and the trajectory ball moving simulation module until the cursor enters the interactive region of the soft button.

[0040] The trajectory ball key operation simulation module is configured to send the bus message corresponding to the trajectory ball key to the display control processor according to the operation requirement, and simulate the key operation of the trajectory ball.

[0041] According to at least one embodiment of the present application, in the display control processor test system for simulating the trajectory ball operation, the cursor position coordinate acquisition module acquires the position coordinates (X_cursor, Y_cursor) of the cursor in the display picture through image recognition.

[0042] According to at least one embodiment of the present application, in the display control processor test system for simulating the trajectory ball operation, the cursor moving direction calculation module calculates the moving direction of the cursor, and the calculation is specifically as follows:

[0043] X'=(Xmin+Xmax) / 2-X_cursor;

[0044] Y'=(Ymin+Ymax) / 2-Y_cursor;

[0045] Wherein:

[0046] (X', Y') is the vector representation of the moving direction of the cursor.

[0047] According to at least one embodiment of the present application, in the display control processor test system for simulating the trajectory ball operation, the trajectory ball X-Y direction displacement calculation module calculates the displacement of the trajectory ball in the X-Y direction, and the calculation is specifically as follows:

[0048] X=S;

[0049] Y=S*(Y' / X');

[0050] Wherein:

[0051] S is the reference value of the simulation quantity of the trajectory ball controlling the cursor to move.

[0052] X, Y is the displacement of the trackball in the X-Y direction.

[0053] According to at least one of the embodiments of the present application, in the above-mentioned test system for the display control processor simulating the trackball operation, in the trackball movement simulation module, the bus message corresponding to the trackball movement is continuously sent to the display control processor, and specifically, the displacement of the trackball in the X-Y direction is calculated.

[0054] According to at least one of the embodiments of the present application, in the above-mentioned test system for the display control processor simulating the trackball operation, in the real-time acquisition and judgment module for the position coordinates of the cursor, the position coordinates (Xcursor, Ycursor) of the cursor in the display picture are acquired in real time through image recognition.

[0055] According to at least one of the embodiments of the present application, in the above-mentioned test system for the display control processor simulating the trackball operation, in the real-time acquisition and judgment module for the position coordinates of the cursor, if XminXcursorXmax and YminYcursorYmax, it is judged that the cursor enters the interactive area of the soft button.

[0056] The present application has at least the following beneficial technical effects:

[0057] The present application provides a test method and system for the display control processor simulating the trackball operation, which can automatically simulate the human-computer interaction operation process through the trackball, support full-automatic test of the display control processor, and be applied to test the airborne display control system, thereby significantly improving the development efficiency and quality of the display control processor, and having high application value. BRIEF DESCRIPTION OF DRAWINGS

[0058] Figure 1 is a schematic diagram of the style of the trackball;

[0059] Figure 2 is a schematic diagram of the test method for the display control processor simulating the trackball operation provided by the embodiments of the present application;

[0060] Figure 3 is a schematic diagram of the display picture in which the "radio" soft button is labeled provided by the embodiments of the present application;

[0061] Figure 4 is a schematic diagram of the test system for the display control processor simulating the trackball operation provided by the embodiments of the present application.

[0062] In order to better illustrate the embodiments, some components in the drawings may be omitted, enlarged or reduced, and do not represent the actual size of the product. In addition, the drawings are only used for illustrative description and cannot be understood as a limitation of the present application. DETAILED DESCRIPTION

[0063] In order to make the technical solutions of the present application and the advantages thereof clearer, the technical solutions of the present application will be further clearly and completely described below with reference to the drawings. It should be understood that the specific embodiments described herein are only some embodiments of the present application, which are used to explain the present application but not to limit the present application. It should be noted that, for the purpose of description, only parts related to the present application are shown in the drawings, and other related parts can be referred to the general design.

[0064] In addition, unless otherwise defined, the technical terms or scientific terms used in the description of the present application should be the general meanings understood by the general skilled in the art to which the present application belongs. The words indicating the position used in the description of the present application are used to indicate the relative direction or positional relationship, and the relative positional relationship may also change accordingly when the absolute position of the described object changes. The "comprising" used in the description of the present application indicates that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, and other elements or objects are not excluded.

[0065] In addition, it should be further noted that, unless otherwise specified and limited, the "installation", "connection" and similar words used in the description of the present application should be understood in a broad sense, for example, the connection can be fixed connection or detachable connection; can be mechanical connection or electrical connection; can be direct connection or indirect connection through intermediate medium, and the skilled in the art can understand the specific meaning of the present application according to the specific circumstances.

[0066] A display control processor test method for simulating trackball operation, as shown in Figure 1 .

[0067] Operation demand extraction step: according to the display control processor test demand, the operation demand is extracted.

[0068] The extracted operation demand includes switching the system setting picture to the radio parameter setting subpage.

[0069] Soft button interaction area position coordinate acquisition step: according to the operation demand, the display picture is marked, and the position coordinates of the interaction area of the corresponding soft button in the display picture are acquired.

[0070] The marked display picture includes defining the operation instruction name and acquiring the rectangular interaction area of the corresponding soft button.

[0071] The position coordinates of the interaction area of the corresponding soft button in the display picture are acquired, specifically the position coordinates (Xmin, Ymin), (Xmax, Ymax) of the left lower and right upper vertices of the soft button are acquired.

[0072] Cursor position coordinate acquisition step: the position coordinates (Xcursor, Ycursor) of the cursor in the display picture are acquired.

[0073] The position coordinates (Xcursor, Ycursor) of the cursor in the display picture can be obtained through image recognition.

[0074] The cursor moving direction is calculated according to the position coordinates of the interactive area of the soft button in the display picture and the position coordinates of the cursor.

[0075] X' = (Xmin+Xmax) / 2-Xcursor;

[0076] Y' = (Ymin+Ymax) / 2-Ycursor;

[0077] Wherein:

[0078] (X', Y') is the vector representation of the moving direction of the cursor.

[0079] The X-Y direction displacement of the trackball is calculated according to the moving direction of the cursor.

[0080] X = S;

[0081] Y = S*(Y' / X');

[0082] Wherein:

[0083] S is the reference value of the analog quantity of the trackball controlling the moving of the cursor.

[0084] X and Y are the displacement of the trackball in the X-Y direction.

[0085] The trackball is moved according to the calculated displacement of the trackball in the X-Y direction and the moving direction of the cursor, so as to simulate the trackball controlling the cursor moving to the interactive area of the soft button, and the bus message corresponding to the trackball movement is continuously sent to the display control processor.

[0086] The bus message corresponding to the trackball movement is specifically the calculated displacement of the trackball in the X-Y direction.

[0087] The position coordinates (Xcursor, Ycursor) of the cursor in the display picture can be obtained through image recognition.

[0088] The position coordinates (Xcursor, Ycursor) of the cursor in the display picture can be obtained through image recognition.

[0089] If Xmin < X_cursor < Xmax and Ymin < Y_cursor < Ymax, it is judged that the cursor enters the interactive area of the soft button.

[0090] The trackball key operation simulation step: according to the operation requirement, the bus message corresponding to the trackball key is sent to the display control processor to simulate the key operation of the trackball, complete the simulation of the trackball operation, and test the display control processor.

[0091] The display control processor test method for simulating trackball operation disclosed in the above embodiment can automatically simulate the human-computer interaction operation process through the trackball, support the full-automatic test of the display control system, and improve the development efficiency and development quality of the display control system processor, which is simple, novel and has high application value.

[0092] In one specific example, the display control processor test method for simulating trackball operation disclosed in the above embodiment is applied to automatically test the airborne display control system by simulating trackball operation, and the following is implemented:

[0093] S1, according to the requirement of the display control processor radio parameter setting test case, the pilot operation requirement is extracted as "switching the system setting picture to the radio parameter setting subpage".

[0094] S2, according to the instruction "switching the system setting picture to the radio parameter setting subpage", the "radio" soft button in the display picture is marked, as shown in Figure 3 The position coordinates of the left lower and right upper vertices of the "radio" soft button rectangular interactive area are (487, 377) and (617, 423).

[0095] S3, through image recognition, the position coordinates of the cursor in the display picture are obtained (367, 850).

[0096] S4, according to the position coordinates of the interactive area of the soft button in the display picture and the position coordinates of the cursor, the moving direction of the cursor is calculated:

[0097] X' = (487 + 617) / 2 - 367 = 185;

[0098] Y' = (377 + 423) / 2 - 850 = -450;

[0099] (185, -450) is the vector representation of the moving direction of the cursor.

[0100] S5, assuming that the simulation quantity reference value S of the trackball control cursor movement is 100, according to the moving direction of the cursor, the displacement of the trackball in X-Y direction is calculated:

[0101] X = 100;

[0102] Y = 100 * (-450 / 185) = -243;

[0103] The displacement of the trackball in the X-Y direction is 100, -243.

[0104] S6, according to the calculated displacement of the trackball in the X-Y direction and the moving direction of the cursor, the cursor is controlled to move in the display control picture, the interaction area of the soft button is simulated to move by the trackball controlled cursor, and the bus message TB1-DPU1-002 corresponding to the trackball movement is continuously sent to the display control system, in which the X displacement of the scroll ball is 100 and the Y displacement of the scroll ball is -243, so as to simulate the movement of the trackball controlled cursor to the interaction area of the soft button.

[0105] S7, the position coordinates (X_cursor, Y_cursor) of the cursor in the display picture are acquired in real time through image recognition.

[0106] It is judged whether the X_cursor is between 487 and 617 and whether the Y_cursor is between 377 and 423, so as to judge whether the cursor enters the interaction area of the "radio" soft button, if not, S4-S7 are repeated until the cursor in the display picture enters the interaction area of the "radio" soft button.

[0107] S8, the bus message TB1-DPU1-002 corresponding to the trackball key is sent to the display control processor, in which the key word is set as "select key pressed", the select key operation of the trackball is simulated, so as to switch the system setting picture to the radio parameter setting sub-page, and the automatic test of the display control processor is supported.

[0108] On the other hand, a display control processor test system for simulating trackball operation is provided, as shown in Figure 4 , comprising:

[0109] The operation requirement extraction module is used to extract the operation requirement according to the display control processor test requirement;

[0110] The soft button interaction area position coordinate acquisition module is used to mark the display picture according to the operation requirement, and acquire the position coordinates of the interaction area of the corresponding soft button in the display picture;

[0111] The cursor position coordinate acquisition module is used to acquire the position coordinates (X_cursor, Y_cursor) of the cursor in the display picture;

[0112] The cursor moving direction calculation module is used to calculate the moving direction of the cursor according to the position coordinates of the soft button interaction area in the display picture and the position coordinates of the cursor;

[0113] The trackball X-Y direction displacement calculation module is used to calculate the displacement of the trackball in the X-Y direction according to the moving direction of the cursor;

[0114] a trackball moving simulation module, configured to control the cursor to move in the display screen according to the calculated displacement of the trackball in the X-Y direction and the moving direction of the cursor, simulate the trackball to control the cursor to move to the interactive region of the soft button, and continuously send bus messages corresponding to the trackball movement to the display control processor;

[0115] a cursor position coordinate real-time acquisition and judgment module, configured to acquire the position coordinates (Xcursor, Ycursor) of the cursor in the display screen in real time, judge whether the cursor enters the interactive region of the soft button, and if not, repeatedly call the cursor moving direction calculation module, the trackball X-Y direction displacement calculation module and the trackball moving simulation module until the cursor enters the interactive region of the soft button;

[0116] a trackball key operation simulation module, configured to send bus messages corresponding to the trackball key operation to the display control processor according to operation requirements, and simulate the key operation of the trackball.

[0117] Optionally, in the display control processor test system for simulating the trackball operation, the cursor position coordinate acquisition module acquires the position coordinates (Xcursor, Ycursor) of the cursor in the display screen through image recognition.

[0118] Optionally, in the display control processor test system for simulating the trackball operation, the cursor moving direction calculation module calculates the moving direction of the cursor, and specifically:

[0119] X' = (Xmin + Xmax) / 2 - Xcursor;

[0120] Y' = (Ymin + Ymax) / 2 - Ycursor;

[0121] wherein:

[0122] (X', Y') are the vector representations of the moving direction of the cursor.

[0123] Optionally, in the display control processor test system for simulating the trackball operation, the trackball X-Y direction displacement calculation module calculates the displacement of the trackball in the X-Y direction, and specifically:

[0124] X = S;

[0125] Y = S * (Y' / X');

[0126] wherein:

[0127] S is a reference value of the simulation quantity of the trackball controlling the cursor to move;

[0128] X and Y are the displacements of the trackball in the X-Y direction.

[0129] Optionally, in the display control processor test system for simulating trackball operation, in the trackball movement simulation module, the bus message corresponding to the trackball movement is continuously sent to the display control processor, and the displacement of the calculated trackball in the X-Y direction is specifically obtained.

[0130] Optionally, in the display control processor test system for simulating trackball operation, in the real-time acquisition and judgment module of the position coordinates of the cursor, the position coordinates (X cursor, Y cursor) of the cursor in the display picture are specifically acquired in real time through image recognition.

[0131] Optionally, in the display control processor test system for simulating trackball operation, in the real-time acquisition and judgment module of the position coordinates of the cursor, if XminX cursorXmax and YminY cursorYmax, it is judged that the cursor enters the interactive area of the soft button.

[0132] For the display control processor test system for simulating trackball operation disclosed in the above embodiments, since it corresponds to the display control processor test method for simulating trackball operation disclosed in the above embodiments, the description is relatively simple, and the specific related parts can be referred to the related description in the display control processor test method for simulating trackball operation. The technical effects can also be referred to the technical effects of the related part of the display control processor test method for simulating trackball operation, which will not be described here.

[0133] In addition, those skilled in the art should also realize that each module and unit of the display control processor test system for simulating trackball operation disclosed in the embodiments can be realized by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the embodiments are generally described in terms of functions. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can choose different methods to implement the described functions for each specific application and its actual constraints, but such implementation should not be considered beyond the scope of the present application.

[0134] So far, the technical solution of the present application has been described in combination with the preferred embodiments shown in the drawings. Those skilled in the art should understand that the protection scope of the present application is obviously not limited to these specific embodiments. Without deviating from the principles of the present application, those skilled in the art can make equivalent changes or replacements to the related technical features. The technical solutions after the changes or replacements will fall within the protection scope of the present application.

Claims

1. A test method for a display and control processor simulating trackball operation, characterized in that, include: Operation requirement extraction steps: Extract operation requirements based on the test requirements of the display and control processor; Steps to obtain the position coordinates of the interactive area of ​​the soft button: Mark the display screen according to the operation requirements, and obtain the position coordinates of the interactive area of ​​the corresponding soft button in the display screen; Steps to obtain cursor position coordinates: Obtain the cursor's position coordinates (X cursor, Y cursor) on the display screen; Steps for calculating cursor movement direction: Calculate the cursor movement direction based on the coordinates of the interactive area of ​​the soft button on the display screen and the cursor's position coordinates; Steps for calculating the XY displacement of the trackball: Calculate the displacement of the trackball in the XY direction based on the direction of cursor movement; Trackball movement simulation steps: According to the calculated displacement of the trackball in the XY direction and the movement direction of the cursor, control the cursor to move in the display screen, simulate the trackball to control the cursor to move towards the interactive area of ​​the soft button, and continuously send the bus message corresponding to the trackball movement to the display processor. The real-time acquisition and judgment steps for cursor position coordinates are as follows: The position coordinates (X cursor, Y cursor) of the cursor in the display screen are acquired in real time, and it is determined whether the cursor has entered the interactive area of ​​the soft button. If not, the cursor movement direction calculation steps, trackball XY direction displacement calculation steps, and trackball movement simulation steps are repeated until the cursor enters the interactive area of ​​the soft button. Trackball button operation simulation steps: According to the operation requirements, send the bus message corresponding to the trackball button to the display and control processor to simulate the trackball button operation.

2. The test method for the display and control processor simulating trackball operation according to claim 1, characterized in that, In the step of obtaining cursor position coordinates, image recognition is used to obtain the position coordinates (X cursor, Y cursor) of the cursor on the display screen.

3. The test method for the display and control processor simulating trackball operation according to claim 2, characterized in that, In the cursor movement direction calculation step, the cursor movement direction is calculated as follows: X' = ​​(Xmin + Xmax) / 2 - X_cursor; Y' = (Ymin + Ymax) / 2 - Y cursor; in: (X', Y') are vector representations of the cursor movement direction.

4. The test method for the display and control processor simulating trackball operation according to claim 3, characterized in that, In the calculation steps for the XY displacement of the trackball, the displacement of the trackball in the XY direction is calculated as follows: X = S; Y = S * (Y' / X'); in: S is the analog reference value for controlling cursor movement with the trackball; X and Y represent the displacement of the trackball in the XY direction.

5. The test method for the display and control processor simulating trackball operation according to claim 4, characterized in that, In the trackball movement simulation step, bus messages corresponding to the trackball movement are continuously sent to the display and control processor, specifically the calculated displacement of the trackball in the XY direction.

6. The test method for the display and control processor simulating trackball operation according to claim 5, characterized in that, In the real-time acquisition and judgment step of the cursor position coordinates, image recognition can be used to obtain the cursor's position coordinates (X cursor, Y cursor) on the display screen in real time.

7. The method for testing a display and control processor by simulating trackball operations according to claim 6, wherein in the step of obtaining and judging the position coordinates of the cursor in real time, if Xmin < Xcursor < Xmax and Ymin < Ycursor < Ymax, it is judged that the cursor enters the interaction area of the soft button.

8. A test system for a display and control processor that simulates trackball operation, characterized in that, It includes: an operation requirement extraction module for extracting operation requirements according to the test requirements of the display and control processor; a soft button interaction area position coordinate acquisition module for marking the display screen according to the operation requirements and acquiring the position coordinates of the interaction area of the corresponding soft button in the display screen; a cursor position coordinate acquisition module for acquiring the position coordinates (Xcursor, Ycursor) of the cursor in the display screen; a cursor movement direction calculation module for calculating the movement direction of the cursor according to the position coordinates of the interaction area of the soft button in the display screen and the position coordinates of the cursor; a trackball X-Y direction displacement calculation module for calculating the displacement of the trackball in the X-Y direction according to the movement direction of the cursor; a trackball movement simulation module for controlling the cursor to move in the display screen according to the calculated displacement of the trackball in the X-Y direction and the movement direction of the cursor, simulating the trackball to control the cursor to move towards the interaction area of the soft button, and continuously sending bus messages corresponding to the trackball movement to the display and control processor; a cursor position coordinate real-time acquisition and judgment module for acquiring the position coordinates (Xcursor, Ycursor) of the cursor in the display screen in real time, judging whether the cursor enters the interaction area of the soft button, and if not, repeatedly calling the cursor movement direction calculation module, the trackball X-Y direction displacement calculation module, and the trackball movement simulation module until the cursor enters the interaction area of the soft button; a trackball key operation simulation module for sending bus messages corresponding to the trackball keys to the display and control processor according to the operation requirements to simulate the key operations of the trackball.

9. The display and control processor test system for simulating trackball operations according to claim 8, wherein in the cursor position coordinate acquisition module, the position coordinates (Xcursor, Ycursor) of the cursor in the display screen are specifically acquired through image recognition.

10. The display and control processor test system for simulating trackball operations according to claim 9, wherein in the cursor movement direction calculation module, the calculation of the movement direction of the cursor is specifically as follows: X’ = (Xmin + Xmax) / 2 - Xcursor; Y’ = (Ymin + Ymax) / 2 - Ycursor; wherein: (X’, Y’) is the vector representation of the cursor movement direction.

11. The display and control processor test system for simulating trackball operations according to claim 10, wherein in the trackball X-Y direction displacement calculation module, the calculation of the displacement of the trackball in the X-Y direction is specifically as follows: X = S; Y = S * (Y’ / X’); wherein: S is the simulation quantity reference value for the trackball to control the cursor movement; X, Y are the displacements of the trackball in the X-Y direction.

12. The display and control processor test system for simulating trackball operations according to claim 11, wherein In the trackball movement simulation module, bus messages corresponding to the trackball movement are continuously sent to the display and control processor, specifically the displacements of the calculated trackball in the X-Y directions.

13. The display and control processor test system for simulating trackball operations according to claim 12, wherein In the cursor position coordinate real-time acquisition and judgment module, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be specifically acquired in real time through image recognition.

14. The display and control processor test system for simulating trackball operations according to claim 13, wherein In the cursor position coordinate real-time acquisition and judgment module, if Xmin < X cursor < Xmax and Ymin < Y cursor < Ymax, it is determined that the cursor enters the interaction area of the soft button.

Citation Information

Patent Citations

  • Simulation driving system of military fighter aircraft

    CN109920300A

  • Signal switching method and system as well as automatic testing method and system applying signal switching method and system

    CN115407691A