Display control processor testing method and system for simulating trackball operation

Abstract

The invention belongs to the technical field of display control processor testing, and particularly relates to a display control processor testing method and system for simulating operation of a trackball, which can automatically simulate a man-machine interaction operation process through the trackball, support full-automatic testing of a display control processor, and is applied to testing of an airborne display control system. The development efficiency and the development quality of the display control processor can be remarkably improved, and the method is simple and novel and has very high application value.

Description

Technical Field

[0003] The present application belongs to the technical field of display control processor testing, and specifically relates to a display control processor testing method and system for simulating trackball operation. Background Art

[0004] The trackball is one of the commonly used human-computer interaction control devices in aircraft cockpits. It mainly provides control functions for the cursor on the display, similar to the "mouse" in the aircraft cockpit.

[0005] Trackball style Figure 1 As shown, A is a selection and confirmation button; B is a scroll wheel, which provides the upward and downward page turning operations of the screen where the cursor is located; C is a scroll ball, which provides the cursor with horizontal and vertical movement operations; D is a "switch" button, which provides the sequential switching control function of the display area where the cursor is located.

[0006] The trackball is connected to the onboard display and control processor through an onboard bus. The trackball controls the system by sending bus messages to the display and control processor (with embedded display and control software). The bus messages sent usually include the scroll wheel change, the X displacement of the rolling ball, the Y displacement of the rolling ball, key words, etc. Among them, the vector formed by the combination of X displacement and Y displacement represents the movement speed and direction of the cursor in the display screen.

[0007] In order to improve the research and development efficiency and quality of aircraft systems, automated testing technical means are usually adopted. The automated testing of the display and control processor of the display and control system is more complicated, often involving automatic recognition and judgment of the display screen and simulation of the pilot's operation. In this regard, an automated testing equipment for aircraft systems based on image recognition has been built, which can support automatic testing of the display and control system based on image recognition, but cannot simulate the control operation of the trackball. When executing trackball-related human-computer interaction test cases, manual operation is required, which breaks the fully automatic testing chain and results in low testing efficiency of the display and control processor. In view of this, the present application is proposed. Summary of the invention

[0008] The purpose of the present application is to provide a display control processor testing method and system for simulating trackball operation, so as to automatically simulate the human-computer interaction operation process related to trackball control and support fully automatic testing of the display control system.

[0009] The technical solution of this application is:

[0010] On the one hand, a display control processor testing method for simulating trackball operation is provided, comprising:

[0011] Operation requirement extraction step: extracting operation requirements according to the display control processor test requirements;

[0012] The step of obtaining the position coordinates of the soft button interaction area is as follows: marking the display screen according to the operation requirements, and obtaining the position coordinates of the interaction area of ​​the corresponding soft button in the display screen;

[0013] Cursor position coordinate acquisition step: obtain the cursor position coordinates (X cursor, Y cursor) in the display screen;

[0014] Cursor moving direction calculation step: Calculate the cursor moving direction according to the interactive area position coordinates of the soft button in the display screen and the cursor position coordinates;

[0015] The steps of calculating the displacement of the trackball in the XY direction are as follows: according to the moving direction of the cursor, the displacement of the trackball in the XY direction is calculated;

[0016] Trackball movement simulation steps: according to the calculated displacement of the trackball in the XY direction and the moving direction of the cursor, control the cursor to move in the display control screen, simulate the trackball to control the cursor to move to the interactive area of ​​the soft button, and continuously send bus messages corresponding to the trackball movement to the display control processor;

[0017] The step of obtaining the position coordinates of the cursor in real time: obtaining the position coordinates of the cursor (X cursor, Y cursor) in the display screen in real time, and judging whether the cursor enters the interactive area of ​​the soft button. If not, repeating the step of calculating the cursor movement direction, the step of calculating the displacement of the trackball in the XY direction, and the step of simulating the movement of the trackball until the cursor enters the interactive area of ​​the soft button.

[0018] Trackball key operation simulation steps: according to the operation requirements, send the bus message corresponding to the trackball key to the display control processor to simulate the trackball key operation.

[0019] According to at least one embodiment of the present application, in the display control processor testing method simulating trackball operation, in the cursor position coordinate acquisition step, the position coordinates (X cursor, Y cursor) of the cursor in the display screen are acquired specifically through image recognition.

[0020] According to at least one embodiment of the present application, in the display control processor testing method for simulating trackball operation, in the cursor movement direction calculation step, the cursor movement direction is calculated as follows:

[0021] X'=(Xmin+Xmax) / 2-X cursor;

[0022] Y'=(Ymin+Ymax) / 2-Y cursor;

[0023] in:

[0024] (X', Y') is the vector representation of the direction of cursor movement.

[0025] According to at least one embodiment of the present application, in the above method for testing a display and control processor by simulating trackball operations, in the step of calculating the displacement of the trackball in the X-Y direction, calculating the displacement of the trackball in the X-Y direction specifically includes:

[0026] X = S;

[0027] Y = S * (Y' / X');

[0028] Where:

[0029] S is the analog quantity reference value for the trackball to control the cursor movement;

[0030] X and Y are the displacements of the trackball in the X-Y direction.

[0031] According to at least one embodiment of the present application, in the above method for testing a display and control processor by simulating trackball operations, in the step of simulating the trackball movement, continuously sending bus messages corresponding to the trackball movement to the display and control processor specifically includes the calculated displacements of the trackball in the X-Y direction.

[0032] According to at least one embodiment of the present application, in the above method for testing a display and control processor by simulating trackball operations, in the step of real-time obtaining and judging the position coordinates of the cursor, specifically, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be obtained in real time through image recognition.

[0033] According to at least one embodiment of the present application, in the above method for testing a display and control processor by simulating trackball operations, in the step of real-time obtaining and judging the position coordinates of the cursor, if Xmin < X cursor < Xmax and Ymin < Y cursor < Ymax, it is determined that the cursor enters the interaction area of the soft button.

[0034] On the other hand, a testing system for a display and control processor by simulating trackball operations is provided, including:

[0035] An operation requirement extraction module for extracting operation requirements according to the display and control processor test requirements;

[0036] A soft button interaction area position coordinate acquisition module for marking the display screen according to the operation requirements and acquiring the position coordinates of the interaction area of the corresponding soft button in the display screen;

[0037] A cursor position coordinate acquisition module for acquiring the position coordinates (X cursor, Y cursor) of the cursor in the display screen;

[0038] A cursor movement direction calculation module for calculating the movement direction of the cursor according to the position coordinates of the interaction area of the soft button in the display screen and the position coordinates of the cursor;

[0039] The trackball XY direction displacement calculation module is used to calculate the displacement of the trackball in the XY direction according to the moving direction of the cursor;

[0040] The trackball movement simulation module is used to control the cursor to move in the display control screen according to the calculated displacement of the trackball in the XY direction and the moving direction of the cursor, simulate the trackball to control the cursor to move to the interactive area of ​​the soft button, and continuously send bus messages corresponding to the trackball movement to the display control processor;

[0041] The cursor position coordinate real-time acquisition and judgment module is used to obtain the cursor position coordinates (X cursor, Y cursor) in the display screen in real time to determine whether the cursor enters the interactive area of ​​the soft button. If not, the cursor movement direction calculation module, the trackball XY direction displacement calculation module, and the trackball movement simulation module are repeatedly called until the cursor enters the interactive area of ​​the soft button.

[0042] The trackball button operation simulation module is used to send bus messages corresponding to the trackball buttons to the display control processor according to the operation requirements to simulate the button operation of the trackball.

[0043] According to at least one embodiment of the present application, in the display control processor test system simulating trackball operation, the cursor position coordinate acquisition module acquires the position coordinates (X cursor, Y cursor) of the cursor in the display screen through image recognition.

[0044] According to at least one embodiment of the present application, in the display control processor test system simulating trackball operation, in the cursor movement direction calculation module, the movement direction of the cursor is calculated as follows:

[0045] X'=(Xmin+Xmax) / 2-X cursor;

[0046] Y'=(Ymin+Ymax) / 2-Y cursor;

[0047] in:

[0048] (X', Y') is the vector representation of the direction of cursor movement.

[0049] According to at least one embodiment of the present application, in the display control processor test system simulating trackball operation, in the trackball XY direction displacement calculation module, the displacement of the trackball in the XY direction is calculated as follows:

[0050] X = S;

[0051] Y = S * (Y' / X');

[0052] in:

[0053] S is the analog reference value of the trackball to control the cursor movement;

[0054] X and Y are the displacements of the trackball in the X-Y direction.

[0055] According to at least one embodiment of the present application, in the above display and control processor test system for simulating trackball operations, in the trackball movement simulation module, bus messages corresponding to the trackball movement are continuously sent to the display and control processor, specifically the calculated displacements of the trackball in the X-Y direction.

[0056] According to at least one embodiment of the present application, in the above display and control processor test system for simulating trackball operations, in the cursor position coordinate real-time acquisition and judgment module, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be specifically acquired in real time through image recognition.

[0057] According to at least one embodiment of the present application, in the above display and control processor test system for simulating trackball operations, in the cursor position coordinate real-time acquisition and judgment module, if Xmin < X cursor < Xmax and Ymin < Y cursor < Ymax, it is determined that the cursor enters the interaction area of the soft button.

[0058] The present application has at least the following beneficial technical effects:

[0059] A method and system for testing a display and control processor by simulating trackball operations are provided, which can automatically simulate the human-computer interaction operation process through the trackball, support the full-automatic testing of the display and control processor, are applied to the testing of the airborne display and control system, can significantly improve the development efficiency and quality of the display and control processor, are simple and novel, and have high application value. Description of the Drawings

[0060] Figure 1 It is a schematic diagram of the style of the trackball;

[0061] Figure 2 It is a schematic diagram of the method for testing a display and control processor by simulating trackball operations provided by an embodiment of the present application;

[0062] Figure 3 It is a schematic diagram of labeling the "Radio" soft button in the display screen provided by an embodiment of the present application;

[0063] Figure 4 It is a schematic diagram of the display and control processor test system for simulating trackball operations provided by an embodiment of the present application.

[0064] For better illustrating this embodiment, some components in the drawings are omitted, enlarged or reduced, which do not represent the dimensions of the actual product. In addition, the drawings are only for illustrative purposes and cannot be construed as a limitation to the present application. Detailed Embodiments

[0065] In order to make the technical solution and advantages of the present application clearer, the technical solution of the present application will be described in further detail in detail and in detail with reference to the accompanying drawings. It can be understood that the specific embodiments described here are only partial embodiments of the present application, which are only used to explain the present application, not to limit the present application. It should be noted that, for the convenience of description, only the parts related to the present application are shown in the accompanying drawings, and other related parts can refer to the general design.

[0066] In addition, unless otherwise defined, the technical terms or scientific terms used in the description of this application shall have the usual meanings understood by those of ordinary skill in the art to which this application belongs. The words used in the description of this application to indicate orientation are only used to indicate relative directions or positional relationships. When the absolute position of the described object changes, its relative positional relationship may also change accordingly. The word "include" used in the description of this application indicates that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, but does not exclude other elements or objects.

[0067] In addition, it should be noted that, unless otherwise clearly specified and limited, the words "installation", "connection" and similar terms used in the description of this application should be understood in a broad sense. For example, the connection can be a fixed connection or a detachable connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium. Technical personnel in the field can understand its specific meaning in this application according to the specific circumstances.

[0068] A display control processor testing method simulating trackball operation, such as Figure 1 shown.

[0069] Operation requirement extraction steps: Extract operation requirements according to the display and control processor test requirements.

[0070] The extracted operation requirements include switching the system setting screen to the radio parameter setting sub-page.

[0071] Steps for obtaining the position coordinates of the soft button interaction area: annotating the display screen according to the operation requirements, and obtaining the position coordinates of the interaction area of ​​the corresponding soft button in the display screen.

[0072] Labeling the display screen includes defining the operation instruction name and obtaining the corresponding soft button rectangular interaction area.

[0073] The interactive area position coordinates of the corresponding soft button in the display screen are obtained, specifically, the position coordinates (Xmin, Ymin) and (Xmax, Ymax) of the lower left and upper right vertices of the soft button are obtained.

[0074] Steps for obtaining the cursor position coordinates: obtain the position coordinates of the cursor in the display screen (X cursor, Y cursor).

[0075] Specifically, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be obtained through image recognition.

[0076] Cursor moving direction calculation step: Calculate the cursor moving direction according to the interactive area position coordinates of the soft button in the display screen and the cursor position coordinates.

[0077] X'=(Xmin+Xmax) / 2-X cursor;

[0078] Y'=(Ymin+Ymax) / 2-Y cursor;

[0079] in:

[0080] (X', Y') is the vector representation of the direction of cursor movement.

[0081] The steps for calculating the displacement of the trackball in the XY direction are as follows: According to the moving direction of the cursor, the displacement of the trackball in the XY direction is calculated.

[0082] X = S;

[0083] Y = S * (Y' / X');

[0084] in:

[0085] S is the analog reference value of the trackball to control the cursor movement;

[0086] X, Y are the displacements of the trackball in the XY direction.

[0087] Trackball movement simulation steps: according to the calculated displacement of the trackball in the XY direction and the moving direction of the cursor, control the cursor to move in the display and control screen, simulate the trackball to control the cursor to move to the interactive area of ​​the soft button, and continuously send bus messages corresponding to the trackball movement to the display and control processor.

[0088] The bus message corresponding to the trackball movement is specifically the calculated displacement of the trackball in the XY direction.

[0089] The step of obtaining the position coordinates of the cursor in real time is as follows: obtaining the position coordinates of the cursor (X cursor, Y cursor) in the display screen in real time, and judging whether the cursor enters the interactive area of ​​the soft button. If not, repeating the step of calculating the cursor movement direction, the step of calculating the displacement of the trackball in the XY direction, and the step of simulating the movement of the trackball until the cursor enters the interactive area of ​​the soft button.

[0090] Specifically, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be obtained in real time through image recognition.

[0091] If Xmin < X cursor < Xmax and Ymin < Y cursor < Ymax, it is determined that the cursor enters the interaction area of the soft button.

[0092] Trackball button operation simulation steps: According to the operation requirements, send the bus message corresponding to the trackball button to the display and control processor to simulate the button operation of the trackball, complete the simulation of the trackball operation, and test the display and control processor.

[0093] The test method for the display and control processor that simulates the trackball operation disclosed in the above embodiments can automatically simulate the human-computer interaction operation process through the trackball, support the full-automatic test of the display and control system, thereby improving the development efficiency and quality of the display and control system processor. It is simple and novel, and has high application value.

[0094] In a specific example, the test method for the display and control processor that simulates the trackball operation disclosed in the above embodiments is applied to automatically test the airborne display and control system as follows:

[0095] S1. According to the requirements of the test case set by the radio parameters of the display and control processor, extract the pilot's operation requirement as "switch the system setting screen to the radio parameter setting sub-page".

[0096] S2. According to the instruction "switch the system setting screen to the radio parameter setting sub-page", mark the "Radio" soft button on the display screen. As Figure 3 shown, obtain the position coordinates (487, 377) and (617, 423) of the lower left and upper right vertices of the rectangular interaction area of the "Radio" soft button.

[0097] S3. Through image recognition, obtain the position coordinates (367, 850) of the cursor on the display screen.

[0098] S4. According to the position coordinates of the interaction area of the soft button on the display screen and the position coordinates of the cursor, calculate the moving direction of the cursor:

[0099] X’ = (487 + 617) / 2 - 367 = 185;

[0100] Y’ = (377 + 423) / 2 - 850 = -450;

[0101] (185, -450) is the vector representation of the cursor moving direction.

[0102] S5. Assume that the simulation quantity reference value S for the trackball to control the cursor movement is 100. According to the moving direction of the cursor, calculate the displacement of the trackball in the X - Y direction:

[0103] X = 100;

[0104] Y = 100 * (-450 / 185) ≈ -243;

[0105] The displacement of the trackball in the XY direction is 100, -243.

[0106] S6. According to the calculated displacement of the trackball in the XY direction and the moving direction of the cursor, the cursor is controlled to move in the display and control screen, the trackball is simulated to control the cursor to move to the interactive area of ​​the soft button, and the bus message TB1-DPU1-002 corresponding to the trackball movement is continuously sent to the display and control system. In the bus message, the rolling ball X displacement is 100, and the rolling ball Y displacement is -243, thereby simulating the trackball to control the cursor to move to the interactive area of ​​the soft button.

[0107] S7, through image recognition, real-time acquisition of the position coordinates of the cursor (X cursor, Y cursor) in the display screen;

[0108] It is determined whether the X cursor is between 487 and 617, and whether the Y cursor is between 377 and 423, so as to determine whether the cursor enters the interactive area of ​​the "Radio" soft button. If not, S4 to S7 are repeated until the cursor in the display screen enters the interactive area of ​​the "Radio" soft button.

[0109] S8. Send the bus message TB1-DPU1-002 corresponding to the trackball button to the display and control processor. The button word in the message is set to "select button pressed" to simulate the selection button operation of the trackball, thereby switching the system setting screen to the radio parameter setting sub-page to support the automated testing of the display and control processor.

[0110] On the other hand, a display control processor test system for simulating trackball operation is provided. Figure 4 As shown, including:, including:

[0111] An operation requirement extraction module is used to extract operation requirements according to the display control processor test requirements;

[0112] A soft button interaction area position coordinate acquisition module is used to mark the display screen according to the operation requirements and obtain the interaction area position coordinates of the corresponding soft button in the display screen;

[0113] The cursor position coordinate acquisition module is used to obtain the position coordinates of the cursor in the display screen (X cursor, Y cursor);

[0114] A cursor movement direction calculation module, used to calculate the cursor movement direction according to the interactive area position coordinates of the soft button and the cursor position coordinates in the display screen;

[0115] The trackball XY direction displacement calculation module is used to calculate the displacement of the trackball in the XY direction according to the moving direction of the cursor;

[0116] The trackball movement simulation module is used to control the cursor to move in the display control screen according to the calculated displacement of the trackball in the XY direction and the moving direction of the cursor, simulate the trackball to control the cursor to move to the interactive area of ​​the soft button, and continuously send bus messages corresponding to the trackball movement to the display control processor;

[0117] The cursor position coordinate real-time acquisition and judgment module is used to obtain the cursor position coordinates (X cursor, Y cursor) in the display screen in real time to determine whether the cursor enters the interactive area of ​​the soft button. If not, the cursor movement direction calculation module, the trackball XY direction displacement calculation module, and the trackball movement simulation module are repeatedly called until the cursor enters the interactive area of ​​the soft button.

[0118] The trackball button operation simulation module is used to send bus messages corresponding to the trackball buttons to the display control processor according to the operation requirements to simulate the button operation of the trackball.

[0119] Optionally, in the display control processor test system simulating trackball operation, the cursor position coordinate acquisition module acquires the position coordinates (X cursor, Y cursor) of the cursor in the display screen through image recognition.

[0120] Optionally, in the display control processor test system simulating trackball operation, the cursor movement direction calculation module calculates the cursor movement direction, specifically:

[0121] X'=(Xmin+Xmax) / 2-X cursor;

[0122] Y'=(Ymin+Ymax) / 2-Y cursor;

[0123] in:

[0124] (X', Y') is the vector representation of the direction of cursor movement.

[0125] Optionally, in the display control processor test system simulating trackball operation, in the trackball XY direction displacement calculation module, the displacement of the trackball in the XY direction is calculated as follows:

[0126] X = S;

[0127] Y = S * (Y' / X');

[0128] in:

[0129] S is the analog reference value of the trackball to control the cursor movement;

[0130] X, Y are the displacements of the trackball in the XY direction.

[0131] Optionally, in the above display and control processor test system for simulating trackball operations, in the trackball movement simulation module, bus messages corresponding to the trackball movement are continuously sent to the display and control processor, specifically, the displacements of the calculated trackball in the X-Y directions.

[0132] Optionally, in the above display and control processor test system for simulating trackball operations, in the cursor position coordinate real-time acquisition and judgment module, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be real-time acquired specifically through image recognition.

[0133] Optionally, in the above display and control processor test system for simulating trackball operations, in the cursor position coordinate real-time acquisition and judgment module, if Xmin < X cursor < Xmax and Ymin < Y cursor < Ymax, it is determined that the cursor enters the interaction area of the soft button.

[0134] For the display and control processor test system for simulating trackball operations disclosed in the above embodiments, since it corresponds to the display and control processor test method for simulating trackball operations disclosed in the above embodiments, the description is relatively simple. For the specific relevant parts, reference can be made to the relevant descriptions in the part of the display and control processor test method for simulating trackball operations, and its technical effects can also be referred to the relevant technical effects in the relevant parts of the display and control processor test method for simulating trackball operations, which will not be elaborated here.

[0135] In addition, those skilled in the art should also be able to realize that each module and unit of the display and control processor test system for simulating trackball operations disclosed in the embodiments of the present application can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, in the present application, it is generally described according to functions. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can choose different methods to implement the described functions for each specific application and its actual constraints, but such implementation should not be considered to exceed the scope of the present application.

[0136] So far, the technical solutions of the present application have been described in combination with the preferred embodiments shown in the drawings. Those skilled in the art should understand that the protection scope of the present application is obviously not limited to these specific embodiments. Without departing from the principle of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the protection scope of the present application.

Claims

1. A display control processor testing method simulating trackball operation, characterized in that: include: Operation requirement extraction step: extracting operation requirements according to the display control processor test requirements; The step of obtaining the position coordinates of the soft button interaction area is as follows: marking the display screen according to the operation requirements, and obtaining the position coordinates of the interaction area of ​​the corresponding soft button in the display screen; Cursor position coordinate acquisition step: obtain the cursor position coordinates (X cursor, Y cursor) in the display screen; Cursor moving direction calculation step: Calculate the cursor moving direction according to the interactive area position coordinates of the soft button in the display screen and the cursor position coordinates; The steps of calculating the displacement of the trackball in the XY direction are as follows: according to the moving direction of the cursor, the displacement of the trackball in the XY direction is calculated; Trackball movement simulation steps: according to the calculated displacement of the trackball in the XY direction and the moving direction of the cursor, control the cursor to move in the display control screen, simulate the trackball to control the cursor to move to the interactive area of ​​the soft button, and continuously send bus messages corresponding to the trackball movement to the display control processor; The step of obtaining the position coordinates of the cursor in real time: obtaining the position coordinates of the cursor (X cursor, Y cursor) in the display screen in real time, and judging whether the cursor enters the interactive area of ​​the soft button. If not, repeating the step of calculating the cursor movement direction, the step of calculating the displacement of the trackball in the XY direction, and the step of simulating the movement of the trackball until the cursor enters the interactive area of ​​the soft button. Trackball key operation simulation steps: according to the operation requirements, send the bus message corresponding to the trackball key to the display control processor to simulate the trackball key operation.

2. The display control processor testing method for simulating trackball operation according to claim 1, characterized in that: In the step of acquiring the cursor position coordinates, the position coordinates (X cursor, Y cursor) of the cursor in the display screen are acquired specifically through image recognition.

3. The display control processor testing method for simulating trackball operation according to claim 2, characterized in that: In the step of calculating the cursor moving direction, the moving direction of the cursor is calculated, specifically: X'=(Xmin+Xmax) / 2-X cursor; Y'=(Ymin+Ymax) / 2-Y cursor; in: (X', Y') is the vector representation of the direction of cursor movement.

4. The display control processor testing method for simulating trackball operation according to claim 3, characterized in that: In the step of calculating the displacement of the trackball in the XY direction, the displacement of the trackball in the XY direction is calculated, specifically: X = S; Y = S * (Y' / X'); in: S is the analog reference value of the trackball to control the cursor movement; X, Y are the displacements of the trackball in the XY direction.

5. The display control processor testing method for simulating trackball operation according to claim 4, characterized in that: In the trackball movement simulation step, bus messages corresponding to the trackball movement are continuously sent to the display control processor, specifically, the calculated displacement of the trackball in the XY direction.

6. The display control processor testing method for simulating trackball operation according to claim 5, characterized in that: [0001] In the step of obtaining the position coordinates of the cursor in real time, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be obtained in real time through image recognition.

7. The test method for the display and control processor for simulating trackball operations according to claim 6, wherein in the step of obtaining and judging the position coordinates of the cursor in real time, if Xmin < Xcursor < Xmax and Ymin < Ycursor < Ymax, it is judged that the cursor enters the interaction area of the soft button.

8. A display control processor test system simulating trackball operation, characterized in that: It includes: an operation requirement extraction module for extracting operation requirements according to the test requirements of the display and control processor; a position coordinate acquisition module for the interaction area of the soft button, which is used to mark the display screen according to the operation requirements and obtain the position coordinates of the interaction area of the corresponding soft button in the display screen; a cursor position coordinate acquisition module for obtaining the position coordinates (Xcursor, Ycursor) of the cursor in the display screen; a cursor movement direction calculation module for calculating the movement direction of the cursor according to the position coordinates of the interaction area of the soft button in the display screen and the position coordinates of the cursor; a trackball X-Y direction displacement calculation module for calculating the displacement of the trackball in the X-Y direction according to the movement direction of the cursor; a trackball movement simulation module for controlling the cursor to move in the display screen according to the calculated displacement of the trackball in the X-Y direction and the movement direction of the cursor, simulating the trackball to control the cursor to move towards the interaction area of the soft button, and continuously sending bus messages corresponding to the trackball movement to the display and control processor; a real-time acquisition and judgment module for the position coordinates of the cursor, which is used to acquire the position coordinates (Xcursor, Ycursor) of the cursor in the display screen in real time, judge whether the cursor enters the interaction area of the soft button, and if not, repeatedly call the cursor movement direction calculation module, the trackball X-Y direction displacement calculation module, and the trackball movement simulation module until the cursor enters the interaction area of the soft button; a trackball key operation simulation module for sending bus messages corresponding to the trackball keys to the display and control processor according to the operation requirements to simulate the key operations of the trackball.

9. The test system for the display and control processor for simulating trackball operations according to claim 8, wherein in the cursor position coordinate acquisition module, the position coordinates (Xcursor, Ycursor) of the cursor in the display screen are specifically obtained through image recognition.

10. The test system for the display and control processor for simulating trackball operations according to claim 9, wherein in the cursor movement direction calculation module, the calculation of the movement direction of the cursor is specifically as follows: X’ = (Xmin + Xmax) / 2 - Xcursor; Y’ = (Ymin + Ymax) / 2 - Ycursor; wherein: (X’, Y’) is the vector representation of the cursor movement direction.

11. The test system for the display and control processor for simulating trackball operations according to claim 10, wherein in the trackball X-Y direction displacement calculation module, the calculation of the displacement of the trackball in the X-Y direction is specifically as follows: X = S; Y = S * (Y’ / X’); wherein: S is the analog quantity reference value for the trackball to control the cursor movement; X, Y are the displacements of the trackball in the X-Y direction.

12. The test system for the display and control processor for simulating trackball operations according to claim 11, wherein In the trackball movement simulation module, bus messages corresponding to the trackball movement are continuously sent to the display and control processor, specifically the displacements of the calculated trackball in the X-Y directions.

13. The display and control processor test system for simulating trackball operations according to claim 12, wherein [0002] In the cursor position coordinate real-time acquisition and judgment module, the position coordinates (X cursor, Y cursor) of the cursor in the display screen can be specifically acquired in real time through image recognition.

14. The display and control processor test system for simulating trackball operations according to claim 13, wherein In the cursor position coordinate real-time acquisition and judgment module, if Xmin < X cursor < Xmax and Ymin < Y cursor < Ymax, it is determined that the cursor enters the interaction area of the soft button.

Images