A universal screen automatic testing method, system, medium and product

Abstract

This application provides a universal automatic screen testing method, system, medium, and product, relating to the field of automatic testing. The method includes: first, acquiring preset encoding information of the adapter board of the screen under test to determine the screen material, display, and touch interface type; generating an appropriate power-on / off timing waveform based on the screen material and supplying power; loading a nine-grid touch test image containing guide trajectories onto the display driver IC via an FPGA; receiving X / Y axis touch coordinate information fed back by the touch control IC; converting this information into pixel-level refined coordinate points by an MCU and displaying it in real time to form a coordinate point sequence; illuminating the coordinate points against a pure black background; collecting actual light intensity data through a light sensor; calculating ideal light intensity data and comparing it with the actual data to finally obtain the screen test result. Through division of labor and collaboration, without the need for complex computing power, it achieves universal adaptation to different types of screens and significantly improves the accuracy and versatility of the test.

Description

Technical Field

[0001] This application relates to the field of automatic testing technology, and in particular to a general automatic screen testing method, system, medium, and product. Background Technology

[0002] With the rapid development of display technology, touch screens have become the core interactive components of various electronic devices. The stability and reliability of their touch functions directly affect the overall user experience of the device. In the screen production and quality inspection process, testing for touch response, edge sensitivity and display consistency is an essential procedure.

[0003] In related technologies, a visual trajectory-assisted detection method is usually used to detect the touch function of the screen. This method converts the coordinate information fed back by the touch chip into observable display points or trajectory lines and displays them on the screen under test in real time. Then, an industrial camera is introduced to capture images and check whether the trajectory lines drawn on the screen are broken, thereby determining whether the screen has a touch failure. At the same time, the screen image is observed to check for dead pixels that do not emit light.

[0004] However, the aforementioned technologies have significant limitations. Their verification of touch and display interaction results relies heavily on visual feedback from two-dimensional images, allowing only qualitative surface-level judgments. When testing rapid swipes or dense trajectories, neither the human eye nor conventional cameras can accurately quantify whether each triggered logical touch coordinate has been 100% converted into physically emitting pixels. Achieving pixel-level precision through machine vision is not only susceptible to misjudgments due to physical obstructions from the test hand or fixture, but also involves extremely complex image recognition algorithms, enormous computational costs, and high equipment expenses. Therefore, finding a method for highly accurate screen detection with minimal computational effort has become a pressing technical challenge in this field. Summary of the Invention

[0005] This application provides a general automatic screen testing method, system, medium, and product for achieving highly accurate quantitative automatic testing of various types of touch screens with extremely low computing power.

[0006] Firstly, this application provides a general automatic screen testing method applied to a screen testing system, which includes a programmable gate array (FPGA) and an MCU. The method includes: acquiring preset encoding information of a corresponding adapter board for the screen under test, the preset encoding information including at least the screen material type, display interface type, and touch interface type of the screen under test; generating a corresponding power-on / off timing waveform based on the screen material type to provide power supply control to the screen under test, the screen material type including at least TFT and OLED materials; and loading a preset nine-grid touch test image onto the display driver IC of the screen under test via the FPGA to control the screen under test to display the nine-grid touch test image, the nine-grid touch test image containing information for guiding... The test subject follows a guided touch trajectory; it receives touch coordinate information from the touch control IC of the screen under test, which are the X-axis and Y-axis coordinate values ​​generated by the capacitance change caused by the test subject touching the screen under test; the MCU converts the touch coordinate information into refined coordinate points and displays these refined coordinate points on the screen under test in real time to record the coordinate point sequence generated by touching along the guided trajectory; while keeping the background area of ​​the screen under test completely black, the refined coordinate points corresponding to the coordinate point sequence are lit up, and the actual light intensity data emitted by the screen under test is collected by a light sensor; the ideal light intensity data of the screen under test is calculated, and the actual light intensity data is compared with the ideal light intensity data to obtain the screen detection result.

[0007] By adopting the above technical solution, the core attributes of the screen are first accurately identified through the adapter board coding, allowing the system to generate suitable power-on and power-off sequences for different TFT / OLED materials, ensuring power supply compatibility for different screens. Then, the FPGA completes the test pattern loading to ensure the stability of the display driver. At the same time, the touch coordinates are converted into refined point display. Combined with the core logic of pure black background light intensity acquisition and light intensity comparison, the reliance on visual feedback is eliminated. The accurate detection of touch and display linkage is achieved by quantifying light intensity data. Moreover, the entire process is carried out by the division of labor and cooperation between FPGA and MCU, without the need for complex computing power. This not only achieves universal adaptation to different types of screens, but also upgrades the detection results from qualitative judgment to quantitative analysis, greatly improving the accuracy and versatility of the detection.

[0008] In conjunction with some embodiments of the first aspect, in some embodiments, the step of converting the touch coordinate information into refined coordinate points via the MCU and displaying the refined coordinate points on the screen under test in real time specifically includes: obtaining the capacitance change coordinate points fed back by the touch control IC via the MCU; obtaining the physical resolution of the screen under test; mapping the capacitance change coordinate points to corresponding pixel-level refined coordinate points according to the physical resolution; and rendering the pixel-level refined coordinate points on the screen under test in real time to form a visual trajectory consistent with the actual sliding path of the test object.

[0009] By adopting the above technical solution, the MCU first accurately obtains the capacitance coordinates of the touch control IC, and then, combined with the key feature of the physical resolution of the screen under test, maps the coordinates to pixel-level refinement points, so that the coordinates correspond precisely to the physical pixels of the screen, avoiding coordinate deviations caused by resolution differences. Then, the pixel-level points are rendered in real time, so that the displayed visual trajectory perfectly matches the actual sliding path, ensuring that the transformation and display of touch coordinates are distortion-free. This provides a precise pixel-level data foundation for subsequent acquisition of light intensity of refinement points and counting of coordinate points, ensuring the accuracy of subsequent light intensity detection and continuity detection from the source, and eliminating detection errors in the coordinate transformation process.

[0010] In conjunction with some embodiments of the first aspect, in some embodiments, the step of acquiring the actual light intensity data emitted by the screen under test through a light sensor includes any of the following methods: performing global light intensity acquisition on the screen under test, the global light intensity acquisition method including: acquiring the total luminous intensity generated by the superposition of all lit refined coordinate points on the screen under test through a light sensor fixed at a preset distance from the screen under test; or, performing regional light intensity acquisition on the screen under test, the regional light intensity acquisition method including: according to the area division of the nine-grid touch test image, acquiring and statistically analyzing the local luminous intensity generated by the lit refined coordinate points in the corresponding nine-grid grid.

[0011] By adopting the above technical solution, two light intensity acquisition methods are provided: global and regional. Global acquisition can quickly obtain the overall luminous intensity of the screen, realizing the overall detection of the touch display. Regional acquisition, on the other hand, relies on the nine-square grid area division to accurately collect the local light intensity of each area, thus addressing the key need for screen area detection. The two methods can be selected as needed, satisfying the scenario requirements of rapid overall screening while also enabling refined detection of each area of ​​the screen. This avoids the problem of global acquisition failing to locate faulty areas. At the same time, regional acquisition matches the nine-square grid test map, ensuring that the light intensity data corresponds one-to-one with the screen test area, providing direct regional data support for subsequent accurate location of faulty areas.

[0012] In conjunction with some embodiments of the first aspect, in some embodiments, the step of calculating the ideal light intensity data of the screen under test specifically includes: obtaining the total number of refined coordinate points recorded in the coordinate point sequence; obtaining the preset standard luminous intensity when a single refined coordinate point is lit in the pure black state; and multiplying the total number of refined coordinate points with the preset standard luminous intensity to obtain the ideal light intensity data of the screen under test.

[0013] By adopting the above technical solution, the total number of refined coordinate points is first counted, and then the preset standard light intensity of a single refined point against a pure black background is retrieved. These two key data are the quantitative benchmarks for screen detection. The ideal light intensity is obtained by multiplying them, so that the ideal light intensity data is directly linked to the actual number of lit refined points, ensuring the objectivity and accuracy of the ideal light intensity. This makes the ideal light intensity a quantifiable detection reference standard, avoiding the subjective error of setting the ideal value. At the same time, this calculation method is simple and efficient, requiring only basic data statistics and multiplication operations, without the need for complex algorithms, reducing the system's computing power consumption and meeting the core requirements of low computing power detection.

[0014] In conjunction with some embodiments of the first aspect, in some embodiments, the step of comparing the actual light intensity data with the ideal light intensity data to obtain the screen detection result specifically includes: calculating the difference between the actual light intensity data collected in each 3x3 grid and the corresponding ideal light intensity data; mapping the difference to different color steps to generate a touch response heatmap reflecting the touch response state of the entire area of ​​the screen under test; when the difference corresponding to any 3x3 grid area in the touch response heatmap exceeds a preset light intensity attenuation threshold, it is determined that there is touch malfunction or display dead pixel in that area.

[0015] By adopting the above technical solution, the difference between the actual and ideal light intensity of each area of ​​the nine-square grid is first calculated. The difference is then mapped to a color gradient to generate a heat map, transforming the abstract light intensity difference into an intuitive visual image. This makes the touch display status of each area of ​​the screen clear at a glance. Then, a preset light intensity attenuation threshold is used to determine the fault. This grasps the core of quantitative fault determination and achieves standardized and quantitative fault determination. It not only solves the problem that traditional visual inspection is difficult to accurately locate fault areas, but also enables rapid identification of fault location and severity through heat maps. At the same time, the standardized threshold determination avoids the error of subjective human judgment, making the detection results more objective and traceable, and improving the efficiency and accuracy of fault determination.

[0016] In conjunction with some embodiments of the first aspect, in some embodiments, the step of obtaining the screen detection result further includes the continuous detection of touch. The continuous detection method includes: obtaining the number of theoretical coordinate points corresponding to the guide trajectory; counting the total number of refined coordinate points actually triggered and recorded by the test body along the guide trajectory; if the total number of refined coordinate points is lower than a preset proportion of the number of theoretical coordinate points, or the distance between adjacent coordinate points in the coordinate point sequence is greater than a preset distance threshold, then it is determined that the screen under test has a touch break defect.

[0017] By adopting the above technical solution, the theoretical number of coordinate points of the guiding trajectory is first obtained as a quantitative benchmark for continuous detection. Then, the number of refined points actually triggered is counted. Combining the two key detection dimensions of the distance between adjacent coordinate points, the disconnection is determined from the dual dimensions of "number of points" and "distance between points". This makes up for the limitations of single-dimensional detection. It can identify disconnections caused by missing touch points and also detect hidden disconnections caused by excessive distance between points. This achieves comprehensive and accurate identification of disconnection defects. At the same time, by using preset ratios and distance thresholds as judgment criteria, the disconnection detection becomes a standardized process without human intervention. This achieves automation and quantification of disconnection detection, improving detection efficiency and consistency.

[0018] In conjunction with some embodiments of the first aspect, in some embodiments, the guiding trajectory includes line or circle guiding trajectories distributed in each area of ​​the 3x3 grid, used to guide the test subject to continuously slide and touch each test area of ​​the screen under test.

[0019] By adopting the above technical solution, the guidance trajectory is set as a line and circle trajectory distributed in each area of ​​the nine-square grid. Taking advantage of the characteristic that the nine-square grid can divide the screen into multiple test areas, the guidance trajectory naturally covers the entire screen area, including key areas such as edges and corners that are prone to touch failure. This guides the test subject to perform continuous sliding touches across the entire area, avoiding the problem of missed tests caused by incomplete trajectory coverage in traditional tests. At the same time, the continuous line and circle trajectory can effectively detect the continuous touch response capability of the screen, making the sliding action of the test subject more regular and ensuring the comprehensiveness and effectiveness of the touch data.

[0020] In a second aspect, this application provides a screen testing system, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the screen testing system to perform the method described in the first aspect and any possible implementation thereof.

[0021] Thirdly, this application provides a computer-readable storage medium including instructions that, when executed on a screen testing system, cause the screen testing system to perform the method described in the first aspect and any possible implementation thereof.

[0022] Fourthly, this application provides a computer program product, including a computer program that, when run on a screen testing system, causes the screen testing system to perform the method described in the first aspect and any possible implementation thereof.

[0023] One or more technical solutions provided in the embodiments of this application have at least the following technical effects or advantages:

[0024] 1. By employing techniques such as identifying screen codes to adapt power supply timing, loading test diagrams onto FPGAs, converting touch coordinates to refined point displays, and comparing light intensity acquisition against a pure black background with ideal light intensity, this technology effectively solves the technical problems of relying on visual feedback for accurate quantitative detection, poor adaptability, and high computational power consumption. This achieves universal adaptation to different types of screens such as TFT / OLED, upgrading touch and display linkage detection from qualitative judgment to quantitative analysis, significantly improving detection accuracy, and eliminating the need for complex computational power.

[0025] 2. By employing a technology that allows for on-demand selection of global light intensity acquisition and zonal light intensity acquisition based on a nine-square grid, with zonal acquisition matching the nine-square grid test map area division, this effectively solves the technical problems in related technologies where light intensity acquisition struggles to balance overall screening with refined regional detection, and where fault areas are difficult to pinpoint. This achieves the technical effect of both quickly completing the overall detection of the screen touch display and accurately acquiring local light intensity data for each area, ensuring a one-to-one correspondence between light intensity data and test areas, and providing direct data support for subsequent accurate fault area location.

[0026] 3. By employing techniques that calculate the light intensity difference between different areas of the nine-grid display, map these differences to color steps to generate a touch response heatmap, and determine faults using preset light intensity attenuation thresholds, this technology effectively solves the technical problems of abstract and unintuitive detection results, reliance on subjective human judgment for fault determination, and inaccurate fault area location in related technologies. It transforms abstract light intensity data into intuitive visual images, making the touch display status of each area of ​​the screen clearly visible, achieving standardized and quantitative fault determination, and significantly improving the accuracy of fault location and the objectivity and traceability of detection results. Attached Figure Description

[0027] Figure 1 This is a schematic diagram of a scenario of the general automatic screen testing method in the embodiments of this application;

[0028] Figure 2 This is a flowchart illustrating a general automatic screen testing method in the embodiments of this application;

[0029] Figure 3 This is a schematic diagram of the physical device structure of a screen testing system in an embodiment of this application. Detailed Implementation

[0030] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. The singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.

[0031] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0032] To facilitate understanding, the method provided in this implementation is described in a scenario below. Please refer to [link / reference]. Figure 1 This is a schematic diagram of a scenario for a general automatic screen testing method in the embodiments of this application.

[0033] exist Figure 1 In the process, the screen testing system (including FPGA and MCU) acts as the core control unit, responsible for acquiring the preset encoding information of the screen under test from the adapter board, sending the adapted power-on / off timing sequence to the screen under test and loading the nine-grid touch test pattern, and receiving the touch coordinate information (X / Y) fed back from the screen under test from the adapter board. Simultaneously, the system collects actual light intensity data by acquiring defect information.

[0034] Light sensor: Fixed at a preset distance from the screen to be tested, it is used to collect actual light intensity data. The sensor obtains quantified light intensity data by detecting the light intensity of the illuminated refined coordinate points on the screen.

[0035] Screen under test: Includes display driver IC and touch control IC. The screen displays a pure black background area and a refined coordinate point sequence to eliminate background interference and record touch trajectories. The screen is divided into a 3x3 grid of test areas, each with a guide trajectory to guide the test subject through the full-area touch test. The finger icon in the diagram represents the test subject performing the touch operation.

[0036] Adapter board: As an intermediate interface, it is responsible for transmitting signals between the screen testing system and the screen under test, including preset encoding information (material / interface) and touch feedback information.

[0037] The entire testing process is as follows: The screen testing system identifies the attributes of the screen under test through the adapter board and generates an adaptive power supply timing sequence, and loads a standardized nine-square grid test diagram; the test object slides and touches the screen under test along the guide trajectory in the diagram; the touch control IC of the screen under test feeds back the touch coordinate information, which the system converts into a refined coordinate point sequence and displays on a pure black background; the light sensor collects the actual light intensity data generated by this sequence; the system compares the actual light intensity with the ideal light intensity, and combines it with touch continuity detection to finally complete the automatic judgment of faults such as touch failure, display dead pixels, and touch interruption.

[0038] The following describes the process of the method provided in this implementation, using the above scenario as an example. Please refer to [link / reference]. Figure 2 This is a flowchart illustrating a general automatic screen testing method in the embodiments of this application.

[0039] S101. Obtain the preset encoding information of the adapter board corresponding to the screen under test. The preset encoding information includes at least the screen material type, display interface type and touch interface type of the screen under test.

[0040] The adapter board is an intermediate circuit board used to connect the screen testing system and the screen under test, enabling signal and power transmission between the two.

[0041] This step is performed after the screen testing system has completed hardware initialization and before any power or signal transmission is provided to the screen under test. The application scenario is the initial testing and adaptation stage for touch display screens of any model and material.

[0042] The screen testing system establishes a data connection with the adapter board of the screen under test through its own communication interface. It reads the preset encoding information stored in the adapter board through a preset communication protocol. This encoding information is a standardized code set in advance according to the factory hardware parameters of the screen under test. Each code uniquely corresponds to the hardware attributes of a screen under test. The system parses the read encoding information and extracts at least three core types of information: screen material type, display interface type, and touch interface type. This provides accurate hardware parameter basis for subsequent steps such as power supply, signal transmission, and touch detection. If the parsed encoding information is missing or difficult to identify, the system will terminate the subsequent operation and issue a prompt.

[0043] This step enables accurate identification of screens with different hardware attributes from the source of testing, effectively solving the problem that existing testing methods are difficult to universally adapt to different types of screens. It lays the parameter foundation for subsequent universal automated testing throughout the entire process and avoids test failures or screen damage caused by screen attribute mismatch.

[0044] S102. Generate the corresponding power-on / off timing waveform according to the screen material type to provide power supply control to the screen under test. The screen material type includes at least TFT material and OLED material.

[0045] Among them, the power-on / off timing waveform refers to the waveform curve composed of parameters such as the voltage output sequence, voltage amplitude, duration, and voltage drop sequence and drop rate when the screen test system provides power to the screen under test. It is the core basis for power supply control. TFT material represents thin film transistor liquid crystal display material, which is a screen material that achieves display by emitting light from the backlight module and deflecting the liquid crystal layer. OLED material represents organic light-emitting diode display material, which is a screen material that achieves display by emitting light from the pixels.

[0046] Specifically, the screen testing system has a pre-stored standard power-on and power-off timing waveform parameter library corresponding to different screen material types. This library includes exclusive power-on and power-off timing parameters for TFT and OLED materials. Based on the screen material type parsed in S101, the system retrieves the corresponding standard parameters from the parameter library and fine-tunes the parameters according to the display interface type and touch interface type of the screen under test to generate a power-on and power-off timing waveform that perfectly matches the screen under test. Subsequently, the system controls the power supply module according to the waveform, providing power to each power supply pin of the screen under test according to the set voltage output sequence and amplitude. It strictly follows the power-on principle of low voltage first and high voltage later, and core components first and peripheral components later. At the same time, it presets the voltage drop rules during power-off to ensure the stability of the power-off process. The system monitors the power supply status in real time throughout the process, and if an abnormal voltage occurs, it immediately performs an emergency power-off according to the power-off sequence.

[0047] This step solves the problem that existing testing methods have fixed power supply modes and are difficult to adapt to the power supply requirements of screens of different materials. By using customized power-on and power-off timing waveforms, it achieves precise power supply control for screens of materials such as TFT and OLED, avoiding problems such as screens failing to light up or driver IC damage caused by mismatch in power supply timing or amplitude, and providing a stable power guarantee for the normal operation of the screen under test.

[0048] S103. Load a preset nine-grid touch test image into the display driver IC of the screen under test through the FPGA, so as to control the screen under test to display the nine-grid touch test image. The nine-grid touch test image contains a guide trajectory for guiding the test object to touch.

[0049] Among them, FPGA (Field-Programmable Gate Array) is a programmable integrated circuit used in screen testing systems to realize high-speed signal processing and image data transmission; display driver IC (Integrated Circuit) refers to a dedicated integrated circuit integrated on the screen under test, used to receive display signals and drive the screen pixels to emit light and display; nine-grid touch test image refers to a standard test image pre-stored in the screen testing system that divides the screen display area into nine equal rectangular areas, and is the visual carrier for touch testing; test body refers to the main body used to perform touch operations on the screen under test, which can be an artificial finger, a professional touch testing fixture, etc.

[0050] This step is performed after the screen testing system has completed power supply control to the screen under test and the screen has entered the display state. The application scenario is to provide standardized visual guidance and operational benchmarks for subsequent touch testing.

[0051] The main control module of the screen testing system sends an image loading command to the FPGA. The FPGA retrieves the preset nine-grid touch test image data from the system's storage module. This image data is standardized digital image data, which has been pre-adapted to different display interface types. The image evenly divides the effective display area of ​​the screen under test into nine areas of the same size. Each area is marked with continuous lines or circles as guides, covering key touch positions such as the center, edges, and corners of the area. The FPGA transmits the nine-grid touch test image data to the display driver IC of the screen under test at high speed through the corresponding display interface. After receiving the data, the display driver IC parses it and drives the pixels of the screen under test to emit light according to the image data until the screen under test completely and clearly displays the nine-grid touch test image and its guides. The system monitors the image display status in real time, and if there is screen distortion or missing parts, it immediately reloads the image.

[0052] In this application, the guiding trajectory is integrated with the nine-grid touch test image and loaded onto the screen under test by the FPGA along with the image. Its distribution covers all nine areas of the grid, and the lines or circles within each area are continuous and uninterrupted. The trajectory fully covers the core touch positions within that area, including the center, four edges, and four corners, ensuring that the test object can touch all key detection points within the area when sliding along the trajectory. Simultaneously, the guiding trajectories of all areas are interconnected and non-overlapping. By continuously sliding the test object along the trajectories of each area in sequence, full coverage of the effective touch area of ​​the entire screen under test can be achieved, without any blind spots. This guiding trajectory provides a unified and standardized touch operation path for the test object, avoiding the randomness of manual touch and ensuring the consistency of touch operation across different test objects and different test runs.

[0053] This step utilizes the high-speed signal processing capabilities of FPGA to achieve rapid and stable loading of test images, solving the problem of inconsistent test results caused by the lack of standardization of test images and standardized guidance for touch operations in existing test methods. The nine-grid area division and standardized guidance trajectory provide an operational benchmark for subsequent full-area, blind-spot-free touch testing, ensuring the comprehensiveness and standardization of touch testing.

[0054] S104. Receive touch coordinate information fed back by the touch control IC of the screen under test. The touch coordinate information is the X-axis and Y-axis coordinate values ​​generated by the capacitance change caused by the test object touching the screen under test.

[0055] Among them, the touch control IC refers to the dedicated integrated circuit integrated on the screen under test, which is used to detect screen touch actions and convert them into electrical signals; the X-axis and Y-axis coordinate values ​​refer to the horizontal and vertical digital coordinates corresponding to the touch position after establishing a plane rectangular coordinate system with the upper left corner of the effective touch area of ​​the screen under test as the origin, which is a quantitative representation of the touch position.

[0056] This step is performed after the screen under test successfully displays the nine-grid touch test image and the test subject performs touch operations according to the guided trajectory. The application scenario is the stage of collecting the original position data of the test subject's touch operations.

[0057] The touch control IC of the screen under test continuously monitors the capacitance state of its touch sensing layer. When the test object performs touch operations such as sliding and clicking on the screen under test according to the guide trajectory in the nine-square grid image, the capacitance value of the sensing layer at the touch position changes. After the touch control IC captures the capacitance change, it converts it into corresponding X-axis and Y-axis coordinate values ​​through its internal processing circuit, forming touch coordinate information. The touch control IC continuously transmits the real-time generated touch coordinate information to the screen testing system according to the communication protocol corresponding to the touch interface type of the screen under test. The system receives this information through the corresponding touch interface. To ensure the accuracy of the data, the system performs real-time verification of the received coordinate information, discarding invalid and garbled coordinate data, and temporarily stores the valid touch coordinate information in chronological order, forming a continuous touch coordinate data stream.

[0058] S105. The touch coordinate information is converted into refined coordinate points by the MCU and the refined coordinate points are displayed on the screen under test in real time to record the sequence of coordinate points generated by touching along the guide trajectory.

[0059] Among them, MCU refers to Microcontroller Unit, which is the core control integrated circuit in the screen testing system used to realize data operation, process control and instruction transmission; refined coordinate point refers to the pixel-level coordinate point that corresponds one-to-one with the screen pixel point after mapping the original touch coordinate information according to the physical resolution of the screen under test; coordinate point sequence refers to the continuous set of points formed by arranging all the refined coordinate points generated by the test object touching along the guide trajectory in the order of the touch time, which is a quantitative representation of the touch trajectory.

[0060] This step is performed after the screen testing system receives the touch coordinate information from the touch control IC and before collecting the light intensity data of the screen under test. The application scenario is the stage of converting the original touch coordinates into pixel-level coordinates that can be displayed on the screen and recording the touch trajectory.

[0061] Specifically, the MCU continuously acquires the capacitance change coordinates fed back by the touch control IC through a communication interface (such as I2C, SPI, etc.) matched with the touch control IC, at a preset communication frequency (such as 100Hz). These coordinates are the original coordinates calculated by the touch control IC based on the capacitance change of the touch sensing layer, which only represent the approximate location of the touch and do not correspond precisely to the physical pixels of the screen. Next, the MCU retrieves the physical resolution of the screen under test (such as 1920×1080) from the preset encoded information parsed by S101. This parameter is the core basis for achieving accurate coordinate mapping. Subsequently, the MCU starts the coordinate mapping algorithm, proportionally converting the X-axis and Y-axis values ​​of the capacitance change coordinates to the horizontal and vertical pixel counts of the physical resolution, respectively. For example, if the X-axis value of the capacitance change coordinate is 50 (corresponding to the horizontal touch area of ​​the screen), the coordinates are converted to the horizontal and vertical pixel counts of the physical resolution. (50% of the position), the screen's physical resolution is 1080 pixels horizontally, so the mapped X-axis pixel-level coordinate is 540, ensuring that each capacitance change coordinate point accurately corresponds to a specific physical pixel on the screen, generating pixel-level refined coordinate points; finally, the MCU transmits the pixel-level refined coordinate point data to the display driver IC of the screen under test at high speed through the FPGA. After receiving the data, the display driver IC immediately drives the corresponding physical pixel to emit light at a preset brightness, and new pixel-level refined coordinate points will be continuously generated and transmitted during the sliding of the test object. All the emitted pixels are arranged continuously in chronological order, and finally form a visual trajectory on the screen under test that completely coincides with the actual sliding path of the test object. The MCU monitors the rendering process throughout, and if there is a coordinate mapping deviation or rendering delay, it will adjust the mapping algorithm parameters and data transmission rate in real time.

[0062] This step solves the problems of mismatch between original touch coordinates and screen pixels and distortion of trajectory display in related technologies. It realizes the transformation of touch coordinates to pixel-level coordinates through accurate mapping of physical resolution, so that the visual trajectory is highly consistent with the actual sliding path. This provides a reliable data foundation for the pixel-level accuracy of subsequent light intensity acquisition and the determination of coordinate point spacing for touch break detection.

[0063] S106. While keeping the background area of ​​the screen under test completely black, light up each of the refined coordinate points corresponding to the coordinate point sequence, and collect the actual light intensity data emitted by the screen under test through the light sensor.

[0064] Among them, the light sensor refers to the sensing element integrated into the screen testing system, which is used to detect the light intensity and convert it into an electrical signal.

[0065] This step is performed after the MCU generates and stores the coordinate point sequence and before calculating the ideal light intensity data. Its application scenario is the core stage of providing actual quantitative data for light intensity comparison detection.

[0066] The screen testing system first controls all pixels in the background area of ​​the screen under test to remain off and enter a pure black state through the display driver IC, thereby eliminating the interference of background light emission on light intensity acquisition; then it controls the screen under test to only light up all the refined coordinate points corresponding to the coordinate point sequence generated in S105, ensuring that each refined coordinate point emits light according to the standard brightness.

[0067] The screen testing system can select any acquisition method according to actual testing needs (overall screening / refined area detection). If the global light intensity acquisition method is selected, the system first confirms that the light sensor is fixed at a preset distance perpendicular to the effective display area of ​​the screen under test. This distance is pre-calibrated and fixed throughout the process based on the screen size and sensor detection accuracy to avoid acquisition errors caused by distance deviation. Then, the light sensor is activated, and the sensor performs a full-area scan detection of the entire effective display area of ​​the screen under test, acquiring the total light intensity formed by the superposition of the light intensity of all illuminated refined coordinate points. The light intensity analog signal is converted into a digital signal and transmitted to the MCU. The MCU calibrates the digital signal to eliminate the influence of ambient light and sensor error, obtaining accurate global actual light intensity data and storing it.

[0068] If the zoned light intensity acquisition method is selected, the system first retrieves the region division parameters of the nine-grid touch test image, accurately matches the effective display area of ​​the screen under test with the nine-grid area, and clarifies the boundary coordinates of the nine grids. Then, the light sensor is activated, and according to the nine-grid region division, the sensor independently scans and detects the display area within each grid, acquiring the local luminous intensity generated by all the illuminated refined coordinate points within each grid. Simultaneously, the acquired data for each region is independently calibrated to avoid interference from light intensity superposition between regions. After acquisition, the actual local light intensity data of the nine regions are transmitted to the MCU for classified storage, ensuring the independence and accuracy of the data for each region. The sensor acquisition frequency for both acquisition methods is synchronized with the display frequency of the refined coordinate points, ensuring that the acquired light intensity data completely corresponds to the actual illuminated refined coordinate points. This step addresses the problem in related technologies where relying on visual feedback makes it difficult to accurately quantify the light intensity corresponding to touch. By offering two selectable acquisition methods—global and zoned—it can quickly acquire light intensity data of the entire touch display on the screen for overall fault screening, while also accurately acquiring local light intensity data of each area to provide a basis for precise location of subsequent fault areas. At the same time, the acquisition method with a fixed preset distance ensures the accuracy and consistency of the light intensity data, laying an objective data foundation for effective comparison with ideal light intensity data in the future.

[0069] S107. Calculate the ideal light intensity data of the screen under test, and compare the actual light intensity data with the ideal light intensity data to obtain the screen detection result.

[0070] Among them, ideal light intensity data refers to the theoretically generated light intensity quantification data when all the refined coordinate points corresponding to the coordinate point sequence are emitting light normally under the ideal state where the screen under test is free of any faults. It is the same measurement standard as the actual light intensity data.

[0071] First, the ideal light intensity data of the screen under test is calculated. Specifically, the MCU retrieves the coordinate point sequence generated and stored in S105 from the storage module, and uses a data statistical algorithm to traverse the sequence to accurately count the total number of refined coordinate points contained therein. If the partitioned light intensity acquisition method was previously selected, the MCU will also divide the area into nine grids and count the number of refined coordinate points in each area separately, providing a basis for calculating the ideal light intensity of the partitions. Next, the MCU retrieves the "preset standard luminous intensity of a single refined coordinate point" that matches the screen under test from the system's preset parameter library. This parameter library pre-stores the luminous intensity values ​​of a single pixel corresponding to different screen materials (including but not limited to TFT / OLED), different physical resolutions, and different standard brightness levels. Based on the screen material and physical resolution information parsed in S101, and the screen brightness level set before the test, the MCU accurately matches and retrieves the corresponding preset standard luminous intensity value. This value has been calibrated at the factory and through multiple actual tests to ensure consistency with the actual light emission characteristics of the screen. Subsequently, the MCU initiates numerical calculation logic, multiplying the total number of refined coordinate points (or the number of refined coordinate points in each partition) with the preset standard luminous intensity of a single point. For global ideal luminous intensity calculation, the total number is multiplied by the standard luminous intensity of a single point to obtain the global ideal luminous intensity data. For partition ideal luminous intensity calculation, the number of refined coordinate points in each partition is multiplied by the standard luminous intensity of a single point to obtain the partition ideal luminous intensity data for each nine-grid area. During the calculation process, the MCU performs precision verification on the values ​​to avoid calculation errors caused by data overflow or inconsistent units. Finally, the calculated global / partition ideal luminous intensity data is stored in a designated area, providing a unified and accurate reference benchmark for subsequent comparative testing.

[0072] Next, the screen malfunction is quantitatively determined and visualized through comparison of light intensity data. Specifically, the MCU in the system retrieves the ideal light intensity data of each nine-grid area from the storage module, as well as the previously collected and stored actual light intensity data of the corresponding areas. According to the formula "actual light intensity of the area - ideal light intensity of the area", the light intensity difference of each nine-grid area is calculated one by one. A negative difference indicates that the actual light intensity of the area is lower than the theoretical value. The larger the absolute value of the difference, the more serious the touch or display malfunction in that area. If the difference is 0 or close to 0, it means that the touch and display linkage in that area is normal.

[0073] The system retrieves pre-stored color gradient mapping rules, which set differentiated difference-color correspondences for different screen types: for example, for OLED screens, an absolute difference of ≤5% (no fault) is mapped to dark green, and 5%-10% (slight attenuation) is mapped to light green. The system substitutes the difference of each nine-grid area into the mapping rules, matches the corresponding color for each area, and generates a touch response heatmap on the system display interface that matches the actual size ratio of the screen under test according to the area position of the nine-grid area. The color of each grid in the heatmap intuitively reflects the touch response status of that area, and also marks the specific difference value of each area, making it easy for testers to view the details. Subsequently, the system retrieves a preset light intensity attenuation threshold (this threshold can be adjusted according to the test scenario, such as setting the threshold to 20% for mass production rapid screening and 10% for high-precision detection), and compares the absolute value of the difference between each nine-grid area with this threshold: if the absolute value of the difference in a certain area is ≤ the threshold, the touch and display functions in that area are determined to be normal; if the absolute value of the difference is > the threshold, the area is determined to have touch malfunction or display defects—specifically, if the number of refined coordinate points in the area is normal but the light intensity difference is large, it is determined to be a display defect (pixel cannot emit light); if the number of refined coordinate points is small and the light intensity difference is large, it is determined to be touch malfunction (no touch coordinates were collected, resulting in no light-emitting points). Finally, the system integrates the heat map and the judgment results of each area to generate the screen detection sub-result for this step, providing a basis for the subsequent generation of the final result by combining touch failure detection.

[0074] This step addresses the issues in related technologies where touch and display fault diagnosis relies on subjective human observation, lacks quantitative results, and suffers from ambiguous fault location. It achieves quantitative fault diagnosis through light intensity difference calculation and transforms abstract data into intuitive visual images using heat maps, making the fault area and severity immediately apparent. Furthermore, it standardizes fault diagnosis through preset thresholds, avoiding errors from human judgment and significantly improving the accuracy of fault location and the objectivity and traceability of detection results.

[0075] In some embodiments, after completing the comparison of light intensity differences and the generation of heat maps, and before integrating the final screen detection results, supplementary detection of screen touch failures can be performed to complement the light intensity detection and achieve a comprehensive determination of screen touch failures.

[0076] Specifically, the system retrieves the theoretical number of coordinate points corresponding to the nine-grid guide trajectory displayed on the screen under test from its internally preset parameter library. This value is calibrated by the system in advance through multiple standard tests, taking into account the actual length of the guide trajectory, the physical resolution of the screen under test, and the sampling frequency of the touch signal. Different types and lengths of guide trajectories correspond to different theoretical coordinate point numbers, and the system can automatically match and retrieve them according to the actual loaded test image.

[0077] Next, the system retrieves the sequence of coordinate points generated by the test subject touching along the guide trajectory from its own storage. Using a built-in statistical algorithm, it iterates through this sequence, accurately counting the total number of valid, chronologically ordered, refined coordinate points. During the counting process, duplicate, garbled, and invalid coordinate points are automatically removed to ensure the accuracy of the results. Subsequently, the system initiates a dual-quantization judgment logic to detect touch continuity: the first level is quantity judgment. The system retrieves a preset ratio threshold, which can be flexibly adjusted according to different testing scenarios such as rapid mass production screening and high-precision quality inspection. The system calculates the ratio between the actual total number of refined coordinate points and the theoretical number of coordinate points. If the calculated ratio is lower than the preset ratio, it is determined that the screen under test has a tendency to experience touch loss due to coordinate point loss.

[0078] The second step is spacing determination. The system calculates the pixel-level straight-line distance between two adjacent refined coordinate points in the coordinate point sequence one by one using the pixel coordinate distance calculation formula. At the same time, it retrieves a preset distance threshold, which is adapted to the physical pixel spacing of the screen under test and is a pixel-level quantized value. If the system detects that the spacing between any adjacent coordinate points is greater than the preset distance threshold, it determines that there is a loss of touch signal at that position, which is a local touch failure.

[0079] The system follows the "OR decision" principle. If the screen under test meets either of the following two conditions, namely "the actual number of refined coordinate points is lower than the theoretical number by a preset ratio" or "the distance between adjacent coordinate points is greater than a preset distance threshold", the screen under test will be determined to have a touch break defect. At the same time, the system will automatically record the specific location and degree of touch break. If neither condition is met, the touch continuity of the screen under test will be determined to meet the standard and there will be no touch break defect.

[0080] The above embodiments complement the light intensity contrast detection. The light intensity contrast detection focuses on determining whether the touch coordinates are effectively converted into physical light-emitting pixels, while the continuity detection in this embodiment focuses on determining whether the touch coordinates are continuously and completely fed back and collected. The combination of the two enables the system to achieve full coverage detection of screen touch and display linkage faults.

[0081] In this embodiment, by employing an integrated technical approach that includes identifying screen encoding to adapt to hardware attributes, customizing the generation of power-on / off timing waveforms, loading standardized test diagrams onto FPGAs, converting touch coordinates to pixel-level fine points, collecting and quantifying light intensity against a pure black background, and dual determination of touch continuity, the system can achieve fully automated testing of touch screens of different materials and interface types. This effectively solves the problems of related technologies that rely on two-dimensional image visual feedback for qualitative judgment, making it difficult to accurately quantify the touch and display linkage relationship. Furthermore, accurate detection requires complex algorithms, consumes a lot of computing power, is prone to misjudgment due to occlusion, and has poor universal adaptability. Thus, it achieves pixel-level accurate quantization detection independent of visual feedback, and takes into account both global and regional fine-grained fault location. It can simultaneously identify various faults such as touch malfunction, display dead pixels, and touch loss, and only requires basic computing power to complete the detection. It is compatible with universal and standardized automatic testing of various touch screens such as TFT and OLED, greatly improving the accuracy, efficiency, and universality of the detection.

[0082] The screen testing system in the embodiments of this invention is described below from the perspective of hardware processing. Please refer to [link / reference]. Figure 3 This is a schematic diagram of the physical device structure of a screen testing system in an embodiment of this application.

[0083] It should be noted that, Figure 3 The structure of the screen testing system shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0084] like Figure 3 As shown, the screen testing system includes a Central Processing Unit (CPU) 301, which can perform various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) 302 or programs loaded from storage section 308 into Random Access Memory (RAM) 303, such as performing the methods described in the above embodiments. The RAM 303 also stores various programs and data required for system operation. The CPU 301, ROM 302, and RAM 303 are interconnected via a bus 304. An Input / Output (I / O) interface 305 is also connected to the bus 304.

[0085] The following components are connected to I / O interface 305: input section 306 including audio input devices, push-button switches, etc.; output section 307 including a liquid crystal display (LCD) and audio output devices, indicator lights, etc.; storage section 308 including a hard disk, etc.; and communication section 309 including a network interface card such as a LAN (Local Area Network) card, modem, etc. Communication section 309 performs communication processing via a network such as the Internet. Drive 310 is also connected to I / O interface 305 as needed. Removable media 311, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 310 as needed so that computer programs read from them can be installed into storage section 308 as needed.

[0086] In particular, according to embodiments of the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing computer programs for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 309, and / or installed from removable medium 311. When the computer program is executed by central processing unit (CPU) 301, it performs the various functions defined in the present invention.

[0087] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0088] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. Each block in a flowchart or block diagram may represent a module, program segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those shown in the drawings.

[0089] Specifically, the screen testing system of this embodiment includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, it implements the general automatic screen testing method provided in the above embodiment.

[0090] In another aspect, the present invention also provides a computer-readable storage medium, which may be included in the screen testing system described in the above embodiments; or it may exist independently and not assembled into the screen testing system. The storage medium carries one or more computer programs that, when executed by a processor of the screen testing system, cause the screen testing system to implement the general automatic screen testing method provided in the above embodiments.

[0091] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0092] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0093] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A general automatic screen testing method, characterized in that, The method is applied to a screen testing system, the system including a programmable gate array (FPGA) and an MCU, and includes: Obtain the preset encoding information of the adapter board corresponding to the screen under test. The preset encoding information includes at least the screen material type, display interface type and touch interface type of the screen under test. The corresponding power-on / off timing waveforms are generated according to the screen material type to provide power supply control to the screen under test. The screen material type includes at least TFT material and OLED material. The FPGA loads a preset nine-grid touch test image into the display driver IC of the screen under test, thereby controlling the screen under test to display the nine-grid touch test image. The nine-grid touch test image contains a guide trajectory for guiding the test object to touch. The system receives touch coordinate information fed back by the touch control IC of the screen under test. The touch coordinate information is the X-axis and Y-axis coordinate values ​​generated by the capacitance change caused by the test object touching the screen under test. The touch coordinate information is converted into refined coordinate points by the MCU and the refined coordinate points are displayed on the screen under test in real time to record the sequence of coordinate points generated by touching along the guide trajectory; While keeping the background area of ​​the screen under test completely black, the refined coordinate points corresponding to the coordinate point sequence are lit up, and the actual light intensity data emitted by the screen under test is collected by the light sensor. Calculate the ideal light intensity data of the screen under test, and compare the actual light intensity data with the ideal light intensity data to obtain the screen detection result.

2. The method according to claim 1, characterized in that, The step of converting the touch coordinate information into refined coordinate points using the MCU and displaying the refined coordinate points on the screen under test in real time specifically includes: The MCU obtains the coordinate points of the capacitance change fed back by the touch control IC. Obtain the physical resolution of the screen under test; Based on the physical resolution, the capacitance change coordinate points are mapped to corresponding pixel-level refined coordinate points; The pixel-level refined coordinate points are rendered in real time on the screen under test to form a visual trajectory consistent with the actual sliding path of the test object.

3. The method according to claim 1, characterized in that, The step of acquiring the actual light intensity data emitted by the screen under test through a light sensor includes any one of the following methods: The global light intensity is acquired by performing global light intensity acquisition on the screen under test. The global light intensity acquisition method includes: The total luminous intensity generated by the superposition of all the illuminated refined coordinate points on the screen under test is collected by a light sensor fixed at a preset distance from the screen under test. Alternatively, the screen under test can be sampled in zones. The zone light intensity sampling method includes: according to the area division of the nine-grid touch test image, sampling and statistically analyzing the local luminous intensity generated by the refined coordinate points lit within the corresponding nine-grid grid.

4. The method according to claim 1, characterized in that, The step of calculating the ideal light intensity data of the screen under test specifically includes: Obtain the total number of refined coordinate points recorded in the coordinate point sequence; Obtain the preset standard luminous intensity when a single refined coordinate point is lit up in the pure black state; The ideal light intensity data of the screen under test is obtained by multiplying the total number of refined coordinate points with the preset standard luminous intensity.

5. The method according to claim 1 or 3, characterized in that, The step of comparing the actual light intensity data with the ideal light intensity data to obtain the screen detection result specifically includes: Calculate the difference between the actual light intensity data collected in each of the nine grid cells and the corresponding ideal light intensity data; The difference is mapped to different color steps to generate a touch response heatmap that reflects the touch response state of the entire area of ​​the screen under test. When the difference between any nine-square grid area in the touch response heatmap exceeds a preset light intensity attenuation threshold, it is determined that there is a touch malfunction or display defect in that area.

6. The method according to claim 1, characterized in that, The step of obtaining the screen detection result further includes detecting the continuity of the touch, wherein the continuity detection method includes: Obtain the number of theoretical coordinate points corresponding to the guide trajectory; The total number of refined coordinate points that were actually triggered and recorded along the guide trajectory of the test subject; If the total number of refined coordinate points is less than a preset proportion of the number of theoretical coordinate points, or if the distance between adjacent coordinate points in the coordinate point sequence is greater than a preset distance threshold, then the screen under test is determined to have a touch failure defect.

7. The method according to claim 1, characterized in that, The guidance trajectory includes line or circle guidance trajectories distributed in each area of ​​the nine-square grid, used to guide the test subject to continuously slide and touch each test area of ​​the screen under test.

8. A screen testing system, characterized in that, The screen testing system includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the screen testing system to perform the method as described in any one of claims 1-7.

9. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on the screen testing system, the screen testing system performs the method as described in any one of claims 1-7.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is run on the screen testing system, the screen testing system performs the method as described in any one of claims 1-7.

Images