Method, device, equipment and storage medium for determining detection area in panel image

Abstract

Embodiments of the present invention provide a method, apparatus, device and storage medium for determining a detection area in an image of a panel to be detected. The method includes: displaying a user interface, including an image display area, the image display area is used to display at least a partial image of the panel to be detected; in response to a user's operation of drawing a basic frame for the electrode of the panel to be detected in the image, determining a first detection frame, and adding the first detection frame to an existing detection frame set; in response to a user's instruction to add a detection frame, determining a second detection frame according to at least one detection frame in the existing detection frame set, and also adding the second detection frame to the existing detection frame set; and determining a detection area according to the detection frame in the existing detection frame set. Automatic drawing of the detection frame of the electrode can be achieved. There is no need for the user to draw a separate detection frame for each electrode. As a result, a large amount of human resources can be saved, and the detection time of the display panel can be shortened, thereby improving the detection efficiency.

Description

Technical Field

[0001] The present invention relates to the field of panel detection technology, and more specifically to a method for determining a detection area in an image of a panel to be detected, a device for determining a detection area in an image of a panel to be detected, an electronic device and a storage medium. Background Art

[0002] Chip on Glass (COG) is a technology that directly bonds a driver circuit chip to a glass substrate, and is widely used in various display products such as liquid crystal display and electroluminescent technology. The COG process aligns the conductive pins of the driver circuit with the electrodes (bumps) on the glass substrate, and uses anisotropic conductive film (ACF) as the bonding dielectric material. The connection and conduction between the conductive pins of the driver circuit and the electrodes on the glass substrate are achieved through high temperature and high pressure for a certain period of time. Similarly, the flexible circuit board technology on glass (FPC On Glass, FOG) is a technology that directly bonds a flexible circuit board (FPC) to a glass substrate, and the process is similar to COG. Similarly, the chip on film (COF) on a flexible substrate is a technology that first encapsulates a semiconductor chip on a flexible substrate, and then bonds the flexible substrate on the encapsulated product to a glass substrate, and its process is also similar to COG. Panel detection technology can be used to detect the connection and conduction quality between the conductive pins of the driver circuit and the electrodes on the glass substrate, so as to judge the quality of the panel according to certain standards.

[0003] Currently, before inspecting the panel, it is necessary to manually draw an inspection frame to determine the inspection area. The inspection frame is drawn along the boundaries of the electrodes on the glass substrate in the display panel. For most display panels, there may be hundreds or even thousands of electrodes. For each electrode, a manual inspection frame needs to be drawn, which may cause a serious waste of human resources and take a long time to inspect. Summary of the invention

[0004] The present invention is proposed in view of the above problems. According to one aspect of the present invention, there is provided a method for determining a detection area in an image of a panel to be detected, the method comprising: displaying a user interface, wherein the user interface comprises an image display area, the image display area is used to display at least a partial image of the panel to be detected; in response to a user's operation of drawing a basic frame for the electrodes of the panel to be detected in the image, determining a first detection frame, and adding the first detection frame to an existing detection frame set; in response to a user's instruction to add a detection frame, determining a second detection frame according to at least one detection frame in the existing detection frame set, and also adding the second detection frame to the existing detection frame set; and determining a detection area according to the detection frames in the existing detection frame set.

[0005] Exemplarily, the user interface also includes a copy control and a paste control, and the instruction for drawing an additional detection frame includes a copy instruction issued by the user using the copy control and a paste instruction issued by the user using the paste control; in response to the user's instruction for drawing an additional detection frame, determining the second detection frame according to at least one detection frame in the existing detection frame set includes: in response to the copy instruction, copying at least one detection frame in the existing detection frame set; in response to the paste instruction, pasting the copied detection frame to a desired position to generate a second detection frame.

[0006] Exemplarily, in the case of copying multiple detection frames in an existing detection frame set, pasting the copied detection frame to a desired position to generate a second detection frame includes: determining a distance between two adjacent detection frames in the copied detection frame as a first distance; and generating a second detection frame at the desired position, wherein the distance between the desired position and the last detection frame in the copied detection frame is the first distance.

[0007] Exemplarily, the user interface also includes an adding control, and determining the first detection frame in response to the user's operation of drawing a basic frame for the electrodes of the panel to be detected in the image includes: activating the corresponding image in response to the user's instruction to add a detection frame issued using the adding control; generating the first detection frame in response to the user's dragging operation on the activated image using an input device.

[0008] Exemplarily, the user interface further includes a selection control, and the method further includes: in response to an instruction issued by the user to select the detection box using the selection control, activating the detection box selected by the user.

[0009] Exemplarily, the method further includes: in response to an adjustment operation of the user, adjusting at least one detection frame in the existing detection frame set so that the adjusted detection frame coincides with a boundary of a corresponding electrode in the image.

[0010] Exemplarily, adjusting at least one detection frame in the existing detection frame set in response to a user's adjustment operation includes: in response to a user's dragging operation on at least one detection frame in the existing detection frame set using an input device, adjusting the dragged detection frame accordingly.

[0011] Exemplarily, the user interface also includes an adjustment control, and adjusting at least one detection frame in the existing detection frame set in response to the user's adjustment operation includes: adjusting at least one detection frame in the existing detection frame set in response to the user's operation on the adjustment control.

[0012] Exemplarily, the adjustment control includes a specific direction isometric control, and adjusting at least one detection frame in the existing detection frame set in response to a user operation on the adjustment control includes: determining, in response to a user operation on the specific direction isometric control, the distance between relative edges of a first detection frame and a last detection frame in a specific direction in at least one detection frame, wherein the specific direction is an arrangement direction of at least one detection frame; calculating the sum of lengths of other detection frames between the first detection frame and the last detection frame in the specific direction; calculating the difference between the distance and the sum; determining the number of detection frame intervals between at least one detection frame; calculating the quotient of the difference and the number of detection frame intervals; and translating other detection frames along the specific direction so that the distance between any two adjacent detection frames in at least one detection frame in the specific direction is equal to the quotient.

[0013] Exemplarily, the adjustment control includes an end equidistant control, and adjusting at least one detection frame in the existing detection frame set in response to a user operation on the adjustment control includes: determining, in response to a user operation on the end equidistant control, an angle between a first detection frame and a last detection frame in at least one detection frame, wherein a first end of at least one detection frame is equidistant; determining the number of detection frame intervals between at least one detection frame; calculating a quotient of an angle between the first detection frame and the last detection frame and the number of detection frame intervals; and for each detection frame in other detection frames between the first detection frame and the last detection frame, rotating the detection frame with the first end of the detection frame as the center so that the angle between any two adjacent detection frames in at least one detection frame is equal to the quotient.

[0014] Exemplarily, the adjustment control includes a step size setting control and a specific direction movement control, and adjusting at least one detection frame in the existing detection frame set in response to a user operation on the adjustment control includes: receiving a step size set by the user using the step size setting control; in response to the user operation on the specific direction movement control, translating at least one detection frame in the specific direction and at a step size.

[0015] According to another aspect of the present invention, there is also provided a device for determining a detection area in an image of a panel to be detected, the device comprising: a display module for displaying a user interface, wherein the user interface comprises an image display area, and the image display area is used to display at least a partial image of the panel to be detected; a first detection frame determination module for determining a first detection frame in response to a user's operation of drawing a basic frame for the electrodes of the panel to be detected in the image, and adding the first detection frame to an existing detection frame set; a second detection frame determination module for determining a second detection frame according to at least one detection frame in the existing detection frame set in response to a user's instruction to add a detection frame, and also adding the second detection frame to the existing detection frame set; and a detection area determination module for determining a detection area according to the detection frames in the existing detection frame set.

[0016] According to another aspect of the present invention, there is also provided an electronic device, comprising a display, a processor and a memory, wherein the display is used to display an image of a panel to be inspected, and the memory stores computer program instructions, which are used by the processor to execute the method for determining a detection area in the image of a panel to be inspected as described above when the computer program instructions are executed.

[0017] According to yet another aspect of the present invention, a storage medium is provided on which program instructions are stored. When the program instructions are run, they are used to execute the method for determining a detection area in an image of a panel to be detected as described above.

[0018] According to the above technical solution, the automatic drawing of the detection frame of the electrode can be realized. There is no need for the user to draw a separate detection frame for each electrode. As a result, a large amount of human resources can be saved, and the detection time of the display panel can be shortened, and the detection efficiency can be improved.

[0019] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other purposes, features and advantages of the present invention will become more apparent by describing the embodiments of the present invention in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0021] Figure 1 A schematic flow chart of a method for determining a detection area in an image of a panel to be detected according to an embodiment of the present invention is shown;

[0022] Figure 2 A schematic diagram showing a user interface according to an embodiment of the present invention;

[0023] Figure 3 A schematic diagram showing a user interface according to another embodiment of the present invention;

[0024] Figure 4 A schematic flow chart showing the steps of determining a first detection frame according to an embodiment of the present invention is shown;

[0025] Figure 5 A schematic flow chart showing the steps of determining a second detection frame according to an embodiment of the present invention is shown;

[0026] Figure 6 A schematic flow chart showing the steps of determining a second detection frame according to another embodiment of the present invention is shown;

[0027] Figure 7 A schematic diagram showing a detection frame of electrodes in an image of a panel to be detected according to an embodiment of the present invention is shown;

[0028] Figure 8 A schematic flow chart showing steps of adjusting at least one detection frame in an existing detection frame set according to an embodiment of the present invention is shown;

[0029] Figure 9a A schematic diagram showing a plurality of detection frames arranged horizontally according to an embodiment of the present invention is shown;

[0030] Figure 9b The figure shows the structure of the device after horizontal equidistant operation according to one embodiment of the present invention. Figure 9a A schematic diagram of multiple detection frames shown;

[0031] Fig.10 A schematic flow chart showing steps of adjusting at least one detection frame in an existing detection frame set according to another embodiment of the present invention is shown;

[0032] Fig.11 A schematic flow chart showing steps of adjusting at least one detection frame in an existing detection frame set according to yet another embodiment of the present invention is shown;

[0033] Fig.12 A schematic block diagram of a device for determining a detection area in an image of a panel to be detected according to an embodiment of the present invention is shown;

[0034] Fig.13 A schematic block diagram of an electronic device according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical scheme and advantages of the present invention more obvious, the exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited to the exemplary embodiments described herein. Based on the embodiments of the present invention described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.

[0036] Figure 1 FIG. 1 is a schematic flow chart of a method 100 for determining a detection area in an image of a panel to be detected according to an embodiment of the present invention. Figure 1 As shown, method 100 may include the following steps.

[0037] Step S110, displaying a user interface. The user interface may include an image display area for displaying at least a partial image of the panel to be inspected.

[0038] It can be understood that in order to facilitate user operation, a user interface can be provided to the user for human-computer interaction.

[0039] Figure 2 A schematic diagram of a user interface according to an embodiment of the present invention is shown. The user interface includes an image display area 210, which can display a partial or full image of a panel to be detected. Based on the user interface, a user can perform relevant operations on the image of the panel to be detected more intuitively and visually. Exemplarily, the image can be an image previously captured by an image acquisition device and pre-stored locally. The user can load and display it through the user interface. Each panel to be detected can be marked with a left mark and a right mark. Figure 2 The middle image display area 210 displays the left mark, i.e., the four rectangular boxes on the left side of the figure. The user can display other parts of the image, such as the right mark (not shown in the figure), by dragging the sliding bar below the image display area 210. The left and right marks can be used for alignment when bonding the chip to the glass substrate.

[0040] Step S130 , in response to the user's operation of drawing a basic frame for the electrodes of the panel to be detected in the image, a first detection frame is determined, and the first detection frame is added to the existing detection frame set.

[0041] See also Figure 2, wherein the image displayed in the image display area 210 includes a plurality of electrodes. For at least one of the electrodes, the user can manually draw a basic frame along its boundary. The obtained one or more basic frames are the first detection frames, and are added to the existing detection frame set. It can be understood that before the first detection frame is added, the existing detection frame set can be an empty set.

[0042] Step S150 , in response to the user's instruction to add a detection frame, determine a second detection frame according to at least one detection frame in the existing detection frame set, and add the second detection frame to the existing detection frame set.

[0043] It can be understood that the instruction to add a detection frame is used to increase the number of detection frames. Exemplarily, the second detection frame can be automatically drawn based on the parameters representing the shape, such as the length and width of the first detection frame in the existing detection frame set. Preferably, the second detection frame and the first detection frame have the same parameters except for the position. The second detection frame can be automatically spaced a specific distance from the first detection frame. And, similar to the first detection frame, the second detection frame may also be one or more, and then added to the existing detection frame set.

[0044] Step S170: determining a detection area according to the detection frames in the existing detection frame set.

[0045] According to the above steps, the existing detection frame set includes the first detection frame and the second detection frame. The area in both the first detection frame and the second detection frame is the detection area. In other words, the detection area includes all areas in the first detection frame and the second detection frame.

[0046] According to the above technical solution, the automatic drawing of the detection frame of the electrode can be realized. There is no need for the user to draw a separate detection frame for each electrode. As a result, a large amount of human resources can be saved, and the detection time of the display panel can be shortened, and the detection efficiency can be improved.

[0047] Figure 4 FIG. 4 is a schematic flow chart showing the steps of determining a first detection frame according to an embodiment of the present invention. Figure 4 As shown, step S130 may include the following steps.

[0048] Step S131 , in response to a user instruction to add a detection frame using an adding control, activating a corresponding image.

[0049] The user interface can include additional controls. Figure 3 , shown as a button "Add Mode". For example, the user can click Figure 3The button "add mode" in triggers the function of adding a detection frame. For the image in the image display area 210, the user can use the add control to issue an instruction to add a detection frame to activate it, so that the user can start drawing a basic frame on it.

[0050] Step S132: generating a first detection frame in response to a user's dragging operation on the activated image using an input device.

[0051] For example, the input device can be any suitable external input device that can draw a detection frame, such as a mouse, a touch screen, a keyboard, etc. The user can use the above input device to perform a drag operation on the aforementioned activated image for the boundary of at least one electrode in the image. Exemplarily, the drag operation can be performed from a vertex of a certain electrode (e.g., the upper left vertex) to the vertex opposite to the vertex (e.g., the lower right vertex). In this way, a basic frame formed along the boundary of the electrode can be drawn, which is the first detection frame.

[0052] In this way, the basic frame of the electrode can be quickly drawn as the first detection frame, and the accuracy of the drawn first detection frame can be guaranteed.

[0053] The user interface may also include selection controls. Figure 3 , shown as a button "Select Mode". For example, the user can Figure 3 The button "Selection Mode" in triggers the function of selecting the detection frame. In this embodiment, the method 100 may also include activating the detection frame selected by the user in response to an instruction to select the detection frame issued by the user using the selection control. Specifically, after clicking the button "Selection Mode", the user can click on the detection frame of any electrode in the image display area 210. For example, a user clicking the detection frame of a certain electrode with a single click of the left mouse button can indicate that the detection frame is selected, that is, the detection frame is activated. After that, when the user clicks the detection frame of the electrode with a single click of the left mouse button again, it can indicate that the detection frame is unselected. In the selection mode, the user can use the mouse to click on the detection frame multiple times to activate multiple detection frames. For the multiple detection frames that have been activated, subsequent detection frame editing operations, such as copying, deleting, or moving, can be performed.

[0054] Therefore, the user can select an appropriate number of detection frames to activate according to actual needs, and the operation is simple.

[0055] The user interface may also include a copy control and a paste control, corresponding to Figure 3 The instructions for adding the detection frame in step S150 may include a copy instruction issued by the user using a copy control and a paste instruction issued by the user using a paste control.

[0056] Figure 5FIG. 4 is a schematic flow chart showing the steps of determining the second detection frame according to an embodiment of the present invention. Figure 5 As shown, step S150 may specifically include the following two steps.

[0057] Step S151, in response to a copy instruction, copy at least one detection box in an existing detection box set.

[0058] According to the foregoing, before executing this step, the existing detection frame set contains a first detection frame, which may be one or more. When the existing detection frame set contains only one detection frame, the user can select the detection frame and click the copy control on the user interface to copy the detection frame. When the existing detection frame set contains multiple detection frames, the detection frame you want to copy can be selected through the above-mentioned selection control for copying. Exemplarily, the detection frame pasted using the paste control is selected by default. Therefore, when drawing a detection frame, after drawing a detection frame, you can use the copy control and the paste control to get two detection frames, continue to use the copy control and the paste control, you can get four detection frames, continue to use the copy control and the paste control, you can get eight detection frames, and so on. That is, in "Paste" mode, if the user does not use the selection control to specify the detection frame you want to copy, all detection frames in the existing detection frame set can be copied by default.

[0059] Step S152 , in response to the paste instruction, the copied detection frame is pasted to a desired position to generate a second detection frame.

[0060] After the copy operation for the detection frame is completed, all the copied detection frames can be pasted to the desired position in response to the paste instruction from the user. It can be understood that the desired position can be set differently according to the needs of the user. For example, the desired position can be a position that is a fixed distance away from the position of the copied detection frame. The number of second detection frames generated by pasting is equal to the number of copied detection frames. Exemplarily, when there are multiple copied detection frames, the second detection frame pasted to the desired position can maintain the positional relationship between the original detection frames. The desired position can also be determined by user input, for example, by responding to the user's operation, where the operation can be understood as the user operating the mouse to click on a certain position, and the position is the desired position.

[0061] According to the above technical solution, the detection frame can be quickly drawn, which saves a lot of time compared with the prior art in which the user manually draws the detection frame for each electrode, while reducing the user's workload and improving the user's experience.

[0062] Figure 6FIG. 4 is a schematic flow chart showing the steps of determining the second detection frame according to another embodiment of the present invention. In the case of copying multiple detection frames in the existing detection frame set, step S152 can be performed as follows: Figure 6 The steps shown are implemented.

[0063] Step S152a, determining the distance between two adjacent detection frames in the copied detection frame as the first distance.

[0064] As described above, when the existing detection frame set contains multiple detection frames, you can select the detection frame you want to copy in the above selection mode and copy it. As described above, in the "Paste" mode, if the user does not specify a detection frame, all detection frames in the existing detection frame set are copied by default. Figure 7 FIG. 1 is a schematic diagram showing a detection frame of electrodes in an image of a panel to be detected according to an embodiment of the present invention. Figure 7 As shown, the first two detection frames are taken as the detection frames selected to be copied as an example, and the distance between them can be the distance between the straight line where the right frame of the left detection frame is located and the straight line where the left frame of the right detection frame is located, and this distance is taken as the first distance. It can be understood that the above two adjacent detection frames can be any two detection frames in the copied detection frames, such as the first two detection frames or the last two detection frames.

[0065] Step S152b: Generate a second detection frame at the desired position, wherein the distance between the desired position and the last detection frame in the copied detection frame is a first distance.

[0066] See again Figure 7 , when there are two detection frames copied, the expected position can be a position at a first distance from the position of the last detection frame in the copied detection frame, and a second detection frame is generated at this position. In the above technical solution, the detection frames are copied and pasted in order from left to right. It can be understood by those of ordinary skill in the art that it is still feasible to execute the above technical solution according to the rule from right to left, and for the sake of brevity, it will not be repeated here. In this embodiment, the copied detection frames are 2, and the total detection frames obtained after the first paste are 4. The user can click the copy control and the paste control again to repeat the above operation. At this time, the copied detection frames are 4, and the total detection frames obtained after the second paste are 8 (not shown in the figure). Repeat the above operation by analogy, and the detection frames of all electrodes in the image of the panel to be detected can be obtained.

[0067] This ensures that the distance between the detection frame obtained after pasting and the copied detection frame is fixed, and because the electrodes are roughly evenly distributed on the panel to be detected, the detection frames of the remaining electrodes can be quickly and accurately obtained according to the above technical solution.

[0068] Preferably, after step S130 and / or step S150, method 100 further includes: step S160, in response to the user's adjustment operation, adjusting at least one detection frame in the existing detection frame set so that the adjusted detection frame coincides with the boundary of the corresponding electrode in the image. It can be understood that the detection frame is used to define the detection area. The desired detection area is the area covered by the electrode on the panel to be detected. When the detection frame coincides with the boundary of its corresponding electrode, it means that the electrode is completely contained in the detection frame and there is no noise area such as the background area in the detection frame, thereby optimizing the detection area. For example, the user can use the above-mentioned selection control button "Select Mode" to select any detection frame in the existing detection frame set that he wants to adjust, and adjust the position of the selected detection frame through the adjustment operation.

[0069] According to the above technical solution, the adjusted detection frame can fit the complete electrode more ideally. In other words, it is ensured that the detection object, i.e., the electrode in the image, is complete when the subsequent detection operation is performed on the panel to be detected, and no noise area is introduced. This avoids the occurrence of problems such as large errors in the detection results of the panel to be detected when the detection frame is offset, i.e., only part of the electrode image is included therein.

[0070] In a specific embodiment, step S160 includes, in response to a user's dragging operation on at least one detection frame in the existing detection frame set using an input device, adjusting the dragged detection frame accordingly.

[0071] As described above, for the first detection frame and / or the second detection frame in the existing detection frame set, the user can use the selection control to select the detection frame that he wants to adjust. For example, after multiple copying and pasting, the positions of some detection frames may not completely overlap with the boundaries of their corresponding electrodes. At this time, the user can use the input devices listed above to drag at least a part of the detection frames in the existing detection frame set. For example, if the user observes through the image display area 210 of the user interface that the positions of some detection frames are biased to the left relative to their corresponding electrodes, the user can use the input device to drag these detection frames to the right to the positions corresponding to the electrodes so that the boundaries of the detection frames and electrodes overlap.

[0072] Through the above technical solution, the user can use the visibility of the user interface to adjust the position of the detection frame respectively, and the operation is simple and easy to implement.

[0073] Exemplarily, the user interface may further include an adjustment control. In this embodiment, step S160 may include: in response to the user's operation on the adjustment control, adjusting at least one detection frame in the existing detection frame set. Different from the above-mentioned use of the input device to adjust the detection frame, in this embodiment, an adjustment control is provided. Figure 3The user interface shown in FIG. 1 shows a plurality of adjustment controls 310. The user can use the adjustment controls to adjust one or more detection frames in the existing detection frame set. The adjustment controls may include one or more, which may correspond to different adjustment operations. It can be understood that in this embodiment, the adjustment operation corresponding to each adjustment control is fixed, such as uniformly moving the currently activated detection frame to the right by a specific number of pixels. The user can adjust the currently activated detection frame accordingly by simply operating the adjustment control. As a result, not only is the user's adjustment operation on the detection frame simplified, but it also provides the possibility of achieving a unified adjustment operation, thereby avoiding errors caused by manual operation by the user.

[0074] Figure 8 1 shows a schematic flow chart of the steps of adjusting at least one detection frame in an existing detection frame set according to an embodiment of the present invention. In this embodiment, the adjustment control 310 may include a specific direction isometric control, such as Figure 3 The buttons "X Equal Distance" and "Y Equal Distance" are shown. Figure 8 As shown, step S160 may include the following steps.

[0075] Step S1601, in response to a user's operation on a specific direction isometric control, determining a distance L between opposite sides of a first detection box and a last detection box in a specific direction in at least one detection box. The specific direction is an arrangement direction of the at least one detection box, such as horizontal or vertical.

[0076] The relative edges refer to the two boundaries of the two detection frames that are closest to each other. For example, for the first detection frame and the last detection frame in the existing set of detection frames arranged horizontally, the distance L between the right boundary of the first detection frame and the left boundary of the last detection frame is calculated. The first detection frame is the leftmost detection frame in the horizontal direction, and the last detection frame is the rightmost detection frame in the horizontal direction. Figure 9a FIG. 4 is a schematic diagram showing a plurality of detection frames arranged horizontally according to an embodiment of the present invention. Figure 9a As shown, the distance between the right boundary of the first detection frame and the left boundary of the last detection frame is L. Alternatively, for the first detection frame and the last detection frame in the vertical direction in the existing detection frame set, the distance between the lower boundary of the first detection frame and the upper boundary of the last detection frame is calculated. The first detection frame is the uppermost detection frame in the vertical direction, and the last detection frame is the lowermost detection frame in the vertical direction.

[0077] Step S1602, calculating the sum d of the lengths of other detection frames between the first detection frame and the last detection frame in the specific direction.

[0078] Exemplarily, for the other detection frames between the first detection frame and the last detection frame in the horizontal direction, the length of each detection frame in the horizontal direction is determined, and the obtained lengths are summed to obtain the sum d of the lengths of these detection frames in the horizontal direction. Figure 9a As shown, the length of each detection box in its horizontal direction is d i , sum the lengths of the remaining three detection frames except the first and last detection frames, that is, d1+d2+d3=d. It can be understood that the term "length" does not mean that the size of the detection frame in the horizontal direction is larger than its size in the vertical direction. Alternatively, for the other detection frames between the first detection frame and the last detection frame in the vertical direction, determine the length of each detection frame in the vertical direction, and sum the obtained lengths to obtain the sum d of the lengths of these detection frames in the vertical direction.

[0079] Step S1603, calculating the difference between the distance determined in step S1601 and the sum calculated in step S1602.

[0080] It can be understood that, since there are intervals between the detection frames, the distance L is greater than the sum of the lengths in a specific direction d. Subtracting the sum d from the distance value L can obtain a positive difference. In fact, the difference represents the total length of the intervals between all detection frames.

[0081] Step S1604: determine the number of detection frame intervals between at least one detection frame to be adjusted.

[0082] For example, the number of detection frames to be adjusted is 5, and the number of detection frame intervals is 4. Therefore, the number of detection frame intervals is equal to the total number of detection frames to be adjusted minus 1.

[0083] Step S1605, calculating the quotient W of the difference calculated in step S1603 and the number of detection frame intervals determined in step S1604.

[0084] The quotient W of the two can be calculated by using the difference value obtained in the above step S1603 as the dividend and the number of detection frame intervals obtained in the above step S1604 as the divisor.

[0085] Step S1606: translate the other detection frames between the first detection frame and the last detection frame along the specific direction so that the distance between any two adjacent detection frames in the detection frames to be adjusted in the specific direction is equal to the quotient W.

[0086] In this embodiment, the distance between any two adjacent detection frames in at least one detection frame to be adjusted can be automatically adjusted in the arrangement direction thereof to the quotient W obtained through the above steps. Thus, these detection frames are automatically adjusted to be evenly arranged. Figure 9bThe figure shows the structure of the device after horizontal equidistant operation according to one embodiment of the present invention. Figure 9a Schematic diagram of multiple detection boxes shown in FIG. Figure 9b As shown, the distance between any two adjacent detection boxes is equal to the quotient W obtained above.

[0087] Usually, in the panel, the electrodes are arranged evenly. With the above solution, when the desired number of detection frames has been generated and the first detection frame and the last detection frame are in the ideal position, the user only needs to operate the specific direction isometric control in the user interface for these detection frames to automatically adjust the multiple detection frames so that the distance between any two adjacent detection frames becomes equal, thereby automatically matching all detection frames to the position of the electrodes. There is no need for the user to perform too much manual adjustment, calculation, etc., which reduces the user's workload.

[0088] Fig.10 A schematic flow chart of the steps of adjusting at least one detection frame in an existing detection frame set according to another embodiment of the present invention is shown. In this embodiment, the adjustment control 310 may also include an end equal distance control. For example Figure 3 The buttons "Upper X Equal Distance" and "Lower X Equal Distance" are shown. Fig.10 As shown, step S160 may include the following steps.

[0089] Step S1607, in response to the user's operation on the end equidistant control, determining the angle between the first detection frame and the last detection frame in at least one detection frame, wherein at least one detection frame is a detection frame to be adjusted, and its first end is equidistant.

[0090] It can be understood that the detection frame usually has two ends, which are respectively referred to as the first end and the second end for the convenience of description. Taking the detection frames arranged roughly horizontally as an example, each detection frame may include an upper end and a lower end. In this embodiment, the first end of the detection frame to be adjusted is equidistant. The following description is given below by taking the detection frames arranged roughly horizontally and with equidistant lower ends as an example. When the lower ends of the detection frames to be adjusted are equidistant, the user can perform the upper end equidistant operation on these detection frames by operating the button "Upper X Equal Distance". At this time, the distance between the lower ends of the detection frames to be adjusted remains unchanged. After the user clicks the button "Upper X Equal Distance", the angle between the extension lines of the right line of the first detection frame and the left line of the last detection frame in the detection frame to be adjusted can be determined. Alternatively, the angle between the extension lines of the left line of the first detection frame and the right line of the last detection frame in the detection frame to be adjusted can be determined.

[0091] Step S1608, determining the number of detection frame intervals between at least one detection frame.

[0092] Similar to the above step S1604, it can be determined that the number of detection frame intervals is equal to the number of detection frames to be adjusted minus 1.

[0093] Step S1609, calculating the quotient of the angle between the first detection frame and the last detection frame determined in step S1607 and the number of detection frame intervals determined in step S1608.

[0094] The quotient of the two detection frames can be calculated by using the angle between the two detection frames obtained above as the dividend and the number of detection frame intervals obtained above as the divisor.

[0095] Step S1610: For each detection frame in other detection frames between the first detection frame and the last detection frame, rotate the detection frame with the first end of the detection frame as the center of the circle so that the angle between any two adjacent detection frames in at least one detection frame is equal to the quotient.

[0096] For example, each detection frame can be rotated with the midpoint of the lower end of each detection frame in the other detection frames between the first detection frame and the last detection frame as the center of the circle. The angle between any two adjacent detection frames in the detection frame obtained after the rotation is equal to the quotient obtained by the above calculation. A person of ordinary skill in the art can understand the specific implementation scheme for operating the button "lower X equal distance" control by reading the above operation for the button "upper X equal distance" control, which will not be repeated here for the sake of brevity.

[0097] In the panel, some electrodes are arranged evenly and divergently, and their shapes are similar to the ribs of a fan. With the above solution, when the desired number of detection frames has been generated and the first and last detection frames are in ideal positions, the user only needs to operate the end equidistant controls in the user interface for these detection frames to automatically rotate multiple detection frames so that the angles between any two adjacent detection frames become equal, thereby automatically matching all detection frames to the positions of the electrodes. There is no need for the user to make too many manual adjustments, which reduces the user's workload and improves the user experience.

[0098] Fig.11 A schematic flow chart of the steps of adjusting at least one detection frame in an existing detection frame set according to another embodiment of the present invention is shown. In this embodiment, the adjustment control may include a step size setting control and a specific direction movement control. Fig.11 As shown, step S160 may further include the following steps.

[0099] Step S1611, receiving the step size set by the user using the step size setting control.

[0100] The step size setting control can be used as follows Figure 3 The dialer shown in the figure can also be implemented using a text input box or a filter box. Figure 3 In the illustrated embodiment, the user can set the step length by clicking the arrow after the text box corresponding to "Step length". For example, clicking an upward arrow can increase the numerical value of the step length, and clicking a downward arrow can decrease the numerical value of the step length.

[0101] Step S1612: in response to the user's operation on the specific direction movement control, at least one detection frame is translated toward the specific direction and with a step size.

[0102] Once the user has set the step size, the control can be moved in a specific direction. Figure 3 Use the four arrow buttons in the upper, lower, left, and right menu to adjust the position of the detection frame. For example, the user can select at least one detection frame whose position they want to adjust in the above-mentioned "selection mode", and the detection frame can be translated in a specific direction by the above-mentioned set step length under the movement instruction issued by the user using the specific direction movement control. It can be understood that when the user operates the specific direction movement control once, these detection frames move correspondingly once. During the movement, the distance between any two adjacent detection frames between these detection frames remains unchanged, which means that during the above-mentioned adjustment process, these detection frames are adjusted as a whole.

[0103] From the user's perspective, the above adjustment operation changes the positional relationship between these detection frames and other detection frames on the image. For example, if the above specific direction is to the right, and before the adjustment operation, there are some detection frames to the left of the detection frame to be adjusted that have already been in place relative to the electrode, then the above adjustment operation separates these detection frames from the already in place detection frames, that is, away from the already in place detection frames.

[0104] Thus, the user can control the detection frame to be adjusted to move in a specific direction with a fixed step size. The user can perform batch operations on a large number of detection frames without having to manually adjust them separately, which can save a lot of time.

[0105] Exemplarily, the adjustment control may include a translation control, a rotation control, a tilt control, and / or an alignment control. The translation control is used to translate the currently activated detection frame in a specific direction with a specific step length. This is implemented, for example, using the above-mentioned specific direction movement control. The rotation control is used to rotate the currently activated detection frame with a specific point as the center. For example, Figure 3 The control ① in the rotation control shown in the figure can be used to rotate with the upper left vertex of the detection box as the center of the circle. Similarly, the control ② in the rotation control can be used to rotate with the upper right vertex of the detection box as the center of the circle. By analogy, the functions of the controls ③ and ④ in the rotation control can be understood. The tilt control is used to tilt one end of the detection box to a specific angle while keeping the other end of the detection box stationary. For example, it can include Figure 3"Tilt Up" and "Tilt Down" in the control. Take the "Tilt Up" control as an example. When the user operates the control, the lower end of the currently activated detection box remains stationary, and the upper end tilts to the left or right at a preset angle. Similarly, the function of the "Tilt Down" control can be known, and it will not be repeated here. The alignment control is used to adjust the currently activated detection box so that all currently activated detection boxes are aligned in a specific direction. It can include Figure 3 In the control, the buttons "Align Top" and "Align Left" are clicked. Taking the button "Align Top" as an example, when the user operates the control, the selected detection boxes move at the same time and ensure that the upper boundaries of all detection boxes are on the same horizontal line. Similarly, the function of the "Align Left" control can be known, and it will not be repeated here. It can be understood that the alignment basis can be the default, such as the first detection box in the currently activated detection box.

[0106] Therefore, users can perform various operations on a large number of detection frames in batches at the same time as needed, which meets the various needs of different users. In addition, the above solution is simple and easy to implement, and the user operation is also simple.

[0107] Exemplarily, the adjustment control 310 may include a per-image deletion control. In this embodiment, the method 100 may further include detecting a detection frame in an existing detection frame set that fails to be displayed in the image display area, and deleting the detected detection frame. In the process of determining the second detection frame based on the detection frame in the existing detection frame set, many second detection frames may be generated. For example, as described above, in the process of copying and pasting, the detection frames involved may increase exponentially, thereby eliminating the need for users to manually draw detection frames, saving a lot of time. It is understandable that after the paste operation is completed, the number of all detection frames obtained may be greater than the number of electrodes displayed in the image display area. Obviously, those detection frames that do not have corresponding electrodes may have a catastrophic effect on the accuracy of panel detection. In this embodiment, the user can operate Figure 3 The button "Delete Area Outside Image" shown will delete the above redundant detection frames with one click.

[0108] Thus, it is ensured that all detection frames and electrodes are in a one-to-one correspondence, that is, the area within each detection frame is a valid detection area. At the same time, the above deletion operation is simple, and the user does not need to delete them manually one by one.

[0109] According to another aspect of the present invention, a device for determining a detection area in an image of a panel to be detected is also provided. Fig.12 FIG. 1 is a schematic block diagram of an apparatus 1200 for determining a detection area in an image of a panel to be detected according to an embodiment of the present invention. Fig.12 As shown, the device 1200 includes a display module 1210 , a first detection frame determination module 1220 , a second detection frame determination module 1230 , and a detection area determination module 1240 .

[0110] The display module 1210 is used to display a user interface, wherein the user interface includes an image display area, and the image display area is used to display at least a partial image of the panel to be inspected.

[0111] The first detection frame determination module 1220 is used to determine a first detection frame in response to a user's operation of drawing a basic frame for electrodes of a panel to be detected in an image, and to add the first detection frame to an existing detection frame set.

[0112] The second detection frame determination module 1230 is used to respond to the user's instruction to add a detection frame, determine a second detection frame according to at least one detection frame in the existing detection frame set, and add the second detection frame to the existing detection frame set.

[0113] The detection area determination module 1240 is used to determine the detection area according to the detection frame in the existing detection frame set.

[0114] According to yet another aspect of the present invention, an electronic device is provided. Fig.13 A schematic block diagram of an electronic device 1300 according to an embodiment of the present invention is shown. As shown in the figure, the electronic device 1300 includes a display 1310, a processor 1320 and a memory 1330. The display 1310 is used to display an image of a panel to be detected. The memory 1230 stores computer program instructions, which are used by the processor 1320 to execute the method 100 for determining a detection area in an image of a panel to be detected as described above.

[0115] According to another aspect of the present invention, a storage medium is also provided. Program instructions are stored on the storage medium, and the program instructions are used to execute the method 100 for determining the detection area in the image of the panel to be detected as described above when running. The storage medium may include, for example, a storage component of a tablet computer, a hard disk of a personal computer, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.

[0116] A person skilled in the art can understand the specific implementation scheme of the device, electronic device and storage medium for determining the detection area in the image of the panel to be inspected by reading the above description of the method for determining the detection area in the image of the panel to be inspected, and for the sake of brevity, it will not be repeated here.

[0117] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present invention thereto. Various changes and modifications may be made therein by one of ordinary skill in the art without departing from the scope and spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as required by the appended claims.

[0118] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0119] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.

[0120] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0121] Similarly, it should be understood that in order to streamline the present invention and help understand one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the method of the present invention should not be interpreted as reflecting the following intention: the claimed invention requires more features than the features explicitly stated in each claim. More specifically, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with less than all the features of a single disclosed embodiment. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.

[0122] It will be understood by those skilled in the art that, except for mutually exclusive features, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this specification may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose.

[0123] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims, any one of the claimed embodiments may be used in any combination.

[0124] The various component embodiments of the present invention can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of the functions of some modules in the device for determining the detection area in the image of the panel to be detected according to an embodiment of the present invention. The present invention can also be implemented as a device program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0125] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

[0126] The above is only a specific embodiment of the present invention or an explanation of a specific embodiment. The protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A method for determining a detection area in an image of a panel to be detected, characterized in that: The method comprises: Displaying a user interface, wherein the user interface includes an image display area, and the image display area is used to display at least a partial image of the panel to be inspected; In response to an operation of a user drawing a basic frame for the electrodes of the panel to be detected in the image, determining a first detection frame, and adding the first detection frame to an existing detection frame set; In response to a user's instruction to add a detection frame, determining a second detection frame according to at least one detection frame in the existing detection frame set, and adding the second detection frame to the existing detection frame set; and A detection area is determined according to the detection frames in the existing detection frame set.

2. The method of claim 1, wherein: The user interface further includes a copy control and a paste control, and the instruction for adding a detection frame includes a copy instruction issued by a user using the copy control and a paste instruction issued by a user using the paste control; The determining, in response to the user's instruction to add a detection frame, the second detection frame according to at least one detection frame in the existing detection frame set comprises: In response to the copy instruction, copy at least one detection frame in the existing detection frame set; In response to the paste instruction, the copied detection frame is pasted to a desired position to generate the second detection frame.

3. The method of claim 2, wherein: In the case of copying multiple detection frames in the existing detection frame set, pasting the copied detection frames to a desired position to generate the second detection frame includes: Determine a distance between two adjacent detection frames in the copied detection frame as a first distance; The second detection frame is generated at the expected position, wherein the distance between the expected position and the last detection frame in the copied detection frames is the first distance.

4. The method according to any one of claims 1 to 3, wherein: The user interface also includes an add control, The determining of the first detection frame in response to the user's operation of drawing a basic frame for the electrodes of the panel to be detected in the image comprises: In response to an instruction of adding a detection frame issued by the user using the adding control, activating a corresponding image; In response to a user's dragging operation on the activated image using an input device, the first detection frame is generated.

5. The method according to any one of claims 1 to 3, wherein: The user interface also includes a selection control, and the method further includes: In response to an instruction issued by the user to select a detection box using the selection control, the detection box selected by the user is activated.

6. The method according to any one of claims 1 to 3, wherein: The method further comprises: In response to an adjustment operation by a user, at least one detection frame in the existing detection frame set is adjusted so that the adjusted detection frame coincides with a boundary of a corresponding electrode in the image.

7. The method of claim 6, wherein: The adjusting at least one detection frame in the existing detection frame set in response to the user's adjustment operation comprises: In response to a user's dragging operation on at least one detection frame in the existing detection frame set using an input device, the dragged detection frame is adjusted accordingly.

8. The method of claim 6, wherein: The user interface further includes an adjustment control, and the adjusting at least one detection frame in the existing detection frame set in response to the user's adjustment operation includes: In response to a user operation on the adjustment control, at least one detection frame in the existing detection frame set is adjusted.

9. The method of claim 8, wherein: The adjustment controls include isometric controls in specific directions. Adjusting at least one detection frame in the existing detection frame set in response to a user operation on the adjustment control comprises: In response to a user operation on the specific direction isometric control, determining a distance between opposite sides of a first detection box and a last detection box in a specific direction in the at least one detection box, wherein the specific direction is an arrangement direction of the at least one detection box; Calculate the sum of the lengths of other detection frames between the first detection frame and the last detection frame in the specific direction in the specific direction; Calculating a difference between the distance and the sum; Determining the number of detection frame intervals between the at least one detection frame; Calculating the quotient of the difference and the number of detection frame intervals; and The other detection frames are translated along the specific direction so that a distance between any two adjacent detection frames in the at least one detection frame in the specific direction is equal to the quotient.

10. The method of claim 8, wherein: The adjustment controls include end isometric controls, The adjusting at least one detection frame in the existing detection frame set in response to the user's operation on the adjustment control comprises: In response to a user operation on the end equidistant control, determining an angle between a first detection frame and a last detection frame in the at least one detection frame, wherein the first ends of the at least one detection frame are equidistant; Determining the number of detection frame intervals between the at least one detection frame; Calculating the quotient of the angle between the first detection frame and the last detection frame and the number of intervals between the detection frames; and For each detection frame among the other detection frames between the first detection frame and the last detection frame, the detection frame is rotated with the first end of the detection frame as the center of the circle so that the angle between any two adjacent detection frames in the at least one detection frame is equal to the quotient.

11. The method of claim 8, wherein: The adjustment control includes a step size setting control and a specific direction movement control. The adjusting at least one detection frame in the existing detection frame set in response to the user's operation on the adjustment control comprises: Receiving a step size set by a user using the step size setting control; In response to a user operation on the specific direction movement control, the at least one detection frame is translated toward the specific direction and with the step size.

12. A device for determining a detection area in an image of a panel to be detected, the device comprising: A display module, used for displaying a user interface, wherein the user interface includes an image display area, and the image display area is used for displaying at least a partial image of the panel to be inspected; A first detection frame determination module, configured to determine a first detection frame in response to an operation of a user drawing a basic frame for the electrodes of the panel to be detected in the image, and add the first detection frame to an existing detection frame set; A second detection frame determining module is used to determine a second detection frame according to at least one detection frame in the existing detection frame set in response to a user's instruction to add a detection frame, and also add the second detection frame to the existing detection frame set; as well as A detection area determination module is used to determine a detection area according to the detection frame in the existing detection frame set.

13. An electronic device comprising a display, a processor and a memory, wherein: The display is used to display the image of the panel to be inspected, and the memory stores computer program instructions, which are used by the processor to execute the method for determining the inspection area in the image of the panel to be inspected as described in any one of claims 1 to 11 when executed.

14. A storage medium having program instructions stored thereon, wherein the program instructions are used to execute the method for determining a detection area in an image of a panel to be detected according to any one of claims 1 to 11 when run.

Images