Touchscreen testing equipment, methods, systems, and computer storage media
By introducing a writing device and an imaging element into the touch screen testing equipment, combined with a rotating shaft and a control arithmetic unit, the writing and erasing process is completed automatically and the images are compared. This solves the problems of high cost and low efficiency of manual testing and achieves efficient evaluation of touch screen functional stability.
Patent Information
- Application Number
- CN202210192719.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-28
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2042-02-28
AI Technical Summary
Existing touchscreen testing methods rely on manual operation, resulting in high labor costs and low testing efficiency, and making it difficult to effectively determine the stability of writing and erasing functions.
A touch screen testing device was designed, including a touch screen, a writing device, a hinge, a support, and a control unit. The hinge controls the rotation of the pen of the writing device, and the device acquires and compares images using an imaging element to automatically complete the writing and erasing process, thereby achieving image similarity comparison to determine the test results.
It has achieved automated touchscreen testing, saving labor costs, improving testing efficiency, and accurately determining the stability of writing and erasing functions.
Smart Images

Figure CN116704527B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of testing technology, and in particular to a touch screen testing device, method, system, and computer storage medium. Background Technology
[0002] With the development of computer technology, computer input methods have evolved from paper tape input to keyboard input, then to mouse input, and finally to touch input. A touchscreen is an interactive input device that allows users to control the computer's operation simply by using their finger or a stylus to touch a specific area. Therefore, touchscreen technology is characterized by its simplicity and flexibility.
[0003] As a companion software to the touchscreen, the whiteboard application's writing and erasing functions are the most frequently used features. Accordingly, stress testing is necessary during software development to ensure the stability of these functions. Current testing methods involve manually writing and erasing within the whiteboard application interface, then visually assessing for any writing errors or inability to erase. Summary of the Invention
[0004] This application provides a touch screen testing device, method, system, and computer storage medium, which can avoid the manual testing methods in related technologies, thus saving labor costs and improving testing efficiency.
[0005] In a first aspect, embodiments of this application provide a touchscreen testing device, comprising: a touchscreen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touchscreen, and the bracket is connected to the writing device via the hinge; wherein...
[0006] The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel; wherein,
[0007] The at least one imaging element is used to capture a test baseline image of the touchscreen at the initial moment of the test;
[0008] The control unit is used to control the pen barrel of the writing device to rotate along a first preset direction and a first preset angle via the rotating shaft so that the writing end completes the writing process in the test.
[0009] The at least one imaging element is also used to acquire a first test image after the writing process is completed;
[0010] The control unit is also used to control the pen barrel of the writing device to rotate along a second preset direction and a second preset angle via the rotating shaft so that the erasing end completes the erasing process in the test.
[0011] The at least one imaging element is also used to acquire a second test image after the erasure process is completed;
[0012] The control arithmetic unit is also used to determine the comparison result between the test reference image and the first test image, and to determine the comparison result between the test reference image and the second test image.
[0013] Secondly, this application provides a touchscreen testing method, which is applied to a touchscreen testing device. The touchscreen testing device includes: a touchscreen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touchscreen and is connected to the writing device via the hinge.
[0014] The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel;
[0015] The touchscreen testing method includes:
[0016] The touchscreen is photographed using at least one imaging element to obtain a test benchmark image;
[0017] The control unit controls the pen barrel of the writing device to rotate along a first preset direction and a first preset angle via the rotating shaft so that the writing end completes the writing process in the test. After the writing process is completed, the first test image is acquired by the at least one imaging element.
[0018] The control arithmetic unit compares the similarity between the first test image and the test reference image. If the similarity between the first test image and the test reference image is less than a first threshold, the pen barrel is controlled by the rotating shaft to rotate along a second preset direction and a second preset angle so that the erasing end of the pen barrel completes the erasing process in the test.
[0019] After the erasure process is completed, a second test image is acquired through the at least one imaging element;
[0020] The control arithmetic unit compares the similarity between the second test image and the test reference image. If the similarity between the second test image and the test reference image is greater than a second threshold, the test is determined to be passed.
[0021] Thirdly, this application provides a touch screen testing device, which is applied to a touch screen testing equipment. The touch screen testing equipment includes: a touch screen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touch screen and is connected to the writing device through the hinge.
[0022] The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel;
[0023] The touchscreen testing device includes:
[0024] The first acquisition module is used to capture images of the touchscreen using the at least one imaging element to obtain a test benchmark image;
[0025] The second acquisition module is used to use the control arithmetic unit to control the pen barrel of the writing device to rotate along the first preset direction and the first preset angle through the rotating shaft so that the writing end completes the writing process in the test, and to acquire the first test image through the at least one imaging element after the writing process is completed.
[0026] The control module is used to compare the similarity between the first test image and the test reference image through the control arithmetic unit. If the similarity between the first test image and the test reference image is less than a first threshold, the control module controls the pen barrel to rotate along a second preset direction and a second preset angle through the rotating shaft so that the erasing end of the pen barrel completes the erasing process in the test.
[0027] The third acquisition module is used to acquire a second test image through the at least one imaging element after the erasure process is completed;
[0028] The determination module is used to compare the similarity between the second test image and the test reference image through the control arithmetic unit, and determine that the test passes if the similarity between the second test image and the test reference image is greater than a second threshold.
[0029] Fourthly, embodiments of this application provide a computer storage medium storing a plurality of instructions adapted for loading by a processor and executing the above-described method steps.
[0030] The beneficial effects of the technical solutions provided in some embodiments of this application include at least the following:
[0031] The touchscreen testing device in this embodiment includes: a touchscreen, a writing device, a hinge, a support, and a control unit. The support is located on one side of the touchscreen and is connected to the writing device via the hinge. The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element. The writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel. Therefore, this embodiment can control the automatic rotation of the pen barrel by setting the writing device connected to the hinge on the support, and use the imaging element to photograph the touchscreen traversed by the writing end and the erasing end of the pen barrel for image comparison, and then further determine the test results. This avoids the manual testing methods used in related technologies, saving labor costs and improving testing efficiency. Attached Figure Description
[0032] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0033] Figure 1 The touchscreen and stylus provided in the related technologies of the embodiments of this application;
[0034] Figure 2 This is an application diagram of a touch screen testing device provided in an embodiment of this application;
[0035] Figure 3 This application provides an embodiment of a touchscreen testing device during the acquisition of a test benchmark image, illustrating a possible operating scenario.
[0036] Figure 4A This application provides an embodiment of a scenario diagram illustrating the writing process of a touchscreen testing device.
[0037] Figure 4B This application provides an embodiment of a touchscreen testing device during the acquisition of a first test image, illustrating the operational scenario.
[0038] Figure 5A A diagram illustrating the operation scenario of the erasure process of another touchscreen testing device provided in this application embodiment;
[0039] Figure 5B An illustration of the operating scenario of another touchscreen testing device provided in this application embodiment when acquiring a second test image;
[0040] Figure 6 This is an application diagram of another touchscreen testing device provided in an embodiment of this application;
[0041] Figure 7 A flowchart illustrating a touchscreen testing method provided in an embodiment of this application;
[0042] Figure 8A An illustration of the operating scenario of another touchscreen testing device provided in this application embodiment when acquiring a first test image;
[0043] Figure 8B An illustration of the operating scenario of another touchscreen testing device provided in this application embodiment when acquiring a second test image;
[0044] Figure 9 A flowchart illustrating another touchscreen testing method provided in an embodiment of this application;
[0045] Figure 10 This is a schematic diagram of the structure of a touch screen testing device provided in an embodiment of this application;
[0046] Reference numerals: 00-Stylus, 01-Touchscreen, 1-Support, 2-Hinge, 31-Eraser end, 32-Image sensor, 33-Pen barrel, 34-Writing end, 35-First image sensor, 36-Second image sensor, 4-Touchscreen, 5-Hinge, 320-Test reference image, 321-First test image, 322-Second test image. Detailed Implementation
[0047] In the following description, when referring to the accompanying drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of systems and methods consistent with some aspects of this application as detailed in the appended claims.
[0048] In the description of this application, it should be understood that the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0049] Figure 1The illustrations exemplify a stylus 00 and a touchscreen 01 from related technologies. The touchscreen 01 is a sensor-type liquid crystal display device capable of receiving input signals such as those from touch. When a graphic button on the screen is touched, the haptic feedback system on the screen can drive various connected devices according to a pre-programmed program. It can replace mechanical button panels and create vivid audio-visual effects through the liquid crystal display screen. The stylus 00 is a pen-shaped tool used to input commands into devices with a touchscreen 01, such as computer screens, mobile devices, and drawing tablets. Users can use the stylus 00 to tap the touchscreen 01 to select documents or write or draw in the whiteboard application of the touchscreen 01.
[0050] Figure 2 An exemplary touchscreen testing device according to this application is shown. This touchscreen testing device may include: a support 1, a hinge 2, a writing device 3, a touchscreen 4, and a control processor (…). Figure 2 (Not shown in the image). The stand is located on the side of the touchscreen and can be connected to the writing device via a hinge.
[0051] Specifically, the writing device 2 in this embodiment may include: an erasing end 31, at least one imaging element 32, a pen barrel 33, and a writing end 34. The erasing end 31 and the writing end 34 are located at opposite ends of the pen barrel, and at least one imaging element 32 is located on the side of the pen barrel 33.
[0052] Specifically, in this embodiment, the imaging element 32 can be used to capture a test reference image of the touchscreen 4 at the initial moment of the test, i.e., a clean touchscreen image without any writing. The control arithmetic unit can be used to control the pen of the writing device 3 to rotate along a first preset direction and a first preset angle via the pivot 2 so that the writing end 34 completes the writing process during the test. The imaging element 32 can also be used to acquire a first test image after the writing process is completed, i.e., an image after the writing end 34 has passed over the touchscreen 4. The control arithmetic unit can also be used to control the pen 33 of the writing device 3 to rotate along a second preset direction and a second preset angle via the pivot 2 so that the erasing end 31 completes the erasing process during the test. The imaging element 32 can also be used to acquire a second test image after the erasing process is completed, i.e., an image after the erasing end 31 has passed over the touchscreen 4. The control arithmetic unit can also be used to determine the comparison result between the test reference image and the first test image, and to determine the comparison result between the test reference image and the second test image.
[0053] It is possible that the control unit in the embodiments of this application can be located in the pen 33 of the writing device 3, or in the touch screen 4, or in the bracket 1 or other electronic devices used to monitor the touch screen test equipment. No restrictions are made here.
[0054] Furthermore, the writing device 3 in this application embodiment may include a shooting element 32, with the first preset direction being opposite to the second preset direction and the first preset angle being equal to the second preset angle.
[0055] It is understood that the imaging element 32, such as a camera, in the embodiments of this application can be disposed on either side of the pen barrel 33. See also Figure 3 In the initial stage of the test in this embodiment, the pen 33 can be parallel to the touch screen 4 so that the camera can capture a test reference image 320 of the touch screen 4.
[0056] See Figure 4A In this embodiment of the application, the first preset angle can be a pre-set angle, for example, Figure 4A The writing end 34 shown can rotate 180 degrees clockwise. That is, the pen barrel drives the writing end 34 to rotate 180 degrees (a first preset angle) clockwise (a first preset direction). The first preset angle can also be any angle, meaning it only needs to satisfy the erasing end 31 to complete the erasing process. For example, if the pen barrel rotates 200 degrees (a first preset angle) clockwise (a first preset direction) and the erasing end 31 can successfully complete the erasing process, then the first preset angle is 200 degrees. See also... Figure 4B In this embodiment of the application, the first test image 321 can be acquired by the imaging element 32 when the writing end 34 is rotated 90 degrees clockwise.
[0057] Furthermore, since the second preset angle in this embodiment is the same as the first preset angle, the second preset angle can be a pre-set angle, for example, Figure 5A The writing end shown can rotate 180 degrees counterclockwise. Specifically, the pen barrel drives the writing end to rotate 180 degrees (second preset angle) counterclockwise (second preset direction) so that the writing end 34 returns to the position of contact with the touch screen 4. The second preset angle can also be any angle, that is, the erasing end 31 can complete the erasing process.
[0058] See Figure 5B In this embodiment of the application, a second test image 322 can be acquired by the imaging element 32 when the writing end 34 is rotated 90 degrees counterclockwise.
[0059] Possibly, the imaging element in this embodiment can take pictures of the touchscreen at any angle after the writing end has passed the touchscreen during the writing process, provided that an image within a preset range of the touchscreen is captured. For example, if the writing end rotates 15 degrees and separates from the touchscreen during writing, the imaging element can take pictures of the touchscreen at any angle between 16 and 180 degrees, as long as an image within the preset range of the touchscreen is present in the captured multiple images. Similarly, the imaging element can take pictures of the touchscreen at any angle after the erasing end has passed the touchscreen during the erasing process. The preset range refers to the range including the area where the writing end or the erasing end has passed the touchscreen.
[0060] Furthermore, the writing device in this application embodiment may include a first imaging element and a second imaging element respectively disposed on both sides of the pen barrel, the first preset direction and the second preset direction are the same, and the first preset angle and the second preset angle are both 180 degrees.
[0061] Possibly, embodiments of this application may use any imaging element to take a picture of the touchscreen in the initial stage of the test to obtain a test benchmark image.
[0062] See Figure 6 In the embodiment of this application, when the first preset direction and the second preset direction are counterclockwise, the first imaging element 35 can be used to take a picture of the touch screen swiped by the writing end 34 to obtain a first test image, and the second imaging element 36 can be used to take a picture of the touch screen swiped by the erasing end 31 to obtain a second test image.
[0063] It is understood that, in the embodiments of this application, when the first preset direction and the second preset direction are clockwise, the second imaging element can be used to take a picture of the touch screen swiped by the writing end to obtain the first test image, and the first imaging element can be used to take a picture of the touch screen swiped by the writing end to obtain the second test image.
[0064] Furthermore, the touchscreen testing device in this embodiment may also include a memory. The memory is used to store a test reference image, a first test image, a second test image, a comparison result between the test reference image and the first test image, and a comparison result between the test reference image and the second test image.
[0065] It is understood that the testing device in this application embodiment can compare the test reference image stored in the memory with the first test image and the second test image obtained by the test, so as to avoid repeatedly obtaining the test reference image.
[0066] Furthermore, the touchscreen testing device in this embodiment may also include a display. The display can be used to show the number of tests and / or the test results.
[0067] It is possible that the display in the embodiments of this application can be disposed on the surface of the pen barrel of the writing device, or on the surface of the bracket, or it can be disposed separately in an electronic device for displaying the number of tests and / or the test results. No limitation is made here.
[0068] In addition, a motor can be provided between the bracket and the rotating shaft in the embodiments of this application. The motor can run at a preset cycle or frequency to drive the rotating shaft to rotate, so that the pen barrel of the writing device rotates at a first preset angle along a first preset direction so that the writing end completes the writing process in the test.
[0069] The touchscreen testing device in the above embodiments of this application may include: a touchscreen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touchscreen and is connected to the writing device via the hinge; wherein the writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and at least one imaging element is located on the side of the pen barrel. Therefore, this application controls the automatic rotation of the pen barrel by setting a writing device connected to the hinge on the bracket, and uses the imaging element to photograph the touchscreen traversed by the writing end and the erasing end of the pen barrel for image comparison. This avoids the manual testing methods in related technologies, saving labor costs and improving testing efficiency.
[0070] Next, combine Figures 2-6 The schematic diagram of the touch screen testing equipment is used to illustrate the touch screen testing method provided in the embodiments of this application.
[0071] In one embodiment, Figure 7 The diagram shows a flowchart of a touchscreen testing method. Figure 7 The touchscreen testing method shown may include the following steps:
[0072] S701 captures a test benchmark image of the touchscreen using at least one imaging element.
[0073] Possibly, in this embodiment, the user can manually or use voice functionality to activate the whiteboard application on the touchscreen. Furthermore, a photographic element can be used to capture an image of the whiteboard on the touchscreen at the initial stage of the test to obtain a test baseline image. In this case, the obtained test baseline image is a clean whiteboard image without any writing.
[0074] S702, the control unit controls the pen barrel of the writing device to rotate along the first preset direction and the first preset angle through the rotating shaft so that the writing end completes the writing process in the test, and after the writing process is completed, the first test image is acquired through at least one imaging element.
[0075] Specifically, in this embodiment, the writing end is the end of the pen barrel with a smaller contact area with the touch screen, and the writing end can be used to bring up the writing pen in the whiteboard application.
[0076] It is understood that the writing process in the test of this application embodiment is to test whether the writing pen in the whiteboard program can be called up, and whether writing can be produced when it is called up.
[0077] The control unit in this embodiment may include a central processing unit (CPU). The CPU controls the rotation angle of the pen in the writing device via a hinge.
[0078] Possibly, the first preset direction in this embodiment can be clockwise or counterclockwise. The first preset angle needs to be preset according to the number of imaging elements. The writing process is the process of rotating the pen along the first preset direction by the first preset angle, and the first test image is used to represent the image generated by the whiteboard application after the writing end swipes across the touch screen.
[0079] S703 compares the similarity between the first test image and the test reference image by controlling the arithmetic unit.
[0080] Possibly, embodiments of this application may utilize a CPU to calculate the similarity between a first test image and a test reference image.
[0081] Possibly, the control unit in this embodiment may also be a microcontroller unit (MCU) or a graphics processing unit (GPU). The MCU or GPU can calculate the similarity between the first test image and the benchmark image using its associated image and graphics processing microprocessors. Specifically, this embodiment can determine the degree of similarity between two images based on the pixels of the first test image and the benchmark image.
[0082] S7031, if the similarity between the first test image and the test reference image is greater than or equal to the first threshold, the test is determined to be a failure, and the pen is stopped from rotating by controlling the arithmetic unit.
[0083] Understandably, if the similarity between the first test image and the test reference image exceeds a first threshold, it can be assumed that the writing end has not invoked the electronic pen within the whiteboard application on the touchscreen to generate handwriting. Therefore, the current test can be determined to have failed, and the MCU or CPU issues a stop command to control the pen to stop rotating.
[0084] S7032, when the similarity between the first test image and the test reference image is less than a first threshold, the pen barrel is rotated along the second preset direction by a second preset angle through the pivot to make the erasing end of the pen barrel complete the erasing process in the test.
[0085] The first threshold is used to represent a numerical value used to determine whether the first test image and the test reference image are similar. The erasing process is used to represent the process of rotating the pen barrel along a second preset direction by a second preset angle.
[0086] Possibly, when the writing device in the embodiments of this application includes a shooting element, the first preset direction is opposite to the second preset direction, and the first preset angle is equal to the second preset angle.
[0087] Understandably, when only one imaging element is installed on the pen barrel in the writing device, the first preset direction needs to be opposite to the second preset direction, the first preset angle needs to be equal to the second preset angle, and the first preset angle and the second preset angle need to be no less than 180 degrees, so that the writing process and erasing process can be completed in one test cycle.
[0088] Possibly, in the writing device of this application embodiment, when the first imaging element and the second imaging element are respectively disposed on both sides of the pen barrel, the first preset direction and the second preset direction are the same, and the first preset angle and the second preset angle are both 180 degrees.
[0089] Understandably, when a shooting element is installed on each side of the pen barrel in the writing device, the first preset direction needs to be the same as the second preset direction, and the first preset angle and the second preset angle are both 180 degrees, so that the writing process and the erasing process can be completed within 360 degrees in one test cycle.
[0090] S704, after the erasure process is completed, acquires a second test image through at least one imaging element.
[0091] The second test image is used to represent the image after the touchscreen is wiped off at the erasing end.
[0092] Specifically, in this embodiment, the erasing end is the end with a larger contact area between the pen and the touch screen. The erasing end can be used to bring up the whiteboard eraser in the whiteboard application to clear the pen marks generated by the writing end.
[0093] It is understood that the erasure process in the test of this application embodiment is to test whether the whiteboard eraser in the whiteboard program can be called up normally, and if it can be called up successfully, whether it can remove the writing marks.
[0094] S705 compares the similarity between the second test image and the test reference image by controlling the arithmetic unit.
[0095] Specifically, in this embodiment of the application, the second test image after the erasing process is completed is compared with a clean test reference image to determine whether the erasing end can normally bring up the whiteboard eraser in the whiteboard application on the touch screen.
[0096] Possibly, in this embodiment, the GPU controlling the arithmetic unit can calculate the similarity between the second test image and the benchmark image using its associated image and graphics processing microprocessor. Specifically, in this embodiment, the degree of similarity between the two images can be determined by the pixels of the second test image and the benchmark image.
[0097] S7051, if the similarity between the second test image and the test reference image is less than or equal to the second threshold, the test is determined to be a failure, and the pen is stopped from rotating by controlling the arithmetic unit.
[0098] Understandably, if the similarity between the second test image and the test reference image is less than or equal to the second threshold, it can be assumed that the eraser in the whiteboard application has not been invoked. Therefore, it can be determined that the current test has failed, and the MCU or CPU issues a stop command to control the pen to stop rotating.
[0099] S7052, if the similarity between the second test image and the test reference image is greater than the second threshold, the test is determined to be passed.
[0100] The second threshold is used to represent a numerical value used to determine whether the second test image is similar to the test reference image.
[0101] It is understood that when the similarity between the second test image and the test reference image in this application embodiment is greater than the second threshold, it can be considered that the whiteboard eraser in the whiteboard application is invoked and can cleanly erase the writing generated by the writing end.
[0102] In a specific example, a test baseline image can be obtained by capturing a picture of the touchscreen using either a first or a second imaging element. See also Figure 8A It can be achieved by using a control arithmetic unit to control the rotating shaft ( Figure 8A (Not shown) The pen barrel of the writing device is rotated 180 degrees clockwise to allow the writing end 34 to complete the writing process during the test. After the writing process is completed, the first test image 321 is acquired by the second imaging element 36. The similarity between the first test image 321 and the test reference image is calculated to be 80% by the control arithmetic unit. Since the similarity of 80% between the first test image 321 and the test reference image is less than the first threshold of 85%, therefore, see Figure 8BThe pen barrel is controlled by the pivot to continue rotating 180 degrees clockwise so that the erasing end 31 of the pen barrel completes the erasing process in the test; after the erasing process is completed, the second test image 322 is acquired by the first imaging element 35; the similarity between the second test image 322 and the test reference image is calculated by the control arithmetic unit to be 97%. Since the similarity between the second test image 322 and the test reference image is 97%, which is greater than the second threshold of 95%, it can be determined that the current test has passed.
[0103] This application uses at least one imaging element to capture images of the touchscreen to obtain a test reference image. A control unit controls the pen of the writing device to rotate along a first preset direction and a first preset angle via a pivot to complete the writing process during the test. After the writing process is completed, at least one imaging element captures a first test image. The control unit compares the similarity between the first test image and the test reference image. If the similarity is less than a first threshold, the pen is rotated along a second preset direction and a second preset angle via a pivot to complete the erasing process during the test. After the erasing process is completed, at least one imaging element captures a second test image. The control unit compares the similarity between the second test image and the test reference image. If the similarity is greater than a second threshold, the test is considered passed. Therefore, this application can capture and compare images of touchscreens without lines and touchscreens with lines by setting at least one imaging element in the touchscreen testing equipment. This solves the problem of relying on the human eye to determine whether lines cannot be drawn, lines are abnormal, or erasure is impossible in existing testing methods, effectively saving labor costs.
[0104] Figure 9 The diagram illustrates another touchscreen testing method. Figure 9 The touchscreen testing method shown may include the following steps:
[0105] S901 captures a test benchmark image of the touchscreen using at least one imaging element.
[0106] Specifically, S901 is the same as S701, which will not be repeated here.
[0107] S902, the control unit controls the pen barrel of the writing device to rotate along the first preset direction and the first preset angle through the rotating shaft so that the writing end completes the writing process in the test, and after the writing process is completed, the first test image is acquired through at least one imaging element.
[0108] Specifically, S902 is the same as S702, and will not be repeated here.
[0109] S903, by controlling the arithmetic unit, compares the similarity between the first test image and the test reference image.
[0110] Specifically, S903 is identical to S703, which will not be repeated here.
[0111] S9031, if the similarity between the first test image and the test reference image is greater than or equal to the first threshold, the test is determined to be a failure, and the pen is stopped from rotating by controlling the arithmetic unit.
[0112] Specifically, S9031 is the same as S7031, and will not be repeated here.
[0113] S9032, when the similarity between the first test image and the test reference image is less than a first threshold, the pen barrel is rotated along the second preset direction by a second preset angle through the pivot to make the erasing end of the pen barrel complete the erasing process in the test.
[0114] Specifically, S9032 is the same as S7032, and will not be repeated here.
[0115] S904, after the erasure process is completed, acquires a second test image through at least one imaging element.
[0116] Specifically, S904 is the same as S704, which will not be repeated here.
[0117] S905, by controlling the arithmetic unit, compares the similarity between the second test image and the test reference image.
[0118] Specifically, S905 is identical to S705, which will not be repeated here.
[0119] S9051, if the similarity between the second test image and the test reference image is less than or equal to the second threshold, the test is determined to be a failure, and the pen is stopped from rotating by controlling the arithmetic unit.
[0120] Specifically, S9051 is the same as S7051, and will not be repeated here.
[0121] S9052, if the similarity between the second test image and the test reference image is greater than the second threshold, the number of tests is increased by 1.
[0122] It is understood that the number of tests to be performed by the writing device can be preset in the embodiments of this application to test the stability of the whiteboard application.
[0123] Specifically, the number of tests is incremented by 1 for each completed test (writing process + erasing process).
[0124] S906, if the similarity between the second test image and the test reference image is greater than the second threshold, determine whether the number of times the similarity between the second test image and the test reference image is greater than the second threshold reaches N times.
[0125] Where N is the pre-set number of tests, and N is a positive integer greater than or equal to 2.
[0126] Understandably, if the number of times the similarity between the second test image and the test reference image is greater than the second threshold does not reach N, then step S902 is executed again: the pen barrel of the writing device is controlled by the control arithmetic unit to rotate along the first preset direction so that the writing end enters the writing process in the test. After the writing process is completed, the first test image is acquired by at least one imaging element until the number of times the similarity between the second test image and the test reference image is greater than the second threshold reaches N, then the test is determined to be passed.
[0127] For example, N=500, which can be understood as the writing device needing to undergo 500 tests. If the similarity between the second test image and the test reference image is 98%, and the current test count is 300. Since the similarity between the second test image and the test reference image is 98%, which is greater than the second threshold of 95%, it is necessary to further determine whether the number of times the similarity between the second test image and the test reference image is greater than the second threshold has reached 500. Since the current test count is 300+1=301<500, it is necessary to return to the step: using the control arithmetic unit to control the pen barrel of the writing device to rotate along the first preset direction via the rotating shaft to allow the writing end to enter the writing process during the test, and acquiring the first test image through at least one imaging element after the writing process is completed. If, when executed to the 450th time, the similarity between the second test image and the test reference image is 80%, which is less than the second threshold, then the test fails. Furthermore, the number of tests (450) and the test result "failure" can also be displayed on a display set on the surface of the pen barrel of the writing device.
[0128] Therefore, this application can determine the stability of the writing and erasing functions of the whiteboard application in the touch screen by pre-setting the number of tests in the control unit.
[0129] Figure 10This is a schematic diagram of the structure of a touchscreen testing apparatus provided in an exemplary embodiment of this application. The touchscreen testing apparatus is applied to a touchscreen testing device, which includes: a touchscreen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touchscreen and is connected to the writing device via the hinge; the writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel. Figure 10 As shown, the touchscreen testing device may include:
[0130] The first acquisition module 11 is used to capture images of the touch screen using the at least one imaging element to obtain a test benchmark image;
[0131] The second acquisition module 12 is used to use the control arithmetic unit to control the pen barrel of the writing device to rotate along the first preset direction and the first preset angle through the rotating shaft so that the writing end completes the writing process in the test, and to acquire the first test image through the at least one imaging element after the writing process is completed.
[0132] Control module 13 is used to compare the similarity between the first test image and the test reference image through the control arithmetic unit. If the similarity between the first test image and the test reference image is less than a first threshold, the control module 13 controls the pen barrel to rotate along a second preset direction and a second preset angle through the rotating shaft so that the erasing end of the pen barrel completes the erasing process in the test.
[0133] The third acquisition module 14 is used to acquire a second test image through the at least one imaging element after the erasure process is completed;
[0134] The determination module 15 is used to compare the similarity between the second test image and the test reference image through the control arithmetic unit, and determine that the test passes if the similarity between the second test image and the test reference image is greater than a second threshold.
[0135] This application uses at least one imaging element to capture images of the touchscreen to obtain a test reference image. A control unit controls the pen of the writing device to rotate along a first preset direction and a first preset angle via a pivot to complete the writing process during the test. After the writing process is completed, at least one imaging element captures a first test image. The control unit compares the similarity between the first test image and the test reference image. If the similarity is less than a first threshold, the pen is rotated along a second preset direction and a second preset angle via a pivot to complete the erasing process during the test. After the erasing process is completed, at least one imaging element captures a second test image. The control unit compares the similarity between the second test image and the test reference image. If the similarity is greater than a second threshold, the test is considered passed. Therefore, this application can capture and compare images of touchscreens without lines and touchscreens with lines by setting at least one imaging element in the touchscreen testing equipment. This solves the problem of relying on the human eye to determine whether lines cannot be drawn, lines are abnormal, or erasure is impossible in existing testing methods, effectively saving labor costs.
[0136] In some embodiments, the writing device includes a shooting element, the first preset direction being opposite to the second preset direction, and the first preset angle being equal to the second preset angle.
[0137] In some embodiments, the writing device includes a first imaging element and a second imaging element respectively disposed on both sides of the pen barrel, the first preset direction being the same as the second preset direction, and the first preset angle being 180 degrees and the second preset angle being 180 degrees.
[0138] In some embodiments, after the second acquisition module 12, the apparatus further includes:
[0139] The first determining module is used to compare the similarity between the first test image and the test reference image through the control arithmetic unit. If the similarity between the first test image and the test reference image is greater than or equal to a first threshold, the module determines that the test has failed and controls the pen to stop rotating through the control arithmetic unit.
[0140] In some embodiments, after the third acquisition module 14, the apparatus further includes:
[0141] The second determining module is used to compare the similarity between the second test image and the test reference image through the control arithmetic unit. If the similarity between the second test image and the test reference image is less than or equal to a second threshold, the test is determined to have failed, and the pen is controlled to stop rotating through the control arithmetic unit.
[0142] In some embodiments, the determining module 15 includes:
[0143] The judgment unit is used to determine whether the number of times the similarity between the second test image and the test reference image is greater than the second threshold reaches N times, where N is a positive integer greater than or equal to 2;
[0144] The determining unit is configured to, if the number of times the similarity between the second test image and the test reference image is greater than the second threshold does not reach N, then execute again the steps of using the control arithmetic unit to control the pen barrel of the writing device to rotate along the first preset direction to make the writing end enter the writing process in the test, and acquiring the first test image through the at least one imaging element after the writing process is completed, until the number of times the similarity between the second test image and the test reference image is greater than the second threshold reaches N, then determine that the test has passed.
[0145] It should be noted that the touchscreen testing system provided in the above embodiments is only illustrated by the division of the functional modules described above when executing the touchscreen testing method. In practical applications, the functions described above can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the touchscreen testing system and the touchscreen testing method embodiments provided in the above embodiments belong to the same concept, and the implementation process is detailed in the method embodiments, which will not be repeated here.
[0146] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0147] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer or processor, cause the computer or processor to perform the above-described instructions. Figure 7 and Figure 9 One or more steps in the illustrated embodiment. If the constituent modules of the above-described touchscreen testing device are implemented as software functional units and sold or used as independent products, they can be stored in the computer-readable storage medium.
[0148] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable system. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital versatile discs (DVDs)), or semiconductor media (e.g., solid-state drives (SSDs)).
[0149] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The aforementioned storage medium includes various media capable of storing program code, such as Read Only Memory (ROM), Random Access Memory (RAM), magnetic disks, or optical disks. Unless otherwise specified, the technical features of this embodiment and its implementation schemes can be combined arbitrarily.
[0150] The embodiments described above are merely preferred embodiments of this application and are not intended to limit the scope of this application. Any modifications and improvements made by those skilled in the art to the technical solutions of this application without departing from the spirit of this application should fall within the protection scope defined by the claims of this application.
Claims
1. A touchscreen testing device, characterized in that, include: Touch screen, writing device, hinge, stand, and control unit; The bracket is located on one side of the touchscreen, and the bracket is connected to the writing device via the hinge; wherein... The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are respectively located at both ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel; wherein, The at least one imaging element is used to capture a test reference image of the touchscreen at the initial moment of the test; the test reference image is a clean touchscreen image without any handwriting. The control unit is used to control the pen barrel of the writing device to rotate along a first preset direction and a first preset angle via the rotating shaft so that the writing end completes the writing process in the test. The at least one imaging element is also used to acquire a first test image after the writing process is completed; The control unit is also used to control the pen barrel of the writing device to rotate along a second preset direction and a second preset angle via the rotating shaft so that the erasing end completes the erasing process in the test. The at least one imaging element is also used to acquire a second test image after the erasure process is completed; The control arithmetic unit is also used to determine the comparison result between the test reference image and the first test image, and to determine the comparison result between the test reference image and the second test image; The control arithmetic unit is specifically used to: compare the similarity between the first test image and the test reference image based on the pixel ratio of the first test image and the pixel ratio of the test reference image; if the similarity between the first test image and the test reference image is less than a first threshold, control the pen barrel of the writing device to rotate along the second preset direction by the rotating shaft to rotate by the second preset angle so that the erasing end completes the erasing process in the test; and compare the similarity between the second test image and the test reference image based on the pixel ratio of the second test image and the pixel ratio of the test reference image; if the similarity between the second test image and the test reference image is greater than a second threshold, determine that the test has passed.
2. The device according to claim 1, characterized in that, The writing device includes a shooting element, the first preset direction is opposite to the second preset direction, and the first preset angle is equal to the second preset angle.
3. The device according to claim 1, characterized in that, The writing device includes a first shooting element and a second shooting element respectively disposed on both sides of the pen barrel, the first preset direction is the same as the second preset direction, and the first preset angle and the second preset angle are both 180 degrees.
4. The device according to claim 1, characterized in that, The touchscreen testing equipment also includes a memory; The memory is used to store the test reference image, the first test image, the second test image, the comparison result between the test reference image and the first test image, and the comparison result between the test reference image and the second test image.
5. The device according to claim 1, characterized in that, The touchscreen testing equipment also includes a display; The display is used to show the number of tests and / or the results of the tests.
6. A touchscreen testing method, characterized in that, The touchscreen testing method is applied to a touchscreen testing device, which includes: a touchscreen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touchscreen and is connected to the writing device via the hinge. The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel; The touchscreen testing method includes: The touchscreen is photographed using at least one imaging element to obtain a test baseline image; the test baseline image is a clean touchscreen image free of any handwriting. The control unit controls the pen barrel of the writing device to rotate along a first preset direction and a first preset angle via the rotating shaft so that the writing end completes the writing process in the test. After the writing process is completed, the first test image is acquired by the at least one imaging element. The control arithmetic unit compares the similarity between the first test image and the test reference image based on the pixels of the first test image and the pixels of the test reference image. If the similarity between the first test image and the test reference image is less than a first threshold, the pen barrel is controlled by the rotating shaft to rotate along a second preset direction and a second preset angle so that the erasing end of the pen barrel completes the erasing process in the test. After the erasure process is completed, a second test image is acquired through the at least one imaging element; The control arithmetic unit compares the similarity between the second test image and the test reference image based on the pixel values of the second test image and the pixel values of the test reference image. If the similarity between the second test image and the test reference image is greater than a second threshold, the test is determined to be passed.
7. The method according to claim 6, characterized in that, The writing device includes a shooting element, the first preset direction is opposite to the second preset direction, and the first preset angle is equal to the second preset angle.
8. The method according to claim 6, characterized in that, The writing device includes a first shooting element and a second shooting element respectively disposed on both sides of the pen barrel, the first preset direction is the same as the second preset direction, and the first preset angle and the second preset angle are both 180 degrees.
9. The method according to claim 6, characterized in that, After the writing process is completed and a first test image is acquired through the at least one imaging element, the method further includes: The control calculator compares the similarity between the first test image and the test reference image. If the similarity between the first test image and the test reference image is greater than or equal to a first threshold, the test is determined to be a failure, and the control calculator controls the pen to stop rotating.
10. The method according to claim 6, characterized in that, After the erasure process is completed and a second test image is acquired through the at least one imaging element, the method further includes: The control calculator compares the similarity between the second test image and the test reference image. If the similarity between the second test image and the test reference image is less than or equal to a second threshold, the test is determined to have failed, and the control calculator controls the pen to stop rotating.
11. The method according to claim 6, characterized in that, The step of determining that the test passes when the similarity between the second test image and the test reference image is greater than a second threshold includes: If the similarity between the second test image and the test reference image is greater than the second threshold, determine whether the number of times the similarity between the second test image and the test reference image is greater than the second threshold reaches N times; N is a positive integer greater than or equal to 2. If the number of times the similarity between the second test image and the test reference image is greater than the second threshold does not reach N, then the steps of using the control arithmetic unit to control the pen barrel of the writing device to rotate along the first preset direction through the rotating shaft to make the writing end enter the writing process in the test, and acquiring the first test image through the at least one imaging element after the writing process is completed are executed again until the number of times the similarity between the second test image and the test reference image is greater than the second threshold reaches N, then the test is determined to be passed.
12. A touchscreen testing device, characterized in that, The touchscreen testing device is applied to a touchscreen testing equipment, which includes: a touchscreen, a writing device, a hinge, a bracket, and a control unit; the bracket is located on one side of the touchscreen and is connected to the writing device via the hinge. The writing device includes: a pen barrel, a writing end, an erasing end, and at least one imaging element; wherein the writing end and the erasing end are located at opposite ends of the pen barrel, and the at least one imaging element is located on the side of the pen barrel; The touchscreen testing device includes: The first acquisition module is used to capture a test reference image of the touch screen using the at least one imaging element; the test reference image is a clean touch screen image without any handwriting. The second acquisition module is used to use the control arithmetic unit to control the pen barrel of the writing device to rotate along the first preset direction and the first preset angle through the rotating shaft so that the writing end completes the writing process in the test, and to acquire the first test image through the at least one imaging element after the writing process is completed. The control module is used to compare the similarity between the first test image and the test reference image based on the pixel of the first test image and the pixel of the test reference image through the control arithmetic unit. If the similarity between the first test image and the test reference image is less than a first threshold, the control module controls the pen barrel to rotate along a second preset direction and a second preset angle through the rotating shaft so that the erasing end of the pen barrel completes the erasing process in the test. The third acquisition module is used to acquire a second test image through the at least one imaging element after the erasure process is completed; The determination module is used to compare the similarity between the second test image and the test reference image based on the pixel comparison of the second test image and the pixel comparison of the test reference image by the control arithmetic unit, and determine that the test passes if the similarity between the second test image and the test reference image is greater than a second threshold.
13. A computer storage medium, characterized in that, The computer storage medium stores a plurality of instructions adapted for loading by a processor and executing the method steps as claimed in any one of claims 6-11.
Citation Information
Patent Citations
Pen pressure adjusting device
CN103425294A
Blurred screen detection method, blurred screen detection apparatus and electronic device
CN107909569A
Chinese character writing test method and system of writing device and writing device
CN111949156A
