Automatic detection method, device and system for interactive screen material downloading

Abstract

The invention provides an automatic detection method, device and system for interactive screen material downloading, and the method comprises the steps: controlling development software to start so as to download materials of an interactive screen, and obtaining an animation playing signal after all the materials are downloaded; according to the animation playing signal, controlling an interactive screen to perform animation playing according to materials, and obtaining an image displayed by the interactive screen in real time; preprocessing each image to obtain a processed image; performing similarity comparison on each processed image and a corresponding material to obtain an image similarity mean value; and determining a detection result of interactive screen material downloading according to the image similarity mean value. According to the method, the development software downloads the materials required by the interaction screen and then controls the interaction screen to play the materials to capture the image, and the image is processed to obtain the image similarity mean value for judging the interaction screen material downloading detection result, so that the detection accuracy is improved, and automatic detection is realized; the problems that an existing interactive screen material downloading accuracy and integrity detection mode is incomplete and low in efficiency are solved.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of electronic device detection, and particularly relates to an interactive screen material download automatic detection method, device and system. BACKGROUND

[0002] In the application of interactive screens, it is crucial to ensure the accuracy and completeness of material downloads. Traditional detection methods rely heavily on manual inspection and simple automated tools, making it difficult to comprehensively detect various abnormalities during the download process. Therefore, a more intelligent and comprehensive detection device is needed to improve detection efficiency and accuracy. SUMMARY

[0003] One embodiment of the present application provides an interactive screen material download automatic detection method, device and system to solve the problem of incomplete and low efficiency in the existing detection method of the accuracy and completeness of interactive screen material downloads.

[0004] In a first aspect, one embodiment of the present application provides an interactive screen material download automatic detection method, including the following steps:

[0005] Controlling the development software to start downloading the materials of the interactive screen, and obtaining the animation playback signals after all the material downloads are completed;

[0006] Controlling the interactive screen to play animations according to the materials based on the animation playback signals, and obtaining images displayed by the interactive screen in real time;

[0007] Preprocessing each image to obtain a processed image, and comparing each processed image with the corresponding material to obtain an image similarity average value;

[0008] Determining the detection result of the interactive screen material download based on the image similarity average value.

[0009] Optionally, before controlling the development software to start downloading the materials of the interactive screen, the automatic detection method further includes starting an image capturing element for capturing images of the interactive screen.

[0010] Optionally, preprocessing each image to obtain a processed image includes using one or more of cropping, grayscale, image binarization, and noise filtering to process each image to obtain a processed image.

[0011] Optionally, comparing each processed image with the corresponding material to obtain an image similarity average value includes comparing each processed image with the corresponding material to obtain a comparison value, and determining an image similarity average value based on all comparison values.

[0012] Optionally, determining the detection result of interactive screen material download based on the mean image similarity includes: comparing the mean image similarity with a set threshold to obtain a detection result of abnormal or normal interactive screen material download.

[0013] Secondly, one embodiment of this application provides an automated detection device for downloading interactive screen materials, comprising: a linkage control unit and an image processing unit connected to the linkage control unit, wherein the image processing unit is also connected to an image capture unit;

[0014] The linkage control unit is used to control the development software to start downloading materials for the interactive screen and to obtain the animation playback signal after all the materials have been downloaded.

[0015] The image capture unit is used to control the interactive screen to play the animation according to the material based on the animation playback signal, and to acquire the image displayed on the interactive screen in real time.

[0016] The image processing unit is used to preprocess each image to obtain a processed image; and to perform a similarity comparison between each processed image and the corresponding source material to obtain an average image similarity value.

[0017] The linkage control unit is also used to determine the detection result of the interactive screen material download based on the average image similarity.

[0018] Optionally, the automated detection device for downloading interactive screen materials also includes a display unit connected to the linkage control unit, the display unit being used to display the detection results.

[0019] Optionally, the linkage control unit and the image processing unit transmit data through a data communication unit, and the linkage control unit and the display unit also transmit data through the data communication unit.

[0020] Optionally, the automated detection device for downloading interactive screen materials also includes a report generation unit connected to the linkage control unit, which is used to generate a detection report based on the detection results.

[0021] Secondly, one embodiment of this application provides an automated detection system for interactive screen material download, including a controller, an interactive screen and a host computer connected to the controller, wherein the controller controls the interactive screen to perform automated detection of material download according to the automated detection method for interactive screen material download described above.

[0022] One embodiment of this application provides an automated detection method, apparatus, and system for interactive screen material downloads. The automated detection method includes controlling development software to start downloading interactive screen materials, acquiring animation playback signals after all materials have been downloaded, controlling the interactive screen to play animations according to the materials based on the animation playback signals, and acquiring images displayed on the interactive screen in real time; preprocessing each image to obtain processed images; performing similarity comparisons between each processed image and its corresponding material to obtain an average image similarity value; and determining the detection result of the interactive screen material download based on the average image similarity value. This automated detection method for interactive screen material downloads improves detection accuracy and achieves automated detection by capturing images when the interactive screen plays the materials after downloading them, processing the images to obtain the average image similarity value used to determine the detection result of the interactive screen material download, thus solving the problems of incompleteness and low efficiency in existing methods for detecting the accuracy and completeness of interactive screen material downloads.

[0023] The automated detection device for downloading interactive screen materials achieves full automation of the detection process and significantly improves detection efficiency by linking the development software with the image processing technology through the linkage control unit, image processing unit, and image capture unit.

[0024] The automated inspection system for downloading interactive screen materials is flexibly designed, easy to integrate with other inspection systems, and can be expanded in function according to specific needs, thus enhancing the adaptability and scalability of the automated inspection system for downloading interactive screen materials. Attached Figure Description

[0025] To more clearly illustrate the technical solution in one embodiment of this application, the accompanying drawings used in the description of the embodiment will be briefly introduced below. Obviously, the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0026] To gain a more complete understanding of this application and its beneficial effects, the following description will be provided in conjunction with the accompanying drawings. In the following description, the same reference numerals denote the same parts.

[0027] Figure 1 A flowchart illustrating the steps of an automated detection method for downloading interactive screen materials, provided as an embodiment of this application.

[0028] Figure 2 A flowchart outlining the framework of an automated detection method for downloading interactive screen materials, provided as an embodiment of this application.

[0029] Figure 3A schematic diagram of the framework of an automated detection device for downloading interactive screen materials provided in one embodiment of this application.

[0030] Figure 4 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials, provided for another embodiment of this application.

[0031] Figure 5 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials, provided as another embodiment of this application.

[0032] Figure 6 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials, provided as another embodiment of this application.

[0033] Figure 7 This is a schematic diagram of an automated detection system for downloading interactive screen materials, provided as an embodiment of this application.

[0034] Figure 8 This is a schematic diagram of the host computer interface in an automated detection system for downloading interactive screen materials, provided as an embodiment of this application. Detailed Implementation

[0035] The technical solution of one embodiment of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0036] One embodiment of this application provides an automated detection method, apparatus, and system for interactive screen material downloads, to solve the problems of incompleteness and low efficiency in existing methods for detecting the accuracy and completeness of interactive screen material downloads.

[0037] Example 1:

[0038] One embodiment of this application provides an automated detection method for downloading interactive screen materials. For an example, please refer to [link to example]. Figure 1 , Figure 1 A flowchart illustrating the steps of an automated detection method for downloading interactive screen materials, provided as an embodiment of this application. Figure 2 A flowchart outlining the framework of an automated detection method for downloading interactive screen materials, provided as an embodiment of this application.

[0039] like Figure 1 and Figure 2 As shown, this application invention provides an automated detection method for downloading interactive screen materials, including the following steps:

[0040] S100. Control the development software to start downloading materials for the interactive screen, and obtain the animation playback signal after all materials have been downloaded;

[0041] S200. Control the interactive screen to play animations according to the materials based on the animation playback signal, and acquire the images displayed on the interactive screen in real time;

[0042] S300. Preprocess each image to obtain a processed image; perform a similarity comparison between each processed image and the corresponding source material to obtain the average image similarity value;

[0043] S400. Determine the detection result of the downloaded interactive screen material based on the mean of image similarity.

[0044] To further explain, in step S100, the development software is first controlled to start downloading the materials required for the interactive screen. Once all the materials are downloaded, the development software sends an animation playback signal, providing a control signal for image capture in the subsequent step S200. In step S200, the interactive screen is controlled to play animations according to the materials based on the animation playback signal output in step S100, acquiring the image displayed on the interactive screen corresponding to each material in real time, providing data for the subsequent step S300. In step S300, each image captured in step S200 is processed to obtain the average image similarity, providing the judgment basis for the detection result in the subsequent step S400. In step S400, the detection result of the interactive screen material download is obtained based on the average image similarity obtained in step S300. The development software can be Canoe software, and in step S100, a Python script controls Canoe software to automatically download the materials.

[0045] Furthermore, the automated detection method for interactive screen material download, through the image processing technology in step S300, can accurately identify visual anomalies during the download process, thus improving detection accuracy. This automated detection method for interactive screen material download achieves full automation of the detection process by combining software development with image processing technology, significantly improving detection efficiency.

[0046] An embodiment of this application provides an automated detection method for interactive screen material downloads, including controlling the development software to start downloading interactive screen materials, acquiring animation playback signals after all materials have been downloaded; controlling the interactive screen to play animations according to the materials based on the animation playback signals, and acquiring images displayed on the interactive screen in real time; preprocessing each image to obtain processed images; performing similarity comparisons between each processed image and its corresponding material to obtain an average image similarity value; and determining the detection result of the interactive screen material download based on the average image similarity value. This automated detection method for interactive screen material downloads captures images by the development software after downloading the required materials and then controlling the interactive screen to play the materials, and processes the images to obtain the average image similarity value for judging the detection result of the interactive screen material download. This improves detection accuracy and achieves automated detection, solving the problems of incompleteness and low efficiency in existing methods for detecting the accuracy and completeness of interactive screen material downloads.

[0047] like Figure 2 As shown, in the embodiment of the invention, before controlling the development software to start and download the materials of the interactive screen, the automated detection method further includes: activating an image capture element for capturing images of the interactive screen.

[0048] To further explain, the image capture element can be selected as a high-definition camera, which captures images displayed on the interactive screen in real time.

[0049] like Figure 2 As shown, in the embodiments of the invention, preprocessing each image to obtain a processed image includes: cropping, grayscale conversion, image binarization, and noise filtering of each image in sequence to obtain a processed image.

[0050] To further explain, the images of interactive screen playback materials captured in real time by the camera are cropped to obtain a cropped image; then the cropped image is converted into a grayscale image to obtain a grayscale image; the grayscale image is then converted into a binary image, typically used for subsequent edge detection or shape recognition; Gaussian blur and median filtering are applied to the binary image to reduce image noise, resulting in a processed image with key detection features. In this embodiment, the OpenCV library is used to preprocess the captured image, including image cropping, grayscale conversion, and noise filtering, to extract key detection features.

[0051] like Figure 2 As shown, in the embodiments of the invention, the process of obtaining the average image similarity value by comparing each processed image with the corresponding material includes: comparing each processed image with the material to obtain a comparison value; and determining the average image similarity value based on all comparison values.

[0052] Furthermore, in the process of obtaining comparison values ​​by comparing each processed image with the corresponding source material, methods such as pixel comparison (e.g., mean squared error, MSE), hash value comparison (e.g., mean hash), or feature extraction (e.g., SIFT or deep learning features) can be used to obtain similarity comparison values. The average of all comparison values ​​is then calculated to obtain the image similarity mean. In this embodiment, pixel comparison involves comparing the RGB values ​​of two images (e.g., the processed image and the corresponding source material) pixel by pixel, calculating the average difference of all RGB values ​​to obtain the comparison value. Hash value comparison involves scaling the image to an 8×8 grayscale image, calculating the average grayscale value of each pixel to generate a hash value, and comparing the similarity (count) of the hash values ​​to obtain the similarity as the comparison value. Feature extraction involves extracting feature vectors such as edges and textures from the image, calculating cosine distance or Euclidean distance to measure the similarity as the comparison value.

[0053] like Figure 2 As shown, in the embodiments of the invention, determining the detection result of interactive screen material download based on the average image similarity includes: comparing the average image similarity with a set threshold to obtain a detection result of abnormal or normal interactive screen material download.

[0054] Furthermore, the threshold value can be set according to requirements and is not specifically limited here. When the average image similarity exceeds the set threshold, the detection result is that the interactive screen material download is abnormal; when the average image similarity does not exceed the set threshold, the detection result is that the interactive screen material download is normal. In this embodiment, the automated detection method for interactive screen material download has functions for detecting completeness and accuracy. Detection of completeness refers to whether there are any missing elements after the downloaded image material is stored in the controller of the interactive screen and the display unit of the interactive screen plays back the downloaded material data, compared with the original image of the downloaded material in the controller of the interactive screen. For example, if a certain area that should be lit is not lit, this is a failure to meet the completeness standard, indicating that the detection result is that the interactive screen material download is abnormal. Accuracy refers to whether the displayed result of the material image is correct in color, grayscale value, and display area compared with the downloaded and stored material content. The process of detecting accuracy actually also includes the detection of completeness. Specifically, this is completed in the process of comparing image similarity.

[0055] In the embodiments of the invention, the automated detection method for downloading interactive screen materials can be described as follows: Before downloading, taking MP4 video format as an example, using the pixels of the display unit of the interactive screen as a template, the grayscale values ​​of each pixel coordinate on the video are extracted to generate a CAN bus-transmittable data file (such as a bin file). During the comparison process, the image capture element (such as a camera) captures the image of the display unit in real time at the same frame rate as the original video. Similarly, the grayscale values ​​of each coordinate point are obtained to generate a bin file of one frame image. Then, the bin data of the two images are compared to obtain pixel information through image similarity comparison. If the average image similarity exceeds a set threshold, the frame image is considered to be the same as the original video, and the detection result is normal (completeness OK, accuracy OK). If the average image similarity does not exceed the average image similarity, the frame image is considered to be different from the original video, and the detection result is abnormal. The abnormal image and data (such as sampling time, original image and captured image, similarity, etc.) are recorded. The automated detection method for downloading interactive screen materials also includes: clustering algorithms to determine the type of anomaly in abnormal images; this part can be manually verified in practice to avoid misjudgment. Finally, the above operations are repeated until all frames in a video have been detected.

[0056] Example 2:

[0057] Figure 3 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials provided in one embodiment of this application.

[0058] like Figure 3 As shown, the present invention also provides an automated detection device for downloading interactive screen materials, comprising: a linkage control unit 100 and an image processing unit 200 connected to the linkage control unit 100, the image processing unit 200 being connected to an image capture unit 300.

[0059] In the embodiments of the invention, the linkage control unit 100 is used to control the development software to start downloading materials for the interactive screen and to acquire the animation playback signal after all materials have been downloaded. The image capture unit 300 is used to control the interactive screen to play animations according to the materials based on the animation playback signal and to acquire the images displayed on the interactive screen in real time. The image processing unit 200 is used to preprocess each image to obtain a processed image; and to perform a similarity comparison between each processed image and the corresponding material to obtain the average image similarity value. The linkage control unit 100 is also used to determine the detection result of the interactive screen material download based on the average image similarity value.

[0060] To further explain, the linkage control unit 100 first controls the development software to start downloading the materials required for the interactive screen. Once all the materials are downloaded, the development software sends an animation playback signal. The image capture unit 300 controls the interactive screen to play animations according to the materials based on the animation playback signal output by the linkage control unit 100, acquiring the image displayed on the interactive screen corresponding to each material in real time. The image processing unit 200 processes each image captured by the image capture unit 300 to obtain the average image similarity. The linkage control unit 100 also uses the average image similarity obtained by the image processing unit 200 to determine the detection result of the interactive screen material download. The development software can be Canoe software. The linkage control unit 100 controls the Canoe software to start and automatically download the materials via a Python script, and compares and analyzes the downloaded materials with those from the image processing unit 200. In this embodiment, the automated detection device for interactive screen material download achieves full automation of the detection process by linking the development software and image processing technology through the linkage control unit 100, image processing unit 200, and image capture unit 300, significantly improving detection efficiency.

[0061] In the embodiments of the invention, the image capture unit 300 can use cameras of different specifications to adapt to various detection environments; the algorithm of the image processing unit 200 can be optimized and adjusted according to specific detection requirements; and the control script of the linkage control unit 100 can be customized to adapt to different types of material download and detection requirements.

[0062] In the embodiments of the invention, the image processing unit 200 is further configured to crop the image of the interactive screen playback material captured in real time to obtain a cropped image; then convert the cropped image into a grayscale image to obtain a grayscale image; then convert the grayscale image into a binary image, typically used for subsequent edge detection or shape recognition; and perform Gaussian blur and median filtering on the binary image to reduce image noise, resulting in a processed image with key detection features. In this embodiment, the captured image is preprocessed using the OpenCV library, including image cropping, grayscale conversion, and noise filtering, to extract key detection features.

[0063] In the embodiments of the invention, the image processing unit 200 further obtains comparison values ​​by comparing each processed image with the corresponding source material using methods such as pixel comparison (e.g., mean squared error), hash value comparison (e.g., mean hash), or feature extraction (e.g., SIFT or deep learning features). The average of all comparison values ​​is then calculated to obtain the average image similarity value. In this embodiment, pixel comparison compares the RGB values ​​of two images (e.g., the processed image and the corresponding source material) pixel by pixel, calculating the average difference of all RGB values ​​to obtain the comparison value. Hash value comparison involves scaling the image to an 8×8 grayscale image, calculating the average grayscale value of each pixel to generate a hash value, and comparing the similarity (count) of the hash values ​​to obtain the similarity value. Feature extraction involves extracting feature vectors such as edges and textures from the image, calculating cosine distance or Euclidean distance to measure the similarity value.

[0064] In the embodiments of the invention, the linkage control unit 100 compares the average value of image similarity with a set threshold to obtain a detection result of whether the interactive screen material download is abnormal or normal.

[0065] To further clarify, the threshold value can be set according to needs, and no specific limitation is made here. When the average image similarity exceeds the set threshold, the detection result is that the interactive screen material download is abnormal; when the average image similarity does not exceed the set threshold, the detection result is that the interactive screen material download is normal.

[0066] Figure 4 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials, provided for another embodiment of this application.

[0067] like Figure 4 As shown in the embodiment of the invention, the automated detection device for downloading interactive screen materials further includes a display unit 400 connected to the linkage control unit 100, which is used to display the detection results.

[0068] Furthermore, the display unit 400 can be selected as the display screen of the host computer. The display unit 400 can not only display the specific detection results under normal and abnormal conditions, but also display the detection process in real time.

[0069] Figure 5 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials, provided as another embodiment of this application.

[0070] like Figure 5As shown, in the embodiment of the invention, the linkage control unit 100 and the image processing unit 200 transmit data through the data communication unit 500, and the linkage control unit 100 and the display unit 400 also transmit data through the data communication unit 500.

[0071] Furthermore, the data communication unit 500 can realize data transmission between the image processing unit 200 and the display unit 400, as well as data transmission with the communication interface of the linkage control unit 100 (such as Canoe software).

[0072] Figure 6 A schematic diagram of the framework of an automated detection device for downloading interactive screen materials, provided as another embodiment of this application.

[0073] like Figure 6 As shown in the embodiment of the invention, the automated detection device for downloading interactive screen materials further includes a report generation unit 600 connected to the linkage control unit 100. The report generation unit 600 is used to generate a detection report based on the detection results.

[0074] Furthermore, the report generation unit 600 automatically generates detailed test reports based on the test results, recording the specific data and analysis results for each test.

[0075] Example 3:

[0076] Figure 7 This is a schematic diagram of an automated detection system for downloading interactive screen materials, provided as an embodiment of this application. Figure 8 This is a schematic diagram of the host computer interface in an automated detection system for downloading interactive screen materials, provided as an embodiment of this application.

[0077] like Figure 7 As shown, the present invention also provides an automated detection system for interactive screen material download, including a controller and an interactive screen and a host computer connected to the controller. The controller controls the interactive screen to perform automatic detection of material download according to the above-described automated detection method for interactive screen material download.

[0078] Furthermore, the content of the automated detection method for downloading interactive screen materials is described in Embodiment 1. The automated detection system for downloading interactive screen materials is flexibly designed, easy to integrate with other detection systems, and can be expanded in function according to specific needs, thereby enhancing the adaptability and scalability of the automated detection system for downloading interactive screen materials.

[0079] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more features.

[0080] The above provides a detailed description of an automated detection method for downloading interactive screen materials according to an embodiment of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An automated detection method for downloading interactive screen materials, characterized in that, Includes the following steps: The development software is controlled to start and download the materials for the interactive screen, and the animation playback signal is obtained after all the materials have been downloaded; The interactive screen is controlled to play the animation according to the material based on the animation playback signal, and the image displayed on the interactive screen is acquired in real time. Each image is preprocessed to obtain a processed image; the processed image is then compared with the corresponding source material to obtain the average image similarity value. The detection result of the interactive screen material download is determined based on the mean similarity of the images.

2. The automated detection method for downloading interactive screen materials according to claim 1, characterized in that, Before the development software is launched to download materials for the interactive screen, the automated detection method further includes: activating an image capture element for capturing images of the interactive screen.

3. The automated detection method for downloading interactive screen materials according to claim 1, characterized in that, Preprocessing each image to obtain a processed image includes performing one or more of the following on each image: cropping, grayscale conversion, image binarization, and noise filtering.

4. The automated detection method for downloading interactive screen materials according to any one of claims 1-3, characterized in that, The process of comparing each processed image with the corresponding source material to obtain the image similarity mean includes: comparing each processed image with the corresponding source material to obtain a comparison value; and determining the image similarity mean based on all the comparison values.

5. The automated detection method for downloading interactive screen materials according to any one of claims 1-3, characterized in that, The detection result of interactive screen material download is determined based on the mean image similarity value, which includes comparing the mean image similarity value with a set threshold to obtain the detection result of abnormal or normal interactive screen material download.

6. An automated detection device for downloading interactive screen materials, characterized in that, include: The linkage control unit and the image processing unit connected to the linkage control unit, wherein the image processing unit is also connected to the image capture unit; The linkage control unit is used to control the development software to start downloading materials for the interactive screen and to obtain the animation playback signal after all the materials have been downloaded. The image capture unit is used to control the interactive screen to play the animation according to the material based on the animation playback signal, and to acquire the image displayed on the interactive screen in real time. The image processing unit is used to preprocess each image to obtain a processed image; and to perform a similarity comparison between each processed image and the corresponding source material to obtain an average image similarity value. The linkage control unit is also used to determine the detection result of the interactive screen material download based on the average image similarity.

7. The automated detection device for downloading interactive screen materials according to claim 6, characterized in that, It also includes a display unit connected to the linkage control unit, the display unit being used to display the detection results.

8. The automated detection device for downloading interactive screen materials according to claim 7, characterized in that, The linkage control unit and the image processing unit transmit data through a data communication unit, and the linkage control unit and the display unit also transmit data through the data communication unit.

9. The automated detection device for downloading interactive screen materials according to claim 6, characterized in that, It also includes a report generation unit connected to the linkage control unit, which is used to generate a test report based on the test results.

10. An automated detection system for downloading interactive screen materials, characterized in that, The system includes a controller, an interactive screen connected to the controller, and a host computer. The controller controls the interactive screen to automatically detect the download of materials according to the automated detection method for material download of the interactive screen as described in any one of claims 1-5.

Images