Automatic detection method, device and system for display device
By using object detection models and image acquisition equipment in school classrooms, the status of the display equipment is automatically detected, which solves the problem of low manual inspection efficiency, and achieves fast and accurate equipment detection and reduces costs.
Patent Information
- Application Number
- CN202110199652.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-02-22
- Publication Date
- 2025-03-18
- Estimated Expiration
- 2041-02-22
AI Technical Summary
In the prior art, the multimedia display equipment inspection in school classrooms relies on manual inspection, resulting in low detection efficiency and inability to detect problems in a timely manner, which affects the teaching progress.
The specified image is sent to the display device through the server device, the image acquisition device is used to collect the video stream, and the number of specified images in the image detection screen is detected through the object detection model, and the number of actual devices is compared to the detection result to achieve automatic detection.
It improves detection efficiency, can detect abnormalities in display equipment in a timely manner, reduces dependence on manual inspection, reduces detection costs, and improves detection accuracy.
Smart Images

Figure CN113012106B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of display screen detection technology, and in particular to an automatic detection method, device and system for a display device. Background Art
[0002] Nowadays, each classroom in schools has more and more multimedia display devices, including large screens, projectors, smart blackboards, etc. In order to ensure that the display equipment in each classroom can operate normally, each school is equipped with a dedicated operation and maintenance teacher. The current solution is to rely on manual inspections of each classroom on a monthly or weekly basis, but this purely manpower-based solution has the following disadvantages: (1) There are many classrooms and many devices in each classroom, and it will take a lot of time to check all of them; (2) Each inspection is generally conducted one month or even one semester apart. The long interval makes it impossible to detect problems in time. Problems can often only be discovered after the teacher uses the equipment in class or after manual inspection, which affects the teaching progress. Summary of the invention
[0003] In order to solve or improve the problems existing in the prior art, each embodiment of the present application provides a method, device and system for automatically detecting a display device.
[0004] In one embodiment of the present application, a method for automatically detecting a display device is provided. The method, applied to a server device, includes: sending a first image to at least one display device in a first space to control at least one display device to display the first image; acquiring a second image captured in the first space; wherein the second image contains a display screen of at least one display device; using a target detection model, detecting the number of first images appearing in the second image; acquiring a second number of at least one display device in the first space; and determining a detection result for the display device in the first space based on the first number and the second number.
[0005] Preferably, acquiring the second image captured in the first space includes: acquiring video information captured in the first space; and extracting at least one frame of image from the video information as the second image.
[0006] Preferably, obtaining the video information collected in the first space includes: generating a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control an image acquisition device to collect video information of at least one display device; sending the second control instruction to the image acquisition device; and receiving video information fed back by the image acquisition device.
[0007] Preferably, the detection result for at least one display device in the first space is determined based on the first number and the second number, including: when the first number and the second number are the same, determining that the detection result is that at least some of the display devices in the first space are normal; when the first number and the second number are different, determining the number of abnormal display devices in the first space based on the difference between the first number and the second number, and taking the number of abnormal display devices as the detection result.
[0008] Preferably, when the first number is different from the second number, the method further includes: obtaining a benchmark picture in which all display devices in the first space display the specified image normally; determining the block position of the second image where the first image is not displayed by comparing the benchmark picture with the second image; determining the identification of the abnormal display device based on the identification of all display devices in the first space and the correlation between the block positions of each display device in the benchmark picture; and adding the identification of the abnormal display device to the detection result.
[0009] Preferably, sending the first image to at least one display device in the first space includes: generating a first control instruction according to a preset automatic detection task; wherein the first control instruction carries the first image; and sending the first control instruction to a control terminal of the display device so that the control terminal controls at least one display device to display the first image.
[0010] Preferably, the above method also includes: sending detection notification information to the client device based on the detection result of the display device in the first space; or obtaining the detection result of at least one display device in the second space; sending detection notification information to the client device based on the detection result of the display device in the first space and the detection result of at least one display device in the second space.
[0011] In another embodiment of the present application, an automatic detection device for display devices is provided. The device includes: a sending module, used to send a first image to at least one display device in a first space to control at least one display device to display the first image; an acquisition module, used to acquire a second image captured in the first space; wherein the second image contains a display screen of at least one display device; a detection module, used to detect the first number of first images appearing in the second image using a target detection model; the acquisition module is also used to acquire the second number of at least one display device in the first space; and a determination module, used to determine the detection result for the display device in the first space based on the first number and the second number.
[0012] In another embodiment of the present application, an automatic detection system for display devices is provided. The system is used to execute the automatic detection method for display devices described above, including: a server device, used to send a first image to at least one display device in a first space; at least one display device, used to display the first image; the server device, also used to obtain a second image captured in the first space; using a target detection model, detecting the number of first images appearing in the second image; obtaining a second number of display devices in the first space; and determining a detection result for the display devices in the first space based on the first number and the second number.
[0013] Preferably, the system further comprises an image acquisition device, which is used to acquire video information in the first space. Correspondingly, the server device is also used to acquire the video information acquired in the first space, and extract at least one frame of image from the video information as the second image.
[0014] Preferably, the server device generates a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control the image acquisition device to acquire video information of at least one display device; sends the second control instruction to the image acquisition device; and receives video information fed back by the image acquisition device.
[0015] Preferably, the above system also includes a control center; a server-side device, further used to generate a first control instruction according to a preset automatic detection task; wherein the first control instruction carries a first image; the first control instruction is sent to the control center of the display device; the control center is used to control at least one display device to display the first image according to the received first control instruction.
[0016] Preferably, the server-side device, when determining the detection result for the display device in the first space based on the first number and the second number, is specifically used to: when the first number and the second number are the same, determine the detection result that at least some of the display devices in the first space are normal; when the first number and the second number are different, determine the number of abnormal display devices in the first space based on the difference between the first number and the second number, and use the number of abnormal display devices as the detection result.
[0017] Preferably, the above system also includes a client device; the server device is also used to send detection notification information to the client device based on the detection result of the display device in the first space; or obtain the detection result of at least one display device in the second space; send detection notification information to the client device based on the detection result of the display device in the first space and the detection result of at least one display device in the second space; the client device is used to receive the detection notification information and display it.
[0018] The technical solutions provided by the embodiments of the present application are as follows: first, the server-side device controls the display devices in each area to play the specified image, the image acquisition device acquires the video stream of the display devices in each area showing the specified image, and detects whether the specified image appears in the picture through the target detection model, thereby replacing manual detection and improving the detection efficiency; secondly, the robustness of this solution is better, and it can adapt to various environments and is not affected by ambient light at all; and this solution detects whether the entire picture is normal, which can avoid the false detection such as generalizing the partial picture in the traditional solution of only using photosensitive devices to detect the picture of a certain area in the screen, thereby improving the detection accuracy; thirdly, by comparing and analyzing whether the number of displayed pictures is consistent with the actual number of devices, it is possible to quickly determine whether there is an abnormality in the display device, without the need to use other devices such as photosensitive devices in the traditional solution, only image acquisition devices are needed, which not only improves the detection efficiency but also saves the detection cost. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0020] Figure 1 A schematic diagram of a flow chart of a display device automatic detection method provided in one embodiment of the present application;
[0021] Figure 2 A schematic diagram of a process of automatic detection of a display device provided in an embodiment of the present application;
[0022] Figure 3 A schematic diagram of the structure of an automatic detection device for a display device provided in one embodiment of the present application;
[0023] Figure 4 A schematic diagram of the structure of a display device automatic detection system provided in one embodiment of the present application;
[0024] Figure 5 A schematic diagram of the structure of an automatic detection system for a display device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0025] The present application provides the following embodiments to solve or partially solve the problems existing in the above-mentioned solutions. In order to enable people in the technical field to better understand the solution of the present application, the technical solution in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application.
[0026] In some processes described in the specification, claims and the above-mentioned figures of the present application, multiple operations appearing in a specific order are included, and these operations may not be executed or executed in parallel in the order in which they appear in this article. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit "first" and "second" to different types. In addition, the embodiments described below are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application.
[0027] Figure 1 The flowchart of the automatic detection method of the display device provided by an embodiment of the present application is shown, and the execution subject of the method can be a server device. Figure 1 As shown, the method includes:
[0028] 101. Send a first image to at least one display device in a first space to control the at least one display device to display the first image;
[0029] 102. Acquire a second image captured in the first space; wherein the second image contains a display screen of at least one display device;
[0030] 103. Detect, using the object detection model, a first number of occurrences of the first image in the second image;
[0031] 104. Obtain a second number of at least one display device in the first space;
[0032] 105. Determine a detection result for the display device in the first space according to the first number and the second number.
[0033] The technical solutions provided by the embodiments of the present application are as follows: first, the server-side device controls the display devices in each area to play the specified image, the image acquisition device acquires the video stream of the display devices in each area showing the specified image, and detects whether the specified image appears in the picture through the target detection model, thereby replacing manual detection and improving the detection efficiency; secondly, the robustness of this solution is better, and it can adapt to various environments and is not affected by ambient light at all; and this solution detects whether the entire picture is normal, which can avoid the false detection such as generalizing the partial picture in the traditional solution of only using photosensitive devices to detect the picture of a certain area in the screen, thereby improving the detection accuracy; thirdly, by comparing and analyzing whether the number of displayed pictures is consistent with the actual number of devices, it is possible to quickly determine whether there is an abnormality in the display device, without the need to use other devices such as photosensitive devices in the traditional solution, only image acquisition devices are needed, which not only improves the detection efficiency but also saves the detection cost.
[0034] In the above step 101, at least one display device may be one display device or multiple display devices. When the first space contains multiple display devices, the content of the first image sent to the multiple display devices may be different, or the content of the first image sent to the multiple display devices may be the same. In this embodiment, the first space may be a school classroom; the display device may be a computer, a projector, a smart blackboard, etc.; the first image may be a special graphic, logo, letter, text, etc. When there are multiple display devices in the same space, the display devices in the same space may be the same display device or different display devices, and multiple display devices may all display the same picture, or multiple display devices may display different pictures, or some display devices may display the same picture, and this embodiment does not limit this.
[0035] The above step 102, "obtaining the second image captured in the first space", can be implemented by the following steps:
[0036] 1021. Obtain video information collected in the first space;
[0037] 1022. Extract at least one frame of image from the video information as a second image.
[0038] In the above step 1021, the collected video information is a video stream collected by the camera, which can be understood as a video of the first space captured by the camera after 360-degree rotation. The 360-degree shooting without blind spots makes the information in the video more complete, and can avoid the situation where the display device in the first space misses the shot. Moreover, this embodiment does not need to use a photosensitive device or other professional analysis camera, but only needs to use the existing image acquisition equipment in the classroom to collect, which saves costs.
[0039] In the above step 1022, the second image includes the display screens of at least some of the display devices in the first space, that is, to detect whether the display functions of at least some of the display devices in the first space are normal. Among them, at least some of the display devices can be a display device in the first space, or multiple display devices in the first space; or all display devices in the first space. The number of at least some of the display devices is based on actual detection requirements and is not specifically limited here.
[0040] In the above step 103, the target detection model can be a specific target detection algorithm or other image recognition algorithms, such as CDN (Content Delivery Network) image algorithm, etc., which is not limited in this embodiment. In this embodiment, the target detection model can be used to complete the automatic inspection of classroom display devices. The target detection model has no restrictions on application scenarios and light and has high robustness.
[0041] In the above step 104, the second number is the number of at least part of the display devices in the above first space that need to be detected.
[0042] The specific determination process of the above step 105 "determining the detection result for at least one display device in the first space according to the first quantity and the second quantity" is:
[0043] When detecting all display devices in the first space (i.e., the second number is the number of all display devices in the first space), if the first number is the same as the second number, it can be determined that the detection result is that all display devices in the first space are normal; if the first number is different from the second number, the number of abnormal display devices in the first space can be determined based on the difference between the first number and the second number, and the number of abnormal display devices is used as the detection result. For example, if the second number is A and the first number is B, then the number of abnormal display devices in the first space is AB (A>B).
[0044] When detecting some display devices in the first space (i.e., the second number is the number of some display devices in the first space), if the first number is the same as the second number, it can be determined that the detection result is that the display devices currently detected in the first space are all normal; if the first number is different from the second number, the number of abnormal display devices in the display devices currently detected in the first space can be determined based on the difference between the first number and the second number, and the number of abnormal display devices is used as the detection result. As above, for example, if the second number is A and the first number is B, then the number of abnormal display devices in the first space is AB (A>B).
[0045] Furthermore, when the first number is different from the second number, in an embodiment of the present application, a benchmark picture in which all display devices in the first space normally display the specified image can be obtained; by comparing the benchmark picture with the second image, the block position of the second image that does not display the first image can be determined; based on the identification of all display devices in the first space and the correlation between the block positions of each display device in the benchmark picture, the identification of the abnormal display device is determined; and the identification of the abnormal display device is added to the detection result.
[0046] Specifically, the server-side device stores a reference picture in which all display devices in the first space display the specified picture normally, and stores the block where the relative position of the display device in the first space in the reference picture is located in association with the device identification of the display device in the block, so as to facilitate the subsequent statistics of the display conditions of each display device in a certain area and facilitate maintenance personnel to obtain specific information of the display device. Among them, the device identification of the display device includes at least: the ID, model and device name of the display device.
[0047] In this embodiment, the server-side device controls the operation of the display device through the control center of the display device. Therefore, sending the first image to at least one display device in the first space may specifically include the following steps: generating a first control instruction according to a preset automatic detection task; wherein the first control instruction carries the first image, and then sending the first control instruction to the control center of the display device so that the control center controls at least one display device to display the first image.
[0048] In this embodiment, the server-side device directly controls the image acquisition device to collect video information. Therefore, obtaining the video information collected in the first space may specifically include the following steps: generating a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control the image acquisition device to collect video information of at least one display device, and then sending the second control instruction to the image acquisition device to receive video information fed back by the image acquisition device.
[0049] Furthermore, the above method also includes:
[0050] Based on the detection results of the display devices in the first space, detection notification information is sent to the client device; or the detection results of the display devices in at least one second space are obtained; based on the detection results of the display devices in the first space and the detection results of the display devices in at least one second space, detection notification information is sent to the client device, so that the staff can timely grasp the detection results of the display devices in each space and maintain the display devices according to the detection results.
[0051] In the embodiment of the present application, at least one second space may be other spaces in a certain area except the first space. Taking a school as an example, the first space is one of the classrooms in the school with a display device, and then at least one second space is other classrooms in the school with a display device except the above classroom.
[0052] The following uses the first space and at least one second space as a school classroom as an example to illustrate the automatic detection of the above-mentioned display device.
[0053] like Figure 2 As shown, after receiving the detection task of the classroom display device, the server device controls the control center of all classrooms to turn on the classroom computers and other display devices, and then each classroom computer and other display device displays the specified picture sent by the server. When the display device displays the specified picture, the image acquisition device in the classroom, such as a camera, starts to rotate and collect the video of the display device in the classroom displaying the specified picture, and then the server device obtains the video stream collected by the image acquisition device, and uses the target detection model to analyze the obtained video stream to determine the number of specified pictures displayed by the display device in each classroom. It is judged whether the number of specified pictures displayed by the display device in each classroom is consistent with the number of display devices that need to be detected in at least part of the corresponding classroom. If they are consistent, it can be determined that at least part of the display devices and computers that need to be detected in the classroom are operating normally, and then the detection results of all classrooms are output, and the detection results are sent to the client device, and the detection ends; if they are inconsistent, according to the identification of at least part of the display devices that need to be detected in the classroom and the association relationship between the positions of the classroom blocks where each display device is located in the reference picture, the identification of the abnormal display device is determined, and the identification of the abnormal display device is added to the detection result, and the result is sent to the client device, and the detection ends.
[0054] Figure 3 FIG. 1 is a schematic diagram showing the structure of an automatic detection device for a display device provided by an embodiment of the present application. Figure 3 As shown, the device comprises:
[0055] A sending module 31, configured to send the first image to at least one display device in the first space to control the at least one display device to display the first image;
[0056] An acquisition module 32 is used to acquire a second image captured in the first space; wherein the second image contains a display screen of at least one display device;
[0057] A detection module 33, configured to detect the number of first images appearing in the second image using an object detection model;
[0058] The acquisition module 32 is further used to acquire a second number of at least one display device in the first space;
[0059] The determination module 34 is used to determine the detection result of the display device in the first space according to the first number and the second number.
[0060] Furthermore, when the first space contains a plurality of display devices, the contents of the first images sent to the plurality of display devices are different; or the contents of the first images sent to the plurality of display devices are the same.
[0061] Furthermore, when the acquisition module 32 is used to acquire the second image captured in the first space, it is mainly used to: acquire video information captured in the first space; and extract at least one frame of image from the video information as the second image.
[0062] Furthermore, the determination module 34, when used to determine the detection result for at least one display device in the first space based on the first number and the second number, is specifically used to: when the first number and the second number are the same, determine the detection result that at least some of the display devices in the first space are normal; when the first number and the second number are different, determine the number of abnormal display devices in the first space based on the difference between the first number and the second number, and use the number of abnormal display devices as the detection result.
[0063] Furthermore, when the first number is different from the second number, the acquisition module 32 is also used to: obtain a benchmark image in which all display devices in the first space normally display the specified image; determine the block position of the second image that does not display the first image by comparing the benchmark image with the second image; determine the identification of the abnormal display device based on the identification of at least some of the display devices in the first space and the correlation between the block positions of each display device in the benchmark image; and add the identification of the abnormal display device to the detection result.
[0064] Furthermore, when the sending module 31 is used to send the first image to at least one display device in the first space, it is specifically used to: generate a first control instruction according to a preset automatic detection task; wherein the first control instruction carries the first image. Accordingly, the sending module 31 is also used to send the first control instruction to the control center of the display device, so that the control center controls at least one display device to display the first image.
[0065] Furthermore, the acquisition module 32, when used to acquire video information collected in the first space, is specifically used to: generate a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control the image acquisition device to collect video information of at least one display device; correspondingly, the sending module 31 is also used to send the second control instruction to the image acquisition device so that the image acquisition device collects video information of at least one display device.
[0066] Furthermore, the sending module 31 is further used to send detection notification information to the client device according to the detection result of the display device in the first space; or the obtaining module 32 is further used to obtain the detection result of at least one display device in at least one second space. Correspondingly, the sending module 31 is also used to send detection notification information to the client device according to the detection result of the display device in the first space and the detection result of the display device in at least one second space.
[0067] Preferably, the identification of the display device includes at least: an IP address, a device model and a device name of the display device.
[0068] It should be noted here that the automatic detection device for the display device provided in the above embodiment can implement the technical solutions described in the above method embodiments. The specific implementation principles of the above modules or units can be found in the corresponding contents of the above method embodiments, which will not be repeated here.
[0069] Figure 4 FIG. 1 is a schematic diagram showing a structure of an automatic detection system for a display device provided by an embodiment of the present application. Figure 4 As shown, the system includes:
[0070] The server device 41 is used to send the first image to at least one display device in the first space;
[0071] at least one display device 42, configured to display a first image;
[0072] The server device 41 is also used to obtain a second image collected in the first space; use the target detection model to detect the number of first images appearing in the second image; obtain the second number of display devices in the first space; and determine the detection results for the display devices in the first space based on the first number and the second number.
[0073] Preferably, the above system further comprises:
[0074] The image acquisition device 43 is used to acquire video information in the first space; correspondingly, the server device 41 is also used to obtain the video information acquired in the first space; and extract at least one frame of image from the video information as the second image.
[0075] Preferably, the server device 41 is also used to generate a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control the image acquisition device 43 to acquire video information of at least one display device 42; send the second control instruction to the image acquisition device 43; and receive video information fed back by the image acquisition device 43.
[0076] Preferably, the above system also includes a control terminal 44; the server device 41 is also used to generate a first control instruction according to a preset automatic detection task; wherein the first control instruction carries a first image; the first control instruction is sent to the control terminal 44 of the display device 42; the control terminal 44 is used to control at least one display device 42 to display the first image according to the received first control instruction.
[0077] Preferably, the server device 41 is also used to determine, when the first number and the second number are the same, that the detection result is that at least some of the display devices in the first space are normal; when the first number and the second number are different, determine the number of abnormal display devices in the first space based on the difference between the first number and the second number, and use the number of abnormal display devices as the detection result.
[0078] Preferably, the system further includes a client device 45; the server device 41 is further used to display the detection result of the device 42 in the first space and send detection notification information to the client device 45; or obtain the detection result of at least one display device 42 in the second space; according to the detection result of the display device in the first space and the detection result of at least one display device in the second space, send detection notification information to the client device 45. Correspondingly, the client device 45 is also used to receive the detection notification information and display it.
[0079] The following takes a school classroom as an example to explain the automatic detection system of the above display device.
[0080] like Figure 5 The structure diagram of the display device and the control center and server device of each classroom of the school is shown. The control module of the server device sends a control instruction to the control center of each classroom. After receiving the control instruction, the control end sends a control information to each classroom to control the computer of the corresponding classroom and other display devices associated with the computer to turn on. Among them, the classrooms are associated through the school local area network. Since the specified picture is displayed by the classroom computer controlled by the server device, this method can not only be used to judge whether the display device of the classroom is normal, but also further confirm that the computer connected to the display device in the classroom is normal. After receiving the specified picture sent by the server device, the computer and other display devices in the classroom display the specified picture. The control module of the server device controls the image acquisition device to collect the video stream of the classroom display device displaying the specified picture, and the video acquisition module of the server device obtains the video stream, and the target detection module of the server device detects the video stream. After the detection is completed, the output module of the server device outputs the detection result.
[0081] It should be noted here that the automatic detection system for the display device provided in the above embodiment can implement the technical solutions described in the above method embodiments. The specific implementation principles of the above modules or units can be found in the corresponding contents of the above method embodiments, which will not be repeated here.
[0082] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0083] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course can also be implemented by combining hardware and software. Based on such an understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a computer product, and the present application can be in the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0084] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable coordinate determination device to produce a machine, so that the instructions executed by the processor of the computer or other programmable coordinate determination device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0085] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable coordinate determination device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, the instruction device implementing the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0086] These computer program instructions may also be loaded onto a computer or other programmable coordinate determining device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide for implementing the process described in the flow chart. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0087] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0088] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0089] Computer readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transit media), such as modulated data signals and carrier waves.
[0090] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for automatically detecting a display device, characterized in that: include: Sending the first image to at least one display device in the first space to control the at least one display device to display the first image; Acquire a second image captured in the first space; wherein the second image contains a display screen of the at least one display device; Detecting, using the object detection model, a first number of occurrences of the first image in the second image; Acquire a second quantity of the at least one display device in the first space; Determine, according to the first number and the second number, a detection result for the display device in the first space; Wherein, determining the detection result for the display devices in the first space according to the first number and the second number includes: when the first number is the same as the second number, determining that the detection result is that at least some of the display devices in the first space are normal; When the first number is different from the second number, determining the number of abnormal display devices in the first space according to the difference between the first number and the second number, and taking the number of abnormal display devices as the detection result; When the first number is different from the second number, the method further includes: Obtain a benchmark image in which all display devices in the first space display the specified image normally; determine the block position of the second image that does not display the first image by comparing the benchmark image with the second image; determine the identification of the abnormal display device based on the identification of all display devices in the first space and the correlation relationship between the block position of each display device in the benchmark image; and add the identification of the abnormal display device to the detection result.
2. The automatic detection method for a display device according to claim 1, characterized in that: Acquiring a second image collected in the first space includes: Acquire video information collected in the first space; At least one frame of image is extracted from the video information as the second image.
3. The automatic detection method of a display device according to claim 2, characterized in that: Acquiring video information collected in the first space, including: Generate a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control the image acquisition device to acquire video information of the at least one display device; sending the second control instruction to the image acquisition device; Receive the video information fed back by the image acquisition device.
4. The automatic detection method for a display device according to any one of claims 1 to 3, characterized in that: Sending a first image to at least one display device in a first space includes: Generate a first control instruction according to a preset automatic detection task; wherein the first control instruction carries the first image; The first control instruction is sent to a control center of the display device, so that the control center controls the at least one display device to display the first image.
5. The automatic detection method for a display device according to any one of claims 1 to 3, characterized in that: Also includes: Sending detection notification information to the client device according to the detection result of the display device in the first space; or Acquire detection results of at least one display device in the second space; and send detection notification information to the client device according to the detection results of the display device in the first space and the detection results of the display device in the at least one second space.
6. An automatic detection device for a display device, characterized in that: include: a sending module, configured to send the first image to at least one display device in the first space, so as to control the at least one display device to display the first image; An acquisition module, configured to acquire a second image captured in the first space; wherein the second image contains a display screen of the at least one display device; a detection module, configured to detect, by using a target detection model, a first number of occurrences of the first image in the second image; The acquisition module is further used to acquire a second quantity of the at least one display device in the first space; a determination module, configured to determine a detection result for the display device in the first space according to the first number and the second number; The determination module is specifically configured to: when the first number is the same as the second number, determine that the detection result is that at least part of the display devices in the first space are normal; when the first number is different from the second number, determine the number of abnormal display devices in the first space according to the difference between the first number and the second number, and use the number of abnormal display devices as the detection result; When the first number is different from the second number, the acquisition module is also used to: obtain a benchmark picture in which all display devices in the first space display the specified image normally; determine the block position of the second image where the first image is not displayed by comparing the benchmark picture with the second image; determine the identification of the abnormal display device based on the identification of all display devices in the first space and the correlation relationship between the block position of each display device in the benchmark picture; and add the identification of the abnormal display device to the detection result.
7. An automatic detection system, characterized in that: include: A server device, configured to send a first image to at least one display device in the first space; at least one display device, configured to display the first image; The server device is further configured to obtain a second image collected in the first space; detect, using the target detection model, a first number of occurrences of the first image in the second image; obtain a second number of display devices in the first space; and determine a detection result for the display devices in the first space based on the first number and the second number; Wherein, when the server-side device determines the detection result for the display devices in the first space according to the first number and the second number, it is specifically used to: when the first number is the same as the second number, determine that the detection result is that at least part of the display devices in the first space are normal; when the first number is different from the second number, determine the number of abnormal display devices in the first space according to the difference between the first number and the second number, and use the number of abnormal display devices as the detection result; When the first number is different from the second number, the server device is further used to: obtain a benchmark picture in which all display devices in the first space display the specified image normally; determine the block position of the second image where the first image is not displayed by comparing the benchmark picture with the second image; determine the identification of the abnormal display device based on the identification of all display devices in the first space and the correlation relationship between the block position of each display device in the benchmark picture; and add the identification of the abnormal display device to the detection result.
8. The automatic detection system according to claim 7, characterized in that: Also included is an image acquisition device; The image acquisition device is used to acquire video information in the first space; The server device is further used to obtain the video information collected in the first space; and extract at least one frame of image from the video information as the second image.
9. The automatic detection system according to claim 8, characterized in that: The server device is also used to generate a second control instruction according to a preset automatic detection task; wherein the second control instruction is used to control the image acquisition device to acquire video information of the at least one display device; send the second control instruction to the image acquisition device; and receive the video information fed back by the image acquisition device.
10. The automatic detection system according to claim 7, characterized in that: It also includes controlling the mid-end; The server device is further configured to generate a first control instruction according to a preset automatic detection task; wherein the first control instruction carries the first image; and send the first control instruction to the control middle end of the display device; The control middle end is used to control the at least one display device to display the first image according to the received first control instruction.
11. The automatic detection system according to any one of claims 7 to 10, characterized in that: It also includes client devices; The server device is further configured to send detection notification information to the client device according to the detection result of the display device in the first space; or obtain the detection result of at least one display device in the second space, and send detection notification information to the client device according to the detection result of the display device in the first space and the detection result of the display device in the at least one second space; The client device is used to receive the detection notification information and display it.
Citation Information
Patent Citations
Image taking apparatus and image taking method
CN101399916A
Monitoring method and system
CN111953962A