Information board management method, device and equipment, readable storage medium and program product

Abstract

The invention relates to an information board management method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: shooting a target information board to obtain a shot image containing the target information board; performing anomaly detection on the target information board based on the shot image to obtain a detection result; when the detection result represents that the target information board is abnormal, acquiring an information board video stream; and sending the detection result and the information board video stream to an information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream. By adopting the method, the management efficiency of the information board can be improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an information board management method, device, equipment, readable storage medium and computer program product. Background Art

[0002] In modern traffic management, road information boards play an important role in distributing information. However, when a road information board fails or is attacked, the actual displayed information may be inconsistent with the pushed display information. Therefore, it is necessary to detect the information board and perform timely and effective maintenance and adjustment based on the detection results to ensure that the display information pushed to the information board can be accurately displayed.

[0003] Currently, the detection, maintenance and adjustment of intelligence boards usually rely on manual labor, resulting in low management efficiency of intelligence boards. Summary of the invention

[0004] Based on this, it is necessary to provide an information board management method, device, computer equipment, computer readable storage medium and computer program product that can improve the efficiency of information board management in response to the above technical problems.

[0005] In a first aspect, the present application provides an information board management method, comprising:

[0006] photographing the target information board to obtain a photographed image including the target information board;

[0007] Performing abnormality detection on the target information board based on the captured image to obtain a detection result;

[0008] When the detection result indicates that the target information board is abnormal, obtaining the information board video stream;

[0009] The detection result and the information board video stream are sent to an information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream.

[0010] In a second aspect, the present application also provides an information board management device, comprising:

[0011] An image shooting module, used for shooting the target information board to obtain a shot image containing the target information board;

[0012] An anomaly detection module, used to perform an anomaly detection on the target information board based on the captured image to obtain a detection result;

[0013] A video stream acquisition module, used for acquiring a video stream of an information board when the detection result indicates that an abnormality exists in the target information board;

[0014] The detection result sending module is used to send the detection result and the information board video stream to the information board control platform, so that the information board control platform can perform fault diagnosis and control on the target information board based on the detection result and the information board video stream.

[0015] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0016] photographing the target information board to obtain a photographed image including the target information board;

[0017] Performing abnormality detection on the target information board based on the captured image to obtain a detection result;

[0018] When the detection result indicates that the target information board is abnormal, obtaining the information board video stream;

[0019] The detection result and the information board video stream are sent to an information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream.

[0020] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0021] photographing the target information board to obtain a photographed image including the target information board;

[0022] Performing abnormality detection on the target information board based on the captured image to obtain a detection result;

[0023] When the detection result indicates that the target information board is abnormal, obtaining the information board video stream;

[0024] The detection result and the information board video stream are sent to an information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream.

[0025] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0026] photographing the target information board to obtain a photographed image including the target information board;

[0027] Performing abnormality detection on the target information board based on the captured image to obtain a detection result;

[0028] When the detection result indicates that the target information board is abnormal, obtaining the information board video stream;

[0029] The detection result and the information board video stream are sent to an information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream.

[0030] The above-mentioned information board management method, device, computer equipment, computer-readable storage medium and computer program product obtain a captured image containing the target information board by photographing the target information board, and perform abnormality detection on the target information board based on the captured image to obtain a detection result. When the detection result shows that there is an abnormality in the information board, the information board video stream is further obtained, and the detection result and video stream are sent to the information board control platform. The control platform can integrate this information and control the information board more accurately, thereby realizing automatic identification and response to abnormal conditions of the information board, thereby improving the management efficiency of the information board. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0032] FIG1 is an application environment diagram of an information board management method according to an embodiment;

[0033] FIG2 is a schematic diagram of a flow chart of an information board management method in one embodiment;

[0034] FIG3 is a schematic diagram of a flow chart of an information board management method in another embodiment;

[0035] FIG4 is a schematic diagram of an information board scene in one embodiment;

[0036] FIG5 is a schematic diagram of an information board management system according to one embodiment;

[0037] FIG6 is a block diagram of a management device for an information board in one embodiment;

[0038] FIG. 7 is a diagram showing the internal structure of an image acquisition device in one embodiment. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0040] The information board management method provided in the embodiment of the present application can be applied to the application environment shown in Figure 1. Among them, the image acquisition device 102 and the information board 106 communicate with the information board control platform 104 through the network respectively. The data storage system can store the data that the information board control platform 104 needs to process. The data storage system can be integrated on the information board control platform 104, or it can be placed on the cloud or other network servers. The above-mentioned information board management method can be executed by the image acquisition device 102, or it can be interactively executed by the image acquisition device 102 and the information board control platform. Taking the execution by the image acquisition device 102 as an example, the image acquisition device shoots the target information board to obtain a captured image containing the target information board; based on the captured image, the target information board is detected for abnormality to obtain a detection result; when the detection result indicates that the target information board has an abnormality, the information board video stream is obtained; the detection result and the information board video stream are sent to the information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream.

[0041] The image acquisition device 102 may be an independent camera or a terminal with an integrated camera function. The terminal may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices and portable wearable devices. IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car devices, projection devices, etc. Portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. Head-mounted devices may be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc. The information board control platform 104 may be an independent physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides cloud computing services.

[0042] In an exemplary embodiment, as shown in FIG2 , a method for managing an information board is provided, which is described by taking the method applied to the image acquisition device in FIG1 as an example, and includes the following steps:

[0043] S202, photograph the target information board to obtain a photographed image including the target information board.

[0044] Among them, the target information board is the information board to be monitored and photographed. The information board can also be called a traffic information board or a variable information board. It is an electronic display board used for road traffic management. Specifically, it can be an information board installed on highways, urban main roads or other sections of roads. It helps guide and manage traffic flow by providing real-time traffic information, warnings and instructions, improves road use efficiency and enhances driving safety.

[0045] Specifically, when the preset image shooting conditions are met, the image acquisition device automatically shoots the target information board to obtain a shot image containing the target information board.

[0046] Among them, the image capture conditions are conditions used to determine when to capture the image, which can be time conditions or event conditions. The time conditions can be timed capture, for example, triggering the image acquisition device to capture at fixed time intervals, or triggering the image acquisition device to capture at each preset time point; event conditions refer to triggering the image acquisition device to capture when a specific event occurs, for example, when the image acquisition device receives a shooting instruction sent by the information board control platform, it is triggered to capture.

[0047] In one embodiment, when the preset image shooting conditions are met, the image acquisition device automatically shoots the target information board to obtain a video stream of a first preset length, and extracts a frame of image from the video stream of the first preset length as a captured image containing the target information board.

[0048] S204, performing abnormality detection on the target information board based on the captured image to obtain a detection result.

[0049] Among them, abnormality detection includes at least one of screen abnormality detection, content abnormality detection and weather abnormality detection. Screen abnormality detection refers to the detection of physical and functional faults of the information board display screen, which can specifically include at least one of bad pixel detection, screen distortion detection and brightness consistency detection. Bad pixel detection is to detect whether the display screen has dead pixels or bright pixels. Screen distortion detection is to detect whether the display screen has screen distortion, that is, the screen display is chaotic or the color is abnormal. Brightness consistency detection is to detect whether the brightness of the display screen is uniform. Content abnormality detection is used to detect whether the information displayed on the information board is accurate. Weather abnormality detection is to detect whether the weather state changes that affect driving in the environment where the information board is located. The detection results include at least one of the screen detection results, content detection results and weather detection results.

[0050] Specifically, after acquiring the captured image, the image acquisition device can also determine the current item to be detected on the target information board, and use the detection algorithm corresponding to the item to be detected to perform anomaly detection on the captured image for the item to be detected to obtain anomaly detection results.

[0051] S206, when the detection result indicates that there is an abnormality in the target information board, the video stream of the information board is obtained.

[0052] In one embodiment, when the detection result obtained by the image acquisition device indicates the existence of at least one of content anomaly, display anomaly and weather anomaly, the image acquisition device can shoot a video of the target information board to obtain an information board video stream of a second preset duration.

[0053] In one embodiment, when the detection results obtained by the image acquisition device indicate the existence of at least one of content anomaly, display anomaly and weather anomaly, the image acquisition device can extract a video stream of a second preset length from a pre-acquired video stream of a first preset length, wherein the second preset length is less than or equal to the first preset length, and the extracted video stream of the second preset length contains the captured images used for anomaly detection.

[0054] S208, sending the detection results and the information board video stream to the information board control platform, so that the information board control platform controls the target information board based on the detection results and the information board video stream.

[0055] Among them, the information board control platform can be a specially designed system for centralized management and control of information boards on the road. The information board control platform can also be used to visualize various relevant information of the information board. Operators can centrally manage and control information boards on the road on the information board control platform.

[0056] Specifically, after obtaining the detection result indicating the existence of an abnormality in the target intelligence board and obtaining the video stream of the intelligence board, the image acquisition device can send the detection result and the video stream of the intelligence board to the intelligence board control platform. The intelligence board control platform can further identify and analyze the video stream of the intelligence board to obtain the analysis result, and based on the analysis result, review the received detection result to obtain the review result, and then generate a control instruction based on the review result, and send the generated control instruction to the target intelligence board so as to control the target intelligence board based on the control instruction.

[0057] For example, when the audit result indicates that the target information board has content abnormalities, that is, the actual display text of the target information board is inconsistent with the preset display text, an information display instruction carrying the preset display text is resent to the target information board, and the target information board updates the display content based on the preset display text after receiving the information display instruction; when the audit result indicates that the target information board has screen abnormalities, that is, the display screen of the target information has at least one of bad pixels, distorted screen and inconsistent brightness, an abnormal prompt information is generated, and the abnormal prompt information is sent to the maintenance personnel terminal, so that the maintenance personnel can quickly locate the target information board with abnormalities after receiving the abnormal prompt information, so as to repair the target information board. When the abnormal prompt information is generated, a closing instruction is also generated, and the closing instruction is sent to the target information board, so that the target information board is closed based on the closing instruction to avoid further damage to the screen; when the audit result indicates that the target information board has weather abnormalities, that is, the weather conditions have changed to affect driving, a new display text is generated based on the weather changes, and an information display instruction carrying the new display text is sent to the target information board, and the target information board updates the display content based on the new display text after receiving the information display instruction.

[0058] In the above-mentioned information board management method, the target information board is photographed to obtain a photographed image containing the target information board, and the target information board is detected for abnormalities based on the photographed image to obtain a detection result. When the detection result shows that there is an abnormality in the information board, the information board video stream is further obtained, and the detection result and the video stream are sent to the information board control platform. The control platform can integrate this information and control the information board more accurately, thereby realizing automatic identification and response to abnormal situations of the information board, thereby improving the management efficiency of the information board.

[0059] In one embodiment, anomaly detection includes at least one of screen anomaly detection, content anomaly detection and weather anomaly detection; the detection result includes at least one of screen detection result, content detection result and weather detection result; the image acquisition device performs anomaly detection on the target information board based on the captured image, and the process of obtaining the detection result includes the following steps: determining the item to be detected for the target information board; when the item to be detected is a content detection item, performing content anomaly detection on the target information board based on the captured image to obtain a content detection result; when the item to be detected is a weather detection item, performing weather anomaly detection on the target information board based on the captured image to obtain a weather detection result; when the item to be detected is a screen detection item, performing screen anomaly detection on the target information board based on the captured image to obtain a screen detection result.

[0060] It should be noted that, for a certain captured image, at least one detection item may be detected for anomalies. For example, at a certain moment, the target information board is in an information display state, and the image acquisition device captures the target information board in this state to obtain a captured image. Through the captured image, anomalies detection of content detection items, anomalies detection of weather detection items, and anomalies detection of screen detection items may be performed. At another moment, the target information board is in a full-screen lit test state, and the image acquisition device captures the target information board in this state to obtain a captured image. Through the captured image, anomalies detection of screen detection items, and anomalies detection of weather detection items may be performed.

[0061] In one embodiment, if there are at least two detection items for the target information board, the priorities of at least two detection items can be pre-configured. After obtaining the captured image, the image acquisition device can determine the next item to be detected for the captured image based on the pre-set priorities of each detection item. For example, the detection items of the target information board include content detection items, screen detection items and weather detection items, and the priorities of these three detection items decrease in sequence. Then, the image acquisition device determines that the first item to be detected is the content detection item, performs content anomaly detection on the target information board based on the captured image, and obtains a content detection result. Then, the next item to be detected is determined to be the weather detection item, and weather anomaly detection is performed on the target information board based on the captured image to obtain a weather detection result. Then, the next item to be detected is determined to be the screen detection item, and screen anomaly detection is performed on the target information board based on the captured image to obtain a screen detection result.

[0062] In the above embodiment, the image acquisition device can comprehensively detect the functional status and environmental impact of the information board by performing abnormal detection on different aspects such as content, weather and screen, thereby improving the accuracy of information board management.

[0063] In one embodiment, the image acquisition device performs content anomaly detection on the target information board based on the captured image, and the process of obtaining the content detection result includes the following steps: segmenting the area where the target information board is located in the captured image to obtain an information board image; performing text recognition on the information board image to obtain the actual display text of the target information board; comparing the actual display text with the preset display text to obtain the content detection result; the above-mentioned information board management method also includes the following steps: when the content detection result indicates that there is a content anomaly in the target information board, sending the actual display text to the information board control platform.

[0064] Specifically, after obtaining the captured image, the image acquisition device can perform edge detection on the captured image to obtain an edge detection result, and based on the edge detection result, segment the area where the target information board in the captured image is located to obtain an information board image, and use an optical character recognition (OCR) algorithm to perform text recognition on the information board image to obtain the actual display text of the target information board, and compare the actual display text with the preset display text to confirm whether the actual display text is consistent with the preset display text, thereby obtaining a content detection result, wherein when the actual display text is consistent with the preset display text, a content detection result representing that the content display is normal is obtained, and when the actual display text is inconsistent with the preset display text, a content detection result representing that the content display is abnormal is obtained, and when the content detection result represents that the target information board has a content abnormality, the actual display text is sent to the information board control platform, and the information board control platform reviews the received detection result based on the received detection result, the actual display text and the information board video stream to obtain an audit result, and then generates a control instruction based on the audit result, and sends the generated control instruction to the target information board, so as to control the target information board based on the control instruction.

[0065] In one embodiment, before segmenting the captured image, the image acquisition device may also perform image preprocessing on the captured image to obtain a preprocessed image, and then segment the area where the target information board is located in the preprocessed image to obtain an information board image.

[0066] The image preprocessing is a process used to improve the quality of the captured image, and specifically may be at least one of grayscale processing, noise filtering processing, and contrast enhancement processing.

[0067] In the above embodiment, the image acquisition device automatically identifies the text displayed on the information board and compares the identified actual display text with the preset display text, so as to detect information input errors, technical failures or tampering, and sends the actual display text, detection results and information board video stream to the information board control platform when an abnormality occurs, so that the information board control platform can control the information board based on the received information, which ensures that the information displayed on the information board is always accurate and up-to-date, and prevents the spread of erroneous information.

[0068] In one embodiment, the image acquisition device performs weather anomaly detection on the target information board based on the captured image, and the process of obtaining the weather detection result includes the following steps: obtaining the historical weather status of the environment where the target information board is located obtained from the most recent weather detection; performing weather detection on the captured image to obtain the current weather status of the environment where the target information board is located; comparing the current weather status with the historical weather status to obtain the weather detection result.

[0069] Specifically, the image acquisition device obtains the historical weather conditions of the environment in which the target information board is located obtained from the most recent weather detection, and inputs the captured image into a pre-trained weather recognition model. The weather recognition model is used to recognize the weather conditions of the captured image to obtain the current weather conditions of the environment in which the target information board is located, and the current weather conditions are compared with the historical weather conditions to determine whether there is a weather change, thereby obtaining a weather detection result. When the weather condition changes from a weather condition that does not affect driving to a weather condition that affects driving, or the weather condition changes from a weather condition that affects driving to a weather condition that does not affect driving, a weather detection result characterizing a weather change is obtained. When the weather condition continues to be a weather condition that does not affect driving or continues to be a weather condition that does not affect driving, a weather detection result characterizing that the weather has not changed is obtained. The weather detection result characterizing a weather change is a weather abnormality.

[0070] Among them, the weather conditions that do not affect driving may specifically include sunny, cloudy and other weather conditions, and the weather conditions that affect driving may specifically include rain, snow, fog, hail, strong wind and other weather conditions.

[0071] In the above embodiment, the image acquisition device performs weather detection on the captured image by acquiring the historical weather status of the environment in which the target information board is located obtained from the most recent weather detection, obtains the current weather status of the environment in which the target information board is located, and compares the current weather status with the historical weather status to obtain the weather detection result, so that changes in weather conditions can be monitored in real time, and when an abnormality occurs, the weather detection result and the information board video stream are sent to the information board control platform, so that the information board control platform can control the information board based on the received information, which ensures that the information displayed on the information board is always up to date and prevents the spread of erroneous information.

[0072] In one embodiment, the image acquisition device performs screen abnormality detection on the target information board based on the captured image, and the process of obtaining the screen detection result includes the following steps: segmenting the area where the target information board is located in the captured image to obtain an information board image; performing screen abnormality detection on the information board image based on a preset screen detection algorithm to obtain a screen detection result; the above-mentioned information board management method also includes the following steps: when the screen detection result indicates that the target information board has a screen abnormality, sending the information board image to the information board control platform.

[0073] Specifically, after obtaining the captured image, the image acquisition device can perform edge detection on the captured image to obtain an edge detection result, and based on the edge detection result, segment the area where the target information board in the captured image is located to obtain an information board image, and use a preset screen detection algorithm to detect each pixel in the information board image to obtain a screen detection result. When the screen detection result indicates that there are bad pixels on the target information board, the bad pixel coordinates, the information board image, the screen detection result and the information board video stream are sent to the information board control platform. When the screen detection result indicates that there is a flower screen on the target information board, the flower screen range information, the information board image, the screen detection result and the information board video stream are sent to the information board control platform. When the screen detection result indicates that there is inconsistent brightness on the target information board, the information of the uneven brightness area, the information board image, the screen detection result and the information board video stream are sent to the information board control platform. The information board control platform reviews the received detection results based on the received information to obtain a review result, and then generates a control instruction based on the review result, and sends the generated control instruction to the target information board so that the target information board can be controlled based on the control instruction.

[0074] In the above embodiment, the image acquisition device obtains an information board image by segmenting the area where the target information board is located in the captured image; screen abnormality detection is performed on the information board image based on a preset screen detection algorithm to obtain a screen detection result. When the screen detection result indicates that there is a screen abnormality in the target information board, the information board image is sent to the information board control platform, so that the information board control platform can control the information board based on the received information, thereby ensuring the correct function of the information board screen.

[0075] In one embodiment, screen anomaly detection includes bad pixel detection, and the captured image is an image captured when the target information board is fully lit, and the information board image is a YUV format image; the image acquisition device performs screen anomaly detection on the information board image based on a preset screen detection algorithm, and the process of obtaining the screen detection result includes the following steps: extracting the Y component value of the information board image; comparing the Y component value with the preset component threshold to obtain the screen detection result.

[0076] The information board image is a YUV format image, which means that the information board image is a YVU format image. The YUV format is a color encoding system. The YUV format mainly distinguishes brightness information (Y) and chrominance information (U and V). The Y component represents the brightness information of the image, and the U and V components carry color information.

[0077] The preset component threshold may specifically include a first component threshold and a second component threshold. The first component threshold is used to evaluate the overall brightness level of the entire information board, and the second component threshold is used to evaluate the brightness level of a local area of ​​the information board. The first component threshold and the second component threshold may be the same or different.

[0078] Specifically, after obtaining the information board image in YUV format, the image acquisition device can divide the information board image into blocks to obtain each image block, extract the overall Y component value of the information board image and the local Y component value of each image block, compare the overall Y component value with the preset first component threshold value to obtain a first comparison result, and compare the local Y component value of each image block with the preset second component threshold value to obtain a second comparison result, thereby obtaining a screen detection result including the first comparison result and the second comparison result. Wherein, if the overall Y component value corresponding to the information board image is less than the first component threshold value, a first comparison result indicating that the information board has a fault can be obtained; for any image block, if the local Y component value corresponding to it is less than the second component threshold value, a second comparison result indicating that there is a bad pixel in the information board area corresponding to the image block can be obtained, and the coordinate position of the bad pixel can be further obtained, and the coordinate position of the bad pixel is sent to the information board control platform, and the information board control platform reviews the received detection result based on the received information to obtain a review result, and then generates a control instruction based on the review result, and sends the generated control instruction to the target information board, so as to control the target information board based on the control instruction.

[0079] In the above embodiment, by using the information board image in YUV format and extracting the Y component (brightness information) for analysis, the amount of data processed is greatly reduced compared to full-color analysis, thereby speeding up the processing speed and improving the efficiency of identifying bad pixels on the screen.

[0080] In one embodiment, as shown in FIG3 , an information board management method is also provided, which is described by taking the method applied to the image acquisition device in FIG1 as an example, and includes the following steps:

[0081] S302, photograph the target information board to obtain a photographed image including the target information board.

[0082] S304, segment the area where the target information board in the captured image is located to obtain an information board image; perform text recognition on the information board image to obtain the actual display text of the target information board; compare the actual display text with the preset display text to obtain a content detection result; when the content detection result indicates that there is an abnormality in the target information board, obtain the information board video stream; send the actual display text, the detection result and the information board video stream to the information board control platform.

[0083] S306, obtain the historical weather status of the environment where the target information board is located obtained from the most recent weather detection; perform weather detection on the captured image to obtain the current weather status of the environment where the target information board is located; compare the current weather status with the historical weather status to obtain the weather detection result; when the weather detection result indicates that there is an abnormality in the target information board, obtain the information board video stream; send the weather detection result and the information board video stream to the information board control platform.

[0084] S308, segment the area where the target information board in the captured image is located to obtain an information board image; perform screen anomaly detection on the information board image based on a preset screen detection algorithm to obtain a screen detection result; when the screen detection result shows that the target information board has an abnormality, obtain the information board video stream; send the information board image, screen detection result and information board video stream to the information board control platform.

[0085] S310, the information board control platform controls the target information board based on the received information.

[0086] The present application also provides an application scenario, which can be a specific information board control scenario on a highway, as shown in FIG4 , the image acquisition device in the application scenario can be a camera fixedly installed at a designated position, and the distance between the camera and the information board meets the distance condition, for example, on a horizontal ground at any distance in the range of 20m-50m from the information board, a base is fixed, and one end of a column with a height of 4-5 meters is fixedly installed on the base, and the column is perpendicular to the horizontal plane, and a camera is fixedly installed on the other end of the column, the camera head of the camera faces the information board, and the focal length of the camera lens is adjusted so that the information board accounts for about 1 / 2 of the camera monitoring screen, wherein the focal length of the camera lens used can be 4mm-18mm, and the camera is lifted up 5-30 degrees according to the installation position of the column. The above-mentioned information board management method can be specifically applied to this application scenario, referring to FIG5 , the camera is used for OCR recognition of the information board, weather recognition bad point detection, real-time image and real-time video acquisition and transmission, and information interaction of the information board information release platform; the information board is used to display the content to be released by the information board information release platform; the information board information release platform is used to release and confirm information.

[0087] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0088] Based on the same inventive concept, the embodiment of the present application also provides an information board management device for implementing the information board management method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more information board management device embodiments provided below can refer to the limitations of the information board management method above, and will not be repeated here.

[0089] In an exemplary embodiment, as shown in FIG6 , an information board management device is provided, including: an image capturing module 602, an abnormality detection module 604, a video stream acquisition module 606 and a detection result sending module 608, wherein:

[0090] An image shooting module 602 is used to shoot the target information board to obtain a shot image including the target information board;

[0091] Anomaly detection module 604, used to perform anomaly detection on the target information board based on the captured image and obtain a detection result;

[0092] The video stream acquisition module 606 is used to acquire the video stream of the information board when the detection result indicates that the target information board is abnormal;

[0093] The detection result sending module 608 is used to send the detection results and the information board video stream to the information board control platform, so that the information board control platform can perform fault diagnosis and control on the target information board based on the detection results and the information board video stream.

[0094] In one embodiment, anomaly detection includes at least one of screen anomaly detection, content anomaly detection and weather anomaly detection; the detection result includes at least one of screen detection result, content detection result and weather detection result; the anomaly detection module 604 is also used to: determine the items to be detected for the target information board; when the items to be detected are content detection items, perform content anomaly detection on the target information board based on the captured image to obtain content detection results; when the items to be detected are weather detection items, perform weather anomaly detection on the target information board based on the captured image to obtain weather detection results; when the items to be detected are screen detection items, perform screen anomaly detection on the target information board based on the captured image to obtain screen detection results.

[0095] In one embodiment, the base anomaly detection module 604 is also used to: segment the area where the target information board is located in the captured image to obtain an information board image; perform text recognition on the information board image to obtain the actual display text of the target information board; compare the actual display text with the preset display text to obtain a content detection result; the detection result sending module 608 is also used to: when the content detection result indicates that the target information board has a content anomaly, send the actual display text to the information board control platform.

[0096] In one embodiment, the anomaly detection module 604 is also used to: obtain the historical weather status of the environment where the target information board is located obtained from the most recent weather detection; perform weather detection on the captured image to obtain the current weather status of the environment where the target information board is located; and compare the current weather status with the historical weather status to obtain the weather detection result.

[0097] In one embodiment, the anomaly detection module 604 is further used to: segment the area where the target information board is located in the captured image to obtain an information board image; perform screen anomaly detection on the information board image based on a preset screen detection algorithm to obtain a screen detection result; the detection result sending module 608 is further used to: send the information board image to the information board control platform when the screen detection result indicates that the target information board has a screen anomaly.

[0098] In one embodiment, screen anomaly detection includes bad pixel detection, and the captured image is an image captured when the target information board is fully lit, and the information board image is a YUV format image; the anomaly detection module 604 is also used to: extract the Y component value of the information board image; compare the Y component value with a preset component threshold to obtain a screen detection result.

[0099] Each module in the information board management device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0100] In an exemplary embodiment, an image acquisition device is provided, and the computer device can be a terminal, and its internal structure diagram can be shown in Figure 7. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, a near field communication (Near Field Communication, NFC) or other technologies. When the computer program is executed by the processor, a method for managing an information board is implemented.

[0101] Those skilled in the art will understand that the structure shown in FIG. 7 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0102] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0103] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0104] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0105] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0106] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0107] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0108] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for managing an information board, characterized in that: Executed on an image acquisition device, the method comprises: photographing the target information board to obtain a photographed image including the target information board; Performing abnormality detection on the target information board based on the captured image to obtain a detection result; When the detection result indicates that the target information board is abnormal, obtaining the information board video stream; The detection result and the information board video stream are sent to an information board control platform, so that the information board control platform controls the target information board based on the detection result and the information board video stream.

2. The method according to claim 1, characterized in that The abnormality detection includes at least one of screen abnormality detection, content abnormality detection and weather abnormality detection; the detection result includes at least one of screen detection result, content detection result and weather detection result; the abnormality detection of the target information board based on the captured image to obtain the detection result includes: Determine the items to be detected for the target information board; When the item to be detected is a content detection item, performing content abnormality detection on the target information board based on the captured image to obtain a content detection result; When the item to be detected is a weather detection item, performing weather anomaly detection on the target information board based on the captured image to obtain a weather detection result; When the item to be detected is a screen detection item, screen abnormality detection is performed on the target information board based on the captured image to obtain a screen detection result.

3. The method according to claim 2, characterized in that The performing content anomaly detection on the target information board based on the captured image to obtain a content detection result includes: Segmenting the area where the target information board is located in the captured image to obtain an information board image; Performing text recognition on the information board image to obtain the actual display text of the target information board; Comparing the actual displayed text with the preset displayed text to obtain a content detection result; The method further includes: when the content detection result indicates that the target information board has abnormal content, sending the actual displayed text to the information board control platform.

4. The method according to claim 2, characterized in that: The step of performing weather anomaly detection on the target information board based on the captured image to obtain a weather detection result includes: Obtain the historical weather conditions of the environment where the target information board is located obtained from the most recent weather detection; Performing weather detection on the captured image to obtain the current weather conditions of the environment where the target information board is located; The current weather status is compared with the historical weather status to obtain a weather detection result.

5. The method according to claim 2, characterized in that: The performing screen abnormality detection on the target information board based on the captured image to obtain a screen detection result includes: Segmenting the area where the target information board is located in the captured image to obtain an information board image; Performing screen abnormality detection on the information board image based on a preset screen detection algorithm to obtain a screen detection result; The method further includes: when the screen detection result indicates that the target information board has a screen abnormality, sending the information board image to the information board control platform.

6. The method according to claim 5, characterized in that The screen abnormality detection includes bad pixel detection, the captured image is an image captured when the target information board is fully lit, and the information board image is a YUV format image; The screen abnormality detection is performed on the information board image based on a preset screen detection algorithm to obtain a screen detection result, including: Extracting the Y component value of the information board image; The Y component value is compared with a preset component threshold to obtain a screen detection result.

7. An information board management device, characterized in that: The device comprises: An image shooting module, used for shooting the target information board to obtain a shot image containing the target information board; An anomaly detection module, used to perform an anomaly detection on the target information board based on the captured image to obtain a detection result; A video stream acquisition module, used for acquiring a video stream of an information board when the detection result indicates that an abnormality exists in the target information board; The detection result sending module is used to send the detection result and the information board video stream to the information board control platform, so that the information board control platform can perform fault diagnosis and control on the target information board based on the detection result and the information board video stream.

8. An image acquisition device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images