A method and device for detecting faults of a display screen and an inspection robot

Abstract

Embodiments of the present disclosure disclose a method, apparatus, and inspection robot for detecting faults in a display screen. The method includes: obtaining an image to be detected; wherein, the image to be detected is obtained by the inspection device taking a picture of the tiled display screen during movement, and the image to be detected is the display image of any one of the display screens in the tiled display screen; the display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point; based on a preset coordinate system, determining a set of coordinates to be detected formed by the respective imaging coordinates of the imaging points with the same RGB value in the image to be detected; comparing the set of coordinates to be detected with at least one preset set of fault point coordinates respectively, and if the comparison is successful, determining the fault type of the display screen; wherein, one fault type of the display screen corresponds to at least one preset set of fault point coordinates. To achieve automatic detection of the display screen, improving the efficiency and accuracy of detection.

Description

Technical Field

[0001] The present disclosure relates to the field of display technologies, and particularly to a method and device for detecting faults of a display screen and an inspection robot. Background Art

[0002] With the development of technology, the application of display systems has become more and more extensive, and the display area has become larger and larger. Large ground display LEDs (light-emitting diodes) generally include thousands of LED screens. In order to ensure normal display, regular inspections are required to discover and handle faults in a timely manner. However, the increasing display area has led to greater difficulty in inspecting the screen, bringing huge pressure to the troubleshooting of ground displays.

[0003] In related technologies, usually, inspection personnel visually inspect, or overlook through a telescope. However, manual inspection has a high labor intensity and great coordination difficulty; overlooking may not be able to detect most problems. The detection efficiency and accuracy of both are relatively low. Summary of the Invention

[0004] Embodiments of the present disclosure provide a method and device for detecting faults of a display screen and an inspection robot, so as to realize automatic detection of the display screen and improve the detection efficiency and accuracy.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for detecting faults of a display screen, including:

[0006] Obtaining an image to be detected; wherein, the image to be detected is obtained by an inspection device taking a picture of a tiled display screen during movement, and the image to be detected is a display image of any one of the display screens in the tiled display screen; the display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point;

[0007] Based on a preset coordinate system, determining a set of coordinates to be detected composed of the imaging coordinates of the imaging points with the same RGB value in the image to be detected;

[0008] Comparing the set of coordinates to be detected with at least one preset set of fault point coordinates respectively. If the comparison is successful, determining the fault type of the display screen; wherein, one fault type of the display screen corresponds to at least one preset set of fault point coordinates.

[0009] In a second aspect, an embodiment of the present disclosure provides an inspection device for detecting faults of a display screen, which is applied to the method in the first aspect and includes an inspection robot, a frame, a light-shielding part, and an image acquisition device;

[0010] The bottom of the frame is provided with wheels for controlling the movement of the inspection device;

[0011] The image acquisition device is located in the space formed by the frame body and the light-shielding part, and is arranged on the inspection robot and faces the side of the splicing display screen, and is used to photograph the splicing display screen to obtain an image to be detected; wherein, the image to be detected is the display image of any one of the display screens in the splicing display screen;

[0012] The inspection robot receives the image to be detected from the image acquisition device, and determines whether the display screen is faulty and the type of the fault according to the image to be detected.

[0013] In a third aspect, an embodiment of the present disclosure provides a device for detecting faults of a display screen, which includes:

[0014] An image acquisition module, which acquires an image to be detected; wherein, the image to be detected is obtained by photographing a splicing display screen during the movement of an inspection device, and the image to be detected is the display image of any one of the display screens in the splicing display screen; the display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point;

[0015] A coordinate determination module, which is used to determine a set of coordinates to be detected composed of the respective imaging coordinates of the imaging points with the same RGB value in the image to be detected based on a preset coordinate system;

[0016] A fault determination module, which compares the set of coordinates to be detected with at least one set of preset fault point coordinates respectively. If the comparison is successful, it determines the type of the fault of the display screen; wherein, one type of fault of the display screen corresponds to at least one set of preset fault point coordinates.

[0017] In a fourth aspect, an embodiment of the present disclosure provides an inspection robot, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the steps of any one of the above methods are implemented.

[0018] In a fifth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the steps of any one of the above methods are implemented.

[0019] The embodiments of the present disclosure have the following beneficial effects:

[0020] Obtain the image to be detected captured by the inspection device during movement for the tiled display screen (the display image of any one display screen in the tiled display screen), and the display screen includes a number of LED lamp beads, and each LED lamp bead corresponds to an imaging point. Based on the preset coordinate system, determine the set of coordinates to be detected composed of the imaging coordinates of the imaging points with the same RGB value in the image to be detected. Considering the circuit characteristics of the display screen, a type of display screen failure corresponds to at least one preset set of failure point coordinates, and each coordinate in the preset set of failure point coordinates represents the positional relationship between the failure points under the corresponding failure type. Therefore, compare the set of coordinates to be detected with at least one preset set of failure point coordinates set in advance respectively. If the comparison is successful, determine the failure type of the display screen. Compared with manual inspection, it realizes the automatic detection of the display screen and improves the detection efficiency and accuracy. Description of the Drawings

[0021] To more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following will briefly introduce the drawings required to be used in the embodiments of the present disclosure. Obviously, the following introduced drawings are only some embodiments of the present disclosure. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0022] Figure 1 Schematic diagram of the application scenario of a method for detecting failures of a display screen provided by an embodiment of the present disclosure;

[0023] Figure 2 Schematic diagram of the structure of an inspection device for detecting display screen failures provided by an embodiment of the present disclosure;

[0024] Figure 3 Flowchart of a method for detecting failures of a display screen provided by an embodiment of the present disclosure;

[0025] Figure 4 Schematic diagram of the imaging points of a one-way signal loss failure provided by an embodiment of the present disclosure;

[0026] Figure 5 Schematic diagram of the imaging points of another one-way signal loss failure provided by an embodiment of the present disclosure;

[0027] Figure 6 Schematic diagram of the imaging points of an LED controller failure provided by an embodiment of the present disclosure;

[0028] Figure 7 Schematic diagram of the imaging points of another LED controller failure provided by an embodiment of the present disclosure;

[0029] Figure 8Schematic diagram of imaging points of LED lamp bead faults provided by an embodiment of the present disclosure;

[0030] Figure 9 Working principle diagram of another inspection device provided by an embodiment of the present disclosure;

[0031] Figure 10 Structural schematic diagram of a fault detection device for a display screen provided by an embodiment of the present disclosure;

[0032] Figure 11 Structural schematic diagram of an inspection robot provided by an embodiment of the present disclosure. Detailed implementation manners

[0033] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure.

[0034] For ease of understanding, the terms involved in the embodiments of the present disclosure are explained below:

[0035] (1) LED is a commonly used light-emitting device that emits light by the recombination of electrons and holes.

[0036] Any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction and does not have any limiting meaning.

[0037] In the specific practice process, large-scale ground display LEDs generally include thousands of LED display screens. To ensure normal display, regular inspections are required to detect faults and handle them in a timely manner. However, the increasing display area has made the inspection of the screen more and more difficult, bringing great pressure to the troubleshooting of ground displays.

[0038] In the related art, usually inspection personnel conduct visual inspections, or overlook from a telescope. However, visual inspection by personnel has a high labor intensity and cannot be carried out frequently. There are many people on the screen, and the coordination difficulty is large. For example, it cannot be carried out simultaneously during the use of the screen. Personnel detection is restricted by time, and visual inspection is seriously interfered by sunlight. Personnel cannot get close to the screen for inspection, and kneeling or sitting postures will greatly increase the labor intensity. Overlooking cannot detect most problems and can only ensure the general display effect. In short, the detection efficiency and accuracy of both are relatively low.

[0039] To this end, the present disclosure provides a method for detecting faults in a display screen. In this method, during the movement of the patrol device, a splicing display screen is photographed, and a display image of any one of the display screens in the splicing display screen is obtained as the image to be detected. Each display screen includes a plurality of lamp beads, and each LED lamp bead corresponds to an imaging point. Therefore, after obtaining the image to be detected, a set of coordinates to be detected is determined, which is composed of the imaging coordinates of the imaging points with the same RGB value in the image to be detected. Since at least one preset fault point coordinate set corresponds to a fault type of a display screen, the set of coordinates to be detected is respectively compared with at least one preset fault point coordinate set. If the comparison is successful, the fault type of the display screen is determined. The automatic detection of the display screen is realized, and the detection efficiency and accuracy are improved.

[0040] After introducing the design concept of the embodiments of the present disclosure, the following briefly introduces the application scenarios applicable to the technical solutions of the embodiments of the present disclosure. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present disclosure rather than to limit them. In specific implementation, the technical solutions provided by the embodiments of the present disclosure can be flexibly applied according to actual needs.

[0041] Reference Figure 1 , which is a schematic diagram of the application scenario of a method for detecting faults in a display screen provided by an embodiment of the present disclosure. Since large-scale ground display LEDs generally include thousands of LED display screens, and each display screen includes a plurality of LED lamp beads. The fault may be that a certain display screen is damaged, or a certain one or several LED lamp beads in a display screen are faulty. Figure 1 The number and position indications of the display screens and LED lamp beads in

[0042] Of course, the method provided by the embodiments of the present disclosure is not limited to Figure 1 the application scenario shown in Figure 1 and can also be used in other possible application scenarios. The embodiments of the present disclosure do not limit this. The functions that can be realized by each device in

[0043] To further illustrate the technical solutions provided by the embodiments of the present disclosure, the following will be described in detail in combination with the drawings and specific implementation manners. Although the embodiments of the present disclosure provide method operation steps as shown in the following embodiments or drawings, based on routine or non-creative labor, more or fewer operation steps may be included in the method. In steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiments of the present disclosure.

[0044] The following will be described in combination with Figure 1The application scenarios shown are used to illustrate the technical solutions provided by the embodiments of the present disclosure.

[0045] Refer to Figure 2 , the inspection device in the embodiments of the present application is described as follows:

[0046] The inspection device includes an inspection robot 21, a frame 22, a light-shielding part 23, and an image acquisition device 24. Among them, wheels are provided at the bottom of the frame 22 for controlling the movement of the inspection device. The image acquisition device 24 is, for example, a camera, located in the space formed by the frame 22 and the light-shielding part 23, and is arranged on the inspection robot 21 and faces the side of the splicing screen, for taking pictures of the splicing display screen to obtain the display image of any one display screen as the image to be detected. The inspection robot 21 receives the image to be detected from the image acquisition device 24 and determines whether the display screen is faulty and the type of fault according to the image to be detected.

[0047] In this inspection device, the light-shielding part 23 can create a dark room to ensure that the external environment is the same for each inspection. And the introduction of the inspection device reduces the floor area occupied by the display screen.

[0048] Next, the fault detection process of the display screen is described:

[0049] Refer to Figure 3 , the embodiments of the present disclosure provide a method for detecting faults in a display screen, including the following steps:

[0050] S301. Obtain the image to be detected; among them, the image to be detected is obtained by the inspection device taking pictures of the splicing display screen during the movement process, and the image to be detected is the display image of any one display screen in the splicing display screen; the display screen includes a number of LED lamp beads, and each LED lamp bead corresponds to an imaging point;

[0051] S302. Based on a preset coordinate system, determine the set of coordinates to be detected composed of the respective imaging coordinates of the imaging points with the same RGB value in the image to be detected;

[0052] S303. Compare the set of coordinates to be detected with at least one preset set of fault point coordinates respectively. If the comparison is successful, determine the type of fault of the display screen; among them, one type of fault of the display screen corresponds to at least one preset set of fault point coordinates.

[0053] In an embodiment of the present application, a to-be-detected image obtained by the inspection device during movement by photographing a spliced display screen (the display image of any one display screen in the spliced display screen) is acquired. The display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point. Based on a preset coordinate system, a to-be-detected coordinate set composed of the imaging coordinates of the imaging points with the same RGB value in the to-be-detected image is determined. Considering the circuit characteristics of the display screen, a failure type of a display screen corresponds to at least one preset failure point coordinate set, and each coordinate in the preset failure point coordinate set represents the positional relationship between the failure points under the corresponding failure type. Therefore, the to-be-detected coordinate set is compared with at least one preset failure point coordinate set set in advance respectively. If the comparison is successful, the failure type of the display screen is determined. Compared with manual inspection, the automatic detection of the display screen is realized, and the detection efficiency and accuracy are improved.

[0054] Regarding S201, large-scale ground display LEDs usually include thousands of LED screens, and each LED screen is called a display screen, which are spliced together. By adjusting the installation position and shooting angle of the camera in the inspection device, the shooting range is set to the size of one display screen. However, in the actual shooting process, the obtained display image may be a part of one display screen, and such a display image is discarded. The obtained display image may be an image presented by more than one display screen. At this time, a to-be-detected image of one display screen can be obtained by image cropping. If the obtained display image is exactly one display screen, it can be directly used as the to-be-detected image. Therefore, the to-be-detected image is the display image of any one display screen.

[0055] In addition, there is no limitation on the playback material of the display screen during the shooting process. The display screen may be in use, for example, during program rehearsal, and the playback material may be the program material during the rehearsal process.

[0056] Regarding S302, taking one display screen as an example, the display screen includes a plurality of LED lamp beads, such as 960*960 LED lamp beads. In the obtained to-be-detected image, each LED lamp bead corresponds to an imaging point. Therefore, after obtaining the to-be-detected image, the RGB values of each imaging point in the to-be-detected image and the imaging coordinates of each imaging point can be obtained.

[0057] Exemplarily, the preset coordinate system is pre-established or pre-stored. Among them, the origin of the preset coordinate system is the upper left vertex of the display screen, the abscissa represents the row number of the imaging point, the ordinate represents the column number of the imaging point, the horizontal axis direction is downward from the origin, and the vertical axis direction is to the right from the origin. Taking 960*960 LED lamp beads as an example, the coordinate of the imaging point in the first row and the first column is (1,1), the coordinate of the imaging point in the second row and the third column is (2,3), and the coordinate of the imaging point in the 960th row and the 960th column is (960,960).

[0058] If the display screen has no faults, the RGB values of each imaging point are the RGB values corresponding to the color of the display material itself. However, when a fault occurs in the display screen, multiple imaging points with the same RGB values may appear at positions with a certain pattern. Therefore, the imaging points with the same RGB values in the image to be detected are screened out, and the set composed of their coordinates is the set of coordinates to be detected.

[0059] Regarding S303, since the fault types of the display screen generally fall into several categories, and one fault type of the display screen corresponds to at least one set of preset fault point coordinates. The coordinates of the fault points corresponding to the corresponding fault type are stored in the set of preset fault point coordinates, and the positional relationship between each fault point can be known according to this set of preset fault point coordinates.

[0060] The set of coordinates to be detected is respectively compared with at least one set of preset fault point coordinates set in advance. When the comparison is successful, the fault type of the display screen can be determined.

[0061] Next, different fault types and their respective determination processes will be described:

[0062] Fault type 1: One-way signal loss fault.

[0063] Refer to Figure 4 , each square represents an imaging point of an LED lamp bead. In the case where the display screen is not faulty, the RGB value of the imaging point corresponding to each lamp bead is the original RGB value of the image to be detected. However, since the display screen system is a dual-backup system, that is, when one-way signal is lost, Figure 4 the LED lamps with the exemplary positional relationship will present the same color, and the other LED lamp beads display the original color. Taking a display screen with 960*960 lamp beads as an example, for the sake of representation Figure 4 and Figure 5 only show 4*4 lamp beads, and the display rules of the other lamp beads are the same as those of the shown lamp beads. Then Figure 4 in the example, it is the loss of signal A. Correspondingly, Figure 5 in the example, it is the loss of signal B.

[0064] It should be noted that Figure 4 and Figure 5 in, the white imaging points are the non-faulty imaging points and display the original color of the display material. The white indication is used for illustration. The black imaging points are the faulty imaging points and display the same color (not necessarily black, and black is only used for illustration), but the specific color type has no necessary connection with the fault type. And based on the chip characteristics of the display, the colors of the black imaging points are the same. For example, Figure 4 in the black imaging points are all purple.

[0065] Fault type 2: At least one LED controller fails.

[0066] See Figure 6 , according to the design of the LED circuit and the characteristics of the LED controller, it can be known that the number of LED beads controlled by an LED controller is related to the type of the LED controller. When an LED controller fails, the display of the LED beads it controls will show corresponding characteristics. Taking an LED controller of one type as an example, see Figure 6 , the failure of this controller can cause Figure 6 the 8 fault points shown in Figure 6 (the black indication in Figure 7 ). For example, 61 is the imaging point of the LED beads controlled by LED controller 1, and 62 is the imaging point of the LED beads controlled by LED controller 2. For another type of LED controller, see Figure 7 , the failure of this controller can cause Figure 6 the 8 fault points shown in Figure 7 , 71 is the imaging point of the LED beads controlled by LED controller 3, and 72 is the imaging point of the LED beads controlled by LED controller 4. Figure 4 and Figure 5 The meanings of the black imaging points and white imaging points in

[0067] The determination process of the first case, fault type 1:

[0068] The preset fault point coordinate set includes the first preset fault point coordinate set. At this time, the coordinate set to be detected is compared with the first preset fault point coordinate set; if each coordinate in the coordinate set to be detected is equal to each coordinate in the first preset fault point coordinate set respectively, it is determined that the comparison is successful, and the fault type of the display screen is determined to be a single-channel signal loss fault or all LED controller faults.

[0069] Exemplarily, the first fault coordinate set stores the coordinates of each fault point at the position rule corresponding to fault type 1. From the actual situation, it can be known that when all LED controllers fail, the display conditions of each LED bead may be the same as those of a single-channel signal loss. In this case, it is necessary to further confirm the fault type manually.

[0070] In this case, the first preset fault point coordinate set is obtained by performing the following operations based on the coordinates of each imaging point of the display screen:

[0071] Starting from the first preset imaging point in the first row, increase the ordinate successively by a set step size, and the coordinates of each obtained imaging point form a first coordinate set; starting from the second preset imaging point in the second row, increase the abscissa successively by the set step size, and the coordinates of each obtained imaging point form a second coordinate set; for each imaging point in the first coordinate set, increase the ordinate successively by the set step size, and the coordinates of each obtained imaging point form a third coordinate set; for each imaging point in the first coordinate set, increase the ordinate successively by the set step size, and the coordinates of each obtained imaging point form a fourth coordinate set; determine that the first coordinate set, the second coordinate set, the third coordinate set, and the fourth coordinate set form a first preset fault point coordinate set; wherein, if the first preset imaging point is the second imaging point in the first row, then the second preset imaging point is the first imaging point in the second row; if the first preset imaging point is the first imaging point in the first row, then the second preset imaging point is the second imaging point in the second row.

[0072] Exemplarily, since the display screen system is a dual-backup system, therefore, when the A-channel signal is lost and the B-channel signal is lost, the coordinates in the corresponding coordinate set of the first fault point are different.

[0073] When the A-channel signal is lost, the first preset imaging point in the first row is the second imaging point in the first row, and the coordinate is (1, 2). Among 960 * 960 imaging points, increase the ordinate successively by a set step size (such as 2), and obtain (1, 4), (1, 6)…(1, 958), (1, 960). The coordinates of these points form the first coordinate set, and these points are all imaging points in the first row.

[0074] The second preset imaging point in the second row is the first imaging point in the second row, and the coordinate is (2, 1). Among 960 * 960 imaging points, increase the ordinate successively by a set step size (such as 2), and obtain (2, 3), (2, 5)…(2, 957), (2, 959). The coordinates of these points form the second coordinate set, and these points are all imaging points in the second row.

[0075] For each imaging point in the first coordinate set, increase the abscissa successively by the set step size. For example, for (1, 2), after successively increasing the abscissa, obtain (3, 2), (5, 2)…(957, 2), (959, 2). In this way, perform the same operation for each point in the first coordinate set, and obtain the third coordinate set. The points in the third coordinate set are imaging points in the 2nd column, 4th column…958th column and 960th column.

[0076] For each imaging point in the second coordinate set, increase the abscissa successively according to the set step size. For example, for (2,1), after successively increasing the abscissa, we get (4,1), (6,1)…(958,1), (960,1). In this way, the same operation is performed for each point in the second coordinate set to obtain the fourth coordinate set. The points in the fourth coordinate set are the imaging points in the 1st column, 3rd column…957th column and 959th column.

[0077] As above, determine that the first coordinate set, the second coordinate set, the third coordinate set, and the fourth coordinate set constitute the first preset fault point coordinate set.

[0078] The above example is described according to the situation of the loss of signal on path A. When the signal on path B is lost, the first preset imaging point is the first imaging point in the first row, and the second preset imaging point is the second imaging point in the second row. The other steps are the same and will not be elaborated here.

[0079] The second case, the determination process of fault type 2:

[0080] The preset fault point coordinate set includes the second preset fault point coordinate set. At this time, compare the coordinate set to be detected with each second preset fault point coordinate subset respectively. If the comparison is successful, it is determined that the LED control chip corresponding to the successfully compared second preset fault point coordinate subset is faulty.

[0081] Exemplarily, for example, if an LED control chip controls 16 LEDs in a specific arrangement, then a 960*960 display screen consists of 57,600 LED control chips, and the coordinates of the fault points corresponding to the failure of each LED control chip form a subset.

[0082] In this case, each second preset fault point coordinate subset is obtained by performing the following operations based on the coordinates of each imaging point on the display screen:

[0083] Among the imaging points controlled by the same LED control chip, determine the third preset imaging point; based on the preset coordinate system, starting from the third preset imaging point, increase the abscissa successively according to the set step size to obtain the first group of preset number of imaging points; where the preset number is determined according to the type of the LED control chip; determine the imaging point at the preset position relationship of the third preset imaging point as the fourth preset imaging point, and starting from the fourth preset imaging point, increase the abscissa successively according to the set step size to obtain the second group of preset number of imaging points; determine that the coordinates of the first group of preset number of imaging points and the second group of preset number of imaging points constitute the second preset fault point coordinate subset.

[0084] Among them, combined with Figure 6, for the imaging points of the control chip of the same LED, they form an imaging point group of 8×2. Starting from the first group of imaging points in the upper left corner of the display screen, if the third preset imaging point is, for example, the second imaging point in the first row, its coordinate is (1, 2). Then, by increasing the abscissa in sequence according to the set step length (such as 2), we get (3, 2), (5, 2), and (7, 2). In this example, the first preset quantity is 4, and the preset positional relationship is the lower left diagonal. That is, the coordinate of the fourth preset imaging point is (2, 1), and then by increasing the abscissa in sequence according to the set step length (such as 2), we get (4, 1), (6, 1), and (8, 1). In this way, the points included in the second preset fault point coordinate subset in this example are (1, 2), (3, 2), (5, 2), (7, 2), (2, 1), (4, 1), (6, 1), and (8, 1).

[0085] As described above, the loss of one - way signal fault and the fault of the LED control chip are explained. Although the above two faults are the most common faults leading to display screen faults, in actual application processes, there may be other faults.

[0086] Considering that the fault type may also be the fault of the LED lamp bead itself, for example, caused by excessive pressure. Therefore, if the set of coordinates to be detected fails to match with at least one set of preset fault point coordinates, and it is determined that it is not a one - way signal fault and not a fault of the LED control chip, then the detection of the fault of the LED lamp bead itself is carried out.

[0087] In a large - scale ground display system, in order to improve the display effect, usually multiple imaging points form an image pixel point. The number of imaging points forming an image pixel point is represented by the second preset quantity, which is determined by the design principles of the loop signal and backup signal of the display screen. Exemplarily, it can be 4, and 4 pixel points are arranged in a square matrix. When the display screen is not faulty, the RGB of an image pixel point is the same and is the color of the image itself. Therefore, for any group of 4 imaging points forming an image pixel point, judge whether the RGB values of the second preset quantity are the same. If the RGB value of at least one imaging point is different from the RGB values of other imaging points, then it is determined that the LED lamp bead corresponding to the different imaging point is faulty.

[0088] In a specific example, Figure 8 shows a situation of LED lamp bead fault. In this example, if the color of imaging point 82 is different from the colors of imaging points 81, 83, and 84, then it is determined that the LED lamp bead of imaging point 82 is faulty. Figure 8 The meanings of the black imaging points and white imaging points in Figure 4 and Figure 5 are the same as those in, and will not be elaborated here.

[0089] In addition, when none of the following faults occur: a single-channel signal fault, an LED control chip fault, or an LED lamp bead fault, the image to be detected can be sent to the server. The server has pre-stored the display screens of each display at the current moment. The server determines the display screen corresponding to the image to be detected based on the current position of the inspection device, that is, the standard image. The image to be detected is compared with the standard image to determine whether the display screen is faulty and the type of the fault. Specifically, an image processing algorithm can be used, which is not limited here.

[0090] During the process of determining the type of the fault of the display screen, the coordinates of each fault point can be obtained. Therefore, while determining the type of the fault, the positions of each fault point on the display screen can also be determined. In addition, the position information of the faulty display screen in the tiled display screen is determined according to the current position of the inspection device; the position information is sent to the server and / or the mobile terminal bound to the inspection device, so that the operation and maintenance personnel can accurately find the faulty display screen for repair according to the position information, and can also timely know the position of the fault point on the display screen.

[0091] In the embodiments of the present application, there is no limitation on the materials played on the display screen. That is, during the use of the display screen, for example, during the rehearsal of actors, the inspection can also be carried out synchronously, and the inspection is carried out under dynamic materials, which can also improve the robustness. In this way, in order to improve the inspection efficiency, the inspection device can be path-planned. In this way, when the inspection device is moved outside the venue and then returns to the venue, the inspection can also continue according to the recorded historical position. The positioning function of the inspection device can be determined by the positioning device to obtain the position information of each display screen in the venue in real time. The inspection device can also report its own position to the server in real time and receive the real-time path sent by the server. As described above, the inspection device replaces manual inspection, which not only improves the automation degree of the inspection side, but also improves the accuracy and efficiency of the detection.

[0092] In addition, referring to Figure 9 , only the moving and shooting functions of the inspection device can also be used, and its movement is manually controlled. Figure 9 In

[0093] As Figure 10 shown, based on the same inventive concept as the above display screen fault detection method, the embodiments of the present disclosure also provide a display screen fault detection device, which at least includes an image acquisition module 1001, a coordinate determination module 1002, and a fault determination module 1003.

[0094] An image acquisition module 1001 acquires an image to be detected. The image to be detected is obtained by the inspection device taking a picture of the tiled display screen during movement. The image to be detected is the display image of any one of the display screens in the tiled display screen. The display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point.

[0095] A coordinate determination module 1002 is configured to determine a set of coordinates to be detected formed by the respective imaging coordinates of the imaging points with the same RGB value in the image to be detected based on a preset coordinate system.

[0096] A fault determination module 1003 compares the set of coordinates to be detected with at least one preset set of fault point coordinates set in advance. If the comparison is successful, the fault type of the display screen is determined. Among them, one fault type of the display screen corresponds to at least one preset set of fault point coordinates.

[0097] In some exemplary embodiments, the preset set of fault point coordinates includes a first preset set of fault point coordinates. The fault determination module 1003 is specifically configured to:

[0098] Compare the set of coordinates to be detected with the first preset set of fault point coordinates.

[0099] If each coordinate in the set of coordinates to be detected is respectively equal to each coordinate in the first preset set of fault point coordinates, it is determined that the comparison is successful, and the fault type of the display screen is determined to be a one-way signal loss fault or an all-LED controller fault.

[0100] In some exemplary embodiments, it further includes a coordinate determination module, which is configured to perform the following operations based on the coordinates of each imaging point of the display screen to determine the first preset set of fault point coordinates:

[0101] Based on the preset coordinate system, starting from the first preset imaging point in the first row, the ordinate is sequentially increased by a set step length, and the coordinates of the obtained imaging points form a first coordinate set. The origin of the preset coordinate system is the upper left vertex of the display screen. The abscissa represents the row number of the imaging point, the ordinate represents the column number of the imaging point, the horizontal axis direction is downward from the origin, and the vertical axis direction is to the right from the origin.

[0102] Starting from the second preset imaging point in the second row, the ordinate is sequentially increased by a set step length, and the coordinates of the obtained imaging points form a second coordinate set.

[0103] For each imaging point in the first coordinate set, the abscissa is sequentially increased by a set step length, and the coordinates of the obtained imaging points form a third coordinate set.

[0104] For each imaging point in the first coordinate set, the abscissa is sequentially increased by a set step length, and the coordinates of the obtained imaging points form a fourth coordinate set.

[0105] Determine that the first coordinate set, the second coordinate set, the third coordinate set, and the fourth coordinate set form a first preset fault point coordinate set;

[0106] Wherein, if the first preset imaging point is the second imaging point in the first row, then the second preset imaging point is the first imaging point in the second row; if the first preset imaging point is the first imaging point in the first row, then the second preset imaging point is the second imaging point in the second row.

[0107] In some exemplary embodiments, the preset fault point coordinate set includes a second preset fault point coordinate set, and the second preset fault point coordinate set includes at least one second preset fault point coordinate subset;

[0108] The fault determination module 1003 is specifically configured to:

[0109] Compare the coordinate set to be detected with each second preset fault point coordinate subset respectively. If the comparison is successful, determine that the LED control chip corresponding to the successfully compared second preset fault point coordinate subset is faulty.

[0110] In some exemplary embodiments, the coordinate determination module is configured to perform the following operations based on the coordinates of each imaging point of the display screen to obtain a determined second preset fault point coordinate subset:

[0111] Determine a third preset imaging point among the imaging points controlled by the same LED control chip;

[0112] Based on a preset coordinate system, starting from the third preset imaging point, increase the abscissa sequentially according to a set step size to obtain a first set of a preset number of imaging points; wherein, the preset number is determined according to the type of the LED control chip; wherein, the origin of the preset coordinate system is the upper left vertex of the display screen, the abscissa represents the row number of the imaging point, the ordinate represents the column number of the imaging point, the horizontal axis direction is downward from the origin, and the vertical axis direction is to the right from the origin;

[0113] Determine the imaging point at the preset position relationship of the third preset imaging point as the fourth preset imaging point, and starting from the fourth preset imaging point, increase the abscissa sequentially according to a set step size to obtain a second set of a preset number of imaging points;

[0114] Determine that the coordinates of the first set of a preset number of imaging points and the second set of a preset number of imaging points form a second preset fault point coordinate subset.

[0115] In some exemplary embodiments, the fault determination module 1003 is further configured to:

[0116] If the set of coordinates to be detected fails to match with at least one set of preset fault point coordinates, then for any group of a second preset number of imaging points that form an image pixel point, determine whether the RGB values of the second preset number are the same;

[0117] If not, determine that the LED lamp beads corresponding to the different imaging points are faulty.

[0118] In some exemplary embodiments, the fault determination module 1003 is further configured to:

[0119] If the set of coordinates to be detected fails to match with at least one set of preset fault point coordinates and there is no LED lamp bead fault, then send the image to be detected to the server, so that the server determines the standard image corresponding to the image to be detected in the pre-stored image set, and compare the image to be detected with the standard image to determine whether the display screen is faulty and the type of the fault.

[0120] In some exemplary embodiments, it further includes a location information sending module, which is configured to, after determining the type of the fault of the display screen:

[0121] Determine the location information of the faulty display screen in the tiled display screen according to the current location of the inspection device;

[0122] Send the location information to the server and / or the mobile terminal bound to the inspection device.

[0123] The display screen fault detection device provided by the embodiments of the present disclosure adopts the same inventive concept as the above-mentioned display screen fault detection method, and can achieve the same beneficial effects, which will not be elaborated here.

[0124] Based on the same inventive concept as the above-mentioned display screen fault detection method, the embodiments of the present disclosure further provide an inspection robot, which may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), a server, etc. As Figure 11 shown, the inspection robot may include a processor 111 and a memory 112.

[0125] The processor 111 may be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present disclosure. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in combination with the embodiments of the present disclosure may be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

[0126] The memory 112, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The memory may include at least one type of storage medium, for example, it may include flash memory, hard disk, multimedia card, card-type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic memory, magnetic disk, optical disk, and so on. The memory is any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 112 in the embodiments of the present disclosure may also be a circuit or any other device capable of implementing a storage function, for storing program instructions and / or data.

[0127] Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions. The foregoing program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps including those of the above method embodiments; the above computer storage medium can be any available medium or data storage device accessible by a computer, including but not limited to: removable storage devices, random access memory (RAM), magnetic memories (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical memories (such as CDs, DVDs, BDs, HVDs, etc.), and semiconductor memories (such as ROMs, EPROMs, EEPROMs, non-volatile memories (NAND FLASH), solid state drives (SSD)), etc., which are various media that can store program codes.

[0128] Alternatively, if the above integrated unit is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiments of the present disclosure, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods of the various embodiments of the present disclosure. The foregoing storage medium includes: removable storage devices, random access memory (RAM), magnetic memories (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical memories (such as CDs, DVDs, BDs, HVDs, etc.), and semiconductor memories (such as ROMs, EPROMs, EEPROMs, non-volatile memories (NAND FLASH), solid state drives (SSD)), etc., which are various media that can store program codes.

[0129] The above embodiments are only used to introduce the technical solutions of the present disclosure in detail. However, the descriptions of the above embodiments are only for helping to understand the methods of the embodiments of the present disclosure, and should not be construed as a limitation to the embodiments of the present disclosure. Any changes or substitutions that can be easily thought of by those skilled in the art of this technology should be covered within the protection scope of the embodiments of the present disclosure.

Claims

1. A method for detecting faults in a display screen, wherein, Including: Obtain an image to be detected; wherein, the image to be detected is obtained by the inspection device taking a picture of the tiled display screen during movement, and the image to be detected is the display image of any one of the display screens in the tiled display screen; the display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point; Based on a preset coordinate system, determine a set of coordinates to be detected composed of the imaging coordinates of the imaging points with the same RGB value in the image to be detected; Compare the set of coordinates to be detected with at least one preset set of fault point coordinates set in advance. If the comparison is successful, determine the fault type of the display screen; wherein, one fault type of the display screen corresponds to at least one preset set of fault point coordinates; Among them, the preset set of fault point coordinates includes a first preset set of fault point coordinates or a second preset set of fault point coordinates; the second preset set of fault point coordinates includes at least one second preset subset of fault point coordinates; The first preset set of fault point coordinates is obtained by increasing the abscissa or ordinate in a set step size based on the preset coordinate system, a first preset imaging point, and a second preset imaging point; Each of the second preset subsets of fault point coordinates is obtained by increasing the abscissa in a set step size based on the preset coordinate system and a third preset imaging point among the imaging points controlled by the same LED control chip.

2. The method according to claim 1, when the preset set of fault point coordinates includes the first preset set of fault point coordinates, the comparing the set of coordinates to be detected with at least one preset set of fault point coordinates, if the comparison is successful, then determining the fault type of the display screen includes: Compare the set of coordinates to be detected with the first preset set of fault point coordinates; If each coordinate in the set of coordinates to be detected is respectively equal to each coordinate in the first preset set of fault point coordinates, determine that the comparison is successful, and determine that the fault type of the display screen is a one-way signal loss fault or an all-LED controller fault.

3. The method according to claim 2, wherein The method further includes: Based on the preset coordinate system, starting from the first preset imaging point in the first row, increase the ordinate in a set step size in sequence, and the coordinates of each obtained imaging point form a first set of coordinates; wherein, the origin of the preset coordinate system is the upper left vertex of the display screen, the abscissa represents the row number of the imaging point, the ordinate represents the column number of the imaging point, the horizontal axis direction is downward from the origin, and the vertical axis direction is to the right from the origin; Starting from the second preset imaging point in the second row, increase the ordinate in the set step size in sequence, and the coordinates of each obtained imaging point form a second set of coordinates; For each imaging point in the first set of coordinates, increase the abscissa in the set step size in sequence, and the coordinates of each obtained imaging point form a third set of coordinates; For each imaging point in the second set of coordinates, increase the abscissa in the set step size in sequence, and the coordinates of each obtained imaging point form a fourth set of coordinates; Determine that the first set of coordinates, the second set of coordinates, the third set of coordinates, and the fourth set of coordinates form the first preset set of fault point coordinates; Wherein, if the first preset imaging point is the second imaging point in the first row, then the second preset imaging point is the first imaging point in the second row; if the first preset imaging point is the first imaging point in the first row, then the second preset imaging point is the second imaging point in the second row.

4. According to the method described in claim 1, when the preset fault point coordinate set includes a second preset fault point coordinate set, and the second preset fault point coordinate set includes at least one second preset fault point coordinate subset; The step of comparing the set of coordinates to be detected with at least one preset fault point coordinate set respectively, and if the comparison is successful, determining the fault type of the display screen, includes: Comparing the set of coordinates to be detected with each second preset fault point coordinate subset respectively. If the comparison is successful, determining that the LED control chip corresponding to the successfully compared second preset fault point coordinate subset is faulty.

5. According to the method described in claim 4, the method further includes: Determining a third preset imaging point among the imaging points controlled by the same LED control chip; Based on the preset coordinate system, starting from the third preset imaging point, increasing the abscissa in sequence according to a set step size to obtain a first set of a preset number of imaging points; wherein, the preset number is determined according to the type of the LED control chip; wherein, the origin of the preset coordinate system is the upper left vertex of the display screen, the abscissa represents the row number of the imaging point, the ordinate represents the column number of the imaging point, the horizontal axis direction is downward from the origin, and the vertical axis direction is to the right from the origin; Determining the imaging point at the preset position relationship of the third preset imaging point as the fourth preset imaging point, and starting from the fourth preset imaging point, increasing the abscissa in sequence according to a set step size to obtain a second set of the preset number of imaging points; Determining that the coordinates of the first set of a preset number of imaging points and the second set of a preset number of imaging points form a second preset fault point coordinate subset.

6. The method according to claim 1, wherein The method further includes: If the set of coordinates to be detected fails to be compared successfully with at least one preset fault point coordinate set, then for any group of a second preset number of imaging points that form an image pixel point, determining whether the second preset number of RGB values are the same; If not, determining that the LED lamp beads corresponding to the non - identical imaging points are faulty.

7. The method according to claim 6, wherein The method further includes: If the set of coordinates to be detected fails to be compared successfully with at least one preset fault point coordinate set, and there is no LED lamp bead fault, then sending the image to be detected to the server, so that the server determines the standard image corresponding to the image to be detected in the pre - stored image set, and comparing the image to be detected with the standard image to determine whether the display screen is faulty and the fault type.

8. The method according to any one of claims 1 to 7, wherein After determining the fault type of the display screen, the method further includes: Determining the position information of the faulty display screen in the tiled display screen according to the current position of the inspection device; Sending the position information to the server and / or the mobile terminal bound to the inspection device.

9. An inspection device for fault detection of a display screen, wherein, Applied to the method according to any one of claims 1 to 8, which includes an inspection robot, a frame body, a light-shielding part, and an image acquisition device; Wheels are provided at the bottom of the frame body for controlling the movement of the inspection device; The image acquisition device is located in the space formed by the frame body and the light-shielding part, and is arranged on the inspection robot and faces the side of the splicing display screen for photographing the splicing display screen to obtain a to-be-detected image; wherein, the to-be-detected image is the display image of any one of the display screens in the splicing display screen; The inspection robot receives the to-be-detected image from the image acquisition device and determines whether the display screen is faulty and the type of the fault according to the to-be-detected image.

10. A fault detection device for a display screen, wherein, It includes: An image acquisition module for acquiring a to-be-detected image; wherein, the to-be-detected image is obtained by photographing a splicing display screen during the movement of the inspection device, and the to-be-detected image is the display image of any one of the display screens in the splicing display screen; the display screen includes a plurality of LED lamp beads, and each LED lamp bead corresponds to an imaging point; A coordinate determination module for determining a to-be-detected coordinate set composed of the respective imaging coordinates of the imaging points with the same RGB value in the to-be-detected image based on a preset coordinate system; A fault determination module for comparing the to-be-detected coordinate set with at least one preset fault point coordinate set set in advance respectively. If the comparison is successful, the fault type of the display screen is determined; wherein, one fault type of the display screen corresponds to at least one preset fault point coordinate set; Wherein, the preset fault point coordinate set includes a first preset fault point coordinate set or a second preset fault point coordinate set; the second preset fault point coordinate set includes at least one second preset fault point coordinate subset; The first preset fault point coordinate set is obtained by increasing the abscissa or ordinate at a set step length based on the preset coordinate system, a first preset imaging point, and a second preset imaging point; Each of the second preset fault point coordinate subsets is obtained by increasing the abscissa at a set step length based on the preset coordinate system and a third preset imaging point among the imaging points controlled by the same LED control chip.

11. An inspection robot, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

12. A computer-readable storage medium having computer program instructions stored thereon, wherein, When the computer program instructions are executed by the processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images