Multimedia system fault self-diagnosis method, system and device in PIS and medium

Abstract

The invention discloses a fault self-diagnosis method, system and device for a multimedia system in a PIS and a medium, and the method comprises the steps: detecting an electrical parameter in real time through an electrical parameter detection module correspondingly configured for each media display device; collecting a monitoring image by using each video monitoring device; according to each electrical parameter, performing primary fault diagnosis on the corresponding media display device to obtain a primary diagnosis result of the corresponding display device; for each piece of media display equipment, when the initial diagnosis result of the display equipment indicates that the display equipment is normal, performing fault diagnosis again according to the monitoring image corresponding to each piece of media display equipment to obtain a corresponding display equipment re-diagnosis result; meanwhile, fault diagnosis is carried out on the corresponding video monitoring equipment according to each monitoring image, and a monitoring equipment diagnosis result corresponding to each video monitoring equipment is obtained. According to the invention, the media display equipment and the video monitoring equipment are combined to realize fault self-diagnosis of the media display equipment and the video monitoring equipment, and the efficiency and the reliability are high.

Description

Technical Field

[0001] The present invention relates to the technical field of rail transit, and in particular, to a method, system, device and medium for self-diagnosing faults in a multimedia system in a PIS. Background Art

[0002] PIS (Passenger Information System) is the passenger information system. The on-vehicle PIS system is a system integrating a media display system, a broadcast system, and a video surveillance system, and is dedicated to the rail transit industry. It mainly relies on multimedia network technology, with an embedded computer system as the core, and uses on-vehicle display terminals and speakers as media to provide information services to passengers.

[0003] The multimedia system is an important part of the on-vehicle PIS system. The multimedia system includes a media display device and a video surveillance device. The media display device mainly includes devices such as an LCD dynamic map display, an LCD graphic display, a destination LED display, and a media controller. The video surveillance device mainly includes devices such as a surveillance touch screen, a camera, and a hard disk video recorder.

[0004] In the actual operation of the on-vehicle PIS system, through fault self-diagnosis, the operating status of each device in the multimedia system can be understood in real time, faults can be discovered and processed in time, safety hazards caused by device failures can be avoided, and the efficiency and informatization level of operation management can be improved, which is of great significance.

[0005] In the existing on-vehicle PIS system, the main functions of devices such as the LCD dynamic map display and the LCD graphic display in the multimedia system are video playback image display and character display. The existing fault detection method mainly connects to these devices such as the LCD dynamic map, the LCD graphic display, and the LED display through the network to check whether these devices are online to determine whether the devices are normally started; whether there are problems such as screen distortion, snowflake points, black screen, and blue screen in the output image display. The device itself cannot identify faults through self-checking. Usually, a test program needs to be run and then the operator observes with the eyes. Since these display devices are arranged in various positions in the carriage, it often takes a long time to observe with the naked eye by the operator, and the efficiency is low. The fault detection method for the video surveillance device in the multimedia system mainly determines whether the camera is displayed normally by connecting through the network and viewing the surveillance screen on the surveillance touch screen. The display size of the surveillance touch is limited, and the number of camera images displayed on the entire screen each time is limited. During the diagnosis process, it is also necessary to manually switch the position of the video surveillance device to judge one by one, and the efficiency is also low, and there is a risk of missing faults, and the reliability is low.

[0006] Therefore, there is an urgent need for an efficient and reliable fault self-diagnosis technology for the multimedia system in the PIS. Summary of the Invention

[0007] In view of this, the present invention provides a method, system, device and medium for self-diagnosing faults of a multimedia system in a PIS, so as to solve the problems of low efficiency and low reliability of the existing multimedia system device diagnosis technology in a PIS.

[0008] The present invention provides a method for self-diagnosing faults of a multimedia system in a PIS. The multimedia system includes a plurality of media display devices and a plurality of video monitoring devices. Among them, each of the media display devices is located within the monitoring area of at least one of the video monitoring devices, and each of the media display devices is also configured with an electrical parameter detection module;

[0009] The method includes:

[0010] Using the electrical parameter detection module corresponding to each of the media display devices, respectively and in real time detecting the electrical parameters of each of the media display devices; and using each of the video monitoring devices to collect monitoring images;

[0011] According to each of the detected electrical parameters, respectively performing a primary fault diagnosis on the corresponding media display device to obtain a primary diagnosis result of the display device corresponding to each of the media display devices;

[0012] For each of the media display devices, when the primary diagnosis result of the display device indicates that the corresponding media display device is normal, respectively performing a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices; and at the same time, respectively performing a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images to obtain a diagnosis result of the monitoring device corresponding to each of the video monitoring devices.

[0013] Optionally, the step of respectively performing a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices includes:

[0014] For each of the media display devices, respectively extracting the display area image corresponding to the corresponding media display device from the monitoring images collected by at least one of the video monitoring devices corresponding to it;

[0015] Respectively performing object detection on each of the extracted display area images to obtain an object detection result;

[0016] According to each of the detected target detection results, perform a second fault diagnosis on the corresponding media display device respectively to obtain the second diagnosis result of the display device corresponding to each media display device.

[0017] Optionally, the method further includes:

[0018] For each media display device, when the second diagnosis result of the display device indicates that the corresponding media display device is normal, output display device normal information; when the second diagnosis result of the display device indicates that the corresponding media display device is abnormal, output first display device abnormal information.

[0019] Optionally, the performing a fault diagnosis on the corresponding video surveillance device according to each of the collected surveillance images respectively to obtain the diagnosis result of the surveillance device corresponding to each video surveillance device includes:

[0020] For each of the collected surveillance images, determine each of the surveillance images as a target diagnosis image corresponding to the corresponding video surveillance device respectively;

[0021] Perform image recognition on each of the target diagnosis images to obtain an image recognition result;

[0022] According to each of the recognized image recognition results, perform a fault diagnosis on the corresponding video surveillance device respectively to obtain the diagnosis result of the surveillance device corresponding to each video surveillance device;

[0023] For each video surveillance device, when the diagnosis result of the surveillance device indicates that the corresponding video surveillance device is normal, output surveillance device normal information; when the diagnosis result of the surveillance device indicates that the corresponding video surveillance device is abnormal, output surveillance device abnormal information.

[0024] Optionally, the method further includes:

[0025] For each media display device, when the first diagnosis result of the display device indicates that the corresponding media display device is abnormal, output second display device abnormal information.

[0026] Optionally, each media display device is preset with a preset calibrated electrical parameter;

[0027] The performing a first fault diagnosis on the corresponding media display device according to each of the detected electrical parameters respectively to obtain the first diagnosis result of the display device corresponding to each media display device includes:

[0028] For each media display device, compare the detected electrical parameter with the corresponding preset calibrated electrical parameter;

[0029] If the comparison is consistent, it is determined that the initial diagnosis result of the corresponding display device is normal; otherwise, it is determined that the initial diagnosis result of the corresponding display device is abnormal.

[0030] Optionally, the electrical parameters include current and / or voltage;

[0031] Correspondingly, the electrical parameter detection module is specifically a voltage detection module and / or a current detection module.

[0032] In addition, the present invention also provides a multimedia system fault self-diagnosis system in a PIS, which is applied to the multimedia system fault self-diagnosis method in the foregoing PIS. The multimedia system includes a plurality of media display devices and a plurality of video monitoring devices. Among them, each of the media display devices is located within the monitoring area of at least one of the video monitoring devices, and each of the media display devices is also configured with an electrical parameter detection module;

[0033] It includes:

[0034] A parameter detection unit, configured to respectively and real-time detect the electrical parameters of each of the media display devices by using the electrical parameter detection modules respectively configured for each of the media display devices;

[0035] An image acquisition unit, configured to acquire monitoring images by using each of the video monitoring devices;

[0036] A display device diagnosis unit, configured to respectively perform an initial fault diagnosis on the corresponding media display device according to the detected electrical parameters of each, to obtain an initial diagnosis result of the display device corresponding to each of the media display devices; for each of the media display devices, when the initial diagnosis result of the display device indicates that the corresponding media display device is normal, respectively perform a re-fault diagnosis on the corresponding media display device according to the monitoring images acquired by at least one of the video monitoring devices corresponding to each of the media display devices, to obtain a re-diagnosis result of the display device corresponding to each of the media display devices;

[0037] A monitoring device diagnosis unit, configured to respectively perform a fault diagnosis on the corresponding video monitoring device according to each of the acquired monitoring images, to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices.

[0038] In addition, the present invention also provides a multimedia system fault self-diagnosis device in a PIS, including:

[0039] A multimedia system, including a plurality of media display devices and a plurality of video monitoring devices, each of the media display devices being located within the monitoring area of at least one of the video monitoring devices; each of the media display devices being configured to provide display information for passengers in the PIS system; each of the video monitoring devices being configured to provide video information for passengers in the PIS system; each of the video monitoring devices also being configured to collect monitoring images within the corresponding monitoring area;

[0040] A plurality of electrical parameter detection modules, which are respectively arranged in one-to-one correspondence with the plurality of media display devices; each of the electrical parameter detection modules being configured to detect the electrical parameters of the corresponding media display device in real time;

[0041] The multimedia system fault self-diagnosis system in the foregoing PIS is communicatively connected to all the media display devices, all the video monitoring devices, and all the electrical parameter detection modules;

[0042] The multimedia system fault self-diagnosis system in the PIS is configured to receive the electrical parameters detected by each of the electrical parameter detection modules, and respectively perform a primary fault diagnosis on the corresponding media display device according to each of the electrical parameters to obtain a primary diagnosis result of the display device corresponding to each of the media display devices; it is also configured to receive the monitoring images collected by each of the video monitoring devices. For each of the media display devices, when the primary diagnosis result of the display device indicates that the corresponding media display device is normal, respectively perform a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices; at the same time, respectively perform a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices.

[0043] In addition, the present invention also provides a computer storage medium, which includes: at least one instruction, and when the instruction is executed, the method steps in the multimedia system fault self-diagnosis method in the foregoing PIS are implemented.

[0044] Advantages of the present invention:

[0045] For the media display device in the multimedia system, first use the corresponding configured electrical parameter detection module to detect the electrical parameters in real time, which can realize the initial fault self-diagnosis of the media display device, automatically detect whether it is working properly according to the electrical parameters, and obtain the corresponding initial diagnosis result of the display device; since each media display device is located within the monitoring area of at least one video monitoring device, the corresponding video monitoring device is used to collect monitoring images, and the images of the media display device within its monitoring area can be collected; using this image, on the one hand, when the media display device is working properly, based on image recognition technology, the secondary fault self-diagnosis of the media display device can be realized, automatically detecting whether the media display device has other types of functional failures other than abnormal operation, and obtaining the secondary diagnosis result of the display device; on the other hand, image recognition technology can also be used to realize the fault self-diagnosis of the video monitoring device itself, so as to automatically detect whether the video monitoring device has a functional failure and obtain the corresponding diagnosis result of the monitoring device.

[0046] In the PIS of the present invention, the method, system, device and medium for fault self-diagnosis of the multimedia system utilize the layout of the media display device and the video monitoring device in the multimedia system to combine the media display device and the video monitoring device. Without the need for the operator to observe with the naked eye or manually switch the device position, the fault self-diagnosis of the media display device and the video monitoring device can be respectively realized. The efficiency of the fault self-diagnosis of the multimedia system in the PIS is high, and there will be no omission of faults, and the reliability is high. Brief Description of the Drawings

[0047] The features and advantages of the present invention will be more clearly understood by referring to the accompanying drawings. The drawings are schematic and should not be construed as any limitation to the present invention. In the drawings:

[0048] Figure 1 Shows the flowchart of a method for fault self-diagnosis of a multimedia system in a PIS in Embodiment 1 of the present invention;

[0049] Figure 2 Shows the structural block diagram of an on-vehicle PIS system in Embodiment 1 of the present invention;

[0050] Figure 3 Shows the structural block diagrams of the video monitoring devices in the driver's cab and the passenger compartment in the on-vehicle PIS system in Embodiment 1 of the present invention;

[0051] Figure 4 Shows the structural block diagram of the media display device in the passenger compartment in the on-vehicle PIS system in Embodiment 1 of the present invention;

[0052] Figure 5 Shows the layout schematic diagram of the video monitoring device and the media display device in the passenger compartment in Embodiment 1 of the present invention;

[0053] Figure 6 The communication structure diagram inside the media display device in the first embodiment of the present invention is shown;

[0054] Figure 7 The structure diagram of a multimedia system fault self-diagnosis system in a PIS in the second embodiment of the present invention is shown;

[0055] Figure 8 The structure diagram of a multimedia system fault self-diagnosis device in a PIS in the third embodiment of the present invention is shown. Detailed implementation manners

[0056] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0057] Embodiment 1

[0058] A multimedia system fault self-diagnosis method in a PIS, the multimedia system includes a plurality of media display devices and a plurality of video monitoring devices, wherein each of the media display devices is located within the monitoring area of at least one of the video monitoring devices, and each of the media display devices is further configured with an electrical parameter detection module;

[0059] As Figure 1 shown, the method includes:

[0060] S1: Using the electrical parameter detection module respectively configured for each of the media display devices, respectively and real-time detect the electrical parameters of each of the media display devices; and use each of the video monitoring devices to collect monitoring images;

[0061] S2: According to the detected electrical parameters of each, respectively perform a primary fault diagnosis on the corresponding media display device to obtain a display device primary diagnosis result corresponding to each of the media display devices;

[0062] S3: For each of the media display devices, when the display device primary diagnosis result indicates that the corresponding media display device is normal, respectively perform a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a display device secondary diagnosis result corresponding to each of the media display devices; at the same time, respectively perform a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices.

[0063] In this embodiment, the multimedia system in the vehicle-mounted PIS system includes multiple media display devices and multiple video monitoring devices. Among them, the media display devices are mainly located in each passenger compartment of rail transit vehicles (such as buses, subways, bullet trains, high-speed trains, etc.), and the video monitoring devices are distributed in each driver's cab and each passenger compartment of the rail transit vehicle, as Figures 2 to 4 shown (wherein, Figure 2 only shows the connection relationship between one passenger compartment and the driver's cab, and the structures of other passenger compartments are similar to this, and the adjacent passenger compartments and the last passenger compartment and the driver's cab communicate with each other through switches). As Figure 2 and Figure 3 shown, the video monitoring devices in the driver's cab mainly include a monitoring touch screen, a camera and a hard disk video recorder; as Figure 2 and Figure 4 shown, the video monitoring devices in the passenger compartment mainly include cameras, and the media display devices in the passenger compartment mainly include LCD dynamic map displays, LCD graphic displays, destination LED displays, etc. The video monitoring devices in the driver's cab realize fault self-diagnosis through the monitoring images collected by themselves. The media display devices in the passenger compartment combine the monitoring images collected by the video monitoring devices in the passenger compartment (mainly cameras) to realize the fault self-diagnosis of the media display devices, and at the same time, the video monitoring devices in the passenger compartment also realize fault self-diagnosis according to the monitoring images collected by themselves.

[0064] Among them, in the passenger compartment, in the layout diagram of the video monitoring devices (mainly cameras) and the media display devices, as Figure 5 shown, in Figure 5 , the LCD dynamic map display and the LCD graphic display are both within the monitoring area of the same camera, and the same camera can be used to respectively collect the images of the LCD dynamic map display and the LCD graphic display (the layouts of other types of media display devices are similar to this, and will not be shown here).

[0065] In this embodiment, for the media display device in the multimedia system, the corresponding configured electrical parameter detection module is first used to detect the electrical parameters in real time, which can realize the initial fault self-diagnosis of the media display device, automatically detect whether it is working properly according to the electrical parameters, and obtain the corresponding initial diagnosis result of the display device; since each media display device is located within the monitoring area of at least one video monitoring device, the corresponding video monitoring device is used to collect monitoring images, and the images of the media display devices within its monitoring area can be collected; using this image, on the one hand, when the media display device is working properly, based on image recognition technology, the secondary fault self-diagnosis of the media display device can be realized, automatically detecting whether the media display device has other types of functional faults except for abnormal operation, and obtaining the secondary diagnosis result of the display device; on the other hand, image recognition technology can also be used to realize the fault self-diagnosis of the video monitoring device itself, so as to automatically detect whether the video monitoring device has a functional fault and obtain the corresponding diagnosis result of the monitoring device.

[0066] In the PIS of this embodiment, the multimedia system fault self-diagnosis method combines the media display device and the video monitoring device in the multimedia system by using their layout. Without the operator observing with the naked eye or manually switching the device positions, the fault self-diagnosis of the media display device and the video monitoring device can be respectively realized. The efficiency of the multimedia system fault self-diagnosis in the PIS is high, there will be no omission of faults, and the reliability is high.

[0067] Next, each step of the multimedia system fault self-diagnosis method in the PIS of this embodiment will be further described.

[0068] Preferably, in step S1 of this embodiment, the electrical parameters include voltage and / or current;

[0069] Correspondingly, the electrical parameter detection module is specifically a voltage detection module and / or a current detection module.

[0070] Since the media display device has a specific working voltage range when it is working properly. For example, when the voltage is too low, the display screen may have phenomena such as insufficient brightness and screen flickering, and when the voltage is too high, there may be a crash or no display. Therefore, the voltage of each media display device can reflect whether it is working properly. Similarly, when the media display device is working properly, its current is relatively stable and within a certain range. For example, when there is a short circuit fault in the display screen, its current will increase sharply, and when a certain component inside the display screen is damaged and an open circuit occurs, its current will decrease or even be zero. Therefore, the current of each media display device can also reflect whether it is working properly. In this embodiment, the voltage is collected through the voltage detection module and / or the current is collected through the current detection module, which can efficiently realize the initial fault self-diagnosis of the media display device and determine whether it is working properly.

[0071] In actual applications, the electrical parameter can also be power, which can be calculated using the voltage collected by the voltage detection module and the current collected by the current detection module. The power of the media display device can also reflect its working condition. For example, if the power increases abnormally and does not match the actual working load, it may indicate an abnormal load in the system, such as a malfunction of a certain chip resulting in increased power consumption.

[0072] Preferably, each of the media display devices is preset with a preset calibrated electrical parameter;

[0073] Then, this embodiment S2 includes:

[0074] S21: For each of the media display devices, compare the detected electrical parameter with the corresponding preset calibrated electrical parameter;

[0075] S22: If the comparison is consistent, determine that the initial diagnosis result of the corresponding display device is normal; otherwise, determine that the initial diagnosis result of the corresponding display device is abnormal.

[0076] Through the above method, the initial self-diagnosis of each media display device can be efficiently achieved. The principle is simple, easy to execute, and has high efficiency and reliability.

[0077] Specifically, in the above S22, when the absolute value of the difference between the detected electrical parameter and the preset calibrated parameter exceeds the preset threshold, it is regarded as inconsistent in the comparison; when the absolute value of the difference between the detected electrical parameter and the preset calibrated parameter does not exceed the preset threshold, it is regarded as consistent in the comparison.

[0078] Preferably, in this embodiment, after S22, the method further includes:

[0079] S23: For each of the media display devices, when the initial diagnosis result of the display device indicates that the corresponding media display device is abnormal, output a second display device abnormal message.

[0080] For the media display device, when it is determined that the initial diagnosis result of the display device is abnormal based on the electrical parameter, the corresponding second display device abnormal message is output. Through this second display device abnormal message, the specific fault type (such as inability to work properly) that occurs in the media display device can be conveniently and directly distinguished.

[0081] Specifically, in this embodiment, when performing a self-diagnosis on the media display device, a diagnosis command can be sent through the broadcast control box (or the monitoring touch screen) in the driver's cab. After receiving the diagnosis command, the driver's cab control host conveys the command to each passenger compartment control host. The passenger compartment host sends the command to the media display device and the electrical parameter detection module in the corresponding passenger compartment. After receiving the instruction, the media display device and the electrical parameter detection module perform a corresponding initial self-diagnosis. If the initial diagnosis result of the display device is abnormal, the second display device abnormal information is directly output and fed back to the broadcast control box in the driver's cab through the passenger compartment host and the driver's cab host in sequence. Relevant personnel can directly view the information on which media display device is not working properly through the broadcast control box.

[0082] Preferably, in step S3 of this embodiment, for each of the media display devices, when the initial diagnosis result of the display device indicates that the corresponding media display device is normal, the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices are respectively used to perform a secondary fault diagnosis on the corresponding media display device, and the secondary diagnosis result of the display device corresponding to each of the media display devices is obtained, including:

[0083] S31: For each of the media display devices, the display area images corresponding to the corresponding media display device are respectively extracted from the monitoring images collected by at least one of the corresponding video monitoring devices;

[0084] S32: Target detection is respectively performed on each of the extracted display area images to obtain a target detection result;

[0085] S33: According to each of the detected target detection results, a secondary fault diagnosis is respectively performed on the corresponding media display device to obtain the secondary diagnosis result of the display device corresponding to each of the media display devices.

[0086] For the secondary self-diagnosis of the media display device, since each media display device is located within the monitoring area of at least one video monitoring device, the monitoring images collected by at least one video monitoring device must include the image of the corresponding media display device. When this embodiment realizes the secondary self-diagnosis of the media display device based on the image, first, the display area image in the monitoring image is extracted. This display area image directly reflects the display situation of the media display device, facilitating subsequent target detection to obtain a target detection result that accurately reflects the display situation of the display device. Finally, through the analysis of this target detection result, the secondary diagnosis result of the display device corresponding to the media display device can be accurately and efficiently realized, and the accuracy and reliability of the secondary fault self-diagnosis of the media display device are higher.

[0087] Specifically, in S31, a display area image can be extracted from a monitoring image based on a deep learning method (such as deep learning object detection algorithms like Faster R-CNN, YOLO, etc.). The specific process is as follows: The monitoring image is trained to obtain a detection model that can learn the appearance features of the media display device and the display area. Using this detection model, the display area of the media display device can be automatically detected in the monitoring image to obtain the display area image.

[0088] Specifically, in S32 and S33, the object detection of the display area image can also be achieved through a deep learning object detection method. The specific process is as follows: A large number of display area images containing normal displays and various abnormal display situations are collected, and the normal areas, abnormal areas, and abnormal types (such as black screen, color distortion, flicker, etc.) are marked. Then, the marked data is trained to optimize the parameters of the model through algorithms such as backpropagation algorithm, so that it can accurately identify and locate different display abnormal situations. After obtaining the object detection model, the extracted display area image is input into the trained object detection model, and the model will output the detection results for each area in the image, including information such as whether there is an abnormality, the type and location of the abnormality, etc. Further, the model can also output a confidence score, and a suitable threshold can be set in advance to determine whether it is a real abnormality. If the confidence is higher than the threshold, the detected abnormality is considered valid; if it is lower than the threshold, it can be considered that the image display is basically normal or the abnormal situation is not obvious.

[0089] In addition, through the above method based on image analysis for the re-fault self-diagnosis of the media display device in this embodiment, it can be determined whether the media display device has a communication abnormality. Specifically, each media display device such as an LCD dynamic map display, an LCD graphic display, etc. has a unique IP address. As Figure 6 shown, the setting of the IP address is determined by the DIP switch on the corresponding device. The first DIP switch represents the carriage where the device is located, and the second DIP switch represents the location where the device is located. When there is an IP address conflict in the media display device, a specific image indicating the conflict will be displayed on the corresponding display screen. Through the object detection of the monitoring image in this embodiment, the information content representing this specific indication of conflict can be identified, and thus it can be determined that the device has an IP address conflict, which means that it has a communication abnormality.

[0090] Preferably, in this embodiment, after S33, the method further includes:

[0091] S34: For each of the media display devices, when the re-diagnosis result of the display device indicates that the corresponding media display device is normal, display device normal information is output; when the re-diagnosis result of the display device indicates that the corresponding media display device is abnormal, first display device abnormal information is output.

[0092] When the diagnostic result of the display device indicates normal again, it is determined that the media display device is normal, that is, the corresponding display device normal information is output; while when the diagnostic result of the display device indicates abnormal again, by outputting the first display device abnormal information, on the one hand, it can be determined that the media display device has a fault, and on the other hand, it can also be determined that the device has an abnormal type of the display function, which is different from the abnormal type corresponding to the aforementioned second display device abnormal information, so as to facilitate subsequent early warning and maintenance.

[0093] Preferably, in step S3 of this embodiment, the fault diagnosis of the corresponding video monitoring device is respectively performed according to each collected monitoring image to obtain the monitoring device diagnosis result corresponding to each video monitoring device, including:

[0094] S35: For each collected monitoring image, each monitoring image is respectively determined as the target diagnosis image corresponding to the corresponding video monitoring device;

[0095] S36: Perform image recognition on each target diagnosis image to obtain an image recognition result;

[0096] S37: According to each image recognition result obtained by recognition, respectively perform fault diagnosis on the corresponding video monitoring device to obtain the monitoring device diagnosis result corresponding to each video monitoring device;

[0097] S38: For each video monitoring device, when the monitoring device diagnosis result indicates that the corresponding video monitoring device is normal, output the monitoring device normal information; when the monitoring device diagnosis result indicates that the corresponding video monitoring device is abnormal, output the monitoring device abnormal information.

[0098] For the fault self-diagnosis of the video monitoring device, since when the video monitoring device has an abnormality, it will cause the entire monitoring image collected by itself to be abnormal, so in this embodiment, the entire monitoring image is directly used as the target diagnosis image for its fault self-diagnosis, and then the image recognition technology is used to obtain the image recognition result. Finally, through the analysis of this image recognition result, the fault self-diagnosis of the video monitoring device itself can be accurately and efficiently realized, and the accuracy and reliability of the obtained monitoring device diagnosis result are high.

[0099] Specifically, in embodiments S36 and S37, features such as the overall color mean and variance can be statistically obtained through the color feature analysis of the target diagnostic image. If a black screen appears, the color mean of the image will be extremely low, almost approaching the value of black; in the case of a blue screen, the mean of the blue channel will be significantly higher than other channels; a mosaic screen may be characterized by a very large color variance and extremely chaotic color distribution. Texture features such as the contrast, correlation, energy, and entropy of the image can also be calculated through texture feature analysis. The texture features of a normal image have a certain stability and regularity. For example, a clear image has relatively high contrast and energy values, and the correlation is also reasonable. When the image is blurred or blocked, the contrast and energy will decrease, and the correlation will become weaker; in the case of a mosaic screen, the entropy value may increase significantly because the image texture becomes extremely disordered. Local texture features of the image can also be extracted through the local binary pattern (LBP), and the occurrence frequencies of different LBP patterns can be statistically obtained. The LBP feature distribution of a normal image is relatively stable. If a fault occurs, such as occlusion, it will cause obvious changes in the LBP features of the local area, showing a feature pattern different from that of the normal area.

[0100] It should be understood that the self-diagnosis process of the display device described in steps S31 to S34 and the self-diagnosis process of the monitoring device described in steps S35 to S38 in this embodiment can be executed either simultaneously or successively. When the two processes are executed successively, the self-diagnosis process of the display device described in steps S31 to S34 can be executed first and then the self-diagnosis process of the monitoring device described in steps S35 to S38, or the self-diagnosis process of the monitoring device described in steps S35 to S38 can be executed first and then the self-diagnosis process of the display device described in steps S31 to S34.

[0101] Specifically, in this embodiment, when performing a fault self-diagnosis on the media display device, the broadcast control box (or the monitoring touch screen) in the driver's cab sends a diagnostic command. After receiving the diagnostic command, the driver's cab control host conveys the diagnostic command to each passenger compartment control host. The passenger compartment host sends the diagnostic command to the media display device and the electrical parameter detection module in the corresponding passenger compartment. At the same time, a specific picture (such as pure red, blue, green, black and white stripes, etc.) is displayed on the display panel of the media display device, and the content of the displayed picture is fed back to the driver's cab control host through the passenger compartment host. After receiving the display picture of the media display device, the driver's cab host sends the diagnostic command to the camera in the passenger compartment through the passenger compartment host again. The camera starts to collect and identify images of the media display device in the monitoring area, and feeds back the identified image information to the driver's cab control host. The driver's cab control host analyzes the data of the information fed back by the camera and the display picture fed back by the media display device, respectively obtains the re-diagnosis result of the display device and the diagnosis result of the monitoring device, and feeds back the obtained re-diagnosis result of the display device and the diagnosis result of the monitoring device to the broadcast control box. At this time, the fault point in the media display device and / or the video monitoring device can be quickly located through the broadcast control box. Further, the driver's cab control host can also send the fault point location information to the passenger compartment control host. After receiving the information, the passenger compartment host makes the speaker at the corresponding position emit an alarm prompt sound.

[0102] Embodiment Two

[0103] A fault self-diagnosis system for a multimedia system in a PIS is applied to the fault self-diagnosis method for the multimedia system in Embodiment One. The multimedia system includes a plurality of media display devices and a plurality of video monitoring devices. Among them, each of the media display devices is located within the monitoring area of at least one of the video monitoring devices, and each of the media display devices is also configured with an electrical parameter detection module.

[0104] As Figure 7 shown, the self-diagnosis system includes:

[0105] A parameter detection unit, configured to respectively and real-time detect the electrical parameters of each media display device by using the electrical parameter detection module corresponding to each media display device.

[0106] An image acquisition unit, configured to acquire monitoring images by using each video monitoring device.

[0107] A display device diagnosis unit is configured to perform an initial fault diagnosis on each corresponding media display device respectively according to each detected electrical parameter, so as to obtain an initial diagnosis result of the display device corresponding to each media display device; for each media display device, when the initial diagnosis result of the display device indicates that the corresponding media display device is normal, perform a re-fault diagnosis on the corresponding media display device respectively according to the monitoring images collected by at least one corresponding video monitoring device of each media display device, so as to obtain a re-diagnosis result of the display device corresponding to each media display device.

[0108] A monitoring device diagnosis unit is configured to perform a fault diagnosis on each corresponding video monitoring device respectively according to each collected monitoring image, so as to obtain a diagnosis result of the monitoring device corresponding to each video monitoring device.

[0109] In this embodiment, for the media display device in the multimedia system, first, through the parameter detection unit, the configured electrical parameter detection module is used to detect the electrical parameters in real time, so as to realize the initial fault self-diagnosis of the media display device. Through the display device diagnosis unit, it is automatically detected whether it works normally according to the electrical parameters, and the corresponding initial diagnosis result of the display device is obtained; since each media display device is located in the monitoring area of at least one video monitoring device, therefore, through the image acquisition unit, the corresponding video monitoring device is used to collect the monitoring images, and the images of the media display device in its monitoring area can be collected; using this image, on the one hand, the display device diagnosis unit can be used again to realize the re-fault self-diagnosis of the media display device based on the image recognition technology when the media display device is working normally, and automatically detect whether the media display device has other functional type of faults except abnormal work, so as to obtain the re-diagnosis result of the display device; on the other hand, the monitoring device diagnosis unit can be used to realize the self-fault diagnosis of the video monitoring device itself by using the image recognition technology, so as to automatically detect whether the video monitoring device has a functional fault and obtain the corresponding diagnosis result of the monitoring device.

[0110] The multimedia system fault self-diagnosis system in the PIS of this embodiment combines the media display device and the video monitoring device by using the layout of the media display device and the video monitoring device in the multimedia system. Without the operator observing with the naked eye or manually switching the device positions, the fault self-diagnosis of the media display device and the video monitoring device can be realized respectively. The efficiency of the multimedia system fault self-diagnosis in the PIS is high, no faults will be missed, and the reliability is high.

[0111] The functions of the units in the multimedia system fault self-diagnosis system in the PIS described in this embodiment correspond to the steps of the multimedia system fault self-diagnosis method in the PIS of Embodiment 1. Therefore, for the details not described in this embodiment, please refer to Embodiment 1 andFigures 1 to 6 The specific description is not repeated here.

[0112] Embodiment III

[0113] As Figure 8 shown, a multimedia system fault self-diagnosis device in a PIS includes:

[0114] A multimedia system, including multiple media display devices and multiple video monitoring devices. Each of the media display devices is located within the monitoring area of at least one of the video monitoring devices; each of the media display devices is used to provide display information for passengers in the PIS system; each of the video monitoring devices is used to provide video information for passengers in the PIS system; each of the video monitoring devices is also used to collect monitoring images within the corresponding monitoring area.

[0115] Multiple electrical parameter detection modules, which are arranged in one-to-one correspondence with the multiple media display devices; each of the electrical parameter detection modules is used to detect the electrical parameters of the corresponding media display device in real time.

[0116] The multimedia system fault self-diagnosis system in Embodiment II is communicatively connected to all the media display devices, all the video monitoring devices, and all the electrical parameter detection modules.

[0117] The multimedia system fault self-diagnosis system in the PIS is used to receive the electrical parameters detected by each of the electrical parameter detection modules, and respectively perform a primary fault diagnosis on the corresponding media display device according to each of the electrical parameters to obtain a primary diagnosis result of the display device corresponding to each of the media display devices; it is also used to receive the monitoring images collected by each of the video monitoring devices. For each of the media display devices, when the primary diagnosis result of the display device indicates that the corresponding media display device is normal, respectively perform a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices; at the same time, respectively perform a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices.

[0118] In this embodiment, based on the multimedia system fault self-diagnosis system in PIS in Embodiment 2, the communication and interaction are respectively carried out with all media display devices, all video monitoring devices and all electrical parameter detection modules. By using the layout of the media display devices and video monitoring devices in the multimedia system, the media display devices and video monitoring devices are combined. Without the need for operators to observe with the naked eye or manually switch the device positions, the fault self-diagnosis of the media display devices and video monitoring devices can be respectively realized. The efficiency of the fault self-diagnosis of the multimedia system in PIS is high, no faults will be missed, and the reliability is high.

[0119] Similarly, for the unspecified details in Embodiment 3, please refer to the specific descriptions in Embodiment 1, Embodiment 2 and Figures 1 to 7 are not elaborated here.

[0120] Embodiment 4

[0121] This embodiment provides another multimedia system fault self-diagnosis device in PIS, including a processor, a memory, and a computer program stored in the memory and operable on the processor. When the computer program runs, it implements the method steps in the multimedia system fault self-diagnosis method in Embodiment 1 of PIS.

[0122] Through the computer program stored in the memory and running on the processor, by using the layout of the media display devices and video monitoring devices in the multimedia system, the media display devices and video monitoring devices are combined. Without the need for operators to observe with the naked eye or manually switch the device positions, the fault self-diagnosis of the media display devices and video monitoring devices can be respectively realized. The efficiency of the fault self-diagnosis of the multimedia system in PIS is high, no faults will be missed, and the reliability is high.

[0123] The so-called processor may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The processor is the control center of the computer device, and connects various parts of the entire computer device through various interfaces and lines.

[0124] The memory can be used to store computer programs and / or models. By running or executing the computer programs and / or models stored in the memory and invoking the data stored in the memory, the processor realizes various functions of the computer device. The memory mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the mobile phone (such as audio data, video data, etc.). In addition, the memory can include high-speed random access memory and can also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a SmartMedia Card (SMC), a Secure Digital (SD) card, a Flash Card, at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0125] It should be understood that each process and / or block in the flowchart and / or block diagram can be implemented by a computer program, as well as the combination of processes and / or blocks in the flowchart and / or block diagram. These computer programs can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for realizing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0126] These computer programs can also be stored in a computer-readable memory that can guide the computer or other programmable data processing devices to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device realizes the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0127] These computer programs can also be loaded onto the computer or other programmable data processing devices, so that a series of operation steps are executed on the computer or other programmable devices to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable devices provide steps for realizing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0128] This embodiment also provides a computer storage medium, which includes: at least one instruction, and when the instruction is executed, it realizes the method steps in the multimedia system fault self-diagnosis method in the PIS of Embodiment 1.

[0129] By executing a computer storage medium containing at least one instruction, using the layout of a media display device and a video surveillance device in a multimedia system, the media display device and the video surveillance device are combined. Without the need for an operator to observe with the naked eye or manually switch the device positions, the self-diagnosis of faults of the media display device and the video surveillance device can be respectively achieved. The efficiency of the self-diagnosis of faults in the multimedia system in the PIS is high, no faults will be missed, and the reliability is high.

[0130] Similarly, for the details not described in Embodiment 4, please refer to the specific descriptions of Embodiment 1, Embodiment 2, Embodiment 3 and Figures 1 to 8 will not be elaborated here.

[0131] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations fall within the scope defined by the appended claims.

Claims

1. A self-diagnosis method for multimedia system faults in a PIS, characterized in that The multimedia system includes a plurality of media display devices and a plurality of video monitoring devices. Among them, each of the media display devices is located within the monitoring area of at least one of the video monitoring devices, and each of the media display devices is also configured with an electrical parameter detection module; The method includes: Using the electrical parameter detection module configured for each of the media display devices, respectively and in real time detecting the electrical parameters of each of the media display devices; and using each of the video monitoring devices to collect monitoring images; According to the detected electrical parameters of each of the media display devices, respectively performing a primary fault diagnosis on the corresponding media display device to obtain a primary diagnosis result of the display device corresponding to each of the media display devices; For each of the media display devices, when the primary diagnosis result of the display device indicates that the corresponding media display device is normal, respectively performing a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices; at the same time, respectively performing a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices.

2. The method according to claim 1, characterized in that, The step of respectively performing a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices includes: For each of the media display devices, respectively extracting the display area image corresponding to the corresponding media display device from the monitoring images collected by at least one of the corresponding video monitoring devices; Performing object detection on each of the extracted display area images to obtain an object detection result; According to the detected object detection result of each of the media display devices, respectively performing a secondary fault diagnosis on the corresponding media display device to obtain the secondary diagnosis result of the display device corresponding to each of the media display devices.

3. The method according to claim 2, characterized in that, The method further includes: For each of the media display devices, when the secondary diagnosis result of the display device indicates that the corresponding media display device is normal, outputting display device normal information; when the secondary diagnosis result of the display device indicates that the corresponding media display device is abnormal, outputting first display device abnormal information.

4. The method according to claim 2, characterized in that, The step of respectively performing a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices includes: For each of the collected monitoring images, respectively determining each of the monitoring images as a target diagnosis image corresponding to the corresponding video monitoring device; Performing image recognition on each of the target diagnosis images to obtain an image recognition result; According to the recognized image recognition result of each of the media display devices, respectively performing a fault diagnosis on the corresponding video monitoring device to obtain the monitoring device diagnosis result corresponding to each of the video monitoring devices; For each of the video monitoring devices, when the diagnosis result of the monitoring device indicates that the corresponding video monitoring device is normal, monitor device normal information is output; when the diagnosis result of the monitoring device indicates that the corresponding video monitoring device is abnormal, monitor device abnormal information is output.

5. The method according to claim 1, wherein The method further includes: For each of the media display devices, when the initial diagnosis result of the display device indicates that the corresponding media display device is abnormal, second display device abnormal information is output.

6. The method according to claim 1, characterized in that, Each of the media display devices is preset with preset calibrated electrical parameters; The performing initial fault diagnosis on each of the media display devices according to the detected electrical parameters respectively to obtain the initial diagnosis result of the display device corresponding to each of the media display devices includes: For each of the media display devices, comparing the detected electrical parameters with the corresponding preset calibrated electrical parameters; If the comparison is consistent, determining that the initial diagnosis result of the corresponding display device is normal, otherwise determining that the initial diagnosis result of the corresponding display device is abnormal.

7. The method according to any one of claims 1 to 6, characterized in that The electrical parameters include current and / or voltage; Correspondingly, the electrical parameter detection module is specifically a voltage detection module and / or a current detection module.

8. A multimedia system fault self-diagnosis system in a PIS, characterized in that, Applied to the multimedia system fault self-diagnosis method in the PIS according to any one of claims 1 to 7, the multimedia system includes a plurality of media display devices and a plurality of video monitoring devices, wherein each of the media display devices is located within the monitoring area of at least one of the video monitoring devices, and each of the media display devices is further configured with an electrical parameter detection module; Includes: A parameter detection unit, configured to respectively and real-time detect the electrical parameters of each of the media display devices by using the electrical parameter detection module corresponding to each of the media display devices; An image acquisition unit, configured to acquire monitoring images by using each of the video monitoring devices; A display device diagnosis unit, configured to perform initial fault diagnosis on each of the media display devices according to the detected electrical parameters respectively to obtain the initial diagnosis result of the display device corresponding to each of the media display devices; for each of the media display devices, when the initial diagnosis result of the display device indicates that the corresponding media display device is normal, respectively perform secondary fault diagnosis on the corresponding media display device according to the monitoring images acquired by at least one of the video monitoring devices corresponding to each of the media display devices to obtain the secondary diagnosis result of the display device corresponding to each of the media display devices; A monitoring device diagnosis unit, configured to respectively perform fault diagnosis on the corresponding video monitoring devices according to each of the acquired monitoring images to obtain the monitoring device diagnosis result corresponding to each of the video monitoring devices.

9. A multimedia system fault self-diagnosis device in a PIS, characterized in that, Includes: A multimedia system, including a plurality of media display devices and a plurality of video monitoring devices, each of the media display devices being located within the monitoring area of at least one of the video monitoring devices; each of the media display devices being configured to provide display information for passengers in the PIS system; each of the video monitoring devices being configured to provide video information for passengers in the PIS system; each of the video monitoring devices also being configured to collect monitoring images within the corresponding monitoring area; A plurality of electrical parameter detection modules, which are arranged in one-to-one correspondence with the plurality of media display devices; each of the electrical parameter detection modules being configured to detect the electrical parameters of the corresponding media display device in real time; The PIS multimedia system fault self-diagnosis system according to claim 9, being communicatively connected to all the media display devices, all the video monitoring devices, and all the electrical parameter detection modules; The PIS multimedia system fault self-diagnosis system is configured to receive the electrical parameters detected by each of the electrical parameter detection modules, and respectively perform a primary fault diagnosis on the corresponding media display device according to each of the electrical parameters, to obtain a primary diagnosis result of the display device corresponding to each of the media display devices; It is further configured to receive the monitoring images collected by each of the video monitoring devices. For each of the media display devices, when the primary diagnosis result of the display device indicates that the corresponding media display device is normal, respectively perform a secondary fault diagnosis on the corresponding media display device according to the monitoring images collected by at least one of the video monitoring devices corresponding to each of the media display devices, to obtain a secondary diagnosis result of the display device corresponding to each of the media display devices; and at the same time, respectively perform a fault diagnosis on the corresponding video monitoring device according to each of the collected monitoring images, to obtain a monitoring device diagnosis result corresponding to each of the video monitoring devices.

10. A computer storage medium, characterized in that, The computer storage medium includes: at least one instruction, which when executed by a computer, implements the method steps according to any one of claims 1 to 7.

Images