Transient alarm tracking method and device, terminal equipment and storage medium

Abstract

The invention provides a transient alarm tracking method and device, terminal equipment and a storage medium, and the method comprises the steps: firstly obtaining an image of a target screen on to-be-tracked equipment; then determining a preset alarm information display area corresponding to the target screen, and performing character recognition on the preset alarm information display area to obtain a character recognition result; and finally, matching the character recognition result with a preset alarm character library, and determining that the to-be-tracked device has a transient alarm under the condition of successful matching. Therefore, the characters in the specific area of the screen of the to-be-tracked equipment are automatically obtained and recognized in a non-intrusive mode, so that the preset alarm information is accurately matched, millisecond-level response is achieved, transient faults which cannot be traced in a traditional mode are effectively captured and recorded, and the accuracy and reliability of equipment diagnosis are improved.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of device monitoring, and particularly relates to a transient alarm tracking method and device, a terminal device and a storage medium. BACKGROUND

[0002] Many current intelligent devices (such as intelligent electric heads) have multiple self-diagnosis alarm functions (such as overheating, phase loss, etc.), but their alarm outputs are usually transmitted to the main control system through only one comprehensive relay signal. This results in that the main control personnel can only receive the comprehensive alarm signal of "having an alarm", and cannot directly obtain the specific alarm type and historical information.

[0003] At present, the above alarm information often appears as a transient alarm, which is quickly restored automatically after being triggered. Since the comprehensive alarm cannot record and distinguish the specific content of the transient alarm, the main control cannot timely locate the fault cause, and the alarm has disappeared when the on-site check is performed, which leads to difficulty in tracing and handling defects and existence of safety hazards. SUMMARY

[0004] The embodiments of the present application provide a transient alarm tracking method, device, terminal device and storage medium, which can timely track the transient alarm.

[0005] The first aspect of the embodiments of the present application provides a transient alarm tracking method, comprising: acquiring an image of a target screen on a device to be tracked; determining a preset alarm information display area corresponding to the target screen, and performing character recognition on the preset alarm information display area to obtain a character recognition result; matching the character recognition result with a preset alarm character library, and in the case of successful matching, determining that the device to be tracked has a transient alarm.

[0006] In the technical solution of the present application, the characters in a specific area of the screen of the device to be tracked are automatically acquired and recognized non-invasively, so that the preset alarm information is accurately matched and a millisecond-level response is realized, thereby effectively capturing and recording the transient fault that cannot be traced by the traditional method, and improving the accuracy and reliability of device diagnosis.

[0007] Optionally, in a possible implementation manner of the first aspect, the image of the target screen is acquired by using an acquisition unit, and before the determination of the preset alarm information display area corresponding to the target screen and the character recognition on the preset alarm information display area to obtain the character recognition result, the method further comprises: acquiring a reference image of the target screen on the device to be tracked; and in the case that a framing operation of the reference image by a user is detected, determining the preset alarm information display area corresponding to the target screen. Thus, by introducing the reference image and the user framing operation, the key alarm area of the screen is accurately locked, irrelevant information interference is effectively excluded, and the accuracy of character recognition is greatly improved.

[0008] Optionally, in a further possible implementation of the first aspect, in the case that the user's frame selection operation on the reference image is detected, the preset alarm information display region corresponding to the target screen is determined, including: in response to detecting the user's frame selection operation on the reference image, determining the region of interest corresponding to the target screen; recognizing the characters in the region of interest; in the case that the character recognition in the region of interest is successful, determining the region of interest as the preset alarm information display region corresponding to the target screen. Thus, by directly frame selecting the key region of the screen by the user and combining real-time character recognition verification, the alarm display region learned by the system is absolutely accurate, and the monitoring blind spot or misjudgment caused by automatic recognition error is completely avoided.

[0009] Optionally, in a further possible implementation of the first aspect, the character recognition in the region of interest includes: recognizing the characters in the region of interest by an optical character recognition (OCR) algorithm. Thus, by applying the OCR algorithm to accurately recognize the preset region of interest, the image information is converted into processable text data, providing a core criterion for realizing automatic comparison and recording of alarm information.

[0010] Optionally, in a further possible implementation of the first aspect, in the case that the character recognition result is matched with the preset alarm character library and the matching is successful, the method further includes: for each type of the to-be-tracked device, setting a corresponding alarm character library; matching the character recognition result with the preset alarm character library, and in the case that the matching is successful, determining that the to-be-tracked device has a transient alarm, including: determining the alarm character library corresponding to the to-be-tracked device according to the type of the to-be-tracked device; matching the character recognition result with the alarm character library corresponding to the to-be-tracked device, and in the case that the matching is successful, determining that the to-be-tracked device has a transient alarm. By pre-setting the exclusive alarm character library for each type of device and performing targeted matching, the accuracy and pertinence of alarm recognition are significantly improved, and the misjudgment problem caused by the difference in alarm text between different devices is effectively avoided.

[0011] Optionally, in a further possible implementation of the first aspect, the method further includes: after the acquisition unit is started, in the case that the image of the target screen on the to-be-tracked device cannot be acquired, closing the trigger mode of the acquisition unit to switch the acquisition state of the acquisition unit from the trigger acquisition to the continuous acquisition; and the image of the target screen on the to-be-tracked device is acquired, including: acquiring the image of the target screen on the to-be-tracked device in real time by using the acquisition unit in the continuous acquisition state. Thus, by automatically switching the acquisition unit to the continuous acquisition mode when the image cannot be acquired, the monitoring interruption problem caused by abnormal configuration of the trigger mode is avoided.

[0012] Optionally, in a further possible implementation manner of the first aspect, after the character recognition result is matched with the preset alarm character library, and it is determined that the to-be-tracked device has the transient alarm in a case that the matching succeeds, the method further includes: uploading information of the transient alarm, wherein the information of the transient alarm includes an image of the target screen collected when the transient alarm is triggered, a triggering time, and the character recognition result. Thus, by automatically uploading the full-dimension alarm information including the on-site image, the triggering time, and the recognition result, an intuitive evidence chain that cannot be tampered with is provided for fault analysis, and the traceability and diagnosis efficiency of the transient alarm are greatly improved.

[0013] The second aspect of the embodiment of the present application provides a transient alarm tracking device, including: An image acquisition module is configured to acquire an image of a target screen on a to-be-tracked device. A character recognition module is configured to determine a preset alarm information display area corresponding to the target screen, and perform character recognition on the preset alarm information display area to obtain a character recognition result. A character matching module is configured to match the character recognition result with a preset alarm character library, and determine that the to-be-tracked device has a transient alarm in a case that the matching succeeds.

[0014] The third aspect of the embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the transient alarm tracking method of the first aspect when executing the computer program.

[0015] The fourth aspect of the embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the transient alarm tracking method of the first aspect.

[0016] The fifth aspect of the embodiment of the present application provides a computer program product, and when the computer program product is executed on a terminal device, the terminal device executes the transient alarm tracking method of the first aspect.

[0017] It can be understood that the beneficial effects of the second aspect to the fifth aspect can be referred to the related description in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0019] Figure 1is a schematic diagram of an architecture of a transient alarm tracking system provided by an embodiment of the present application; Figure 2 is a schematic diagram of a flow of a transient alarm tracking method provided by an embodiment of the present application; Figure 3 is a display example diagram of a target screen on a device to be tracked provided by an embodiment of the present application; Figure 4 is a schematic diagram of a software operation interface provided by an embodiment of the present application; Figure 5 is another schematic diagram of a software operation interface provided by an embodiment of the present application; Figure 6 is a schematic diagram of a structure of a transient alarm tracking apparatus provided by an embodiment of the present application; Figure 7 is a schematic diagram of a structure of a terminal device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0020] In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application can be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0021] It should be understood that the term "comprises / comprising" when used in this specification and the appended claims, specifies the presence of stated features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0022] It should also be understood that the term "and / or" when used in this specification and the appended claims, means any one of the associated listed items, or a combination of any combination of at least one of the associated listed items.

[0023] As used in this specification and the appended claims, the term "if" can be interpreted as meaning "when" or "once" or "in response to a determination" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [a described condition or event] is detected" can be interpreted as meaning "once it is determined" or "in response to a determination" or "once [the described condition or event] is detected" or "in response to detecting [the described condition or event]," depending on the context.

[0024] In addition, in the description of the present application and the appended claims, the terms "first", "second", "third", etc. are used only to distinguish descriptions, and cannot be understood as indicating or implying relative importance.

[0025] In the present application, the reference to "one embodiment" or "some embodiments" means that the specific features, structures or characteristics described in connection with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in other some embodiments", "in further some embodiments" and the like appearing in different places in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "include", "contain", "have" and their variants mean "include but not limited to", unless otherwise specifically emphasized.

[0026] It should be understood that the size of the serial number of each step in the embodiments does not mean the order of execution, and the execution order of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0027] In the related art, current many intelligent devices often appear transient alarm, and the transient alarm is automatically recovered quickly after being triggered. Since the integrated alarm cannot record and distinguish the specific content of the transient alarm, the master control cannot timely locate the fault reason, and the alarm has disappeared when the on-site check is performed, which leads to the difficulty in tracing and processing the defects, and the security risks exist.

[0028] It should be noted that the transient alarm is also called transient alarm or flash alarm, which refers to a fault or abnormal signal generated during the operation of the device, with extremely short duration (usually milliseconds to seconds) and then automatically disappearing. There are many factors leading to transient alarm, such as power problems, signal interference, mechanical disturbance, logic fluctuation, etc. Among them, the instantaneous voltage drop, surge or interruption will cause power problems. The instantaneous voltage drop, surge or interruption will cause signal interference problems. The instantaneous jamming or vibration of the device triggers the protection, which will cause mechanical disturbance problems. The temporary logic error of the control system software or hardware will cause logic fluctuation problems.

[0029] Therefore, the application provides a transient alarm tracking method and device, a terminal device and a storage medium. First, an image of a target screen on a device to be tracked is acquired. Then, a preset alarm information display area corresponding to the target screen is determined, and character recognition is performed on the preset alarm information display area to obtain a character recognition result. Finally, the character recognition result is matched with a preset alarm character library, and in the case of successful matching, it is determined that the device to be tracked has a transient alarm. Thus, specific region characters of the screen of the device to be tracked are automatically acquired and recognized in a non-intrusive manner, so that the preset alarm information is accurately matched and a millisecond-level response is realized, and thus transient faults that cannot be traced by traditional methods are effectively captured and recorded, and the accuracy and reliability of equipment diagnosis are improved.

[0030] The application can be applied to all nuclear power plants, thermal power plants, hydropower plants and other scenarios using intelligent electric heads (also known as intelligent electric actuators, intelligent electric actuators, etc.), and the display screen of the intelligent electric head is tracked for transient alarms. The intelligent electric head is an advanced valve control device used to drive the valve (such as a gate valve, a stop valve, a ball valve, a butterfly valve, etc.) to open, close or adjust to a specific position. The intelligent electric head is essentially a mechatronic device that integrates valve driving, control, monitoring and communication functions. It is no longer a simple "motor + switch", but an intelligent terminal integrated with a microprocessor, becoming a key device for remote control, automation and fault diagnosis in industrial piping systems (especially in the fields of nuclear power, thermal power, chemical industry, oil and gas, etc.). In addition to the intelligent electric head, the application can also be applied to any device with a display alarm, such as electrical and instrument control devices.

[0031] In order to illustrate the technical solutions of the application, specific embodiments are described below.

[0032] Figure 1 An architecture diagram of a transient alarm tracking system provided by an embodiment of the application is shown. As shown in Figure 1 The transient alarm tracking system mainly includes an acquisition unit and an identification unit.

[0033] The acquisition unit can include an industrial camera and an integrated illumination light source. The industrial camera is responsible for high-speed and high-resolution acquisition of images of the screen of the device to be tracked. A model with a high frame rate requirement is usually selected to ensure that the transient alarm can be captured within milliseconds. The industrial camera includes a lens that determines the imaging quality and the field of view. The focal length should be selected according to the installation distance and the screen size to ensure that the screen image is clear and complete. The illumination light source is mainly set to solve the problem of complex ambient light, screen reflection or dimness, etc. It can provide stable and uniform illumination to ensure that the screen characters can form a high contrast with the background under any lighting conditions, laying a foundation for subsequent recognition.

[0034] The recognition unit runs an operating system, device control software, and visual recognition algorithm, etc., receives image data transmitted from the collection unit, and performs character recognition and logical judgment. The recognition unit includes a storage device, such as a hard disk or a solid state disk, for storing system software, alarm character library recipes, and images and recorded data captured when an alarm occurs. The recognition unit has a communication interface, provides a network port to connect the collection camera and upload data, and can also have other interfaces for expansion or access to the factory network.

[0035] The collection unit can be provided with a mounting bracket, and a user (operator) can fine-tune the position, angle, and height of the camera on site through the bracket to ensure that the camera can face the screen and the picture is not distorted.

[0036] The collection unit and the recognition unit can be connected in communication through a network cable, which is used to transmit high-speed image data and control instructions.

[0037] The above transient alarm tracking system, by real-time monitoring of the device to be tracked, is different from the traditional video recording work. The transient alarm tracking system can create a monitoring list (an example of an alarm character library) for possible alarms through the background software settings, and realize transient alarm tracking and capturing. It is composed of a visual collection unit, a visual recognition unit, a visual processing unit, a bracket, and a fixing clamp, etc. The video collected by the collection unit under the normal operation state of the device to be tracked is only recorded and not saved. When the display screen of the device to be tracked shows an abnormal alarm, it can be captured immediately and an alarm can be sent out. Through the transient alarm tracking system, non-invasive real-time and accurate monitoring of on-site devices can be realized, without the need for additional personnel to go to the factory for daily inspection, reducing labor intensity. Through the transient alarm tracking system, visual tracking and inspection of new devices can be realized offline, confirming that there is no missing abnormal alarm information during the debugging of new devices, improving the reliability of device quality, and timely processing potential defects to avoid the need for power reduction or state reduction of the unit during on-site installation or uplink stage.

[0038] Based on the system architecture shown in the above Figure 1 , a flowchart of a transient alarm tracking method provided by an embodiment of the present application is shown. Figure 2 The transient alarm tracking method can be executed by a transient alarm tracking system or a transient alarm tracking device.

[0039] As shown in Figure 2 , the transient alarm tracking method can include the following steps: Step 201, acquiring an image of a target screen on a device to be tracked.

[0040] In one embodiment, some preparations are needed before step 201 is performed. The staff installs the acquisition unit, the identification unit, the support and other hardware components on site, connects the acquisition unit and the identification unit through a network cable, ensures that the system is powered on and in a working state. Then the staff opens the computer background identification software, inputs the user password, and enters the system operation interface. Then check whether the cameras included in the acquisition unit are online on the system operation interface. If the camera is occupied, check whether there is software using the camera, or try again after waiting for a few minutes. In the case that the camera can be normally used, open the image acquisition function of the camera and confirm that the image display is normal. Then adjust the camera position, focal length and brightness according to the on-site situation to ensure that the camera can clearly acquire images. Then the system enters the real-time monitoring state and uses the camera to acquire images of the target screen on the device to be tracked in real time. Figure 3 A display example of the target screen on the device to be tracked is shown.

[0041] In one possible implementation, after starting the camera in the software, if there is still no image picture displayed, it may be because the camera is currently set in the trigger mode by mistake. When the camera is in the trigger mode, the camera will be in a "waiting" state until it receives a special "trigger signal" (usually from an external sensor or software command, etc.), and then the camera will take a picture. This is an advanced function for precise synchronization with other devices. For the application scenario of the embodiment of the present application which needs continuous monitoring, the camera should work in the free running mode or the continuous acquisition mode, that is, it does not need an external signal and continuously acquires images. That is, after starting the acquisition unit, if the image of the target screen on the device to be tracked cannot be acquired, the trigger mode of the acquisition unit is closed to switch the acquisition state of the acquisition unit from trigger acquisition to continuous acquisition; acquiring the image of the target screen on the device to be tracked includes: acquiring the image of the target screen on the device to be tracked in real time by using the acquisition unit in the continuous acquisition state. In this way, by automatically switching the acquisition unit to the continuous acquisition mode when the image cannot be acquired, the problem of monitoring interruption caused by abnormal trigger mode configuration is avoided.

[0042] In step 202, a preset alarm information display area corresponding to the target screen is determined, and character recognition is performed on the preset alarm information display area to obtain a character recognition result.

[0043] In the embodiment of the present application, the preset alarm information display area can help the system to accurately lock the key alarm area of the screen, effectively exclude irrelevant information interference, and improve the accuracy of alarm character recognition.

[0044] In one embodiment, a reference frame image of the target screen on the device to be tracked can be acquired; upon detecting a user's selection operation on the reference image, the preset alarm information display area corresponding to the target screen is determined. Thus, by introducing a reference image and user selection operation, the key alarm area of ​​the screen can be accurately located, effectively eliminating interference from irrelevant information and significantly improving the accuracy of character recognition.

[0045] Furthermore, in response to detecting a user's selection of a reference image, the system can determine the region of interest (ROI) corresponding to the target screen; identify the characters within the ROI; and if character recognition is successful, designate the ROI as the preset alarm information display area corresponding to the target screen. Thus, by allowing the user to directly select key areas of the screen and combining this with real-time character recognition verification, the system ensures the absolute accuracy of the alarm display area it learns, completely avoiding monitoring blind spots or misjudgments caused by automatic recognition errors.

[0046] It should be noted that before executing the transient alarm tracking method, the camera should be switched to trigger mode, and a single frame image of the target screen on the device to be tracked should be actively acquired. The software interface for selecting a frame from the reference image is shown below. Figure 4 As shown, the image display window on the left will display the calibration screen. It can respond to the user's click on the initialization model in the software interface, load the character recognition algorithm, and after successful model loading, respond to the user's click on the ROI_1 control and the user's selection of a bounding box on the reference image to obtain the region to be detected, i.e., the Region of Interest (ROI), drawn by the user by dragging the mouse arrow. Then, responding to the user's click on the T-model recognition OCR control, a character recognition test is performed to determine if the characters can be correctly recognized. If the recognition is successful, the ROI is designated as the alarm information display area corresponding to the target screen. (Refer to...) Figure 3 Within the rectangular area displayed in the alarm information display area, the software can automatically recognize the characters, i.e., "80.1%". If recognition fails, the area of ​​interest or camera position needs to be readjusted, and the character recognition test repeated.

[0047] Specifically, the characters in the region of interest can be recognized by an optical character recognition (OCR) algorithm, which can continuously image stably and process and output data of the collected picture in milliseconds. OCR refers to a process in which an electronic device checks characters printed on paper, determines their shapes by detecting dark and light patterns, and then translates the shapes into computer text by using character recognition methods; that is, for printed characters, an optical method is used to convert the characters in a paper document into a black-and-white dot matrix image file, and the characters in the image are converted into a text format by using recognition software, so as to provide the characters for further editing and processing by word processing software. How to debug or use auxiliary information to improve the recognition accuracy is the most important topic of OCR. The main indicators for measuring the performance of an OCR system include: rejection rate, misrecognition rate, recognition speed, friendliness of the user interface, stability of the product, ease of use, and feasibility. The image information is converted into processable text data by applying the OCR algorithm to accurately recognize the preset region of interest, thereby providing a core criterion for realizing automatic comparison and recording of alarm information.

[0048] In step 203, the character recognition result is matched with the preset alarm character library, and in the case of successful matching, it is determined that the to-be-tracked device has a transient alarm.

[0049] In the embodiment of the present application, the camera collects images in real time, recognizes characters in the images, and compares the recognized characters with each character in the alarm character library. When the comparison is consistent, the collected picture is saved, and it is determined that the to-be-tracked device has a transient alarm.

[0050] It should be noted that the software interface of the alarm character library is as shown in Figure 5 In the software interface, the formula in Figure 5 is a metaphorical term, which refers to a set of pre-saved device configuration and alarm rule setting. One formula can include the following setting information: device identity, recognition area, alarm character library, camera parameter, storage path, and the like. The device identity refers to the to-be-tracked device number, function position (for example, "No. 1 unit, XXX system, YYY valve") corresponding to the formula. The recognition area is the alarm information display area determined in the foregoing embodiments. The alarm character library is a list of specific alarm information that needs to be tracked for the to-be-tracked device. The camera parameter includes brightness, contrast, focal length, and the like adjusted to obtain a clear image. The storage path refers to the position where the captured transient alarm image is saved.

[0051] In an embodiment, each setting information can be freely configured according to user settings. For example, the device identity, the identification area, the alarm character library, the camera parameter, the storage path and the like can be set in response to a click operation of a user on a creation recipe control in a software interface for setting the alarm character library. Subsequently, a corresponding configuration setting can be selected from a database in response to a click operation of the user on a recipe selection control, and finally, the system enters an identification and tracking state in response to a click operation of the user on a read recipe control. When some parameters in the recipe need to be updated, the parameter modification can be performed in response to a click operation of the user on a recipe modification control.

[0052] In an embodiment, the alarm character library can be set in combination with the actual application scenario and demand, and Chinese, digital, English and the like fields or combinations can be set. In addition, for each type of device to be tracked, a corresponding alarm character library can be set. In actual application, the alarm character library corresponding to the device to be tracked is first determined according to the type of the device to be tracked, and then the character recognition result is matched with the alarm character library corresponding to the device to be tracked, and in the case of successful matching, it is determined that the device to be tracked exists transient alarm. By pre-setting a dedicated alarm character library for each type of device and performing targeted matching, the accuracy and pertinence of alarm identification are significantly improved, and the misjudgment problem caused by the difference in alarm text between different devices is effectively avoided.

[0053] In the embodiment of the present application, when the preset alarm character appears in the screen of the device to be tracked, that is, the character recognition result is successfully matched with the preset alarm character library, the system automatically captures the image and saves it to a specified location, records the alarm time, image, recognition result and the like. Specifically, when the character recognition result is successfully matched with the preset alarm character library, the information of the transient alarm is uploaded, wherein the information of the transient alarm includes the image of the target screen collected when the transient alarm is triggered, the trigger time and the character recognition result. Thus, by automatically uploading the full-dimensional alarm information including the on-site image, the trigger time and the recognition result, an intuitive evidence chain that cannot be tampered with is provided for fault analysis, greatly improving the traceability and diagnosis efficiency of the transient alarm.

[0054] It should be noted that the user can view the saved alarm image and identification statistical information (such as recognition rate, un-recognized number and the like) in the background. The records can be filtered or deleted according to time, frequency and the like conditions. In addition, the image storage address can be set according to the software identification, and the information display interface can display the number of completed identification code images, the number of un-identified code images, the number of read codes, the read code rate and the like in real time. The user can view the corresponding alarm fault pictures in the background in real time, analyze the defect type and time, judge the fault type of the device to be tracked, and arrange maintenance or further processing.

[0055] It can be understood that the record has a maximum record limit, preventing the use of system resources too much or exceeding system limit problems.

[0056] The transient alarm tracking method disclosed in the above embodiments of the application first acquires an image of a target screen on a to-be-tracked device; then determines a preset alarm information display area corresponding to the target screen, and performs character recognition on the preset alarm information display area to obtain a character recognition result; and finally matches the character recognition result with a preset alarm character library, and determines that the to-be-tracked device has a transient alarm in a case where the matching is successful. In this way, specific region characters of the screen of the to-be-tracked device are automatically acquired and recognized in a non-intrusive manner, so as to accurately match the preset alarm information and achieve a millisecond-level response, and thus transient faults that cannot be traced by a traditional manner are effectively captured and recorded, and the accuracy and reliability of device diagnosis are improved. The transient alarm tracking method has a high detection speed, and the speed is ≤1 min / 400 pcs, and a high abnormal alarm recognition rate.

[0057] Referring to Figure 6 , a structure schematic diagram of a transient alarm tracking device provided by an embodiment of the application is shown, and only parts related to the embodiments of the application are shown for ease of description.

[0058] The transient alarm tracking device can specifically include the following modules: The image acquisition module 601 is configured to acquire an image of a target screen on a to-be-tracked device.

[0059] The character recognition module 602 is configured to determine a preset alarm information display area corresponding to the target screen, and perform character recognition on the preset alarm information display area to obtain a character recognition result.

[0060] The character matching module 603 is configured to match the character recognition result with a preset alarm character library, and determine that the to-be-tracked device has a transient alarm in a case where the matching is successful.

[0061] The transient alarm tracking device disclosed in the above embodiments of the application first acquires an image of a target screen on a to-be-tracked device; then determines a preset alarm information display area corresponding to the target screen, and performs character recognition on the preset alarm information display area to obtain a character recognition result; and finally matches the character recognition result with a preset alarm character library, and determines that the to-be-tracked device has a transient alarm in a case where the matching is successful. In this way, specific region characters of the screen of the to-be-tracked device are automatically acquired and recognized in a non-intrusive manner, so as to accurately match the preset alarm information and achieve a millisecond-level response, and thus transient faults that cannot be traced by a traditional manner are effectively captured and recorded, and the accuracy and reliability of device diagnosis are improved.

[0062] Further, in a possible implementation of the embodiment of the application, the image of the target screen is acquired by the acquisition unit, and the transient alarm tracking device further includes the following modules. The first acquisition module is configured to acquire a frame of reference image of a target screen on the device to be tracked.

[0063] The first determination module is configured to determine a preset alarm information display region corresponding to the target screen when detecting a frame selection operation of the reference image by the user.

[0064] Therefore, by introducing the reference image and the frame selection operation of the user, the key alarm region of the screen is accurately locked, irrelevant information interference is effectively excluded, and the accuracy of character recognition is greatly improved.

[0065] Further, in another possible implementation of the embodiment of the application, the first determination module can include the following units. The first determination unit is configured to determine a region of interest corresponding to the target screen in response to detecting a frame selection operation of the reference image by the user.

[0066] The first identification unit is configured to identify characters in the region of interest.

[0067] The second determination unit is configured to determine the region of interest as the preset alarm information display region corresponding to the target screen when the character identification in the region of interest is successful.

[0068] Therefore, by directly framing the key region of the screen by the user and combining real-time character identification verification, it is ensured that the alarm display region learned by the system is absolutely accurate, and the monitoring blind spot or misjudgment caused by automatic identification errors is completely avoided.

[0069] Further, in another possible implementation of the embodiment of the application, the first identification unit is specifically configured to identify the characters in the region of interest by using an optical character recognition (OCR) algorithm. Therefore, by applying the OCR algorithm to accurately identify the preset region of interest, the image information is converted into processable text data, which provides a core criterion for realizing automatic comparison and recording of alarm information.

[0070] Further, in another possible implementation of the embodiment of the application, the transient alarm tracking device further includes the following modules. The character library setting module is configured to set a corresponding alarm character library for each type of device to be tracked.

[0071] The character matching module 603 can include the following units. The third determination unit is configured to determine an alarm character library corresponding to the device to be tracked according to the type of the device to be tracked.

[0072] The fourth determining unit is configured to match the character recognition result with an alarm character library corresponding to the device to be tracked, and determine that the device to be tracked has a transient alarm if the matching is successful.

[0073] By presetting a dedicated alarm character library for each type of device and performing targeted matching, the accuracy and pertinence of alarm recognition are significantly improved, and the misjudgment problem caused by differences in alarm texts among different devices is effectively avoided.

[0074] Further, in another possible implementation manner of the embodiment of the application, the transient alarm tracking device can further include the following modules: The mode switching module is configured to, after the acquisition unit is started, switch the acquisition state of the acquisition unit from triggered acquisition to continuous acquisition if the image of the target screen on the device to be tracked cannot be acquired.

[0075] The image acquisition module 601 can include the following units: The first acquisition unit is configured to acquire the image of the target screen on the device to be tracked in real time by using the acquisition unit in the continuous acquisition state.

[0076] Therefore, by automatically switching the acquisition unit to the continuous acquisition mode when the image cannot be acquired, the monitoring interruption problem caused by abnormal configuration of the triggered mode is avoided.

[0077] Further, in another possible implementation manner of the embodiment of the application, the transient alarm tracking device can further include the following modules: The alarm information uploading module is configured to upload information of the transient alarm, wherein the information of the transient alarm includes the image of the target screen acquired when the transient alarm is triggered, the triggering time, and the character recognition result.

[0078] Therefore, by automatically uploading the full-dimension alarm information including the on-site image, the triggering time, and the recognition result, an unforgeable intuitive evidence chain is provided for fault analysis, and the traceability and diagnosis efficiency of the transient alarm are greatly improved.

[0079] The transient alarm tracking device provided in the embodiment of the application can be applied in the method embodiment described above, and details are described in the description of the method embodiment.

[0080] Figure 7 is a structural schematic diagram of a terminal device provided in the embodiment of the application. As shown in the figure, Figure 7 the terminal device 700 in this embodiment includes at least one processor 710 (for example, a CPU (Central Processing Unit, central processing unit) or the like), Figure 7The diagram shows only one processor, a memory 720, and a computer program 721 stored in the memory 720 and executable on the at least one processor 710. When the processor 710 executes the computer program 721, it implements the steps in the above-described transient alarm tracking method embodiments.

[0081] The terminal device 700 can be a desktop computer, laptop, handheld computer, cloud server, or other computing device. This terminal device may include, but is not limited to, a processor 710 and a memory 720. Those skilled in the art will understand that... Figure 7 This is merely an example of terminal device 700 and does not constitute a limitation on terminal device 700. It may include more or fewer components than shown in the figure, or combine certain components, or different components, such as input / output devices, network access devices, etc.

[0082] The processor 710 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0083] In some embodiments, the memory 720 may be an internal storage unit of the terminal device 700, such as a hard disk or memory of the terminal device 700. In other embodiments, the memory 720 may be an external storage device of the terminal device 700, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the terminal device 700. Furthermore, the memory 720 may include both internal and external storage units of the terminal device 700. The memory 720 is used to store the operating system, applications, boot loader, data, and other programs, such as the program code of the computer program. The memory 720 can also be used to temporarily store data that has been output or will be output.

[0084] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above-mentioned division of each functional unit and module is exemplified, and in actual application, the above-mentioned functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be realized in the form of hardware or software. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the above system can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0085] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the related description of other embodiments.

[0086] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0087] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / terminal device and method can be implemented in other ways. For example, the apparatus / terminal device embodiments described above are only schematic, and the division of the modules or units is only a logical function division, and there can be another division in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0088] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0089] In addition, each of the function units in each of the embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software function unit.

[0090] The integrated module / unit, if realized in the form of a software function unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on such understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer-readable storage medium. The computer program can implement the steps of each method embodiment when executed by a processor. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or some intermediate forms. The computer-readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the computer-readable medium can include appropriate contents according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0091] The above-mentioned embodiment methods can also be completed by a computer program product, which, when running on a terminal device, causes the terminal device to execute the steps of each method embodiment.

[0092] The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, rather than limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A transient alarm tracking method, characterized in that, include; Acquire an image of the target screen on the device to be tracked; Determine the preset alarm information display area corresponding to the target screen, and perform character recognition on the preset alarm information display area to obtain the character recognition result; The character recognition result is matched with a preset alarm character library, and if the match is successful, it is determined that the device to be tracked has a transient alarm.

2. The method according to claim 1, characterized in that, The image of the target screen is acquired using a data acquisition unit. Before determining the preset alarm information display area corresponding to the target screen and performing character recognition on the preset alarm information display area to obtain the character recognition result, the method further includes: Acquire a reference frame image of the target screen on the device to be tracked; If a user selects a frame on the reference image, the preset alarm information display area corresponding to the target screen is determined.

3. The method according to claim 2, characterized in that, The step of determining the preset alarm information display area corresponding to the target screen when a user's selection operation on the reference image is detected includes: In response to detecting a user's selection operation on the reference image, the region of interest corresponding to the target screen is determined; Characters in the region of interest are identified; If the character in the region of interest is successfully recognized, the region of interest will be determined as the preset alarm information display area corresponding to the target screen.

4. The method according to claim 3, characterized in that, The process of recognizing characters in the region of interest includes: The characters in the region of interest are recognized using an optical character recognition (OCR) algorithm.

5. The method according to claim 1, characterized in that, Before matching the character recognition result with a preset alarm character library, and determining that the tracked device has a transient alarm if a match is successful, the method further includes: For each type of device to be tracked, set up a corresponding alarm character library; The step of matching the character recognition result with a preset alarm character library, and determining that the tracked device has a transient alarm if the match is successful, includes: Based on the type of the device to be tracked, determine the alarm character library corresponding to the device to be tracked; The character recognition result is matched with the alarm character library corresponding to the device to be tracked, and if the match is successful, it is determined that the device to be tracked has a transient alarm.

6. The method according to claim 1, characterized in that, The image of the target screen is acquired using a data acquisition unit, and the method further includes: After the acquisition unit is started, if it is unable to acquire an image of the target screen on the device to be tracked, the trigger mode of the acquisition unit is turned off, so as to switch the acquisition state of the acquisition unit from triggered acquisition to continuous acquisition. The acquisition of an image of the target screen on the device to be tracked includes: The image of the target screen on the device to be tracked is acquired in real time using a continuously acquiring unit.

7. The method according to claim 1, characterized in that, After matching the character recognition result with a preset alarm character library, and determining that the tracked device has a transient alarm if the match is successful, the method further includes: Upload the information of the transient alarm, wherein the information of the transient alarm includes the image of the target screen collected when the transient alarm is triggered, the trigger time, and the character recognition result.

8. A transient alarm tracking device, characterized in that, include: The image acquisition module is used to acquire images of the target screen on the device to be tracked; The character recognition module is used to determine the preset alarm information display area corresponding to the target screen, and to perform character recognition on the preset alarm information display area to obtain the character recognition result; The character matching module is used to match the character recognition result with a preset alarm character library, and if the match is successful, determine that the device to be tracked has a transient alarm.

9. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 7.

Images