Monitoring method and system for recording equipment

By obtaining the equipment list and analyzing the status prediction model, the repair priority of the included equipment is determined, which solves the problem of improper equipment repair sequence and achieves efficient equipment repair and stable regional operation.

CN120634170AActive Publication Date: 2025-09-12SUZHOU BAINIAN SOFTWARE TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202510841653.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-06-23
Publication Date
2025-09-12
Estimated Expiration
2045-06-23

AI Technical Summary

Technical Problem

Existing technologies lack scientific assessment of the impact of faults and appropriate repair timing in the management of equipment repair, resulting in improper equipment repair sequence and affecting the normal operation of the area.

Method used

By obtaining a list of equipment to be repaired in the target area, the status prediction model is used to analyze the equipment operating status. The repair priority is determined based on the importance score of the fault function and the impact score of the suspension of normal functions, and the equipment is repaired in order of priority.

Benefits of technology

The negative impact on regional operations during equipment repair was reduced, ensuring that key equipment was repaired first, and improving the efficiency of the repair work and the continuity and stability of data collection in the region.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120634170A_ABST
    Figure CN120634170A_ABST
Patent Text Reader

Abstract

The invention provides a recording device monitoring method and system, and relates to the field of recording device monitoring, and the method comprises the steps: obtaining a to-be-repaired device list of each target sub-region included in a target region; obtaining an input data list every preset time length; according to an input data list and a state prediction model, obtaining predicted working states of the target area and each target sub-area in the second time window; if the predicted working states of the target area and any target sub-area are idle states, obtaining the repair priority of each piece of to-be-repaired equipment in the to-be-repaired equipment list of the target sub-area; and repairing the to-be-repaired equipment according to the sequence of the repairing priorities of the to-be-repaired equipment in the to-be-repaired equipment list of the target sub-region from high to low. According to the method and the device, the rationality and the normalization of the overall repair work are improved, potential risks caused by equipment faults and repair operation in the region are reduced, and the balance between region management and equipment repair is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of monitoring of recording equipment, and in particular to a monitoring method and system for recording equipment. Background Art

[0002] In the field of modern intelligent management and monitoring, there is a growing demand for comprehensive monitoring and data collection across large areas (such as large industrial parks, transportation hubs, and smart city zones). Multiple data collection devices, such as cameras, microphones, and sensors, are typically deployed within these areas. Each of these devices is responsible for collecting data from a specific area or type, playing an indispensable role in regional security, resource scheduling, and environmental monitoring. The proper operation of any device is crucial to ensuring stable regional operations.

[0003] However, during the long-term operation of the recording equipment, some of its functions may malfunction and need to be repaired. At present, the existing technology has obvious defects in the repair management of recording equipment. On the one hand, when repairing the recording equipment, it is usually necessary to stop the equipment from running, which will cause the equipment to be unable to collect data normally during the repair period. For recording equipment with different functions, the impact of stopping operation on the region is significantly different. On the other hand, the existing technology lacks an effective method to judge the appropriate time to repair the recording equipment, and it is difficult to scientifically evaluate the importance and impact range of failures of different recording equipment. There are often cases where the repair order is arbitrarily arranged or repairs are carried out blindly. Equipment with less impact on the region may be repaired first, while equipment with greater impact and more important is shelved, resulting in a decrease in the overall management and monitoring efficiency of the region, and even serious consequences. Therefore, there is an urgent need for a technical solution that can scientifically evaluate the impact of recording equipment failures and reasonably select the repair time and order to reduce the impact of the equipment repair process on the normal operation of the region. Summary of the Invention

[0004] In response to the above technical problems, the present application provides a monitoring method and system for recording equipment, which at least partially solve the problems existing in the prior art.

[0005] In a first aspect of the present application, a monitoring method for a recording device is provided, the method comprising: A list of devices to be repaired in each target sub-area contained in the target area is obtained; wherein the list of devices to be repaired includes the device ID of each device to be repaired in the corresponding target sub-area; and each device to be repaired has at least one fault function.

[0006] At intervals of a preset duration, the collected data of all normal collecting devices contained in each target sub-area within a first time window is obtained to obtain an input data list; wherein the end time of the first time window is the current time.

[0007] According to the input data list and the state prediction model, the predicted working state of the target area and each target sub-area in the second time window is obtained; wherein the start time of the second time window is the current time; the predicted working state is a busy state or an idle state.

[0008] If the predicted working states of the target area and any target sub-area are both idle, the repair priority of each device to be repaired in the list of devices to be repaired in the target sub-area is obtained; wherein the repair priority is determined based on the preset importance score of the fault function of the corresponding device to be repaired and the stop impact score of the normal function; the stop impact score indicates the degree of impact on the target area after the corresponding normal function stops running; during the repair process of the device to be repaired, all normal functions are stopped.

[0009] The devices to be repaired are repaired in descending order of repair priority of the devices to be repaired in the list of devices to be repaired in the target sub-area.

[0010] In a second aspect of the present application, a monitoring system for a recording device is provided, the system comprising: The device list acquisition unit is used to acquire a list of devices to be repaired in each target sub-area contained in the target area; wherein the list of devices to be repaired includes the device ID of each device to be repaired in the corresponding target sub-area; and each device to be repaired has at least one fault function.

[0011] The data acquisition unit is used to obtain the collected data of all normal collecting devices contained in each target sub-area within the first time window at intervals of a preset time length to obtain an input data list; wherein the end time of the first time window is the current time.

[0012] The prediction unit is used to obtain the predicted working state of the target area and each target sub-area in the second time window based on the input data list and the state prediction model; wherein the start time of the second time window is the current time; the predicted working state is a busy state or an idle state.

[0013] A priority determination unit is configured to obtain a repair priority for each device to be repaired in a list of devices to be repaired in the target sub-area if the predicted working states of the target area and any target sub-area are both idle; wherein the repair priority is determined based on a preset importance score of the fault function of the corresponding device to be repaired and a stop impact score of a normal function; the stop impact score indicates the degree of impact on the target area after the corresponding normal function stops running; during the repair process of the device to be repaired, all normal functions of the device to be repaired stop running.

[0014] The repair unit is configured to repair the devices to be repaired in descending order of repair priority of the devices to be repaired in the list of devices to be repaired in the target sub-area.

[0015] This application has at least the following beneficial effects: This application first obtains a list of devices to be repaired for each target sub-area within a target area; each device to be repaired has at least one faulty function. Next, at predetermined intervals, data collected from all functioning recording devices within each target sub-area within a first time window is obtained to generate an input data list. Regularly obtaining data from functioning recording devices within a specific time window provides a real-time reflection of the current operating status of the target area. Then, based on the input data list and a state prediction model, the predicted operating status of the target area and each target sub-area within a second time window is obtained. Using the input data list and the state prediction model, predictions are made to predict the operating status of the target area and each sub-area within a future time window (the second time window). A predicted busy state indicates a high dependency on the recording devices within the area, and device downtime could have a significant impact. A predicted idle state indicates relatively low demand for the devices within the area, and repairing the devices at this time would minimize the negative impact of device downtime. If the predicted operating status for the target area and any target sub-area is idle, the repair priority for each device to be repaired in the target sub-area's list of devices to be repaired is determined. Here, since the target area is composed of several target sub-areas, each interconnected and coordinated to support the overall function of the target area, repairing equipment in any sub-area, even if the sub-area itself appears to have minimal impact, may disrupt the coordinated relationship between the equipment within the area, leading to data gaps or functional loss in the overall business process, and thus impacting the normal operation of the entire target area. Only when the entire target area and any target sub-area are idle does the entire area's dependence on the equipment's operation be low, and repairs will not disrupt the overall operation of the area. Repair priority is determined based on the preset importance score of the faulty function and the outage impact score of normal functions. This assessment method comprehensively considers the importance of the device function and the impact of the outage on the area during the repair process. Equipment with critical function failures and high outage impact is given a higher repair priority, ensuring that these equipment with the greatest impact on regional operations are repaired first; equipment with less significant impact is repaired later. This ensures that repair resources are allocated rationally, prioritizing critical issues and preventing critical equipment failures from continuously impacting regional operations due to improper repair sequencing, thereby improving the efficiency and effectiveness of repair work. Finally, the devices to be repaired are repaired in descending order of their repair priority in the list of devices to be repaired in the target sub-area. Repairs are performed based on the determined repair priority, ensuring that the most important and impactful devices are addressed first.Repairing equipment according to priority during favorable periods of regional idleness not only mitigates the negative impact of equipment downtime on the region during the repair process, but also ensures an orderly repair process, maximizing the continuity and stability of data collection and monitoring within the region. This orderly repair approach also facilitates management and scheduling, improving the rationality and standardization of overall repair work, reducing potential risks associated with regional equipment failures and repair operations, and achieving a balance between regional management and equipment repair. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0017] Figure 1 A flow chart of a monitoring method for a recording device provided in an embodiment of the present application; Figure 2 This is a structural block diagram of the monitoring system of the recording device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0019] It should be noted that the terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0020] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein can be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on this application, it should be understood by those skilled in the art that an aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement an apparatus and / or practice a method. In addition, other structures and / or functionalities other than one or more of the aspects described herein can be used to implement this apparatus and / or practice this method.

[0021] Please refer to Figure 1 As shown, an embodiment of the present application provides a monitoring method for a recording device, the method comprising: S100, obtaining a list of devices to be repaired in each target sub-area contained in a target area; wherein the list of devices to be repaired includes the device ID of each device to be repaired in the corresponding target sub-area; and each device to be repaired has at least one fault function.

[0022] Specifically, the target area can be the overall geographic area or functional area where recording equipment management and monitoring is required, such as an industrial park, urban block, or large venue. A target sub-area is a subdivision of the target area, and can be divided based on geographic location (e.g., grid division), functional attributes (e.g., security monitoring area, environmental monitoring area), or management requirements, facilitating refined management and repair decisions. Both the target area and target sub-areas can be manually divided. A device to be repaired refers to a recording device that has experienced at least one functional failure during operation (i.e., has at least one faulty function) and requires repair or maintenance. Examples of faulty functions include storage, real-time preview, and local playback. In this embodiment, when scanning or receiving status information reported by each recording device, devices with faulty functions are identified and categorized and aggregated according to the target sub-area to form a list of devices to be repaired. Each target sub-area corresponds to a separate list of devices to be repaired, which contains a unique identifier (device ID) for each device to be repaired. This ID can be generated by combining the device's factory serial number, region code, and device serial number to uniquely identify the device.

[0023] S200, obtaining the recorded data of all normal recording devices contained in each target sub-area within a first time window at intervals of a preset duration to obtain an input data list; wherein the end time of the first time window is the current time.

[0024] Specifically, the system sets a fixed, preset duration (e.g., 15 or 30 minutes) as the data collection cycle. During each cycle, the system uses the data collection interface to obtain data collected in real time within the first time window (a continuous period from the current time forward, such as the past hour) from all functioning recording devices in each target sub-area. This data includes various types, including audio and video, such as video footage captured by cameras and audio information recorded by microphones. After collection, the data undergoes pre-processing operations such as format unification and noise reduction, and is organized into input data lists by sub-area and device category, providing the foundation for subsequent status prediction.

[0025] Here, a "normal" recording device refers to one that is currently operating normally and capable of collecting and transmitting data according to its pre-set functions. This corresponds to the device to be repaired. The first time window is the time range set for acquiring historical data. The end time is fixed at the current time, and the window length can be adjusted based on actual needs (e.g., 1 hour, 2 hours). This window is used to capture recent regional operating status information.

[0026] S300, based on the input data list and the state prediction model, obtain the predicted working state of the target area and each target sub-area in the second time window; wherein the start time of the second time window is the current time; the predicted working state is a busy state or an idle state.

[0027] Specifically, the compiled input data list is fed into a pre-trained state prediction model, which extracts and analyzes features from multimodal data (video, audio, etc.). By learning the mapping relationship between historical data and the operating status of the corresponding area, the model predicts the operating status of the target area and each target sub-area within a second time window (a period starting from the current time, such as the next hour), and outputs a "busy" or "idle" state. For example, if a sub-area is predicted to have a large amount of personnel movement or equipment operation within the next hour, it is considered busy; conversely, if minimal personnel and equipment activity is expected, it is considered idle.

[0028] S400, if the predicted working states of the target area and any target sub-area are both idle, obtain the repair priority of each device to be repaired in the list of devices to be repaired in the target sub-area; wherein the repair priority is determined based on the preset importance score of the fault function of the corresponding device to be repaired and the stop impact score of the normal function; the stop impact score indicates the degree of impact on the target area after the corresponding normal function stops running; during the repair process of the device to be repaired, all normal functions are stopped.

[0029] Specifically, since the target area is composed of several target sub-areas, each interconnected and coordinated to support the overall function of the target area, repairing equipment in any sub-area, even if the sub-area itself appears to have minimal impact, may disrupt the coordinated relationship between the equipment within the area, leading to data gaps or functional loss in the overall business process, and thus impacting the normal operation of the entire target area. Only when the entire target area and any target sub-area are idle does the entire area's dependence on the equipment's operation be low, and repairs will not disrupt the overall operation of the area. Repair priority is determined based on the preset importance score of the faulty function and the outage impact score of normal functions. This assessment comprehensively considers the importance of the device function and the impact of the outage on the area during the repair process. Equipment with critical function failures and high outage impact is given a higher repair priority, ensuring that these equipment with the greatest impact on regional operations are repaired first; equipment with less significant impact is repaired later. This ensures that repair resources are allocated rationally, prioritizing critical issues and preventing critical equipment failures from continuously impacting regional operations due to improper repair sequencing, thereby improving the efficiency and effectiveness of repair efforts. Among them, repair priority: a quantitative indicator used to measure the urgency of repairing the equipment to be repaired, which is obtained by comprehensively evaluating the importance of the faulty function and the impact of the cessation of normal functions. The higher the value, the higher the priority the equipment should be repaired.

[0030] S500 : Repairing the devices to be repaired in the list of devices to be repaired in the target sub-area in descending order of their repair priorities.

[0031] Specifically, according to the determined repair priority, the devices in the list of devices to be repaired in the target sub-area are sorted, and the repair operation is carried out in sequence starting from the device with the highest priority. During the repair process, a command is sent through the device control interface to cause the device to be repaired to stop all normal functions.

[0032] This embodiment performs repairs based on a predetermined repair priority, ensuring that highly important and impactful equipment is addressed first. Repairing equipment according to priority during favorable periods when the region is idle not only reduces the negative impact of equipment downtime on the region during the repair process, but also enables the repair work to proceed in an orderly manner, maximizing the continuity and stability of data collection and monitoring within the region. Furthermore, this orderly repair approach facilitates management and scheduling, improves the rationality and standardization of overall repair work, reduces potential risks in the region due to equipment failures and repair operations, and achieves a balance between regional management and equipment repair.

[0033] In an exemplary embodiment of the present application, the repair priority is determined according to the following steps: S410: Obtain a fault function score GF based on a preset importance score of each fault function of the corresponding device to be repaired, wherein GF meets the following conditions: GF=Σ n i=1 GQ i ; GQ i is the i-th fault function G of the corresponding device to be repaired i The corresponding preset importance score; i=1, 2, ..., n; wherein n is the number of the corresponding fault functions of the equipment to be repaired; the preset importance score of the fault function represents the importance of the corresponding fault function to the target area.

[0034] Specifically, the preset importance score of the fault function is determined according to a preset mapping table, wherein the preset mapping table includes several recording device functions and a preset importance score corresponding to each recording device function; the fault function is any one of the several recording device functions.

[0035] The fault function score is calculated by summing up the preset importance scores of each fault function, comprehensively considering the impact of each fault function on the repair priority of the device to be repaired. A higher preset importance score indicates a more important fault function, while a lower preset importance score indicates a less important fault function.

[0036] S420: Obtain a normal function score ZF based on the stop impact score of each normal function of the corresponding device to be repaired, where ZF meets the following conditions: ZF=Σ m j=1 TQ j ; TQ j is the jth normal function T of the corresponding device to be repaired j Corresponding stop impact score; j=1, 2, ..., m; where m is the number of normal functions of the corresponding device to be repaired; the stop impact score is proportional to the number of key included devices of the corresponding normal function and inversely proportional to the preset importance score of the corresponding normal function; the preset importance score of the normal function represents the importance of the corresponding normal function to the target area; the key included device is the normal included device that is currently running the corresponding normal function in the target sub-area where the corresponding device to be repaired is located.

[0037] Among them, TQ j Meet the following conditions: TQ j =SL j / EPF j ; Among them, SLj T j Corresponding score of key included equipment quantity; SL j Meet the following conditions: SL j =NUMG j / NUMZ j ;NUMG j T j The corresponding number of key recording devices; NUMZ j The number of recorded devices in the target sub-area where the corresponding device to be repaired is located; EPF j T j The corresponding preset importance score.

[0038] Specifically, since all device functions of the device to be repaired need to be stopped when repairing the device to be repaired, all device functions of the device to be repaired include faulty functions and normal functions. This embodiment obtains a stop impact score for each normal function of the device to be repaired. The stop impact score is proportional to the final repair priority, that is, the larger the stop impact score, the earlier the corresponding device to be repaired should be repaired; conversely, the smaller the stop impact score, the later the corresponding device to be repaired should be repaired. The stop impact score is related to the importance of the normal function itself (the preset importance score of the normal function) and the impact of the normal function on the target area after it stops running. The impact of the normal function on the target area after it stops running is determined based on the key included devices included in the target sub-area where the device to be repaired corresponding to the normal function is located; the key included devices are normal included devices that are currently running the corresponding normal function in the target sub-area where the device to be repaired is located, that is, the key included devices are included devices that can realize the normal function and are currently running. If there are more critical devices, it means there are more devices that can perform the same function as the normal function. In this case, the impact of the normal function of the device to be repaired ceasing to operate on the target area may be smaller, because there are more devices with the same function to perform the replacement operation. At this time, it can be repaired first. Conversely, if there are fewer critical devices, it may be that the normal function of other devices to be repaired has failed. In this case, the impact of the normal function of the device to be repaired ceasing to operate on the target area may be greater, and repair should be carried out later to keep it running. As other higher-priority devices to be repaired are repaired, the number of corresponding critical devices may increase. If repairs are carried out at this time, the impact on the target area may be greatly reduced. Therefore, the impact score of the stop is proportional to the number of critical devices with corresponding normal functions.

[0039] In addition, the stop impact score is inversely proportional to the preset importance score of the normal function. That is, the higher the preset importance score of the normal function, the more important the normal function is. Then, after stopping operation, the impact on the target area is likely to be greater. In this case, in order to avoid a greater impact on the target area, the device to be repaired should be repaired later. Conversely, if the preset importance score of the normal function is lower, the less important the normal function is, then after stopping operation, the impact on the target area is likely to be smaller. In this case, the device to be repaired should be repaired earlier. If the device to be repaired later is repaired, while waiting for repair, it is possible that after other devices to be repaired are repaired, more devices in the system will be working normally. Then, there may be more devices with the same function as the normal function and can operate normally. At this time, if the repair is performed later, the impact on the target area may be greatly reduced.

[0040] In summary, the equipment with the most significant impact on the target area should be repaired later, waiting for the repair of other equipment to be repaired. This is because once the faulty functions are restored to normal, the impact of the more significant impact on the target area can be reduced.

[0041] S430: Obtain the repair priority XY of the corresponding device to be repaired based on GF and ZF, where XY meets the following conditions: XY=GF+ZF.

[0042] Specifically, the repair priority XY of the corresponding equipment to be repaired is obtained by adding GF and ZF. The greater the repair priority, the sooner the corresponding equipment to be repaired will be repaired, and vice versa. By comprehensively considering the importance of the fault function itself and the impact of the normal function on the system after it stops running, it is determined that the equipment to be repaired that has the greatest importance of the fault function itself and has a low impact on the target area after it stops running is repaired first, so as to minimize the system fluctuations caused by equipment cessation during the repair process, while ensuring the priority repair of important functions. And by delaying the repair of equipment that has a great impact on the target area after it stops running, repair time is gained for other equipment to be repaired. As more equipment in the system resumes normal operation and the number of key included equipment increases, the negative impact on the target area during the subsequent repair of high-impact equipment is greatly reduced, ensuring the system's transition from local repair to overall stability, and improving the reliability and stability of the system's long-term operation.

[0043] In an exemplary embodiment of the present application, the preset importance score of the fault function and the preset importance score of the normal function are both determined according to a preset mapping table, wherein the preset mapping table includes several recording device functions and the preset importance score corresponding to each recording device function; the fault function or the normal function is any one of the several recording device functions.

[0044] In an exemplary embodiment of the present application, each device to be repaired has a corresponding repair patch package, and the device to be repaired is repaired using the repair patch package.

[0045] Specifically, a complete repair patch package usually contains several key parts. The first is the core repair code, which is the core program for resolving device failures. The second is the patch description document, which records in detail the function of the patch, applicable device models and system versions, installation steps, precautions, and other information to facilitate technical personnel's operation. In addition, it may also include a version verification file to verify that the patch package has not been tampered with during transmission and storage, ensuring the security and effectiveness of the repair. After the repair priority of the device to be repaired is determined, the device currently being repaired will suspend operation according to the instructions in the patch package, implant the repair code into the device system, replace or correct the problematic program module, and restart the device after completion to make the new repair program take effect.

[0046] In an exemplary embodiment of the present application, the collected data includes audio data and video data; the state prediction model is a multimodal fusion model; step S300 includes: S310 , performing feature extraction on all audio data in the input data list to obtain audio features of a target area, and performing feature extraction on all video data in the input data list to obtain video features of the target area.

[0047] Specifically, the entire target area is firstly extracted for features. In the process of audio feature extraction, techniques such as Mel-frequency cepstral coefficients (MFCC) can be used to extract feature parameters reflecting the frequency, energy and other characteristics of the audio signal. In terms of video feature extraction, convolutional neural networks (CNN) can be used to extract key features such as texture, shape, and motion in video images.

[0048] S320: Perform feature fusion on the audio features and the video features of the target area to obtain fused features of the target area.

[0049] Specifically, the audio and video features of the target region are fused to obtain a fused feature of the target region. This feature fusion can be performed via serial fusion, directly concatenating the audio and video feature vectors, or via weighted fusion, assigning different weights to the audio and video data based on their importance in different scenarios. Feature fusion integrates the complementary information in the audio and video data to form a more representative feature vector.

[0050] S330: Input the fusion features of the target area into the multimodal fusion model to obtain a predicted working state of the target area in the second time window.

[0051] The fused features of the target region are input into the multimodal fusion model. Using the model's training parameters and algorithm, the predicted operating state of the target region in the second time window is calculated and output. During training, the multimodal fusion model is optimized using a large amount of labeled data, learning the mapping relationship between audio and video features and operating states. This allows accurate prediction of operating states based on the input fused features. The multimodal fusion model can be an attention mechanism fusion model, a two-stream convolutional neural network model, or a Transformer multimodal fusion model.

[0052] S340: Perform feature extraction on the audio data corresponding to the normal recording devices in the input data list contained in each target sub-region to obtain an audio feature corresponding to each target sub-region, and perform feature extraction on the video data corresponding to the normal recording devices in the input data list contained in each target sub-region to obtain a video feature corresponding to each target sub-region; S350, performing feature fusion on the audio features and video features of each target sub-region to obtain a fused feature of each target sub-region; S360: Input the fusion features of each target sub-region into the multimodal fusion model to obtain the predicted working state of each target sub-region in the second time window.

[0053] Here, feature extraction and state prediction are performed on each target sub-region respectively to obtain the predicted working state of each target sub-region in the second time window.

[0054] This embodiment fully utilizes the advantages of different modal data by fusing audio and video data and processing them using a multimodal fusion model. It can more comprehensively and accurately predict the working status of the target area and its sub-areas.

[0055] In an exemplary embodiment of the present application, step S400 includes: S410: The device to be repaired corresponding to the device ID with the highest repair priority in the list of devices to be repaired in the target sub-area is used as the current device to be repaired.

[0056] S420: Repair the device to be repaired using the repair patch package.

[0057] S430, in response to the completion of repair of the current device to be repaired, delete the corresponding device ID from the list of devices to be repaired in the target sub-area; and jump to the step of obtaining the recorded data of all normal recorded devices contained in each target sub-area within the first time window at each preset interval to obtain the input data list, until the list of devices to be repaired in the target sub-area is empty.

[0058] Specifically, the preset time may be slightly longer than the time required for device repair. In this embodiment, only one device may be repaired at a time. After reacquiring data, the state of the target sub-area is re-judged to determine whether to continue repairing.

[0059] The loop mechanism in this embodiment enables the system to monitor the equipment status of the target sub-area in real time and dynamically. Data is retrieved at intervals slightly longer than the preset duration of equipment repair. This ensures sufficient time to complete equipment repairs while also promptly identifying new problems that may arise after repairs or incomplete repairs. This allows for continuous optimization of the equipment status in the target sub-area, ensuring that the entire area is always in good working condition and providing a stable and reliable equipment operating environment for production and operations.

[0060] Please refer to Figure 2 As shown, an embodiment of the present application provides a monitoring system 100 for a recording device, the system comprising: The device list acquisition unit 110 is configured to acquire a list of devices to be repaired in each target sub-area contained in the target area; wherein the list of devices to be repaired includes the device ID of each device to be repaired in the corresponding target sub-area; and each device to be repaired has at least one fault function.

[0061] The data acquisition unit 120 is used to obtain the collected data of all normal collecting devices contained in each target sub-area within a first time window at intervals of a preset duration to obtain an input data list; wherein the end time of the first time window is the current time.

[0062] The prediction unit 130 is used to obtain the predicted working state of the target area and each target sub-area in the second time window based on the input data list and the state prediction model; wherein the start time of the second time window is the current time; the predicted working state is a busy state or an idle state.

[0063] The priority determination unit 140 is used to obtain the repair priority of each device to be repaired in the list of devices to be repaired in the target sub-area if the predicted working states of the target area and any target sub-area are both idle; wherein the repair priority is determined based on the preset importance score of the fault function of the corresponding device to be repaired and the stop impact score of the normal function; the stop impact score indicates the degree of impact on the target area after the corresponding normal function stops running; during the repair process of the device to be repaired, all normal functions are stopped.

[0064] The repairing unit 150 is configured to repair the devices to be repaired in descending order of repair priority of the devices to be repaired in the list of devices to be repaired in the target sub-area.

[0065] An embodiment of the present application further provides a computer program product, which includes program code. When the program product is run on an electronic device, the program code is used to enable the electronic device to execute the steps of the method according to various exemplary embodiments of the present application described above in this specification.

[0066] Furthermore, although the steps of the method of the present application are described in a particular order in the accompanying drawings, this does not require or imply that the steps must be performed in this particular order, or that all steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0067] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0068] In an exemplary embodiment of the present application, an electronic device capable of implementing the above method is also provided.

[0069] Those skilled in the art will appreciate that various aspects of the present application can be implemented as systems, methods, or program products. Therefore, various aspects of the present application can be specifically implemented in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation that combines hardware and software aspects, which may be collectively referred to herein as a "circuit," "module," or "system."

[0070] The electronic device according to this embodiment of the present application is merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0071] The electronic device is implemented as a general-purpose computing device. Components of the electronic device may include, but are not limited to, the at least one processor, the at least one memory, and a bus connecting different system components (including the memory and the processor).

[0072] The storage stores program codes, which can be executed by the processor, so that the processor executes the steps described in the above “Exemplary Method” section of this specification according to various exemplary embodiments of the present application.

[0073] The memory may include readable media in the form of volatile memory, such as random access memory (RAM) and / or cache memory, and may further include read only memory (ROM).

[0074] The storage may also include a program / utility having a set (at least one) of program modules, such program modules including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0075] The bus may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.

[0076] The electronic device may also communicate with one or more external devices (e.g., a keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device, and / or any device that enables the electronic device to communicate with one or more other computing devices (e.g., a router, modem, etc.). This communication may occur via an input / output (I / O) interface. Furthermore, the electronic device may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter. As shown in the figure, the network adapter communicates with other modules of the electronic device via a bus. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0077] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0078] In exemplary embodiments of the present application, a computer-readable storage medium is also provided, on which is stored a program product capable of implementing the aforementioned methods of this specification. In some possible implementations, various aspects of the present application may also be implemented in the form of a program product, which includes program code. When the program product is executed on a terminal device, the program code is used to cause the terminal device to execute the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present application.

[0079] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0080] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0081] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0082] The program code used to perform the operations of the present application can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0083] Furthermore, the above-mentioned figures are merely illustrative of the processes included in the methods according to exemplary embodiments of the present application and are not intended to be limiting. It is readily understood that the processes illustrated in the above-mentioned figures do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0084] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the application, the features and functions of two or more modules or units described above can be concretized in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0085] The above are only specific embodiments of the present application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A monitoring method for a recording device, characterized in that: The method comprises: Obtain a list of devices to be repaired in each target sub-area contained in the target area; wherein the list of devices to be repaired includes the device ID of each device to be repaired in the corresponding target sub-area; and each device to be repaired has at least one fault function; At each preset time interval, the data collected by all normal collecting devices in each target sub-area within the first time window is obtained to obtain an input data list; wherein the end time of the first time window is the current time; According to the input data list and the state prediction model, the predicted working state of the target area and each target sub-area in the second time window is obtained; wherein the start time of the second time window is the current time; the predicted working state is a busy state or an idle state; If the predicted working states of the target area and any target sub-area are both idle, the repair priority of each device to be repaired in the list of devices to be repaired in the target sub-area is obtained; the repair priority is determined based on the preset importance score of the fault function of the corresponding device to be repaired and the suspension impact score of the normal function; the suspension impact score indicates the degree of impact on the target area after the corresponding normal function stops operating; during the repair process of the device to be repaired, all normal functions of the device to be repaired are suspended; The devices to be repaired are repaired in descending order of repair priority of the devices to be repaired in the list of devices to be repaired in the target sub-area.

2. The monitoring method of recording equipment according to claim 1, characterized in that: Repair priority is determined according to the following steps: According to the preset importance score of each fault function of the corresponding equipment to be repaired, the fault function score GF is obtained, where GF meets the following conditions: GF=Σ n i=1 GQ i ; GQ i is the i-th fault function G of the corresponding device to be repaired i The corresponding preset importance score; i = 1, 2, ..., n; where n is the number of fault functions of the corresponding equipment to be repaired; the preset importance score of the fault function indicates the importance of the corresponding fault function to the target area; According to the stop impact score of each normal function of the corresponding equipment to be repaired, the normal function score ZF is obtained, where ZF meets the following conditions: ZF=Σ m j=1 TQ j ; TQ j is the jth normal function T of the corresponding device to be repaired j Corresponding stop impact score; j = 1, 2, ..., m; where m is the number of normal functions of the corresponding device to be repaired; the stop impact score is proportional to the number of key included devices of the corresponding normal function and inversely proportional to the preset importance score of the corresponding normal function; the preset importance score of the normal function indicates the importance of the corresponding normal function to the target area; the key included device is the normal included device currently running the corresponding normal function in the target sub-area where the corresponding device to be repaired is located; According to GF and ZF, the repair priority XY of the corresponding device to be repaired is obtained, where XY meets the following conditions: XY=GF+ZF.

3. The monitoring method of recording equipment according to claim 2, characterized in that: TQ j Meet the following conditions: TQ j =SL j / EPF j ; Among them, SL j T j Corresponding score of key included equipment quantity; SL j Meet the following conditions: SL j =NUMG j / NUMZ j ;NUMG j T j The corresponding number of key recording devices; NUMZ j The number of recorded devices in the target sub-area where the corresponding device to be repaired is located; EPF j T j The corresponding preset importance score.

4. The monitoring method of recording equipment according to claim 3, characterized in that: The preset importance score of the faulty function and the preset importance score of the normal function are both determined based on a preset mapping table, wherein the preset mapping table includes several recording device functions and the preset importance score corresponding to each recording device function; the faulty function or the normal function is any one of the several recording device functions.

5. The monitoring method of recording equipment according to claim 4, characterized in that: Each device to be repaired has a corresponding repair patch package, and the device to be repaired is repaired using the repair patch package.

6. The monitoring method of recording equipment according to claim 1, characterized in that: The collected data includes audio data and video data; the state prediction model is a multimodal fusion model; and obtaining the predicted working state of the target area and each target sub-area in the second time window based on the input data list and the state prediction model includes: Performing feature extraction on all audio data in the input data list to obtain audio features of the target area, and performing feature extraction on all video data in the input data list to obtain video features of the target area; Performing feature fusion on the audio features of the target area and the video features of the target area to obtain fusion features of the target area; Inputting the fusion features of the target area into the multimodal fusion model to obtain the predicted working state of the target area in the second time window; Performing feature extraction on the audio data corresponding to the normal recording device in each target sub-region in the input data list to obtain an audio feature corresponding to each target sub-region, and performing feature extraction on the video data corresponding to the normal recording device in each target sub-region in the input data list to obtain a video feature corresponding to each target sub-region; Performing feature fusion on the audio features and video features of each target sub-region to obtain a fused feature of each target sub-region; The fusion features of each target sub-region are respectively input into the multimodal fusion model to obtain the predicted working state of each target sub-region in the second time window.

7. The monitoring method of recording equipment according to claim 5, characterized in that: Repair the devices in the target sub-area's list of devices to be repaired in descending order of their repair priority, including: The device to be repaired corresponding to the device ID with the highest repair priority in the list of devices to be repaired in the target sub-area is used as the current device to be repaired; Repair the device to be repaired by using the repair patch package; In response to the completion of the repair of the current device to be repaired, the corresponding device ID is deleted from the list of devices to be repaired in the target sub-area; and the process jumps to the preset time interval to obtain the recorded data of all normal recorded devices contained in each target sub-area within the first time window to obtain the input data list, until the list of devices to be repaired in the target sub-area is empty.

8. A monitoring system for recording equipment, characterized in that: The system comprises: A device list acquisition unit is configured to acquire a list of devices to be repaired in each target sub-area contained in the target area; wherein the list of devices to be repaired includes the device ID of each device to be repaired in the corresponding target sub-area; and each device to be repaired has at least one fault function; A data acquisition unit is configured to acquire, at intervals of a preset duration, data collected by all normal collecting devices within each target sub-area within a first time window to obtain an input data list; wherein the end time of the first time window is the current time; A prediction unit is configured to obtain a predicted working state of the target area and each target sub-area in a second time window based on the input data list and the state prediction model; wherein the start time of the second time window is the current time; and the predicted working state is a busy state or an idle state; a priority determination unit configured to obtain a repair priority for each device to be repaired in a list of devices to be repaired in the target sub-region if the predicted working states of the target region and any target sub-region are both idle; wherein the repair priority is determined based on a preset importance score of the faulty function of the corresponding device to be repaired and a stop impact score of a normal function; the stop impact score indicates the degree of impact on the target region after the corresponding normal function stops operating; and during the repair process of the device to be repaired, all normal functions of the device to be repaired are stopped; The repair unit is configured to repair the devices to be repaired in descending order of repair priority of the devices to be repaired in the list of devices to be repaired in the target sub-area.

Citation Information

Patent Citations

  • Method and device for determining equipment maintenance work order and electronic equipment

    CN115018339A

  • Equipment maintenance method, equipment maintenance system, equipment maintenance device and storage medium

    CN115511122A

  • Hygiene maintenance system based on big data and smart pension

    CN115526357A

  • Server fault determination method and device and computer storage medium

    CN118502998A