Intelligent monitoring analysis system

Abstract

The invention relates to the technical field of intelligent systems, and discloses an intelligent monitoring analysis system, the intelligent monitoring analysis system is connected with a plurality of video devices, the system comprises a database layer, a basic service layer, an application service layer and a client, the database layer is used for storing data of the basic service layer, the application service layer and the client; the basic service layer is used for providing basic service of system business, acquiring and processing video data of video equipment and providing the video data for the application service layer; the application service layer is used for providing an application service of the system business based on the video data, the basic service and the task data of the system business, generating corresponding business data and sending the business data to the client; and the client is used for configuring the task data of the system business and displaying the task data based on the business data. According to the invention, the dependence on manpower can be reduced, and the analysis efficiency is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent systems, and particularly relates to an intelligent monitoring and analyzing system. BACKGROUND

[0002] The traditional energy facility monitoring system relies on manual inspection and single video monitoring, and has problems such as response lag, high labor cost, difficult to find safety hazards in time and the like.

[0003] At present, the unattended intelligent monitoring and analyzing system can partially realize automatic monitoring, but still has deficiencies in multi-source data fusion, intelligent linkage, dynamic environment adaptation and the like, the video monitoring and the equipment state data are separated, it is difficult to realize cross-system linkage, and the system has high dependence on manual operation, low analysis efficiency, lacks intelligent analysis algorithm for complex scenes, and has high false alarm rate. SUMMARY

[0004] Therefore, the present application provides an intelligent monitoring and analyzing system, which can reduce dependence on manual operation and improve analysis efficiency.

[0005] In a first aspect, the present application provides an intelligent monitoring and analyzing system connected with multiple video devices, the system comprising a database layer, a basic service layer, an application service layer and a client, wherein the database layer is configured to store data of the basic service layer, the application service layer and the client; the basic service layer is configured to provide basic services of system services, and is further configured to acquire and process video data of the video devices, and provide the video data for the application service layer; the application service layer is configured to provide application services of the system services based on the video data and basic services and task data of the system services, generate corresponding service data, and send the service data to the client; and the client is configured to configure task data of the system services, and display based on the service data.

[0006] In this implementation mode, the intelligent monitoring and analyzing system comprising the database layer, the basic service layer, the application service layer and the client is constructed, multi-source data fusion is realized by the basic service layer, intelligent analysis is realized by the application service layer, automatic management of monitoring data is realized, video monitoring and equipment data are combined, cross-system linkage is realized, intelligent analysis algorithm is combined, and false alarm rate is reduced. Therefore, the intelligent monitoring and analyzing system of the present application can reduce dependence on manual operation and improve analysis efficiency.

[0007] In an optional implementation, the basic service layer comprises a video device access module, a video device management module, a video stream media module and a video linkage module, wherein the video device access module is configured to interface and transmit data of the video device; the video device management module is configured to provide a state data interface and an entity interface of the video device; the video stream media module is configured to connect the video device and acquire video data; and the video linkage module is configured to process the video data.

[0008] In an optional implementation, the basic service layer comprises a user permission management module and an authentication interface module, wherein the user permission management module is configured to set user permissions of system services; and the authentication interface module is configured to access an authentication platform and perform user authentication by using the authentication platform.

[0009] In an optional implementation, the system services comprise a surveillance and prevention function, wherein the client is configured to configure a monitoring time period and a monitoring matter; the application service layer is configured to identify the video data by using a video recognition algorithm, determine whether the monitoring matter appears in the monitoring time period, generate an identification result, and send the identification result to the client; and the client is further configured to display the identification result.

[0010] In an optional implementation, the system services comprise a timing inspection function, wherein the client is configured to configure an inspection scheme and an execution cycle, and the inspection scheme comprises an inspection route and a video device rotation sequence; the application service layer is configured to rotate the video data according to the inspection scheme and the execution cycle, and detect an abnormal video; when an abnormal video is detected, the application service layer is configured to intercept the abnormal video, generate an inspection report, and send the inspection report to the client, wherein the inspection report comprises the abnormal video; and the client is further configured to display the inspection report.

[0011] In an optional implementation, the system services further comprise a key prompt function, wherein the application service layer is configured to perform alarm and generate alarm information when an abnormal device is detected in the abnormal video, and the alarm information comprises an alarm time, a device number, a device name and an alarm category; and the application service layer is configured to add a label to the abnormal device in the abnormal video, and the label comprises the alarm information.

[0012] In an optional implementation, the system services are linkage tracking functions, wherein the client is configured to select alarm information; the application service layer is configured to extract a device number in the alarm information; the basic service layer is configured to adjust a target video device based on the device number, acquire video data, and the video data comprises a video of an abnormal device corresponding to the device number; the application service layer is configured to extract the video data and send the video data to the client; and the client is further configured to display the video data.

[0013] In an alternative embodiment, the system service is a video recognition function, wherein the client is configured to configure a target to be recognized and a behavior to be recognized; the application service layer is configured to recognize the video data by using a video recognition algorithm, obtain the target to be recognized and the behavior to be recognized in the video data, generate a target result, and send the target result to the client; and the client is further configured to display the target result.

[0014] In an alternative embodiment, the system service is an augmented reality superimposition function, wherein the client is configured to configure label information, the label information including a prompt label and a device label; and the application service layer is configured to recognize the video data by using a video recognition algorithm, superimpose the label in the video data according to the label information, and obtain updated video data.

[0015] In an alternative embodiment, the system service is an intelligent storage function, wherein the client is configured to configure a storage rule, the storage rule including a storage period and an override rule; and the application service layer is configured to classify the video data by using a video recognition algorithm, and store the video data of different levels according to the storage rule. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the drawings needed to be used in the description of the embodiments or the prior art. Obviously, the drawings described below are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0017] Figure 1 is a schematic diagram of an intelligent monitoring and analysis system according to an embodiment of the present application;

[0018] Figure 2 is a flowchart of a method for implementing a watch and prevent function according to an embodiment of the present application;

[0019] Figure 3 is a flowchart of a method for implementing a timing inspection function according to an embodiment of the present application;

[0020] Figure 4 is a flowchart of a method for implementing a key prompt function according to an embodiment of the present application;

[0021] Figure 5 is a flowchart of a method for implementing a linkage tracking function according to an embodiment of the present application;

[0022] Figure 6 is a flowchart of a method for implementing an augmented reality superimposition function according to an embodiment of the present application;

[0023] Figure 7is a flowchart of an intelligent storage function implementation method according to an embodiment of the present application;

[0024] Figure 8 is a schematic diagram of another intelligent monitoring and analysis system according to an embodiment of the present application;

[0025] Figure 9 is a hardware structure schematic diagram of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

[0027] In the present embodiment, an intelligent monitoring and analysis system is provided, which is suitable for real-time monitoring, intelligent analysis, early warning and automatic management of energy facilities such as photovoltaic modules, energy storage devices, charging piles and power distribution cabinets.

[0028] Figure 1 is a schematic diagram of an intelligent monitoring and analysis system according to an embodiment of the present application, as shown in Figure 1 The intelligent monitoring and analysis system includes a database layer, a basic service layer, an application service layer and a client.

[0029] The intelligent monitoring and analysis system is connected to multiple video devices, wherein the video devices are used for monitoring the station.

[0030] The database layer is a database engine used by the applications of the intelligent monitoring and analysis system, and is used to store data generated in the running process of the basic service layer, the application service layer and the client.

[0031] In an implementation manner, the database layer includes two databases of a dream database and a Redis database, which respectively store different types of data.

[0032] The dream database is a high-performance and scalable domestic relational database management system, which has complete independent intellectual property rights, supports multiple data structures and programming language interfaces, is widely used in enterprise-level applications, big data processing and financial industries, and provides stable and reliable data services.

[0033] The dream database mainly stores relational business data, such as user permission related data, video device management related data, alarm element data, etc.

[0034] Redis is an open source Key-Value database written in ANSI C, adhering to the BSD license, supporting network, based on memory, distributed, and optional persistence, and providing APIs in multiple languages. Redis is often referred to as a data structure server because the value can be a string, a hash, a list, a set, and a sorted set, etc.

[0035] The Redis database is mainly used to store business data with high update frequency, such as alarm information and AR information.

[0036] The basic service layer provides basic services and data for independent business applications. The data and services in this layer can be associated with any business context, and are abstracted as relatively low-level system concepts, used to provide basic services for system business, and also used to obtain and process video data of video devices, and provide video data for the application service layer.

[0037] In an implementation manner, the basic service layer includes three service categories, which are video service, user service, and data service.

[0038] In an example, the basic service layer includes a video device access module, a video device management module, a video stream media module, and a video linkage module, and the video service is implemented through the video device access module, the video device management module, the video stream media module, and the video linkage module.

[0039] Specifically, the video device access module is used for interface docking and data transmission of the video device.

[0040] The video device management module is used to provide a CRUD (Create, Read, Update, Delete, which refer to creation, reading, updating, and deleting in database operation) interface or a CRUD interface of state data of various entities related to the video device.

[0041] For example, basic information of a video device such as a camera, a camera state, a dynamic orientation of the camera, a video node tree, a logical video tree, a scene configuration, and a video group.

[0042] The video stream media module includes a video code stream data resource pool and a camera control connection pool. The video stream media module is used to connect various (brands and models) video devices and platforms supported by the system, and obtain video code stream data.

[0043] The video stream media module supports multiple video transmission protocols, and provides parsing and re-encapsulation functions for multiple video packaging formats.

[0044] The video transmission protocol includes an RTSP (Real Time Streaming Protocol), an ONVIF (Open Network Video Interface Forum), an RTP (Real-time Transport Protocol), and the like, and the video encapsulation format includes a PS, an RTP, and the like.

[0045] It can be understood that the basic service layer further includes a multi-protocol compatible module, the multi-protocol compatible module supports ONVIF, RTSP, and GB / T28181 protocols, and access is realized through a device SDK or a standardized interface.

[0046] The video linkage tracking module is configured to process the video data.

[0047] Exemplarily, the video linkage tracking module superimposes the calculated positions of information such as power components, energy storage, charging piles, power distribution cabinets, and the like in the video screen through the associated device signals and the map object data, and simultaneously supports real-time linkage tracking of the device signal targets.

[0048] In an example, the basic service layer includes a user permission management module and an authentication interface module, and user services are realized through the user permission management module and the authentication interface module.

[0049] Specifically, the user permission management module is configured to set user permissions of system services.

[0050] The authentication interface module is configured to access an authentication platform and perform user authentication by using the authentication platform.

[0051] In another example, the user service defines a general user and permission system model, which includes basic functions such as user management, permission management, organization management, and role management. The user and permission system can provide safe and effective login access control for high-level services. The user service simultaneously includes a unified authentication interface module, which can realize access to a unified authentication platform.

[0052] In an example, the data service provides various real-time dynamic data of regulatory objects required by the business system. After various access signals are analyzed and processed by the system, the signals are fused into unified regulatory target signals and pushed to a data bus for use by high-level business applications.

[0053] The data bus service uses zmq as a basic frame line to realize the subscription and consumption mechanism of pub-sub.

[0054] The data bus of the present application can realize real-time synchronization. The system of the present application adopts a data bus service constructed based on ZeroMQ (zmq), and the core mechanism thereof is a pub-sub mode. The data bus is not associated with business attributes, and does not store data snapshots, but only serves as an intermediate device for data push-subscription. In the system, the data generated by various data sources (such as video streams, device states, environmental parameters, etc.) is pushed to the data bus through corresponding data interfaces. At the same time, the business modules or services that need these data subscribe to the relevant topics, thereby obtaining the required data in real time. This architecture realizes the decoupling of data, so that the data producers and consumers do not need to interact directly, thereby improving the flexibility and scalability of the system. For example, when a new data source is added, it only needs to push its data to the data bus, without the need to modify the existing business module code.

[0055] In another example, the data service includes a timestamp normalization module for eliminating time delay differences.

[0056] Specifically, since the multi-source data comes from different devices and systems, the timestamps of data acquisition may differ. The timestamp normalization module performs time alignment processing on the data obtained from different data sources, unifies the time reference of multi-source data, eliminates the time delay problem caused by the difference in data acquisition time, and thereby constructs a unified device dynamic portrait, providing an accurate data basis for subsequent intelligent analysis and decision-making.

[0057] The application service layer provides system services associated with system business. Such services are developed according to the actual design needs of the system, and are used to provide application services of system business based on video data and basic services, task data of system business, and generate corresponding business data.

[0058] In one example, the services of the application service layer include an alarm service, an AR superimposition service, a key monitoring service, and an external interface.

[0059] The application service layer is also used to send business data to the client.

[0060] The client is used to configure the task data of system business, and to display based on the business data.

[0061] Specifically, the client mainly refers to the UI interaction interface used by the end user, and the client design should include the task function entrances of all business items designed in the system requirement design.

[0062] The task functions include setting up surveillance, viewing surveillance, alarm records, alarm information, device status, rule configuration, video control, etc.

[0063] In an implementation manner, the system service includes a surveillance function, the client configures a monitoring time period and a monitoring item; the basic service layer acquires video data; the application service layer identifies the video data by using a video recognition algorithm, judges whether the monitoring item appears in the monitoring time period, generates an identification result, and sends the identification result to the client; and the client displays the identification result. Specifically, refer to Figure 2 , Figure 2 is a flowchart of a surveillance function implementation method according to an embodiment of the present application.

[0064] Specifically, the client is started, the user logs in the system interface, and the user selects the device, the monitoring time period, and the monitoring item that need to be configured for surveillance in the client.

[0065] The monitoring item includes device abnormality, personnel intrusion, etc.

[0066] The basic service layer determines the preset position of the device information that needs to be surveilled according to the preset bit or the absolute positioning mode of the geodetic coordinate, automatically adjusts the camera head of the video device to the preset position, and collects video data according to the preset zoom ratio.

[0067] The application service layer calls the video recognition algorithm in the monitoring time period, only focuses on the monitoring item selected by the user, and judges whether the monitoring item occurs in real time to generate an identification result. The identification result is fed back to the client in real time.

[0068] The client displays the identification result on the system interface for the user to view.

[0069] Specifically, the application service layer is responsible for processing user requests related to the “key surveillance” function, including setting a surveillance target, configuring a surveillance rule, receiving a surveillance event, triggering an alarm, etc. Upon receiving a surveillance target setting request sent by the client, such as specifying a certain photovoltaic module, energy storage device, charging pile, or power distribution cabinet as a surveillance target. Define and manage the surveillance rule, such as the triggering condition, surveillance time, alarm mode, etc. Store the surveillance rule information into the database, and associate it with the surveillance target information of the application service layer. Receive event information related to the surveillance target from the basic service layer, such as sensor data abnormality, device state change, etc.

[0070] In another implementation, the system service includes a scheduled inspection function, and the client configures the inspection plan and execution cycle; the basic service layer obtains video data; the application service layer rotates the video data according to the inspection plan and the execution cycle, and performs anomaly detection on the video data. When an abnormal video is detected, the abnormal video is intercepted, an inspection report is generated, and the inspection report is sent to the client, which includes the abnormal video; the client displays the inspection report.

[0071] Specifically, see Figure 3 , Figure 3 4 is a flow chart of a method for implementing a timed inspection function according to an embodiment of the present invention.

[0072] Launch the client and customize an inspection plan template. Each inspection plan in the template includes an inspection route and a rotation order for video devices. The user selects an inspection plan from the template and sets a run cycle, such as daily or weekly.

[0073] Receive the client's start inspection instruction, synchronously enable the inspection plan, the basic service layer automatically executes according to the inspection plan, obtains the video screen in a carousel, the application service layer subscribes to the video analysis result push, monitors abnormal conditions in real time through the video recognition algorithm, performs abnormality detection on the video data, discards the video data when no abnormal video is detected, and automatically takes a screenshot of the video when an abnormal video is detected. Receive the client's end inspection instruction, stop the inspection plan, cancel the video analysis subscription, generate an inspection report, record the abnormal conditions and screenshots, and send the inspection report to the client.

[0074] The client displays the inspection report on the system interface for users to view.

[0075] Furthermore, users can query historical inspection records at any time to understand the monitoring status.

[0076] Furthermore, the system service includes a key reminder function (early warning function), please refer to Figure 3 When an abnormal video is detected, an early warning message is generated, and a snapshot video is started, and the early warning message is stored in the database. Specifically, when the application service layer detects the presence of an abnormal device in the abnormal video, an alarm is issued, an alarm message is generated, and a label is added to the abnormal device in the abnormal video.

[0077] Among them, the key functions include alarm services, which include calculation, generation, event triggering, recording, query and other business functions of alarm information.

[0078] Specifically, see Figure 4 , Figure 4 4 is a flow chart of a method for implementing a key prompt function according to an embodiment of the present invention.

[0079] Launch the client, which displays alarm information such as device abnormalities in a list format. View alarm information such as the alarm time, device number, device name, and alarm category. Select the abnormal video that caused the alarm. Overlay a prominent label containing the alarm information on the alarm device in the alarm video. The labeled video data is then sent to the client for display. This method allows users to quickly locate the problem.

[0080] In one example, anomaly detection includes detecting cracks, hot spots, stains and other anomalies in photovoltaic modules, detecting module temperature anomalies through thermal imaging technology, and providing timely warnings of potential failures.

[0081] In one example, anomaly detection includes combining key parameters of the energy storage device, such as battery status, temperature, and voltage, with historical data and algorithm models to predict potential equipment failures of the energy storage device.

[0082] Furthermore, when an alarm event is triggered, detailed information is recorded and the responsible parties are notified in a reasonable manner according to the alarm principle. The alarm service also provides an alarm record query function to facilitate statistical analysis of historical alarm information.

[0083] Furthermore, the system includes a linkage tracking function, allowing users to view alarm information after an abnormal alarm is triggered. The client selects the alarm information; the application service layer extracts the device number from the alarm information; the basic service layer adjusts the target video device based on the device number and obtains video data containing the abnormal device corresponding to the device number. The application service layer extracts the video data and sends it to the client; the client then displays the video data.

[0084] Specifically, see Figure 5 , Figure 5 The figure is a flow chart of a method for implementing the linkage tracking function according to an embodiment of the present invention. In this method, the linkage tracking calculates the target position through a spatial coordinate mapping algorithm and drives the gimbal to adjust the viewing angle, with an error rate of less than 2%.

[0085] The client displays alarm information such as abnormal status of equipment in the form of a list, and can view alarm information such as alarm time, equipment number, equipment name, and alarm category. When the user clicks on the alarm information in the alarm list, the system automatically extracts the equipment number, and calls the corresponding camera according to the equipment number to achieve automatic focus, view the on-site situation, automatically play the picture of the alarm equipment and locate the alarm location.

[0086] In another implementation, the system service includes a video recognition function, the client configures the target to be identified and the behavior to be identified; the basic service layer obtains the video data; the application service layer uses the video recognition algorithm to identify the video data, obtains the target to be identified and the behavior to be identified in the video data, generates the target result, and sends the target result to the client; the client displays the target result.

[0087] The target identification of this application includes device identification, object identification, and meter identification. Device identification can identify basic information such as the device name and serial number; object identification supports the identification of foreign objects on photovoltaic modules, such as bird droppings and dust; and meter identification can identify indicator lights and switch status on the device panel to assist in determining the device's operating status.

[0088] The behavior recognition of this application can identify non-compliant behaviors of personnel when operating equipment, such as not wearing a safety helmet, illegal operation, etc.

[0089] In another implementation, the system services include augmented reality overlay function, and the client configures tag information; the basic service layer obtains video data; the application service layer uses a video recognition algorithm to identify the video data, and overlays tags in the video data according to the tag information to obtain updated video data.

[0090] The label information includes prompt labels and device labels.

[0091] See also Figure 6 , Figure 6 This is a flow chart of a method for implementing augmented reality overlay functionality according to an embodiment of the present invention. AR tag overlay supports custom styles and trigger conditions, and data is updated in real time via WebSocket.

[0092] When the client is launched and the desired video data is clicked, the application service layer identifies the device in the video and overlays device labels such as basic information, technical parameters, operational monitoring data, and alarm information on the video. When the client clicks the Draw button, the application service layer overlays warning lines, alarm prompts, and other prompt labels on the video to enhance monitoring intuitiveness.

[0093] Specifically, the application service layer is responsible for processing user requests related to AR overlay functionality, invoking corresponding services, and overlaying AR elements such as device information, labels, and warning lines onto the video screen. This layer interacts with the user interface layer, the data service layer, and the video processing layer. Based on user requests, the data service layer is called upon to obtain device information, technical parameters, operational monitoring data, and so on. The video processing layer's services are then called upon to overlay the acquired data onto the video screen as AR elements. The results of multiple services are integrated to create a complete AR overlay effect.

[0094] In another implementation, the augmented reality superimposition function and the linkage tracking function are combined.

[0095] Specifically, the device real-time parameters, alarm tags, and virtual warning lines are superimposed in the video screen. When an anomaly (such as temperature overrun) is detected, the camera view angle is automatically adjusted and linked to the adjacent sensor for multi-dimensional data verification. For example, through linkage with the video monitoring system, the device name, model, real-time parameters, and other information are displayed in the video screen, and the results of multiple services are integrated to form a complete AR superimposition effect.

[0096] This function can provide users with more intuitive device state display and more convenient operation experience. Through AR technology, users can more intuitively understand the device state, quickly locate abnormal devices, and improve emergency response efficiency. At the same time, multi-dimensional data verification reduces the false alarm rate and improves the reliability and accuracy of the system.

[0097] In another implementation, the system service includes an intelligent storage function, the client end is configured with a storage rule, the storage rule includes a storage period and an overlay rule, the basic service layer acquires video data, and the application service layer classifies the video data using a video recognition algorithm and stores video data of different levels according to the storage rule.

[0098] Specifically, please refer to Figure 7 , Figure 7 is a flowchart of an intelligent storage function implementation method according to an embodiment of the application.

[0099] The client end is started, the video device that needs intelligent storage is selected on the client end, and the storage rule and the storage period are customized and configured, such as the storage path, the storage format, and the like. The negative sample video data recognized by the data layer is automatically stored for subsequent analysis and optimization. The storage period is configured according to the abnormality level, the old data is automatically overlaid, and the storage space is saved.

[0100] In a possible implementation, different storage periods are configured for high-risk data according to the level of abnormal events.

[0101] For example, high-risk data is permanently stored for subsequent audit and analysis; low-risk data is automatically overlaid according to the time or capacity threshold to avoid wasting storage space.

[0102] The hierarchical storage strategy of this function improves the utilization rate of storage resources while ensuring data security. For example, for some routine monitoring data, a shorter storage period can be used to reduce storage costs; and for critical high-risk data, permanent storage is performed to meet the subsequent audit and traceability requirements.

[0103] Further, the storage content is viewed on the video playback page of the client end.

[0104] In an implementation, the system service includes an external application interface function, which provides a unified external interface according to the business needs of the system.

[0105] In an implementation, the system service includes a dynamic adjustment strategy function.

[0106] Specifically, based on the device dynamic portrait after multi-source data fusion, combined with the evaluation results of the intelligent analysis engine, the priority and frequency of data collection, processing and analysis are dynamically adjusted.

[0107] For example, when it is detected that the device is in a high-risk state or an abnormal situation, the data collection frequency is increased so as to obtain more detailed information in time for analysis.

[0108] Through dynamic scheduling, the system can more efficiently integrate multi-source data and ensure the accuracy and timeliness of the analysis results. At the same time, the dynamic scheduling mechanism can reasonably allocate computing resources according to system load and data importance, improving the overall performance of the system.

[0109] In an implementation, the system service includes a multi-level energy storage scheduling echelon function.

[0110] Specifically, the application service layer obtains the basic characteristics of the energy storage device, divides the energy storage device into multiple scheduling echelons according to the use scenarios of the energy storage device, and dynamically optimizes the charging and discharging strategy according to the electricity price peak and valley, the device state of health (SOH) and the load demand.

[0111] The basic characteristics include capacity, charging and discharging efficiency, state of health, etc.

[0112] For example, the energy storage device with good state of health and large capacity is used as the first echelon to meet the power supply demand during high-load periods; the energy storage device with slightly poor state of health or small capacity is used as the second echelon to supplement the first echelon.

[0113] During the electricity price valley period, low-price power grid is preferentially used to charge the energy storage device; when the device state of health is good and the load demand is low, the charging amount of the energy storage device is increased; when a high-load period is detected, a backup battery pack is enabled to supplement power supply. At the same time, the charging strategy is adjusted according to the device state of health, and for the device with poor state of health, the charging current is reduced or a more conservative charging strategy is adopted to prolong the device life.

[0114] For example, low-price electricity is used for charging at night, and the energy storage device is used for power supply during the daytime high-load period, reducing the dependence on the power grid.

[0115] Through dynamic charging and discharging collaborative management, energy utilization efficiency can be improved, operating costs can be reduced, and the impact on the power grid can be reduced.

[0116] The intelligent monitoring analysis system architecture design of the present application mainly includes the system architecture, data model, user interface, and system deployment scheme, system interface, system docking, query statistics scheme, etc. It generally describes the development and implementation scheme of the video platform system from the system architecture, data model, user interface, etc.

[0117] The intelligent monitoring analysis system is developed using B / S architecture, uses a component-based micro-service architecture method and strategy to design the hierarchical architecture of the system, and uses an object-oriented method to construct components and services. The system has a unified, simple and consistent user operation interface, and has strong extensibility, reusability and good performance.

[0118] The intelligent monitoring analysis system has strong flexibility. During development, the use of workflow, business rule engine, etc. improves the adaptability of the system to business process and business rule changes; in terms of architecture, micro-service architecture and component technology are used to cope with various changes in the system; in terms of data, a good data model design is used to cope with various major changes; in implementation, the reuse of each level improves the development efficiency and flexibility of the system.

[0119] The intelligent monitoring analysis system is built on various standards, such as architecture standards and data standards, and a unified system development standard specification system will be established during actual development to improve the overall level of the system and facilitate integration with external agencies. Please refer to Figure 8 , Figure 8 is a schematic diagram of another intelligent monitoring analysis system according to an embodiment of the present application.

[0120] The intelligent monitoring analysis system of the present application realizes the combination of video monitoring and device state data, cross-system linkage through multi-source data fusion, intelligent linkage and dynamic environment adaptation; the intelligent analysis algorithm for complex scenes has a low false alarm rate; the health state monitoring of energy storage devices and the charging and discharging strategy are coordinated to improve the energy dispatching efficiency.

[0121] At the same time, the present application has a safe and reliable design mechanism, a dual-redundancy hot standby mechanism: the database uses master-slave cluster (Dream Database + Redis), the service node supports dynamic expansion and load balancing, ensuring that single-point failure does not affect system operation; multi-level permission control: fine-grained permission management based on roles (administrator, operator, inspector), sensitive operations require secondary authentication, and the log audit module records the full-link operation behavior; environmental self-adaptive regulation and control: real-time monitoring of battery operating environment, automatic start of constant temperature and humidity equipment when temperature or humidity exceeds the threshold, and push of regulation and control instructions through the remote client.

[0122] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0123] The embodiment of the present invention also provides a computer device having the above Figure 1 or Figure 8 The intelligent monitoring and analysis system shown.

[0124] See also Figure 9 , Figure 9 is a structural diagram of a computer device provided by an optional embodiment of the present invention, such as Figure 9 As shown, the computer device includes: one or more processors 10, memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components utilize different buses to communicate with each other and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of a GUI on an external input / output device (such as, a display device coupled to an interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Equally, multiple computer devices can be connected, and each device provides part of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 9 A processor 10 is taken as an example.

[0125] The processor 10 may be a central processing unit, a network processor, or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic, or any combination thereof.

[0126] The memory 20 stores instructions that can be executed by at least one processor 10, so as to enable at least one processor 10 to execute the method shown in the above embodiment.

[0127] The memory 20 can include a program storage area and a data storage area, where the program storage area can store an operating system, application programs required for at least one function, and the data storage area can store data created according to the use of the computer device, etc. In addition, the memory 20 can include a high-speed random access memory, and can also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state memory device. In some alternative embodiments, the memory 20 can optionally include a memory disposed remotely from the processor 10, which can be connected to the computer device through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0128] The memory 20 can include a volatile memory, such as a random access memory, and can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid state disk, and can also include a combination of the above-mentioned kinds of memories.

[0129] The computer device also includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30, and the output device 40 can be connected by a bus or other means, Figure 9 For example, by a bus connection.

[0130] The input device 30 can receive input digital or character information, and generate key signal inputs related to the user settings and function controls of the computer device, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 can include a display device, an auxiliary lighting device (e.g., an LED), a tactile feedback device (e.g., a vibration motor), etc. The display device includes, but is not limited to, a liquid crystal display, a light-emitting diode, a display, and a plasma display. In some alternative embodiments, the display device can be a touch screen.

[0131] The embodiments of the present application further provide a computer readable storage medium, and the method according to the embodiments of the present application can be implemented in hardware, firmware, or recorded in a storage medium, or stored in a remote storage medium or a non-transitory machine readable storage medium and downloaded to a local storage medium through network, so that the method described herein can be processed by such software on a storage medium using a general purpose computer, a special purpose processor, or programmable or special hardware. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid state disk, etc. Further, the storage medium can also include a combination of the above-mentioned memories. It can be understood that the computer, the processor, the microprocessor controller, or the programmable hardware includes a storage component that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiments is implemented.

[0132] Part of the present application can be applied as a computer program product, for example, computer program instructions, when executed by a computer, the operation of the computer can invoke or provide the method and / or technical solutions according to the present application. Those skilled in the art should understand that the form of computer program instructions in computer readable medium includes but is not limited to source file, executable file, installation package file, etc. Correspondingly, the way of computer program instructions executed by computer includes but is not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Here, the computer readable medium can be any available computer readable storage medium or communication medium accessible to the computer.

[0133] Although the embodiments of the present application are described in conjunction with the accompanying drawings, various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of the present application, and such modifications and changes fall within the scope defined by the appended claims.

Claims

1. An intelligent monitoring and analysis system, characterized in that: The intelligent monitoring and analysis system is connected to multiple video devices. The system includes a database layer, a basic service layer, an application service layer and a client. The database layer is used to store data of the basic service layer, the application service layer and the client; The basic service layer is used to provide basic services for system business, and is also used to obtain and process video data of the video device and provide the video data to the application service layer; The application service layer is used to provide application services for the system business based on the video data, the basic services, and the task data of the system business, generate corresponding business data, and send the business data to the client; The client is used to configure task data of the system business and display based on the business data.

2. The intelligent monitoring and analysis system according to claim 1, characterized in that: The basic service layer includes a video device access module, a video device management module, a video streaming module and a video linkage module, wherein: The video device access module is used for interface connection and data transmission of the video device; The video device management module is used to provide a status data interface and a physical interface of the video device; The video streaming module is used to connect to the video device and obtain the video data; The video linkage module is used to process the video data.

3. The intelligent monitoring and analysis system according to claim 1, characterized in that: The basic service layer includes a user rights management module and an authentication docking module, including: The user rights management module is used to set user rights for the system services; The authentication docking module is used to access the authentication platform and use the authentication platform to perform user authentication.

4. The intelligent monitoring and analysis system according to claim 2, characterized in that: The system services include marking functions, wherein, The client is used to configure monitoring time periods and monitoring items; The application service layer is configured to identify the video data using a video recognition algorithm, determine whether the monitoring event occurs within the monitoring time period, generate a recognition result, and send the recognition result to the client; The client is also used to display the recognition result.

5. The intelligent monitoring and analysis system according to claim 2, characterized in that: The system service includes a regular inspection function, wherein: The client is used to configure an inspection plan and an execution cycle, wherein the inspection plan includes an inspection route and a rotation sequence of video devices; The application service layer is configured to rotate the video data according to the execution period of the inspection scheme and perform anomaly detection on the video data. When an abnormal video is detected, the abnormal video is intercepted, an inspection report is generated, and the inspection report is sent to the client, wherein the inspection report includes the abnormal video. The client is also used to display the inspection report.

6. The intelligent monitoring and analysis system according to claim 5, characterized in that: The system service also includes a key prompt function, wherein, The application service layer is used to issue an alarm and generate alarm information when an abnormal device is detected in the abnormal video, and the alarm information includes the alarm time, device number, device name, and alarm category; A label is added to the abnormal device in the abnormal video, wherein the label includes the alarm information.

7. The intelligent monitoring and analysis system according to claim 6, characterized in that: The system service is a linkage tracking function, wherein: The client is used to select the alarm information; The application service layer is used to extract the device number in the alarm information; The basic service layer is configured to adjust a target video device based on the device number and obtain the video data, where the video data includes a video of the abnormal device corresponding to the device number; The application service layer is used to extract the video data and send the video data to the client; The client is also used to display the video data.

8. The intelligent monitoring and analysis system according to claim 2, characterized in that: The system service is a video recognition function, wherein: The client is used to configure the target to be identified and the behavior to be identified; The application service layer is configured to identify the video data using a video recognition algorithm, obtain the target to be identified and the behavior to be identified in the video data, generate a target result, and send the target result to the client; The client is also used to display the target result.

9. The intelligent monitoring and analysis system according to claim 2, characterized in that: The system service is an augmented reality overlay function, wherein: The client is used to configure tag information, wherein the tag information includes a prompt tag and a device tag; The application service layer is used to identify the video data using a video recognition algorithm, and to superimpose tags on the video data according to the tag information to obtain updated video data.

10. The intelligent monitoring and analysis system according to any one of claims 2 to 9, characterized in that: The system service is an intelligent storage function, wherein: The client is used to configure storage rules, wherein the storage rules include storage period and overwriting rules; The application service layer is used to classify the video data using a video recognition algorithm and store the video data of different levels according to the storage rules.

Images