Video automatic configuration method and system based on regulations

By adopting a procedure-based video automation configuration method in the nuclear engineering environment, the procedure step information in the video screen is automatically identified and displayed, and the problem of inefficiency of traditional video surveillance systems is solved, and efficient information acquisition and task simplification is achieved.

CN119135976APending Publication Date: 2024-12-13SHANGHAI NUCLEAR ENGINEERING RESEARCH & DESIGN INSTITUTE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411238026.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-05
Publication Date
2024-12-13

AI Technical Summary

Technical Problem

In the working environment of nuclear engineering, traditional video surveillance systems require manual operations to switch and locate relevant information, resulting in inefficiency and increased task load, and it is impossible to efficiently obtain relevant information related to procedures.

Method used

Adopt the video automation configuration method based on the procedure, and by obtaining the procedure content and video screen, identifying the procedure steps and associated information, cutting the video screen, building a video layout template, and synchronizing the video blocks according to the execution order of the procedure steps to achieve automation Video screen display.

Benefits of technology

It improves the efficiency of staff obtaining information related to procedures, reduces the task load of operators, and realizes efficient information acquisition and video surveillance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119135976A_ABST
    Figure CN119135976A_ABST
Patent Text Reader

Abstract

The invention relates to a regulation-based video automatic configuration method and system, and the method comprises the steps: S1, obtaining regulation contents and a video image of a distributed control system, recognizing regulation steps in the regulation contents and related information corresponding to the regulation steps, carrying out the cutting of the video image according to the related information, and storing the cut video image in a database; obtaining a video block corresponding to the procedure step; s2, constructing a video layout template according to the regulation content, arranging and integrating the video blocks into the video layout template according to a preset rule, and obtaining a regulation matching video picture; and S3, synchronously triggering and displaying the video blocks in the video picture matched with the regulation according to the execution sequence of the regulation steps. According to the method and the device, the corresponding video picture content can be automatically displayed according to the execution sequence of the procedure steps, so that a worker can efficiently and accurately obtain associated information related to the procedure.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention mainly relates to the technical field of video monitoring display, and in particular to a video automation configuration method and system based on a procedure. Background Art

[0002] In the working environment of nuclear engineering, strict compliance with the requirements of regulations is crucial. Some of these regulations are accompanied by corresponding graphic display interfaces or monitoring video screens, which intuitively display key related information through the screen. The traditional screen information query and retrieval mechanism relies on the parameters or equipment identification clearly stated in the electronic regulation system, and guides the user to the complete screen containing this information in the distributed control system (DCS) through preset links. This process requires manual operation, such as clicking or using the configured screen navigation tool to switch and open the screen to display the entire DCS process flow display screen.

[0003] The DCS display screen is often complicated, and the directly presented screen cannot always focus on the information points directly related to the current procedure step. Therefore, the operator has to perform a secondary search, manually locate and view the specific display area to obtain the required information. This manual information retrieval method is not only inefficient, but also significantly increases the operator's human-machine interface management task load when performing tasks. Operations such as searching and switching screens take up a lot of their time and energy. At present, there is a problem of low efficiency in obtaining procedure-related related information from the DCS video screen. Summary of the invention

[0004] The technical problem to be solved by the present application is to provide a procedure-based video automation configuration method and system, which can automatically display the corresponding video screen content according to the execution order of the procedure steps, so that the staff can efficiently and accurately obtain the relevant information related to the procedure.

[0005] The technical solution adopted by the present application to solve the above-mentioned technical problems is a procedure-based video automation configuration method, including: step S1: obtaining the procedure content and the video screen of the distributed control system, identifying the procedure steps in the procedure content and the associated information corresponding to the procedure steps, cutting the video screen according to the associated information, and obtaining the video blocks corresponding to the procedure steps; step S2: constructing a video layout template according to the procedure content, arranging and integrating the video blocks into the video layout template according to preset rules, and obtaining the procedure-matching video screen; and step S3: synchronously triggering the display of the video blocks in the procedure-matching video screen according to the execution order of the procedure steps.

[0006] In one embodiment of the present application, in step S1, the step of identifying the procedure steps in the procedure content and the associated information corresponding to the procedure steps includes: inputting the procedure content into a pre-trained multimodal neural network model, the pre-trained multimodal neural network model outputting the procedure steps and the associated information corresponding to the procedure steps; numbering each procedure step to obtain the procedure step number.

[0007] In one embodiment of the present application, in step S1, the video screen is cut according to the associated information, and the step of obtaining the video block corresponding to the procedure step includes: identifying the video screen using a target tracking method and / or an image recognition method according to the associated information, and obtaining the video position area corresponding to the associated information; cutting the video position area using a pixel-level video cutting method to obtain the video block; wherein the video block includes the associated information; and numbering each video block to obtain a block number.

[0008] In one embodiment of the present application, the associated information includes: one or any combination of device information, real-time operating parameter information, alarm information, trend information, safety prompt information, and historical record information.

[0009] In one embodiment of the present application, in step S2, a video layout template is constructed according to the procedure content, and the step of arranging the video blocks and integrating them into the video layout template according to preset rules includes: constructing the video layout template according to the execution order and importance of each procedure step; wherein the video layout template includes multiple grids; according to the execution order of each procedure step, the video blocks corresponding to each procedure step are arranged in an orderly manner from top to bottom and from left to right and integrated into the video layout template; each video block is adaptively scaled according to the size of the grid.

[0010] In one embodiment of the present application, in step S2, after the step of obtaining the video screen corresponding to the procedure, it also includes: taking the video blocks corresponding to the procedure steps as a video set; numbering the video set corresponding to each procedure step to obtain a scene number.

[0011] In one embodiment of the present application, in step S3, the step of synchronously triggering the display of the video block in the video screen corresponding to the procedure according to the execution order of the procedure steps includes: synchronously triggering the corresponding scene number according to the execution order of each procedure step; calling and displaying the video block corresponding to the scene number.

[0012] In one embodiment of the present application, in step S3, in the process of displaying the video block in the procedure supporting video screen, a visual prompt method and / or a voice prompt method is used to highlight and emphasize the video block corresponding to the current procedure step; wherein the visual prompt method includes one or any combination of highlight display, flashing display, bold border display, and raised edge display, and the voice prompt method includes broadcasting the serial number of the current procedure step and / or a specific alarm sound of the current procedure step.

[0013] In order to solve the above-mentioned technical problems, the present application also proposes a procedure-based video automation configuration system, which is configured to execute the above-mentioned procedure-based video automation configuration method, including: an information capture module, which is used to obtain the procedure content and the video screen of the distributed control system, identify the procedure steps in the procedure content and the associated information corresponding to the procedure steps, cut the video screen according to the associated information, and obtain the video blocks corresponding to the procedure steps; a layout integration module, which is used to construct a video layout template according to the procedure content, and arrange and integrate the video blocks into the video layout template according to preset rules to obtain the procedure-matching video screen; a linkage display module, which is used to synchronously trigger the display of the video blocks in the procedure-matching video screen according to the execution order of the procedure steps.

[0014] The technical solution of the present application can accurately obtain the video block content directly corresponding to each procedural step by cutting the video screen according to the related information; by integrating the video block arrangement into the video layout template, it can automatically generate customized procedural supporting video screens according to different work scenarios; by synchronously displaying the corresponding video blocks according to the execution order of the procedural steps, it can help staff quickly obtain the required information, thereby improving overall work efficiency.

[0015] The video automation configuration method based on the procedure of this application can be encapsulated into video automation configuration and monitoring software. Through the calling and splicing fusion configuration of video screens, the traditional restrictions of DCS on display content can be cleverly circumvented. Through the intelligent cutting and real-time splicing of multiple single screens, this application can break the traditional constraints of "one step, one screen", and can realize the intensive procedure screen display of "multi-step, multi-window". There is no need to increase the DCS software screen. The flexible reorganization of the video source of the display terminal can greatly improve the monitoring efficiency. This application can be widely used in the VDU (Video Display Unit) or large-screen display system of the main control room operation station, which can greatly enrich the display content of the video terminal, make it more compatible with the use of the procedure, and effectively reduce the task load of the operator when executing the procedure. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below with reference to the accompanying drawings, wherein:

[0017] Figure 1 is an exemplary flow chart of a procedure-based video automation configuration method according to an embodiment of the present application;

[0018] Figure 2 is a schematic diagram of a procedure-based video automation configuration system according to an embodiment of the present application;

[0019] Figure 3 It is a system block diagram of a procedure-based video automation configuration system according to an embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below with reference to the accompanying drawings.

[0021] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein, and therefore the present application is not limited to the specific embodiments disclosed below.

[0022] As shown in this application and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0023] Flowcharts are used in the present application to illustrate the operations performed by the system according to the embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, various steps may be processed in reverse order or simultaneously. At the same time, other operations may be added to these processes, or one or more operations may be removed from these processes.

[0024] The procedure-based video automation configuration system of the present application is first introduced here, and the procedure-based video automation configuration method of the present application will be introduced later.

[0025] Figure 2 is a schematic diagram of a video automation configuration system based on a procedure according to an embodiment of the present application, with reference to Figure 2As shown, the procedure-based video automation configuration system 200 of this embodiment is configured to execute the procedure-based video automation configuration method as described later, and the video automation configuration system 200 includes: an information capture module 210, which is used to obtain the procedure content and the video screen of the distributed control system, identify the procedure steps in the procedure content and the associated information corresponding to the procedure steps, cut the video screen according to the associated information, and obtain the video blocks corresponding to the procedure steps. A layout integration module 220 is used to construct a video layout template according to the procedure content, and arrange and integrate the video blocks into the video layout template according to preset rules to obtain the procedure-matching video screen. A linkage display module 230 is used to synchronously trigger the display of the video blocks in the procedure-matching video screen according to the execution order of the procedure steps.

[0026] Exemplarily, the above-mentioned modules in the procedure-based video automation configuration system 200 of the present application can be implemented by a computer hardware device composed of a processor and a memory. Specifically, the above-mentioned modules are stored in the memory as program units, and the processor executes the program units stored in the memory to realize thread control.

[0027] Continue to refer Figure 2 As shown, exemplarily, the procedure-based video automation configuration system 200 is equivalent to video automation configuration and monitoring software, including three core modules: (1) Information capture module 210: Based on the associated information of the procedure, it can bypass the DCS control of the content of the display screen output end through the video, cut the single video screen where the information content is located accordingly, and number the cut video blocks. (2) Layout integration module 220: It can arrange and integrate the cut video blocks according to the rules of a specific template (such as a nine-square grid, etc.) according to the computerized procedure execution steps to form a corresponding procedure-matched video screen, and perform a reasonable display layout on the operation station VDU or large-screen terminal. (3) Linkage display module 230: It can highlight and emphasize the corresponding video block content according to the progress of the procedure execution steps, so that the operator can easily obtain relevant information.

[0028] This application uses information capture and video cropping technology to integrate parameter display, alarm and other information that are highly relevant to the procedure steps to generate corresponding procedure-matching video images. These video images can accurately match the reference and related information required during the execution of the procedure, and are scientifically and reasonably laid out and displayed on the VDU or large-screen display terminal of the operating station, so that operators can quickly and efficiently obtain information and promote collaborative work between operating teams. In the case of limited physical video output resources, this application reconstructs video images that meet the requirements of the procedure by retrieving, calling, cutting and combining the specific information required by the procedure. When the procedure execution enters the relevant steps, the system can visually enhance these key information to reduce the operator's information processing burden and improve overall operational efficiency.

[0029] The following text will introduce the procedure-based video automation configuration method of this application.

[0030] The present application proposes a procedure-based video automation configuration method, which can be applied to scenarios where it is necessary to quickly obtain procedure-related information and procedure-related video images according to procedure requirements. The procedure-based video automation configuration method of the present application can be run in a nuclear power plant production DCS network computer, for example, in a computer controller, and can also be run in a nuclear power plant management and operation network cloud platform. The present application does not limit the operating environment of the procedure-based video automation configuration method.

[0031] Figure 1 is an exemplary flow chart of a video automation configuration method based on a procedure according to an embodiment of the present application, with reference to Figure 1 As shown, the video automation configuration method based on the procedure of this embodiment includes the following steps:

[0032] Step S1: Acquire the procedure content and the video screen of the distributed control system, identify the procedure steps in the procedure content and the associated information corresponding to the procedure steps, cut the video screen according to the associated information, and obtain the video blocks corresponding to the procedure steps.

[0033] Step S2: construct a video layout template according to the content of the regulations, and integrate the video blocks into the video layout template according to preset rules to obtain the video screen supporting the regulations.

[0034] Step S3: Synchronously triggering the display of the video blocks in the video screen supporting the procedure according to the execution order of the procedure steps.

[0035] The above steps S1 to S3 are described in detail below:

[0036] In step S1, the procedure content and the video screen of the distributed control system (DCS) are obtained, the procedure steps in the procedure content and the associated information corresponding to the procedure steps are identified, the video screen is cut according to the associated information, and the video blocks corresponding to the procedure steps are obtained.

[0037] In some embodiments, the associated information includes: one or any combination of equipment information, real-time operating parameter information, alarm information, trend information, safety prompt information, and historical record information. For example, in nuclear engineering, the procedure-related information can generally include a series of standard operating procedures, technical specifications, safety regulations, and emergency response procedures related to nuclear facility safety, operation and maintenance, and fault handling. This information is the basis for ensuring the safe and efficient operation of nuclear engineering, covering all aspects from daily inspections to emergency accident handling.

[0038] For example, reference Figure 2 As shown, step S1 of the present application is equivalent to Figure 2 The procedure disassembly step 211, information retrieval step 212, and signal source cropping step 213 are shown in FIG. Specifically, (1) Procedure disassembly step 211: In the computerized procedure, each computerized procedure is disassembled into specific executable and quantifiable procedure steps, focusing on sorting out the display information of the equipment, parameters, and alarms in each procedure step, and encoding each procedure step. (2) Information retrieval step 212: The display information required for each procedure step obtained in the procedure disassembly step 211 is completely retrieved in the DCS software system through the graphic display submodule, trend submodule, alarm submodule, etc., and the submodule information coding corresponding to the information is determined. (3) Signal source cropping step 213: Through the pixel-level video cutting method, the information distributed in the video sources of different submodules obtained in the information retrieval step 212 is cropped to determine the minimum video block required for each procedure step.

[0039] In some embodiments, in step S1, the step of identifying the procedure steps in the procedure content and the associated information corresponding to the procedure steps includes:

[0040] Step S1a: Input the procedure content into the pre-trained multimodal neural network model, and the pre-trained multimodal neural network model outputs the procedure steps and the associated information corresponding to the procedure steps. Exemplarily, the pre-trained multimodal neural network model of the present application is constructed based on a deep learning model. During the training of the model, the multimodal data includes procedure documents, procedure pictures, procedure videos, etc. The pre-trained multimodal neural network model of the present application can identify key information in the procedure content.

[0041] Step S1b: Number each procedure step to obtain the procedure step number.

[0042] In some embodiments, in step S1, the step of cutting the video screen according to the associated information to obtain the video blocks corresponding to the procedure steps includes:

[0043] Step S1c: using a target tracking method and / or an image recognition method to identify the video frame according to the associated information, and obtaining a video position area corresponding to the associated information.

[0044] Step S1d: using a pixel-level video cutting method to cut the video position area to obtain a video block; wherein the video block includes associated information.

[0045] Step S1e: number each video block to obtain a block number. For example, one procedure step number may correspond to one block number or multiple block numbers, which is not limited in the present application.

[0046] In step S2, a video layout template is constructed according to the content of the procedure, and the video blocks are arranged and integrated into the video layout template according to the preset rules to obtain the video screen supporting the procedure. Figure 2 As shown, step S2 of the present application is equivalent to Figure 2 The fusion arrangement step 221 and the scene retention step 222 are shown in FIG. Specifically, (1) the fusion arrangement step 221: the smallest video block obtained in the source cropping step 213 is orderly integrated into the display block through a fusion processing method according to the procedure steps from top to bottom and from left to right. The integration can place different video blocks in a pre-set video layout template and can be scaled to the corresponding size. (2) The scene retention step 222: the video set integrated in the fusion arrangement step 221 and located in the video layout template is determined according to the procedure step number and saved in the video splicing and fusion software.

[0047] In some embodiments, in step S2, a video layout template is constructed according to the content of the protocol, and the step of arranging the video blocks and integrating them into the video layout template according to a preset rule includes:

[0048] Step S2a: Construct a video layout template according to the execution order and importance of each procedure step; wherein the video layout template includes multiple grids. Exemplarily, the video layout template can be set as a template in the form of a nine-grid or 2*4 grid, and the grid corresponding to the procedure step with high importance can be set larger, and other grids can be set smaller, which is not limited in this application.

[0049] Step S2b: according to the execution order of each procedure step, the video blocks corresponding to each procedure step are arranged in order from top to bottom and from left to right and integrated into the video layout template.

[0050] Step S2c: Each video block is adaptively scaled according to the size of the grid. For example, an adaptive layout algorithm can be used to adjust the size of each video block, so that the best display effect can be achieved on operating station VDUs or large-screen terminals of different sizes.

[0051] In some embodiments, in step S2, after obtaining the procedure supporting video screen, the step further includes:

[0052] Step S2d: The video blocks corresponding to the procedure steps are taken as a video set.

[0053] Step S2e: Number the video set corresponding to each procedure step to obtain a scene number. For example, the scene is nuclear facility safety inspection, operation and maintenance, fault handling, etc. A scene number can correspond to one video block or multiple video blocks, which is not limited in this application.

[0054] In step S3, the video blocks in the video screen supporting the protocol are synchronously triggered to display according to the execution order of the protocol steps. Figure 2 As shown, step S3 of the present application is equivalent to Figure 2 The procedure triggering step 231 and the highlighting step 232 are shown in FIG. Specifically, (1) Procedure triggering step 231: through the procedure steps in the computerized procedure system, the corresponding scene and scene number saved in the scene retention step 222 are automatically triggered, and the procedure steps and the required video blocks are fully presented in the VDU or large-screen display system, realizing the "multi-step multi-window" intensive procedure screen presentation effect. (2) Highlighting step 232: as the execution of the procedure steps progresses, each time a step is activated, the outer edge of the video block of the corresponding step is raised to highlight the current activated step, so that the operator can quickly obtain the corresponding information. The operator can also freely control the display content and method of the video screen as needed.

[0055] In some embodiments, in step S3, the step of synchronously triggering the display of the video block in the video picture of the protocol matching according to the execution order of the protocol steps includes:

[0056] Step S3a: Synchronously trigger the corresponding scene number according to the execution order of each procedure step;

[0057] Step S3b: Retrieve and display the video block corresponding to the scene number.

[0058] In some embodiments, in step S3, in the process of displaying the video block in the video screen supporting the procedure, a visual prompt method and / or a voice prompt method are used to highlight and emphasize the video block corresponding to the current procedure step; wherein the visual prompt method includes one or any combination of highlight display, flashing display, bold border display, and edge raised display, and the voice prompt method includes broadcasting the sequence number of the current procedure step and / or a specific alarm sound of the current procedure step. Exemplarily, such a setting can improve the operator's concentration when obtaining information.

[0059] The technical solution of the present application can accurately obtain the video block content directly corresponding to each procedural step by cutting the video screen according to the related information; by integrating the video block arrangement into the video layout template, it can automatically generate customized procedural supporting video screens according to different work scenarios; by synchronously displaying the corresponding video blocks according to the execution order of the procedural steps, it can help staff quickly obtain the required information, thereby improving overall work efficiency.

[0060] The video automation configuration method based on the procedure of this application can be encapsulated into video automation configuration and monitoring software. Through the calling and splicing fusion configuration of video screens, the traditional restrictions of DCS on display content can be cleverly circumvented. Through the intelligent cutting and real-time splicing of multiple single screens, this application can break the traditional constraints of "one step, one screen", and can realize the intensive procedure screen display of "multi-step, multi-window". There is no need to increase the DCS software screen. The flexible reorganization of the video source of the display terminal can greatly improve the monitoring efficiency. This application can be widely used in the VDU or large-screen display system of the main control room operation station, which can greatly enrich the display content of the video terminal, make it more compatible with the use of the procedure, and effectively reduce the task load of the operator when executing the procedure.

[0061] The present application also includes a procedure-based video automation configuration system, including a memory and a processor, wherein the memory is used to store instructions executable by the processor; and the processor is used to execute the instructions to implement the procedure-based video automation configuration method described above.

[0062] Figure 3 is a system block diagram of a video automation configuration system based on a procedure according to an embodiment of the present application. Figure 3As shown, the video automation configuration system 300 based on the procedure may include an internal communication bus 301, a processor 302, a read-only memory (ROM) 303, a random access memory (RAM) 304, and a communication port 305. The video automation configuration system 300 based on the procedure may also include a hard disk 306. The internal communication bus 301 may implement data communication between components of the video automation configuration system 300 based on the procedure. The processor 302 may make judgments and issue prompts. In some embodiments, the processor 302 may be composed of one or more processors. The communication port 305 may implement data communication between the video automation configuration system 300 based on the procedure and the outside. In some embodiments, the video automation configuration system 300 based on the procedure may send and receive information and data from the network through the communication port 305. The video automation configuration system 300 based on the procedure may also include different forms of program storage units and data storage units, such as a hard disk 306, a read-only memory (ROM) 303 and a random access memory (RAM) 304, which can store various data files used for computer processing and / or communication, and possible program instructions executed by the processor 302. The processor executes these instructions to implement the main part of the method. The results processed by the processor are transmitted to the user device through the communication port and displayed on the user interface.

[0063] The above-mentioned procedure-based video automation configuration method can be implemented as a computer program, stored in the hard disk 306, and loaded into the processor 302 for execution to implement the procedure-based video automation configuration method of the present application.

[0064] The basic concepts have been described above. Obviously, for those skilled in the art, the above application disclosure is only an example and does not constitute a limitation of the present application. Although not explicitly stated herein, those skilled in the art may make various modifications, improvements and amendments to the present application. Such modifications, improvements and amendments are suggested in the present application, so such modifications, improvements and amendments still belong to the spirit and scope of the exemplary embodiments of the present application.

[0065] At the same time, the present application uses specific words to describe the embodiments of the present application. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of the present application. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, some features, structures or characteristics in one or more embodiments of the present application can be appropriately combined.

[0066] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of the present application are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

Claims

1. A video automation configuration method based on a procedure, characterized in that: include: Step S1: Acquire the procedure content and the video screen of the distributed control system, identify the procedure steps in the procedure content and the associated information corresponding to the procedure steps, cut the video screen according to the associated information, and obtain the video block corresponding to the procedure steps; Step S2: constructing a video layout template according to the content of the procedure, arranging and integrating the video blocks into the video layout template according to preset rules, and obtaining a video screen supporting the procedure; as well as Step S3: Synchronously triggering the display of the video blocks in the video screen supporting the procedure according to the execution order of the procedure steps.

2. The video automation configuration method according to claim 1, characterized in that: In step S1, the step of identifying the procedure steps in the procedure content and the associated information corresponding to the procedure steps includes: Inputting the procedure content into a pre-trained multimodal neural network model, the pre-trained multimodal neural network model outputting the procedure steps and associated information corresponding to the procedure steps; Number each procedure step to obtain the procedure step number.

3. The video automation configuration method according to claim 1, characterized in that: In step S1, the step of cutting the video screen according to the associated information to obtain the video blocks corresponding to the procedure steps includes: According to the associated information, a target tracking method and / or an image recognition method is used to identify the video screen, and a video position area corresponding to the associated information is obtained; Using a pixel-level video cutting method to cut the video position area to obtain the video block; wherein the video block includes the associated information; Each video block is numbered to obtain a block number.

4. The video automation configuration method according to claim 1, characterized in that: The associated information includes: one or any combination of equipment information, real-time operating parameter information, alarm information, trend information, safety prompt information, and historical record information.

5. The video automation configuration method according to claim 1, characterized in that: In step S2, the steps of constructing a video layout template according to the content of the procedure and integrating the video block arrangement into the video layout template according to a preset rule include: Constructing the video layout template according to the execution order and importance of each procedure step; wherein the video layout template includes a plurality of grids; According to the execution order of each procedure step, the video blocks corresponding to each procedure step are arranged in order from top to bottom and from left to right and integrated into the video layout template; Each video block is adaptively scaled according to the size of the grid.

6. The video automation configuration method according to claim 1, characterized in that: In the step S2, after obtaining the procedure supporting video screen, it also includes: The video blocks corresponding to the procedure steps are taken as a video set; The video collection corresponding to each procedure step is numbered to obtain a scene number.

7. The video automation configuration method according to claim 1 or 6, characterized in that: In step S3, the step of synchronously triggering the display of the video blocks in the video screen supporting the protocol according to the execution order of the protocol steps includes: The corresponding scene number is triggered synchronously according to the execution order of each procedure step; The video block corresponding to the scene number is retrieved and displayed.

8. The video automation configuration method according to claim 1, characterized in that: In step S3, in the process of displaying the video block in the video screen supporting the procedure, a visual prompt method and / or a voice prompt method are used to highlight and emphasize the video block corresponding to the current procedure step; wherein the visual prompt method includes one or any combination of highlight display, flashing display, bold border display, and raised edge display, and the voice prompt method includes broadcasting the serial number of the current procedure step and / or the specific alarm sound of the current procedure step.

9. A video automation configuration system based on procedures, characterized in that: The method is configured to execute the procedure-based video automation configuration method according to any one of claims 1 to 8, comprising: An information capture module is used to obtain the procedure content and the video screen of the distributed control system, identify the procedure steps in the procedure content and the associated information corresponding to the procedure steps, cut the video screen according to the associated information, and obtain the video block corresponding to the procedure steps; A layout integration module, used to construct a video layout template according to the content of the procedure, and to integrate the video block arrangement into the video layout template according to a preset rule to obtain a video screen supporting the procedure; The linkage display module is used to synchronously trigger the display of the video blocks in the procedure supporting video screen according to the execution order of the procedure steps.