Audit video generation method and system used in graph operation and maintenance field, and medium
By real-time analysis and conversion of graphics operation and maintenance traffic to H.264 standard video streams in the audit video generation system in the field of graphics operation and maintenance, the problems of private audit format, large overhead of transcoding performance and lack of remote operation video auditing in the existing technology are solved, and efficient and general audit video generation and real-time traceability capabilities are achieved.
Patent Information
- Application Number
- CN202411721109.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-28
- Publication Date
- 2025-02-28
AI Technical Summary
The audit formats of existing graphics protocols are mostly private video formats, and a dedicated player is required for audit playback, resulting in increased audit dependence and not universal and concise enough; the performance overhead of existing standard video transcoding methods is large, and the utilization rate of storage and video recording space is poor, and commercial remote tools usually do not provide remote operation video recording audit function, resulting in the inability to trace the source when security issues are not available.
By deploying an audit video generation system on the operation and maintenance client, graphics server terminal and intermediate agent equipment, the system includes a protocol parser, RGB graphics maintenance layer, YUV graphics maintenance layer, H.264 encoding layer and video packaging module, it analyzes graphics operation and maintenance traffic in real time, converts it to H.264 standard video stream, and packages it into a standard video format.
It realizes the generation of audit videos for remote graphics operation and maintenance, with high real-time performance, low performance loss, and easy configuration and deployment, improving the ease of use and resource utilization of audit videos, and supporting a variety of application scenarios.
Smart Images

Figure CN119545121A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of graphics operation and maintenance auditing, and specifically relates to an audit video generation method, system and medium for the graphics operation and maintenance field. Background Art
[0002] Most of the audit formats of existing graphic protocols are private video formats, which require dedicated players for audit playback, increasing the audit dependency and not being universal and concise enough. For example, the video format and audit playback in the intermediate agent operation and maintenance audit system are both private formats. Most of the existing standard video transcoding uses ffmpeg to compare the data of each image in full, find the difference between adjacent images, and then generate a frame of video data. The key frame settings are relatively fixed, which has a huge performance overhead for transcoding, and the utilization rate of the generated storage video space is not good enough. Some existing commercial remote tools (such as todesk, sunflower, etc.) do not provide remote operation video auditing. In most scenarios, remote service terminals will be deployed under the office network so that employees can work remotely at any time. However, the lack of video auditing will result in the inability to trace the source after security issues occur. Summary of the invention
[0003] The purpose of the present invention is to provide an audit video generation method, system and medium for the field of graphic operation and maintenance, aiming to solve the above-mentioned problems.
[0004] The present invention is mainly achieved through the following technical solutions: A method for generating audit videos for use in the field of graphic operation and maintenance, comprising the following steps: Step S100: obtaining graphic operation and maintenance traffic based on the operation and maintenance client, the graphic server terminal and the intermediate proxy device; Step S200: parsing the graphic message in the graphic operation and maintenance traffic based on the protocol parser and rendering it into the RGB graphic maintenance layer; calling the graphic transcoder to convert the RGB data into the corresponding YUV data and rendering it into the YUV graphic maintenance layer; Step S300: updating the image change heat map according to the time dimension and the spatial dimension of the image change area on the screen, and converting the data of the YUV graphic maintenance layer into an H.264 standard video stream in real time based on the graphic transcoder; Step S400: Encapsulating the H.264 video stream into a corresponding standard video format according to the video encapsulation format by a video encapsulator.
[0005] In order to better implement the present invention, further, step S100 includes the following steps: Step S110: on the operation and maintenance client, the graphic data flow is diverted by directly connecting to the graphic client and performing data analysis based on the transmission capture flow between the graphic server terminal and the graphic client; Step S120: on the graphics server terminal, the graphics connection data is directed, and the graphics data flow is directed by directly connecting to the graphics server and performing data analysis based on the transmission capture flow between the operation and maintenance client and the graphics server; Step S130: In the intermediate proxy device, based on the protocol parsing of the operation and maintenance proxy, the graphic data traffic is bypassed and output.
[0006] In order to better implement the present invention, further, step S200 includes the following steps: Step S210: Create and initialize a protocol parser, and initialize an RGB graphics maintenance layer; Step S220: Create and initialize a graphics transcoder and a YUV graphics maintenance layer; Step S230: During operation, the protocol parser receives and parses the graphics protocol message and renders it into an original RGB bitmap, and updates it to the RGB graphics maintenance layer; Step S240: When the RGB graphics maintenance layer updates data, the changed graphics data is thrown to the YUV graphics maintenance layer through the event interface registered by the graphics transcoder; the graphics transcoder converts the RGB data into corresponding YUV data according to the configured YUV sampling rate and renders it into the YUV graphics maintenance layer.
[0007] In order to better implement the present invention, further, step S210 includes the following steps: Step S211: When a new graphics operation and maintenance traffic is connected, the protocol of the graphics operation and maintenance traffic is identified, and a corresponding protocol parser is matched according to the protocol; Step S212: the protocol analyzer analyzes the graphics protocol message and obtains graphics capability parameters, wherein the graphics capability parameters include resolution, color setting, and image rendering method; Step S213: Initialize the memory screen maintained by the RGB graphics maintenance layer according to the resolution, and initialize the protocol parser according to the color setting and image rendering method for subsequent parsing of graphics operation and maintenance traffic.
[0008] In order to better implement the present invention, further, step S220 includes the following steps: Step S221: Obtain resolution, YUV sampling rate, image sampling intensity, video frame rate, and video key frame strategy based on input configuration; Step S222: Initialize the YUV graphics maintenance layer according to the resolution size and the YUV sampling rate; Step S223: Initialize the image change heat map of the entire screen, divide the screen into rectangular grid areas from the upper left corner to the lower right corner of the screen, and initialize the maintenance of the set point map according to the image sampling intensity; Step S224: setting the image sampling period of the graphic transcoder according to the video frame rate to periodically track and process the changed area in the memory screen; Step S225: Initializing the graphics transcoder based on the video key frame strategy to initialize the timing of generating key frames during graphics transcoding; Step S226: Initialize the graphics update interface provided by the registration protocol parser.
[0009] In order to better implement the present invention, further, step S300 includes the following steps: Step S310: updating the image change heat map according to the coordinate area of the graphic change, and performing hotspot auto-increment on the array elements corresponding to the graphic change area; Step S320: the graphics transcoder performs periodic image processing according to the frame rate setting, and when the time period is triggered, determines whether to generate an I frame or a P frame, and transcodes the data of the YUV graphics maintenance layer into a frame of H.264; Step S330: When the data conversion within a cycle is processed, the two-dimensional array of the image change heat map is reset to zero for maintenance and detection of the image change area in the next cycle.
[0010] In order to better implement the present invention, further, step S320 includes the following steps: Step S321: if the current frame is the first frame, an I frame is generated to represent the complete image data of the first screen, and the entire screen data in the YUV graphics maintenance layer is transcoded into the H.264 format and encapsulated as an I frame; otherwise, proceed to step S322; Step S322: When the time from the last I frame reaches the set threshold, or the image data size between the last I frame reaches the set threshold, the entire screen data in the YUV graphics maintenance layer is transcoded into the H.264 format and encapsulated as an I frame; otherwise, step S323 is entered to generate a P frame; Step S323: When an I frame is not needed, a P frame is generated. If there is no change in the heat map during the cycle time, an empty P frame is generated. If an image area changes during the cycle, the YUV data in the changed graphic area is transcoded into H.264 format and encapsulated as a P frame.
[0011] In the standard video implemented, there are only two types of frame combinations: I-frames and P-frames. Therefore, if the conditions for generating an I-frame are not met, all P-frames will be generated. Specifically, the first frame of the video must be a complete full-screen image to ensure the integrity of the video image, so the first frame must be an I-frame. The first frame is the only special case. If it is not the first frame, it will be executed uniformly according to the subsequent judgment logic.
[0012] The present invention is mainly achieved through the following technical solutions: An audit video generation system for the field of graphics operation and maintenance is based on the above method and includes a graphics transcoder and a protocol parser, an RGB graphics maintenance layer, a YUV graphics maintenance layer, an H.264 encoding layer and a video encapsulation module arranged in sequence from front to back; the protocol parser is used to parse the graphics messages in the graphics operation and maintenance traffic and render them into the RGB graphics maintenance layer; the graphics transcoder is used to maintain the image changes of the screen and convert the original image data into H.264 video data according to the strategy; the video encapsulation module is used to encapsulate the H.264 video data into the corresponding standard video format.
[0013] In order to better implement the present invention, further, the audit video generation system is respectively built into the operation and maintenance client, the graphic server terminal and the intermediate proxy device to realize the diversion of graphic data traffic.
[0014] A computer-readable storage medium stores a computer program, which implements the above method when executed by a processor.
[0015] The beneficial effects of the present invention are as follows: (1) The present invention realizes the generation of audit videos in a universal format by remote graphic operation and maintenance. The present invention generates audit videos in a universal format in real time and achieves the best audit experience with very low performance loss. It can also flexibly adjust performance, storage, and video quality. The present invention improves the ease of use of audit videos, improves the real-time performance of audit video generation, reduces audit resource loss, and can be flexibly configured and deployed according to actual application scenarios.
[0016] (2) The audit video generation system designed by the present invention has the advantages of being universal and concise. Based on the input graphic stream data and the corresponding configuration, it can output a standard video file. The present invention can be used in a variety of scenarios to better connect the client, operation and maintenance agent, and server. The design of the audit video generation system adopts the optimal solution for video generation in principle, because the graphic protocol during remote operation and maintenance is based on the previous screen data to update the image data of the area that needs to be changed, which naturally fits the concept of P frame (forward prediction frame) in H.264. When processing the protocol traffic, the change graphic data is converted into P frame (forward prediction frame) in real time, which is naturally the optimal solution.
[0017] (3) In the transcoding device of the present invention, parameter algorithms such as YUV sampling rate and heat maintenance of screen update are designed, which can flexibly control the quality of audit video, storage space size, and performance overhead during transcoding, and can be adjusted according to input parameters to achieve the optimal value in a specific scenario. For example, for scenarios where transcoding performance overhead is not considered and audit storage overhead needs to be considered more, it can be adjusted to YUV420, heat map maintenance uses 8*8 finest strength, and the frame rate is set to a minimum of about 10 frames; for scenarios where the image quality of audit video needs to be considered more, it can be adjusted to YUV444, heat map maintenance uses 8*8 finest strength, and the frame rate is set to more than 24 frames; for scenarios where transcoding concurrency and performance overhead need to be considered more, it can be adjusted to YUV420, heat map maintenance uses 64*64, and the frame rate is set to a minimum of about 10 frames. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 It is a principle block diagram of the audit video generation system used in the field of graphic operation and maintenance of the present invention; Figure 2 Provide a block diagram of the audit video generation system built into the operation and maintenance client; Figure 3 Provide a block diagram of the audit video generation system built into the server; Figure 4 A block diagram of the audit video generation system built into the middle agent device; Figure 5 A schematic diagram of a heat map of image changes for screen updates. DETAILED DESCRIPTION
[0019] Embodiment 1: A method for generating audit videos in the field of graphic operation and maintenance aims to realize remote graphic operation and maintenance to generate audit videos in a universal format, especially to generate audit videos in a universal format in real time, and to achieve the best audit experience with very low performance loss. It can also flexibly regulate performance, storage, and video quality; improve the usability of audit videos, the real-time nature of audit video generation, reduce audit resource loss, and can be flexibly configured and deployed according to actual application scenarios. Figure 1 As shown, the specific steps include: Step S100: Connecting the graphic operation and maintenance traffic to the audit video generation system; Step S200: creating an image memory of a complete screen, parsing the graphic packets in various graphic flows and rendering them into the screen memory; Step S300: Generate H.264 standard video stream in real time according to the two dimensions of time dimension and image change area on the screen; Step S400: Encapsulate the H.264 video stream into a corresponding standard video format according to actual needs.
[0020] Step S410: Initialize and create a video encapsulator and set a standard video encapsulation format; Step S420: encapsulate the H.264 data according to the video encapsulation format and output the video in a standard video format.
[0021] Preferably, the step S100 specifically includes: Step S110: Figure 2 As shown, the audit video generation system is deployed on the client PC of the operation and maintenance and the graphic connection data is diverted. One method is to directly connect to the graphic client (the client needs to provide SDK interface support), and the other method is to parse the data after capturing the traffic based on the transmission (it is difficult to parse the encrypted graphic connection data); Step S120: Figure 3 As shown, the audit video generation system is deployed on the graphic server terminal and completes the drainage of graphic connection data. One method is to directly integrate into the server (the server needs to provide SDK interface support, or integrate the audit video generation system as part of the server), and the other method is to parse the data after capturing the traffic based on transmission (it is difficult to parse the encrypted transmission graphic connection data); Step S130: Figure 4 As shown, the audit video generation system is deployed to an intermediate proxy device. Since the proxy device can parse the protocol, the plaintext traffic of the graphic connection can be directly bypassed.
[0022] Preferably, the specific steps of step S200 include: Step S210: Initialize and create several protocol parsers to parse various graphics protocols and render them into original bitmaps; initialize the RGB graphics maintenance layer; Step S220: When the protocol parser is successfully initialized, a graphics transcoder is initialized to maintain the image changes of the screen and convert the original image data into H.264 video data according to the strategy; a YUV graphics maintenance screen is initialized; Step S230: During operation, the protocol parser continuously receives the graphics protocol data, parses the graphics protocol message and renders it into the original RGB bitmap, and updates it to the RGB graphics maintenance layer; Step S240: when the RGB graphics maintenance layer updates data, the changed graphics data is thrown to the YUV graphics maintenance layer through the event interface registered by the transcoder.
[0023] Preferably, the specific steps of step S210 include: Step S211: When a new graphic operation and maintenance traffic is connected, the protocol of the graphic traffic is first identified, and a protocol parser for processing the protocol is matched according to the protocol; Step S212: The protocol analyzer analyzes the graphics protocol of the connection and obtains the graphics capability parameters used in this connection, where the graphics capability parameters include resolution, color setting, image rendering method, etc.; Step S213: Initialize the memory screen maintained by the RGB graphics maintenance layer according to the resolution, and initialize the specific protocol parsing capability according to the color setting and image rendering method for subsequent parsing of graphics traffic.
[0024] Preferably, the specific steps of step S220 include: Step S221: After the protocol parser is successfully created, the resolution, YUV sampling rate, image sampling intensity, video frame rate, video key frame strategy and other settings are obtained from the input configuration, and the graphic transcoder is initialized and created; Step S222: Initialize and create a YUV graphics maintenance layer according to the resolution size and the YUV sampling rate; specifically, the YUV sampling rate is divided into three types: yuv444, yuv422, and yuv420, corresponding to three different image qualities: high, medium, and low; Step S223: Initialize the image change heat map of the entire screen, divide the screen into rectangular grid areas from the upper left corner to the lower right corner of the screen, and initialize the maintenance of the set point map according to the image sampling intensity; specifically, the image sampling is divided into four levels - 64*64, 32*32, 16*16, 8*8, and a two-dimensional data is used for maintenance, each one-dimensional array represents a row of rectangular areas, and each element in the one-dimensional array represents a monitored rectangular area; Step S224: Initializing the image sampling period of the graphics transcoder according to the video frame rate setting to periodically track and process the changed area in the memory screen; Step S225: the graphics transcoder sets a video key frame strategy to determine the timing of generating a key frame during graphics transcoding; Step S226: Initialize the graphics update interface provided by the registration protocol parser to receive image changes in the graphics protocol to drive subsequent graphics transcoder operations.
[0025] Preferably, in step S240, when the protocol parser completes the graphics protocol parsing and rendering, the event interface registered by the graphics transcoder is called. After the graphics transcoder receives the RGB original graphics data in the interface, it converts the RGB data into corresponding YUV data according to the configured YUV sampling rate and renders it into the YUV graphics maintenance memory.
[0026] Preferably, the specific steps of step S300 include: Step S310: Figure 5 As shown, according to the coordinate area of the graphic change, the image change hotspot map is updated, and the array elements corresponding to the graphic change area are automatically incremented; Step S320: The graphics transcoder performs periodic image processing according to the frame rate setting. When the time period is triggered, it determines whether to generate an I frame (key frame) or a P frame (forward prediction frame), and transcodes the data in the YUV graphics maintenance memory into a frame of H.264. For example, if the video frame rate is set to 20 frames / second, each unit period is 50 milliseconds.
[0027] Step S330: When the data conversion within a cycle is processed, the two-dimensional array of the image change heat map is reset to zero for maintenance and detection of the image change area in the next cycle.
[0028] Preferably, the specific steps of step S320 include: Step S321: when the current frame is the first frame, an I frame (key frame) needs to be generated to represent the complete image data of the first screen, and the entire screen data in the YUV graphics maintenance memory is transcoded into the H.264 format and encapsulated as an I frame (key frame); Step S322: According to the key frame strategy in the configuration, when the time from the last I frame (key frame) reaches the set threshold, or the amount of image data between the last I frame (key frame) reaches the set threshold, the entire screen data in the YUV graphics maintenance memory is transcoded into H.264 format and encapsulated as an I frame (key frame).
[0029] Specifically, because the I frame is a complete screen of image data, the data occupies a large space. However, the setting of the I frame is related to the experience of arbitrary drag and drop jumps during video playback. The I frame should be set as little as possible to avoid excessive file size, and it should be set to the maximum to ensure that the video can quickly jump to the image at the corresponding time point when jumping. Here, the two-dimensional settings of time and space are used to ensure the best I frame setting that is compatible with time and space. When the video jumps to play, it will first find the I frame closest to the jump point to start rendering to ensure that the correct full-screen data is rendered; we only set the I frame and P frame, so we will only find the first I frame before the jump point.
[0030] Step S323: when an I frame (key frame) is not needed, a P frame (forward prediction frame) is generated. If there is no change in the heat map within the periodic time, an empty P frame (forward prediction frame) is generated to indicate that there is no image change in the frame and the image is the same as the previous frame. Step S324: When an I frame (key frame) is not needed and an image area changes within the period, the YUV data in the changed graphic area is transcoded into H.264 format and encapsulated as a P frame (forward prediction frame).
[0031] Embodiment 2: An audit video generation system for the field of graphics operation and maintenance is based on the above method, such as Figure 1 As shown, it includes several protocol parsers, RGB graphics maintenance layer, YUV graphics maintenance layer, H.264 encoding layer and video encapsulation module. The protocol parser is used to parse the graphics message in the graphics operation and maintenance traffic and render it into the RGB graphics maintenance layer; the graphics transcoder is used to maintain the image changes of the screen and convert the original image data into H.264 video data according to the strategy; the video encapsulation module is used to encapsulate the H.264 video data into the corresponding standard video format.
[0032] like Figures 2 to 4 As shown, the audit video generation system is built into the operation and maintenance client, the graphic server terminal and the intermediate proxy device respectively to realize the diversion of graphic data traffic.
[0033] The present invention realizes the remote graphic operation and maintenance to generate audit videos in a universal format, generates audit videos in a universal format in real time, and achieves the best audit experience with very low performance loss. It can also flexibly regulate performance, storage, and video quality; improves the usability of audit videos, improves the real-time nature of audit video generation, reduces audit resource loss, and can be flexibly configured and deployed according to actual application scenarios.
[0034] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Any simple modification or equivalent change made to the above embodiment based on the technical essence of the present invention shall fall within the protection scope of the present invention.
Claims
1. A method for generating audit videos used in the field of graphic operation and maintenance, characterized in that: The following steps are involved: Step S100: obtaining graphic operation and maintenance traffic based on the operation and maintenance client, the graphic server terminal and the intermediate proxy device; Step S200: parsing the graphic message in the graphic operation and maintenance traffic based on the protocol parser and rendering it into the RGB graphic maintenance layer; Call the graphics transcoder to convert RGB data into corresponding YUV data and render it into the YUV graphics maintenance layer; Step S300: updating the image change heat map according to the time dimension and the spatial dimension of the image change area on the screen, and converting the data of the YUV graphic maintenance layer into an H.264 standard video stream in real time based on the graphic transcoder; Step S400: Encapsulating the H.264 video stream into a corresponding standard video format according to the video encapsulation format by a video encapsulator.
2. According to claim 1, a method for generating audit videos used in the field of graphic operation and maintenance, characterized in that: The step S100 includes the following steps: Step S110: on the operation and maintenance client, the graphic data flow is diverted by directly connecting to the graphic client and performing data analysis based on the transmission capture flow between the graphic server terminal and the graphic client; Step S120: on the graphics server terminal, the graphics connection data is directed, and the graphics data flow is directed by directly connecting to the graphics server and performing data analysis based on the transmission capture flow between the operation and maintenance client and the graphics server; Step S130: In the intermediate proxy device, based on the protocol parsing of the operation and maintenance proxy, the graphic data traffic is bypassed and output.
3. According to claim 1, a method for generating audit videos used in the field of graphic operation and maintenance, characterized in that: The step S200 includes the following steps: Step S210: Create and initialize a protocol parser, and initialize an RGB graphics maintenance layer; Step S220: Create and initialize a graphics transcoder and a YUV graphics maintenance layer; Step S230: During operation, the protocol parser receives and parses the graphics protocol message and renders it into an original RGB bitmap, and updates it to the RGB graphics maintenance layer; Step S240: When the RGB graphics maintenance layer updates data, the changed graphics data is thrown to the YUV graphics maintenance layer through the event interface registered by the graphics transcoder; the graphics transcoder converts the RGB data into corresponding YUV data according to the configured YUV sampling rate and renders it into the YUV graphics maintenance layer.
4. The audit video generation method for the field of graphic operation and maintenance according to claim 3 is characterized in that: The step S210 includes the following steps: Step S211: When a new graphics operation and maintenance traffic is connected, the protocol of the graphics operation and maintenance traffic is identified, and a corresponding protocol parser is matched according to the protocol; Step S212: the protocol analyzer analyzes the graphics protocol message and obtains graphics capability parameters, wherein the graphics capability parameters include resolution, color setting, and image rendering method; Step S213: Initialize the memory screen maintained by the RGB graphics maintenance layer according to the resolution, and initialize the protocol parser according to the color setting and image rendering method for subsequent parsing of graphics operation and maintenance traffic.
5. The audit video generation method for the field of graphic operation and maintenance according to claim 3 is characterized in that: The step S220 includes the following steps: Step S221: Obtain resolution, YUV sampling rate, image sampling intensity, video frame rate, and video key frame strategy based on input configuration; Step S222: Initialize the YUV graphics maintenance layer according to the resolution size and the YUV sampling rate; Step S223: Initialize the image change heat map of the entire screen, divide the screen into rectangular grid areas from the upper left corner to the lower right corner of the screen, and initialize the maintenance of the set point map according to the image sampling intensity; Step S224: setting the image sampling period of the graphic transcoder according to the video frame rate to periodically track and process the changed area in the memory screen; Step S225: Initializing the graphics transcoder based on the video key frame strategy to initialize the timing of generating key frames during graphics transcoding; Step S226: Initialize the graphics update interface provided by the registration protocol parser.
6. The audit video generation method for the field of graphic operation and maintenance according to claim 1 is characterized in that: The step S300 includes the following steps: Step S310: updating the image change heat map according to the coordinate area of the graphic change, and performing hotspot auto-increment on the array elements corresponding to the graphic change area; Step S320: the graphics transcoder performs periodic image processing according to the frame rate setting, and when the time period is triggered, determines whether to generate an I frame or a P frame, and transcodes the data of the YUV graphics maintenance layer into a frame of H.264; Step S330: When the data conversion within a cycle is processed, the two-dimensional array of the image change heat map is reset to zero for maintenance and detection of the image change area in the next cycle.
7. The audit video generation method for the field of graphic operation and maintenance according to claim 6 is characterized in that: The step S320 includes the following steps: Step S321: if the current frame is the first frame, an I frame is generated to represent the complete image data of the first screen, and the entire screen data in the YUV graphics maintenance layer is transcoded into the H.264 format and encapsulated as an I frame; otherwise, proceed to step S322; Step S322: When the time from the last I frame reaches the set threshold, or the image data size between the last I frame reaches the set threshold, the entire screen data in the YUV graphics maintenance layer is transcoded into the H.264 format and encapsulated as an I frame; otherwise, step S323 is entered to generate a P frame; Step S323: When an I frame is not needed, a P frame is generated. If there is no change in the heat map during the cycle time, an empty P frame is generated. If an image area changes during the cycle, the YUV data in the changed graphic area is transcoded into H.264 format and encapsulated as a P frame.
8. An audit video generation system for the field of graphic operation and maintenance, based on the method described in any one of claims 1 to 7, characterized in that: It includes a graphics transcoder and a protocol parser, an RGB graphics maintenance layer, a YUV graphics maintenance layer, an H.264 encoding layer and a video encapsulation module arranged in sequence from front to back; the protocol parser is used to parse the graphics messages in the graphics operation and maintenance traffic and render them into the RGB graphics maintenance layer; the graphics transcoder is used to maintain the image changes of the screen and convert the original image data into H.264 video data according to the strategy; the video encapsulation module is used to encapsulate the H.264 video data into the corresponding standard video format.
9. The audit video generation system for the field of graphic operation and maintenance according to claim 8, characterized in that: The audit video generation system is respectively built into the operation and maintenance client, the graphic server terminal and the intermediate proxy device to realize the diversion of graphic data traffic.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method described in any one of claims 1 to 7 is implemented.