Multi-channel video composite processing system and method for monitoring video acquisition equipment

Abstract

The invention discloses a multi-channel video composite processing system and a multi-channel video composite processing method for monitoring video acquisition equipment, and relates to the technical field of video image transmission. Multi-channel video images are intelligently received, feature extraction is performed, and the original resolution of each channel of video is respectively obtained; the composite analysis subsystem is used for realizing intelligent compositing of multiple paths of videos according to the association of a preset output resolution YSfb and an original resolution, comprehensively evaluating the adaptability and distortion state of a composited picture by synthesizing an adaptation index HCzs, and improving the comprehensive control on the quality of the whole picture; the evaluation management subsystem sets an adaptation threshold value Q in advance, an adaptation index HCzs is synthesized through comparative analysis, the system can automatically obtain a level management report, and timely monitoring and management of the running state of the system are facilitated; the video processing subsystem adopts a corresponding processing scheme according to the level management report, and the image contrast is improved through an enhancement processing technology; and the video distribution subsystem performs local storage and remote transmission on the processed composite video image.

Description

Technical Field

[0001] The present invention relates to the technical field of video image transmission, and particularly to a multi-channel video composite processing system and method for a monitoring video acquisition device. Background Art

[0002] When a warehouse video access gateway device is in use, it usually needs to access multiple channels of video to achieve the purpose of simultaneously monitoring and storing the whole process of the warehouse, operation transportation, and blasting. Existing monitoring devices mostly adopt the method of separately storing and transmitting multiple channels of video, and each channel of video will occupy storage space and transmission bandwidth. In this case, when the device accesses multiple channels of video, it has high requirements for the hard disk storage space and network transmission bandwidth, and problems such as video packet loss may occur when transmitting multiple channels of video in a low-bandwidth network environment.

[0003] Therefore, in view of the above problems, there is an urgent need for a method capable of multiplexing multiple channels of video to save storage space, increase the storage days, and save transmission bandwidth, and detecting whether the composite video image is in a normal state. This method stores and transmits in the form of a single video stream and can adapt to more environments. Summary of the Invention

[0004] (1) Technical Problems to be Solved

[0005] Aiming at the deficiencies of the prior art, the present invention provides a multi-channel video composite processing system and method for a monitoring video acquisition device, which can multiplex multiple channels of video into one channel for storage and transmission, effectively saving storage space and transmission bandwidth. Moreover, it can intelligently detect whether the composite video image is in a normal state, providing a solution for video transmission in the case of insufficient storage space and low-bandwidth environment.

[0006] (2) Technical Solutions

[0007] To achieve the above objectives, the present invention is realized through the following technical solutions: A multi-channel video composite processing system for a monitoring video acquisition device includes a video transmission subsystem, a composite analysis subsystem, an evaluation management subsystem, a video processing subsystem, and a video distribution subsystem;

[0008] The video transmission subsystem is used to receive multiple channels of video images, extract features from the multiple channels of video images, respectively obtain the first original resolution Yfx1, the second original resolution Yfx2,..., the nth original resolution Yfxn in each channel of video image, and pre-set an output resolution YSfb, and transmit the multiple channels of video images to the composite analysis subsystem for composite into one channel of video image;

[0009] The composite analysis subsystem is used to associate the output resolution YSfb with the first original resolution Yfx1, the second original resolution Yfx2, …, the nth original resolution Yfxn respectively, so as to obtain the composite resolution influence coefficients Zy for each path, compare the magnitudes of the composite resolution influence coefficients for each path, determine the maximum value ZDZ and the minimum value ZXZ, perform a subtraction operation on the maximum value ZDZ and the minimum value ZXZ to obtain the composite resolution difference Wfhc, associate the composite resolution difference Wfhc with the output resolution YSfb to obtain the distortion state coefficient Szxs, and combine the composite resolution influence coefficients Zy for each path. After dimensionless processing, the synthetic adaptation index HCzs is obtained. The synthetic adaptation index HCzs is obtained through the following formula:

[0010]

[0011] In the formula, YSC represents a preset difference, Wldk represents the network bandwidth, F1 represents the proportional coefficient of the distortion state coefficient Szxs, F2 represents the proportional coefficient of the preset difference YSC, F3 represents the proportional coefficient of the network bandwidth Wldk, where 0.12 ≤ F1 ≤ 0.35, 0.20 ≤ F2 ≤ 0.25, 0.15 ≤ F3 ≤ 0.40, and 0.55 ≤ F1 + F2 + F3 ≤ 1.0, and R represents the first correction constant;

[0012] The evaluation and management subsystem is used to preset an adaptation threshold Q, and compare and analyze the synthetic adaptation index HCzs with the adaptation threshold Q to obtain a level management report;

[0013] The video processing subsystem is used to adopt corresponding processing schemes according to the level management report, preprocess the video images that are composite into one path, enhance the contrast of the images through enhancement processing techniques, and evenly divide the video images that are composite into one path into the same number of regions as the number of video paths SPls of the multiple video images;

[0014] The video distribution subsystem is used to perform local storage and remote transmission tasks on the video images that are composite into one path after being processed by the video processing subsystem.

[0015] Preferably, the video transmission subsystem includes a video input unit and a video output unit;

[0016] The video input unit is used to receive multiple video images and output the multiple video images to the video processing unit;

[0017] The video output unit is used to composite the multiple video images into one video image and send it back to the video processing unit.

[0018] Preferably, the video output unit includes a video split screen module, a video output module, and a video write-back module;

[0019] The video split screen module is used for the analysis calculation and composite operation of multiple videos;

[0020] The video output module is used to complete the local output of the video and output it to the display screen for viewing;

[0021] The video write-back module is used to complete the forwarding of one video after composition and write it back to the video processing unit.

[0022] Preferably, the composite resolution influence coefficients Zy of each path include the first composite resolution influence coefficient Dyfh1, the second composite resolution influence coefficient Dyfh2,..., the nth composite resolution influence coefficient Dyfhn. After dimensionless processing, they are respectively obtained through the following formulas:

[0023]

[0024] ...

[0026]

[0027] In the formula, YSfb represents the output resolution, SPls represents the number of video paths, Yfx1 represents the first original resolution, Yfx2 represents the second original resolution, Yfxn represents the nth original resolution, i represents the proportional coefficient of the output resolution YSfb, h represents the proportional coefficient of the number of video paths SPls, u1 represents the proportional coefficient of the first original resolution Yfx1, u2 represents the proportional coefficient of the second original resolution Yfx2, un represents the proportional coefficient of the nth original resolution Yfxn. Among them, 0.12 ≤ i ≤ 0.25, 0.20 ≤ h ≤ 0.38, 0.32 ≤ u1 ≤ 0.37, 0.22 ≤ u2 ≤ 0.37, 0.30 ≤ u1 ≤ 0.37, and 0.70 ≤ i + h + u1 ≤ 1.0, 0.60 ≤ i + h + u2 ≤ 1.0, 0.68 ≤ i + h + un ≤ 1.0, C represents the second correction constant.

[0028] Preferably, compare the first composite resolution influence coefficient Dyfh1, the second composite resolution influence coefficient Dyfh2,..., the nth composite resolution influence coefficient Dyfhn to obtain the composite resolution difference Wfhc. The composite resolution difference Wfhc is obtained through the following formula:

[0029] Wfhc = ZDZ - ZXZ;

[0030] Wherein, ZDZ represents the maximum value, and ZXZ represents the minimum value.

[0031] Preferably, after dimensionless processing, the distortion state coefficient Szxs is obtained by the following formula:

[0032]

[0033] Wherein, Fgsl represents the number of segments, both α and β represent proportionality coefficients, and G represents the third correction constant;

[0034] Compare the output resolution YSfb with the influence coefficient Zy of each composite resolution, and after dimensionless processing, obtain the preset difference Yscz. The preset difference Yscz is obtained by the following formula:

[0035] Yscz = YSfb - Zy;

[0036] It should be noted that this formula holds when the value of the preset difference Yscz is positive.

[0037] Preferably, compare and analyze the composite adaptation index HCzs with the adaptation threshold Q to obtain a hierarchical management report:

[0038] If the composite adaptation index HCzs is greater than or equal to the adaptation threshold Q, that is, when HCzs ≥ Q, obtain the first-level report, indicating that the current effect of compositing multiple video images into one video image is in a normal state and meets the expected standard. At this time, no additional adjustment or processing is required, and the system can run normally;

[0039] If the composite adaptation index HCzs is less than the adaptation threshold Q, that is, when HCzs < Q, obtain the second-level report, indicating that the current effect of compositing multiple video images into one video image is in an abnormal state. At this time, the mismatched video source will be optimized.

[0040] Preferably, the video processing subsystem includes a video processing unit and a video encoding unit;

[0041] The video processing unit is used to receive multiple video images output by the video input unit, send the multiple video images to the video output module, receive one video image output by the video output module and perform preprocessing, and after processing, output the composite one video image from the same source to the video encoding unit and the video output unit respectively;

[0042] Among them, preprocessing will use enhancement processing technology to enhance a video image, enhancing the contrast, brightness, and color features of the image to highlight key information in the image, extract effective data features, and perform standard normalization processing on the image information after feature extraction according to dimensionless processing technology;

[0043] The video encoding unit is used to perform compression encoding on the composite video image of one path.

[0044] Preferably, the video distribution subsystem includes a video storage unit and a video upload unit;

[0045] The video storage unit is used to locally store the encoded video image of one path;

[0046] The video upload unit is used to upload the encoded video image of one path to a remote platform.

[0047] Preferably, the method for multiplexed video composite processing of a monitoring video acquisition device includes the following steps:

[0048] Step 1: Input multiplexed video images into the video input unit. The video input unit detects the formats and the first original resolution Yfx1, the second original resolution Yfx2,..., the nth original resolution Yfxn of the multiplexed video images, and pre-sets the output resolution YSfb, and sends them to the composite analysis subsystem;

[0049] Step 2: Analyze and calculate the multiplexed video images, calculate and obtain the influence coefficient Zy of each composite resolution, the difference Wfhc of the composite resolution, and the distortion state coefficient Szxs, and after dimensionless processing, analyze and obtain the synthesis adaptation index HCzs;

[0050] Step 3: Compare and analyze the synthesis adaptation index HCzs with the adaptation threshold Q to obtain a hierarchical management report;

[0051] Step 4: The video processing unit sends the multiplexed video images to the video output unit. The video output unit composites the multiplexed video images into one video image and sends it back to the video processing unit, and takes corresponding processing solutions according to the hierarchical management report; The video processing unit is used to receive and process one video image output by the video output module, and after processing, outputs one video image from the same source to the video encoding unit and the video output unit respectively;

[0052] Step 5: The video encoding unit is used to perform compression encoding on the composite video image of one path, and locally store the encoded video image of one path; at the same time, upload the encoded video image of one path to a remote platform.

[0053] (III) Beneficial effects

[0054] The present invention provides a multi-channel video composite processing system and method for a monitoring video acquisition device, which has the following beneficial effects:

[0055] (1) Through the video transmission subsystem, the system can intelligently receive multi-channel video images, extract features, and respectively obtain the original resolutions of each channel of video; the composite analysis subsystem associates the preset output resolution YSfb with the original resolution to achieve the intelligent composite of multi-channel video, improving the adaptability of the system to video sources with different resolutions. The adaptability and distortion state of the composite picture are comprehensively evaluated through the synthetic adaptation index HCzs, improving the overall control of the picture quality; the evaluation and management subsystem preset the adaptation threshold Q. By comparing and analyzing the synthetic adaptation index HCzs, the system can automatically obtain the level management report, which helps to monitor and manage the system operation status in a timely manner; the video processing subsystem adopts corresponding processing schemes according to the level management report, improves the image contrast through enhancement processing technology, and further optimizes the quality of the composite video image, which is beneficial to further improving the user viewing experience and monitoring effect. The video distribution subsystem locally stores and remotely transmits the processed composite video image, supporting flexible data management methods, which enables users to choose local storage or real-time transmission to a remote platform according to their needs, increasing the system's customization and application flexibility. In short, the system not only improves the intelligent composite and adaptation ability of multi-channel video sources, further saves storage space, increases the storage days, and saves transmission bandwidth, but also makes the system more intelligent and user-friendly through comprehensive evaluation and level management, providing an efficient and reliable video processing and management solution for monitoring applications.

[0056] (2) In order to adapt multi-channel video to a composite picture, the synthetic adaptation index HCzs is obtained through a large amount of calculations, and the level management report is automatically obtained, facilitating the observation of the situation presented by the current video image for subsequent adjustment work. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 It is a schematic diagram of the block diagram process of the multi-channel video composite processing system for the monitoring video acquisition device of the present invention;

[0058] Figure 2 It is a schematic diagram of the step process of the video output unit in the multi-channel video composite processing system for the monitoring video acquisition device of the present invention;

[0059] Figure 3 It is a schematic diagram of the step process of the multi-channel video composite processing system for the monitoring video acquisition device of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0060] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0061] When the warehouse video access gateway device is in use, it usually needs to access multiple videos to achieve the purpose of simultaneously monitoring and storing the whole process of the warehouse, operation transportation, and blasting. Existing monitoring devices mostly adopt the method of separately storing and transmitting multiple videos, and each video will occupy storage space and transmission bandwidth. In this case, when the device accesses multiple videos, it has relatively high requirements for the hard disk storage space and network transmission bandwidth, and problems such as video packet loss may occur when transmitting multiple videos in a low-bandwidth network environment.

[0062] Therefore, in view of the above problems, there is an urgent need for a method capable of multiplexing multiple videos to save storage space, increase the storage days, and save transmission bandwidth, and detecting whether the video image after multiplexing is in a normal state. This method stores and transmits in the form of a single video stream and can adapt to more environments.

[0063] Embodiment 1

[0064] Please refer to Figure 1 , the present invention provides a multiplexed video processing system for monitoring video acquisition devices, including a video transmission subsystem, a multiplexing and analysis subsystem, an evaluation and management subsystem, a video processing subsystem, and a video distribution subsystem;

[0065] The video transmission subsystem is used to receive multiple video images, extract features from the multiple video images, respectively obtain the first original resolution Yfx1, the second original resolution Yfx2,..., the nth original resolution Yfxn in each video image, and preset the output resolution YSfb, and transmit the multiple video images to the multiplexing and analysis subsystem for multiplexing into a single video image;

[0066] The composite analysis subsystem is used to associate the output resolution YSfb with the first original resolution Yfx1, the second original resolution Yfx2, …, the nth original resolution Yfxn respectively, so as to obtain the composite resolution influence coefficients Zy for each path, compare the magnitudes of the composite resolution influence coefficients for each path, determine the maximum value ZDZ and the minimum value ZXZ, obtain the composite resolution difference Wfhc through subtraction operation on the maximum value ZDZ and the minimum value ZXZ, associate the composite resolution difference Wfhc with the output resolution YSfb to obtain the distortion state coefficient Szxs, and combine the composite resolution influence coefficients Zy for each path. After dimensionless processing, the synthetic adaptation index HCzs is obtained. The synthetic adaptation index HCzs is obtained through the following formula:

[0067]

[0068] In the formula, YSC represents the preset difference, Wldk represents the network bandwidth, F1 represents the proportionality coefficient of the distortion state coefficient Szxs, F2 represents the proportionality coefficient of the preset difference YSC, F3 represents the proportionality coefficient of the network bandwidth Wldk, where 0.12 ≤ F1 ≤ 0.35, 0.20 ≤ F2 ≤ 0.25, 0.15 ≤ F3 ≤ 0.40, and 0.55 ≤ F1 + F2 + F3 ≤ 1.0, and R represents the first correction constant;

[0069] The evaluation and management subsystem is used to preset the adaptation threshold Q, and compare and analyze the synthetic adaptation index HCzs with the adaptation threshold Q to obtain a level management report;

[0070] The video processing subsystem is used to adopt corresponding processing schemes according to the level management report, preprocess the video images combined into one path, enhance the contrast of the images through enhancement processing technology, and evenly divide the video images combined into one path into the same number of regions as the number of video paths SPls of the multiple video images;

[0071] The video distribution subsystem is used to perform local storage and remote transmission tasks on the video images combined into one path processed by the video processing subsystem.

[0072] During the operation of this system, through the video transmission subsystem, the system can intelligently receive multiple video images, extract features, and respectively obtain the original resolutions of each video; the composite analysis subsystem associates the preset output resolution YSfb with the original resolutions to achieve the intelligent composition of multiple videos, and comprehensively evaluates the adaptability and distortion state of the composite image through the synthesis adaptation index HCzs; the evaluation management subsystem preset the adaptation threshold Q, and through comparative analysis of the synthesis adaptation index HCzs, the system can automatically obtain the level management report; the video distribution subsystem performs local storage and remote transmission of the processed composite video images, which enables users to select local storage or real-time transmission to a remote platform according to their needs, increasing the system's customization and application flexibility.

[0073] Embodiment 2

[0074] Please refer to Figure 2 , specifically: The video transmission subsystem includes a video input unit and a video output unit;

[0075] The video input unit is used to receive multiple video images and output multiple video images to the video processing unit;

[0076] The video output unit is used to composite multiple video images into one video image and send it back to the video processing unit.

[0077] The video output unit includes a video split screen module, a video output module, and a video write-back module;

[0078] The video split screen module is used for the analysis calculation and composite operation of multiple videos;

[0079] The video output module is used to complete the local output of the video and output it to the display screen for viewing;

[0080] The video write-back module is used to complete the forwarding of one composite video and write it back to the video processing unit.

[0081] In this embodiment, the video output unit processes multiple video images, associates with the set output resolution YSfb and the first original resolution Yfx1, the second original resolution Yfx2,..., the nth original resolution Yfxn, respectively obtains the composite resolution influence coefficient Zy of each path, scales the input video, and composites multiple videos into one video. Substantially, the above operation is to scale the video sources with the same or different resolutions and then place them at different positions in the composite video image, achieving the effect of splicing multiple videos in one image, so as to realize the next functions such as data transmission preview and storage.

[0082] Embodiment 3

[0083] Please refer to Figure 1 , specifically: each composite resolution influence coefficient Zy includes the first composite resolution influence coefficient Dyfh1, the second composite resolution influence coefficient Dyfh2,..., the nth composite resolution influence coefficient Dyfhn, and after dimensionless processing, they are respectively obtained through the following formulas:

[0084]

[0085] ...

[0087]

[0088] In the formula, YSfb represents the output resolution, SPls represents the number of video channels, Yfx1 represents the first original resolution, Yfx2 represents the second original resolution, Yfxn represents the nth original resolution, i represents the proportional coefficient of the output resolution YSfb, h represents the proportional coefficient of the number of video channels SPls, u1 represents the proportional coefficient of the first original resolution Yfx1, u2 represents the proportional coefficient of the second original resolution Yfx2, un represents the proportional coefficient of the nth original resolution Yfxn, where 0.12 ≤ i ≤ 0.25, 0.20 ≤ h ≤ 0.38, 0.32 ≤ u1 ≤ 0.37, 0.22 ≤ u2 ≤ 0.37, 0.30 ≤ u1 ≤ 0.37, and 0.70 ≤ i + h + u1 ≤ 1.0, 0.60 ≤ i + h + u2 ≤ 1.0, 0.68 ≤ i + h + un ≤ 1.0, C represents the second correction constant.

[0089] Compare the first composite resolution influence coefficient Dyfh1, the second composite resolution influence coefficient Dyfh2,..., the nth composite resolution influence coefficient Dyfhn to obtain the composite resolution difference Wfhc, and the composite resolution difference Wfhc is obtained through the following formula:

[0090] Wfhc = ZDZ - ZXZ;

[0091] In the formula, ZDZ represents the maximum value, and ZXZ represents the minimum value.

[0092] After dimensionless processing, the distortion state coefficient Szxs is obtained through the following formula:

[0093]

[0094] In the formula, Fgsl represents the number of segments, both α and β represent proportional coefficients, and G represents the third correction constant;

[0095] Compare the output resolution YSfb with the composite resolution influence coefficients Zy of each path, and after dimensionless processing, obtain a preset difference Yscz. The preset difference Yscz is obtained through the following formula:

[0096] Yscz = YSfb - Zy;

[0097] Note: This formula holds when the value of the preset difference Yscz is positive.

[0098] In this embodiment, the system calculates the composite resolution influence coefficient of each path of video and intelligently adjusts the resolution of each path of video according to the preset output resolution YSfb, so as to realize the intelligent composition of the overall video, which helps to adapt to video sources with different resolutions and improve the adaptability of the system. In short, through functions such as intelligent resolution adjustment and comprehensive evaluation of the distortion state, the system provides a comprehensive and effective solution for the processing of surveillance videos, improving the adaptability of the system and the user experience.

[0099] Embodiment 4

[0100] Please refer to Figures 1 to 3 , specifically: Compare and analyze the composite adaptation index HCzs with the adaptation threshold Q to obtain a hierarchical management report:

[0101] When the composite adaptation index HCzs is greater than or equal to the adaptation threshold Q, that is, when HCzs ≥ Q, obtain a first-level report, indicating that currently, the effect of compositing multiple video images into one video image is in a normal state, meeting the expected standard. The parameters such as the layout and resolution of each path of video in the composite picture have been intelligently adjusted, making the overall picture display effect good. At this time, no additional adjustment or processing is required, and the system can run normally;

[0102] When the composite adaptation index HCzs is less than the adaptation threshold Q, that is, when HCzs < Q, obtain a second-level report, indicating that currently, the effect of compositing multiple video images into one video image is in an abnormal state, there are some adaptation problems, and the overall effect has not reached the ideal state. At this time, the unadapted video source will be optimized, such as adjusting the resolution and clarity, etc., to make it adapt to the composite picture.

[0103] In this embodiment, such a report generation and operation mechanism helps users understand the working state of the system in a timely manner and provides practical feedback information; through the second-level report, users can quickly identify existing problems and take corresponding optimization measures to further improve the performance and adaptability of the overall monitoring system. This beneficial effect makes the system more intelligent and flexible.

[0104] Embodiment 5

[0105] Please refer toFigure 1 , specifically: the video processing subsystem includes a video processing unit and a video encoding unit;

[0106] The video processing unit is used to receive multiple video images output by the video input unit, send the multiple video images to the video output module, receive one video image output by the video output module and perform preprocessing, and after processing, output the composite one video image from the same source to the video encoding unit and the video output unit respectively;

[0107] Among them, the preprocessing will use enhancement processing technology to enhance the video image of one path, enhance the contrast, brightness and color features of the image to highlight the key information in the image, extract effective data features, which helps to improve the recognition and analysis ability of the monitoring system for key scenes; and perform standard normalization processing on the image information after feature extraction according to the dimensionless processing technology, which helps to eliminate the scale difference between different images, makes the subsequent processing more stable and reliable, and improves the robustness and accuracy of the system.

[0108] The video encoding unit is used to compress and encode the composite one video image, which improves the efficiency of data transmission, is especially suitable for remote transmission, reduces the occupancy of network bandwidth, and at the same time reduces the demand for local storage devices.

[0109] The video distribution subsystem includes a video storage unit and a video upload unit, providing dual options of local storage and remote transmission.

[0110] The video storage unit is used to locally store the encoded one video image;

[0111] The video upload unit is used to upload the encoded one video image to a remote platform.

[0112] The output end of the video input unit is connected to the input end of the video processing unit, the video processing unit communicates bidirectionally with the video output unit, the output end of the video processing unit is connected to the input end of the video encoding unit, and the output end of the video encoding unit is respectively connected to the input ends of the video storage unit and the video upload unit.

[0113] It should be noted that: the locally output composite video image can be viewed locally, and at the same time, a copy of the composite video image is used for subsequent video compression encoding and other functions; the composite video is encoded, and the encoding format is H.264; the encoded video has two uses, one is to upload it to a remote platform, and the other is to be used for local storage. Whether the local storage is enabled can be set by the remote platform, and it will only be stored in the local SD card or hard disk when in use, which can be set according to specific requirements to adapt to more situations.

[0114] In this embodiment, functions such as image enhancement, dimensionless processing, compression encoding, and local storage and remote transmission provide better image quality, efficient data management, and transmission methods for the monitoring system.

[0115] Embodiment 6

[0116] Please refer to Figure 1 and Figure 2 , specifically: a multi-channel video composite processing method for a monitoring video acquisition device, including the following steps.

[0117] Step 1: Input multi-channel video images into the video input unit. The video input unit detects the formats and the first original resolution Yfx1, the second original resolution Yfx2,..., the nth original resolution Yfxn of the multi-channel video images, and pre-sets the output resolution YSfb, and sends them to the composite analysis subsystem.

[0118] Step 2: Analyze and calculate the multi-channel video images, calculate the influence coefficients Zy of each composite resolution, the difference Wfhc of the composite resolution, and the distortion state coefficient Szxs, and after dimensionless processing, analyze and obtain the synthesis adaptation index HCzs.

[0119] Step 3: Compare and analyze the synthesis adaptation index HCzs with the adaptation threshold Q to obtain a hierarchical management report.

[0120] Step 4: The video processing unit sends the multi-channel video images to the video output unit. The video output unit composites the multi-channel video images into one video image and sends it back to the video processing unit, and adopts corresponding processing schemes according to the hierarchical management report; the video processing unit is used to receive and process one video image output by the video output module, and after processing, outputs one video image from the same source to the video encoding unit and the video output unit respectively.

[0121] Step 5: The video encoding unit is used to compress and encode the composite video image, and locally store the encoded video image; at the same time, upload the encoded video image to the remote platform.

[0122] In this embodiment, combining the content of steps one to five, this method detects the formats and original resolutions of multiple video images, and simultaneously preset the output resolution YSfb to provide basic data for subsequent processing; the synthesis adaptation index HCzs is compared with the adaptation threshold Q for analysis to obtain a level management report. This step provides an evaluation of the overall synthesis effect, enabling the system to automatically identify whether the synthesis effect is normal and providing a reference for subsequent processing; corresponding processing schemes are adopted according to the level management report to achieve flexible processing of the synthesized video; the video coding unit compresses and encodes one of the composite video images to achieve efficient management of video data. At the same time, the encoded video image is uploaded to a remote platform to support remote monitoring and data backup while meeting local requirements.

[0123] Although the embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that various changes, modifications, substitutions and variations can be made in these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. Multi-channel video composite processing system for surveillance video acquisition devices, characterized in that: It includes a video transmission subsystem, a composite analysis subsystem, an evaluation management subsystem, a video processing subsystem, and a video distribution subsystem; The video transmission subsystem is used to receive multiple video images, perform feature extraction on the multiple video images, respectively obtain the first original resolution Yfx1, the second original resolution Yfx2, ..., the nth original resolution Yfxn in each video image, preset the output resolution YSfb, and transmit the multiple video images to the composite analysis subsystem to be combined into one video image; The composite analysis subsystem is used to associate the output resolution YSfb with the first original resolution Yfx1, the second original resolution Yfx2, ..., the nth original resolution Yfxn respectively, to respectively obtain the composite resolution influence coefficients Zy for each path, compare the magnitudes of the composite resolution influence coefficients for each path, determine the maximum value ZDZ and the minimum value ZXZ, perform a subtraction operation on the maximum value ZDZ and the minimum value ZXZ to obtain the composite resolution difference Wfhc, associate the composite resolution difference Wfhc with the output resolution YSfb to obtain the distortion state coefficient Szxs, and combine the composite resolution influence coefficients Zy for each path. After dimensionless processing, obtain the synthesis adaptation index HCzs. The synthesis adaptation index HCzs is obtained through the following formula: In the formula, YSC represents the preset difference, Wldk represents the network bandwidth, F1 represents the proportionality coefficient of the distortion state coefficient Szxs, F2 represents the proportionality coefficient of the preset difference YSC, F3 represents the proportionality coefficient of the network bandwidth Wldk, where 0.12 ≤ F1 ≤ 0.35, 0.20 ≤ F2 ≤ 0.25, 0.15 ≤ F3 ≤ 0.40, and 0.55 ≤ F1 + F2 + F3 ≤ 1.0, and R represents the first correction constant; The evaluation management subsystem is used to preset the adaptation threshold Q, and compare and analyze the synthesis adaptation index HCzs with the adaptation threshold Q to obtain a level management report; The video processing subsystem is used to adopt corresponding processing schemes according to the level management report, and perform preprocessing on the combined video image into one video image, enhance the contrast of the image through enhancement processing technology, and evenly divide the combined video image into the same number of regions as the number of video paths SPls of the multiple video images; The video distribution subsystem is used to perform local storage and remote transmission tasks on the combined video image processed by the video processing subsystem.

2. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 1, characterized in that: The video transmission subsystem includes a video input unit and a video output unit; The video input unit is used to receive multiple video images and output the multiple video images to the video processing unit; The video output unit is used to combine multiple video images into one video image and send it back to the video processing unit.

3. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 2, characterized in that: The video output unit includes a video split screen module, a video output module, and a video write-back module; The video split screen module is used for the analysis calculation and combination operation of multiple videos; The video output module is used to complete the local output of the video and output it to the display screen for viewing; The video write-back module is used to complete the forwarding of one of the videos after composition and write it back to the video processing unit.

4. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 3, characterized in that: The composite resolution influence coefficients Zy for each path include the first-path composite resolution influence coefficient Dyfh1, the second-path composite resolution influence coefficient Dyfh2,..., the nth-path composite resolution influence coefficient Dyfhn. After dimensionless processing, they are respectively obtained through the following formulas: ... In the formula, YSfb represents the output resolution, SPls represents the number of video paths, Yfx1 represents the first original resolution, Yfx2 represents the second original resolution, Yfxn represents the nth original resolution, i represents the proportional coefficient of the output resolution YSfb, h represents the proportional coefficient of the number of video paths SPls, u1 represents the proportional coefficient of the first original resolution Yfx1, u2 represents the proportional coefficient of the second original resolution Yfx2, un represents the proportional coefficient of the nth original resolution Yfxn. Among them, 0.12 ≤ i ≤ 0.25, 0.20 ≤ h ≤ 0.38, 0.32 ≤ u1 ≤ 0.37, 0.22 ≤ u2 ≤ 0.37, 0.30 ≤ u1 ≤ 0.37, and 0.70 ≤ i + h + u1 ≤ 1.0, 0.60 ≤ i + h + u2 ≤ 1.0, 0.68 ≤ i + h + un ≤ 1.0, and C represents the second correction constant.

5. The multi-channel video composite processing system of the surveillance video acquisition device according to claim 4, characterized in that: Compare the first-path composite resolution influence coefficient Dyfh1, the second-path composite resolution influence coefficient Dyfh2,..., the nth-path composite resolution influence coefficient Dyfhn to obtain the composite resolution difference Wfhc. The composite resolution difference Wfhc is obtained through the following formula: Wfhc = ZDZ - ZXZ; In the formula, ZDZ represents the maximum value, and ZXZ represents the minimum value.

6. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 5, characterized in that: After dimensionless processing, the distortion state coefficient Szxs is obtained through the following formula: In the formula, Fgsl represents the number of segments, both α and β represent proportional coefficients, and G represents the third correction constant; Compare the output resolution YSfb with the composite resolution influence coefficients Zy for each path. After dimensionless processing, obtain the preset difference Yscz. The preset difference Yscz is obtained through the following formula: Yscz = YSfb - Zy; Note: This formula holds when the value of the preset difference Yscz is positive.

7. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 6, wherein: Compare and analyze the composite adaptation index HCzs with the adaptation threshold Q to obtain a level management report: If the composite adaptation index HCzs is greater than or equal to the adaptation threshold Q, that is, when HCzs ≥ Q, obtain the first-level report, indicating that currently, when multiple video images are composited into one video image, the presented effect is in a normal state and meets the expected standard. At this time, no additional adjustment or processing is required, and the system can run normally; When the synthesized adaptation index HCzs is less than the adaptation threshold Q, that is, when HCzs < Q, a second-level report is obtained, indicating that the current effect of combining multiple video images into one video image is in an abnormal state. At this time, the mismatched video sources will be optimized.

8. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 7, characterized in that: The video processing subsystem includes a video processing unit and a video encoding unit; The video processing unit is used to receive multiple video images output by the video input unit, send the multiple video images to the video output module, receive one video image output by the video output module and perform preprocessing. After processing, the combined one video image is output to the video encoding unit and the video output unit from the same source; Among them, the preprocessing will use enhancement processing technology to enhance the video image, enhance the contrast, brightness and color features of the image to highlight the key information in the image, extract effective data features, and perform standard normalization processing on the image information after feature extraction according to dimensionless processing technology; The video encoding unit is used to perform compression encoding on the combined one video image.

9. The multi-channel video composite processing system of the monitoring video acquisition device according to claim 8, wherein: The video distribution subsystem includes a video storage unit and a video upload unit; The video storage unit is used to locally store the encoded one video image; The video upload unit is used to upload the encoded one video image to a remote platform.

10. A method for multiplex video composite processing of a monitoring video acquisition device, comprising the monitoring video acquisition device multiplex video composite processing system according to any one of claims 1 to 9 above, characterized in that: It includes the following steps, Step 1: Input multiple video images into the video input unit. The video input unit detects the formats and the first original resolution Yfx1, the second original resolution Yfx2,..., the nth original resolution Yfxn of the multiple video images, and pre-sets the output resolution YSfb, and sends them to the composite analysis subsystem; Step 2: Analyze and calculate the multiple video images, calculate and obtain the influence coefficient Zy of each composite resolution, the difference Wfhc of the combined resolution, and the distortion state coefficient Szxs. After dimensionless processing, analyze and obtain the synthesized adaptation index HCzs; Step 3: Compare and analyze the synthesized adaptation index HCzs with the adaptation threshold Q to obtain a level management report; Step 4: The video processing unit sends the multiple video images to the video output unit. The video output unit combines the multiple video images into one video image and sends it back to the video processing unit, and takes corresponding processing solutions according to the level management report; the video processing unit is used to receive and process one video image output by the video output module. After processing, one video image is output to the video encoding unit and the video output unit from the same source; Step 5: The video encoding unit is used to perform compression encoding on the combined one video image, and locally store the encoded one video image; at the same time, upload the encoded one video image to a remote platform.

Images