An airport monitoring video transmission method and device, a storage medium and an electronic device

Abstract

The application provides an airport monitoring video transmission method and device, a storage medium and electronic equipment, comprehensive complexity corresponding to each coding tree unit in each frame of image in an image group is acquired, and based on a preset condition, a current frame of image can be accurately divided into a key area and a non-key area; based on the comprehensive complexity of the kth merging area in the current frame of image and the total bit budget of the current frame of image, the number of bits allocated to the kth merging area in the current frame of image is determined; based on the number of bits allocated to the kth merging area, the pixel points in the kth merging area are encoded; after all the frames of image in the image group are encoded, the encoded data is transmitted. According to the dynamic bit allocation based on the comprehensive complexity of the key area and the non-key area, the coding accuracy of the key area is improved, and the definition of the key area and the overall monitoring efficiency are significantly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of images, in particular to an airport monitoring video transmission method and device, a storage medium and an electronic equipment. BACKGROUND

[0002] In recent years, thanks to the rapid economic development, people's living standards have improved significantly, and the number of people choosing to travel by plane is also increasing. As a crucial transportation hub, the safety of the airport, especially the flight area, has always been widely concerned.

[0003] With the rapid development of intelligent monitoring technology, as an area with high safety requirements, airports have generally installed high-resolution, multi-angle monitoring systems to achieve real-time monitoring of key areas such as runways, parking aprons, and terminals. However, the existing bandwidth is usually insufficient to support the transmission of high-resolution video. The bit allocation method in rate control is a key link in the video transmission process, responsible for allocating bits to the frames to be encoded during transmission, thereby determining the number of bits that the frames to be encoded can obtain. However, the existing bit allocation method usually cannot meet the low-bandwidth video transmission requirements. SUMMARY

[0004] The purpose of the present application is to provide an airport monitoring video transmission method, device, storage medium and electronic equipment to improve the above problems.

[0005] To achieve the above purpose, the technical solution adopted by the embodiments of the present application is as follows:

[0006] In a first aspect, the embodiments of the present application provide an airport monitoring video transmission method, which comprises:

[0007] Obtaining the comprehensive complexity corresponding to each coding tree unit in each frame image in the image group, wherein the frame image in the image group is an image in the airport monitoring video;

[0008] Merging the coding tree units in the current frame image that meet the first condition, the second condition and the third condition into a key area, and merging the coding tree units in the current frame image that meet the fourth condition, the second condition and the third condition into a non-key area; wherein the first condition is that the comprehensive complexity corresponding to the coding tree unit is greater than a first complexity threshold, the second condition is that two coding tree units to be merged are adjacent, the third condition is that the absolute value of the difference in comprehensive complexity of the two coding tree units to be merged is less than a second complexity threshold, and the fourth condition is that the comprehensive complexity corresponding to the coding tree unit is less than or equal to the first complexity threshold;

[0009] determine an allocated bit number corresponding to the kth merged region in the current frame image according to the comprehensive complexity of the kth merged region in the current frame image and a total bit budget of the current frame image, wherein the comprehensive complexity of the kth merged region is a sum of comprehensive complexities corresponding to respective coding tree units of the kth merged region;

[0010] encode pixel points in the kth merged region based on the allocated bit number corresponding to the kth merged region;

[0011] transmit the encoded data after all frame images in the image group are encoded.

[0012] In a second aspect, an embodiment of the present application provides an airport monitoring video transmission device, and the device comprises:

[0013] a first processing unit configured to acquire a comprehensive complexity corresponding to each coding tree unit in each frame image in an image group, wherein the frame images in the image group are images in an airport monitoring video;

[0014] The first processing unit is further configured to merge coding tree units in a current frame image that meet a first condition, a second condition and a third condition into a key region, and merge coding tree units in the current frame image that meet a fourth condition, the second condition and the third condition into a non-key region, wherein the first condition is that the comprehensive complexity corresponding to the coding tree unit is greater than a first complexity threshold, the second condition is that two coding tree units to be merged are adjacent, the third condition is that an absolute value of a difference between comprehensive complexities of the two coding tree units to be merged is less than a second complexity threshold, and the fourth condition is that the comprehensive complexity corresponding to the coding tree unit is less than or equal to the first complexity threshold.

[0015] The first processing unit is further configured to determine an allocated bit number corresponding to the kth merged region in the current frame image according to the comprehensive complexity of the kth merged region in the current frame image and a total bit budget of the current frame image, wherein the comprehensive complexity of the kth merged region is a sum of comprehensive complexities corresponding to respective coding tree units of the kth merged region.

[0016] The first processing unit is further configured to encode pixel points in the kth merged region based on the allocated bit number corresponding to the kth merged region.

[0017] A second processing unit is configured to transmit the encoded data after all frame images in the image group are encoded.

[0018] In a third aspect, an embodiment of the present application provides a storage medium having a computer program stored thereon, and the computer program is executed by a processor to implement the method described above.

[0019] In a fourth aspect, an electronic device is provided, and the electronic device includes a processor and a memory storing one or more programs, and the one or more programs, when executed by the processor, implement the method described above.

[0020] Compared with the prior art, the airport monitoring video transmission method, device, storage medium and electronic device provided by the embodiments of the present application can accurately identify the key area and the non-key area, dynamically allocate bits according to the comprehensive complexity of the key area and the non-key area, realize accurate bit allocation of the video frame under the condition of low-bandwidth transmission of high-resolution video frames, improve the coding accuracy of the key area, and thus improve the overall quality of the video frame. The problem of quality degradation caused by insufficient resource allocation under low bandwidth can be effectively solved, the clarity of the key area and the overall monitoring efficiency are significantly improved. The embodiments of the present application are suitable for complex scenes such as airport runways and traffic sections that require high-quality monitoring under low bandwidth, and can realize quality optimization on the basis of existing monitoring equipment, thereby promoting the further development of intelligent transportation and intelligent safety.

[0021] In order to make the above objectives, characteristics and advantages of the present application more apparent, clear and easy to understand, the following preferred embodiments are specifically described below with reference to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. It should be understood that the following drawings only show some of the embodiments of the present application, and therefore should not be considered as a limitation to the scope. For those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0023] Figure 1 The structural schematic diagram of the electronic device provided by the embodiments of the present application.

[0024] Figure 2 The flowchart of the airport monitoring video transmission method provided by the embodiments of the present application.

[0025] Figure 3 Figure 2 is a flowchart of an airport monitoring video transmission method according to an embodiment of the present application.

[0026] Figure 4 Figure 3 is a schematic diagram of an airport monitoring video transmission device according to an embodiment of the present application.

[0027] In the figure: 10 - processor; 11 - memory; 12 - bus; 13 - communication interface; 301 - first processing unit; 302 - second processing unit. DETAILED DESCRIPTION

[0028] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. The components of the embodiments of the present application described and shown in the accompanying drawings can be arranged and designed in various different configurations.

[0029] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the claimed present application, but only represents selected embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative work are within the scope of protection of the present application.

[0030] It should be noted that: similar reference numerals and letters represent similar items in the following drawings, therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. Meanwhile, in the description of the present application, the terms “first”, “second” and the like are only used to distinguish description, and cannot be understood as indicating or implying relative importance.

[0031] It should be noted that: similar reference numerals and letters represent similar items in the following drawings, therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. Meanwhile, in the description of the present application, the terms “first”, “second” and the like are only used to distinguish description, and cannot be understood as indicating or implying relative importance.

[0032] In the description of the present application, it should be noted that the terms "upper", "lower", "inner", "outer" and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, or the orientation or positional relationship commonly placed when the product of the present application is used, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application.

[0033] In the description of the present application, it should be noted that, unless otherwise explicitly specified and limited, the terms "arranged", "connected" should be understood broadly, for example, can be fixedly connected, or can be detachably connected, or integrally connected; can be mechanically connected, or can be electrically connected; can be directly connected, or can be indirectly connected through an intermediate medium, or can be connected inside two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0034] Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The following examples and features in the examples can be combined with each other without conflict.

[0035] Current bit allocation strategies cannot meet the existing high data volume demand, resulting in a significant reduction in video frame quality, and in the case of low bandwidth, high-precision transmission and coding for key parts of high-resolution video frames.

[0036] Current bit allocation strategies are difficult to accurately identify the key areas that really need priority protection in video frames, such as moving targets or abnormal activity areas. The allocation of area weights in video frames is usually static or rough, and cannot adapt to the dynamic changes of the scene in real time.

[0037] Current bit allocation strategies often only focus on the bit demand within the current frame or a short period of time, ignoring the importance of global optimization within a longer time span, such as within a group of pictures (GOP) or within the entire monitoring sequence, which can lead to uneven resource allocation and fluctuations in video quality.

[0038] In order to overcome the above problems, the embodiment of the present application provides an airport monitoring video transmission method, which realizes low-bandwidth video transmission scene for airport flight area monitoring, proposes a dynamic bit allocation optimization method, and comprehensively improves the video frame quality based on scene characteristics and feedback mechanism. The optimization method based on dynamic weight allocation of key areas, the long-time span resource allocation method based on global feedback, and the adaptive adjustment method combining resource utilization rate maximization and detail priority guarantee are constructed, which can effectively solve the problem of quality decline caused by insufficient resource allocation under low bandwidth. The important areas in the video frame picture can be accurately identified, and the optimal allocation of bit resources can be realized in long time and multiple scenes, which significantly improves the definition of key areas and the overall monitoring efficiency. It is suitable for complex scenes such as airport runway and traffic section which require low bandwidth and high quality monitoring. The quality optimization is realized on the basis of existing monitoring equipment, which helps the further development of intelligent transportation and intelligent safety.

[0039] The embodiment of the present application provides an electronic device, which can be a mobile phone, a computer, a server and the like. Please refer to Figure 1 , the structural schematic diagram of the electronic device. The electronic device includes a processor 10, a memory 11 and a bus 12. The processor 10 and the memory 11 are connected through the bus 12, and the processor 10 is used to execute the executable modules stored in the memory 11, such as computer programs.

[0040] The processor 10 can be an integrated circuit chip with signal processing capability. In the implementation process, each step of the airport monitoring video transmission method can be completed by integrated logic circuits or software instructions in the processor 10. The processor 10 mentioned above can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP) and the like; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

[0041] The memory 11 can include a high-speed random access memory (RAM), and can also include a non-volatile memory, such as at least one disk memory.

[0042] The bus 12 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. Figure 1 Only one bidirectional arrow is shown in the figure, but it does not mean that there is only one bus 12 or only one type of bus 12.

[0043] The memory 11 is configured to store a program, for example, a program corresponding to the airport monitoring video transmission device. The airport monitoring video transmission device includes at least one software function module stored in the memory 11 in the form of software or firmware or solidified in an operating system (OS) of the electronic device. The processor 10 executes the program to implement the airport monitoring video transmission method after receiving an execution instruction.

[0044] Possibly, the electronic device provided by the embodiment of the present application further includes a communication interface 13. The communication interface 13 is connected with the processor 10 through the bus.

[0045] It should be understood that, Figure 1 The structure shown in the figure is only a schematic structure of part of the electronic device, and the electronic device can further include more or fewer components than those shown in the figure, or have a different configuration from that shown in the figure. Figure 1 The components shown in the figure can be realized in hardware, software, or a combination thereof. Figure 1 The components shown in the figure can be realized in hardware, software, or a combination thereof. Figure 1 The components shown in the figure can be realized in hardware, software, or a combination thereof.

[0046] The airport monitoring video transmission method provided by the embodiment of the present application can be applied to, but is not limited to, the electronic device shown in the figure, and the specific flow is described with reference to the Figure 1 The airport monitoring video transmission method includes S11, S12, S13, S14, S15, and S16, which are specifically described as follows. Figure 2

[0047] S11, obtaining a comprehensive complexity corresponding to each coding tree unit in each frame image in the image group.

[0048] The frame image in the image group is an image in the airport monitoring video, and the coding tree unit (CTU) includes a plurality of pixel points.

[0049] Optionally, the step of S11 of obtaining the comprehensive complexity corresponding to each coding tree unit in each frame image in the image group includes S111 and S112, which are specifically described as follows.

[0050] ​S111, obtain gradient complexity, texture complexity and motion complexity of the coding tree unit.

[0051] S112, perform weighted operation according to the gradient complexity, the texture complexity and the motion complexity to determine the comprehensive complexity.

[0052] As to the calculation manner of the gradient complexity, the texture complexity and the motion complexity, the embodiment of the application further provides an alternative implementation, please refer to the following.

[0053]

[0054] C i = w g · G i + w t · T i + w m · M i

[0055] Wherein, C i represents the comprehensive complexity corresponding to the i-th coding tree unit, w g represents the gradient weight, w t represents the texture weight, w m represents the motion weight, G i represents the gradient complexity, T i represents the texture complexity, M i represents the motion complexity, N represents the number of pixel points in the i-th coding tree unit, CTU i represents the i-th coding tree unit, I(x, y) represents the brightness value of the pixel point (x, y), I(x+1, y) represents the brightness value of the pixel point (x+1, y), I(x, y+1) represents the brightness value of the pixel point (x, y+1), LBP(x, y) represents the texture value of the pixel point (x, y), represents the motion value of the pixel point (x, y).

[0056] S12, merge the coding tree units satisfying the first condition, the second condition and the third condition in the current frame image into the key region.

[0057] S13, merge the coding tree units satisfying the fourth condition, the second condition and the third condition in the current frame image into the non-key region.

[0058] Wherein, the first condition is that the comprehensive complexity corresponding to the coding tree unit is greater than a first complexity threshold, the second condition is that the two coding tree units to be merged are adjacent, the third condition is that the absolute value of the difference of the comprehensive complexity of the two coding tree units to be merged is less than a second complexity threshold, and the fourth condition is that the comprehensive complexity corresponding to the coding tree unit is less than or equal to the first complexity threshold.

[0059] Suppose the integrated complexity corresponding to the ith coding tree unit and the integrated complexity corresponding to the jth coding tree unit are both greater than the first complexity threshold, and they are adjacent, if the formula |C i -C j |<ε is established, the ith coding tree unit and the jth coding tree unit can be merged into a key region. It should be noted that if the integrated complexity corresponding to the hth coding tree unit adjacent to the jth coding tree unit is also greater than the first complexity threshold, and the formula |C h -C j |<ε is established, the hth coding tree unit can be merged into the key region.

[0060] Suppose the integrated complexity corresponding to the ith coding tree unit and the integrated complexity corresponding to the jth coding tree unit are both less than or equal to the first complexity threshold, and they are adjacent, if the formula |C i -C j |<ε is established, the ith coding tree unit and the jth coding tree unit can be merged into a non-key region. It should be noted that if the integrated complexity corresponding to the hth coding tree unit adjacent to the jth coding tree unit is also less than or equal to the first complexity threshold, and the formula |C h -C j |<ε is established, the hth coding tree unit can be merged into the non-key region.

[0061] Wherein, C i represents the ith coding tree unit, C j represents the jth coding tree unit, C h represents the hth coding tree unit, and ε represents the two complexity thresholds.

[0062] In an optional embodiment, each coding tree unit can be respectively taken as a region without merging, and the coding tree unit is determined as a key region or a non-key region based on the first complexity threshold.

[0063] S14, according to the integrated complexity of the kth merged region in the current frame image and the total bit budget of the current frame image, determine the allocated bit number corresponding to the kth merged region in the current frame image.

[0064] Wherein, the integrated complexity of the kth merged region is the sum of the integrated complexity corresponding to each coding tree unit of the kth merged region.

[0065] It should be understood that the kth merging area in the current frame image can be a key area or a non-key area, the comprehensive complexity of the key area is greater than that of the non-key area, and bit dynamic allocation is performed based on the comprehensive complexity, so that more bits can be allocated to the key area, the coding accuracy of the key area is improved, and the clarity and overall monitoring efficiency of the key area are significantly improved.

[0066] S15, encoding the pixel points in the kth merging area based on the allocated bits corresponding to the kth merging area.

[0067] S16, after all frame images in the image group are encoded, transmitting the encoded data.

[0068] In the airport monitoring video transmission method provided by the embodiment of the application, the key area and the non-key area in the video frame can be accurately identified, dynamic bit allocation is performed according to the comprehensive complexity of the key area and the non-key area, accurate bit allocation of the video frame is realized in the case of low-bandwidth transmission of high-resolution video frames, the coding accuracy of the key area is improved, and thus the overall quality of the video frame is improved, the problem of quality degradation caused by insufficient resource allocation in low-bandwidth is effectively solved, the clarity and overall monitoring efficiency of the key area are significantly improved. The method is suitable for complex scenes such as airport runways and traffic sections that require low-bandwidth and high-quality monitoring, and can realize quality optimization on the basis of existing monitoring equipment, and help the further development of intelligent transportation and intelligent safety.

[0069] On the basis of the foregoing, regarding the content in S14, the embodiment of the application further provides an alternative implementation, please refer to the following. S14, determining the allocated bits corresponding to the kth merging area in the current frame image according to the comprehensive complexity of the kth merging area in the current frame image and the total bit budget of the current frame image, comprising: S141, S142, S143 and S144, which are specifically described as follows.

[0070] S141, determining the area weight corresponding to the kth merging area according to the comprehensive complexity of the kth merging area and the complexity sum corresponding to the current frame image.

[0071] Optionally, the formula of the area weight corresponding to the kth merging area is as follows:

[0072]

[0073]

[0074] wherein, C k represents the comprehensive complexity of the kth merging area, R k represents the kth merging area, C idenotes the comprehensive complexity corresponding to the i-th coding tree unit, i∈R k denotes that the i-th coding tree unit belongs to R k W k denotes the region weight corresponding to the k-th merging region, denotes the total complexity corresponding to the current frame image, N R denotes the total number of coding tree units in the current frame image, C j denotes the comprehensive complexity corresponding to the j-th coding tree unit.

[0075] S142, determining the initial bit number corresponding to the k-th merging region according to the region weight corresponding to the k-th merging region and the total bit budget of the current frame image.

[0076] S143, when the k-th merging region is a key region, adjusting the initial bit corresponding to the k-th merging region in combination with the first signal-to-noise ratio target value and the peak signal-to-noise ratio corresponding to the k-th merging region, to obtain the allocated bit number corresponding to the k-th merging region.

[0077] S144, when the k-th merging region is a non-key region, adjusting the initial bit corresponding to the k-th merging region in combination with the second signal-to-noise ratio target value and the peak signal-to-noise ratio corresponding to the k-th merging region, to obtain the allocated bit number corresponding to the k-th merging region.

[0078] The first signal-to-noise ratio target value is the average or median of the peak signal-to-noise ratios of each key region in the coded frame image in the image group, and the second signal-to-noise ratio target value is the average or median of the peak signal-to-noise ratios of each non-key region in the coded frame image in the image group.

[0079] Optionally, the formula of the allocated bit number corresponding to the k-th merging region is as follows:

[0080]

[0081] wherein, denotes the initial bit number corresponding to the k-th merging region, W k denotes the region weight corresponding to the k-th merging region, R total denotes the total bit budget of the current frame image, denotes the allocated bit number corresponding to the k-th merging region, q denotes the first feedback intensity coefficient, PSNR k denotes the peak signal-to-noise ratio corresponding to the k-th merging region, PSNR target1 denotes the first signal-to-noise ratio target value, PSNR target2 denotes the second signal-to-noise ratio target value.

[0082] q·(PSNR target1 -PSNRk ) and q- (PSNR target2 - PSNR k ) as a feedback signal and the dynamic characteristics of the region to optimize the bit allocation of the current frame. The next frame is adjusted according to the feedback signal. By dynamically adjusting the quality of the key area can be ensured continuous.

[0083] In an alternative embodiment, after the number of allocated bits corresponding to the kth merged region, S14, according to the comprehensive complexity of the kth merged region in the current frame image and the total bit budget of the current frame image, the step of determining the number of allocated bits corresponding to the kth merged region in the current frame image, S145, S146 and S147, are described as follows.

[0084] S145, determine whether the number of allocated bits corresponding to the kth merged region is greater than the upper limit of the number of bits corresponding to the kth merged region. If yes, execute S146; if not, execute S147.

[0085] S146, the upper limit of the number of bits is determined as the number of allocated bits corresponding to the kth merged region.

[0086] Wherein, the upper limit of the number of bits corresponding to the kth merged region can be expressed as The upper limit of the number of bits corresponding to the kth merged region can be dynamically adjusted according to the number of bits allocated to the key area in the encoding process of the previous frame image, to adapt to different complexity regions and prevent over allocation.

[0087] S147, the number of allocated bits corresponding to the kth merged region remains unchanged.

[0088] On the basis of the foregoing, as to how to obtain the total bit budget corresponding to each frame image, the embodiment of the application further provides an alternative embodiment, please refer to Figure 3 After S11, the airport monitoring video transmission method further comprises: S21, S22, S23 and S24, which are described as follows.

[0089] S21, according to the comprehensive complexity of the coding tree unit, the complexity sum corresponding to each frame image is obtained.

[0090] It should be understood that the complexity sum corresponding to the frame image is the sum of the comprehensive complexity of the coding tree unit in the frame image.

[0091] S22, according to the complexity sum corresponding to each frame image and the motion intensity, the frame weight corresponding to each frame image is determined.

[0092] S23, according to the frame weight corresponding to each frame image and the total bit budget sum corresponding to the image group, the initial bit budget corresponding to each frame image is determined.

[0093] S24, in combination with the peak signal-to-noise ratio corresponding to each frame object, adjusting the initial bit budget corresponding to each frame image to obtain the total bit budget corresponding to each frame image.

[0094] Optionally, the formula of the total bit budget corresponding to the frame image is as follows:

[0095]

[0096] R frame,j =R GOP ·W frame,j

[0097]

[0098] wherein, represents the total bit budget corresponding to the jth frame image, R frame,j represents the initial bit budget corresponding to the jth frame image, λ represents the second feedback intensity coefficient, PSNR target3 represents the third signal-to-noise ratio target value, the third signal-to-noise ratio target value is the average or median of the peak signal-to-noise ratios corresponding to all frame images, PSNR j represents the peak signal-to-noise ratio corresponding to the jth frame image, R GOP represents the total bit budget of the image group, W frame,j represents the frame weight corresponding to the jth frame image, C total,j represents the complexity sum corresponding to the jth frame image, M frame,j represents the motion intensity corresponding to the jth frame image, C total,k represents the complexity sum corresponding to the kth frame image, M frame,k represents the motion intensity corresponding to the kth frame image, N frames represents the number of frames in the image group.

[0099] In the GOP range, the frame-level bit budget is dynamically allocated according to the frame importance to ensure the balance of the quality between frames. Through the inter-frame feedback mechanism, the bit budget and quality allocation of each frame are adjusted, so as to ensure the stability of the video quality in a long time sequence.

[0100] Please refer to Figure 4 , Figure 4 The airport monitoring video transmission device provided by the embodiment of the application can be applied to the electronic device described above.

[0101] The airport monitoring video transmission device comprises a first processing unit 301 and a second processing unit 302.

[0102] The first processing unit 301 is configured to acquire a comprehensive complexity corresponding to each coding tree unit in each frame image in the image group, wherein the frame image in the image group is an image in the airport monitoring video.

[0103] The first processing unit 301 is further configured to merge the coding tree units satisfying the first condition, the second condition and the third condition in the current frame image into a key region, and merge the coding tree units satisfying the fourth condition, the second condition and the third condition in the current frame image into a non-key region; wherein the first condition is that the comprehensive complexity corresponding to the coding tree unit is greater than a first complexity threshold, the second condition is that two coding tree units to be merged are adjacent, the third condition is that the absolute value of the difference between the comprehensive complexities of the two coding tree units to be merged is less than a second complexity threshold, and the fourth condition is that the comprehensive complexity corresponding to the coding tree unit is less than or equal to the first complexity threshold.

[0104] The first processing unit 301 is further configured to determine the number of allocated bits corresponding to the kth merged region in the current frame image according to the comprehensive complexity of the kth merged region in the current frame image and the total bit budget of the current frame image, wherein the comprehensive complexity of the kth merged region is the sum of the comprehensive complexities corresponding to each coding tree unit of the kth merged region.

[0105] The first processing unit 301 is further configured to encode the pixel points in the kth merged region based on the number of allocated bits corresponding to the kth merged region.

[0106] The second processing unit 302 is configured to transmit the encoded data after all the frame images in the image group are encoded.

[0107] Optionally, the second processing unit 302 can perform the S16 described above, and the first processing unit 301 can perform other steps in the method embodiments described above.

[0108] It should be noted that the airport monitoring video transmission apparatus provided in the embodiment can perform the method processes shown in the method process embodiments described above to achieve the corresponding technical effects. For brevity, the part of the embodiment not mentioned in the description can be referred to the corresponding content in the above embodiments.

[0109] The embodiment of the present application further provides a storage medium storing computer instructions and programs, which, when read and run, perform the airport monitoring video transmission method of the above embodiments. The storage medium can include memory, flash memory, register or a combination thereof.

[0110] The following provides an electronic device, which can be a mobile phone, a computer, a server and the like. The electronic device is as follows Figure 1The airport monitoring video transmission method described above can be implemented, and specifically, the electronic device includes a processor 10, a memory 11 and a bus 12. The processor 10 can be a CPU. The memory 11 is used to store one or more programs, and when the one or more programs are executed by the processor 10, the airport monitoring video transmission method of the above embodiment is executed.

[0111] To sum up, the airport monitoring video transmission method, device, storage medium and electronic device provided by the embodiment of the application acquire the comprehensive complexity corresponding to each coding tree unit in each frame of image in the image group, merge the coding tree units in the current frame of image that meet the first condition, the second condition and the third condition into a key area, and merge the coding tree units in the current frame of image that meet the fourth condition, the second condition and the third condition into a non-key area; determine the allocated bit number corresponding to the kth merged area in the current frame of image according to the comprehensive complexity of the kth merged area in the current frame of image and the total bit budget of the current frame of image; encode the pixel points in the kth merged area based on the allocated bit number corresponding to the kth merged area; and after all the frames of image in the image group are encoded, the encoded data is transmitted. The key area and the non-key area can be accurately identified, dynamic bit allocation is performed according to the comprehensive complexity of the key area and the non-key area, accurate bit allocation of the video frame is realized in the case of low-bandwidth transmission of high-resolution video frames, the encoding accuracy of the key area is improved, and thus the overall quality of the video frame is improved, the problem of quality decline caused by insufficient resource allocation in low-bandwidth is effectively solved, the definition of the key area and the overall monitoring efficiency are significantly improved. The application is suitable for complex scenes such as airport runways and traffic sections that require high-quality monitoring, and the quality of the existing monitoring equipment is optimized to promote the further development of intelligent transportation and intelligent safety.

[0112] The above only describes preferred embodiments of the application and is not intended to limit the application. For those skilled in the art, the application can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the application shall be included in the protection scope of the application.

[0113] It is obvious for those skilled in the art that the application is not limited to the details of the above exemplary embodiments, and the application can be implemented in other specific forms without departing from the spirit or essential characteristics of the application. Therefore, the embodiments should be regarded as exemplary and non-limiting, and the scope of the application is defined by the appended claims rather than the above description, and all changes falling within the meaning and scope of the equivalent elements of the claims are intended to be included in the application. Any reference signs in the claims should not be regarded as limiting the claims involved.

Claims

1. An airport monitoring video transmission method, characterized by, The method comprises: obtaining a comprehensive complexity corresponding to each coding tree unit in each frame image in the image group, wherein the frame image in the image group is an image in the airport monitoring video, and the comprehensive complexity is a complexity obtained by performing a weighted operation on a gradient complexity, a texture complexity and a motion complexity of the coding tree unit; merging coding tree units in a current frame image that meet a first condition, a second condition and a third condition into a key region, and merging coding tree units in the current frame image that meet a fourth condition, the second condition and the third condition into a non-key region; wherein the first condition is that the comprehensive complexity corresponding to the coding tree unit is greater than a first complexity threshold, the second condition is that two coding tree units to be merged are adjacent, the third condition is that an absolute value of a comprehensive complexity difference between the two coding tree units to be merged is less than a second complexity threshold, and the fourth condition is that the comprehensive complexity corresponding to the coding tree unit is less than or equal to the first complexity threshold; determining an allocated bit number corresponding to a kth merged region in the current frame image according to a comprehensive complexity of the kth merged region in the current frame image and a total bit budget of the current frame image, wherein the comprehensive complexity of the kth merged region is a sum of comprehensive complexities corresponding to each coding tree unit of the kth merged region; and an expression of the allocated bit number corresponding to the kth merged region is: wherein, represents the initial number of bits corresponding to the kth merging region, represents the region weight corresponding to the kth merging region, represents the total bit budget of the current frame image, represents the allocated number of bits corresponding to the kth merging region, represents the first feedback strength coefficient, represents the peak signal-to-noise ratio corresponding to the kth merging region, represents the first signal-to-noise ratio target value, represents the second signal-to-noise ratio target value, the first signal-to-noise ratio target value being the average or median of the peak signal-to-noise ratios of each key region in the encoded frame images in the group of images, and the second signal-to-noise ratio target value being the average or median of the peak signal-to-noise ratios of each non-key region in the encoded frame images in the group of images. encoding pixel points in the kth merged region based on the allocated bit number corresponding to the kth merged region; after encoding of all frame images in the image group is completed, transmitting the encoded data.

2. The airport monitoring video transmission method of claim 1, wherein, The step of determining the allocated bit number corresponding to the kth merged region in the current frame image according to the comprehensive complexity of the kth merged region in the current frame image and the total bit budget of the current frame image comprises: determining a region weight corresponding to the kth merged region according to the comprehensive complexity of the kth merged region and a total complexity corresponding to the current frame image; determining an initial bit number corresponding to the kth merged region according to the region weight corresponding to the kth merged region and the total bit budget of the current frame image; when the kth merged region is a key region, adjusting the initial bit number corresponding to the kth merged region in combination with a first signal-to-noise ratio target value and a peak signal-to-noise ratio corresponding to the kth merged region, to obtain the allocated bit number corresponding to the kth merged region; when the kth merged region is a non-key region, adjusting the initial bit number corresponding to the kth merged region in combination with a second signal-to-noise ratio target value and the peak signal-to-noise ratio corresponding to the kth merged region, to obtain the allocated bit number corresponding to the kth merged region.

3. The airport monitoring video transmission method of claim 2, wherein, After the allocated bit number corresponding to the kth merged region is obtained, the method further comprises: determining whether the allocated bit number corresponding to the kth merged region is greater than an upper limit of a bit number corresponding to the kth merged region; if yes, determining the upper limit of the bit number as the allocated bit number corresponding to the kth merged region; if no, keeping the allocated bit number corresponding to the kth merged region unchanged.

4. The airport monitoring video transmission method according to claim 1, wherein the method further comprises: wherein, denotes the integrated complexity of the i-th coding tree unit, denotes the gradient weight, denotes the texture weight, denotes the motion weight, denotes the gradient complexity, denotes the texture complexity, denotes the motion complexity, N denotes the number of pixel points in the i-th coding tree unit, denotes the i-th coding tree unit, denotes the luminance value of the pixel point (x, y), denotes the luminance value of the pixel point (x+1, y), denotes the luminance value of the pixel point (x, y+1), denotes the texture value of the pixel point (x, y), denotes the motion value of the pixel point (x, y).

5. The airport monitoring video transmission method of claim 1, wherein, ​ According to the comprehensive complexity corresponding to the coding tree unit, obtain the complexity sum corresponding to each frame image; According to the complexity sum corresponding to each frame image and the motion intensity, determine the frame weight corresponding to each frame image; According to the frame weight corresponding to each frame image and the bit budget sum corresponding to the image group, determine the initial bit budget corresponding to each frame image; In combination with the peak signal-to-noise ratio corresponding to each frame object, adjust the initial bit budget corresponding to each frame image to obtain the total bit budget corresponding to each frame image.

6. The airport monitoring video transmission method of claim 5, wherein, wherein, denotes a total bit budget corresponding to the jth frame image, denotes an initial bit budget corresponding to the jth frame image, denotes a second feedback strength coefficient, denotes a third signal-to-noise ratio target value, denotes a peak signal-to-noise ratio corresponding to the jth frame image, denotes a total bit budget corresponding to the group of images, denotes a frame weight corresponding to the jth frame image, denotes a complexity total corresponding to the jth frame image, denotes a motion strength corresponding to the jth frame image, denotes a complexity total corresponding to the kth frame image, denotes a motion strength corresponding to the kth frame image, denotes a number of frames in the group of images.

7. An airport monitoring video transmission apparatus characterized by comprising: The apparatus comprises: A first processing unit is configured to obtain the comprehensive complexity corresponding to each coding tree unit in each frame image in an image group, wherein the frame images in the image group are images in an airport monitoring video, and the comprehensive complexity is the complexity obtained by performing weighted operation on the gradient complexity, the texture complexity and the motion complexity of the coding tree unit; The first processing unit is further configured to merge the coding tree units satisfying a first condition, a second condition and a third condition in a current frame image into a key region, and merge the coding tree units satisfying a fourth condition, the second condition and the third condition in the current frame image into a non-key region, wherein the first condition is that the comprehensive complexity corresponding to the coding tree unit is greater than a first complexity threshold, the second condition is that two coding tree units to be merged are adjacent, the third condition is that the absolute value of the difference between the comprehensive complexities of the two coding tree units to be merged is less than a second complexity threshold, and the fourth condition is that the comprehensive complexity corresponding to the coding tree unit is less than or equal to the first complexity threshold; The first processing unit is further configured to determine the allocated bit number corresponding to the kth merged region in the current frame image according to the comprehensive complexity of the kth merged region in the current frame image and the total bit budget of the current frame image, wherein the comprehensive complexity of the kth merged region is the sum of the comprehensive complexities corresponding to the coding tree units in the kth merged region, and the formula of the allocated bit number corresponding to the kth merged region is: wherein, represents the initial number of bits corresponding to the kth merging region, represents the region weight corresponding to the kth merging region, represents the total bit budget of the current frame image, represents the allocated number of bits corresponding to the kth merging region, represents the first feedback strength coefficient, represents the peak signal-to-noise ratio corresponding to the kth merging region, represents the first signal-to-noise ratio target value, represents the second signal-to-noise ratio target value, the first signal-to-noise ratio target value being the average or median of the peak signal-to-noise ratios of each key region in the encoded frame images in the group of images, and the second signal-to-noise ratio target value being the average or median of the peak signal-to-noise ratios of each non-key region in the encoded frame images in the group of images; The first processing unit is further configured to encode the pixel points in the kth merged region based on the allocated bit number corresponding to the kth merged region; A second processing unit is configured to transmit the encoded data after all the frame images in the image group are encoded.

8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by a processor to implement the method of any one of claims 1-6.

9. An electronic device, comprising: Comprise: A processor and a memory for storing one or more programs; When the one or more programs are executed by the processor, the method of any one of claims 1-6 is implemented.

Images