Image processing method, electronic equipment and storage medium

Abstract

The invention discloses an image processing method, electronic equipment and a storage medium, and the method comprises the steps: receiving at least one region-of-interest image sent by a target processing end and basic information corresponding to each region-of-interest image; the region-of-interest image is obtained by dividing the target image by the target processing end by using preset configuration information; in response to successful receiving of the target region-of-interest image and the corresponding basic information, encoding the successfully received target region-of-interest image and the corresponding basic information, and transmitting an encoded code stream to a second processing end; the target region-of-interest image is one of the at least one region-of-interest image; according to the method, the target image is divided into at least one region-of-interest image, the basic information of each region-of-interest image is obtained, and each region-of-interest image is subjected to coding, transmission and other processing, so that the processing time of each link is shortened, the time delay is reduced, and the image processing efficiency is improved.

Description

Technical Field

[0001] The present application relates to the technical field of image processing, and in particular to an image processing method, electronic equipment and storage medium. Background Art

[0002] With the explosive growth of computer applications, image processing has been iteratively developing towards intelligence and humanization, and various intelligent scenarios have been continuously developed and applied. In the development of image processing, image acquisition and image processing are usually carried out through the characteristics of the device to achieve the purpose of image processing.

[0003] In current image processing, based on the characteristics of the device, the length of image processing will cause a delay of at least 1 frame. In addition, there is the time for network transmission and decoding, which makes the delay in image acquisition and processing even longer. The current solution is to increase the frame rate to reduce the delay, but this will correspondingly increase the dependence on system performance and data transmission bandwidth, affecting the efficiency of image processing and restricting the development of image processing. Summary of the invention

[0004] The main technical problem solved by the present application is to provide an image processing method, an electronic device and a storage medium, which divides the target image into at least one region of interest image, obtains the basic information of each region of interest image, and then encodes, transmits and processes each region of interest image respectively, thereby reducing the processing time of each link, thereby reducing the delay and improving the efficiency of image processing.

[0005] In order to solve the above technical problems, a technical solution adopted in the present application is: to provide an image processing method, applied to a first processing end, comprising: receiving at least one region of interest image and basic information corresponding to each region of interest image sent by a target processing end; wherein, the at least one region of interest image is obtained by dividing the target image by the target processing end using preset configuration information; in response to successful reception of the target region of interest image and the corresponding basic information, encoding the successfully received target region of interest image and the corresponding basic information, and transmitting the encoded code stream to a second processing end; wherein, the target region of interest image is one of the at least one region of interest image.

[0006] In some embodiments, the receiving of at least one region of interest image and basic information corresponding to each region of interest image sent by the target processing end includes: receiving at least two region of interest images output by the image acquisition module in the target processing end, wherein the at least two region of interest images are obtained by the target processing end by dividing the current frame target image using preset configuration information; and receiving the basic information corresponding to each region of interest image output by the parameter configuration module in the target processing end, wherein the basic information represents the division parameters of each region of interest in the target image.

[0007] In some embodiments, at least two images of the region of interest sent by a target processing end are received; in response to successful reception of the target image of the region of interest and the corresponding basic information, the successfully received target image of the region of interest and the corresponding basic information are encoded, and the encoded code stream is transmitted to a second processing end, including: in response to successful reception of any of the target image of the region of interest and the corresponding basic information, the target image of the region of interest and the corresponding basic information are bound; the bound target image of the region of interest and the basic information are encoded, and the encoded code stream is transmitted to the second processing end.

[0008] In some embodiments, before encoding, it also includes: in response to the current region of interest image being the last region of interest image in the current frame target image, using external influence information to determine a first change in exposure parameters of different frame target images, and setting the exposure parameters corresponding to the next frame target image according to the first change; using preset configuration information to determine a second change in basic information of the region of interest images in different frame target images, and setting the basic information corresponding to the region of interest image in the next frame target image according to the second change; using the exposure parameters corresponding to the next frame target image and the basic parameters corresponding to the region of interest image in the next frame target image as feedback information, and feeding them back to the target processing end, so that the target processing end controls the image acquisition module to acquire multiple region of interest images and corresponding basic information of the next frame target image.

[0009] In order to solve the above technical problems, another technical solution adopted in the present application is: to provide an image processing method, applied to the second processing end, including: receiving the encoded code stream sent by the first processing end and decoding it, obtaining multiple area of ​​interest images, basic information corresponding to each of the area of ​​interest images, and a binding relationship between the area of ​​interest images and the corresponding basic information; using the binding relationship and preset configuration information, at least two of the area of ​​interest images are analyzed and fused to determine the analysis results and each frame of the target image obtained by the fusion.

[0010] In some embodiments, the use of the binding relationship and the preset configuration information to analyze and fuse at least two of the area of ​​interest images to determine the analysis results and each frame of the target image obtained by the fusion includes: using the binding relationship and the preset configuration information to determine the target area image with the at least two associated area of ​​interest images, wherein the at least two associated area of ​​interest images are at least two of the multiple area of ​​interest images divided by a frame of the target image; in response to analyzing the target area image, determining the analysis result of the target area image, and displaying the analysis result; using the binding relationship and the preset configuration information to fuse the multiple area of ​​interest image data to determine a frame of the target image.

[0011] In some embodiments, the binding relationship and preset configuration information are used to fuse the multiple area of ​​interest image data to determine a frame of target image, including: using the binding relationship and preset configuration information to obtain difference information between basic information corresponding to the multiple area of ​​interest images; optimizing the difference information, and then splicing the multiple area of ​​interest images into a complete frame of target image.

[0012] In some embodiments, it also includes: in response to the last image of the region of interest in the current region of interest image that is not the current frame target image, querying whether there is an analysis result; in response to the existence of the analysis result, outputting the analysis result; or in response to the absence of the analysis result, continuing to receive the encoded code stream and performing subsequent processing.

[0013] In order to solve the above technical problems, another technical solution adopted in the present application is: to provide an image processing method, applied to a target processing end, including: acquiring a target image, and receiving preset configuration information sent by a first processing end; using the preset configuration information to divide the target image into at least one region of interest image, and obtaining the basic information corresponding to each region of interest image; in response to successful division of the target image, transmitting at least one region of interest image and the corresponding basic information to the first processing end.

[0014] In some embodiments, the method further includes: receiving feedback information sent by the first processing end, and using the feedback information to adjust the division of the next frame target image.

[0015] In some embodiments, it also includes: the target image is divided into at least: uniform division, non-uniform division, path division and complex division.

[0016] To solve the above technical problems, another technical solution adopted in the present application is: to provide an electronic device, the electronic device comprising a memory and a processor coupled to the memory, the memory storing at least one computer program, and the at least one computer program, when loaded and executed by the processor, is used to implement the image processing method as described above.

[0017] To solve the above technical problems, another technical solution adopted in the present application is: providing a computer-readable storage medium, wherein the computer-readable storage medium has at least one program, and when the at least one program is loaded and executed by a processor, it is used to implement the image processing method as described above.

[0018] Different from the current technology, the image processing method provided by the present application includes: receiving at least one region of interest image and basic information corresponding to each region of interest image sent by the target processing end; wherein, at least one region of interest image is obtained by dividing the target image by the target processing end using preset configuration information; in response to the successful reception of the target region of interest image and the corresponding basic information, encoding the successfully received target region of interest image and the corresponding basic information, and transmitting the encoded code stream to the second processing end; wherein, the target region of interest image is one of the at least one region of interest image. That is, in the present application, by dividing the target image into at least one region of interest image, and obtaining the basic information of each region of interest image, and then encoding, transmitting and other processing are performed on each region of interest image respectively, the processing time of each link is reduced, thereby reducing the delay and improving the efficiency of image processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0020] Figure 1 is a flowchart of an embodiment of an image processing method applied to a first processing end in the present application;

[0021] Figure 2 is a flowchart of an embodiment of an image processing method applied to a second processing end in the present application;

[0022] Figure 3 It is a flowchart of an embodiment of an image processing method applied to a target processing end in the present application;

[0023] Figure 4is a structural schematic diagram of an embodiment of an image processing system in the present application;

[0024] Figure 5 It is a structural schematic diagram of an embodiment of an electronic device in the present application;

[0025] Figure 6 It is a structural diagram of an embodiment of a computer-readable storage medium in the present application. DETAILED DESCRIPTION

[0026] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only used to illustrate the present invention, but are not intended to limit the scope of the present invention. Similarly, the following examples are only partial embodiments of the present invention rather than all embodiments, and all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of the present invention.

[0027] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0028] Traditional image processing methods, due to the characteristics of the device, basically cause at least one frame of delay time, plus the network transmission and decoding time, making the delay of image acquisition and processing a bottleneck restricting the development of technology. Current solutions mostly use the method of increasing the frame rate to reduce the delay, but this will correspondingly increase the dependence on system performance and data transmission bandwidth, affecting the efficiency of image processing and restricting the development of image processing.

[0029] Therefore, an image processing method is provided, which divides the target image into at least one region of interest image, obtains basic information of each region of interest image, and then encodes, transmits and processes each region of interest image respectively, thereby reducing the processing time of each link, thereby reducing the delay and improving the efficiency of image processing.

[0030] See also Figure 1 , Figure 1 is a flowchart of an embodiment of an image processing method applied to the first processing end in the present application; it should be noted that if there is a substantial result, the method of the present application is not based on Figure 1 The process sequence shown is limited.

[0031] like Figure 1 As shown, the image processing method applied to the first processing end of the present application may include the following steps:

[0032] S10, receiving at least one region of interest image and basic information corresponding to each region of interest image sent by the target processing end; wherein, the at least one region of interest image is obtained by dividing the target image by the target processing end using preset configuration information.

[0033] Among them, the target processing end is a processing end used to divide the target image into at least one region of interest image; the region of interest image refers to the ROI area (region of interest), which is obtained by dividing it using the ROI acquisition characteristics of the target processing end and preset configuration information; the basic information refers to the parameter information that characterizes the region of interest.

[0034] Specifically, after the target processing end divides the target image using preset configuration information to obtain at least one region of interest image, the first processing end receives the region of interest image sent by the target processing end, and receives basic information corresponding to each region of interest image.

[0035] S20. In response to successful reception of the target region of interest image and the corresponding basic information, the successfully received target region of interest image and the corresponding basic information are encoded, and the encoded code stream is transmitted to the second processing end; wherein the target region of interest image is one of the at least one region of interest images.

[0036] Among them, the target area of ​​interest image refers to one of the at least one area of ​​interest images currently received; encoding refers to compressing the target area of ​​interest image to obtain a coded code stream after image compression; the second processing end refers to a processing end used for decoding and subsequent processing of the coded code stream.

[0037] Specifically, in the process of receiving an image of the region of interest, if an image of the region of interest and corresponding basic information are successfully received, it is set as a target image of the region of interest. The first processing end responds to the successful reception of the target image of the region of interest and the corresponding basic information, and can encode the successfully received target image of the region of interest and the corresponding basic information, that is, perform image compression on the target image of the region of interest and the corresponding basic information to obtain a corresponding encoding code stream, and then transmit the obtained encoding code stream to the second processing end.

[0038] In some embodiments, there may be multiple target region of interest images, and the multiple target region of interest images may be subsequently encoded and transmitted in parallel.

[0039] In this embodiment, by dividing the target image into at least one region of interest image and obtaining basic information of each region of interest image, and then encoding, transmitting and other processing are performed on each region of interest image respectively, the processing time of each link is reduced, thereby reducing the delay and improving the efficiency of image processing.

[0040] In some embodiments, step S10 of receiving at least one region of interest image and basic information corresponding to each region of interest image sent by the target processing end may include the following operations.

[0041] At least two region-of-interest images output by an image acquisition module in a target processing end are received, wherein the at least two region-of-interest images are obtained by dividing a current frame target image by the target processing end using preset configuration information.

[0042] The target processing end may include an image acquisition module for acquiring the target image and then outputting it; the target processing end may output two or more images of the region of interest.

[0043] Specifically, after the image acquisition module in the target processing end acquires the target image and divides the current frame target image into at least two region of interest images using preset configuration information, the first processing end receives at least two region of interest images output by the image acquisition module in the target processing end.

[0044] And receiving basic information corresponding to each region of interest image output by a parameter configuration module in a target processing end, wherein the basic information represents a division parameter of each region of interest in the target image.

[0045] The target processing end may further include a parameter configuration module for providing preset configuration information and obtaining basic information corresponding to each region of interest image.

[0046] Specifically, after the parameter configuration module provides preset configuration information to the image acquisition module, and the image acquisition module uses the preset configuration information to divide the current frame target image into at least two region of interest images, the first processing end receives the basic information corresponding to each region of interest image output by the parameter configuration module in the target processing end.

[0047] In some embodiments, the preset configuration information includes at least: the number of region of interest images, the size (height and width) of the region of interest images, the starting position, the switching / moving method, etc.; the basic information includes at least: the starting position, the size (height and width) of the region of interest images, the serial number of each region of interest image, and the exposure sequence; wherein the serial number can be the division serial number of the region of interest image in the same frame of the target image, and the exposure sequence can be the exposure sequence of the region of interest images in the same frame of the target image.

[0048] In this embodiment, the first processing end receives at least one region of interest image divided by the target image and the corresponding basic information, effectively dividing each frame of the target image, thereby providing a basis for earlier processing for subsequent encoding, decoding and other processing tasks, thereby reducing delays and improving image processing efficiency.

[0049] In some embodiments, step S20, in response to successful reception of the target region of interest image and the corresponding basic information, encodes the successfully received target region of interest image and the corresponding basic information, and transmits the encoded code stream to the second processing end, which may include the following operation steps.

[0050] In response to successful reception of any target region of interest image and corresponding basic information, the target region of interest image and the corresponding basic information are bound.

[0051] Binding refers to binding the target region of interest image with the basic information related to the target region of interest, so that in the subsequent processing, the corresponding target region of interest image can be distinguished according to the basic information.

[0052] Specifically, in the process of receiving the image of the region of interest at the first processing end, in response to successful reception of any target region of interest and corresponding basic information, the successfully received target region of interest image and the corresponding basic information are bound so that they can be processed together in subsequent processing.

[0053] The bound target region of interest image and basic information are encoded, and the encoded code stream is transmitted to the second processing end.

[0054] Specifically, after the target area of ​​interest image and the corresponding basic information are bound, subsequent processing can be started, that is, the bound target area of ​​interest image and basic information are encoded to obtain the encoded code stream corresponding to the target area of ​​interest image and basic information, and then the first processing end transmits the obtained encoded code stream to the second processing end.

[0055] In some embodiments, if there are multiple target region of interest images, the multiple region of interest images and corresponding basic information may be bound in parallel, and encoding and transmission processing of the multiple target region of interest images may be performed in parallel.

[0056] In this embodiment, once any target area of ​​interest image and the corresponding basic information are successfully received, the subsequent processing process can begin, and in the case of multiple target area of ​​interest images, binding, encoding, transmission and other processing can be performed in parallel, that is, the processing time corresponding to each link will be reduced, thereby reducing the delay and improving the efficiency of image processing.

[0057] Furthermore, before encoding, the following operations may also be included.

[0058] In response to the current region of interest image being the last region of interest image in the current frame target image, a first change of exposure parameters of different frame target images is determined using external impact information, and the exposure parameters corresponding to the next frame target image are set according to the first change.

[0059] Among them, judging whether the current region of interest image is the last region of interest image of the current frame target image is to determine whether the division and exposure conditions corresponding to the target images of different frames have changed, that is, whether the target images of different frames are processed differently; external influence information refers to the external environment changes that cause changes in the quality of the target image; the first change situation refers to the change between the exposure parameters of the current frame target image and the exposure parameters of the next frame target image.

[0060] Specifically, in the process of binding the region of interest image and the corresponding basic information, it is necessary to judge the serial number of the current region of interest image to determine whether it is the last region of interest image in the current frame target image, and when it is determined that it is the last region of interest image corresponding to the current frame, the first processing end responds to the current region of interest image as the last region of interest image in the current frame target image, and uses external influence information to determine the first change of exposure parameters of different frame target images, that is, determine the first change of the current frame target image and exposure parameters and the exposure parameters of the next frame target image, and then set the exposure information of the region of interest image divided by the next frame target image.

[0061] For example, if the external environment corresponding to the external impact information becomes darker, it is necessary to increase the exposure time or increase the gain.

[0062] The preset configuration information is used to determine a second change in basic information of the image of the region of interest in different frames of target images, and the basic information corresponding to the image of the region of interest in the next frame of target image is set according to the second change.

[0063] The second change situation refers to the change situation between the division information of the image of the region of interest in the current frame target image and the division information of the image of the region of interest in the next frame target image.

[0064] Specifically, in the process of binding the image of the region of interest and the corresponding basic information, the preset configuration information is used to determine the second change situation of the basic information of the image of the region of interest in different frame target images, and the basic information corresponding to the image of the region of interest in the next frame target image is set according to the second change situation, that is, the second change situation of the basic information of the current frame target image and the basic information of the next frame target image is determined, and then the basic information of the next frame target image is set, that is, the division information.

[0065] The exposure parameters corresponding to the next frame of the target image and the basic parameters corresponding to the image of the region of interest in the next frame of the target image are fed back to the target processing end as feedback information, so that the target processing end controls the image acquisition module to acquire multiple images of the region of interest and corresponding basic information of the next frame of the target image.

[0066] The feedback information refers to the exposure parameters and basic parameters corresponding to the next frame of the target image obtained by the first processing end.

[0067] Specifically, after the first processing end obtains the exposure parameters and the corresponding basic information corresponding to the next frame of the target image, it feeds them back to the target processing end as feedback information, so that the target processing end uses the exposure parameters and the basic information corresponding to the next frame to control the image acquisition module to acquire multiple images of the region of interest of the next frame of the target image, thereby enabling the first processing end to receive the multiple images of the region of interest and the corresponding basic information of the next frame of the target image.

[0068] In this embodiment, it is applied to the first processing end, by dividing the target image into at least one region of interest image, and obtaining the basic information of each region of interest image, and then encoding, transmitting and other processing are performed on each region of interest image respectively, so as to reduce the processing time of each link, thereby reducing the delay and improving the efficiency of image processing.

[0069] The present application also provides an image processing method applied to a second processing end.

[0070] See also Figure 2 , Figure 2 It is a flowchart of an embodiment of an image processing method applied to a second processing end in the present application.

[0071] like Figure 2 As shown, the image processing method applied to the second processing end includes the following operations.

[0072] Y10. Receive and decode the coded code stream sent by the first processing end to obtain multiple region of interest images, basic information corresponding to each region of interest image, and a binding relationship between the region of interest images and the corresponding basic information.

[0073] The coded code stream is obtained after the first processing end encodes the image of the region of interest and the corresponding basic information; the binding relationship refers to the association relationship between the image of the region of interest and the corresponding basic information.

[0074] Specifically, after the first processing end obtains the encoded code stream after encoding the region of interest image and the corresponding basic information, the second processing end receives the encoded code stream sent by the first processing end and decodes the encoded code stream to obtain multiple region of interest images, the basic information corresponding to each region of interest image, and the binding relationship between the region of interest image and the corresponding basic information.

[0075] Y20. Analyze and fuse at least two region of interest images using the binding relationship and preset configuration information to determine the analysis results and each frame of the target image obtained by the fusion.

[0076] The analysis refers to analyzing the information contained in the region of interest image; and the fusion refers to fusing multiple region of interest images into a complete frame of target image.

[0077] Specifically, the second processing end uses the binding information and preset configuration information to analyze at least two area of ​​interest images to obtain corresponding analysis results, such as the content contained in the area of ​​interest images; and fuses at least two area of ​​interest images, that is, splices at least two area of ​​interest images into a complete frame of target image.

[0078] In this embodiment, the second processing end, that is, the decoding end, is used to analyze and fuse the multiple images of the region of interest obtained, that is, each region of interest is processed accordingly, thereby improving the degree of parallel processing, thereby reducing latency and improving image processing efficiency.

[0079] In some embodiments, step Y20 uses the binding relationship and preset configuration information to analyze and fuse at least two region of interest images, determine the analysis results and each frame of the target image obtained by fusion, and may include the following operations.

[0080] The target region image is determined by using the binding relationship and preset configuration information with at least two associated region images of interest, wherein the at least two associated region images of interest are at least two region images of interest among a plurality of region images of interest divided from a frame of target image.

[0081] Among them, the at least two associated area of ​​interest images can be a target that can be determined by multiple area of ​​interest images, such as a car, and a complete frame of target image is divided into multiple area of ​​interest images, and the part corresponding to the target is at least a part of a frame of target image.

[0082] Specifically, the second processor uses the binding relationship and the preset configuration information to determine a target region image corresponding to a target from the at least two associated region-of-interest images.

[0083] In response to analyzing the target area image, an analysis result of the target area image is determined, and the analysis result is displayed.

[0084] Among them, the target area image can correspond to a complete target.

[0085] Specifically, the target area image is analyzed to determine the analysis result of the target area image on the complete target, and then the analysis result of the complete target is presented, for example, displayed.

[0086] Using the binding relationship and preset configuration information, multiple region of interest image data are fused to determine a frame of target image.

[0087] Fusion refers to restoring multiple region-of-interest images divided in the same frame into a complete target image.

[0088] Specifically, the second processing end determines the multiple region-of-interest images divided into each frame of the target image by using the binding relationship and the preset configuration information, and then fuses the corresponding multiple region-of-interest images to obtain a complete frame of the target image.

[0089] Furthermore, the binding relationship and preset configuration information are used to fuse multiple region of interest image data to determine a frame of target image, which may also include the following operations.

[0090] The difference information between the basic information corresponding to the multiple region of interest images is obtained by using the binding relationship and the preset configuration information.

[0091] Since the exposure start time of each region of interest image is different, there may be slight misalignment or deformation or brightness difference on each region of interest image, and the corresponding difference information needs to be obtained.

[0092] Specifically, before fusion, a binding relationship and preset configuration information are required to obtain difference information between the associated region-of-interest images.

[0093] The difference information is optimized, and then multiple region-of-interest images are stitched into a complete target image.

[0094] The difference information is optimized, that is, the slight misalignment or deformation or brightness difference existing in each region of interest image is optimized, and then the optimized region of interest images are spliced ​​to obtain a complete frame of target image without error.

[0095] In some embodiments, the following operations may also be included.

[0096] In response to the current region of interest image being the last region of interest image in the target image of the current frame, it is queried whether there is an analysis result.

[0097] The determination of whether the current region of interest image is the last region of interest image in the current frame target image is for the purpose of determining a complete target in a target image using a partial region of interest when there is no complete frame target image.

[0098] In response to the existence of the analysis result, the analysis result is output.

[0099] Specifically, when there is a complete target, the complete target is analyzed to obtain analysis results, and the analysis results are output for display.

[0100] Or in response to the absence of the analysis result, continue to receive the encoded code stream and perform subsequent processing.

[0101] Specifically, if there is no analysis result, the coded bitstream continues to be received, and after waiting for a plurality of region-of-interest images corresponding to a complete frame of target image, the complete frame of target image is analyzed to obtain the analysis result of the complete frame of target image.

[0102] In this embodiment, the second processing end, i.e., the decoding end, is applied to obtain multiple images of the region of interest based on the received encoded code stream, and then analyze and fuse them at the same time, that is, multiple images of the region of interest can be processed in parallel at each stage, reducing delays and effectively improving image processing efficiency.

[0103] The present application also provides an image processing method applied to a target processing end.

[0104] See also Figure 3 , Figure 3 It is a flowchart of an embodiment of an image processing method applied to a target processing end in the present application.

[0105] like Figure 3 As shown, the image processing method applied to the target processing end may include the following operations.

[0106] Z10. Capture a target image and receive preset configuration information sent by the first processing end.

[0107] The target processing end includes an image acquisition module and a parameter configuration module, wherein the image acquisition module is used to acquire images and output them, and the parameter configuration module is used to provide configuration information so that the image acquisition module outputs according to the configuration information.

[0108] Specifically, the image acquisition module of the target processing end acquires the target image, and the parameter configuration module of the target processing end receives the preset configuration information or feedback information sent by the first processing end, and then adjusts the configuration information according to the feedback information.

[0109] Z20. Divide the target image into at least one region of interest image using preset configuration information, and obtain basic information corresponding to each region of interest image.

[0110] Specifically, after acquiring the target image, the image acquisition module divides the target image using preset configuration information to divide at least one region of interest image, and the parameter configuration module obtains basic information corresponding to each region of interest image.

[0111] Z30. In response to successful division of the target image, at least one region of interest image and corresponding basic information are transmitted to the first processing end.

[0112] Among them, the first processing end is the encoding end.

[0113] Specifically, after a complete frame of the target image is successfully divided, the obtained at least one region of interest image and the corresponding basic information are transmitted to the first processing end to be encoded and processed at the first processing end.

[0114] In this embodiment, a complete frame of target image is divided into at least one region of interest image using preset configuration information, and then the region of interest image corresponding to the complete frame of target image is transmitted to subsequent processing, and after being divided into multiple region of interest images, each region of interest image can be subsequently processed, which reduces the time for processing each frame of target image, that is, reduces the delay, thereby improving the image processing efficiency.

[0115] In some embodiments, the following operations may also be included.

[0116] The feedback information sent by the first processing end is received, and the division of the next frame target image is adjusted by using the feedback information.

[0117] The feedback information is determined by the first processing end according to changes in exposure parameters and changes in basic information.

[0118] Specifically, after receiving the feedback information, the parameter configuration module of the target processing end adjusts the preset configuration information using the feedback information, so that the image acquisition module outputs the corresponding region of interest image using the adjusted configuration information.

[0119] That is, when the division of the region of interest image required by the current frame target image and the next frame target image is different, the above adjustment operation is performed.

[0120] In some embodiments, the following operations may also be included.

[0121] The target image is divided into at least the following ways: uniform division, non-uniform division, path division and complex division.

[0122] Among them, uniform division means that in the same frame of target image, each region of interest image is evenly divided with the same size (height and width), which is suitable for scenarios that require low-latency full-scene analysis and processing; non-uniform division means randomly dividing a frame of target image into multiple region of interest images, and the size (height and width) of each region of interest image can be different. It is suitable for scenarios with low-latency triggering of one or more fixed associated area scene analysis, such as ROI0 for intrusion analysis and ROI1 for departure analysis; path division means dividing according to the target's motion trajectory, the width can be the same and can be smaller than the width of the complete frame target image, which is suitable for scenarios where the target moves along a specified path; complex division means dividing according to multiple different targets, which can be partially overlapping and have different heights and widths, which is suitable for complex scenes with multiple analysis requirements at the same time.

[0123] In this embodiment, it is applied to the target processing end, and the preset configuration information is used to divide the target image into multiple region of interest images, thereby providing a region of interest image of less than one frame for subsequent encoding, transmission, decoding and other processing of each region of interest image, and multiple region of interest images can be processed in parallel to reduce delay and thus improve image processing efficiency.

[0124] In some embodiments, an image processing system is also provided.

[0125] See also Figure 4 , Figure 4 It is a structural diagram of an embodiment of an image processing system in the present application.

[0126] like Figure 4 As shown, the image processing system 400 includes a target processing end 410 , a first processing end 420 and a second processing end 430 , wherein the target processing end 410 includes an image acquisition module 411 and a parameter configuration module 412 .

[0127] Specifically, the parameter configuration module 412 in the target processing end 410 provides preset configuration information to the image acquisition module 411, so that the image acquisition module 411 divides the acquired target image into multiple region of interest images according to the configuration information and outputs them; the first processing end 420 receives the multiple region of interest images and the basic information corresponding to each region of interest image output by the target processing end 410, and then encodes each region of interest and the corresponding basic information respectively, and transmits the encoded code stream to the second processing end 430; the second processing end 430 receives the encoded code stream and decodes it to obtain multiple region of interest images and the corresponding basic information, and then can analyze and fuse the region of interest images to obtain the analysis results of partial areas, fuse to obtain a complete frame of target image and the analysis results of the target image, and can display the analysis results.

[0128] The present application also provides an electronic device.

[0129] See also Figure 5 , Figure 5 1 is a schematic diagram of the structure of an electronic device in an embodiment of the present application. The electronic device can execute the steps of the image processing method in the above method.

[0130] The electronic device 500 includes a memory 520, a processor 510 coupled to the memory, and at least one computer program stored in the memory 520 and executable on the processor 510; when the processor 510 loads and executes the at least one computer program, it is used to implement the image processing steps in the above method. For related contents, please refer to the detailed description of the above method, which will not be repeated here.

[0131] The present application also provides a computer-readable storage medium.

[0132] See also Figure 6 , Figure 6 It is a structural diagram of an embodiment of a computer-readable storage medium in the present application.

[0133] The computer readable storage medium 600 stores at least one program 610, which is used to implement the image processing steps in the above method when loaded and executed by the processor. For related contents, please refer to the detailed description of the above method, which will not be repeated here.

[0134] The above scheme divides the target image into at least one region of interest image and obtains the basic information of each region of interest image, and then encodes, transmits and processes each region of interest image respectively, thereby reducing the processing time of each link, thereby reducing the delay and improving the efficiency of image processing.

[0135] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0136] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0137] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0138] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0139] The above description is only an implementation mode of the present invention, and does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An image processing method, characterized in that: Applied to the first processing end, including: Receive at least one region of interest image and basic information corresponding to each region of interest image sent by a target processing end; wherein the at least one region of interest image is obtained by the target processing end dividing the target image using preset configuration information; In response to successful reception of the target area of ​​interest image and the corresponding basic information, the successfully received target area of ​​interest image and the corresponding basic information are encoded, and the encoded code stream is transmitted to the second processing end; wherein the target area of ​​interest image is one of the at least one area of ​​interest image.

2. The method according to claim 1, characterized in that The receiving target processing end sends at least one region of interest image and basic information corresponding to each region of interest image, including: Receiving at least two region-of-interest images output by an image acquisition module in the target processing end, wherein the at least two region-of-interest images are obtained by dividing the current frame target image by the target processing end using preset configuration information; And receiving the basic information corresponding to each of the region of interest images output by the parameter configuration module in the target processing end, wherein the basic information represents the division parameters of each region of interest in the target image.

3. The method according to claim 1, characterized in that receiving at least two region of interest images sent by a target processing end; In response to the successful reception of the target region of interest image and the corresponding basic information, encoding the successfully received target region of interest image and the corresponding basic information, and transmitting the encoded code stream to the second processing end, comprises: In response to successful reception of any of the target region of interest image and the corresponding basic information, binding the target region of interest image and the corresponding basic information; The bound target region of interest image and the basic information are encoded, and the encoded code stream is transmitted to the second processing end.

4. The method according to claim 3, characterized in that: Before encoding, it also includes: In response to the current region of interest image being the last region of interest image in the current frame of target images, determining a first change situation of exposure parameters of target images of different frames by using external influence information, and setting exposure parameters corresponding to the next frame of target images according to the first change situation; Determine a second change of basic information of the image of the region of interest in different frames of target images by using preset configuration information, and set basic information corresponding to the image of the region of interest in the next frame of target image according to the second change; The exposure parameters corresponding to the next frame of the target image and the basic parameters corresponding to the image of the region of interest in the next frame of the target image are fed back to the target processing end as feedback information, so that the target processing end controls the image acquisition module to acquire multiple images of the region of interest and corresponding basic information of the next frame of the target image.

5. An image processing method, characterized in that: Applied to the second processing end, including: Receive and decode the coded code stream sent by the first processing end to obtain a plurality of region of interest images, basic information corresponding to each of the region of interest images, and a binding relationship between the region of interest images and the corresponding basic information; By using the binding relationship and the preset configuration information, at least two images of the region of interest are analyzed and fused to determine the analysis result and each frame of the target image obtained by the fusion.

6. The method according to claim 5, characterized in that The method of analyzing and fusing at least two images of the region of interest by using the binding relationship and the preset configuration information, and determining the analysis result and each frame of the target image obtained by fusion, comprises: Determine a target region image by using the binding relationship and the preset configuration information with the at least two associated region images of interest, wherein the at least two associated region images of interest are at least two region images of interest among a plurality of region images of interest divided by a frame of target image; In response to analyzing the target area image, determining an analysis result of the target area image, and displaying the analysis result; The binding relationship and the preset configuration information are used to fuse the plurality of image data of the region of interest to determine a frame of target image.

7. The method according to claim 6, characterized in that The method of utilizing the binding relationship and the preset configuration information to fuse the plurality of image data of the region of interest to determine a frame of target image includes: Using the binding relationship and the preset configuration information, obtaining difference information between the basic information corresponding to the plurality of images of the region of interest; The difference information is optimized, and then a plurality of the region of interest images are spliced ​​into a complete frame of target image.

8. The method according to claim 6, characterized in that Also includes: In response to the current region of interest image being the last region of interest image in the target image of the current frame, querying whether there is an analysis result; In response to the existence of the analysis result, outputting the analysis result; Or in response to the absence of the analysis result, continue to receive the encoded code stream and perform subsequent processing.

9. An image processing method, characterized in that: Applied to the target processing end, including: Capturing a target image and receiving preset configuration information sent by the first processing end; Divide the target image into at least one region of interest image using preset configuration information, and obtain basic information corresponding to each region of interest image; In response to the target image being successfully divided, at least one of the region of interest images and the corresponding basic image are transmitted to the first processing end.

10. The method according to claim 9, characterized in that Also includes: The feedback information sent by the first processing end is received, and the division of the next frame target image is adjusted by using the feedback information.

11. The method according to claim 9, characterized in that Also includes: The target image is divided into at least one of uniform division, non-uniform division, path division and complex division.

12. An electronic device, characterized in that: The electronic device includes a memory and a processor coupled to the memory, the memory stores at least one computer program, and when the at least one computer program is loaded and executed by the processor, it is used to implement the image processing method according to any one of claims 1-11.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium has at least one program, and when the at least one program is loaded and executed by the processor, it is used to implement the image processing method according to any one of claims 1 to 11.

Images