Image data transmission method and related apparatus

Abstract

The embodiment of the application discloses a kind of image data transmission method and related device, method includes: obtaining historical frame image;Respectively, historical frame image and current frame image are carried out image area division, obtain the multiple first image area corresponding to historical frame image and the multiple second image area corresponding to current frame image, wherein, each first image area corresponds one second image area;Contrast multiple first image area and multiple second image area, determine the variation parameter corresponding to multiple first image area and / or multiple second image area;According to variation parameter, current frame image is segmented, and the high variation area corresponding to current frame image and low variation area are obtained;High variation area is transmitted to the back-end platform of electronic equipment.The embodiment of the application is advantageous to improve the image data transmission processing efficiency of system, and save the power consumption of system.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data transmission, in particular to an image data transmission method and related device. BACKGROUND

[0002] With the development of data transmission technology, more and more attention is paid to reducing system data transmission processing pressure and improving image data transmission processing efficiency.

[0003] At present, the camera system transmits and processes the original image data in an integral frame. The instantaneous image data volume is large, and in the current main application scenario of dual-camera, the instantaneous image data volume is huge, and the system has great real-time data transmission processing pressure, which greatly increases the system power consumption. Especially for the spatial alignment transform (SAT) scene, the data sent to the upper layer display is switched between two data, which is difficult to reduce the data volume of transmission processing. SUMMARY

[0004] The embodiments of the present application provide an image data transmission method and related device, which is beneficial to reduce system image data transmission processing pressure, improve system image data transmission processing efficiency, and save system power consumption.

[0005] In a first aspect, the embodiments of the present application provide an image data transmission method applied to an electronic device, the method comprising:

[0006] obtaining a historical frame image;

[0007] dividing the historical frame image and a current frame image into image regions respectively to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region;

[0008] comparing the plurality of first image regions and the plurality of second image regions to determine a variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions;

[0009] segmenting the current frame image according to the variation parameter to obtain a high variation region and a low variation region corresponding to the current frame image;

[0010] transmitting image data corresponding to the high variation region to a back-end platform of the electronic device, wherein the high variation region is used by the back-end platform to fuse a target image according to the historical frame image, and the target image corresponds to the current frame image.

[0011] In a second aspect, an embodiment of the present application provides an image data transmission device, which is arranged in an electronic device, and includes an acquisition unit, a region division unit, a determination unit, a segmentation unit and a transmission unit, wherein

[0012] The acquisition unit is configured to acquire a historical frame image.

[0013] The region division unit is configured to perform image region division on the historical frame image and a current frame image respectively, to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region.

[0014] The determination unit is configured to compare the plurality of first image regions and the plurality of second image regions, and determine a variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions.

[0015] The segmentation unit is configured to segment the current frame image according to the variation parameter, to obtain a high variation region and a low variation region corresponding to the current frame image.

[0016] The transmission unit is configured to transmit image data corresponding to the high variation region to a back-end platform of the electronic device, wherein the high variation region is used by the back-end platform to obtain a target image by fusing the historical frame image, and the target image corresponds to the current frame image.

[0017] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, a communication interface and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing steps in any method of the first aspect of the embodiments of the present application.

[0018] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform some or all of the steps described in any method of the first aspect of the embodiments of the present application.

[0019] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps described in any method of the first aspect of the embodiments of the present application. The computer program product can be a software installation package.

[0020] It can be seen that in the embodiments of the present application, the historical frame image is obtained, the historical frame image and the current frame image are regionally divided respectively to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region, then the plurality of first image regions and the plurality of second image regions are compared to determine the variation parameters corresponding to the plurality of first image regions and / or the plurality of second image regions, and then the current frame image is segmented according to the variation parameters to obtain a high variation region and a low variation region corresponding to the current frame image, and the high variation region is transmitted to the back-end platform of the electronic device. The high variation region can be used by the back-end platform to fuse the target image corresponding to the current frame image according to the historical frame image. In this way, by using the characteristics that the front-end platform of the electronic device can preferentially obtain image data and quickly process, the variation parameters of different regions of the current frame image can be determined at the front-end platform of the electronic device, the high variation region and the low variation region of the current frame image are segmented according to the variation parameters, and only the high variation region is transmitted to the back-end platform. The target image corresponding to the current frame image is obtained by the back-end platform for fusion processing, which is beneficial to reduce the system image transmission processing pressure, improve the system image data transmission processing efficiency, save the system power consumption, and better adapt to the shooting requirements of high frame rate shooting scenes. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0022] Figure 1 is a schematic diagram of an image data transmission system architecture provided by an embodiment of the present application;

[0023] Figure 2 is a flowchart of an image data transmission method provided by an embodiment of the present application;

[0024] Figure 3 is a division schematic diagram of a variation region provided by an embodiment of the present application;

[0025] Figure 4 is an interaction schematic diagram of an image data transmission method provided by an embodiment of the present application;

[0026] Figure 5 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0027] Figure 6is a functional unit constituent block diagram of an image data transmission device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to enable persons skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative labor fall within the scope of protection of the present application.

[0029] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, and are not used to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed, or can optionally include other steps or units inherent to the process, method, product or device.

[0030] Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily all refer to the same embodiment, nor does it necessarily refer to a particular embodiment that is preferred over other embodiments. It is explicitly and implicitly understood that the embodiments described herein can be combined with other embodiments.

[0031] The electronic device can be a portable electronic device that also contains other functions such as personal digital assistant and / or music player functions, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication function (such as a smart watch, smart glasses), a vehicle-mounted device, etc. Exemplary embodiments of the portable electronic device include, but are not limited to, portable electronic devices equipped with an IOS system, an Android system, a Microsoft system, or other operating systems. The above-mentioned portable electronic device can also be other portable electronic devices, such as a laptop computer, etc. It should also be understood that in some other embodiments, the above-mentioned electronic device can also not be a portable electronic device, but a desktop computer.

[0032] Currently, the camera system transmits image data in an entire frame. In a low-resolution and low-frame-rate scenario, the system can perform real-time transmission processing because the instantaneous image data processed by the system is not very large. However, with the development of technology and the change of user demand, preview and video recording are required to be high-resolution and high-frame-rate. In the case where the hardware performance is not optimized, the system transmission processing pressure is very large, the power consumption increases, and the endurance and functional experience of the electronic device are affected.

[0033] In addition, the main application scenario of the camera system of the current mobile phone is dual-camera, and there is a demand for simultaneous output of dual-camera data for a long time or a short time. In this high-frame-rate scenario, the amount of data that needs to be transmitted and processed by the system is close to doubled. At the same time, for the SAT scenario, because the data sent to the upper layer display is switched between two data, it is difficult to reduce the data amount of the two data. In the case where the system transmission processing performance is limited, the shooting processing cannot be completed.

[0034] To solve the above problems, the present application provides an image data transmission method and related device, which will be described in detail below.

[0035] First, the example application scenario disclosed in the embodiments of the present application is introduced as follows.

[0036] Figure 1 The architecture schematic diagram of the image data transmission system to which the present application is applied is shown, wherein the above system architecture can be applied to an electronic device, and the system architecture can include a front-end platform and a back-end platform.

[0037] The front-end platform can be used to analyze and / or segment the current frame image transmitted by the image sensor, that is, the RAW format image data, and transmit the analyzed and / or segmented image data to the back-end platform. The front-end platform can be provided by a front-end chip or a processor included in the electronic device, without limitation.

[0038] The back-end platform can receive the analyzed and / or segmented image data transmitted by the front-end platform, and perform image fusion, 3A algorithm, and the like processing according to the image data to obtain a new frame image, that is, a target image, which corresponds to the current image and can be used to restore the current shooting scene of the electronic device. The back-end platform can be provided by an application processor (AP) included in the electronic device, or can be provided by a back-end server, a cloud server, and the like, without limitation.

[0039] It should be noted that in the present application, multiple can refer to two or more than two, and the following will not be described in detail.

[0040] The second part is an introduction to the protection scope of the application.

[0041] Please refer to Figure 2 , Figure 2 is a flowchart of a data transmission processing method provided by the application, which is applied to an electronic device. As shown in the figure, the image data transmission method includes the following operations.

[0042] S201, obtaining a historical frame image.

[0043] As shown in Figure 1 , the electronic device can include a front-end platform, and the historical frame image can be obtained through the front-end platform. The historical frame image can be collected by an image sensor and can be cached in the front-end platform.

[0044] The historical frame image can be one frame of image or multiple frames of image.

[0045] S202, respectively dividing the historical frame image and the current frame image into image regions to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region.

[0046] If the historical frame image includes multiple images, the electronic device front-end platform can set an image region division method, and divide each historical frame image and current frame image through the image region division method, and divide each historical frame image into a plurality of first image regions and divide the current frame image into a plurality of second image regions. Since a unified division method is adopted, each first image region obtained by division has a corresponding second image region. Furthermore, there is a mutual correlation between the image regions obtained by dividing each frame of image, for example, multiple first image regions in the same historical frame image have an arrangement relationship; the first block of first image regions in the historical frame image obtained by the same division method is one-to-one corresponding to the first block of second image regions in the current image frame; in this way, it is beneficial to compare the image regions frame by frame to facilitate comparison of the differences between each first image region and / or second image region, thereby facilitating accurate positioning of the change parameter.

[0047] For example, the historical frame image and / or the current frame image can be divided into 4 image regions, and each image region has the same size.

[0048] S203, comparing the plurality of first image regions and the plurality of second image regions to determine the change parameter corresponding to the plurality of first image regions and / or the plurality of second image regions.

[0049] If the historical frame image only includes one image, it indicates that the historical frame image is adjacent to the current frame image, and the plurality of second image regions of the current frame image and the plurality of first image regions of the historical frame image adjacent to the current frame image can be compared, so as to determine the change parameters corresponding to the plurality of first image regions and / or the plurality of second image regions.

[0050] If the historical frame image includes a plurality of historical frame images, that is, the plurality of historical frame images are continuous image frames, the plurality of historical frame images and the current frame image can be arranged according to the time of shooting, and the adjacent two frame images can be compared respectively, so as to further determine the change parameters corresponding to the plurality of first image regions and the plurality of second image regions.

[0051] The change parameter can be used to indicate the change range of the image features corresponding to the object in the image within a certain time, for example, can be used to indicate the change distance or relative displacement of the same object corresponding to the pixel points in the first image region and / or the second image region corresponding to the adjacent two historical frame images or the current frame image and the adjacent historical frame image.

[0052] The change parameter can be understood as an evaluation index, which can be used to evaluate the change trend of the object in the image within a certain time.

[0053] For example, when the relative displacement of the adjacent two frame images is larger, the change of the change parameters corresponding to the plurality of first image regions and / or the plurality of second image regions is determined to be larger.

[0054] S204, according to the change parameter, the current frame image is segmented to obtain a high change region and a low change region corresponding to the current frame image.

[0055] The high change region and the low change region are a relative concept, that is, the high change region can exist relative to the low change region.

[0056] The change parameter is used to evaluate the change trend of the object in the current frame image, when the change trend is severe or the change value corresponding to the change parameter reaches a certain threshold, it can be determined that the region corresponding to the object is a high change region, otherwise, it can be determined as a low change region.

[0057] S205, the image data corresponding to the high change region is transmitted to the back-end platform of the electronic device, wherein the high change region is used for the back-end platform to fuse the target image according to the historical frame image, and the target image corresponds to the current frame image.

[0058] In this process, the electronic device can transmit the aforementioned high-variability areas to the backend platform. That is, for each frame of the image captured in real time, the corresponding high-variability areas need to be transmitted to the backend platform, but the image data corresponding to the low-variability areas are not transmitted.

[0059] It should be noted that after the transmission of the high-variability region corresponding to the current frame image is complete, this current frame image can be stored as a new historical frame image. This is convenient for comparison with the current frame image captured in real time in the next frame to obtain historical frame images with varying parameters. Of course, the backend platform can also obtain this new historical frame image as well as any historical frame image before the capture time of this historical frame image; this part is resource-shared.

[0060] In addition, for areas with low volatility, frame skipping or frame jumping transmission can be performed depending on the actual situation.

[0061] For example, such as Figure 3 The diagram illustrates the division of the variable region. As shown, this variable region can include a high-variability region, a low-variability region, and a background region. The background region is distinct from the high-variability and low-variability regions. After determining the high-variability and low-variability regions on the electronic device's front-end platform, the other regions can be designated as the background region. Generally, objects within the high-variability region can change, while objects within the low-variability region show less change relative to the high-variability region. The high-variability region may or may not partially overlap with the low-variability region. The specific division method is determined based on the variation parameters and is not limited here.

[0062] As can be seen, in this example, only the high-variable region corresponding to the current frame image is transmitted to the back-end platform. The back-end platform then merges the high-variable region with the background region in the historical frame image and / or the low-variable region obtained from the previous transmission by the front-end platform, based on the historical frame images, to obtain the target image corresponding to the current frame image. This helps to reduce the system's image transmission and processing pressure, improve the system's image data transmission and processing efficiency, and save the system's power consumption.

[0063] It can be seen that the image transmission processing method described in the embodiments of the present application acquires a historical frame image; respectively divides image regions of the historical frame image and a current frame image to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region; compares the plurality of first image regions and the plurality of second image regions to determine a variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions; according to the variation parameter, divides the current frame image to obtain a high-variation region and a low-variation region corresponding to the current frame image; and transmits image data corresponding to the high-variation region to a back-end platform of the electronic device, wherein the high-variation region is used by the back-end platform to fuse a target image according to the historical frame image, and the target image corresponds to the current frame image. In this way, by using the characteristics that the front-end platform of the electronic device can preferentially obtain image data and quickly process, the variation parameters of different regions of the current frame image can be determined at the front-end platform of the electronic device, the high-variation region and the low-variation region of the current frame image are divided according to the variation parameters, and only the high-variation region is transmitted to the back-end platform, and then the target image corresponding to the current frame image is obtained by fusion processing of the back-end platform, which is beneficial to reducing the system image transmission processing pressure, improving the system image data transmission processing efficiency, saving the system power consumption, and better adapting to the shooting requirements of high-frame-rate shooting scenes.

[0064] In one possible example, the comparison of the plurality of first image regions and the plurality of second image regions to determine the variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions can include the following steps: respectively determining a first image feature of each first image region and a second image feature of each second image region; and determining the variation parameter of the plurality of first image regions and / or the plurality of second image regions according to the each first image feature and the each second image feature.

[0065] The image feature can include at least one of a feature for representing an outer boundary or contour of an object in an image, a feature for representing a spatial relationship between objects in an image, and the like, which are not limited herein. The object can refer to a shooting target in a captured image, an object appearing in an image, and the like, which are not limited herein. The image feature can be obtained by identifying feature points in an image and analyzing.

[0066] The spatial relationship can include at least one of a relative position, a relative direction, and the like, without limitation; the connection relationship, the containing relationship, the overlapping relationship, and the like, can be determined according to the relative position and the relative direction, without limitation; the connection relationship can be a connection or adjacency relationship, the overlapping relationship can be an intersection or overlapping relationship, and the containing relationship can include a containing or encompassing relationship.

[0067] Each first image region can correspond to a first image feature, and each second image region can correspond to a second image feature.

[0068] In a specific implementation, the same object in each first image region and the corresponding second image region can be located according to a feature of an external or contour of the object included in the image feature, and the displacement of the pixel point of the same object moving between the first image region and the second image region can be determined according to the relative position between the objects, that is, the variation parameter.

[0069] It can be seen that in the present example, the variation parameters of the plurality of first image regions and / or second image regions can be determined by determining the first image feature of each first image region and the second image feature of each second image region, respectively; in this way, the image features and the change trend of different regions in the entire image are identified and analyzed based on the feature points; this is advantageous for subsequent differential segmentation to obtain the high-variation region and the low-variation region in the current frame image according to the variation parameters, and is advantageous for improving the segmentation accuracy.

[0070] Optionally, when the current frame image is re-segmented according to the variation parameters to obtain the high-variation region and the low-variation region, the first target image feature and the second target image feature corresponding to the high-variation region and the low-variation region can also be determined according to the image features of each first image region and each second image region, and the spatial relationship of the high-variation region and the low-variation region can be determined according to the first target image feature and the second target image feature, for example, as shown in Figure 3 The high-variation region and the low-variation region are in an overlapping relationship; further, the image frame after segmentation, the image data corresponding to the high-variation region, and the image data corresponding to the low-variation region can be obtained by segmenting the current image frame according to the spatial relationship.

[0071] In one possible example, determining the variation parameter of the first image region and / or the second image region according to the image features of the first image region and the second image region can include the following steps: determining a selected reference feature point and / or a reference region of each first image region according to the first image feature and the second image feature; determining the variation trend of the reference feature point and / or the reference region between each first image region and the second image region corresponding to the first image region, to obtain the variation parameter corresponding to each first image region and / or second image region.

[0072] In the embodiments of the present application, the current image frame is compared with the previous frame historical image frame.

[0073] In the embodiments of the present application, the current image frame is compared with the previous frame historical image frame.

[0074] In the embodiments of the present application, the current image frame is compared with the previous frame historical image frame.

[0075] It should be noted that for the first image region, the selected reference feature point and / or reference region can be multiple, and according to the connection relationship between the first image region and the first image region, each first image region and the corresponding second image region are compared one by one.

[0076] It can be seen that in the present example, the reference feature point and / or the reference region can be selected, the reference region is located in the first image region, and the variation parameters of the first image region and / or the second image region are determined according to the multiple reference feature points, so that the variation parameters of the image region can be obtained more accurately, which is beneficial to accurately segment the current frame image according to the variation parameters in the subsequent process, to obtain the high variation region and the low variation region corresponding to the current frame image.

[0077] It should be noted that when the variation parameter is obtained by comparing the image regions, if the historical frame images include multiple, the same way as described above can also be used, that is, each frame of historical frame image is compared with another frame of historical frame image or the current frame image according to the shooting time, and then the change trend of the same object in a certain time is obtained, so as to further obtain the variation parameter; the specific comparison mode is not repeated here.

[0078] In one possible example, after the current frame image is divided according to the variation parameter, the above method further includes the following steps: determining the background region corresponding to the current frame image; determining whether the image data corresponding to the low variation region and / or the background region needs to be transmitted; if it is determined that the image data corresponding to the low variation region and / or the background region needs to be transmitted, determining a first transmission strategy corresponding to the low variation region and the background region, and / or a second transmission strategy corresponding to the background region; transmitting the image data corresponding to the low variation region to the back-end platform according to the first transmission strategy, and / or transmitting the image data corresponding to the background region to the back-end platform according to the second transmission strategy.

[0079] Among them, the first transmission strategy can be the same as or different from the second transmission strategy; the first transmission strategy can be used for transmitting the image data corresponding to the low variation region, and the second transmission strategy can be used for transmitting the image data corresponding to the background region; when the variation trends corresponding to the variation parameters corresponding to the low variation region and the high variation region both satisfy the preset transmission condition, it can be determined that the first transmission strategy is the same as the second transmission strategy, otherwise, they are different.

[0080] Among them, the first transmission strategy and / or the second transmission strategy can be used to indicate the transmission mode of transmitting the low variation region and / or the background region, for example, it can be frame skipping transmission, frame skipping transmission, etc. Alternatively, the single image component corresponding to the low variation region and / or the background region can be selectively transmitted alternately. The specific transmission strategy is not limited here.

[0081] It can be seen that in the present example, the image data corresponding to the low variation region and / or the background region can be adaptively transmitted when it needs to be transmitted, which can also reduce the transmission and processing pressure of the system on the basis of ensuring the processing effect.

[0082] In one possible example, the dividing the current frame image according to the variation parameter to obtain the high variation region and the low variation region corresponding to the current frame image can include the following steps: when the variation parameter corresponding to any of the second image regions is greater than a first preset threshold, the second image region is divided according to the variation parameter to obtain the high variation region; when the variation parameter corresponding to any of the second image regions is less than or equal to the first preset threshold and greater than a second preset threshold, the second image region is divided according to the variation parameter to obtain the low variation region, wherein the first preset threshold is greater than the second preset threshold; and the region of any of the second image regions except the high variation region and the low variation region is determined as the background region.

[0083] The first preset threshold and / or the second preset threshold can be preset by the system or set by the user, and specifically, the first preset threshold can be greater than the second preset threshold.

[0084] In a specific implementation, each of the second image regions in the current frame image can be compared one by one according to the variation parameter, and the variation parameter and the first preset threshold and / or the second preset threshold can be compared to redivide the second image region, the region where the image feature corresponding to the variation parameter greater than the first preset threshold is located is divided into the high variation region to obtain at least one high variation region corresponding to the current frame image, and the region where the image feature corresponding to the variation parameter less than or equal to the first preset threshold and greater than the second preset threshold is located is divided into the low variation region to obtain at least one low variation region corresponding to the current frame image, and the other region except the high variation region and / or the low variation region is determined as the background region. Of course, if there is no variation parameter less than or equal to the first preset threshold and greater than the second preset threshold, it can be indicated that the current frame image only includes the high variation region and the background region.

[0085] It can be seen that in the example, the variation parameter can be evaluated according to the first preset threshold and / or the second preset threshold, the current frame image is redivided or segmented according to the variation parameter to obtain the high variation region, the low variation region and the background region, which is beneficial to subsequent differential transmission of image data, and in particular for a high frame rate shooting scene, the image transmission method described in the application can be used in the case that the system transmission processing performance is limited, that is, the image data corresponding to the high variation region, the low variation region and the background region is differentially transmitted, which is beneficial to improving the image data transmission processing efficiency, reducing the transmission processing pressure of the system, thus saving the power consumption of the system and realizing the shooting demand of high frame rate.

[0086] Optionally, the electronic device front-end platform can also cache the current frame image as a historical frame image for comparison with the next frame image.

[0087] In a possible example, the determining whether the image data corresponding to the low-variation region and / or the background region needs to be transmitted can include the following steps: determining a difference value of a variation parameter between the low-variation region and / or the background region corresponding to each two frames of images in the previous N frames of images, to obtain N difference values; and determining a difference value of a variation parameter between the low-variation region and / or the background region corresponding to each two frames of images in the previous M frames of images, to obtain M difference values, where N is a positive integer greater than or equal to 1, M is a positive integer less than or equal to N, and the previous N frames of images include the historical frame of image and the current frame of image; determining a first average value between the N difference values and a second average value between the M difference values; if the first average value is greater than or equal to a third preset threshold value, or the first average value is less than the third preset threshold value and the second average value is greater than or equal to the third preset threshold value, it is determined that the low-variation region and / or the background region needs to be transmitted; and if the first average value is less than the third preset threshold value and the second average value is less than the third preset threshold value, it is determined that the low-variation region and / or the background region does not need to be transmitted.

[0088] wherein N is a positive integer greater than or equal to 1, and M is a positive integer less than N; when N is 1, M is 1. The third preset threshold value can be set by a user or by default of the system, and is not limited herein; the third preset threshold value can be used to evaluate whether the low-variation region and / or the background region needs to be transmitted. The previous N frames of images are images with continuous shooting times, and the previous M frames of images and the previous N frames of images both include the current frame of image.

[0089] wherein the third preset threshold value can be used to define a transmission requirement of transmitting the low-variation region and / or the background region. The first average value and / or the second average value are both used to represent an evaluation of a variation trend of the low-variation region and / or the background region.

[0090] wherein the high-variation region and / or the background region and / or the low-variation region are used for the target image corresponding to the current frame of image to be obtained by the back-end platform according to the historical frame of image.

[0091] For example, if N is 5 and M is 3, the first 5 frames of images including the current frame of image are determined, the variation parameters of the low variation region corresponding to each two consecutive frames of the first 5 frames of images are determined, and the difference between the variation parameters of the two low variation regions is obtained, 5 difference values are obtained, the average of the 5 difference values is calculated, and the first average is obtained. The variation parameters of the low variation region corresponding to each two consecutive frames of the first 3 frames of images including the current frame of image are determined, the difference between the variation parameters of the two low variation regions is obtained, 3 difference values are obtained, the average of the 3 difference values is calculated, and the second average is obtained. If the variation trend of the low variation region of the first 5 consecutive frames is that the first average is less than the third preset threshold, the low variation region can be transmitted once when the variation trend of the 3 frames of images reaches the transmission requirement, that is, the second average is greater than the third preset threshold.

[0092] Further, when the first average is greater than or equal to the third preset threshold, it indicates that the variation trend of the 5 frames of images changes, that is, the low variation region needs to be transmitted. If the first average and the second average are both less than the third preset threshold, it indicates that the variation trend of the first 5 frames of images and the first 3 frames of images is not large, and the low variation region does not need to be transmitted.

[0093] It can be seen that in the present example, when the historical frame of image stored by the front-end platform is large, when determining whether the image data corresponding to the low variation region and / or the background region needs to be transmitted, the first N frames of images can be compared to determine the variation trend of the low variation region, and when it is determined that the variation is not large, the variation trend of the low variation region corresponding to the first M frames of images can be further determined to further determine whether transmission is needed. In this way, in the present embodiment, when the image data is subjected to differential transmission processing, the differential transmission can be simply based on the judgment of the image content and the variation, that is, the real-time transmission processing is performed only when the variation trend of the variation parameter meets the transmission condition, which is beneficial to differential processing of the image data and meets different shooting scenes, and is beneficial to reducing the transmission and processing pressure of the system on the basis of ensuring the processing effect.

[0094] It should be noted that in the present embodiment, the variation trend of the low variation region and / or the background region can also be evaluated by other indicators or methods, which is the same as the above-mentioned method of determining whether the low variation region and / or the background region needs to be transmitted, and will not be described again.

[0095] Please refer to Figure 4 , Figure 4 is an interactive schematic diagram of an image data transmission method provided by the present embodiment, applied to an electronic device, and the electronic device includes a front-end platform and a back-end platform. As shown in the figure, the image data transmission method includes the following operations.

[0096] S401, the front-end platform acquires historical frame images.

[0097] S402, the front-end platform divides the history frame image and the current frame image respectively to obtain a plurality of first image regions corresponding to the history frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region.

[0098] S403, the front-end platform compares the plurality of first image regions and the plurality of second image regions to determine the variation parameters corresponding to the plurality of first image regions and / or the plurality of second image regions.

[0099] S404, the front-end platform divides the current frame image according to the variation parameters to obtain a high variation region, a low variation region and a background region corresponding to the current frame image.

[0100] S405, the front-end platform transmits the image data corresponding to the high variation region to the back-end platform of the electronic device.

[0101] S406, the front-end platform determines whether the image data corresponding to the low variation region and / or the background region needs to be transmitted.

[0102] S407, if the front-end platform determines that the image data corresponding to the low variation region and / or the background region needs to be transmitted, the front-end platform determines a first transmission strategy corresponding to the low variation region and the background region, and / or a second transmission strategy corresponding to the background region.

[0103] S408, the front-end platform transmits the image data corresponding to the low variation region to the back-end platform according to the first transmission strategy, and / or transmits the image data corresponding to the background region to the back-end platform according to the second transmission strategy, wherein the high variation region and / or the background region and / or the low variation region are used by the back-end platform to fuse the target image according to the history frame image, and the target image corresponds to the current frame image.

[0104] S409, the back-end platform receives the high variation region and / or the background region and / or the low variation region, and fuses the high variation region and / or the background region and / or the low variation region according to the history frame image to obtain the target image.

[0105] In one possible example, the back-end platform of the electronic device is further configured to fuse the received low variation region and the high variation region to obtain a target image, and cache the received low variation region, and replace the historical cached low variation region with the newly received low variation region.

[0106] In the case of receiving a low-variation region, the received low-variation region and the high-variation region are fused to obtain a target image corresponding to the current frame image.

[0107] The low-variation region stored in the history buffer is replaced by a newly received low-variation region corresponding to the current frame.

[0108] In this example, when the low-variation region is received, the received low-variation region and the high-variation region are fused to obtain a target image, and the low-variation region stored in the history buffer is replaced by a newly received low-variation region corresponding to the current frame, and the history frame image used to fuse the target image is updated, which is beneficial to guarantee the integrity of image data transmission and the effect of system image data transmission.

[0109] In one possible example, for a single-camera scene, the back-end platform of the electronic device is further configured to perform smoothing processing on the target image.

[0110] The smoothing processing is performed on the splicing part of the fused target image to avoid the splicing part being conspicuous.

[0111] In this example, in the single-camera scene, the back-end platform performs smoothing processing on the splicing part of the fused target image, which is beneficial to make the target image more flat and natural, and guarantee the effect of system image data transmission.

[0112] In one possible example, for a dual-camera scene, if the electronic device is applied to a dual-camera scene, the electronic device includes a main camera and a sub-camera, and the image data includes image data corresponding to the main camera and image data corresponding to the sub-camera; the above method further includes the following steps: transmitting the image data corresponding to the main camera to the back-end platform of the electronic device; determining the high-variation region, the low-variation region, and the background region corresponding to the image data corresponding to the sub-camera according to the variation parameter, and transmitting the image data corresponding to the high-variation region to the back-end platform; and when it is determined that the image data corresponding to the low-variation region and / or the background region needs to be transmitted, determining a first transmission strategy corresponding to the low-variation region and the background region, and / or a second transmission strategy corresponding to the background region according to the determination; transmitting the image data corresponding to the low-variation region to the back-end platform according to the first transmission strategy, and / or transmitting the image data corresponding to the background region to the back-end platform according to the second transmission strategy.

[0113] It can be seen that in the example, only the sub-camera image adopts the image data transmission method, the main camera image does not adopt the image data transmission method, each frame of image is completely transmitted, or the current frame of image can also be divided by smaller first preset threshold and second preset threshold to obtain the high variation region, low variation region and background region corresponding to the current frame.

[0114] The steps S401-S406 described above can be referred to Figure 2 The steps S201-S205 in the described image data transmission method and the related description thereof will not be repeated here.

[0115] It can be seen that the image transmission processing method described in the embodiments of the application, the electronic device front-end platform acquires historical frame images; the front-end platform respectively divides the image regions of the historical frame images and the current frame image to obtain a plurality of first image regions corresponding to the historical frame images and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region; the front-end platform compares the plurality of first image regions and the plurality of second image regions to determine the change parameters corresponding to the plurality of first image regions and / or the plurality of second image regions; the front-end platform splits the current frame image according to the change parameters to obtain a high-change region, a low-change region and a background region corresponding to the current frame image; the front-end platform transmits image data corresponding to the high-change region to the back-end platform of the electronic device; the front-end platform determines whether it is necessary to transmit image data corresponding to the low-change region and / or the background region; if the front-end platform determines that it is necessary to transmit image data corresponding to the low-change region and / or the background region, the front-end platform determines a first transmission strategy corresponding to the low-change region and the background region and / or a second transmission strategy corresponding to the background region; the front-end platform transmits image data corresponding to the low-change region to the back-end platform according to the first transmission strategy and / or transmits image data corresponding to the background region to the back-end platform according to the second transmission strategy, wherein the high-change region and / or the background region and / or the low-change region are used by the back-end platform to fuse the historical frame images to obtain a target image corresponding to the current frame image; the back-end platform receives the high-change region and / or the background region and / or the low-change region and fuses the high-change region and / or the background region and / or the low-change region according to the historical frame images to obtain a target image; in this way, by using the characteristics that the electronic device front-end platform can quickly process image data, the change parameters of different regions of the current frame image can be determined by the electronic device front-end platform, the high-change region and the low-change region of the current frame image can be split according to the change parameters, the high-change region is transmitted to the back-end platform, and then it is determined whether it is necessary to transmit the low-change region and / or the background region, so as to realize differential transmission processing of image data. Finally, the target image corresponding to the current frame image is obtained by the back-end platform according to the historical frame images, in combination with the high-change region and / or the low-change region and / or the background region, and fusion processing, which is beneficial to reducing the system image transmission processing pressure, improving the system image data transmission processing efficiency, and saving the system power consumption.

[0116] Please refer to Figure 5 , Figure 5A structure schematic diagram of an electronic device is provided in the embodiments of the present application, as shown in the figure, the electronic device comprises a processor, a memory, a communication interface and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to instruct the processor to perform the following steps:

[0117] Obtaining a historical frame image;

[0118] Dividing the historical frame image and the current frame image into image regions respectively to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region;

[0119] Comparing the plurality of first image regions and the plurality of second image regions to determine a variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions;

[0120] Segmenting the current frame image according to the variation parameter to obtain a high variation region and a low variation region corresponding to the current frame image;

[0121] Transmitting image data corresponding to the high variation region to a back-end platform of the electronic device, wherein the high variation region is used by the back-end platform to fuse a target image according to the historical frame image, and the target image corresponds to the current frame image.

[0122] It can be seen that the image transmission processing method described in the embodiment of the application acquires a historical frame image; image regions of the historical frame image and a current frame image are divided respectively to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region; the plurality of first image regions and the plurality of second image regions are compared to determine a variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions; the current frame image is segmented according to the variation parameter to obtain a high-variation region and a low-variation region corresponding to the current frame image; image data corresponding to the high-variation region is transmitted to a back-end platform of the electronic device, wherein the high-variation region is used by the back-end platform to fuse the target image corresponding to the current frame image according to the historical frame image. In this way, by using the characteristics that the front-end platform of the electronic device can preferentially obtain image data and quickly process, the variation parameters of different regions of the current frame image can be determined at the front-end platform of the electronic device, the high-variation region and the low-variation region of the current frame image are segmented according to the variation parameters, and only the high-variation region is transmitted to the back-end platform, and then the target image corresponding to the current frame image is obtained by the back-end platform through fusion processing. This is conducive to reducing the system image transmission processing pressure, improving the system image data transmission processing efficiency, saving the system power consumption, and better adapting to the shooting requirements of high-frame-rate shooting scenes.

[0123] In one possible example, in the aspect of comparing the plurality of first image regions and the plurality of second image regions to determine the variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions, the above program includes instructions for performing the following steps:

[0124] determining a first image feature of each first image region and a second image feature of each second image region;

[0125] determining the variation parameter of the plurality of first image regions and / or the plurality of second image regions according to the first image feature and the second image feature.

[0126] In one possible example, in the aspect of determining the variation parameter of each first image region and / or the second image region according to the first image feature and the second image feature, the above program includes instructions for performing the following steps:

[0127] determining a selected reference feature point and / or a reference region of each first image region according to the first image feature and the second image feature;

[0128] determining a variation trend of the reference feature point and / or the reference region between each of the first image region and the second image region corresponding to the first image region, to obtain a variation parameter corresponding to each of the first image region and / or the second image region.

[0129] In one possible example, after the current frame image is segmented according to the variation parameter, the above program further includes instructions for performing the following steps:

[0130] determining a background region corresponding to the current frame image;

[0131] determining whether image data corresponding to the low variation region and / or the background region needs to be transmitted;

[0132] if it is determined that the image data corresponding to the low variation region and / or the background region needs to be transmitted, determining a first transmission strategy corresponding to the low variation region and the background region, and / or a second transmission strategy corresponding to the background region;

[0133] transmitting the image data corresponding to the low variation region to the backend platform according to the first transmission strategy, and / or

[0134] transmitting the image data corresponding to the background region to the backend platform according to the second transmission strategy.

[0135] In one possible example, in terms of segmenting the current frame image according to the variation parameter to obtain a high variation region and a low variation region corresponding to the current frame image, the above program includes instructions for performing the following steps:

[0136] when the variation parameter corresponding to any of the second image regions is greater than a first preset threshold, segmenting the second image region according to the variation parameter to obtain the high variation region;

[0137] when the variation parameter corresponding to any of the second image regions is less than or equal to the first preset threshold and greater than a second preset threshold, segmenting the second image region according to the variation parameter to obtain the low variation region, wherein the first preset threshold is greater than the second preset threshold;

[0138] determining a region excluding the high variation region and the low variation region in any of the second image regions as the background region.

[0139] In one possible example, in terms of determining whether image data corresponding to the low variation region and / or the background region needs to be transmitted, the above program includes instructions for performing the following steps:

[0140] determining a difference value between the variation parameters of the low variation region and / or the background region corresponding to each two frames of the N previous frames of images, to obtain N difference values, and determining a difference value between the variation parameters of the low variation region and / or the background region corresponding to each two frames of the M previous frames of images, to obtain M difference values, wherein N is a positive integer greater than or equal to 1, M is a positive integer less than or equal to N, and the N previous frames of images include the historical frame of image and the current frame of image;

[0141] determining a first average value between the N difference values and a second average value between the M difference values;

[0142] if the first average value is greater than or equal to a third preset threshold value, or the first average value is less than the third preset threshold value and the second average value is greater than or equal to the third preset threshold value, it is determined that the low variation region and / or the background region needs to be transmitted;

[0143] if the first average value is less than the third preset threshold value and the second average value is less than the third preset threshold value, it is determined that the low variation region and / or the background region does not need to be transmitted.

[0144] In one possible example, if the electronic device is applied to a dual-camera scene, the electronic device includes a main camera and a sub-camera, and the image data includes image data corresponding to the main camera and image data corresponding to the sub-camera; the above program further includes instructions for performing the following steps:

[0145] transmitting the image data corresponding to the main camera to the back-end platform; and determining the high variation region, the low variation region and the background region corresponding to the image data corresponding to the sub-camera according to the variation parameter, and transmitting the image data corresponding to the high variation region to the back-end platform, and when it is determined that the image data corresponding to the low variation region and / or the background region needs to be transmitted, determining a first transmission strategy corresponding to the low variation region and the background region, and / or a second transmission strategy corresponding to the background region according to the determination; transmitting the image data corresponding to the low variation region to the back-end platform according to the first transmission strategy, and / or transmitting the image data corresponding to the background region to the back-end platform according to the second transmission strategy.

[0146] In one possible example, the back-end platform is further configured to fuse the received low variation region and high variation region to obtain a target image, and cache the received low variation region, and replace the historically cached low variation region with the low variation region.

[0147] The above describes the scheme of the embodiments of the present application mainly from the perspective of the process of executing the method. It can be understood that, in order to implement the above functions, the electronic device comprises hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in the form of hardware or computer software driving hardware depends on the specific application of the technical solution and the design constraint conditions. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0148] The embodiments of the present application can divide the functional units of the electronic device according to the above method examples. For example, each functional unit can be divided corresponding to each function, or two or more functions can be integrated in one processing unit. The integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical functional division. Actual implementation can have another division manner.

[0149] In the case of dividing each functional module corresponding to each function, Figure 6 In addition to the schematic diagram of the image data transmission device, as shown in the figure, Figure 6 The image data transmission device 600 can comprise an acquisition unit 601, a region division unit 602, a determination unit 603, a segmentation unit 604 and a transmission unit 605, wherein,

[0150] The acquisition unit 601 is configured to acquire historical frame images;

[0151] The region division unit 602 respectively divides the historical frame images and the current frame images into image regions to obtain a plurality of first image regions corresponding to the historical frame images and a plurality of second image regions corresponding to the current frame images, wherein each first image region corresponds to a second image region;

[0152] The determination unit 603 compares the plurality of first image regions and the plurality of second image regions to determine a variation parameter corresponding to the plurality of first image regions and / or the plurality of second image regions;

[0153] The segmentation unit 604 segments the current frame image according to the variation parameter to obtain a high variation region and a low variation region corresponding to the current frame image;

[0154] The transmission unit 605 transmits image data corresponding to the high-variation region to a back-end platform of the electronic device, wherein the high-variation region is used by the back-end platform to fuse the historical frame image to obtain a target image corresponding to the current frame image.

[0155] It can be seen that the image transmission processing apparatus described in the embodiments of the present application acquires historical frame images; divides the historical frame images and a current frame image into image regions respectively to obtain a plurality of first image regions corresponding to the historical frame images and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region; compares the plurality of first image regions and the plurality of second image regions to determine variation parameters corresponding to the plurality of first image regions and / or the plurality of second image regions; segments the current frame image according to the variation parameters to obtain a high-variation region and a low-variation region corresponding to the current frame image; and transmits image data corresponding to the high-variation region to a back-end platform of the electronic device, wherein the high-variation region is used by the back-end platform to fuse the historical frame image to obtain a target image corresponding to the current frame image. In this way, by taking advantage of the characteristics of the front-end platform of the electronic device that can obtain image data in priority and process quickly, the variation parameters of different regions of the current frame image can be determined at the front-end platform of the electronic device, the high-variation region and the low-variation region of the current frame image can be segmented according to the variation parameters, and only the high-variation region is transmitted to the back-end platform, and then the back-end platform fuses and processes to obtain a target image corresponding to the current frame image, which is conducive to reducing the image transmission processing pressure of the system, improving the image data transmission processing efficiency of the system, saving the power consumption of the system, and better adapting to the shooting requirements of high-frame-rate shooting scenarios.

[0156] In one possible example, in the aspect of comparing the plurality of first image regions and the plurality of second image regions to determine variation parameters corresponding to the plurality of first image regions and / or the plurality of second image regions, the determination unit 603 is specifically configured to:

[0157] determine a first image feature of each first image region and a second image feature of each second image region;

[0158] determine variation parameters of the plurality of first image regions and / or the plurality of second image regions according to the first image feature and the second image feature.

[0159] In one possible example, in the aspect of determining variation parameters of each first image region and / or each second image region according to the first image feature and the second image feature, the determination unit 603 is specifically configured to:

[0160] determining a selected reference feature point and / or a reference region for each of the first image regions according to the first image feature and the second image feature;

[0161] determining a variation trend of the reference feature point and / or the reference region between each of the first image regions and the second image region corresponding to the first image region, to obtain a variation parameter corresponding to each of the first image region and / or the second image region.

[0162] In one possible example, after the current frame image is segmented according to the variation parameter, the determining unit 603 is specifically configured to:

[0163] determining a background region corresponding to the current frame image;

[0164] determining whether image data corresponding to the low-variation region and / or the background region needs to be transmitted;

[0165] if it is determined that the image data corresponding to the low-variation region and / or the background region needs to be transmitted, determining a first transmission strategy corresponding to the low-variation region and the background region, and / or a second transmission strategy corresponding to the background region;

[0166] transmitting the image data corresponding to the low-variation region to the backend platform according to the first transmission strategy, and / or

[0167] transmitting the image data corresponding to the background region to the backend platform according to the second transmission strategy.

[0168] In one possible example, in terms of segmenting the current frame image to obtain a high-variation region and a low-variation region corresponding to the current frame image according to the variation parameter, the segmenting unit 604 is specifically configured to:

[0169] when the variation parameter corresponding to any of the second image regions is greater than a first preset threshold, segmenting the second image region according to the variation parameter to obtain the high-variation region;

[0170] when the variation parameter corresponding to any of the second image regions is less than or equal to the first preset threshold and greater than a second preset threshold, segmenting the second image region according to the variation parameter to obtain the low-variation region, wherein the first preset threshold is greater than the second preset threshold;

[0171] determining a region excluding the high-variation region and the low-variation region in any of the second image regions as the background region.

[0172] In a possible example, in the determining whether the image data corresponding to the low-variation region and / or the background region needs to be transmitted, the determining unit 603 is specifically configured to:

[0173] determine a difference value between the variation parameters of the low-variation region and / or the background region corresponding to each two images in the previous N images, to obtain N difference values, and determine a difference value between the variation parameters of the low-variation region and / or the background region corresponding to each two images in the previous M images, to obtain M difference values, wherein N is a positive integer greater than or equal to 1, M is a positive integer less than or equal to N, and the previous N images include the historical frame image and the current frame image;

[0174] determine a first average value between the N difference values and a second average value between the M difference values;

[0175] if the first average value is greater than or equal to a third preset threshold value, or the first average value is less than the third preset threshold value and the second average value is greater than or equal to the third preset threshold value, it is determined that the low-variation region and / or the background region needs to be transmitted;

[0176] if the first average value is less than the third preset threshold value and the second average value is less than the third preset threshold value, it is determined that the low-variation region and / or the background region does not need to be transmitted.

[0177] In a possible example, if the electronic device is applied to a dual-camera scene, the electronic device includes a main camera and a sub-camera, and the image data includes image data corresponding to the main camera and image data corresponding to the sub-camera; the transmitting unit 605 is specifically configured to:

[0178] transmit the image data corresponding to the main camera to the back-end platform; and determine the high-variation region, the low-variation region and the background region corresponding to the image data corresponding to the sub-camera according to the variation parameter, transmit the image data corresponding to the high-variation region to the back-end platform, and when it is determined that the image data corresponding to the low-variation region and / or the background region needs to be transmitted, determine a first transmission strategy corresponding to the low-variation region and the background region and / or a second transmission strategy corresponding to the background region according to the determination, transmit the image data corresponding to the low-variation region to the back-end platform according to the first transmission strategy, and / or transmit the image data corresponding to the background region to the back-end platform according to the second transmission strategy.

[0179] In a possible example, the back-end platform is further configured to fuse the received low-variation region and high-variation region to obtain a target image, and cache the received low-variation region, and replace the historically cached low-variation region with the low-variation region.

[0180] It should be noted that all relevant content of each step involved in the above method embodiments can be cited to the function description of the corresponding function module, and will not be repeated here.

[0181] The electronic device provided in the embodiment is used to execute the image data transmission method described above, and thus the same effects as the implementation method described above can be achieved.

[0182] In the case of using integrated units, the electronic device can include a processing module, a storage module and a communication module. The processing module can be used to control and manage the actions of the electronic device, for example, it can be used to support the electronic device to execute the steps described above. The storage module can be used to support the electronic device to execute the steps executed by the acquisition unit 601, the region division unit 602, the determination unit 603, the segmentation unit 604 and the transmission unit 605. The storage module can be used to support the electronic device to execute the storage of program codes and data, etc. The communication module can be used to support the communication between the electronic device and other electronic devices.

[0183] The processing module can be a processor or a controller. It can realize or execute various exemplary logical blocks, modules and circuits described in combination with the disclosure of the present application. The processor can also be a combination of computing functions, such as one or more microprocessor combinations, digital signal processing (DSP) and microprocessor combinations, etc. The storage module can be a memory. The communication module can be a device for interacting with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0184] The embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes a computer to execute part or all of the steps of any method described in the above method embodiments. The above computer includes an electronic device.

[0185] The embodiments of the present application also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program. The computer program can be operable to cause a computer to execute part or all of the steps of any method described in the above method embodiments. The computer program product can be a software installation package, and the above computer includes an electronic device.

[0186] It should be noted that, for the foregoing method embodiments, the sequences of the described actions are not necessarily required to achieve the objects of the application, and certain steps can be performed in other sequences or even concurrently. Additionally, the described embodiments are merely provided as examples, and not all of the actions described are necessarily required to achieve desired results.

[0187] In the above embodiments, the description of each embodiment is focused on different aspects, and the parts not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0188] In several embodiments provided in the present application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely schematic. For example, the division of the above units is merely a logical function division. In actual implementation, another division manner can be adopted. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, apparatuses or units, and can be electrical or other forms.

[0189] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0190] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0191] If the above integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer readable memory. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a memory and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the above-mentioned method of each embodiment of the present application. The aforementioned memory includes: a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0192] A person of ordinary skill in the art can understand that all or part of the steps of the various methods of the above embodiments can be completed by a program instructing relevant hardware, and the program can be stored in a computer readable memory, which can include a flash disk, a read-only memory, a random access memory, a magnetic disk or an optical disk, etc.

[0193] The embodiments of the present application are described in detail above, and the specific examples are applied to the principles and implementation modes of the present application. The above embodiment description is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed, and the above description should not be understood as a limitation of the present application.

Claims

1. An image data transmission method, applied to electronic devices, characterized in that, The method includes: Acquire historical frame images; The historical frame image and the current frame image are divided into image regions respectively to obtain multiple first image regions corresponding to the historical frame image and multiple second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region; By comparing the plurality of first image regions and the plurality of second image regions, the variable parameters corresponding to the plurality of first image regions and / or the plurality of second image regions are determined; Based on the variation parameters, the current frame image is segmented to obtain the high variation region, low variation region and background region corresponding to the current frame image; The image data corresponding to the high-variability region is transmitted to the back-end platform of the electronic device, wherein the high-variability region is used by the back-end platform to obtain a target image based on the historical frame image, and the target image corresponds to the current frame image; The method further includes, after segmenting the current frame image according to the changing parameters: Determine whether it is necessary to transmit image data corresponding to the low-variation region and / or the background region; The step of determining whether it is necessary to transmit image data corresponding to the low-variation region and / or the background region includes: The difference in variation parameters between the low-variation region and / or background region corresponding to each two frames in the first N frames is determined to obtain N difference values; and the difference in variation parameters between the low-variation region and / or background region corresponding to each two frames relative to the first M frames is determined to obtain M difference values, where N is a positive integer greater than or equal to 1, and M is a positive integer less than N, and the first N frames include the historical frame images and the current frame image; Determine the first mean among the N differences and the second mean among the M differences; If the first mean is greater than or equal to the third preset threshold, or if the first mean is less than the third preset threshold and the second mean is greater than or equal to the third preset threshold, then it is determined that the low-variation region and / or the background region need to be transmitted. If the first average value is less than the third preset threshold, and the second average value is less than the third preset threshold, then it is determined that the low-variation region and / or the background region do not need to be transmitted.

2. The method according to claim 1, characterized in that, The step of comparing the plurality of first image regions and the plurality of second image regions to determine the variation parameters corresponding to the plurality of first image regions and / or the plurality of second image regions includes: Determine a first image feature for each of the first image regions and a second image feature for each of the second image regions; Based on each first image feature and each second image feature, the variation parameters of the plurality of first image regions and / or second image regions are determined.

3. The method according to claim 2, characterized in that, The step of determining the variation parameters of each first image region and / or second image region based on each first image feature and each second image feature includes: Based on each first image feature and each second image feature, select reference feature points and / or reference regions for each first image region; Determine the variation trend of the reference feature points and / or the reference regions between each first image region and the corresponding second image region, and obtain the variation parameters corresponding to each first image region and / or second image region.

4. The method according to claim 1 or 3, characterized in that, The method further includes: If it is determined that image data corresponding to the low-variation region and / or the background region needs to be transmitted, then a first transmission strategy corresponding to the low-variation region and the background region, or a second transmission strategy corresponding to the background region, is determined. According to the first transmission strategy, the image data corresponding to the low-variation area is transmitted to the backend platform, and / or According to the second transmission strategy, the image data corresponding to the background area is transmitted to the backend platform.

5. The method according to claim 4, characterized in that, The step of segmenting the current frame image according to the variation parameters to obtain the high variation region and low variation region corresponding to the current frame image includes: When the variation parameter corresponding to any second image region is greater than the first preset threshold, the second image region is segmented according to the variation parameter to obtain the high variation region; When the variation parameter corresponding to any second image region is less than or equal to the first preset threshold and greater than the second preset threshold, the second image region is segmented according to the variation parameter to obtain the low variation region, wherein the first preset threshold is greater than the second preset threshold; The region in any second image region excluding the high-variation region and the low-variation region is determined as the background region.

6. The method according to claim 1, characterized in that, If the electronic device is used in a dual-camera scenario, the electronic device includes a main camera and a secondary camera, and the image data includes image data corresponding to the main camera and image data corresponding to the secondary camera; the method further includes: The system transmits image data corresponding to the main camera to the backend platform; and, based on the variation parameters, determines the high-variation region, low-variation region, and background region corresponding to the image data corresponding to the secondary camera, and transmits the image data corresponding to the high-variation region to the backend platform; and, when it is determined that image data corresponding to the low-variation region and / or the background region needs to be transmitted, it transmits the image data corresponding to the low-variation region to the backend platform according to the first transmission strategy and / or the image data corresponding to the background region according to the second transmission strategy.

7. The method according to claim 6, characterized in that, The backend platform is also used to fuse the received low-variation region and the high-variation region to obtain the target image, and to cache the received low-variation region and replace the historically cached low-variation region with the low-variation region.

8. An image data transmission device, disposed in an electronic device, characterized in that, The device includes an acquisition unit, a region division unit, a determination unit, a segmentation unit, and a transmission unit, wherein, The acquisition unit is used to acquire historical frame images; The region division unit is used to divide the historical frame image and the current frame image into image regions respectively, to obtain a plurality of first image regions corresponding to the historical frame image and a plurality of second image regions corresponding to the current frame image, wherein each first image region corresponds to a second image region. The determining unit is used to compare the plurality of first image regions and the plurality of second image regions to determine the variation parameters corresponding to the plurality of first image regions and / or the plurality of second image regions; The segmentation unit is used to segment the current frame image according to the variation parameters to obtain the high variation region, low variation region and background region corresponding to the current frame image; The transmission unit is used to transmit the image data corresponding to the high-variability region to the back-end platform of the electronic device, wherein the high-variability region is used by the back-end platform to obtain a target image based on the fusion of the historical frame images, and the target image corresponds to the current frame image; Wherein, after segmenting the current frame image according to the changing parameters, the device is further specifically used for: Determine whether it is necessary to transmit image data corresponding to the low-variation region and / or the background region; The step of determining whether it is necessary to transmit image data corresponding to the low-variation region and / or the background region includes: The difference in variation parameters between the low-variation region and / or background region corresponding to each two frames in the first N frames is determined to obtain N difference values; and the difference in variation parameters between the low-variation region and / or background region corresponding to each two frames relative to the first M frames is determined to obtain M difference values, where N is a positive integer greater than or equal to 1, and M is a positive integer less than N, and the first N frames include the historical frame images and the current frame image; Determine the first mean among the N differences and the second mean among the M differences; If the first mean is greater than or equal to the third preset threshold, or if the first mean is less than the third preset threshold and the second mean is greater than or equal to the third preset threshold, then it is determined that the low-variation region and / or the background region need to be transmitted. If the first average value is less than the third preset threshold, and the second average value is less than the third preset threshold, then it is determined that the low-variation region and / or the background region do not need to be transmitted.

9. An electronic device, characterized in that, The method includes a processor, a memory, a communication interface, and one or more programs, said one or more programs being stored in the memory and configured to be executed by the processor, said programs including instructions for performing the steps of the method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, A computer program for storing electronic data interchange, wherein the computer program causes a computer to perform the method as described in any one of claims 1-7.

11. A computer program product, comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method according to any one of claims 1-7.

Images