A filling method and device of an image and an electronic device

Abstract

The application discloses a filling method and device of images and electronic equipment, and belongs to the technical field of computers. A plurality of image filling areas and a plurality of first images arranged by a preset layout mode are acquired; a first display effect and a second display effect of each image filling area filled with any different first image are determined, the second display effect being obtained after the first image is combined with at least one other first image; based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computers, and particularly relates to an image filling method and device and electronic equipment. BACKGROUND

[0002] With the rapid development of social economy, social application programs have become an indispensable social tool in people's daily life. Generally, a user selects multiple pictures to publish in the process of using a social application program.

[0003] At present, a social application program usually provides a user with some selectable picture arrangement modes. For example, multiple pictures can be arranged and spliced according to arrangement modes such as a nine-square grid. However, the above processing mode often requires the user to select a corresponding picture for each image filling area of the image with the arrangement mode of the nine-square grid and the like by means of artificial selection. In the selection process, the user needs to repeatedly switch between multiple pictures to determine the picture placed in each image filling area, which reduces the processing efficiency of the pictures. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide an image filling method, device and electronic equipment to solve the technical problem of low picture processing efficiency.

[0005] To solve the above technical problem, the embodiments of the present application are implemented as follows:

[0006] In a first aspect, the embodiments of the present application provide an image filling method, comprising:

[0007] obtaining multiple image filling areas arranged by a preset layout mode and multiple first images;

[0008] determining a first display effect and a second display effect of each image filling area filling any different first image, the second display effect being obtained by combining the first image with at least one other first image;

[0009] determining a target image corresponding to each image filling area based on the first display effect and the second display effect, and filling the determined target image corresponding to each image filling area into the corresponding image filling area.

[0010] In a second aspect, the embodiments of the present application provide an image filling device, comprising:

[0011] an acquisition module configured to obtain multiple image filling areas arranged by a preset layout mode and multiple first images;

[0012] The first determining module is configured to determine a first display effect and a second display effect obtained by filling each image filling region with any different first image, wherein the second display effect is obtained by combining the first image with at least one other first image.

[0013] The second determining module is configured to determine a target image corresponding to each image filling region based on the first display effect and the second display effect, and fill the determined target image corresponding to each image filling region into the corresponding image filling region.

[0014] In a third aspect, an electronic device is provided, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the computer program, when executed by the processor, implements the steps of the image filling method according to the first aspect.

[0015] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the image filling method according to the first aspect.

[0016] In a fifth aspect, a chip is provided, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is configured to run a program or an instruction to implement the method according to the first aspect.

[0017] The image filling method, device, and electronic device provided in the embodiments of the present application obtain a plurality of image filling regions and a plurality of first images arranged in a preset layout mode, determine a first display effect and a second display effect obtained by filling each image filling region with any different first image, wherein the second display effect is obtained by combining the first image with at least one other first image, and then determine a target image corresponding to each image filling region based on the first display effect and the second display effect, and fill the determined target image corresponding to each image filling region into the corresponding image filling region. In the embodiments of the present application, the first display effect and the second display effect obtained by filling each image filling region with any different first image are determined, and then the target image corresponding to each image filling region is determined based on the first display effect and the second display effect, and the determined target image corresponding to each image filling region is filled into the corresponding image filling region. The above process does not require multiple manual operations by the user, and the user only needs to select the preset layout mode and the plurality of first images to be filled, so as to fill the plurality of first images to be filled into the plurality of image filling regions arranged in the preset layout mode, thereby effectively improving the processing efficiency of the images. BRIEF DESCRIPTION OF DRAWINGS

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 A schematic flowchart of a first method for filling an image provided in an embodiment of this application;

[0020] Figure 2 A diagram illustrating a nine-grid layout method provided in this application embodiment;

[0021] Figure 3 A second flowchart illustrating the image filling method provided in this application embodiment;

[0022] Figure 4 A schematic diagram of a third method for filling images provided in an embodiment of this application;

[0023] Figure 5 A schematic diagram of the fourth process for the image filling method provided in the embodiments of this application;

[0024] Figure 6 A diagram illustrating a four-grid layout method provided in this application embodiment;

[0025] Figure 7 A schematic diagram of the module composition of the image filling device provided in the embodiments of this application;

[0026] Figure 8 This is a schematic diagram of a first structure of an electronic device provided in an embodiment of this application;

[0027] Figure 9 This is a schematic diagram of a second structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0028] To enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this application.

[0029] With the rapid development of society and the economy, social networking applications have become indispensable social tools in people's daily lives. Typically, users will select multiple images to post when using these applications. Currently, social networking applications usually offer users several image arrangement options, such as arranging and stitching multiple images in a grid or similar pattern. However, this often requires users to manually select the corresponding image for each image filling area within the grid or similar arrangement. This selection process necessitates switching between multiple images to determine the placement of each image in the filling area, reducing processing efficiency. Based on this, embodiments of this application provide an image filling method, apparatus, and electronic device. In the embodiments provided in this application, in order to improve the user's image processing efficiency, firstly, a first display effect and a second display effect are obtained by filling each image filling area with any different first image. Based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined. Then, the target image corresponding to each determined image filling area is filled into the corresponding image filling area. The above process does not require multiple manual operations by the user. The user only needs to select a preset layout method and multiple first images to be filled to realize the filling of multiple first images to be filled into multiple image filling areas arranged in the corresponding preset layout method, which effectively improves the image processing efficiency.

[0030] In this embodiment of the application, the terminal device can be a smartphone, tablet computer, etc. Taking a terminal device as an example... Figure 1 This is a schematic diagram of the first flowchart of the image filling method provided in the embodiments of this application. Figure 1 The methods described above can be executed by the aforementioned terminal devices, particularly by the program modules configured within those devices, such as... Figure 1 As shown, the method includes at least the following steps:

[0031] In step S102, multiple image filling regions and multiple first images are obtained by arranging them in a preset layout.

[0032] As an example, the preset layout mode described above can be a preset jigsaw layout mode, which can include a regular layout mode formed by splicing a plurality of image filling areas, such as a nine-square layout mode, a six-square layout mode, a four-square layout mode, and the like. Alternatively, the preset jigsaw layout mode described above can also include an irregular pattern layout mode formed by splicing a plurality of image filling areas, and the irregular pattern can be a cartoon heart pattern, a cartoon plum blossom pattern, a cartoon cat face pattern, and the like. The image filling area is an area for filling a first image, which can be displayed by filling the image filling area. The shape of the image filling area can be a regular pattern shape, or can also be an irregular pattern shape. The regular pattern shape can be a circular shape, a square shape, and the like, and the irregular pattern shape can be a five-pointed star shape, a cartoon heart shape, and the like. The embodiments of the present specification do not specifically limit the specific layout mode of the preset layout mode described above and the specific shape of the image filling area.

[0033] With the rapid development of social economy, social application programs have become an indispensable social tool in people's daily life. Generally, users will select multiple pictures to publish when using social application programs. At present, social application programs usually provide users with some selectable picture arrangement modes, for example, multiple pictures can be arranged and spliced according to arrangement modes such as nine-square. However, the above processing mode often requires the user to manually select a corresponding picture for each image filling area with a nine-square arrangement mode. In the selection process, the user needs to repeatedly switch between multiple pictures to determine the picture placed in each image filling area, which reduces the processing efficiency of the picture. Therefore, the embodiments of the present application provide a technical solution to solve the above problems. For details, please refer to the following contents.

[0034] In an optional implementation, a terminal device of a user can be installed with a certain social application program (for the sake of subsequent description, it can be referred to as a social application). The social application can be provided with a control corresponding to a preset layout mode and an image selection control. In this way, when the user needs to publish multiple images at a time, the user can select multiple first images in the image editing area corresponding to the social application by clicking the image selection control provided in the social application. At the same time, the preset layout mode can be selected in the image editing area by triggering the control corresponding to the preset layout mode. In this way, the terminal device can obtain multiple image filling areas arranged by the preset layout mode selected by the user and multiple first images selected by the user.

[0035] In step S104, a first display effect and a second display effect are determined by filling each image filling area with any different first image. The second display effect is obtained by combining the first image with at least one other first image.

[0036] In some alternative implementations, such as Figure 2 As shown, Figure 2 A 3x3 grid is arranged in a preset layout. This 3x3 grid, arranged from left to right and top to bottom, can include nine image-filled areas. The positions of these nine image-filled areas can be represented as position a, position b, position c, position d, position e, position f, position g, position h, and position k, respectively. Taking a terminal device acquiring 12 first images using the above method as an example, the different first images can be pre-filled into each of the above image-filled areas sequentially, thereby obtaining a layout diagram with 12 first images filled in each of the above image-filled areas.

[0037] Specifically, taking the image-filled area at position 'a' in the 3x3 grid as an example, the 12 images mentioned above can be sequentially filled into this area to obtain a layout of 12 first images for that area. After obtaining this layout, the terminal device can evaluate the display effect of each first image layout based on a pre-set algorithm, thereby determining the first display effect obtained by filling the image-filled area with the 12 first images. For example, the 12 images can be represented as images A, B, C, D, E, F, G, H, I, J, K, and L. The first display effects of the first images corresponding to the image-filled area (such as the image-filled area at position 'a') can be sequentially: 80%, 88%, 90%, 96%, 70%, 66%, 98%, 68%, 50%, 40%, 78%, 60%, etc. Similarly, following the above method, the first display effect corresponding to the remaining 8 image filling areas of the 3x3 grid can be determined.

[0038] As an example, the second display effect can be a combined display effect obtained by splicing at least any two first images in the plurality of first images in a preset manner. The second display effect can be determined based on one or more of a matching degree between image colors of the at least any two first images, a correlation degree between shooting scenes of the at least any two first images, and continuity of shooting times of the at least any two first images. The preset manner can be that, taking any determined image filling area (for example, position a) as a reference image, any other first image (for example, image A) is selected from the remaining plurality of first images and filled in a right image filling area (for example, position b) located on the right side of the image filling area (for example, position a); or, any other first image (for example, image A) is selected from the remaining plurality of first images and filled in a lower image filling area (for example, position d) located on the lower side of the image filling area (for example, position a), and the like. The embodiments of the present specification do not specifically limit the specific content of the method for determining the second display effect and the preset manner.

[0039] In step S106, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area.

[0040] In an optional implementation, after the terminal device determines the first display effect and the second display effect obtained by filling any different first image into each image filling area through the processing of step S104, the target display effect obtained by filling any different first image into each image filling area can be determined based on the sum of the first display effect and the second display effect, and then the target image corresponding to each image filling area is determined based on the target display effect, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area.

[0041] It should be noted that after the target image corresponding to each image filling area is determined in the above manner, the first image to be filled in the other image filling areas will not include the filled first image.

[0042] It can be seen from the technical solutions provided by the embodiments of the present specification that the image filling method, device and electronic equipment in the embodiments of the present specification obtain a plurality of image filling areas and a plurality of first images arranged by a preset layout mode, determine a first display effect and a second display effect obtained by filling any different first image in each image filling area, the second display effect is obtained by combining the first image with at least one other first image, then, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area. In the embodiments of the present application, the first display effect and the second display effect obtained by filling any different first image in each image filling area are determined, then, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area. The above process does not require multiple manual operations by the user. The user only needs to select a preset layout mode and a plurality of first images to be filled, and the plurality of first images to be filled can be filled into the plurality of image filling areas arranged by the preset layout mode, thereby effectively improving the processing efficiency of the images.

[0043] Further, as shown in Figure 3 The processing method of step S104 can be various, and an optional processing method is provided below. For details, refer to the specific processing procedures of steps S1042-S1046.

[0044] In step S1042, a first layout mode diagram obtained by pre-filling any different first image in each image filling area is determined.

[0045] In step S1044, the first layout mode diagram is input into a first preset scoring model, the image features of the first image pre-filled in the first layout mode diagram are extracted by the first preset scoring model, the image feature information of the first image is obtained, and the display effect of the first image pre-filled in the first layout mode diagram is scored based on the image feature information, to obtain the first display effect corresponding to the image filling area. The image feature information at least includes one or more of the shooting time, the shooting location, the color saturation, the exposure, the blur, and the depth of field corresponding to the first image.

[0046] As an example, the first preset scoring model can be obtained by pre-training based on a large amount of sample data. Specifically, the structure and aesthetics of the entire layout mode diagram obtained by filling any sample image in different image filling areas can be trained.

[0047] In step S1046, the second display effect obtained by filling each image filling area with any different first image is determined.

[0048] Furthermore, such as Figure 4 As shown, there are many ways to process step S1046 above. Here is another optional processing method, which can be found in the specific processing of steps S10462-S10464 below.

[0049] In step S10462, a first image pair combination is obtained, consisting of any two different first images from a plurality of first images.

[0050] In one optional implementation, when the terminal device acquires multiple first images through the processing in step S102, it can use any first image as a reference image and combine the acquired images other than the reference image in pairs according to a preset method to obtain a first image pair composed of any two first images from the multiple first images. As an example, using the above... Figure 2 For example, the above-mentioned preset method can be to fill any different first image (such as image C) as a reference image in any determined image filling area, and then select any other first image (such as image A) from the remaining multiple first images to fill the image filling area to the right of the above-mentioned image filling area (such as position e) (such as position f); or, select any other first image (such as image A) from the remaining multiple first images to fill the image filling area to the left of the above-mentioned image filling area (such as position e) (such as position d); or, select any other first image (such as image A) from the remaining multiple first images to fill the image filling area above the above-mentioned image filling area (such as position e) (such as position b); or, select any other first image (such as image A) from the remaining multiple first images to fill the image filling area below the above-mentioned image filling area (such as position e) (such as position h), etc. The embodiments in this specification do not specifically limit the specific content of the above-mentioned preset method.

[0051] In step S10464, the first image pair combination is input into the second preset scoring model. The combination dimension information of the two first images contained in the first image pair combination is determined by the second preset scoring model. The display effect of the first image pair combination is scored based on the combination dimension information to obtain the second display effect of the first image pair combination corresponding to each image filling area being filled with any different first image. The combination dimension information includes at least one or more of the following: shooting time, shooting location, image category, and image color.

[0052] As an example, the image categories can include cartoon images, landscape images, and person images, and the like. The embodiments of the present specification do not specifically limit the specific categories included in the image categories. It should be noted that the second preset scoring model and the first preset scoring model can be the same or different, and the embodiments of the present specification do not specifically limit this.

[0053] Further, in order to further improve the overall display effect after filling the plurality of first images in the image filling area according to the above-mentioned preset layout mode, as shown in Figure 5 The processing method of step S106 can be various, and an optional processing method is provided below. For details, refer to the specific processing method of steps S1062-S1066.

[0054] In step S1062, based on the first display effect and the second display effect corresponding to the first image, and the first weight corresponding to the first display effect and the second weight corresponding to the second display effect, the target display effect corresponding to the first image is determined.

[0055] In an optional implementation manner, the above-mentioned preset layout mode is a four-grid layout mode, as shown in Figure 6 The four-grid layout mode provided by the embodiments of the present specification is shown in Figure 6 Each image filling area corresponds to a position, as shown in Figure 6 The positions 1 and 2 are located at the upper left and upper right positions of the four-grid, and the positions 3 and 4 are respectively located at the lower left and lower right positions of the four-grid. The number of the plurality of first images is four, which are respectively denoted as image A, image B, image C, and image D. Taking the image filling area at the position 1 as an example, the first display effect of filling any different first image (such as image C, image B, image D, and image A) in the image filling area is respectively (90%, 80%, 70%, 50%).

[0056] In an alternative implementation, taking the first image filled in a certain image filling area as an example, for the target candidate image filled in the image filling area, the second display effect corresponding to the target candidate image can include: taking the target candidate image as a reference image, the combination matching degree of two cases obtained by filling any first image selected from the remaining three first images in the right image filling area of the image filling area and in the lower image filling area of the image filling area, that is, the second display effect can include the sum of the matching degrees of the multiple combination modes corresponding to the two-by-two first image combination. As an example, taking the above target candidate image as image C as an example, when image C is combined with image B, the second display effect obtained can be represented as: CB{Y1=8, Y2=7}; wherein Y1 can be represented as the matching degree obtained by arranging image B in the right image filling area of image C when image C is taken as a reference image, that is, the matching degree obtained by arranging image C in position 1 and image B in position 2. Y2 can be represented as the matching degree obtained by arranging image B in the lower image filling area of image C when image C is taken as a reference image, that is, the matching degree obtained by arranging image C in position 1 and image B in position 3. The second display effect of image C and image D and image A can be represented as: CD{Y1=6, Y2=5}; CA{Y1=7, Y2=4}.

[0057] Similarly, for image B, the second display effect corresponding to the first image pair combination of image B and the other remaining images can be represented as: BC{Y1=9, Y2=8}; BD{Y1=6, Y2=5}; BA{Y1=7, Y2=4}. The second display effect corresponding to the first image pair combination of image A and the other remaining images can be represented as: AB{Y1=9, Y2=8}; AC{Y1=8, Y2=7}; AD{Y1=7, Y2=3}. The second display effect corresponding to the first image pair combination of image D and the other remaining images can be represented as: DA{Y1=8, Y2=5}; DB{Y1=7, Y2=6}; DC{Y1=9, Y2=3}.

[0058] As an example, the target display effect corresponding to the first image can be determined based on a formula: S[i] = W1*X[i] + W2*Y[i j](Y1+Y2). Wherein, W1 can be represented as a first weight corresponding to the first display effect, W2 can be represented as a second weight corresponding to the second display effect, X[i] can be represented as a first display effect of a target candidate image corresponding to a current image filling area, Y[i j](Y1+Y2) can be represented as a second display effect of a combination of the first image pair corresponding to the target candidate image. Wherein, i can be represented as a target candidate image, and j can be represented as other first images matched with the target candidate image.

[0059] In an alternative implementation, for the image filling region corresponding to position 1, assuming that the value of the first weight is 2 and the value of the second weight is 1, the target display effect of image C determined by filling image C into the position 1 can be calculated as follows: S(CA) = 2*9 + (4+7)*1 = 29; S(CB) = 2*9 + (8+7)*1 = 33; S(CD) = 2*9 + (6+5)*1 = 29, so the target display effect can be S(C) = S(CA) + S(CB) + S(CD) = 91, that is, the target display effect of image C determined by filling image C into the position 1 is 91. Similarly, the target display effect of the first image (such as image B) determined by filling image B into the position 1 can be calculated as follows: S(BA) = 2*8 + (7+4)*1 = 27; S(BC) = 2*8 + (9+8)*1 = 33; S(BD) = 2*8 + (6+5)*1 = 27, so the target display effect can be S(B) = S(BA) + S(BC) + S(BD) = 87, that is, the target display effect of the first image determined by filling image B into the position 1 is 87. Similarly, the target display effect of the first image determined by filling image A into the position 1 can be calculated as follows: S(AB) = 2*7 + (9+8)*1 = 31; S(AC) = 2*7 + (7+3)*1 = 23; S(AD) = 2*7 + (8+7)*1 = 29, so the target display effect can be S(A) = S(AB) + S(AC) + S(AD) = 83, that is, the target display effect of the first image determined by filling image A into the position 1 is 83. Similarly, assuming that the target display effect of the first image determined by filling image D into the position 1 can be calculated as follows: S(DA) = 2*5 + (8+5)*1 = 23; S(DC) = 2*5 + (7+6)*1 = 23; S(DB) = 2*5 + (1+9)*1 = 20, so the target display effect can be S(A) = S(DA) + S(DC) + S(DB) = 66, that is, the target display effect of the first image determined by filling image D into the position 1 is 66.

[0060] In step S1064, based on the target display effect, the target image corresponding to each image filling region is determined.

[0061] In an alternative implementation, taking the example of the embodiment in step S1062 above, for the image filling region corresponding to position 1, assuming that the target image filling order of image A, image B, image C, and image D is S(C) > S(B) > S(A) > S(D) in descending order of the target display effect matching degrees of the first images determined at the position 1, image C can be determined as the target image to be filled at the position 1. Similarly, the target images of the image filling regions corresponding to positions 2, 3, and 4 can be determined according to the above method.

[0062] In step S1066, the target image corresponding to each determined image filling region is filled into the corresponding image filling region.

[0063] Further, the processing method of step S1066 can be various, and an alternative processing method is provided below. For details, refer to the specific processing procedures of steps B2-B4 below.

[0064] In step B2, the filling order of the image filling region is obtained.

[0065] In an alternative implementation, while the terminal device obtains the plurality of image filling regions and the plurality of first images arranged according to the preset layout mode through the processing of step S102 above, the terminal device can display the plurality of image filling regions arranged according to the preset layout mode on the display interface of the terminal device. At this time, the terminal device can receive the triggering operation of the user on the plurality of image filling regions arranged according to the preset layout mode, and determine the triggering order of the user on the plurality of image filling regions as the filling order of the image filling region. Alternatively, while the terminal device obtains the plurality of image filling regions and the plurality of first images arranged according to the preset layout mode through the processing of step S102 above, the terminal device can display the plurality of image filling regions arranged according to the preset layout mode on the display interface of the terminal device. If no triggering operation of the user on the image filling region is received within a preset time period, or if the user clicks the prompt information of not selecting the filling order displayed on the display interface within the preset time period, the filling can be performed according to a default filling order. As an example, the default filling order can be a filling order from left to right and from top to bottom, or a filling order from the center position outward. It should be noted that the specific filling order of the image filling region is not limited in the embodiments of the present disclosure.

[0066] In step B4, based on the filling order of the image filling region, the target image corresponding to each determined image filling region is sequentially filled into the corresponding image filling region.

[0067] In an optional implementation, the preset layout manner is the nine-square layout manner, and the filling sequence of the image filling areas can be, for example, from the center position, sequentially filling from inside to outside. For example, the first image corresponding to the image filling area at the center position is determined as the first image to be filled in the image filling area at the center position, and the determined first image to be filled is filled into the image filling area at the center position. Then, based on the center position, four image filling areas corresponding to the center position control are sequentially determined in the order from left to right and from top to bottom, and the first image to be filled corresponding to the determined image filling area is filled into the four image filling areas. Subsequently, the image filling areas at the four vertex positions of the nine-square are filled in the order from left to right and from top to bottom.

[0068] As can be seen from the technical solutions provided by the above embodiments of the present specification, the embodiments of the present specification acquire a plurality of image filling areas and a plurality of first images arranged through a preset layout manner, determine a first display effect and a second display effect obtained by filling any different first image into each image filling area, the second display effect is obtained by combining the first image with at least one other first image, then, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area. In the embodiments of the present application, the first display effect and the second display effect obtained by filling any different first image into each image filling area are determined, then, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the determined target image corresponding to each image filling area is filled into the corresponding image filling area. The above process does not require multiple manual operations by the user. The user only needs to select a preset layout manner and a plurality of first images to be filled, and the plurality of first images to be filled can be filled into a plurality of image filling areas arranged in the corresponding preset layout manner, thereby effectively improving the processing efficiency of the images.

[0069] Corresponding to the image filling method provided by the above embodiments, based on the same technical concept, the embodiments of the present application also provide an image filling device, Figure 7 The module composition diagram of the image filling device provided by the embodiments of the present application is shown in the figure. The image filling device is used to execute Figures 1 to 6 The image filling method described above, as Figure 7 shown, the image filling device comprises:

[0070] The acquisition module 701 is configured to acquire a plurality of image filling areas and a plurality of first images arranged through a preset layout manner.

[0071] The first determining module 702 is configured to determine a first display effect and a second display effect of each image filling area filling any different first image, the second display effect being obtained after the first image is combined with at least one other first image.

[0072] The second determining module 703 is configured to determine a target image corresponding to each image filling area based on the first display effect and the second display effect, and fill the target image corresponding to each image filling area determined into the corresponding image filling area.

[0073] Optionally, the first determining module comprises:

[0074] The first determining unit is configured to determine a first layout mode diagram obtained by pre-filling any different first image in each image filling area.

[0075] The first processing unit is configured to input the first layout mode diagram into a first preset scoring model, extract image features of the first image pre-filled in the first layout mode diagram through the first preset scoring model, obtain image feature information of the first image, score a display effect of the first image pre-filled in the first layout mode diagram based on the image feature information, and obtain a first display effect corresponding to the image filling area, the image feature information at least including one or more of a shooting time, a shooting location, a color saturation, an exposure, a blur, and a depth of field corresponding to the first image.

[0076] Optionally, the first determining module comprises:

[0077] The first obtaining unit is configured to obtain a first image pair combination composed of any different two first images in the plurality of first images.

[0078] The second processing unit is configured to input the first image pair combination into a second preset scoring model, determine combination dimension information of the two first images contained in the first image pair combination through the second preset scoring model, score a display effect of the first image pair combination based on the combination dimension information, and obtain a second display effect of the first image pair combination corresponding to each image filling area filling any different first image, the combination dimension information at least including one or more of a shooting time, a shooting location, an image category, and an image color.

[0079] Optionally, the second determining module comprises:

[0080] a second determining unit, configured to determine a target display effect corresponding to the first image based on the first display effect corresponding to the first image, the second display effect, a first weight corresponding to the first display effect, and a second weight corresponding to the second display effect.

[0081] a third determining unit, configured to determine a target image corresponding to each of the image filling areas based on the target display effect.

[0082] Optionally, the second determining module includes:

[0083] a second obtaining unit, configured to obtain a filling sequence of the image filling areas.

[0084] an image filling unit, configured to fill the target image corresponding to each of the image filling areas into the corresponding image filling area based on the filling sequence of the image filling areas.

[0085] As can be seen from the technical solutions provided by the above embodiments of the present specification, the image filling method, device and electronic equipment in the embodiments of the present application obtain a plurality of image filling areas and a plurality of first images arranged by a preset layout mode, determine a first display effect and a second display effect obtained by filling any different first image into each image filling area, the second display effect is obtained by combining the first image with at least one other first image, then, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the target image corresponding to each image filling area is filled into the corresponding image filling area. In the embodiments of the present application, the first display effect and the second display effect obtained by filling any different first image into each image filling area are determined, then, based on the first display effect and the second display effect, a target image corresponding to each image filling area is determined, and the target image corresponding to each image filling area is filled into the corresponding image filling area. The above process does not require multiple manual operations by the user, the user only needs to select a preset layout mode and a plurality of first images to be filled, and the plurality of first images to be filled can be filled into the plurality of image filling areas arranged by the preset layout mode, thereby effectively improving the processing efficiency of the images.

[0086] The image filling apparatus in the embodiments of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), or the like, and can also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, a self-service machine, or the like. The embodiments of the present application are not limited in this regard.

[0087] The image filling apparatus in the embodiments of the present application can be an apparatus having an operating system. The operating system can be an Android operating system, an ios operating system, or other possible operating system. The embodiments of the present application are not limited in this regard.

[0088] The image filling apparatus provided by the embodiments of the present application can implement the method embodiments. Figures 1 to 6 The processes implemented by the method embodiments are not repeated here to avoid repetition.

[0089] Optionally, as shown in Figure 8 The embodiments of the present application also provide an electronic device 800, which includes a processor 801 and a memory 802. The memory 802 stores programs or instructions that can be run on the processor 801. When the programs or instructions are executed by the processor 801, the programs or instructions implement each step of the above image filling method embodiments and achieve the same technical effects. The processes are not repeated here to avoid repetition.

[0090] It should be noted that the electronic device in the embodiments of the present application includes the mobile electronic device and the non-mobile electronic device described above.

[0091] Figure 9 To implement the hardware structure of an electronic device according to an embodiment of the present application.

[0092] The electronic device 900 includes, but is not limited to, a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910, etc.

[0093] Those skilled in the art can understand that the electronic device 900 can also include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 910 through a power management system, so as to realize the functions of managing charging, discharging, and power consumption management through the power management system. Figure 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than the figure, or combine certain components, or different component arrangements, which are not described here.

[0094] The interface unit 908 is configured to:

[0095] Obtain a plurality of image filling areas and a plurality of first images arranged by a preset layout mode;

[0096] The processor 910 is configured to determine a first display effect and a second display effect obtained by filling any different first image in each image filling area, and the second display effect is obtained by combining the first image with at least one other first image.

[0097] The processor 910 is configured to determine a target image corresponding to each image filling area based on the first display effect and the second display effect, and fill the determined target image corresponding to each image filling area into the corresponding image filling area.

[0098] The processor 910 is further configured to:

[0099] Determine a first layout mode diagram obtained by pre-filling any different first image in each image filling area;

[0100] Input the first layout mode diagram into a first preset scoring model, extract image features of the first image pre-filled in the first layout mode diagram through the first preset scoring model, obtain image feature information of the first image, score the display effect of the first image pre-filled in the first layout mode diagram based on the image feature information, and obtain a first display effect corresponding to the image filling area. The image feature information at least includes one or more of the shooting time, the shooting location, the color saturation, the exposure, the blur, and the depth of field corresponding to the first image.

[0101] The interface unit 908 is further configured to: obtain a first image pair combination composed of any two different first images in the plurality of first images;

[0102] The processor 910 is further configured to: input the first image pair combination into a second preset scoring model, determine combination dimension information of the two first images contained in the first image pair combination through the second preset scoring model, score a display effect of the first image pair combination based on the combination dimension information, and obtain a second display effect of the first image pair combination corresponding to each image filling area filled with any different first image pair, the combination dimension information at least including one or more of shooting time, shooting location, image category, and image color.

[0103] The processor 910 is further configured to:

[0104] determine a target display effect corresponding to the first image based on the first display effect, the second display effect corresponding to the first image, and a first weight corresponding to the first display effect and a second weight corresponding to the second display effect;

[0105] determine a target image corresponding to each image filling area based on the target display effect.

[0106] The interface unit 908 is further configured to:

[0107] obtain a filling order of the image filling area;

[0108] The processor 910 is further configured to:

[0109] fill the target image corresponding to each image filling area into the corresponding image filling area in turn based on the filling order of the image filling area.

[0110] It can be seen from the technical solutions provided by the embodiments of the present specification that the image filling method, device and electronic equipment in the embodiments of the present application, by acquiring a plurality of image filling areas arranged by a preset layout mode and a plurality of first images, determining a first display effect and a second display effect obtained by filling any different first image in each image filling area, the second display effect being obtained by combining the first image with at least one other first image, and then determining a target image corresponding to each image filling area based on the first display effect and the second display effect, filling the determined target image corresponding to each image filling area into the corresponding image filling area. In the embodiments of the present application, by determining the first display effect and the second display effect obtained by filling any different first image in each image filling area, and then determining the target image corresponding to each image filling area based on the first display effect and the second display effect, filling the determined target image corresponding to each image filling area into the corresponding image filling area, the above process does not require multiple manual operations by the user. The user only needs to select a preset layout mode and a plurality of first images to be filled, and the plurality of first images to be filled can be filled into the plurality of image filling areas arranged by the corresponding preset layout mode, thereby effectively improving the processing efficiency of the images.

[0111] It should be understood that in the embodiments of the present application, the input unit 904 can include a graphics processor (GPU) 1041 and a microphone 9042. The graphics processor 9041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 906 can include a display panel 9061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 907 includes at least one of a touch panel 9071 and other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 can include two parts of a touch detection device and a touch controller. The other input devices 9072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, an operating lever, and the like, which will not be described here.

[0112] The memory 909 can be used to store software programs and various data. The memory 909 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), etc. In addition, the memory 909 can include a volatile memory or a non-volatile memory, or the memory 909 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 109 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0113] The processor 910 can include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 910.

[0114] The embodiments of the present application also provide a readable storage medium, the readable storage medium stores programs or instructions, the programs or instructions are executed by a processor to realize the processes of the above-mentioned image filling method embodiments, and the same technical effects can be achieved. To avoid repetition, details are not described here.

[0115] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disc or an optical disc, etc.

[0116] The embodiment of the present application further provides a chip, which comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions to realize the processes of the above image filling method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0117] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system level chip, a system chip, a chip system or a system on chip, etc.

[0118] The embodiment of the present application provides a computer program product, which is stored in a storage medium, and is executed by at least one processor to realize the processes of the above image filling method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0119] It should be noted that in this document, the term "comprising" or "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiment of the present application is not limited to the order of performing the functions as shown or discussed, but can also include performing the functions in a substantially simultaneous manner or in the opposite order, for example, the described method can be performed in an order different from that described, and various steps can also be added, omitted or combined. In addition, the features described with reference to certain examples can be combined in other examples.

[0120] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned example methods can be realized by means of software and a necessary general hardware platform, and of course, can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product in essence or in the form of a part that contributes to the prior art, which is stored in a storage medium (such as a ROM / RAM, a magnetic disc, an optical disc), and includes a plurality of instructions for causing a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application.

[0121] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

Claims

1. A method of padding an image, characterized by, The method comprises: obtaining a plurality of image filling areas and a plurality of first images arranged by a preset layout mode; determining a first display effect and a second display effect of each image filling area filled with any different first image, wherein the second display effect is a combined display effect obtained by splicing at least two first images according to a preset mode, and the preset mode is to fill the at least two first images in adjacent image filling areas; determining a target display effect of each image filling area filled with any different first image based on the sum of the first display effect and the second display effect; based on the target display effect, determining the target image corresponding to each image filling area, and filling the determined target image corresponding to each image filling area into the corresponding image filling area; wherein the first display effect and the second display effect are scores obtained by evaluating the display effect based on an algorithm.

2. The method of claim 1, wherein, The method comprises: determining a first layout mode obtained by pre-filling any different first image in each image filling area; inputting the first layout mode into a first preset scoring model, extracting image features of the first image pre-filled in the first layout mode by the first preset scoring model, obtaining image feature information of the first image, and scoring the display effect of the first image pre-filled in the first layout mode based on the image feature information, to obtain the first display effect corresponding to the image filling area, wherein the image feature information at least includes one or more of the shooting time, the shooting location, the color saturation, the exposure, the blur, and the depth of field corresponding to the first image.

3. The method of claim 1, wherein, The method comprises: obtaining a first image pair combination composed of any two different first images in the plurality of first images; inputting the first image pair combination into a second preset scoring model, determining the combination dimension information of the two first images contained in the first image pair combination by the second preset scoring model, and scoring the display effect of the first image pair combination based on the combination dimension information, to obtain the second display effect of the first image pair combination corresponding to each image filling area filled with any different first image, wherein the combination dimension information at least includes one or more of the shooting time, the shooting location, the image category, and the image color.

4. The method of claim 1, wherein, The method comprises: obtaining the filling order of the image filling area; based on the filling order of the image filling area, sequentially filling the target image corresponding to each image filling area into the corresponding image filling area.

5. An apparatus for filling of an image, characterized by The device comprises: The acquisition module is configured to acquire a plurality of image filling areas and a plurality of first images arranged by a preset layout mode. The first determination module is configured to determine a first display effect and a second display effect obtained by filling any different first image in each image filling area, wherein the second display effect is a combined display effect obtained by splicing at least two first images in a preset manner, and the preset manner is to fill the at least two first images in adjacent image filling areas. The second determination module is configured to determine a target display effect obtained by filling any different first image in each image filling area based on a sum of the first display effect and the second display effect, and determine a target image corresponding to each image filling area based on the target display effect, and fill the determined target image corresponding to each image filling area into the corresponding image filling area. The first display effect and the second display effect are scores obtained by evaluating the display effect based on an algorithm.

6. The apparatus of claim 5, wherein, The first determination module includes: The first determination unit is configured to determine a first layout mode map obtained by filling any different first image in each image filling area. The first processing unit is configured to input the first layout mode map into a first preset scoring model, extract image features of the first image pre-filled in the first layout mode map through the first preset scoring model, obtain image feature information of the first image, score the display effect of the first image pre-filled in the first layout mode map based on the image feature information, and obtain the first display effect corresponding to the image filling area, wherein the image feature information at least includes one or more of shooting time, shooting location, color saturation, exposure, blur, and depth of field corresponding to the first image.

7. The apparatus of claim 5, wherein, The first determination module includes: The first acquisition unit is configured to acquire a first image pair combination composed of any two different first images in the plurality of first images. The second processing unit is configured to input the first image pair combination into a second preset scoring model, determine combination dimension information of the two first images contained in the first image pair combination through the second preset scoring model, score the display effect of the first image pair combination based on the combination dimension information, and obtain the second display effect of the first image pair combination corresponding to any different first image filled in each image filling area, wherein the combination dimension information at least includes one or more of shooting time, shooting location, image category, and image color.

8. The apparatus of claim 5, wherein, The second determination module includes: The second acquisition unit is configured to acquire a filling order of the image filling area. The image filling unit is configured to sequentially fill the target image corresponding to each image filling area determined into the corresponding image filling area based on the filling order of the image filling area.

9. An electronic device, comprising: The image filling unit is configured to sequentially fill the target image corresponding to each image filling area determined into the corresponding image filling area based on the filling order of the image filling area. - a processor, a memory, and a computer program stored on said memory and runtable on said processor, said computer program, when executed by said processor, implementing the steps of the padding method of an image according to any one of claims 1 to 4.

Images