Image synthesis method and device, and storage medium

Abstract

An image synthesis method and device, and a storage medium. A first bounding box line is obtained by performing convex hull extraction on a target object image to be processed; the first bounding box line is narrowed towards the center to obtain a second bounding box line; a target ray at which at last one connection point is located when a first preset material and the target object image are synthesized is determined according to the target object image; at least one connection point between the first preset material and the target object image is determined according to the first bounding box line, the second bounding box line, a target object image contour and at least one target ray; and the first preset material and the target object image are synthesized according to the connection point, and a synthesis result is displayed. An allowable range of the connection point is defined based on the first bounding box line, the second bounding box line  and the target object image contour which are obtained. A reasonable position of the connection point can be determined within the range such that the first preset material is reasonably positioned in the synthesis result, and a user-intended image synthesis effect can be achieved.

Description

[00179] performing an object segmentation on a target object in the image to be processed to obtai n the target obj ect i mage.

[00180] According to one or more embodiments of the present disclosure, the first preset material is an animation material; and the displaying a synthesis result comprises:

[00181] playing the animation material to dynamically display the synthesis result

[00182] In the second aspect, According to one or more embodiments of the present disclosure, a device for image synthesis is provided, and the device for image synthesis comprises:

[00183] a boundary extraction unit, configured to perform a convex hull extraction on a target object image in an image to be processed to obtain a first boundary frame line, and to zoom out the first boundary frame line toward a center of the first boundary frame line according to a preset ratio to obtain a second boundary frame line;

[00184] a ray construction unit, configured to determine, according to the target object image, at least one target ray where at least one connection point is located in synthesizing a first preset material with the target object image;

[00185] a connection point determination unit; configured to determine the at least one connection point between the first preset material and the target object image, according to the first boundary frame line, the second boundary frame line, a contour of the target object i mage, and the at least one target ray; and

[00186] an image synthesis unit; configured to synthesize the first preset material and the target object image according to the at least one connection point, and to display a synthesis result.

[00187] According to one or more embodiments of the present disclosure, when determining the at least one connection point between the first preset material and the target object image according to the first boundary frame line, the second boundary frame line, a contour of the target object image, and the at least one target ray, the connection point determination unit is configured for:

[00188] for any one target ray of the at least one target ray, determining a first intersection point or a second intersection point as one connection point between the first preset material and the target object image, wherein the first intersection point is an i ntersecti on poi nt between the any one target ray and the second boundary frame I i ne, and the second intersection point is an intersection point between the any one target ray and the contour of the target object image.

[00189] According to one or more embodiments of the present disclosure, when for any one target ray of the at least one target ray, determining a first intersection point or a second intersection point as one connection point between the first preset material and the target object image, the connection point determination unit is configured for:

[00190] for the any one target ray, obtai ni ng a thi rd i ntersecti on poi nt between the any one target ray and the fi rst boundary frame I i ne; and

[00191] with the third intersection point as a beginning point; searching for a firstly appeared intersection point on the any one target ray along a direction of the any one target ray toward an interior of the target object image, taking the firstly appeared intersection point as the one connection point between the first preset material and the target object image; wherein the firstly appeared intersection point is the first intersection point between the any one target ray and the second boundary frame line, or the second intersection point between the any one target ray and the contour of the taget obj ect i mage.

[00192] According to one or more embodiments of the present disclosure, when for any one target ray of the at least one target ray, determining a first intersection point or a second intersection point as one connection point between the first preset material and the target object image, the connection point determination unit is configured for:

[00193] for the any one target ray, obtai ni ng the fi rst i ntersecti on poi nt between the any one target ray and the second boundary frame line and the second intersection point between the any one target ray and the contour of the taget obj ect i mage;

[00194] determi ni ng an i ntersection poi nt cl oser to the fi rst boundary frame I i ne from the f i rst i ntersecti on poi nt and the second i ntersecti on poi nt; and

[00195] determi ni ng the i ntersection point closer to the first boundary frame I i ne as the one connection point between the first preset material and the target object image.

[00196] According to one or more embodiments of the present disclosure, when determining, according to the taget object image, at least one taget ray where at least one connection point is located when synthesizing a first preset material with the target object image, the ray construction unit is configured for:

[00197] determining a count of axes in performing an axis extraction on the target object image according to a type of the first preset material;

[00198] performing the axis extraction on the target object image according to the count of the axes to obtain at least one axis; and

[00199] correspondi ngly determi ni ng the at I east one target ray accordi ng to the at I east one axis, and the at least one target ray and the at least one axis respectively formi ng a preset included angle.

[00200] A ccordi ng to one or more embodi ments of the present di sd osure, the count of the axes is two, when performing the axis extraction on the target object image, the ray construction unit is configured for:

[00201] performing a principal component analysis on the target object image by a principle component analysis algorithm^ to extract a first axis and a second axis of the target object image.

[00202] According to one or more embodiments of the present disclosure, when correspondingly determining the at least one target ray according to the axes, the ray construction unit is configured for:

[00203] taking an intersection point between the first axis and the second axis as a starting endpoint of the at least one target ray; and

[00204] creating the at least one target ray that starts from the starting endpoint and forms a correspondi ng preset i nd uded angl e with the fi rst axis or the second axis.

[00205] According to one or more embodiments of the present disclosure, when correspondingly determining the at least one target ray according to the axes, the connection point determination unit is further configured for:

[00206] i n a case where a I ength-wi dth rati o of the target obj ect i mage exceeds a preset threshold, performing at least one of following steps according to the Iength-width ratio of the target object i mage:

[00207] translati ng the fi rst axis or the second axis; and

[00208] adj usti ng the preset i nd uded angl e.

[00209] According to one or more embodiments of the present disclosure, the image synthesis unit is further configured for:

[00210] obtaining a second preset material;

[00211] determining a placement position of the second preset material inside the target object image and a target size of the second preset material, according to the at least one connection point; and

[00212] adjusting the second preset material to the target size, and synthesizing an adjusted second preset material and the target object image according to the placement position.

[00213] According to one or more embodiments of the present disclosure, when determining a placement position of the second preset material inside the target object image and a target size of the second preset material, according to the at least one connection point; the image synthesis unit is configured for:

[00214] determining an origin for establishing a coordinate axis according to the at least one connection point, and establishing the coordinate axis based on the origin; and

[00215] determining the placement position of the second preset material inside the target object image and the target size of the second preset material, according to the coordinate axis.

[00216] According to one or more embodiments of the present disclosure, before the boundary extraction unit performing a convex hull extraction on a target object image in an image to be processed, the boundary extraction unit is further configured for:

[00217] performing an object segmentation on a target object in the image to be processed to obtai n the target obj ect i mage.

[00218] According to one or more embodiments of the present disclosure, the first preset material is an animation material; and when displaying the synthesis result, the image synthesis unit 804 is further configured for: dynamically displaying the synthesis result

[00219] In the third aspect according to one or more embodiments of the present disclosure, an electronic device is provided, and the electronic device comprises:

[00220] at I east one processor; and

[00221] a memory;

[00222] wherein the memory stores a computer execution instruction, the at least one processor executes the computer execution instruction stored in the memory, causing the electronic device to perform the method for image synthesis described in the first aspect and various possible designs of the first aspect

[00223] In the fourth aspect one or more embodiments of the present disclosure provides a computer-readable storage medium wherein the computer-readable storage medium stores a computer execution instruction, and in a case where a processor executes the computer execution instruction, the method for image synthesis described in the first aspect and various possi ble designs of the fi rst aspect is real ized.

[00224] The above descriptions are merely optional embodiments of the present disclosure and illustrations of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, and should also cover, without departing from the above-mentioned disclosed concept; the technical solutions formed by the above-mentioned technical features or other technical solutions formed by any combination of its equivalent features. For example, a technical solution is formed by replacing the above features with the technical features disclosed in the present disclosure (but not limited to) with similar functions.

[00225] Furthermore, although operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although the above discussion contains several implementation-specific details, these should not be construed as limitations on the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment Conversely, various features that are described in the context of a single embodiment may also be implemented in embodiments separately or in any suitable combination.

[00226] Although the subject matter has been described in language specific to structural features and / or logical acts of method, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A method for image synthesis, comprising:performing a convex hull extraction on a target object image in an image to be processed to obtai n a fi rst boundary frame I i ne;zooming out the first boundary frame line toward a center of the first boundary frame I i ne accordi ng to a preset rati o to obtai n a second boundary frame I i ne;determining, according to the target object image, at least one target ray where at least one connection point is located in synthesizing a first preset material with the target object i mage;determining the at least one connection point between the first preset material and the target object image, according to the first boundary frame line, the second boundary frame I i ne, a contour of the target obj ect i mage, and the at I east one target ray; andsynthesizing the first preset material and the target object image according to the at least one connection point; and displaying a synthesis result.

2. The method according to claim 1, wherein the determining the at least one connection point between the first preset material and the target object image according to the first boundary frame line, the second boundary frame line, a contour of the target object image, and the at least one target ray, comprises:for any one target ray of the at least one target ray, determining a first intersection point or a second intersection point as one connection point between the first preset material and the target object image, wherein the first intersection point is an intersection point between the any one target ray and the second boundary frame line, and the second intersection point is an intersection point between the any one target ray and the contour of the target object image.

3. T he method accordi ng to cl ai m 2, wherei n the for any one target ray of the at I east one target ray, determining a first intersection point or a second intersection point as oneconnect! on poi nt between the f i rst preset materi al and the target obj ect i mage, compri ses:for the any one target ray, obtai ni ng a thi rd i ntersecti on poi nt between the any one target ray and the first boundary frame line; andwith the third intersection point as a beginning point; searching for a firstly appeared intersection point on the any one target ray along a direction of the any one target ray toward an interior of the target object image, taking the firstly appeared intersection point as the one connection point between the first preset material and the target object image; wherein the firstly appeared intersection point is the first intersection point between the any one target ray and the second boundary frame line, or the second intersection point between the any one target ray and the contour of the target object i mage.

4. T he method accordi ng to cl ai m 2, wherei n the for any one target ray of the at I east one target ray, determining a first intersection point or a second intersection point as one connect! on poi nt between the f i rst preset materi al and the target obj ect i mage, compri ses:for the any one target ray, obtaining the first intersection point between the any one target ray and the second boundary frame line and the second intersection point between the any one target ray and the contour of the target object i mage;determining an intersection point closer to the first boundary frame line from the first intersection point and the second intersection point; anddetermining the intersection point closer to the first boundary frame line as the one connect! on poi nt between the f i rst preset materi al and the target obj ect i mage.

5. The method according to any one of claims 1-4, wherein the determining, according to the target object image, at least one target ray where at least one connection point is located when synthesizing a first preset material with the target object image, comprises:determining a count of axes in performing an axis extraction on the target object image accordi ng to a type of the fi rst preset material;performing the axis extraction on the target object image according to the count of the axes; andcorrespondingly determining the at least one target ray according to the axes, and the atI east one target ray and the axes respectively formi ng a preset i nd uded angl e.

6. The method according to claim 5, wherein the count of the axes is two, and the performing the axis extraction on the target object image, comprises:performing a principal component analysis on the target object image by a principle component analysis algorithm, to extract a first axis and a second axis of the target object image.

7. The method according to claim 6, wherein the correspondingly determining the at least one target ray according to the axes, comprises:taking an intersection point between the first axis and the second axis as a starting endpoi nt of the at I east one target ray; andcreating the at least one target ray that starts from the starting endpoint and forms a correspondi ng preset i nd uded angle with the first axis or the second axis.

8. The method according to claim 6, further comprising:in a case where a length-width ratio of the target object image exceeds a preset threshold, performing at least one of following steps according to the length-width ratio of the target object image:transl ati ng the fi rst axis or the second axis; andadjusting the preset induded angle.

9. The method according to any one of claims 1-8, further comprising:obtaining a second preset material;determining a placement position of the second preset material inside the target object image and a target size of the second preset material, according to the at least one connection point; andadjusting the second preset material to the target size, and synthesizing an adjusted second preset material and the target object image according to the placement position.

10. The method according to claim 9, wherein the determining a placement position of the second preset material inside the target object image and a target size of the second preset material, according to the at least one connection point, comprises:determining an origin for establishing a coordinate axis according to the at least one connection point, and establishing the coordinate axis based on the origin; anddetermining the placement position of the second preset material inside the target object image and the target size of the second preset material, according to the coordinate axis.

11. The method according to any one of claims 1-10, wherein before the performing a convex hull extraction on a target object image in an image to be processed, the method further comprises:performing an object segmentation on a target object in the image to be processed to obtai n the target obj ect i mage.

12. The method according to any one of claims 1-11, wherein the first preset material is an animation material; andthe displaying a synthesis result comprises:playing the animation material to dynamically display the synthesis result13. The method according to claim 12, wherein the playing the animation material to dynamically display the synthesis result, comprises:performing a three-dimensional processing on the synthesis result and dynamically displayi ng the synthesis result subjected to the three-di mensi onal processi ng.

14. A device for image synthesis, comprising:a boundary extraction unit configured to perform a convex hull extraction on a target object image in an image to be processed to obtain a first boundary frame line, and to zoom out the fi rst boundary frame I i ne toward a center of the fi rst boundary frame I i ne accordi ng to a preset ratio to obtain a second boundary frame Iine;a ray construction unit configured to determine, according to the target object image, atI east one target ray where at I east one connect! on poi nt i s I ocated i n sy nthesi zi ng a fi rst preset material with the target object image;a connection point determination unit, configured to determine the at least one connection point between the first preset material and the target object image, according to the first boundary frame line, the second boundary frame line, a contour of the target object i mage, and the at I east one target ray; andan image synthesis unit; configured to synthesize the first preset material and the target object image according to the at least one connection point; and to display a synthesis result.

15. A n el ectroni c devi ce, compri si ng:at least one processor; anda memory;wherein the memory stores a computer execution instruction, the at least one processor executes the computer execution instruction stored in the memory, causing the electronic device to perform the method for i mage synthesis accordi ng to any one of dai ms 1 -13.

16. A computer-readable storage medium wherein the computer-readable storage medium stores a computer execution instruction, and in a case where a processor executes the computer execution instruction, the method for image synthesis according to any one of claims 1-13 is realized.

Images