Image production method and device, electronic equipment and storage medium

Abstract

The invention relates to an image production method and device, electronic equipment and a storage medium. The method comprises the steps that a background layer image and rendering data of multiple candidate objects are acquired; sorting the plurality of candidate objects based on a preset sorting rule to obtain a target sequence; according to the target sequence, image rendering is carried out based on the rendering data of the candidate objects in sequence, and foreground layer images corresponding to the candidate objects are obtained; in the image display process, in response to a switching instruction of switching to a target object, synthesizing a foreground layer image and a background layer image corresponding to the target object, and obtaining and displaying a target image corresponding to the target object; the target object is an object in the plurality of candidate objects. The time interval from detection of the switching instruction to display of the target image corresponding to the switching instruction can be shortened, rapid production and timely display of the target image are achieved, and then the image display and sharing process is synchronized.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to an image production method, device, electronic device and storage medium. Background Art

[0002] In today's era of increasingly frequent digital information exchange, users often need to share multiple things with others in many scenarios such as daily social interaction, work collaboration, and interest exchanges. For example, in activities such as product display, images are used to present the key features and detailed information of products. The use of images can improve the effect of information transmission.

[0003] However, in the process of making images for sharing things, especially for things with complex structures, since they often contain many components, fine textures, diverse materials, and intricate spatial relationships, when using existing image rendering technology to process these complex things, it is necessary to accurately calculate and simulate every detail, such as ray tracing, material reflection and refraction, shadow generation, etc., which results in a long rendering time. During the sharing process, as the shared content progresses, it is necessary to quickly produce an image of the object that matches the current shared content to ensure that the display and sharing of the object image are synchronized. However, due to the limitation of the above rendering time, the corresponding image cannot be generated in time, making it difficult to synchronize the image display and sharing process. Summary of the invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an image production method, an apparatus, an electronic device and a storage medium.

[0005] In a first aspect, the present disclosure provides an image production method, comprising:

[0006] Obtaining a background layer image and rendering data of multiple candidate objects;

[0007] Sorting the multiple candidate objects based on a preset sorting rule to obtain a target sequence;

[0008] According to the target sequence, image rendering is performed based on the rendering data of the candidate objects in sequence to obtain a foreground layer image corresponding to the candidate objects;

[0009] During the image display process, in response to a switching instruction to switch to a target object, the foreground layer image and the background layer image corresponding to the target object are synthesized to obtain a target image corresponding to the target object and display it; the target object is an object among the multiple candidate objects.

[0010] In a second aspect, the present disclosure further provides an image production device, comprising:

[0011] An acquisition module, used for acquiring a background layer image and rendering data of multiple candidate objects;

[0012] A sorting module, used to sort the multiple candidate objects based on a preset sorting rule to obtain a target sequence;

[0013] A rendering module, used for performing image rendering based on the rendering data of the candidate objects in sequence according to the target sequence to obtain a foreground layer image corresponding to the candidate objects;

[0014] A switching module is used to synthesize the foreground layer image and the background layer image corresponding to the target object in response to a switching instruction to switch to the target object during the image display process, to obtain and display the target image corresponding to the target object; the target object is an object among the multiple candidate objects.

[0015] In a third aspect, the present disclosure further provides an electronic device, the electronic device comprising:

[0016] one or more processors;

[0017] A storage device for storing one or more programs;

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the image production method as described above.

[0019] In a fourth aspect, the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the image production method as described above.

[0020] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0021] The technical solution provided by the embodiment of the present disclosure performs image rendering based on the rendering data of the candidate object in sequence according to the target sequence to obtain a foreground layer image corresponding to the candidate object; in the image display process, in response to the switching instruction to switch to the target object, the foreground layer image and the background layer image corresponding to the target object are synthesized to obtain the target image corresponding to the target object and display it; the target object is an object among multiple candidate objects. In practice, it usually takes a long time to render the candidate object, while it often takes a short time to synthesize the foreground layer image and the background layer image. The essence of the above technical solution is to render each candidate object in advance to obtain the foreground layer image corresponding to the candidate object. When a switching instruction for a candidate object is detected, the foreground layer image and the background layer image corresponding to the candidate object that have been rendered before can be directly called to synthesize, rather than starting to render the foreground layer image corresponding to the candidate object after the switching instruction is detected. In this way, the time interval from detecting the switching instruction to displaying the target image corresponding to the switching instruction can be fully shortened, and the target image can be quickly produced and displayed in time, thereby synchronizing the image display and sharing process. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0024] Figure 1 A flowchart of an image production method provided by an embodiment of the present disclosure;

[0025] Figure 2 A schematic diagram of an image production provided by an embodiment of the present disclosure;

[0026] Figure 3 A flowchart of another image production method provided by an embodiment of the present disclosure;

[0027] Figure 4 A schematic diagram of a live broadcast page of a live broadcast room provided in an embodiment of the present disclosure;

[0028] Figure 5 is a structural schematic diagram of an image production device in an embodiment of the present disclosure;

[0029] Figure 6 It is a structural schematic diagram of an electronic device in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0031] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0032] Figure 1 A flowchart of an image production method provided in an embodiment of the present disclosure, this embodiment is applicable to the case of producing images in a client, the method can be executed by an image production device, the device can be implemented in software and / or hardware, the device can be configured in an electronic device, such as a terminal, specifically including but not limited to smart phones, PDAs, tablet computers, wearable devices with display screens, desktop computers, laptop computers, all-in-one machines, smart home devices, etc. Alternatively, this embodiment is applicable to the case of producing images in a server, the method can be executed by an image production device, the device can be implemented in software and / or hardware, the device can be configured in an electronic device, such as a server.

[0033] like Figure 1 As shown, the method may specifically include:

[0034] S110: Obtain a background layer image and rendering data of a plurality of candidate objects.

[0035] The candidate object may be, for example, something that the user wishes to share. The rendering data of the candidate object may be, for example, data for rendering an image including the candidate object. Exemplarily, the rendering data of the candidate object may include at least one of the following: geometric shape data, material data, lighting data, and color data of a three-dimensional model of the candidate object.

[0036] The image produced by the technical solution provided by the present application is a target image, and the target image corresponds to the candidate object. In other words, different candidate objects have different target images.

[0037] In this application, the target image is regarded as the superposition result of two parts, one part is the foreground layer image, and the other part is the background layer image. The foreground layer image is obtained by image rendering based on the rendering data of the candidate object. The background layer image is pre-specified or produced by image generation technology or other image processing technology. For example, see Figure 2, the target image is synthesized by the foreground layer image and the background layer image. The foreground layer image is obtained based on the rendering data of the candidate object and is used to show the characteristics of the candidate object.

[0038] The technical solution provided by the present application can be used in a variety of scenarios such as video conferencing and live broadcasting. Taking the live broadcast scenario as an example, the candidate objects can be, for example, things shared by the host and the users watching the live broadcast during the live broadcast in the target live broadcast room. Optionally, the candidate objects can be purchasable goods or services. For example, if the target live broadcast room is mainly used for the host to share information about various brands and models of vehicles with the users watching the live broadcast, the candidate objects are the various brands and models of vehicles shared in the target live broadcast room. In this scenario, the target image produced using the technical solution provided by the present application can be used as a background image used in the live broadcast of the target live broadcast room.

[0039] It is also necessary to emphasize that the candidate object has a corresponding relationship with the usage scenario of the target image. For example, in a live broadcast scenario, since the candidate object may be something that the host and the viewing user want to share during the live broadcast of the target live broadcast room, the candidate object has a corresponding relationship with the target live broadcast room.

[0040] S120 , sorting multiple candidate objects based on a preset sorting rule to obtain a target sequence.

[0041] The preset sorting rule is pre-specified and used to sort multiple candidate objects. The present application does not limit the specific rules of the preset sorting rule. The target sequence is the sorting result of multiple candidate objects.

[0042] For example, if the candidate objects are commodities, the preset sorting rule may be, for example, to sort the candidate objects by their prices. Alternatively, the preset sorting rule may be, for example, to rank the candidate object with the highest popularity first in the target sequence, and to rank the remaining candidate objects by their similarity to the candidate object at the first position and / or their own popularity values.

[0043] When the preset sorting rules are different, the specific implementation method of this step may be different.

[0044] Exemplarily, if the preset sorting rules include: arranging the candidate object with the highest popularity in the first place in the target sequence; sorting the remaining candidate objects according to their similarity with the candidate object in the first place and / or their own heat values. The implementation method of this step may include: determining the first candidate object and the second candidate object among multiple candidate objects based on preset screening conditions; the first candidate object meets the preset screening conditions, and the second candidate object does not meet the preset screening conditions; the preset screening conditions include that the heat value of the candidate object is the largest; determining the similarity between the second candidate object and the first candidate object; determining the position of each second candidate object in the target sequence according to the similarity between the second candidate object and the first candidate object and / or the heat value of the second candidate object, and obtaining the target sequence.

[0045] The popularity value is a parameter used to characterize the popularity of the candidate object corresponding to it. Optionally, the popularity value of the candidate object may include at least one of the following: the candidate object's attention volume, collection volume, purchase volume, evaluation volume, sharing volume, browsing volume, consultation volume, and like volume.

[0046] "The first candidate object meets the preset screening condition, and the second candidate object does not meet the preset screening condition" means that the first candidate object is the most popular candidate object among all the candidate objects corresponding to the target live broadcast room. Except for the first candidate object, all other candidate objects corresponding to the target live broadcast room are second candidate objects.

[0047] According to the similarity between the second candidate object and the first candidate object, the position of each second candidate object in the target sequence is determined to obtain the target sequence, which may include, for example, arranging the second candidate objects in sequence after the first candidate object in order of the similarity between the second candidate object and the first candidate object from high to low to obtain the target sequence.

[0048] According to the heat value of the second candidate object, the position of each second candidate object in the target sequence is determined to obtain the target sequence, which may include, for example: arranging the second candidate objects in order from high to low heat values ​​after the first candidate object to obtain the target sequence.

[0049] According to the similarity between the second candidate object and the first candidate object and the heat value of the second candidate object, the position of each second candidate object in the target sequence is determined to obtain the target sequence, which may include, for example: according to the similarity between the second candidate object and the first candidate object and the heat value of the second candidate object, the score of each second candidate object is determined; and the second candidate objects are arranged in descending order after the first candidate object according to the second candidate object score to obtain the target sequence.

[0050] Usually, candidate objects often have multiple features, which involve multiple aspects. For example, if the candidate object is a vehicle, it includes performance features (such as engine power, torque, acceleration ability, fuel economy and braking performance, etc.), configuration features (such as the number of airbags, anti-lock braking system, whether the seat has heating / ventilation function, in-car air conditioning performance, automatic parking and automatic driving assistance system, etc.), vehicle size features (such as body length, width, height and wheelbase, etc.), interior features (such as the texture of interior materials, color matching and center console design, etc.), and usage features (such as sedans, SUVs, MPVs and commercial vehicles, etc.).

[0051] Optionally, the similarity between the second candidate object and the first candidate object can be determined based on one or more features of the second candidate object and the first candidate object. In practice, the similarity between the second candidate object and the first candidate object is determined based on which feature or features, and this application does not limit this.

[0052] S130 , performing image rendering based on the rendering data of the candidate objects in sequence according to the target sequence to obtain a foreground layer image corresponding to the candidate objects.

[0053] The foreground layer image corresponding to the candidate object is an image rendered by rendering data of the candidate object, which is a two-dimensional image. It is subsequently synthesized with the background layer image obtained in S110 to obtain the final target image.

[0054] Optionally, in actual applications, when rendering any candidate object, the rendering data of the candidate object is first rendered into a three-dimensional model, and then the three-dimensional model is converted into a two-dimensional image. This setting can better restore the candidate object, so that the foreground layer image corresponding to the candidate object can more accurately display the detailed features of the candidate object.

[0055] S140. During the image display process, in response to a switching instruction to switch to a target object, the foreground layer image and the background layer image corresponding to the target object are synthesized to obtain a target image corresponding to the target object and display it; the target object is an object among multiple candidate objects.

[0056] The switching instruction to switch to the target object may be, for example, an instruction indicating that a target image corresponding to the target object needs to be displayed currently.

[0057] There are many occasions for generating a switching instruction to switch to a target object, which is not limited by the present application. Exemplarily, the timing for generating a switching instruction to switch to a target object includes: detecting that a user has selected an option for displaying a target image corresponding to the target object, or detecting that a preset object switching condition is met.

[0058] Among them, the user selects an option for displaying a target image corresponding to the target object, for example, the user performs a trigger operation (such as clicking, dragging, or hovering, etc.) on the option for displaying a target image corresponding to the target object. In the live broadcast scenario, "detecting that a preset object switching condition is met" can be, for example, that the pre-set object switching condition includes the host saying a preset sentence or phrase in the target image display, such as "Next, let's talk about the next car." When it is detected that the host says "Next, let's talk about the next car", the next car of the current vehicle being explained in the target sequence is used as the target vehicle, and a switching instruction to switch to the target object is generated.

[0059] In the live broadcast scene, the target image corresponding to the target object is displayed. For example, the target image corresponding to the target object can be used as the background of the live broadcast room, so that the target image corresponding to the target object is displayed in the live broadcast page. The live broadcast page can be, for example, the page that the viewing user sees after entering the target live broadcast room when the target live broadcast room is in the live broadcast state.

[0060] The above technical solution is set to render images based on the rendering data of the candidate objects in accordance with the target sequence, and obtain the foreground layer image corresponding to the candidate object; in the image display process, in response to the switching instruction to switch to the target object, the foreground layer image and the background layer image corresponding to the target object are synthesized to obtain the target image corresponding to the target object and display it; the target object is an object among multiple candidate objects. In practice, it usually takes a long time to render the candidate object, while it often takes a short time to synthesize the foreground layer image and the background layer image. The essence of the above technical solution is to render each candidate object in advance to obtain the foreground layer image corresponding to the candidate object. When a switching instruction for a candidate object is detected, the foreground layer image corresponding to the candidate object that has been rendered before can be directly called to synthesize with the background layer image, rather than starting to render the foreground layer image corresponding to the candidate object after the switching instruction is detected. In this way, the time interval from detecting the switching instruction to displaying the target image corresponding to the switching instruction can be fully shortened, and the target image can be quickly produced and displayed in time, thereby synchronizing the image display and sharing process. If the technical solution provided by the present application is applied to the live broadcast scene, the utilization rate of the live broadcast room background can be improved.

[0061] Figure 3A flowchart of another image production method provided by the present application is given. Figure 3 , the image production method may include:

[0062] S210: Obtain a background layer image and rendering data of a plurality of candidate objects.

[0063] S220: Sort multiple candidate objects based on a preset sorting rule to obtain a target sequence. The candidate object at the first position in the target sequence is the first candidate object, and the objects after the first candidate object in the target sequence are all second candidate objects.

[0064] S230: Before the image display starts, image rendering is performed based on the rendering data of the first candidate object to obtain a foreground layer image corresponding to the first candidate object.

[0065] S240: Synthesize the foreground layer image corresponding to the first candidate object and the background layer image to obtain a target image corresponding to the first candidate object.

[0066] S250. In response to the image display start instruction, display the target image corresponding to the first candidate object, and perform image rendering based on the rendering data of the second candidate object in sequence according to the target sequence to obtain a foreground layer image corresponding to the second candidate object.

[0067] S260. During the image display process, in response to a switching instruction to switch to a second candidate object, the foreground layer image and the background layer image corresponding to the second candidate object are synthesized to obtain a target image corresponding to the second candidate object and display it.

[0068] Still taking the live broadcast scene as an example, before the live broadcast starts, only the foreground layer image corresponding to the first candidate object is rendered, and the foreground layer image corresponding to the second candidate object is not rendered. And before the live broadcast starts, the foreground layer image corresponding to the first candidate object is synthesized with the background layer image to obtain the target image corresponding to the first candidate object. When the live broadcast start instruction is detected, the target image corresponding to the first candidate object is directly displayed. In the process of displaying the target image corresponding to the first candidate object, the foreground layer image corresponding to the second candidate object is rendered in sequence according to the arrangement order of the second candidate objects in the target sequence. Subsequently, when a switching instruction to switch to a second candidate object is detected, the foreground layer image and background layer image corresponding to the second candidate object that have been rendered before are called to obtain and display the target image corresponding to the candidate object to be switched.

[0069] The purpose of this setting is to reasonably plan the rendering timing of the foreground layer image corresponding to each candidate object and the synthesis timing with the background layer image, and then reasonably allocate the computing power resources used to produce the target image, ensuring that the time from detecting the instruction to displaying the target image corresponding to the instruction is short.

[0070] Based on the above technical solutions, there are various specific implementation methods for "obtaining a background layer image", which are not limited in this application. For example, "obtaining a background layer image" may include: obtaining target subject information; and generating a background layer image based on the target subject information.

[0071] The target theme information may be, for example, the core points set for the shared things or the description information of the sharing background. Taking the live broadcast scene as an example, the target theme information may be, for example, the description information of the core points set for a single live broadcast of the target live broadcast room. It is used to reflect the core information that the live broadcast room wants to convey in the live broadcast. Exemplarily, the target theme information of a live broadcast may include, but is not limited to, at least one of the following: description information of the festival targeted by the live broadcast, description information of the activity targeted by the live broadcast, and description information of the business purpose of the live broadcast.

[0072] Generating a background layer image based on the target subject information may include, for example, taking the target subject information as prompt information and inputting it into an image generating module to obtain the background layer image.

[0073] By setting the background layer image to be generated based on the target theme information, the background layer image can be used as a tool to convey the target theme information, helping other users to quickly understand the theme of this sharing. In the live broadcast scenario, such a setting can help the viewing users to quickly understand the theme of the live broadcast.

[0074] Furthermore, generating a background layer image based on the target subject information may include: generating a candidate background image based on the target subject information; intercepting the candidate background image based on the characteristics of a preset graphic element to obtain a background layer image; the preset graphic element includes at least one of the following: a foreground layer image corresponding to the candidate object, a functional component displayed in an image display page, and a graphic element used to decorate the image display page. The image display page is used to display the target object.

[0075] Exemplarily, the candidate background image may be an image directly generated based on the target subject information.

[0076] Taking the live broadcast scenario as an example, the image display page can be a live broadcast page. The functional components displayed in the image display page may include one or more of the following: a link to the product that the anchor is introducing in real time (also called a product card in some scenarios), an interactive panel for posting comments or talking with the anchor (also called a comment area or public screen in some scenarios), an object display panel for centrally displaying candidate objects to be shared in the live broadcast room, and a component for displaying the name of the live broadcast room. For example, in Figure 4 In the example, component 1 is a component for displaying the name of the live broadcast room, component 2 is an object display panel for centrally displaying candidate objects to be shared in the live broadcast room, and component 3 is an interactive panel for posting comments or talking with the anchor. Component 1, component 2, and component 3 are all functional components displayed in the image display page.

[0077] The graphic elements used to decorate the image display page may be, for example, atmosphere stickers displayed on the image display page for creating an atmosphere. Specifically, taking the live broadcast scene as an example, the graphic elements used to decorate the live broadcast page of the target live broadcast room may be, for example, stickers related to specific festivals or activities, or interactive stickers such as applause, heart shapes, smiley faces, etc.

[0078] The features of the preset graphic element may be, for example, features of the appearance of the preset graphic element, such as shape, size or color.

[0079] In practice, the pattern of some areas of the candidate background image may be complex, or the color may be close to the color of the preset graphic element. If the area is too close to the preset graphic element, the contrast between the preset graphic element and the pattern of the area will be small, and the graphic element will be submerged by the pattern of the area, resulting in other users being unable to quickly distinguish the preset graphic element. In view of this, by setting features based on the preset graphic element, the candidate background image is intercepted to obtain a background layer image, which means that an area that is conducive to highlighting the preset graphic element is selected from the candidate background image for cropping, and the cropped image is used as the background layer image. In this way, the recognition of the preset graphic element can be improved.

[0080] In practice, there are many specific implementation methods for "intercepting the candidate background image based on the features of the preset graphic element to obtain the background layer image", and this application does not limit this. Exemplarily, the implementation method of this step includes: processing the candidate background image into blocks to obtain multiple sub-images; determining the matching value between the sub-image and the preset graphic element; determining the target sub-image from the multiple sub-images based on the matching value between the sub-image and the preset graphic element and the preset matching threshold; and obtaining the background layer image based on the target sub-image.

[0081] The matching value between the sub-image and the preset graphic element is used to represent the influence of the sub-image on the distinguishability of the preset graphic element when the two are displayed at a relatively close distance (such as a preset distance). Optionally, the greater the matching value between the sub-image and the preset graphic element, the smaller the influence of the sub-image on the distinguishability of the preset graphic element when the two are displayed at a relatively close distance (such as a preset distance).

[0082] Furthermore, a matching value between a sub-image and a preset graphic element may be set, including: determining the color difference between the sub-image and the preset graphic element; determining a complexity score for each sub-image; and determining a matching value between the sub-image and the preset graphic element based on the color difference between the sub-image and the preset graphic element and the sub-image complexity score.

[0083] When there are multiple preset graphic elements, "determining the color difference between the sub-image and the preset graphic element" may include: selecting one of the multiple preset graphic elements as a representative, calculating the color difference between the sub-image and the representative preset graphic element; using the color difference between the sub-image and the representative preset graphic element as the color difference between the sub-image and the preset graphic element. Alternatively, the color difference between the sub-image and each preset graphic element may be calculated separately, and the average value of the color difference between the sub-image and each preset graphic element may be used as the color difference between the sub-image and the preset graphic element. When calculating the color difference, the CMC color difference formula may be selected for calculation. The greater the color difference between the sub-image and the preset graphic element, the less likely the sub-image is to drown out the preset graphic element.

[0084] There are many ways to implement "determining the complexity score of each sub-image". Optionally, the image can be subjected to discrete cosine transformation to obtain a transformation result; based on the transformation result, the proportion of high-frequency components is determined. If the proportion of high-frequency components in a sub-image is higher, the pattern of the sub-image is more complex, and the complexity score of the sub-image is lower.

[0085] "Based on the color difference between the sub-image and the preset graphic element and the sub-image complexity score, determine the matching value between the sub-image and the graphic element associated with the target live broadcast room". For example, the color difference between the sub-image and the preset graphic element and the average value of the sub-image complexity score can be calculated; and the sub-image with an average value greater than a set threshold is selected as the target sub-image.

[0086] There are many specific implementation methods for "obtaining a background layer image based on the target sub-image", and this application does not limit this. For example, multiple target sub-images can be spliced ​​to obtain a background layer image; or, based on the target sub-image, an image generation technology is used to perform an image expansion operation to obtain a background layer image.

[0087] The above technical solution can enable the final background layer image to better highlight the preset graphic elements, especially the candidate object image, so that users can more easily distinguish the preset graphic elements.

[0088] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0089] Figure 5 Schematic diagram of the structure of an image production device in an embodiment of the present disclosure. The image production device provided in the embodiment of the present disclosure can be configured in a client or in a server. Figure 5 , the image making device specifically comprises:

[0090] An acquisition module 310 is used to acquire a background layer image and rendering data of a plurality of candidate objects;

[0091] A sorting module 320 is used to sort the multiple candidate objects based on a preset sorting rule to obtain a target sequence;

[0092] A rendering module 330 is used to perform image rendering based on the rendering data of the candidate objects in sequence according to the target sequence to obtain a foreground layer image corresponding to the candidate objects;

[0093] The switching module 340 is used to synthesize the foreground layer image and the background layer image corresponding to the target object in response to a switching instruction to switch to the target object during the image display process, to obtain and display the target image corresponding to the target object; the target object is an object among the multiple candidate objects.

[0094] Furthermore, the sorting module 320 is used to:

[0095] Among the multiple candidate objects, a first candidate object and a second candidate object are determined based on a preset screening condition; the first candidate object satisfies the preset screening condition, and the second candidate object does not satisfy the preset screening condition; the preset screening condition includes: the candidate object has the largest heat value; the heat value is a parameter used to characterize the popularity of the candidate object corresponding thereto;

[0096] determining a similarity between the second candidate object and the first candidate object;

[0097] According to the similarity between the second candidate object and the first candidate object and / or the heat value of the second candidate object, the position of each second candidate object in the target sequence is determined to obtain the target sequence.

[0098] Furthermore, the rendering module 330 is used to:

[0099] Before the image display starts, performing image rendering based on the rendering data of the first candidate object to obtain a foreground layer image corresponding to the first candidate object;

[0100] synthesizing the foreground layer image corresponding to the first candidate object and the background layer image to obtain a target image corresponding to the first candidate object;

[0101] In response to an image display start instruction, a target image corresponding to the first candidate object is displayed, and image rendering is performed based on the rendering data of the second candidate object in sequence according to the target sequence to obtain a foreground layer image corresponding to the second candidate object;

[0102] The switching module 340 is used to:

[0103] During the image display process, in response to a switching instruction to switch to a second candidate object, the foreground layer image and the background layer image corresponding to the second candidate object are synthesized to obtain a target image corresponding to the second candidate object and displayed.

[0104] Furthermore, the acquisition module 310 is used to:

[0105] Obtain target subject information;

[0106] Based on the target subject information, a background layer image is generated.

[0107] Furthermore, the acquisition module 310 is used to:

[0108] Based on the target subject information, generating a candidate background image;

[0109] Based on the characteristics of preset graphic elements, the candidate background image is intercepted to obtain the background layer image; the preset graphic elements include at least one of the following: a foreground layer image corresponding to the candidate object, a functional component displayed in an image display page, and a graphic element used to decorate the image display page; the image display page is used to display the target object.

[0110] Furthermore, the acquisition module 310 is used to:

[0111] Performing block processing on the candidate background image to obtain multiple sub-images;

[0112] Determining a matching value between the sub-image and the preset graphic element;

[0113] Determining a target sub-image from among the multiple sub-images based on a matching value between the sub-image and the preset graphic element and a preset matching threshold;

[0114] Based on the target sub-image, the background layer image is obtained.

[0115] Furthermore, the acquisition module 310 is used to:

[0116] Determining the color difference between the sub-image and the preset graphic element;

[0117] Determining a complexity score for each of the sub-images;

[0118] Based on the color difference between the sub-image and the preset graphic element and the sub-image complexity score, a matching value between the sub-image and the preset graphic element is determined.

[0119] The image production device provided in the embodiment of the present disclosure can execute the steps executed by the client or server in the image production method provided in the embodiment of the method of the present disclosure, and has execution steps and beneficial effects, which will not be repeated here.

[0120] Figure 6 Schematic diagram of the structure of an electronic device in the embodiment of the present disclosure. Figure 6 , which shows a schematic diagram of the structure of an electronic device 1000 suitable for implementing the embodiment of the present disclosure. The electronic device 1000 in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), wearable electronic devices, etc., and fixed terminals such as digital TVs, desktop computers, smart home devices, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0121] like Figure 6 As shown, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 to a random access memory (RAM) 1003 to implement the image production method of the embodiment described in the present disclosure. In the RAM 1003, various programs and information required for the operation of the electronic device 1000 are also stored. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / display (I / O) interface 1005 is also connected to the bus 1004.

[0122] Typically, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; a display device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device 1000 to communicate with other devices wirelessly or by wire to exchange information. Figure 6 The electronic device 1000 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0123] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart, thereby realizing the image production method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0124] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include an information signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated information signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0125] In some embodiments, the client and the server may communicate using any known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital information communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any known or future developed network.

[0126] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0127] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0128] Obtaining a background layer image and rendering data of multiple candidate objects;

[0129] Sorting the multiple candidate objects based on a preset sorting rule to obtain a target sequence;

[0130] According to the target sequence, image rendering is performed based on the rendering data of the candidate objects in sequence to obtain a foreground layer image corresponding to the candidate objects;

[0131] During the image display process, in response to a switching instruction to switch to a target object, the foreground layer image and the background layer image corresponding to the target object are synthesized to obtain a target image corresponding to the target object and display it; the target object is an object among the multiple candidate objects.

[0132] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0133] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0134] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0135] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

[0136] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0137] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0138] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, including:

[0139] one or more processors;

[0140] A memory for storing one or more programs;

[0141] When the one or more programs are executed by the one or more processors, the one or more processors implement any image production method provided by the present disclosure.

[0142] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, and when the program is executed by a processor, the image production method as described in any one of the present disclosure is implemented.

[0143] The embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the image production method described above is implemented.

[0144] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0145] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An image production method, characterized in that: include: Obtaining a background layer image and rendering data of multiple candidate objects; Sorting the multiple candidate objects based on a preset sorting rule to obtain a target sequence; According to the target sequence, image rendering is performed based on the rendering data of the candidate objects in sequence to obtain a foreground layer image corresponding to the candidate objects; During the image display process, in response to a switching instruction to switch to a target object, the foreground layer image corresponding to the target object and the background layer image are synthesized to obtain a target image corresponding to the target object and display the target image; The target object is an object among the multiple candidate objects.

2. The method according to claim 1, characterized in that The step of sorting the plurality of candidate objects based on a preset sorting rule to obtain a target sequence includes: Among the multiple candidate objects, a first candidate object and a second candidate object are determined based on a preset screening condition; the first candidate object satisfies the preset screening condition, and the second candidate object does not satisfy the preset screening condition; the preset screening condition includes: the candidate object has the largest heat value; the heat value is a parameter used to characterize the popularity of the candidate object corresponding thereto; determining a similarity between the second candidate object and the first candidate object; According to the similarity between the second candidate object and the first candidate object and / or the heat value of the second candidate object, the position of each second candidate object in the target sequence is determined to obtain the target sequence.

3. The method according to claim 2, characterized in that The step of performing image rendering based on the rendering data of the candidate objects in sequence according to the target sequence to obtain a foreground layer image corresponding to the candidate objects includes: Before the image display starts, performing image rendering based on the rendering data of the first candidate object to obtain a foreground layer image corresponding to the first candidate object; synthesizing the foreground layer image corresponding to the first candidate object and the background layer image to obtain a target image corresponding to the first candidate object; In response to an image display start instruction, a target image corresponding to the first candidate object is displayed, and image rendering is performed based on the rendering data of the second candidate object in sequence according to the target sequence to obtain a foreground layer image corresponding to the second candidate object; In the image display process, in response to a switching instruction to switch to a target object, a foreground layer image corresponding to the target object and a background layer image are synthesized to obtain a target image corresponding to the target object and display the target image, including: During the image display process, in response to a switching instruction to switch to a second candidate object, the foreground layer image and the background layer image corresponding to the second candidate object are synthesized to obtain a target image corresponding to the second candidate object and displayed.

4. The method according to claim 1, characterized in that: The step of obtaining the background layer image includes: Obtain target subject information; Based on the target subject information, a background layer image is generated.

5. The method according to claim 4, characterized in that The step of generating a background layer image based on the target subject information includes: Based on the target subject information, generating a candidate background image; Based on the characteristics of preset graphic elements, the candidate background image is intercepted to obtain the background layer image; the preset graphic elements include at least one of the following: a foreground layer image corresponding to the candidate object, a functional component displayed in an image display page, and a graphic element used to decorate the image display page; the image display page is used to display the target object.

6. The method according to claim 5, characterized in that The step of intercepting the candidate background image based on the features of the preset graphic elements to obtain the background layer image includes: Performing block processing on the candidate background image to obtain multiple sub-images; Determining a matching value between the sub-image and the preset graphic element; Determining a target sub-image from among the multiple sub-images based on a matching value between the sub-image and the preset graphic element and a preset matching threshold; Based on the target sub-image, the background layer image is obtained.

7. The method according to claim 6, characterized in that The determining of the matching value between the sub-image and the preset graphic element includes: Determining the color difference between the sub-image and the preset graphic element; Determining a complexity score for each of the sub-images; Based on the color difference between the sub-image and the preset graphic element and the sub-image complexity score, a matching value between the sub-image and the preset graphic element is determined.

8. An image production device, characterized in that: include: An acquisition module, used for acquiring a background layer image and rendering data of multiple candidate objects; A sorting module, used to sort the multiple candidate objects based on a preset sorting rule to obtain a target sequence; A rendering module, used for performing image rendering based on the rendering data of the candidate objects in sequence according to the target sequence to obtain a foreground layer image corresponding to the candidate objects; A switching module, used for synthesizing the foreground layer image and the background layer image corresponding to the target object in response to a switching instruction to switch to the target object during the image display process, obtaining a target image corresponding to the target object and displaying it; The target object is an object among the multiple candidate objects.

9. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images