Method for pushing multimedia resource, method and device for rendering multimedia resource

Abstract

Provided are a push method of a multimedia resource, a rendering method and device of the multimedia resource. The push method of the multimedia resource comprises: acquiring a plurality of product images; determining initial position information and combined position information of each product image in the plurality of product images; generating a rendering configuration file based on the initial position information and the combined position information of each product image, wherein the rendering configuration file is used to define a rendering manner in which each product image moves along a respective movement path in a display frame as the display frame moves in a screen; and sending the plurality of product images and the rendering configuration file to a client; wherein the respective movement path of each product image is a path between the initial position and the combined position of the product image; and wherein the plurality of product images are combined together when each of the plurality of product images is in the respective combined position in the display frame.

Description

TECHNICAL FIELD

[0001] The present disclosure relates generally to the field of electronic technology, and more particularly, to a push method of multimedia resources, a rendering method and device of multimedia resources. BACKGROUND

[0002] Personalized recommendation can recommend information and goods that users are interested in to users according to the interests and characteristics of the users. With more and more personalized recommendation scenarios, there are more and more personalized advertisement generation schemes. However, the personalized advertisement generation at the present stage is mainly based on static and single images, which is less attractive to users and affects user experience and final conversion rate. SUMMARY

[0003] An exemplary embodiment of the present disclosure provides a push method of multimedia resources, a rendering method and device of multimedia resources, which can improve user experience.

[0004] According to a first embodiment of the present disclosure, a push method of multimedia resources is provided, comprising: acquiring a plurality of product images; determining initial position information and combined position information of each product image in the plurality of product images; generating a rendering configuration file based on the initial position information and the combined position information of each product image, wherein the rendering configuration file is used to define a rendering manner in which each product image moves along a respective movement path in a display frame as the display frame moves in a screen; and sending the plurality of product images and the rendering configuration file to a client; wherein the respective movement path of each product image is a path between the initial position and the combined position of the product image; and wherein the plurality of product images are combined together when each of the plurality of product images is in the respective combined position in the display frame.

[0005] Optionally, the step of determining the initial position information and the combined position information of each product image in the plurality of product images comprises: determining the initial position information of each product image and first size information of the product image when the product image is in the initial position, and the combined position information of the product image and second size information of the product image when the product image is in the combined position; wherein the step of generating the rendering configuration file based on the initial position information and the combined position information of each product image comprises: generating the rendering configuration file based on the initial position information and the first size information of each product image, and the combined position information and the second size information of each product image; and wherein the rendering configuration file is used to define a rendering manner in which each product image moves along a respective movement path and changes size in the display frame as the display frame moves in the screen.

[0006] Optionally, the rendering configuration file comprises one of the following: initial position information and combined position information of each product image; a moving path of each product image; a mapping relationship between a position of a display frame relative to a screen and a position at which each product image is rendered.

[0007] Optionally, the rendering configuration file comprises one of the following: initial position information and combined position information of each product image; a moving path of each product image; a mapping relationship between a position of a display frame relative to a screen and a position at which each product image is rendered; the rendering configuration file further comprises one of the following: first size information and second size information of each product image; a mapping relationship between a position of a display frame relative to a screen and a size of each product image; a mapping relationship between a position at which each product image is rendered and a size of the product image.

[0008] Optionally, the rendering configuration file further comprises an occlusion relationship between product images.

[0009] Optionally, the initial positions of the plurality of product images are such that the plurality of product images are arranged at equal intervals in the display frame.

[0010] Optionally, the pushing method further comprises: obtaining a background image and rendering information thereof for display with the plurality of product images in the same display frame; wherein the step of generating a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information comprises: generating a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information, and the rendering information of the background image; and wherein the step of sending the plurality of product images and the rendering configuration file to the client comprises: sending the plurality of product images, the background image and the rendering configuration file to the client.

[0011] Optionally, the step of determining the combined position information and the second size information of each product image comprises: generating a plurality of candidate combined images according to a canvas of a set size, wherein each candidate combined image is an image formed by combining the plurality of product images together on the canvas, and the positions of the plurality of product images in different candidate combined images are different; and selecting an optimal combined image from the plurality of candidate combined images, and determining the combined position information and the second size information of each product image based on the positions and sizes of the plurality of product images corresponding to the optimal combined image relative to the canvas.

[0012] Optionally, the step of determining the combined position information and the second size information of each product image based on the position and size of the plurality of product images relative to the canvas corresponding to the optimal combined image comprises: determining the position and size of the canvas relative to the background image, and taking the position and size of the canvas relative to the background image and the position and size of each product image relative to the canvas as the combined position information and the second size information of each product image.

[0013] Alternatively, the position and size of the canvas relative to the background image are determined; the combined position of each product image relative to the background image and the size of each product image in the combined position are determined based on the position and size of the canvas relative to the background image and the position and size of each product image relative to the canvas; and the combined position of each product image relative to the background image and the size of each product image in the combined position are taken as the combined position information and the second size information of each product image.

[0014] Optionally, the step of generating a plurality of candidate combined images according to the canvas of the set size comprises: generating a plurality of product images scaled according to a first scaling ratio in a random starting position in the canvas that meets a first preset condition, wherein the first scaling ratio is determined based on the ratio between the area of the canvas and the sum of the areas of the plurality of product images; controlling each scaled product image to move towards the center point of the canvas by a first preset proportion of its own size each time until the product image meets at least one second preset condition after moving, and then backtracking by a second preset proportion of its own size and stopping moving; when all product images have stopped moving, scaling the entire region enclosed by the outer contours of the plurality of product images after backtracking according to a second scaling ratio, and determining the entire image composed of the plurality of product images in the current position after scaling according to the second scaling ratio as a candidate combined image; wherein the second scaling ratio is determined based on the ratio between the area of the canvas and the area of the entire region.

[0015] Optionally, the step of selecting the optimal combined image from the plurality of candidate combined images comprises: selecting the optimal combined image based on the ratio between the blank area and the center area of the center region of each candidate combined image, and the distance between the aspect ratio and the fixed aspect ratio; wherein the lower the ratio between the blank area and the center area of the center region, and the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the possibility of the candidate combined image being selected.

[0016] Optionally, the first preset condition comprises at least one of the following: the product images are not overlapped with each other, and the random starting position of the product image with a larger aspect ratio is farther away from the center point of the canvas; and / or, the second preset condition comprises at least one of the following: the proportion of the portion that must be displayed being blocked exceeds a first proportion threshold, the proportion being blocked exceeds a second proportion threshold, and overlapping with the bottom of other product images.

[0017] Optionally, the product image is obtained by: cropping a region only including the target product from the sample image as the product image, and marking the bottom of the product image and the portion that must be displayed.

[0018] Optionally, the pushing method further comprises: obtaining an auxiliary multimedia resource and rendering information thereof; wherein the step of generating the rendering configuration file based on the initial position information and the combined position information of each product image comprises: generating the rendering configuration file based on the initial position information and the combined position information of each product image, and the rendering information of the auxiliary multimedia resource; wherein the step of sending the plurality of product images and the rendering configuration file to the client comprises: sending the plurality of product images, the auxiliary multimedia resource, and the rendering configuration file to the client; wherein the auxiliary multimedia resource comprises at least one of the following: a decorative image, a text.

[0019] According to a second embodiment of the present disclosure, a rendering method of a multimedia resource is provided, comprising: receiving a plurality of product images and a rendering configuration file for rendering the plurality of product images in a same display frame; determining, according to the rendering configuration file, a mapping relationship between a position of the display frame relative to a screen and a position of each product image in the plurality of product images being rendered; and rendering the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in the screen; wherein the respective movement path of each product image is a path between an initial position of the product image and a combined position of the product image; and wherein the plurality of product images are combined together when each product image in the plurality of product images is in the respective combined position in the display frame.

[0020] Optionally, the rendering method further comprises: determining, according to the rendering configuration file, a mapping relationship between the position of each product image being rendered and a size of the product image, or a mapping relationship between the position of the display frame relative to the screen and the size of each product image; and wherein the step of rendering the plurality of product images in the display frame according to the mapping relationship comprises: rendering the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along the respective movement path and changes size in the display frame as the display frame moves in the screen.

[0021] Optionally, according to the mapping relationship, the step of rendering the plurality of product images in the display frame comprises: when the display frame moves upwards in the screen, rendering each product image in the display frame to move along a respective moving path to a combined position and to reduce each product image; when the display frame moves downwards in the screen, rendering each product image in the display frame to move along a respective moving path to an initial position and to enlarge each product image.

[0022] Optionally, the rendering configuration file comprises one of: initial position information and combined position information of each product image; a moving path of each product image; a mapping relationship between a position of the display frame relative to the screen and a position of each product image being rendered.

[0023] Optionally, the rendering configuration file comprises one of: initial position information and combined position information of each product image; a moving path of each product image; a mapping relationship between a position of the display frame relative to the screen and a position of each product image being rendered; the rendering configuration file further comprises one of: first size information and second size information of each product image; a mapping relationship between a position of the display frame relative to the screen and a size of each product image; a mapping relationship between a position of each product image being rendered and a size of the product image.

[0024] Optionally, the rendering configuration file further comprises: an occlusion relationship between product images.

[0025] Optionally, the rendering method further comprises: receiving a background image and / or an auxiliary multimedia resource, wherein the rendering configuration file further comprises: rendering information of the background image and / or the auxiliary multimedia resource; wherein the rendering method further comprises: rendering the background image and / or the auxiliary multimedia resource in the display frame according to the rendering information of the background image and / or the auxiliary multimedia resource; wherein the auxiliary multimedia resource comprises at least one of: a decorative image, text.

[0026] According to a third embodiment of the present disclosure, a pushing device of a multimedia resource is provided, comprising: a product image acquisition unit configured to acquire a plurality of product images; a rendering information determination unit configured to determine initial position information and combined position information of each product image in the plurality of product images; a configuration file generation unit configured to generate a rendering configuration file based on the initial position information and the combined position information of each product image, wherein the rendering configuration file is used to define a rendering manner of moving each product image along a respective movement path in a display frame as the display frame moves in a screen; and a sending unit configured to send the plurality of product images and the rendering configuration file to a client; wherein the respective movement path of each product image is a path between the initial position and the combined position of the product image; and wherein the plurality of product images are combined together when each of the plurality of product images is in the respective combined position in the display frame.

[0027] Optionally, the rendering information determination unit is configured to determine the initial position information of each product image and first size information of the product image when it is in the initial position, and the combined position information and second size information of the product image when it is in the combined position; and the configuration file generation unit is configured to generate the rendering configuration file based on the initial position information and the first size information of each product image, and the combined position information and the second size information; and the rendering configuration file is used to define a rendering manner of moving and transforming the size of each product image along the respective movement path in the display frame as the display frame moves in the screen.

[0028] Optionally, the rendering configuration file comprises one of the following: the initial position information and the combined position information of each product image; the movement path of each product image; and a mapping relationship between the position of the display frame relative to the screen and the position of each product image being rendered.

[0029] Optionally, the rendering configuration file comprises one of the following: the initial position information and the combined position information of each product image; the movement path of each product image; and a mapping relationship between the position of the display frame relative to the screen and the position of each product image being rendered; and the rendering configuration file further comprises one of the following: the first size information and the second size information of each product image; a mapping relationship between the position of the display frame relative to the screen and the size of each product image; and a mapping relationship between the position of each product image being rendered and the size of the product image.

[0030] Optionally, the rendering configuration file further comprises an occlusion relationship between the product images.

[0031] Optionally, the initial positions of the plurality of product images are such that the plurality of product images are arranged at equal intervals in the display frame.

[0032] Optionally, the pushing apparatus further comprises a background acquisition unit configured to acquire a background image and rendering information thereof for displaying together with the plurality of product images in a same display frame; wherein the configuration file generation unit is configured to generate a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information, and the rendering information of the background image; and the sending unit is configured to send the plurality of product images, the background image and the rendering configuration file to the client.

[0033] Optionally, the rendering information determination unit is configured to generate a plurality of candidate combined images according to a canvas of a set size, wherein each candidate combined image is an image formed by combining the plurality of product images together on the canvas, and the positions of the plurality of product images in different candidate combined images are different; and filter out an optimal combined image from the plurality of candidate combined images, and determine the combined position information and the second size information of each product image based on the positions and sizes of the plurality of product images corresponding to the optimal combined image relative to the canvas.

[0034] Optionally, the rendering information determination unit is configured to determine the position and size of the canvas relative to the background image, and determine the position and size of the canvas relative to the background image and the position and size of each product image relative to the canvas as the combined position information and the second size information of each product image.

[0035] Alternatively, the position and size of the canvas relative to the background image are determined; the combined position of each product image relative to the background image and the size of each product image when in the combined position are determined based on the position and size of the canvas relative to the background image and the position and size of each product image relative to the canvas; and the combined position of each product image relative to the background image and the size of each product image when in the combined position are determined as the combined position information and the second size information of each product image.

[0036] Optionally, the rendering information determining unit is configured to: generate a random starting position of the plurality of product images scaled according to a first scaling ratio in the canvas, wherein the first scaling ratio is determined based on a ratio between an area of the canvas and a sum of areas of the plurality of product images; control each product image to move towards a center point of the canvas by a first preset proportion of its own size each time until the product image stops moving when at least one second preset condition is met after the movement, and then moves back by a second preset proportion of its own size and stops; when all product images have stopped moving, scale an entire area surrounded by the outer contours of the plurality of product images after the movement back according to a second scaling ratio, and determine an entire image formed by the plurality of product images scaled according to the second scaling ratio at the current position as a candidate combined image; wherein the second scaling ratio is determined based on a ratio between an area of the canvas and an area of the entire area.

[0037] Optionally, the rendering information determining unit is configured to: select an optimal combined image based on a ratio between a blank area of a central region of each candidate combined image and an area of the central region, and a distance between an aspect ratio and a fixed aspect ratio; wherein the lower the ratio between the blank area of the central region and the area of the central region, and the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the possibility of the candidate combined image being selected.

[0038] Optionally, the first preset condition comprises at least one of the following: the product images do not overlap with each other, and the random starting position of a product image with a larger aspect ratio is farther away from the center point of the canvas; and / or, the second preset condition comprises at least one of the following: a proportion of a part that must be displayed being blocked exceeds a first proportion threshold, a proportion being blocked exceeds a second proportion threshold, and overlapping with the bottom of another product image.

[0039] Optionally, the product image is obtained by: cropping a region including only a target product from a sample image as the product image, and marking the bottom of the product image and the part that must be displayed.

[0040] Optionally, the pushing device further comprises: an auxiliary information obtaining unit configured to obtain an auxiliary multimedia resource and rendering information thereof; wherein the configuration file generating unit is configured to generate a rendering configuration file based on the initial position information and the combined position information of each product image, and the rendering information of the auxiliary multimedia resource; wherein the sending unit is configured to send the plurality of product images, the auxiliary multimedia resource, and the rendering configuration file to the client; wherein the auxiliary multimedia resource comprises at least one of the following: a decorative image, a text.

[0041] According to a fourth embodiment of the present disclosure, a rendering device of a multimedia resource is provided, comprising: a receiving unit configured to receive a plurality of product images and a rendering configuration file for rendering the plurality of product images in a same display frame; a relationship determining unit configured to determine, according to the rendering configuration file, a mapping relationship between a position of the display frame relative to a screen and a position at which each product image in the plurality of product images is rendered; and a rendering unit configured to render the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in the screen, wherein the respective movement path of each product image is a path between an initial position of the product image and a combined position, and wherein the plurality of product images are combined together when each product image in the plurality of product images is at the respective combined position in the display frame.

[0042] Optionally, the relationship determining unit is further configured to determine, according to the rendering configuration file, a mapping relationship between the position at which each product image is rendered and a size of the product image, or a mapping relationship between the position of the display frame relative to the screen and the size of each product image, and the rendering unit is configured to render the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along the respective movement path and changes in size in the display frame as the display frame moves in the screen.

[0043] Optionally, the rendering unit is configured to render each product image to move along the respective movement path towards the combined position and to shrink in size in the display frame as the display frame moves upwards in the screen, and to render each product image to move along the respective movement path towards the initial position and to enlarge in size in the display frame as the display frame moves downwards in the screen.

[0044] Optionally, the rendering configuration file comprises one of: initial position information and combined position information of each product image; a movement path of each product image; and a mapping relationship between the position of the display frame relative to the screen and the position at which each product image is rendered.

[0045] Optionally, the rendering configuration file comprises one of: initial position information and combined position information of each product image; a movement path of each product image; and a mapping relationship between the position of the display frame relative to the screen and the position at which each product image is rendered, and the rendering configuration file further comprises one of: first size information and second size information of each product image; a mapping relationship between the position of the display frame relative to the screen and the size of each product image; and a mapping relationship between the position at which each product image is rendered and the size of the product image.

[0046] Optionally, the rendering configuration file further comprises an occlusion relationship between the product images.

[0047] Optionally, the receiving unit is further configured to receive a background image and / or an auxiliary multimedia resource, wherein the rendering configuration file further comprises rendering information of the background image and / or the auxiliary multimedia resource; and the rendering unit is further configured to render the background image and / or the auxiliary multimedia resource in the display frame according to the rendering information of the background image and / or the auxiliary multimedia resource; and the auxiliary multimedia resource comprises at least one of the following: a decorative image, text.

[0048] According to a fifth embodiment of the present disclosure, a system comprising at least one computing device and at least one storage device storing instructions is provided, wherein the instructions, when executed by the at least one computing device, cause the at least one computing device to perform the method for pushing multimedia resources or the method for rendering multimedia resources as described above.

[0049] According to a sixth embodiment of the present disclosure, a computer-readable storage medium storing instructions is provided, wherein the instructions, when executed by at least one computing device, cause the at least one computing device to perform the method for pushing multimedia resources or the method for rendering multimedia resources as described above.

[0050] The method for pushing multimedia resources and the method for rendering multimedia resources and the devices according to the exemplary embodiments of the present disclosure can make each product image move along a respective moving path in the display frame (e.g., an advertisement frame) and combine together as the display frame moves in the screen, thereby improving user experience and final conversion rate.

[0051] Additional aspects and / or advantages of the general inventive concept will be set forth in part in the description which follows, and in part will be obvious from the description, or can be learned by practice of the general inventive concept. BRIEF DESCRIPTION OF DRAWINGS

[0052] The above and other objects and features of the present exemplary embodiments of the present disclosure will become more apparent from the following description of the exemplary embodiments of the present disclosure given for the purpose of illustrations only, wherein:

[0053] Figure 1 A flowchart illustrating a method for pushing multimedia resources according to an exemplary embodiment of the present disclosure is shown;

[0054] Figure 2 An example of a method for obtaining product images according to an exemplary embodiment of the present disclosure is shown;

[0055] Figure 3An example of a method for pushing multimedia resources according to exemplary embodiments of the present disclosure is shown;

[0056] Figure 4 A flowchart illustrating a method for determining combined position information and second size information for each product image according to an exemplary embodiment of the present disclosure;

[0057] Figure 5 and Figure 6 An example is shown of determining combined position information and second size information for each product image according to an exemplary embodiment of this disclosure;

[0058] Figure 7 A flowchart illustrating a method for generating multiple candidate combined images according to an exemplary embodiment of the present disclosure;

[0059] Figure 8 A flowchart illustrating a method for rendering multimedia resources according to exemplary embodiments of the present disclosure;

[0060] Figure 9 An example of rendering a multimedia resource according to an exemplary embodiment of the present disclosure is shown;

[0061] Figure 10 A structural block diagram of a multimedia resource delivery device according to an exemplary embodiment of the present disclosure is shown.

[0062] Figure 11 A structural block diagram of a multimedia resource rendering apparatus according to an exemplary embodiment of the present disclosure is shown. Detailed Implementation

[0063] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings, examples of which are illustrated in the drawings, wherein the same reference numerals always refer to the same parts. The embodiments will now be described with reference to the accompanying drawings in order to explain this disclosure.

[0064] Figure 1 A flowchart illustrating a method for pushing multimedia resources according to exemplary embodiments of the present disclosure is provided. By way of example only, the pushing method may be performed by a server (e.g., the server-side of an application).

[0065] Reference Figure 1 In step S101, multiple product images are acquired.

[0066] As an example, each product image may contain at least one product. When a product image contains only one product, it is called a single-product image.

[0067] As an example, each product image may contain one or more products; for instance, it may contain multiple images of the same product.

[0068] As an example, the products included in the plurality of product images can each be different.

[0069] As an example, the plurality of product images that need to be recommended to a user can be filtered from a product image library according to the characteristics of the user. For example, after receiving a refresh request from the user, an initial material set is obtained using each recall strategy corresponding to the current scene, and after coarse sorting or coarse sorting plus fine sorting, a product image set to be pushed is obtained. Then, the product images in the product image set to be pushed are recommended in combination using the pushing method in the present disclosure.

[0070] As an example, the pushing method according to the exemplary embodiments of the present disclosure can further include: obtaining a background image from a background library, for display together with the plurality of product images in the same display frame (for example, an advertisement frame).

[0071] As an example, the pushing method according to the exemplary embodiments of the present disclosure can further include: obtaining other auxiliary multimedia resources, for display together with the plurality of product images in the same display frame (for example, an advertisement frame).

[0072] As an example, the other auxiliary multimedia resources can include, but are not limited to, at least one of the following: decorative images, text.

[0073] As an example, the product image can be obtained by: cropping a region including only the target product from a sample image as a product image, and marking the bottom and the part that must be displayed of the product image. For example, a certain proportion of the lower part of the entire product image (for example, the lower 1 / 3 part) can be considered as the bottom.

[0074] Figure 2 An example of a method for obtaining a product image according to an exemplary embodiment of the present disclosure is shown.

[0075] As Figure 2As shown, the sample images can be pre-processed to obtain product images and their label information. For example, each sample image can be processed to remove background (e.g., convert jpeg to png to make the background transparent), and then cut the extra background to form a product image. The background is removed so that the product images can be combined without being blocked by each other's background; the extra background is cut to compress the image boundary to the product's bounding box, which is convenient for subsequent calculations. In addition, the operation of generating a bottom mask and a show mask can also be included. The bottom mask and the show mask are two two-dimensional labels. The bottom mask labels the "bottom" of the product on the product image; the show mask labels the "must-show part" of the product on the product image to prevent tall products from completely blocking small products. The bottom mask and the show mask can be used in step S102, and the use method will be described in detail later.

[0076] In step S102, initial position information and combined position information of each product image in the plurality of product images are determined.

[0077] As an example, the initial position information and the combined position information of each product image can be information for directly describing the specific initial position and the specific combined position of each product image in the display frame (e.g., coordinate description), or can be information for indirectly describing the initial position and the combined position of each product image in the display frame, for example, the initial position and the combined position of each product image relative to the background image displayed together.

[0078] In step S103, a rendering configuration file is generated based on the initial position information and the combined position information of each product image, wherein the rendering configuration file is used to define a rendering manner for moving each product image along a respective movement path in the display frame as the display frame moves in the screen.

[0079] The respective movement path of each product image is the path between the initial position and the combined position of the product image. When the plurality of product images are all in the respective combined positions in the display frame, the plurality of product images are combined together.

[0080] It should be understood that the initial positions of different product images are different, and the combined positions of different product images are different.

[0081] As an example, the initial positions of the product images can be such that the product images are arranged in the display frame with equal intervals. For example, the initial positions of the product images can be such that the product images are arranged in the display frame from top to bottom with equal intervals, starting from the top end of the display frame. It should be understood that other arrangements are also possible, and the present disclosure does not limit to this.

[0082] As an example, the combined positions of the product images can be determined using various appropriate combination logic, such that when the product images are in the combined positions in the same display frame, the combined image formed by the product images is aesthetically pleasing, aggregated, and in perspective.

[0083] In one embodiment, 3D modeling can be performed for each product image, and conflicts between the product images can be determined in three-dimensional space when the product images are aggregated.

[0084] In view of the large amount of calculation for 3D modeling for each product image, in another embodiment, the bottom_mask and show_mask two-dimensional markers of each product image can be used in combination with the two-dimensional product images to simulate the conflicts in the 3D scene. Figure 3 An example will be described below.

[0085] As an example, the step of determining the initial position information and the combined position information of each product image in the product images can include determining the initial position information and the first size information of each product image when it is in the initial position, and the combined position information and the second size information of each product image when it is in the combined position. As an example, a rendering configuration file can be generated based on the initial position information and the first size information of each product image, and the combined position information and the second size information of each product image; wherein the rendering configuration file is used to define the rendering manner of each product image moving along the respective movement path and changing size (e.g., zooming in or out) in the display frame as the display frame moves in the screen. For example, the second size can be smaller than the first size.

[0086] As an example, the push method according to the exemplary embodiments of the present disclosure can further include determining the occlusion relationship (which can also be understood as the rendering order) between the product images. For example, a product image rendered later allows occlusion of a product image rendered earlier. As an example, a rendering configuration file can be generated based on the initial position information and the combined position information of each product image, and the occlusion relationship between the product images, to satisfy the defined occlusion relationship when rendering the product images.

[0087] As an example, the rendering configuration file can be a json file.

[0088] As an example, the rendering configuration file may include one of the following: initial position information and combined position information for each product image; movement path for each product image; and mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered.

[0089] As an example, the rendering configuration file may also include: the occlusion relationship between product images.

[0090] As an example, the rendering configuration file may also include: first size information and second size information for each product image; a mapping relationship between the position of the display frame relative to the screen and the size of each product image; and a mapping relationship between the position where each product image is rendered and the size of that product image.

[0091] Furthermore, as an example, the rendering configuration file may also include: rendering information of the background image and / or rendering information of other auxiliary multimedia resources. For example, the rendering information may include, but is not limited to: rendering position and / or rendering style. Accordingly, the push method according to exemplary embodiments of this disclosure may further include: determining the rendering information of the background image and / or the rendering information of other auxiliary multimedia resources.

[0092] It should be understood that the rendering configuration file may also include other content for limiting the rendering method of the display object, which is not limited in this disclosure.

[0093] As an example, the push method according to an exemplary embodiment of this disclosure may further include: determining a movement path for each product image. For example, the shape of the movement path for each product image may be set (e.g., a straight line or an arc), or the movement path for each product image may be determined based on the principle of minimizing mutual occlusion between product images during movement.

[0094] In step S104, the plurality of product images and the rendering configuration file are sent to the client. This allows the client to render each product image according to the rendering configuration file, moving it along its respective path as the display frame moves across the client's screen.

[0095] As an example, background images and / or other auxiliary multimedia resources can also be sent to the client.

[0096] like Figure 3 As shown, background image selection, product image selection, and auxiliary information selection can be performed first. Then, the rendering positions of various materials can be determined. In particular, for product images, initial position information and combined position information need to be determined, and a rendering configuration file is generated based on the rendering positions required for various materials and provided to the client.

[0097] Figure 4A flowchart showing a method of determining the combined position information and the second size information of each product image according to an example embodiment of the present disclosure is shown.

[0098] Referring to Figure 4 and in conjunction with Figure 5 and Figure 6 At step S201, a plurality of candidate combined images are generated according to a canvas of a set size, wherein each candidate combined image is an image formed by combining the plurality of product images together on the canvas, and the positions of the plurality of product images in different candidate combined images are different.

[0099] As an example, the set size can be related to the size of the background image.

[0100] Figure 7 An example embodiment of step S201 is shown.

[0101] Referring to Figure 7 At step S301, a random starting position of the plurality of product images in the canvas after being scaled according to a first scaling ratio is generated, wherein the first scaling ratio is determined based on the ratio between the area of the canvas and the sum of the areas of the plurality of product images. This is to allow all product images to be "placed" on the canvas.

[0102] As an example, the set size can be related to the required size of the overall image formed by the plurality of product images being combined together in the combined position. For example, according to the area A of the canvas and the sum B of the areas of the plurality of product images, all product images are uniformly scaled with a scaling ratio of A / B x 0.8, it should be understood that the coefficient 0.8 can be adjusted according to actual conditions.

[0103] As an example, the first preset condition can include at least one of the following: the product images do not overlap each other, and the random starting position of the product image with a larger aspect ratio is farther away from the center point of the canvas.

[0104] As an example, all product images can be randomly placed on the canvas, and the rules for random placement can include but are not limited to that each product image does not overlap each other, and the product image with a larger aspect ratio is more likely to be placed at the back.

[0105] For example, the farther the random starting position of the product image is from the center point of the canvas, the farther the lower boundary (e.g., the lower boundary of the non-product shadow part in the product image) of the product image is from the center point.

[0106] In step S302, each scaled product image is controlled to move its own size by a first preset ratio toward the center point of the canvas each time, until the product image moves and meets at least one second preset condition, at which point it reverts to its own size by a second preset ratio and stops moving.

[0107] It should be understood that the starting point of each product image's first movement is its corresponding random initial position.

[0108] As an example, the dimensions here can be the smaller of the width and height of the scaled product image.

[0109] Additionally, it should be noted that the movement of each product image on the canvas may not be simultaneous or proportional. For example, some product images may have reached the vicinity of the center point of the canvas and made minor adjustments by reversing because the second preset condition is met. However, some product images may not have reached the vicinity of the center point due to their smaller movement step size. In such cases, some product images may be reversing or stopping, while others may be moving forward.

[0110] It should be understood that "retreat" here refers to returning along the original path from which the movement began.

[0111] As an example, the second preset condition may include, but is not limited to, at least one of the following: the proportion of the part that must be displayed is obscured by more than a first proportion threshold, the proportion of the part obscured is more than a second proportion threshold, or it overlaps with the bottom of other product images.

[0112] As an example, the occlusion relationship between product images can be as follows: the higher the lowest point of the lower boundary, the lower the priority for the overlapping part of the product image with other product images not to be occluded.

[0113] In practice, step S302 involves moving the scaled product image towards the center of the canvas at a first preset ratio (e.g., 10%) of its own size. If a conflict is detected, the image reverts to a second preset ratio (e.g., 5%) of its own size and stops; otherwise, it continues moving towards the center of the canvas at the first preset ratio of its own size. For example, the first preset ratio can be greater than the second preset ratio.

[0114] The conflict determination methods are as follows: there can be no overlap between the bottom_masks of all product images; the area of ​​the show_mask of each product image cannot be obscured by more than a first proportion threshold (e.g., 5%); and the total area of ​​each product image cannot be obscured by more than a second proportion threshold (e.g., 90%).

[0115] In other words, combining Figure 6According to step S302, through the movement aggregation and conflict judgment, the product images are gradually made more compact. When the conflict judgment confirms that the product images cannot be made more compact, the movement is reversed and stopped.

[0116] In step S303, when all product images have stopped moving, the entire area surrounded by the outer contours of the product images after the movement is reversed is scaled according to a second scaling ratio, and the entire image (i.e., the part surrounded by the outer contours) formed by the product images after the movement is reversed and scaled according to the second scaling ratio at the current positions is determined as a candidate combined image. The second scaling ratio is determined based on the ratio between the area of the canvas and the area of the entire area.

[0117] The entire area surrounded by the outer contours of the product images after the movement is reversed is scaled to fine-tune the size of the canvas. For example, the canvas area A and the area C of the entire area surrounded by the outer contours of the product images after the movement is reversed are scaled, and the second scaling ratio can be A / C*0.8. It should be understood that the coefficient 0.8 can be adjusted according to actual conditions.

[0118] Return Figure 4 In step S202, the optimal combined image is selected from the candidate combined images, and the combined position information and the second size information of each product image are determined based on the position and size of the product images corresponding to the optimal combined image relative to the canvas.

[0119] In an embodiment, the position and size of the canvas relative to the background image can be determined, and the position and size of the canvas relative to the background image and the position and size of each product image relative to the canvas are determined as the combined position information and the second size information of each product image. Thus, when the product images are rendered, the combined position and the second size of each product image in the display frame can be determined according to the actual display position and the actual display size of the background image in the display frame.

[0120] For example, the position and size of the canvas relative to the background image, i.e., the overall position and overall size at which the product images need to be combined.

[0121] In another embodiment, the position and size of the canvas relative to the background image can be determined; based on the position and size of the canvas relative to the background image and the position and size of each product image relative to the canvas, the combined position of each product image relative to the background image and the size of each product image in the combined position are determined; and then the combined position of each product image relative to the background image and the size of each product image in the combined position are taken as the combined position information and the second size information of each product image.

[0122] As an example, the step of screening the optimal combined image from the plurality of candidate combined images can include: based on the ratio of the blank area to the central area of the central region of each candidate combined image and the distance between the aspect ratio and the fixed aspect ratio, the optimal combined image is screened; wherein the lower the ratio of the blank area to the central area of the central region of each candidate combined image and the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the possibility of being selected by the candidate combined image. The purpose is to hope that the final screened combined image has less blank in the middle and as much as possible to meet the target aspect ratio.

[0123] For example, the first score of each candidate combined image can be obtained according to the ratio of the blank area to the central area of the central region of each candidate combined image; and the second score of each candidate combined image can be obtained according to the distance between the aspect ratio and the fixed aspect ratio; then the total score of each candidate combined image is obtained according to the first score and the second score (for example, weighted sum), and the candidate combined image with the highest total score is taken as the optimal combined image.

[0124] As an example, the central region and the non-central region of the image can be divided according to the preset standard, which is not limited by the present disclosure.

[0125] Figure 8 A flowchart of a rendering method of a multimedia resource according to an example embodiment of the present disclosure is shown. The rendering method can be performed by a client (for example, a client of an application) only as an example.

[0126] Referring to Figure 8 In step S401, a plurality of product images and a rendering configuration file for rendering the plurality of product images in the same display frame are received.

[0127] In step S402, according to the rendering configuration file, the mapping relationship between the position of the display frame relative to the screen and the position of each product image in the plurality of product images being rendered is determined.

[0128] In step S403, the plurality of product images are rendered in the display frame according to the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in the screen.

[0129] wherein the respective movement path of each product image is a path between the initial position and the combined position of the product image; and wherein the plurality of product images are combined together when each of the plurality of product images is in the respective combined position in the display frame.

[0130] As an example, the rendering method can further comprise determining a mapping relationship between a position at which each product image is rendered and a size of the product image, or determining a mapping relationship between a position of the display frame relative to the screen and a size of each product image, according to the rendering configuration file. Accordingly, as an example, step S403 can comprise rendering the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along a respective movement path and changes in size in the display frame as the display frame moves in the screen.

[0131] As an example, step S403 can comprise rendering each product image in the display frame to move along a respective movement path towards the combined position and to shrink in size when the display frame moves upwards in the screen; and rendering each product image in the display frame to move along a respective movement path towards the initial position and to enlarge in size when the display frame moves downwards in the screen.

[0132] As an example, the rendering configuration file can comprise one of: initial position information and combined position information of each product image; a movement path of each product image; a mapping relationship between a position of the display frame relative to the screen and a position at which each product image is rendered.

[0133] As an example, the rendering configuration file can comprise one of: initial position information and combined position information of each product image; a movement path of each product image; a mapping relationship between a position of the display frame relative to the screen and a position at which each product image is rendered; and the rendering configuration file can further comprise one of: first size information and second size information of each product image; a mapping relationship between a position of the display frame relative to the screen and a size of each product image; a mapping relationship between a position at which each product image is rendered and a size of the product image.

[0134] As an example, the rendering configuration file can further comprise an occlusion relationship between the product images.

[0135] As an example, the rendering method can further include a background image and / or an auxiliary multimedia resource, wherein the rendering profile can further include rendering information of the background image and / or the auxiliary multimedia resource. The rendering method can further include rendering the background image and / or the auxiliary multimedia resource in the showcase according to the rendering information of the background image and / or the auxiliary multimedia resource. For example, the auxiliary multimedia resource can include at least one of the following: a decorative image, text.

[0136] As an example, when the initial position information and the first size information of each product image, the combined position information and the second size information include the position and size of a canvas of the combined image relative to the background image, and the position and size of each product image relative to the canvas, the initial position of each product image relative to the background image and the size at the initial position, or when the initial position information and the first size information of each product image, the combined position information and the second size information include the combined position of each product image relative to the background image and the size at the combined position, the initial position of each product image relative to the background image and the size at the initial position, step S402 can include determining the actual display position and the actual display size of the background image in the showcase according to the rendering information of the background image, and then determining the initial position and the first size, the combined position and the second size of each product image in the showcase according to the actual display position and the actual display size of the background image and the initial position information and the first size information, the combined position information and the second size information of each product image. Then, based on the initial position and the first size, the combined position and the second size of each product image in the showcase, the mapping relationship between the position of the showcase relative to the screen and the position and size of each product image rendered is determined, and each product image is rendered in the showcase along the respective moving path and changes in size as the showcase moves in the screen according to the corresponding mapping relationship of each product image.

[0137] Figure 9 A rendering example of a multimedia resource according to an example embodiment of the present disclosure is shown. As shown, according to an embodiment of the present disclosure, as the screen is slid upwards so that the position of the showcase relative to the screen changes, the food in the showcase accordingly generates a set meal from the initial position to the combined position, and sliding the food back will move in reverse. For example, the position of the product image relative to the showcase starts to move when the top of the showcase appears at the bottom of the screen, and the product image reaches the combined position until the bottom of the showcase appears completely in the screen, displaying the final set meal effect. Figure 9

[0138] Figure 10 A structural block diagram of a pushing device of a multimedia resource according to an example embodiment of the present disclosure is shown.​

[0139] As shown in Figure 10 The push device of multimedia resources according to the exemplary embodiments of the present disclosure comprises a product image acquisition unit 101, a rendering information determination unit 102, a configuration file generation unit 103, and a sending unit 104.

[0140] Specifically, the product image acquisition unit 101 is configured to acquire a plurality of product images.

[0141] The rendering information determination unit 102 is configured to determine initial position information and combined position information of each product image in the plurality of product images.

[0142] The configuration file generation unit 103 is configured to generate a rendering configuration file based on the initial position information and the combined position information of each product image, wherein the rendering configuration file is used to define a rendering manner of moving each product image along a respective movement path in a showcase in a screen as the showcase moves in the screen.

[0143] The sending unit 104 is configured to send the plurality of product images and the rendering configuration file to a client.

[0144] The respective movement path of each product image is a path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when each of the plurality of product images is in the respective combined position in the showcase.

[0145] As an example, the rendering information determination unit 102 can be configured to determine the initial position information of each product image and first size information thereof when in the initial position, and the combined position information and second size information thereof when in the combined position; wherein the configuration file generation unit is configured to generate the rendering configuration file based on the initial position information and the first size information of each product image, and the combined position information and the second size information; wherein the rendering configuration file is used to define a rendering manner of moving and transforming the size of each product image along the respective movement path in the showcase in the screen as the showcase moves in the screen.

[0146] As an example, the rendering configuration file can comprise one of the following: the initial position information and the combined position information of each product image; the movement path of each product image; and a mapping relationship between the position of the showcase relative to the screen and the position of each product image being rendered.

[0147] As an example, the rendering configuration file can comprise one of the following: initial position information and combined position information of each product image; a moving path of each product image; a mapping relationship between a position of a display frame relative to a screen and a position at which each product image is rendered; the rendering configuration file further comprises one of the following: first size information and second size information of each product image; a mapping relationship between a position of a display frame relative to a screen and a size of each product image; a mapping relationship between a position at which each product image is rendered and a size of the product image.

[0148] As an example, the rendering configuration file can further comprise an occlusion relationship between product images.

[0149] As an example, the initial positions of the plurality of product images can be such that the plurality of product images are arranged at equal intervals in the display frame.

[0150] As an example, the pushing apparatus can further comprise a background acquisition unit (not shown), configured to acquire a background image and its rendering information for display with the plurality of product images in the same display frame; wherein the configuration file generation unit 103 can be configured to generate a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information, and the rendering information of the background image; and wherein the sending unit 104 can be configured to send the plurality of product images, the background image and the rendering configuration file to the client.

[0151] As an example, the rendering information determination unit 102 can be configured to generate a plurality of candidate combined images in a canvas of a set size, wherein each candidate combined image is an image formed by combining the plurality of product images together on the canvas, and the positions of the plurality of product images in different candidate combined images are different; select an optimal combined image from the plurality of candidate combined images, and determine the combined position information and the second size information of each product image based on the positions and sizes of the plurality of product images corresponding to the optimal combined image relative to the canvas.

[0152] As an example, the rendering information determination unit 102 can be configured to determine a position and a size of the canvas relative to the background image, and to take the position and the size of the canvas relative to the background image and the position and the size of each product image relative to the canvas as the combined position information and the second size information of each product image.

[0153] Alternatively, a position and a size of the canvas relative to the background image are determined; a combined position of each product image relative to the background image and a size of each product image when in the combined position are determined based on the position and the size of the canvas relative to the background image and a position of each product image relative to the canvas and a size of each product image; and the combined position of each product image relative to the background image and the size of each product image when in the combined position are taken as the combined position information and the second size information of each product image.

[0154] As an example, the rendering information determining unit 102 can be configured to: generate random starting positions of the plurality of product images in the canvas after being scaled according to a first scaling ratio, wherein the first scaling ratio is determined based on a ratio between an area of the canvas and a sum of areas of the plurality of product images; control each scaled product image to move towards a center point of the canvas by a first preset proportion of its own size each time until the product image stops moving when at least one second preset condition is met, and then moves back by a second preset proportion of its own size and stops; when all product images have stopped moving, scale an entire region enclosed by the outer contours of the plurality of product images after moving back according to a second scaling ratio, and determine an entire image formed by the plurality of product images in the current positions after being scaled according to the second scaling ratio as a candidate combined image; wherein the second scaling ratio is determined based on a ratio between an area of the canvas and an area of the entire region.

[0155] As an example, the rendering information determining unit 102 can be configured to: select an optimal combined image based on a ratio between an empty area of a central region of each candidate combined image and an area of the central region, and a distance between an aspect ratio and a fixed aspect ratio; wherein the lower the ratio between the empty area of the central region and the area of the central region, and the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the possibility of the candidate combined image being selected.

[0156] As an example, the first preset condition can include at least one of the following: the product images do not overlap with each other, and the random starting position of a product image with a larger aspect ratio is farther away from the center point of the canvas; and / or the second preset condition can include at least one of the following: a proportion of a part that must be displayed being blocked exceeds a first proportion threshold, a proportion being blocked exceeds a second proportion threshold, and overlapping with the bottom of another product image.

[0157] As an example, the product image can be obtained by: cropping a region including only a target product from a sample image as the product image, and marking the bottom of the product image and the part that must be displayed.

[0158] As an example, the pushing apparatus can further include an auxiliary information obtaining unit (not shown), which is configured to obtain an auxiliary multimedia resource and rendering information thereof; wherein the configuration file generating unit 103 can be configured to generate a rendering configuration file based on the initial position information and the combined position information of each product image, and the rendering information of the auxiliary multimedia resource; wherein the sending unit 104 can be configured to send the plurality of product images, the auxiliary multimedia resource and the rendering configuration file to the client; wherein the auxiliary multimedia resource includes at least one of the following: a decorative image, a text.

[0159] Figure 11 A structural block diagram of a multimedia resource rendering apparatus according to an example embodiment of the present disclosure is shown.

[0160] As Figure 11 shown, the multimedia resource rendering apparatus according to an example embodiment of the present disclosure includes a receiving unit 201, a relationship determining unit 202, and a rendering unit 203.

[0161] In particular, the receiving unit 201 is configured to receive a plurality of product images and a rendering configuration file for rendering the plurality of product images in a same display frame.

[0162] The relationship determining unit 202 is configured to determine, according to the rendering configuration file, a mapping relationship between a position of the display frame relative to a screen and a position at which each product image in the plurality of product images is rendered.

[0163] The rendering unit 203 is configured to render the plurality of product images in the display frame in accordance with the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in the screen.

[0164] The respective movement path of each product image is a path between an initial position of the product image and a combined position; wherein the plurality of product images are combined together when the plurality of product images are all in the respective combined positions in the display frame.

[0165] As an example, the relationship determining unit 202 can be further configured to determine, according to the rendering configuration file, a mapping relationship between a position at which each product image is rendered and a size of the product image, or a mapping relationship between a position of the display frame relative to the screen and a size of each product image; wherein the rendering unit 203 can be configured to render the plurality of product images in the display frame in accordance with the mapping relationship, so that each product image moves along a respective movement path and changes in size in the display frame as the display frame moves in the screen.

[0166] As an example, the rendering unit 203 can be configured to: when the showcase frame moves upward in the screen, render each product image in the showcase frame to move along a respective movement path to a combined position and to reduce the size of each product image; and when the showcase frame moves downward in the screen, render each product image in the showcase frame to move along a respective movement path to an initial position and to enlarge the size of each product image.

[0167] As an example, the rendering configuration file can include one of: initial position information and combined position information of each product image; a movement path of each product image; a mapping relationship between a position of the showcase frame relative to the screen and a position at which each product image is rendered.

[0168] As an example, the rendering configuration file can include one of: initial position information and combined position information of each product image; a movement path of each product image; a mapping relationship between a position of the showcase frame relative to the screen and a position at which each product image is rendered; and the rendering configuration file further includes one of: first size information and second size information of each product image; a mapping relationship between a position of the showcase frame relative to the screen and a size of each product image; a mapping relationship between a position at which each product image is rendered and a size of the product image.

[0169] As an example, the rendering configuration file can further include an occlusion relationship between product images.

[0170] As an example, the receiving unit 201 can be further configured to receive a background image and / or an auxiliary multimedia resource, wherein the rendering configuration file can further include rendering information of the background image and / or the auxiliary multimedia resource; and the rendering unit 203 can be further configured to render the background image and / or the auxiliary multimedia resource in the showcase frame according to the rendering information of the background image and / or the auxiliary multimedia resource; and the auxiliary multimedia resource includes at least one of: a decorative image, text.

[0171] It should be understood that the specific implementation manners of the multimedia resource pushing apparatus and the multimedia resource rendering apparatus according to the example embodiments of the present disclosure can be implemented with reference to the related specific implementation manners described in combination with Figures 1 to 9 the description of the multimedia resource pushing apparatus and the multimedia resource rendering apparatus, which will not be described herein again.

[0172] The units included in the multimedia resource delivery apparatus and the multimedia resource rendering apparatus according to exemplary embodiments of the present disclosure can be configured as software, hardware, firmware, or any combination thereof to perform specific functions. For example, these units may correspond to dedicated integrated circuits, pure software code, or modules combining software and hardware. Furthermore, one or more functions implemented by these units may also be uniformly executed by components in a physical entity device (e.g., a processor, client, or server).

[0173] It should be understood that the method for pushing multimedia resources according to exemplary embodiments of the present disclosure can be implemented by a program recorded on a computer-readable medium. For example, according to exemplary embodiments of the present disclosure, a computer-readable medium for pushing multimedia resources can be provided, wherein a computer program for performing the method for pushing multimedia resources as described in the above exemplary embodiments is recorded on the computer-readable medium.

[0174] It should be understood that the multimedia resource rendering method according to the exemplary embodiments of the present disclosure can be implemented by a program recorded on a computer-readable medium. For example, according to the exemplary embodiments of the present disclosure, a computer-readable medium for rendering multimedia resources can be provided, wherein a computer program for performing the multimedia resource rendering method as described in the above exemplary embodiments is recorded on the computer-readable medium.

[0175] The computer program in the aforementioned computer-readable medium can run in an environment deployed in computer devices such as clients, hosts, agent devices, and servers. It should be noted that the computer program can also be used to perform additional steps besides those described above, or to perform more specific processing while performing the above steps. The content of these additional steps and further processing has been described in reference to... Figures 1 to 9 The above has already been described, and will not be repeated here to avoid repetition.

[0176] It should be noted that the multimedia resource pushing device and the multimedia resource rendering device according to the exemplary embodiments of this disclosure can rely entirely on the operation of the computer program to realize their respective functions. That is, each unit corresponds to each step in the functional architecture of the computer program, so that the entire system is called through a special software package (e.g., a lib library) to realize the corresponding functions.

[0177] On the other hand, each unit included in the push device of multimedia resources and the rendering device of multimedia resources according to the exemplary embodiments of the present disclosure can also be implemented by hardware, software, firmware, middleware, microcode, or any combination thereof. When implemented in software, firmware, middleware, or microcode, program code or code segments to perform the corresponding operations can be stored in a computer-readable medium such as a storage medium, so that a processor can perform the corresponding operations by reading and executing the program code or code segments.

[0178] For example, the exemplary embodiments of the present disclosure can also be implemented as a computing device including a storage component and a processor, the storage component having stored therein a set of computer-executable instructions which, when executed by the processor, perform the push method of multimedia resources or the rendering method of multimedia resources as described in the exemplary embodiments above.

[0179] In particular, the computing device can be deployed in a server or a client, or on a node device in a distributed network environment. In addition, the computing device can be a PC computer, a tablet device, a personal digital assistant, a smart phone, a web application, or any other device capable of executing the above-mentioned set of instructions.

[0180] Here, the computing device is not necessarily a single computing device, but can also be a collection of any devices or circuits capable of executing the above-mentioned instructions (or set of instructions) individually or jointly. The computing device can also be part of an integrated control system or system manager, or can be configured to interface with a portable electronic device locally or remotely (e.g., via wireless transmission).

[0181] In the computing device, the processor can include a central processing unit (CPU), a graphics processing unit (GPU), a programmable logic device, a dedicated processor system, a microcontroller, or a microprocessor. By way of example and not limitation, the processor can also include an analog processor, a digital processor, a microprocessor, a multi-core processor, a processor array, a network processor, etc.

[0182] Some of the operations described in the push method of multimedia resources and the rendering method of multimedia resources according to the exemplary embodiments of the present disclosure can be implemented by software, some of the operations can be implemented by hardware, and in addition, these operations can also be implemented by a combination of software and hardware.

[0183] The processor can execute instructions or code stored in one of the storage components, wherein the storage components can also store data. Instructions and data can also be sent and received via a network interface device using any known transmission protocol.

[0184] The storage component can be integral to the processor, e.g., RAM or flash memory arranged within an integrated circuit microprocessor, etc. Further, the storage component can include a separate device, such as an external disk drive, memory array, or other storage device that can be used with any database system. The storage component and the processor can be operatively coupled, or can communicate with each other, e.g., via I / O port(s), network connection(s), etc., so that the processor can read information from, and write information to, the storage component.

[0185] Further, the computing device can also include a video display (such as a liquid crystal display) and a user input interface (such as a keyboard, a mouse, a touch input device, etc.). All of the components of the computing device can be connected via a bus or connection, or multiple buses or connections, and can communicate with one another by way of the bus or connection.

[0186] The operations involved in the push method of multimedia resource and the rendering method of multimedia resource according to the exemplary embodiments of the present disclosure can be described as various interconnected or coupled functional blocks or functional diagrams. However, these functional blocks or functional diagrams can be equally integrated as a single logical device or operate in non-exact boundaries.

[0187] For example, as described above, the computing device for pushing multimedia resource according to the exemplary embodiments of the present disclosure can include a storage component and a processor, wherein the storage component stores therein a set of computer executable instructions which, when executed by the processor, perform the push method of multimedia resource as described in the exemplary embodiments above.

[0188] For example, as described above, the computing device for rendering multimedia resource according to the exemplary embodiments of the present disclosure can include a storage component and a processor, wherein the storage component stores therein a set of computer executable instructions which, when executed by the processor, perform the rendering method of multimedia resource as described in the exemplary embodiments above.

[0189] The above describes various exemplary embodiments of the present disclosure, and it should be understood that the above description is merely exemplary and is not exhaustive, and the present disclosure is not limited to the disclosed exemplary embodiments. Many modifications and changes are obvious to those skilled in the art without departing from the scope and spirit of the present disclosure. Therefore, the scope of protection of the present disclosure should be subject to the scope of claims.

Claims

1. A method for pushing multimedia resources, comprising: Acquire multiple product images; Determine the initial position information and combined position information of each product image among the plurality of product images; Based on the initial position information and combined position information of each product image, a rendering configuration file is generated, wherein the rendering configuration file is used to define the rendering method of making each product image move along its respective movement path in the display frame as the display frame moves in the screen; Send the multiple product images and the rendering configuration file to the client; The movement path of each product image is the path between its initial position and the combined position. When the multiple product images are all in their respective combined positions within the display frame, the multiple product images are combined together.

2. The push method as described in claim 1, wherein, The steps of determining the initial position information and combined position information of each product image among the plurality of product images include: determining the initial position information of each product image and its first size information when it is in the initial position, combined position information and its second size information when it is in the combined position; The step of generating a rendering configuration file based on the initial position information and combined position information of each product image includes: generating a rendering configuration file based on the initial position information, first size information, combined position information and second size information of each product image; The rendering configuration file is used to define the rendering method in which each product image moves along its respective movement path and changes size in the display frame as it moves across the screen.

3. The push method as described in claim 1, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; and mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered.

4. The push method as described in claim 2, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered; The rendering configuration file also includes one of the following: first size information and second size information for each product image; the mapping relationship between the position of the display frame relative to the screen and the size of each product image; and the mapping relationship between the position where each product image is rendered and the size of that product image.

5. The push method as described in claim 3 or 4, wherein, The rendering configuration file also includes: the occlusion relationship between product images.

6. The push method as described in claim 1, wherein, The initial positions of the multiple product images ensure that they are arranged at equal intervals within the display frame.

7. The push method as described in claim 2, wherein, The push method also includes: Obtain the background image and its rendering information for displaying in the same display frame as the multiple product images; The step of generating a rendering configuration file based on the initial position information and first size information, combined position information and second size information of each product image includes: generating a rendering configuration file based on the initial position information and first size information, combined position information and second size information of each product image, and the rendering information of the background image; The step of sending the plurality of product images and the rendering configuration file to the client includes: sending the plurality of product images, the background image and the rendering configuration file to the client.

8. The push method as described in claim 7, wherein, The steps for determining the combined location information and second dimension information for each product image include: Multiple candidate combined images are generated according to a canvas of a set size. Each candidate combined image is an image formed by combining the multiple product images together on the canvas. The positions of the multiple product images are different in different candidate combined images. The optimal combination image is selected from the multiple candidate combination images, and the combination position information and second size information of each product image are determined based on the position and size of the multiple product images corresponding to the optimal combination image relative to the canvas. The step of selecting the optimal combined image from the plurality of candidate combined images includes: The first score of each candidate image combination is obtained by the ratio of the area of ​​the blank area to the area of ​​the central region of each candidate image combination. The second score of each candidate image combination is obtained by the distance between the aspect ratio of each candidate image combination and the fixed aspect ratio. The first and second scores of each candidate image combination are weighted and summed to obtain the total score of each candidate image combination. The candidate image combination with the highest total score is selected as the optimal combination image. Among them, the lower the ratio of the blank area to the area of ​​the central region, and the closer the aspect ratio is to the fixed aspect ratio, the higher the probability that the candidate combination image will be selected.

9. The push method as described in claim 8, wherein, The step of determining the combined position information and second size information of each product image based on the position and size of the multiple product images corresponding to the optimal combined image relative to the canvas includes: The position and size of the canvas relative to the background image are determined, and the position and size of the canvas relative to the background image, as well as the position and size of each product image relative to the canvas, are used as combined position information and second size information for each product image; or, Determine the position and size of the canvas relative to the background image; Based on the position and size of the canvas relative to the background image, and the position and size of each product image relative to the canvas, determine the combined position of each product image relative to the background image and its size when in the combined position; The combined position of each product image relative to the background image and its size at the combined position are used as the combined position information and the second size information of each product image.

10. The push method as described in claim 8, wherein, The steps for generating multiple candidate combined images according to a canvas of a set size include: Generate random starting positions in the canvas of the plurality of product images after being scaled according to a first scaling ratio, which satisfy a first preset condition, wherein the first scaling ratio is determined based on the ratio between the area of ​​the canvas and the sum of the areas of the plurality of product images. Each scaled product image moves towards the center of the canvas by a first preset ratio of its own size each time until the product image meets at least one second preset condition after moving, at which point it reverts to the second preset ratio of its own size and stops moving. When all product images have stopped moving, the entire area enclosed by the outer contours of the multiple product images after the rollback is scaled according to the second scaling ratio, and the entire image formed by the multiple product images scaled according to the second scaling ratio at the current position is determined as a candidate combined image. The second scaling factor is determined based on the ratio between the area of ​​the canvas and the area of ​​the entire region; The first preset condition includes at least one of the following: the product images do not overlap each other, and the random starting position of the product image with a larger aspect ratio is farther away from the center point of the canvas; The second preset condition includes at least one of the following: the proportion of the part that must be displayed is obscured by more than a first proportion threshold, the proportion of the part that is obscured is more than a second proportion threshold, or the part overlaps with the bottom of other product images.

11. The push method as described in claim 1, wherein, Product images are obtained by cropping the area containing only the target product from a sample image, and marking the bottom of the product image and the parts that must be shown.

12. The push method as described in claim 1, wherein, The push method further includes: acquiring auxiliary multimedia resources and their rendering information; The step of generating a rendering configuration file based on the initial position information and combined position information of each product image includes: generating a rendering configuration file based on the initial position information and combined position information of each product image and the rendering information of the auxiliary multimedia resources; The step of sending the plurality of product images and the rendering configuration file to the client includes: sending the plurality of product images, the auxiliary multimedia resources and the rendering configuration file to the client; The auxiliary multimedia resources include at least one of the following: decorative images and text.

13. A method for rendering multimedia resources, comprising: Receive multiple product images and a rendering configuration file for rendering the multiple product images in the same display frame; Based on the rendering configuration file, determine the mapping relationship between the position of the display frame relative to the screen and the rendering position of each of the multiple product images; According to the mapping relationship, the plurality of product images are rendered in the display frame so that each product image moves along its respective movement path in the display frame as the display frame moves in the screen; The movement path of each product image is the path between its initial position and the combined position. When the multiple product images are all in their respective combined positions within the display frame, the multiple product images are combined together.

14. The rendering method as described in claim 13, wherein, The rendering method further includes: determining, according to the rendering configuration file, the mapping relationship between the position of each product image being rendered and the size of the product image, or determining the mapping relationship between the position of the display frame relative to the screen and the size of each product image; The step of rendering the plurality of product images in the display frame according to the mapping relationship includes: rendering the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along its respective movement path and changes size in the display frame as the display frame moves in the screen.

15. The rendering method as described in claim 14, wherein, The steps of rendering the multiple product images in the display frame according to the mapping relationship include: As the display frame moves upward on the screen, each product image within the display frame is rendered and moves along its respective path to the combined position while shrinking each product image. As the display frame moves downwards on the screen, each product image within the display frame is rendered and moves along its respective path back to its initial position, while each product image is enlarged.

16. The rendering method as described in claim 13, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; and mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered.

17. The rendering method as described in claim 14, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered; The rendering configuration file also includes one of the following: first size information of each product image when it is in its initial position and second size information when it is in its combined position; the mapping relationship between the position of the display frame relative to the screen and the size of each product image; and the mapping relationship between the position where each product image is rendered and the size of that product image.

18. The rendering method as described in claim 16 or 17, wherein, The rendering configuration file also includes: the occlusion relationship between product images.

19. The rendering method as described in claim 13, wherein, The rendering method further includes: receiving a background image and / or auxiliary multimedia resources. The rendering configuration file further includes: rendering information of the background image and / or the auxiliary multimedia resources; The rendering method further includes: rendering the background image and / or the auxiliary multimedia resources in the display frame according to the rendering information of the background image and / or the auxiliary multimedia resources; The auxiliary multimedia resources include at least one of the following: decorative images and text.

20. A multimedia resource delivery device, comprising: The product image acquisition unit is configured to acquire multiple product images; The rendering information determining unit is configured to determine the initial position information and combined position information of each of the plurality of product images; The configuration file generation unit is configured to generate a rendering configuration file based on the initial position information and combined position information of each product image, wherein the rendering configuration file is used to define the rendering method in which each product image moves along its respective movement path in the display frame as the display frame moves in the screen. The sending unit is configured to send the plurality of product images and the rendering configuration file to the client; The movement path of each product image is the path between its initial position and the combined position. When the multiple product images are all in their respective combined positions within the display frame, the multiple product images are combined together.

21. The pushing device as claimed in claim 20, wherein, The rendering information determination unit is configured to: determine the initial position information of each product image and its first size information when it is in the initial position, the combined position information and its second size information when it is in the combined position; The configuration file generation unit is configured to generate a rendering configuration file based on the initial position information and first size information of each product image, combined with the position information and second size information. The rendering configuration file is used to define the rendering method in which each product image moves along its respective movement path and changes size in the display frame as it moves across the screen.

22. The pushing device as claimed in claim 20, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; and mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered.

23. The pushing device as claimed in claim 21, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered; The rendering configuration file also includes one of the following: first size information and second size information for each product image; the mapping relationship between the position of the display frame relative to the screen and the size of each product image; and the mapping relationship between the position where each product image is rendered and the size of that product image.

24. The pushing device as claimed in claim 22 or 23, wherein, The rendering configuration file also includes: the occlusion relationship between product images.

25. The pushing device as claimed in claim 20, wherein, The initial positions of the multiple product images ensure that they are arranged at equal intervals within the display frame.

26. The pushing device as claimed in claim 21, wherein, The pushing device also includes: The background acquisition unit is configured to acquire a background image and its rendering information for displaying in the same display frame as the multiple product images; The configuration file generation unit is configured to generate a rendering configuration file based on the initial position information and first size information of each product image, the combined position information and second size information, and the rendering information of the background image. The sending unit is configured to send the plurality of product images, the background image, and the rendering configuration file to the client.

27. The pushing device as claimed in claim 26, wherein, The rendering information determination unit is configured as follows: Multiple candidate combined images are generated according to a canvas of a set size. Each candidate combined image is an image formed by combining the multiple product images together on the canvas. The positions of the multiple product images are different in different candidate combined images. The optimal combination image is selected from the multiple candidate combination images, and the combination position information and second size information of each product image are determined based on the position and size of the multiple product images corresponding to the optimal combination image relative to the canvas. The process of selecting the optimal combined image from the multiple candidate combined images includes: The first score of each candidate image combination is obtained by the ratio of the area of ​​the blank area to the area of ​​the central region of each candidate image combination. The second score of each candidate image combination is obtained by the distance between the aspect ratio of each candidate image combination and the fixed aspect ratio. The first and second scores of each candidate image combination are weighted and summed to obtain the total score of each candidate image combination. The candidate image combination with the highest total score is selected as the optimal combination image. Among them, the lower the ratio of the blank area to the area of ​​the central region, and the closer the aspect ratio is to the fixed aspect ratio, the higher the probability that the candidate combination image will be selected.

28. The pushing device as claimed in claim 27, wherein, The rendering information determination unit is configured as follows: The position and size of the canvas relative to the background image are determined, and the position and size of the canvas relative to the background image, as well as the position and size of each product image relative to the canvas, are used as combined position information and second size information for each product image; or, Determine the position and size of the canvas relative to the background image; Based on the position and size of the canvas relative to the background image, and the position and size of each product image relative to the canvas, determine the combined position of each product image relative to the background image and its size when in the combined position; The combined position of each product image relative to the background image and its size at the combined position are used as the combined position information and the second size information of each product image.

29. The pushing device as claimed in claim 27, wherein, The rendering information determination unit is configured as follows: Generate random starting positions in the canvas of the plurality of product images after being scaled according to a first scaling ratio, which satisfy a first preset condition, wherein the first scaling ratio is determined based on the ratio between the area of ​​the canvas and the sum of the areas of the plurality of product images. Each scaled product image moves towards the center of the canvas by a first preset ratio of its own size each time until the product image meets at least one second preset condition after moving, at which point it reverts to the second preset ratio of its own size and stops moving. When all product images have stopped moving, the entire area enclosed by the outer contours of the multiple product images after the rollback is scaled according to the second scaling ratio, and the entire image formed by the multiple product images scaled according to the second scaling ratio at the current position is determined as a candidate combined image. The second scaling factor is determined based on the ratio between the area of ​​the canvas and the area of ​​the entire region; The first preset condition includes at least one of the following: the product images do not overlap each other, and the random starting position of the product image with a larger aspect ratio is farther away from the center point of the canvas; The second preset condition includes at least one of the following: the proportion of the part that must be displayed is obscured by more than a first proportion threshold, the proportion of the part that is obscured is more than a second proportion threshold, or the part overlaps with the bottom of other product images.

30. The pushing device as claimed in claim 20, wherein, Product images are obtained by cropping the area containing only the target product from a sample image, and marking the bottom of the product image and the parts that must be shown.

31. The pushing device as claimed in claim 20, wherein, The push device further includes: an auxiliary information acquisition unit, configured to acquire auxiliary multimedia resources and their rendering information; The configuration file generation unit is configured to generate a rendering configuration file based on the initial and combined position information of each product image and the rendering information of the auxiliary multimedia resources. The sending unit is configured to send the plurality of product images, the auxiliary multimedia resources, and the rendering configuration file to the client. The auxiliary multimedia resources include at least one of the following: decorative images and text.

32. A multimedia resource rendering apparatus, comprising: The receiving unit is configured to receive multiple product images and a rendering configuration file for rendering the multiple product images in the same display frame; The relationship determination unit is configured to determine, based on the rendering configuration file, the mapping relationship between the position of the display frame relative to the screen and the rendering position of each of the plurality of product images; The rendering unit is configured to render the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along its respective movement path in the display frame as the display frame moves in the screen; The movement path of each product image is the path between its initial position and the combined position. When the multiple product images are all in their respective combined positions within the display frame, the multiple product images are combined together.

33. The rendering apparatus of claim 32, wherein, The relationship determination unit is further configured to: determine, based on the rendering configuration file, the mapping relationship between the rendered position of each product image and the size of the product image, or determine the mapping relationship between the position of the display frame relative to the screen and the size of each product image; The rendering unit is configured to render the plurality of product images in the display frame according to the mapping relationship, so that each product image moves along its respective movement path and changes size in the display frame as the display frame moves in the screen.

34. The rendering apparatus of claim 33, wherein, The rendering unit is configured as follows: As the display frame moves upward on the screen, each product image within the display frame is rendered and moves along its respective path to the combined position while shrinking each product image. As the display frame moves downwards on the screen, each product image within the display frame is rendered and moves along its respective path back to its initial position, while each product image is enlarged.

35. The rendering apparatus of claim 32, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; and mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered.

36. The rendering apparatus of claim 33, wherein, The rendering configuration file includes one of the following: initial position information and combined position information for each product image; movement path of each product image; mapping relationship between the position of the display frame relative to the screen and the position where each product image is rendered; The rendering configuration file also includes one of the following: first size information of each product image when it is in its initial position and second size information when it is in its combined position; the mapping relationship between the position of the display frame relative to the screen and the size of each product image; and the mapping relationship between the position where each product image is rendered and the size of that product image.

37. The rendering apparatus of claim 32 or 33, wherein, The rendering configuration file also includes: the occlusion relationship between product images.

38. The rendering apparatus of claim 32, wherein, The receiving unit is also configured to receive background images and / or auxiliary multimedia resources. The rendering configuration file further includes: rendering information of the background image and / or the auxiliary multimedia resources; The rendering unit is further configured to: render the background image and / or the auxiliary multimedia resources in the display frame according to the rendering information of the background image and / or the auxiliary multimedia resources; The auxiliary multimedia resources include at least one of the following: decorative images and text.

39. A system comprising at least one computing device and at least one storage device for storing instructions, wherein, When the instruction is executed by the at least one computing device, it causes the at least one computing device to perform the multimedia resource push method as described in any one of claims 1 to 12 or the multimedia resource rendering method as described in any one of claims 13 to 19.

40. A computer-readable storage medium for storing instructions, wherein, When the instruction is executed by at least one computing device, it causes the at least one computing device to perform the multimedia resource push method as described in any one of claims 1 to 12 or the multimedia resource rendering method as described in any one of claims 13 to 19.

Images