Interaction resource determination method and related device

Abstract

The embodiment of the invention discloses an interaction resource determination method and a related device, which can be applied to scenes such as cloud technology, artificial intelligence, intelligent traffic, auxiliary driving and advertisement putting. According to the method, the original images are subjected to image processing in advance, so that the client can obtain the multiple original images and the special effect images having the corresponding relation with the original images only by decoding the obtained dynamic image resource packet, the processing pressure of the client is reduced, and the processing efficiency of the client is improved. Furthermore, the preset control can be rendered based on the special effect image at the corresponding position through the corresponding relation between the original image and the special effect image to obtain the linkage control, so that the synchronism of the linkage control and the to-be-displayed resource is improved, the fusion effect of the linkage control and the to-be-displayed resource in the interactive resource is improved, and the user experience is improved. Therefore, the fusion effect of the control and the dynamic image can be improved while the performance problems such as jamming are avoided, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method for determining interactive resources and related devices. Background Art

[0002] With the development of multimedia technology, clients can display dynamic images such as videos and Graphics Interchange Format (GIF) animations, allowing advertisements, information, and other content to be displayed in the form of dynamic images. To improve the user experience, controls are added to the dynamic images during client development, allowing users to use them to interact with the dynamic images, such as searching and jumping.

[0003] Due to the different processing performance of the devices on which the client is installed, a device with lower processing performance may not be able to add controls to the dynamic image while rendering the dynamic image. In the related art, in order to take into account the processing performance of various devices, dynamic images with smaller data volume are generally produced.

[0004] However, limiting the data volume of dynamic images will result in poor display effects. Moreover, even if the data volume of dynamic images is reduced, since each original image included in the dynamic image needs to be processed, it may cause performance problems such as freezing on devices with low processing performance, poor fusion of controls and dynamic images, and other problems, resulting in a poor user experience. Summary of the Invention

[0005] In order to solve the above technical problems, the present application provides a method and related device for determining interactive resources, which can improve the fusion effect of controls and dynamic images while avoiding performance problems such as lag, thereby improving user experience.

[0006] The embodiments of this application disclose the following technical solutions:

[0007] In a first aspect, an embodiment of the present application provides a method for determining an interaction resource, the method comprising:

[0008] Get dynamic image resource package;

[0009] Decoding the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images, wherein the special effect images are images obtained by performing image processing on the original images having the correspondence based on a preset image processing effect;

[0010] Rendering a first target image among the plurality of original images to obtain a resource to be displayed;

[0011] According to the special effect image corresponding to the first target image, the preset control is rendered in the image area corresponding to the placement position of the resource to be displayed, so as to obtain a linkage control corresponding to the resource to be displayed, wherein the linkage control has an interactive function;

[0012] Display interactive resources, where the interactive resources include the resources to be displayed and linkage controls corresponding to the resources to be displayed.

[0013] In a second aspect, an embodiment of the present application provides a method for determining an interaction resource, the method comprising:

[0014] Acquire dynamic image resources and image processing effects, wherein the dynamic image resources include multiple original images;

[0015] Performing image processing on the dynamic image resource according to the image processing effect to obtain a plurality of special effect images corresponding to the original images respectively;

[0016] Encoding the plurality of original images and the plurality of special effect images corresponding to the original images to obtain a dynamic image resource package, wherein the original images and the special effect images corresponding to the original images in the dynamic resource package have a corresponding relationship;

[0017] Send the dynamic image resource package.

[0018] In a third aspect, an embodiment of the present application provides a device for determining interactive resources, the device comprising: an acquisition unit, a decoding unit, a first rendering unit, a second rendering unit, and a display unit;

[0019] The acquisition unit is used to acquire a dynamic image resource package;

[0020] The decoding unit is configured to decode the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images, wherein the special effect images are images obtained by performing image processing on the original images having the correspondence based on a preset image processing effect;

[0021] The first rendering unit is configured to render a first target image among the plurality of original images to obtain a resource to be displayed;

[0022] The second rendering unit is configured to render the preset control in the image area corresponding to the placement position of the resource to be displayed according to the preset control in the special effect image corresponding to the first target image, to obtain a linkage control corresponding to the resource to be displayed, wherein the linkage control has an interactive function;

[0023] The display unit is used to display interactive resources, and the interactive resources include the resources to be displayed and linkage controls corresponding to the resources to be displayed.

[0024] In a fourth aspect, an embodiment of the present application provides a device for determining interactive resources, the device comprising: an acquisition unit, an image processing unit, an encoding unit, and a sending unit;

[0025] The acquisition unit is used to acquire dynamic image resources and image processing effects, wherein the dynamic image resources include multiple original images;

[0026] The image processing unit is configured to perform image processing on the dynamic image resource according to the image processing effect to obtain special effect images corresponding to a plurality of the original images respectively;

[0027] The encoding unit is configured to encode the plurality of original images and the special effect images corresponding to the plurality of original images to obtain a dynamic image resource package, wherein the original images and the special effect images corresponding to the original images in the dynamic resource package have a corresponding relationship;

[0028] The sending unit is used to send the dynamic image resource package.

[0029] In a fifth aspect, an embodiment of the present application provides a system for determining interactive resources, characterized in that the system includes a first device and a second device;

[0030] The first device is configured to execute the method according to the second aspect;

[0031] The second device is used to execute the method described in the first aspect.

[0032] In a sixth aspect, an embodiment of the present application provides a computer device, the computer device including a processor and a memory:

[0033] The memory is used to store a computer program and transmit the computer program to the processor;

[0034] The processor is configured to execute the method described in the first aspect or the method described in the second aspect according to instructions in the computer program.

[0035] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program, and the computer program is used to execute the method described in the first aspect above, or execute the method described in the second aspect above.

[0036] In an eighth aspect, embodiments of the present application provide a computer program product or computer program, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method described in the first aspect or the method described in the second aspect.

[0037] As can be seen from the above technical solution, to reduce subsequent processing pressure, the dynamic image resource package includes not only multiple original images but also special effect images corresponding to each original image. In other words, the original images are pre-processed to obtain the special effect images, eliminating the need for the client to perform further image processing. Obtaining and decoding the dynamic image resource package not only yields the original images and special effect images, but also determines the correspondence between the original images and the special effect images, ensuring that the preset controls and the resources to be displayed can be aligned during the rendering process. Taking the example of adding a preset control to the first target image among multiple original images, the first target image is rendered to obtain the resource to be displayed, and the preset control is rendered according to the special effect image corresponding to the first target image to obtain the linkage control corresponding to the resource to be displayed. The linkage control not only has an interactive function, but also the special effect image of the rendered preset control is obtained by image processing based on the image area corresponding to the placement position of the preset control on the resource to be displayed, so that after the linkage control is placed on the resource to be displayed, the resource to be displayed below the linkage control can be seen through the linkage control, and the user can correctly identify the position of the linkage control, thereby improving the fusion effect of the rendered preset control and the resource to be displayed. When displaying the interactive resource including the resource to be displayed and its corresponding linkage control, the synchronization of the resource to be displayed and its corresponding linkage control is high.

[0038] Therefore, by performing image processing on the original image in advance, the client can obtain multiple original images and special effect images corresponding to each original image by only decoding the acquired dynamic image resource package. While reducing the processing pressure of the client, it can also render the preset controls based on the special effect images at the corresponding positions through the correspondence between the original images and the special effect images to obtain linkage controls, thereby improving the synchronization between the linkage controls and the resources to be displayed, thereby improving the fusion effect of the linkage controls and the resources to be displayed in the interactive resources, thereby avoiding performance problems such as lag, and improving the fusion effect of the controls and dynamic images, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0040] Figure 1 A schematic diagram of an interactive resource provided in an embodiment of the present application;

[0041] Figure 2 A schematic diagram of an application scenario of a method for determining interactive resources provided in an embodiment of the present application;

[0042] Figure 3 A signaling interaction diagram of a method for determining interactive resources provided in an embodiment of the present application;

[0043] Figure 4 A schematic diagram of a special effects image provided in an embodiment of the present application;

[0044] Figure 5 A schematic diagram of a special effects image provided in an embodiment of the present application;

[0045] Figure 6 A schematic diagram of a combined image provided in an embodiment of the present application;

[0046] Figure 7 A schematic diagram of a combined image provided in an embodiment of the present application;

[0047] Figure 8 A schematic diagram of the structure of an apparatus for determining interactive resources provided in an embodiment of the present application;

[0048] Figure 9 A schematic diagram of the structure of an apparatus for determining interactive resources provided in an embodiment of the present application;

[0049] Figure 10 A schematic diagram of the structure of the server provided in the embodiment of the present application;

[0050] Figure 11 A schematic diagram of the structure of the terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The embodiments of the present application are described below with reference to the accompanying drawings.

[0052] The terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "corresponding to" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0053] In the process of developing the client, controls will be added to the dynamic image, and the dynamic image with the added controls will be the interactive resource. For example, the dynamic image is a video. Figure 1 , which is a schematic diagram of an interactive resource provided by an embodiment of the present application. Figure 1 In the game, advertisements are displayed through videos, and a control with a search function is added to each frame of the video. The control has a real-time frosted glass effect and is integrated with the video. In other words, in the top header of the information page, the lower layer is the video, and the upper layer is the control. During the video playback, the real-time frosted glass effect of the control is linked to the video. The user's visual experience is that the control can be seen through and the video part can be vaguely seen, but it is like a layer of frosted glass blocking the middle, so that the font on the control is clearly visible. It is understandable that Figure 1 The controls are added to only one video frame.

[0054] In related technologies, to achieve the above-mentioned effect, the client plays the video and takes a screenshot of each video frame. After performing Gaussian blur calculation on the screenshot part, it performs edge blending calculation with the control to give the control a frosted glass effect. That is, after rendering the control, the rendered control is added to the corresponding video frame.

[0055] That is, because dynamic images consist of multiple original images, controls need to be added to each original image and integrated with the original image. For example, Gaussian calculations and edge blending calculations need to be performed on each video frame. This requires processing each original image in the dynamic image, which can lead to serious performance issues. Devices with lower processing performance may become stuck and unable to perform other interactive operations, resulting in a poor user experience.

[0056] In addition, as the amount of dynamic image data increases, the number of original images that the client needs to process increases, which will further increase the processing pressure of the device and may cause the original image to not correspond to the effect of the control. For example, the control with a frosted glass effect based on the first video frame is increased to the tenth video frame, resulting in poor fusion effect of the control and the dynamic image and a poor user experience.

[0057] Furthermore, in related technologies, in order to reduce the processing pressure on the device, the multiple original images included in the dynamic image are pre-processed so that the client can directly render the control based on the image-processed original images. Although this method can reduce the processing pressure on the device, it will also cause other problems. That is, the original image that has undergone image processing and is sent in advance cannot be synchronized with the dynamic image, resulting in a poor fusion effect between the control and the dynamic image after adding the control to the dynamic image. For example, if the control rendered based on the first video frame is added to the tenth video frame, the video part seen through the control is separated from the video part without the control, which in turn leads to a poor user experience.

[0058] To summarize, in order to achieve the effect of adding controls to dynamic images while rendering them, devices with lower processing performance may experience performance issues such as lag, poor fusion of controls and dynamic images, and other issues, resulting in a poor user experience.

[0059] Based on this, the embodiment of the present application provides a method and related device for determining interactive resources. By performing image processing on the original image in advance, the client can obtain multiple original images and special effect images corresponding to each original image by only decoding the acquired dynamic image resource package. While reducing the processing pressure of the client, it can also render the preset control based on the special effect image at the corresponding position through the correspondence between the original image and the special effect image to obtain a linkage control, thereby improving the synchronization between the linkage control and the resource to be displayed, thereby improving the fusion effect of the linkage control and the resource to be displayed in the interactive resource, thereby avoiding performance problems such as lag, and improving the fusion effect of the control and the dynamic image, thereby improving the user experience.

[0060] The method for determining interactive resources provided in this application can be applied to computer devices with the ability to determine interactive resources, such as terminal devices and servers. Among them, the terminal device can specifically be a desktop computer, a laptop computer, a smart phone, a tablet computer, an Internet of Things device and a portable wearable device. The Internet of Things device can be a smart speaker, a smart TV, a smart air conditioner, a smart car device, etc. The smart car device can be a car navigation terminal and a car computer, etc. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, etc., but is not limited to this; the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server or server cluster that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal device and the server can be directly or indirectly connected through wired or wireless communication, and this application does not limit this.

[0061] The method for determining interactive resources provided in this application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, assisted driving, and advertising. To facilitate understanding of the method for determining interactive resources provided in the embodiments of this application, the following uses the execution entity of the method for determining interactive resources as a server and the application scenario as an advertising delivery scenario as an example to illustrate the application scenario of the method for determining interactive resources.

[0062] See also Figure 2 , which is a schematic diagram of an application scenario of a method for determining interactive resources provided by an embodiment of the present application. Figure 2 As shown, this application scenario includes a terminal device 210 and a server 220, and the terminal device 210 and the server 220 can communicate with each other via a communication network. The communication network uses standard communication technologies and / or protocols, typically the Internet, but can also be any network, including but not limited to Bluetooth, local area network (LAN), metropolitan area network (MAN), wide area network (WAN), mobile, private network, or any combination of virtual private networks. In some embodiments, customized or dedicated data communication technologies can be used to replace or supplement the above-mentioned data communication technologies.

[0063] Taking the display of video advertisements in a browser client as an example, the browser is installed in the terminal device 210 in the form of a client. In order to enable all types of terminal devices to play interactive resources with large data volumes, the original images included in the dynamic image resources will be processed separately based on preset image processing effects in advance to obtain special effect images corresponding to each original image. After encapsulating them in a dynamic image resource package, they are uploaded to the server 220 serving as the delivery end.

[0064] When a user opens a browser client via terminal device 210, the browser client retrieves a dynamic image resource package from server 220 and decodes the dynamic image resource package to obtain multiple original images and special effect images corresponding to each original image. The rendering process is illustrated using the first target image among the multiple original images as an example. The first target image is rendered to obtain and display the resource to be displayed. Based on the preset control in the special effect image corresponding to the first target image, the preset control is rendered in the image area corresponding to the placement of the resource to be displayed, obtaining and displaying the linkage control corresponding to the resource to be displayed, thereby achieving the display of interactive resources.

[0065] Therefore, users can not only see the information 231 displayed by the browser, but also see the interactive resource 232 in the top header operation position of the information page. The lower layer of the interactive resource is the video 2321, and the upper layer is the preset control 2322. The image processing effect of the preset control has a linkage effect with the video advertisement. The user's visual experience is that the control can be seen through and the video part can be vaguely seen, but it is like a layer of image special effects blocking in the middle, so that the font on the control is clearly visible.

[0066] The method for determining interactive resources provided in the embodiments of the present application can be executed by a terminal device. However, in other embodiments of the present application, the server may have similar functions to the terminal device, thereby executing the method for determining interactive resources provided in the embodiments of the present application, or the terminal device and the server may jointly execute the method for determining interactive resources provided in the embodiments of the present application, and this embodiment does not limit this.

[0067] The following is a detailed introduction to a method for determining interactive resources provided by this application through a system embodiment.

[0068] See also Figure 3 , which is a signaling interaction diagram of a method for determining interactive resources provided by an embodiment of the present application. Figure 3 In the embodiment, the interactive resource determination system includes a first device and a second device. The first device is used to generate a dynamic image resource package, and the second device is used to display the interactive resources obtained based on the dynamic image resource package. For ease of description, the following embodiment is described as an example in which both the first device and the second device are terminal devices. For details, see S301-S309.

[0069] S301: The first device obtains dynamic image resources and image processing effects.

[0070] Dynamic image resources consist of multiple original images, and the changes in these images convey a dynamic visual effect. For example, dynamic images are a sequence of static images or graphics that continuously change gradually, and are displayed sequentially along a timeline to create a visual experience of movement. Such media forms as video and animation can also be used to create a visual experience of movement.

[0071] Image processing effects are effects required for image processing, such as frosted glass effects, water ripple effects, contrast enhancement, color adjustment, transparent video, and various filter effects. The embodiments of the present application do not specifically limit the method for obtaining image processing effects. For example, a user sets dynamic image resources and image processing effects each time through the first device. For another example, after the user pre-sets the desired image processing effect, the first device saves the preset image processing effect and then obtains the image processing effect from the storage location before using the image processing effect.

[0072] It should be noted that in the specific implementation of this application, all collected data (such as dynamic image resources, special effect images, etc.) are subject to separate permission or consent from the object to which the data belongs (such as users, institutions or enterprises), and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0073] S302: The first device performs image processing on the dynamic image resource according to the image processing effect to obtain special effect images corresponding to the multiple original images.

[0074] For example, if the image processing effect is a frosted glass effect, a Gaussian blur calculation may be performed on the dynamic image resource so that the dynamic image resource has a Gaussian blur effect, thereby obtaining a plurality of special effect images with a Gaussian blur effect.

[0075] The embodiments of the present application do not specifically limit the image processing method. Those skilled in the art can set it according to actual needs. The following two methods are used as examples for explanation.

[0076] Method 1 is to divide the dynamic image resource into multiple original images, and then perform image processing on each original image based on the image processing effect to obtain a special effect image corresponding to each original image.

[0077] Method 2: performing image processing on the entire dynamic image resource based on the image processing effect to obtain a special effect image resource with a corresponding effect. The special effect image resource includes multiple special effect images, and the multiple special effect images have a one-to-one correspondence with the multiple original images.

[0078] The embodiment of the present application does not specifically limit the size of the special effect image. Those skilled in the art can set it according to actual needs. The above-mentioned method 1 is taken as an example below to illustrate the two methods.

[0079] Method 1: After dividing the dynamic image resources into multiple original images, the entire image area of ​​each original image is processed separately based on the image processing effect to obtain a special effect image corresponding to each original image, so that the size of the obtained special effect image is consistent with the size of the original image.

[0080] See also Figure 4 , which is a schematic diagram of a special effect image provided by an embodiment of the present application. Figure 4 In the image processing effect, the frosted glass effect is used. Figure 4 The middle (B) figure shows an original image. Figure 4 The image (A) in the middle shows a special effect image with Gaussian blur effect obtained by performing Gaussian blur calculation based on the original image shown in the image (B). It should be noted that Figure 4 The orange shadow in the middle picture (A) indicates that the orange is thrown upward from the lower right.

[0081] Thus, the original image (i.e., the entire image area of ​​the original image) is processed by the image processing effect to obtain the special effect image corresponding to the original image, which is convenient, fast, and simple to produce. Moreover, since the original image and the special effect image are of the same size, it is convenient to splice or split the two later.

[0082] Method 2: Obtain the placement position of a preset control. A preset control is a control that will be placed on a dynamic image resource. The placement position of the preset control is used to identify the placement position of the preset control. The following description uses one of the multiple original images (hereinafter referred to as the second target image for ease of explanation) as an example. After dividing the dynamic image resource into multiple original images, the second target image is cropped according to the placement position of the preset control to obtain a region image corresponding to the placement position. This region image is then processed according to the image processing effect to obtain a special effects image corresponding to the second target image.

[0083] See also Figure 5 , which is a schematic diagram of a special effect image provided by an embodiment of the present application. Figure 5 In the image processing effect, the frosted glass effect is used. Figure 5 The middle (C) figure shows an original image, that is, the second target image, and the preset control placement is Figure 5 The position of the big orange in the middle (C) image can be used to crop the second target image to obtain the area image corresponding to the placement position, such as Figure 5 As shown in Figure (B), then the image processing effect is compared. Figure 5 The image of the region shown in Figure (B) is processed to obtain a special effect image corresponding to the second target image, such as Figure 5 It should be noted that the size of the special effect image can be consistent with the size of the second target image. Figure 5 In the figure, for the convenience of representation, the special effect image is contrasted by black to highlight the Gaussian blur effect.

[0084] The embodiments of the present application do not specifically limit the method for obtaining the placement position of the preset control, and those skilled in the art can set it according to actual needs. For example, the user sets the dynamic image resources, image processing effects and the placement position of the preset control each time through the first device, so that the method and position of the preset control can cooperate with the dynamic image resources, improve the artistic effect, and attract more users. For another example, after the user pre-sets the placement position of the desired preset control, the first device saves the placement position of the preset control, and then obtains the placement position of the preset control from the storage location before performing image processing.

[0085] Thus, by performing image processing on a portion of the original image (i.e., the portion of the original image related to the placement of the preset control) using an image processing effect, a special effects image corresponding to the original image is obtained. This special effects image is smaller in size, and the data volume of the subsequent dynamic image resource package is reduced, thereby increasing the speed of sending and receiving, shortening the time, and reducing bandwidth usage during the subsequent sending and receiving process. Furthermore, the client can process dynamic image resource packages with lower data volume, reducing the processing performance requirements of the device on which the client is installed, increasing versatility, and improving the user experience.

[0086] S303: The first device encodes the multiple original images and the special effect images corresponding to the multiple original images to obtain a dynamic image resource package.

[0087] The dynamic image resource package obtained by encoding not only includes information for identifying the original image and information for identifying the special effect image, but also includes the correspondence between the original image and its corresponding special effect image. For example, the original image and the special effect image corresponding to the original image are spliced ​​and superimposed to obtain a combined image, thereby obtaining multiple combined images based on multiple original images and multiple special effect images. The combined images are then encoded, so that the original image and the special effect image have a correspondence through the combined image. For another example, multiple original images are encoded, multiple special effect images are encoded, and the correspondence between the original images and the special effect images is saved to obtain a dynamic image resource package.

[0088] The following description will be made by taking the splicing method as an example, with reference to S3031-S3033 for details (not shown in the figure).

[0089] S3031: Splicing a second target image in a plurality of original images and a special effect image corresponding to the second target image to obtain a combined image corresponding to the second target image.

[0090] The second target image is one of the original images, and the combined image is an image obtained by splicing an original image and its corresponding special effect image. The present embodiment does not specifically limit the splicing method. For example, the original image and its corresponding special effect image can be spliced ​​left and right, such as Figure 6 As another example, the original image and its corresponding special effect image can be spliced ​​up and down, as shown in Figure 7 shown.

[0091] S3032: Using the multiple original images as second target images respectively, and obtaining combined images corresponding to the respective original images.

[0092] Thus, each original image is spliced ​​with its corresponding special effect image to obtain a combined image corresponding to each original image.

[0093] S3033: Encode the multiple combined images to obtain a dynamic image resource package.

[0094] Each combined image is encoded separately to obtain a dynamic image resource package. It is understandable that if the multiple original images included in the dynamic image resource have a sequential relationship, the multiple combined images in the dynamic image resource package also have a sequential relationship, and the sequential relationship of the combined images is consistent with the sequential relationship of the original images.

[0095] Therefore, by splicing the original image and its corresponding special effect image, the combined image is obtained and then encoded, so that the dynamic image resource package contains the encoding results of multiple combined images, and the combined image includes the original image and the corresponding special effect image, so that the original image and the corresponding special effect image are directly synchronized, which can ensure the synchronization of subsequent rendering and improve the fusion effect between the linkage control and the resources to be displayed. Moreover, the special effect image is obtained in advance and there is no need for subsequent client rendering, which can reduce the processing pressure of the client. While ensuring the processing performance of the device on which the client is installed, it can ensure the fusion effect between the linkage control and the resources to be displayed, thereby improving the user experience.

[0096] Furthermore, compared to resource packages generated by encoding only the original images, dynamic image resource packages generated by encoding combined images have a larger data volume. Even if all combined images are packaged together, a good compression ratio cannot be achieved because image formats such as jpg and png are already compressed. Dynamic image resource packages with larger data volumes result in longer transmission times and greater storage pressure.

[0097] Based on this, an embodiment of the present application provides an encoding method, namely S3033: encoding multiple combined images to obtain a specific implementation method of a dynamic image resource package.

[0098] Specifically, the encoding result of the j-th combined image is obtained, where j is a positive integer. The difference between the j+1-th combined image and the j-th combined image is determined, that is, the difference between the current combined image and the previous combined image is determined. Encoding is performed based on the difference between the j+1-th combined image and the j-th combined image and the encoding result of the j-th combined image to obtain the encoding result of the j+1-th combined image. Since multiple original images with a sequential relationship generally change continuously, the difference between two adjacent original images is small. Similarly, the combined image is obtained based on the original image, and the difference between two adjacent combined images is also small. Therefore, encoding can be performed based on the encoding result of the previous combined image and the difference between two adjacent combined images to obtain the encoding result of the current combined image. By analogy, the encoding results of each combined image are obtained to obtain a dynamic image resource package.

[0099] Therefore, because the multiple combined images have the same sequential relationship as the multiple original images, that is, there is continuity between the multiple combined images, resulting in small differences between adjacent combined images. Therefore, it is not necessary to encode each combined image individually. Instead, encoding can be performed based on the encoding result of the previous combined image and the difference between the current combined image and the previous combined image to obtain the encoding result of the current combined image. This utilizes the similarity between adjacent combined images for encoding, and only one copy of the data is stored for the identical parts of adjacent combined images. This compresses resource size, reduces data storage pressure, shortens transmission time, and improves user experience.

[0100] S304: The first device sends a dynamic image resource package.

[0101] The embodiments of the present application do not specifically limit the receiving end of the dynamic image resource package. For example, the first device may upload the dynamic image resource package to a cloud server so that the client can obtain the dynamic image resource package from the cloud server. In another example, the first device may send the dynamic image resource package directly to the second device.

[0102] As a possible implementation manner, before sending the dynamic image resource package, the first device may further set the resource type of the dynamic image resource package to the target type.

[0103] In related technologies, only the original image may be encoded, or the original image and special effect images may be encoded separately. However, in this application, multiple original images and the special effect images corresponding to the original images are encoded together to obtain a dynamic image resource package. In other words, the dynamic image resource package includes not only the original images, but also the special effect images corresponding to the original images, as well as the corresponding relationship between the original images and the special effect images.

[0104] If the data packet obtained by the client may include the original image, special effect image and the correspondence between the two (i.e., a dynamic image resource package), it may also include only the original image, or include the original image and special effect image. In order to cope with application scenarios with a large number of data packet types, resource types can be set for various data packets. For example, the resource type included in the dynamic image resource can be set as the target type, so that the dynamic image resource can be quickly identified based on the resource type. Therefore, when decoding is performed subsequently, the dynamic image resource package needs to be decoded in a targeted manner.

[0105] Therefore, by setting the resource type for the dynamic image resource package, the client can quickly identify and determine the corresponding decoding method of the dynamic image resource package based on the resource type. This not only improves the accuracy of subsequent rendering, but also does not limit the client to only obtain dynamic image resource packages, expanding the scope of client display content, such as the ability to deliver various types of advertisements, thereby expanding application scenarios.

[0106] S305: The second device obtains a dynamic image resource package.

[0107] The second device can be installed with clients of video, information, browser, communication and other types, and obtain the dynamic image resource package through the client, so as to add preset controls to the dynamic image resources based on the dynamic image resource package.

[0108] As can be seen from the foregoing, the dynamic image resource package includes not only the original image and the special effect image obtained by image processing based on the original image, but also the corresponding relationship between the original image and the special effect image, so as to ensure synchronization.

[0109] S306: The second device decodes the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images.

[0110] A special effects image is an image created by processing a corresponding original image based on a preset image processing effect. The special effects image is used to render a preset control, allowing the rendered linked control to be graphically linked with the displayed resource. To ensure synchronization of the linkage, the special effects image should include the image area corresponding to the placement of the preset control within the displayed resource. This means that the special effects image can be processed based on the entire image area of ​​the original image, or only based on the image area corresponding to the placement of the preset control within the displayed resource.

[0111] The correspondence between the original image and the special effect image can be obtained by splicing the original image and its corresponding special effect image, or by storing the image identifier of the original image and the image identifier of the special effect image in the form of a table, etc. This application does not make any specific restrictions on this.

[0112] Therefore, since the original image is processed in advance by other devices such as the first device, the client of the second device only needs to decode it through the video player included therein, etc., without processing the original image, which reduces the processing pressure of the client, thereby reducing the processing performance requirements of the second device, and can run on all devices, such as low-end mobile devices. Moreover, there is no limit on the size of dynamic image resources, so that users can view interactive resources with larger data volumes, which is more attractive to users. In addition, since the client itself needs to perform decoding operations, the embodiments of the present application do not limit the encoding and decoding methods, and basically most devices support decoding operations, which improves versatility.

[0113] As a possible implementation, if a dynamic image resource package carries a resource type, the client will receive various types of data packets, such as data packets including only original images, original images and special effect images but not including corresponding relationships, etc. If the resource type of the dynamic image resource package is a target type, the dynamic image resource package is decoded according to the decoding method corresponding to the target type. That is, if the resource type is a target type, three elements must be decoded from the dynamic image resource package: multiple original images, multiple special effect images, and the corresponding relationships between the original images and the special effect images, thereby obtaining multiple original images, multiple special effect images, and the corresponding relationships between the original images and the special effect images.

[0114] Therefore, by setting the resource type for the dynamic image resource package, the client can quickly identify and determine the corresponding decoding method for the dynamic image resource package based on the resource type. This not only improves the accuracy of subsequent rendering, but also expands the scope of client display content, allowing for the delivery of various types of advertisements, thereby expanding application scenarios. Moreover, compared to identifying dynamic image resource packages by identifying attributes such as data volume and size, identifying by resource type is more accurate and simpler.

[0115] As a possible implementation, as can be seen from the foregoing, the original image and its corresponding special effect image can be spliced ​​together to form a combined image, thereby encoding the multiple combined images to form a dynamic resource package. Furthermore, to reduce the problem of a larger data volume of the dynamic image resource package obtained by encoding the combined images, encoding is performed based on the encoding result of the previous combined image and the difference between the current combined image and the previous combined image to obtain the encoding result of the current combined image.

[0116] Correspondingly, during decoding, the encoding result corresponding to the i+1th combined image can be obtained from the dynamic resource package. It can be understood that the encoding result corresponding to the i+1th combined image includes the difference between the i+1th combined image and the i-th combined image, as well as the encoding result of the i-th combined image, where i is a positive integer. Based on the difference between the i+1th combined image and the i-th combined image, as well as the encoding result of the i-th combined image, the i+1th combined image is obtained, and the i+1th combined image is split to obtain the i+1th original image and the special effect image corresponding to the i+1th original image. Thus, the encoding results corresponding to each combined image in the dynamic resource package are traversed to obtain multiple original images, multiple special effect images, and the corresponding relationship between the original images and the special effect images.

[0117] Therefore, since the multiple combined images have the same sequential relationship as the multiple original images, that is, there is continuity between the multiple combined images, resulting in a small difference between adjacent combined images. Therefore, it is not necessary to encode each combined image. Encoding can be performed based on the encoding result of the previous combined image and the difference between the current combined image and the previous combined image to obtain the encoding result of the current combined image. During decoding, the current combined image can be restored based on the difference between adjacent combined images included in each encoding result and the encoding result of the previous combined image. Therefore, by utilizing the similarity between adjacent combined images for encoding, the amount of encoding can be reduced, the pressure on data storage can be reduced, the transmission time can be shortened, and the user experience can be improved.

[0118] S307: The second device renders the first target image among the multiple original images to obtain a resource to be displayed.

[0119] In actual applications, preset controls can be added to each of the multiple original images, or preset controls can be added to some of the multiple original images to achieve better promotion effects, etc. This application does not make specific restrictions on this.

[0120] The following example illustrates adding a preset control to one of the multiple original images, namely the first target image. It should be noted that the present embodiment does not specifically limit whether the first target image and the second target image are the same; both are one of the multiple original images.

[0121] Rendering is performed based on the first target image to obtain the resource to be displayed. For example, the first target image is rendered by using Open Graphics Library (OpenGL) to obtain the resource to be displayed.

[0122] S308: The second device renders the preset control in the image area corresponding to the placement position of the resource to be displayed according to the preset control in the special effect image corresponding to the first target image, to obtain a linkage control corresponding to the resource to be displayed.

[0123] Linkage controls are controls with interactive functions, so that users can trigger linkage controls by clicking and other operations while viewing interactive resources, which can achieve the effect of interacting with interactive resources and improve user experience. Moreover, since the effect of rendering linkage controls is to be able to see the resources to be displayed below the linkage controls through the linkage controls, it does not delay the user's correct identification of the linkage control's position, such as the text above the linkage control. Figure 1 shown.

[0124] Therefore, when rendering a preset control, it is necessary to determine the placement position of the preset control, that is, the position of the preset control on the resource to be displayed, and thus determine the image area required for rendering the linkage control based on the placement position of the preset control, that is, the image area is obtained from the special effect image obtained by pre-image processing, the special effect image is obtained based on the original image, and the resource to be displayed is obtained based on the original image, so an image area can be obtained from the special effect image, which is consistent with the image content described in the image area corresponding to the placement position of the preset control on the resource to be displayed.

[0125] The embodiment of the present application does not specifically limit the method of obtaining the linkage control, and two methods are used as examples for explanation below.

[0126] Method 1: The special effect image is obtained by performing image processing on the entire image area of ​​the original image, that is, the special effect image is obtained by performing image processing on the complete original image based on a preset image processing effect, and the complete original image is the entire image area of ​​the original image.

[0127] Based on this, the placement position of the preset control in the resource to be displayed can be obtained. According to the placement position, the special effect image corresponding to the first target image is cropped to obtain the regional image corresponding to the placement position. The preset control is rendered based on the regional image to obtain the linkage control corresponding to the resource to be displayed.

[0128] Thus, the complete original image (i.e., the entire image area of ​​the original image) of the original image is processed through the image processing effect to obtain the special effect image corresponding to the original image, which is convenient, fast, and simple to produce. Moreover, since the original image and the special effect image are of the same size, it is convenient to splice and split the two later. However, when rendering the preset control, only the image area corresponding to the placement position of the preset control, that is, a part of the special effect image, needs to be rendered, and the special effect image corresponding to the first target image needs to be cropped before rendering.

[0129] Method 2: The special effect image is obtained based on the image area corresponding to the placement position of the preset control in the resource to be displayed, that is, the special effect image is an image obtained by performing image processing on part of the original image based on the preset image processing effect, and the part of the original image is the part of the image area corresponding to the placement position of the preset control in the resource to be displayed in the original image.

[0130] Based on this, the size of the special effect image is consistent with the size of the preset control, so the special effect image corresponding to the first target image can be directly rendered into the preset control to obtain the linkage control corresponding to the resource to be displayed.

[0131] Thus, part of the original image (i.e., the part of the image area in the original image related to the placement of the preset control) is processed through the image processing effect to obtain a special effect image corresponding to the original image. The size of the special effect image is relatively small, and the amount of data of the dynamic image resource package subsequently obtained is reduced, thereby increasing the speed of sending and receiving, shortening the time, and reducing the bandwidth occupancy in the subsequent sending and receiving process. Moreover, the client can process the dynamic image resource package with a relatively low data volume, which reduces the processing performance requirements for the device on which the client is installed, has high versatility, and improves the user experience. In addition, the size of the special effect image is consistent with the size of the preset control, so that the special effect image corresponding to the first target image can be directly rendered into the preset control to obtain the linkage control corresponding to the resource to be displayed, which is convenient and quick for the client, and further reduces the performance processing pressure of the client.

[0132] S309: The second device displays the interactive resource.

[0133] The interactive resource includes a resource to be displayed and a linkage control corresponding to the resource to be displayed. The embodiment of the present application does not specifically limit the method of displaying the interactive resource, and two methods are used as examples for description below.

[0134] Method 1: The multiple original images included in the dynamic image resource have a sequential relationship, such as the multiple video frames included in the video have a playback order. Then, the resources to be displayed corresponding to the multiple original images can be displayed in sequence according to the sequential relationship of the multiple original images. In the process of displaying the resources to be displayed, the linkage control corresponding to the resources to be displayed must also be displayed. Taking the resource to be displayed corresponding to one of the multiple original images as the target resource to be displayed as an example, in the process of displaying the target resource to be displayed, the linkage control corresponding to the target resource to be displayed is displayed at the preset position of the target resource to be displayed.

[0135] For example, after the first video frame is displayed, the linkage control is displayed on the first video frame. That is to say, the resource to be displayed and the linkage control are rendered separately, and then displayed separately. As a possible implementation method, although the resource to be displayed and the linkage control are displayed separately, due to the low processing pressure on the client, they can be rendered and displayed separately very quickly, and can be displayed together for the user. It should be noted that if the resource to be displayed corresponding to the current original image is displayed, the resource to be displayed corresponding to the next original image will not be displayed before the linkage control corresponding to the resource to be displayed is displayed, thereby ensuring the synchronization between the linkage control and the resource to be displayed.

[0136] Thus, by separately processing the resources to be displayed and the linkage controls, for example, rendering the original image to obtain the resources to be displayed before displaying them, and rendering the special effects image corresponding to the original image on the preset control to obtain the linkage control before displaying them, and not displaying the next resource to be displayed until the linkage control is fully displayed, the synchronization of the linkage control and the resources to be displayed is ensured during the real-time rendering of dynamic image resources. Moreover, by pre-rendering the special effects images, the client only needs to render the original image and the special effects image, without having to render each original image, which reduces the processing pressure on the client and further ensures the synchronization of the linkage control and the resources to be displayed during the real-time rendering of dynamic image resources.

[0137] Method 2 combines the resource to be displayed and its corresponding linkage control to obtain interactive resources corresponding to multiple original images. Specifically, the linkage control is placed on the resource to be displayed according to the preset control placement, resulting in an interactive resource that includes the resource to be displayed and the linkage control. Furthermore, the multiple original images included in the dynamic image resource are sequentially related, and the interactive resources corresponding to the multiple original images are displayed sequentially according to this sequence.

[0138] Therefore, by first fusing the resources to be displayed and their corresponding linkage controls, multiple interactive resources are obtained and displayed in sequence. This not only ensures the synchronization of the linkage controls and the resources to be displayed, but also reduces the probability of freezes during the display of interactive resources by pre-fusing the interactive resources, improves the display effect of the interactive resources, and enhances the user experience.

[0139] As can be seen from the above technical solution, to reduce subsequent processing pressure, the dynamic image resource package includes not only multiple original images but also special effect images corresponding to each original image. In other words, the original images are pre-processed to obtain the special effect images, eliminating the need for the client to perform further image processing. Obtaining and decoding the dynamic image resource package not only yields the original images and special effect images, but also determines the correspondence between the original images and the special effect images, ensuring that the preset controls and the resources to be displayed can be aligned during the rendering process. Taking the example of adding a preset control to the first target image among multiple original images, the first target image is rendered to obtain the resource to be displayed, and the preset control is rendered according to the special effect image corresponding to the first target image to obtain the linkage control corresponding to the resource to be displayed. The linkage control not only has an interactive function, but also the special effect image of the rendered preset control is obtained by image processing based on the image area corresponding to the placement position of the preset control on the resource to be displayed, so that after the linkage control is placed on the resource to be displayed, the resource to be displayed below the linkage control can be seen through the linkage control, and the user can correctly identify the position of the linkage control, thereby improving the fusion effect of the rendered preset control and the resource to be displayed. When displaying the interactive resource including the resource to be displayed and its corresponding linkage control, the synchronization of the resource to be displayed and its corresponding linkage control is high.

[0140] Therefore, by performing image processing on the original image in advance, the client can obtain multiple original images and special effect images corresponding to each original image by only decoding the acquired dynamic image resource package. While reducing the processing pressure of the client, it can also render the preset controls based on the special effect images at the corresponding positions through the correspondence between the original images and the special effect images to obtain linkage controls, thereby improving the synchronization between the linkage controls and the resources to be displayed, thereby improving the fusion effect of the linkage controls and the resources to be displayed in the interactive resources, thereby avoiding performance problems such as lag, and improving the fusion effect of the controls and dynamic images, thereby improving the user experience.

[0141] In order to facilitate further understanding of the technical solution provided by the embodiments of the present application, the following takes the example of promoting video advertisements on the top header image running position of an information client, and adding a linkage control with a search function and a frosted glass effect to the video advertisement. In this embodiment, the first device and the second device are both terminal devices, and an overall exemplary introduction to the method for determining the interactive resource is given.

[0142] The following first explains the process of creating a dynamic image resource package.

[0143] S1: The first device obtains the video advertisement and special effect video.

[0144] The dynamic image resource is processed based on the image processing effect to obtain special effect images corresponding to the multiple original images. For example, a Gaussian blur effect can be added to a video advertisement using video editing tools such as Adobe Premiere Pro, Final Cut Pro X, Sony Vegas Pro, and iMovie to produce a special effect video. It is understood that a video advertisement includes multiple original images, and a special effect video includes multiple special effect images.

[0145] To facilitate the direct creation of dynamic image resource packages, video editing tools such as Adobe Premiere Pro, Final Cut Pro X, Sony Vegas Pro, iMovie, Jianying, and Format Factory can be used. However, these tools cannot be redeveloped or packaged into a finished product. Manual processing of S2-S6 is required each time, significantly reducing production efficiency. Therefore, the ffmpeg video editing tool can be redeveloped and packaged, allowing designers to import video ads into dynamic image resource packages with a single click.

[0146] In addition, resource promotion users can not only create video ads, but also set one or more combinations of image processing effects and preset control placement positions.

[0147] S2: The first device divides the video advertisement into frames, a plurality of original images, and divides the special effect video into frames, to obtain a plurality of special effect images.

[0148] If you use the secondary development packaged ffmpeg video editing tool, you can use the command "ffmpeg -iinput.mp4 -vf fps=1out%d.png" to implement S2.

[0149] S3: The first device extracts the audio of the video advertisement to obtain an audio resource.

[0150] If you use the secondary development and packaged ffmpeg video editing tool, you can use the command "ffmpeg -iinput.mp4 -vn output.aac" to implement S3.

[0151] S4: The first device splices the second target image in the multiple original images and the special effect image corresponding to the second target image to obtain a combined image corresponding to the second target image.

[0152] If you use the ffmpeg video editing tool (packaged with secondary development), you can use the command "ffmpeg -iinput1_%d.png -iinput2_%d.png -filter_complex hstack output_%d.png" to implement S4. The left side of the combined image is the special effect image, and the right side is the original image.

[0153] The plurality of original images are respectively used as the second target image to obtain the combined images corresponding to the respective original images.

[0154] S5: The first device obtains a combined video according to the multiple combined images.

[0155] If you use the secondary development packaged ffmpeg video editing tool, you can use the command "ffmpeg-framerate 30 -i output_%d.png -c:v libx264-pix_fmt yuv420poutput.mp4" to achieve S5.

[0156] S6: The first device inserts the audio resource into the combined video, encodes the combined video, and obtains a dynamic image resource package.

[0157] If you use the ffmpeg video editing tool that is packaged for secondary development, you can use the command "ffmpeg -ioutput.mp4 -i output.aac -c:v copy -c:a aac final_output.mp4" to implement S6.

[0158] By encapsulating S2-S6, a dynamic image resource package can be automatically obtained, further improving production efficiency. In this way, resource promotion users can directly import the two video resources of S1 into the ffmpeg video editing tool encapsulated by secondary development. The ffmpeg video editing tool encapsulated by secondary development will automatically execute S2-S6 and finally export the dynamic image resource package.

[0159] In addition, you also need to set the resource type included in the dynamic image resource to the target type.

[0160] S7: The first device sends a dynamic image resource package to the delivery server.

[0161] The delivery server is used to configure the delivery conditions of dynamic image resource packages.

[0162] Then the rendering process of the dynamic image resource package is explained.

[0163] S8: The second device obtains a dynamic image resource package.

[0164] S9: If the resource type of the dynamic image resource package is the target type, the second device decodes the dynamic image resource package according to the decoding method corresponding to the target type to obtain multiple original images, multiple special effect images, and the correspondence between the original images and the special effect images.

[0165] It is understandable that the second device includes a video player and a business module, and the video player decodes the dynamic image resource package according to the decoding method corresponding to the target type to obtain multiple original images, multiple special effect images, and the corresponding relationship between the original images and the special effect images. That is to say, during the decoding process, the video player divides the dynamic image resources into two parts, one part is multiple original images, and the other part is multiple special effect images. Moreover, since the multiple video frames included in the video have a playback order, the video player decodes the dynamic image resources according to the playback order during the decoding process, that is, first decodes to obtain the first combined image, and then splits the combined image to obtain the original image and the special effect image corresponding to it.

[0166] S10: The second device renders the first target image among the multiple original images to obtain a resource to be displayed.

[0167] For example, the video player decodes in sequence to obtain a combined image corresponding to the first target image, then splits the combined image to obtain the first target image and a special effect image corresponding to it, and renders the first target image through OpenGL to obtain the resource to be displayed, and displays the resource to be displayed.

[0168] S11: The second device renders the preset control in the image area corresponding to the placement position of the resource to be displayed according to the preset control in the special effect image corresponding to the first target image, to obtain a linkage control corresponding to the resource to be displayed.

[0169] For example, after splitting the composite image corresponding to the first target image to obtain the first target image and the special effect image corresponding to it, the video player sends the special effect image corresponding to the first target image to the business module. The business module obtains the placement position of the preset control in the resource to be displayed, crops the special effect image corresponding to the first target image based on the placement position, obtains the regional image corresponding to the placement position, renders the preset control based on the regional image, obtains the linkage control corresponding to the resource to be displayed, and adds the linkage control to the resource to be displayed, thereby displaying the interactive resource.

[0170] With respect to the above-described method for determining interactive resources, the present application also provides a corresponding apparatus for determining interactive resources, so that the above-described method for determining interactive resources can be applied and implemented in practice.

[0171] See also Figure 8 , which is a structural diagram of a device for determining interactive resources provided by an embodiment of the present application. Figure 8 As shown, the interactive resource determination device 800 includes: an acquisition unit 801, a decoding unit 802, a first rendering unit 803, a second rendering unit 804 and a display unit 805;

[0172] The acquisition unit 801 is used to acquire a dynamic image resource package;

[0173] The decoding unit 802 is configured to decode the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images, wherein the special effect images are images obtained by performing image processing on the original images having the correspondence based on a preset image processing effect;

[0174] The first rendering unit 803 is configured to render a first target image among the plurality of original images to obtain a resource to be displayed;

[0175] The second rendering unit 804 is configured to render the preset control in the image area corresponding to the placement position of the resource to be displayed according to the preset control in the special effect image corresponding to the first target image, to obtain a linkage control corresponding to the resource to be displayed, wherein the linkage control has an interactive function;

[0176] The display unit 805 is configured to display interactive resources, where the interactive resources include the resources to be displayed and linkage controls corresponding to the resources to be displayed.

[0177] It can be seen from the above technical solution that the interactive resource determination device includes: an acquisition unit, a decoding unit, a first rendering unit, a second rendering unit and a display unit. In order to reduce the subsequent processing pressure, the dynamic image resource package includes not only a plurality of original images, but also special effect images corresponding to each original image, that is, the original image is processed in advance to obtain the special effect image, so that the client included in the interactive resource determination device does not need to perform image processing again. By acquiring the dynamic image resource package through the acquisition unit and decoding the dynamic image resource package through the decoding unit, not only the original image and the special effect image can be obtained, but also the correspondence between the original image and the special effect image can be obtained, so as to ensure that the preset controls and the resources to be displayed can be aligned during the rendering process. Taking the example of adding a preset control to the first target image among multiple original images, the first target image is rendered by a first rendering unit to obtain a resource to be displayed, and the preset control is rendered by a second rendering unit according to the special effect image corresponding to the first target image to obtain a linkage control corresponding to the resource to be displayed. The linkage control not only has an interactive function, but also the special effect image of the rendered preset control is obtained by image processing based on the image area corresponding to the placement position of the preset control on the resource to be displayed, so that after the linkage control is placed on the resource to be displayed, the resource to be displayed below the linkage control can be seen through the linkage control, and the user can correctly identify the position of the linkage control, thereby improving the fusion effect of the rendered preset control and the resource to be displayed. When the interactive resource including the resource to be displayed and its corresponding linkage control is displayed by the display unit, the synchronization of the resource to be displayed and its corresponding linkage control is high.

[0178] Therefore, by performing image processing on the original image in advance, the client can obtain multiple original images and special effect images corresponding to each original image by only decoding the acquired dynamic image resource package. While reducing the processing pressure of the client, it can also render the preset controls based on the special effect images at the corresponding positions through the correspondence between the original images and the special effect images to obtain linkage controls, thereby improving the synchronization between the linkage controls and the resources to be displayed, thereby improving the fusion effect of the linkage controls and the resources to be displayed in the interactive resources, thereby avoiding performance problems such as lag, and improving the fusion effect of the controls and dynamic images, thereby improving the user experience.

[0179] As a possible implementation, if the special effect image is an image obtained by performing image processing on a complete original image based on a preset image processing effect, and the complete original image is the entire image area of ​​the original image, then the second rendering unit 804 is specifically configured to:

[0180] Obtaining a placement position of the preset control on the resource to be displayed;

[0181] According to the placement position, cropping the special effect image corresponding to the first target image to obtain a region image corresponding to the placement position;

[0182] The preset control is rendered based on the area image to obtain a linkage control corresponding to the resource to be displayed.

[0183] As a possible implementation, if the special effect image is an image obtained by performing image processing on a portion of the original image based on a preset image processing effect, and the portion of the original image is a portion of the image area corresponding to the placement position of the preset control in the original image at the resource to be displayed, then the second rendering unit 804 is specifically configured to:

[0184] The special effect image corresponding to the first target image is rendered into the preset control to obtain a linkage control corresponding to the resource to be displayed.

[0185] As a possible implementation, if the dynamic image resource package includes multiple combined images, and the combined image is an image obtained by splicing the original image and the special effect image corresponding to the original image, the decoding unit 802 is specifically configured to:

[0186] Obtaining an encoding result corresponding to the (i+1)th combined image from the dynamic resource package, where the encoding result corresponding to the (i+1)th combined image includes a difference between the (i+1)th combined image and the (i)th combined image, and an encoding result of the (i)th combined image, where i is a positive integer;

[0187] Obtaining the (i+1)th combined image according to a difference between the (i+1)th combined image and the (i)th combined image, and an encoding result of the (i)th combined image;

[0188] Splitting the (i+1)th combined image to obtain the (i+1)th original image and a special effect image corresponding to the (i+1)th original image;

[0189] The encoding results corresponding to the combined images in the dynamic resource package are traversed to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images.

[0190] As a possible implementation manner, if the multiple original images have a sequential relationship, then if the multiple original images have a sequential relationship, the display unit 805 is specifically configured to:

[0191] Displaying the resources to be displayed corresponding to the multiple original images in sequence according to the sequential relationship of the multiple original images;

[0192] During the process of displaying the target resource to be displayed, a linkage control corresponding to the target resource to be displayed is displayed at a preset position of the target resource to be displayed, where the target resource to be displayed is a resource to be displayed corresponding to one of the multiple original images.

[0193] As a possible implementation manner, if the multiple original images have a sequential relationship, the display unit 805 is specifically configured to:

[0194] fusing the resource to be displayed and the linkage control corresponding to the resource to be displayed to obtain interactive resources corresponding to a plurality of the original images;

[0195] According to the sequential relationship of the multiple original images, the interactive resources respectively corresponding to the multiple original images are displayed in sequence.

[0196] As a possible implementation, if the dynamic image resource package carries a resource type, the decoding unit 802 is specifically configured to:

[0197] If the resource type of the dynamic image resource package is a target type, the dynamic image resource package is decoded according to the decoding method corresponding to the target type to obtain multiple original images, multiple special effect images, and the corresponding relationship between the original images and the special effect images.

[0198] With respect to the above-described method for determining interactive resources, the present application also provides a corresponding apparatus for determining interactive resources, so that the above-described method for determining interactive resources can be applied and implemented in practice.

[0199] See also Figure 9 , which is a structural diagram of a device for determining interactive resources provided by an embodiment of the present application. Figure 9 As shown, the interactive resource determination device 900 includes: an acquisition unit 901, an image processing unit 902, an encoding unit 903 and a sending unit 904;

[0200] The acquisition unit 901 is used to acquire dynamic image resources and image processing effects, wherein the dynamic image resources include multiple original images;

[0201] The image processing unit 902 is configured to perform image processing on the dynamic image resource according to the image processing effect to obtain special effect images corresponding to a plurality of the original images;

[0202] The encoding unit 903 is configured to encode the plurality of original images and the special effect images corresponding to the plurality of original images to obtain a dynamic image resource package, wherein the original images and the special effect images corresponding to the original images in the dynamic resource package have a corresponding relationship;

[0203] The sending unit 904 is configured to send the dynamic image resource package.

[0204] It can be seen from the above technical solution that the device for determining the interactive resource includes: an acquisition unit, an image processing unit, an encoding unit and a sending unit; the acquisition unit acquires dynamic image resources and image processing effects, and the dynamic image resources include multiple original images; the image processing unit performs image processing on the dynamic image resources according to the image processing effects to obtain special effect images corresponding to the multiple original images, thereby performing image processing on the original images in advance so that the client can perform image processing again later, reducing the processing pressure of the client. The encoding unit encodes the multiple original images and the special effect images corresponding to the multiple original images to obtain a dynamic image resource package, so that the original images in the dynamic resource package and the special effect images corresponding to the original images have a corresponding relationship, so as to ensure that the preset controls and the resources to be displayed can be aligned in the subsequent rendering process. The dynamic image resource package is sent by the sending unit

[0205] Therefore, by performing image processing on the original image in advance, the client can obtain multiple original images and special effect images corresponding to each original image by only decoding the acquired dynamic image resource package. While reducing the processing pressure of the client, it can also encode the original image, special effect image, and the correspondence between the original image and the special effect image, so that the original image in the dynamic resource package and the special effect image corresponding to the original image have a correspondence, so as to ensure that the preset controls and the resources to be displayed can be aligned in the subsequent rendering process, improve the synchronization of the linkage controls and the resources to be displayed, thereby improving the fusion effect of the linkage controls and the resources to be displayed in the interactive resources, thereby avoiding performance problems such as lag while improving the fusion effect of the controls and dynamic images, thereby improving the user experience.

[0206] As a possible implementation, the interactive resource determination device 900 further includes a splicing unit configured to:

[0207] splicing the second target image in the plurality of original images and the special effect image corresponding to the second target image to obtain a combined image corresponding to the second target image;

[0208] Using the plurality of original images as the second target image, respectively, to obtain a combined image corresponding to each of the original images;

[0209] The encoding unit 903 is specifically configured to:

[0210] The plurality of combined images are encoded to obtain the dynamic image resource package.

[0211] As a possible implementation manner, if the plurality of combined images have the same order relationship as the plurality of original images, the encoding unit 903 is specifically configured to:

[0212] Get the encoding result of the j-th combined image, where j is a positive integer;

[0213] determining a difference between the j+1th combined image and the jth combined image;

[0214] performing encoding according to a difference between the j+1th combined image and the jth combined image and an encoding result of the jth combined image to obtain an encoding result of the j+1th combined image;

[0215] The encoding results of each of the combined images are obtained to obtain the dynamic image resource package.

[0216] As a possible implementation, the acquiring unit 901 is further configured to:

[0217] Get the placement position of the preset control;

[0218] The image processing unit 902 is specifically configured to:

[0219] According to the placement position of the preset control, the second target image is cropped to obtain a region image corresponding to the placement position;

[0220] Image processing is performed on the region image according to the image processing effect to obtain a special effect image corresponding to the second target image.

[0221] The embodiment of the present application also provides a computer device, which can be a server or a terminal device. The computer device provided by the embodiment of the present application will be introduced from the perspective of hardware entity. Figure 10 The following is a schematic diagram of the server structure. Figure 11 Shown is a schematic diagram of the structure of the terminal equipment.

[0222] See also Figure 10, this figure is a schematic diagram of a server structure provided in an embodiment of the present application. The server 1400 may have relatively large differences due to different configurations or performances, and may include one or more processors 1422, such as central processing units (CPUs), a memory 1432, and one or more application programs 1442 or a storage medium 1430 for data 1444 (for example, one or more massive storage devices). Among them, the memory 1432 and the storage medium 1430 may be temporary storage or permanent storage. The program stored in the storage medium 1430 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the processor 1422 may be configured to communicate with the storage medium 1430 to execute a series of instruction operations in the storage medium 1430 on the server 1400.

[0223] The server 1400 may also include one or more power supplies 1426, one or more wired or wireless network interfaces 1450, one or more input and output interfaces 1458, and / or one or more operating systems 1441, such as Windows Server 2003. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0224] The steps performed by the server in the above embodiment can be based on the Figure 10 The server structure shown.

[0225] The CPU 1422 is configured to execute the following steps:

[0226] Get dynamic image resource package;

[0227] Decoding the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images, wherein the special effect images are images obtained by performing image processing on the original images having the correspondence based on a preset image processing effect;

[0228] Rendering a first target image among the plurality of original images to obtain a resource to be displayed;

[0229] According to the special effect image corresponding to the first target image, the preset control is rendered in the image area corresponding to the placement position of the resource to be displayed, so as to obtain a linkage control corresponding to the resource to be displayed, wherein the linkage control has an interactive function;

[0230] Display interactive resources, where the interactive resources include the resources to be displayed and linkage controls corresponding to the resources to be displayed.

[0231] Alternatively, the CPU 1422 is configured to execute the following steps:

[0232] Acquire dynamic image resources and image processing effects, wherein the dynamic image resources include multiple original images;

[0233] Performing image processing on the dynamic image resource according to the image processing effect to obtain a plurality of special effect images corresponding to the original images respectively;

[0234] Encoding the plurality of original images and the plurality of special effect images corresponding to the original images to obtain a dynamic image resource package, wherein the original images and the special effect images corresponding to the original images in the dynamic resource package have a corresponding relationship;

[0235] Send the dynamic image resource package.

[0236] Optionally, the CPU 1422 may also execute the method steps of any specific implementation of the method for determining the interactive resources in the embodiments of the present application.

[0237] See also Figure 11 , which is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application. Taking the terminal device as a smart phone as an example, Figure 11 The block diagram shows a partial structure of the smartphone, which includes components such as a radio frequency (RF) circuit 1510, a memory 1520, an input unit 1530, a display unit 1540, a sensor 1550, an audio circuit 1560, a wireless fidelity (WiFi) module 1570, a processor 1580, and a power supply 1590. Those skilled in the art will appreciate that Figure 11 The structure of the smartphone shown in the figure does not constitute a limitation on the smartphone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0238] The following combination Figure 11 A detailed introduction to the various components of a smartphone:

[0239] The RF circuit 1510 may be used for receiving and sending signals during information transmission or calls. In particular, after receiving downlink information from the base station, it is sent to the processor 1580 for processing. In addition, the designed uplink data is sent to the base station.

[0240] The memory 1520 may be used to store software programs and modules. The processor 1580 implements various functional applications and data processing of the smartphone by running the software programs and modules stored in the memory 1520 .

[0241] The input unit 1530 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the smartphone. Specifically, the input unit 1530 may include a touch panel 1531 and other input devices 1532. The touch panel 1531, also known as a touch screen, can collect user touch operations on or near it and drive the corresponding connection device according to a pre-set program. In addition to the touch panel 1531, the input unit 1530 may also include other input devices 1532. Specifically, other input devices 1532 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0242] The display unit 1540 can be used to display information input by the user or information provided to the user, as well as various menus of the smartphone. The display unit 1540 may include a display panel 1541. Optionally, the display panel 1541 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0243] The smartphone may also include at least one sensor 1550, such as a light sensor, a motion sensor, or other sensors. Other sensors that may be included in the smartphone, such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., are not described in detail here.

[0244] Audio circuit 1560, speaker 1561, and microphone 1562 provide an audio interface between the user and the smartphone. Audio circuit 1560 converts received audio data into electrical signals and transmits them to speaker 1561, which then converts them into sound signals for output. Microphone 1562, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 1560 and converted into audio data. The audio data is then processed by processor 1580 and transmitted to, for example, another smartphone via RF circuit 1510, or stored in memory 1520 for further processing.

[0245] Processor 1580 is the control center of the smartphone. It connects all parts of the smartphone using various interfaces and lines. It executes or runs software programs and / or modules stored in memory 1520 and accesses data stored in memory 1520 to perform various functions of the smartphone and process data. Optionally, processor 1580 may include one or more processing units.

[0246] The smartphone also includes a power supply 1590 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1580 through a power management system, thereby managing functions such as charging, discharging, and power consumption through the power management system.

[0247] Although not shown, the smartphone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0248] In the embodiment of the present application, the memory 1520 included in the smart phone can store a computer program and transmit the computer program to the processor.

[0249] The processor 1580 included in the smart phone can execute the method for determining the interactive resources provided in the above embodiment according to the instructions in the computer program.

[0250] An embodiment of the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program is used to execute the method for determining interactive resources provided in the above embodiment.

[0251] The present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method for determining interactive resources provided in various optional implementations of the above aspects.

[0252] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions, and the above-mentioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiments; and the above-mentioned storage medium can be at least one of the following media: read-only memory (English: Read-Only Memory, abbreviated: ROM), RAM, magnetic disk or optical disk, etc., various media that can store computer programs.

[0253] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0254] It should be noted that the various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0255] The above is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Based on the implementation methods provided in the above aspects, the present application can also be further combined to provide more implementation methods. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A method for determining interactive resources, characterized in that: The method comprises: Get dynamic image resource package; Decoding the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images, wherein the special effect images are images obtained by performing image processing on the original images having the correspondence based on a preset image processing effect; Rendering a first target image among the plurality of original images to obtain a resource to be displayed; According to the special effect image corresponding to the first target image, the preset control is rendered in the image area corresponding to the placement position of the resource to be displayed, so as to obtain a linkage control corresponding to the resource to be displayed, wherein the linkage control has an interactive function; Display interactive resources, where the interactive resources include the resources to be displayed and linkage controls corresponding to the resources to be displayed.

2. The method according to claim 1, characterized in that If the special effect image is an image obtained by performing image processing on a complete original image based on a preset image processing effect, and the complete original image is the entire image area of ​​the original image, then, in the special effect image corresponding to the first target image, the preset control is rendered in the image area corresponding to the placement position of the resource to be displayed, to obtain a linkage control corresponding to the resource to be displayed, including: Obtaining a placement position of the preset control on the resource to be displayed; According to the placement position, cropping the special effect image corresponding to the first target image to obtain a region image corresponding to the placement position; The preset control is rendered based on the area image to obtain a linkage control corresponding to the resource to be displayed.

3. The method according to claim 1, characterized in that If the special effect image is an image obtained by performing image processing on a portion of the original image based on a preset image processing effect, and the portion of the original image is a portion of an image area corresponding to the placement position of the preset control in the original image, then rendering the preset control in the image area corresponding to the placement position of the resource to be displayed in the special effect image corresponding to the first target image to obtain a linkage control corresponding to the resource to be displayed includes: The special effect image corresponding to the first target image is rendered into the preset control to obtain a linkage control corresponding to the resource to be displayed.

4. The method according to claim 1, wherein If the dynamic image resource package includes multiple combined images, and the combined images are images obtained by splicing the original image and the special effect images corresponding to the original image, decoding the dynamic image resource package to obtain the multiple original images, the multiple special effect images, and the corresponding relationship between the original images and the special effect images includes: Obtaining an encoding result corresponding to the (i+1)th combined image from the dynamic resource package, where the encoding result corresponding to the (i+1)th combined image includes a difference between the (i+1)th combined image and the (i)th combined image, and an encoding result of the (i)th combined image, where i is a positive integer; Obtaining the (i+1)th combined image according to a difference between the (i+1)th combined image and the (i)th combined image, and an encoding result of the (i)th combined image; Splitting the (i+1)th combined image to obtain the (i+1)th original image and a special effect image corresponding to the (i+1)th original image; The encoding results corresponding to the combined images in the dynamic resource package are traversed to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images.

5. The method according to claim 1, wherein If the plurality of original images have a sequential relationship, the display interaction resource includes: Displaying the resources to be displayed corresponding to the multiple original images in sequence according to the sequential relationship of the multiple original images; During the process of displaying the target resource to be displayed, a linkage control corresponding to the target resource to be displayed is displayed at a preset position of the target resource to be displayed, where the target resource to be displayed is a resource to be displayed corresponding to one of the multiple original images.

6. The method according to claim 1, characterized in that If the plurality of original images have a sequential relationship, the display interaction resource includes: fusing the resource to be displayed and the linkage control corresponding to the resource to be displayed to obtain interactive resources corresponding to a plurality of the original images; According to the sequential relationship of the multiple original images, the interactive resources respectively corresponding to the multiple original images are displayed in sequence.

7. The method according to claim 1, characterized in that If the dynamic image resource package carries a resource type, decoding the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images includes: If the resource type of the dynamic image resource package is a target type, the dynamic image resource package is decoded according to the decoding method corresponding to the target type to obtain multiple original images, multiple special effect images, and the corresponding relationship between the original images and the special effect images.

8. A method for determining interactive resources, characterized in that: The method comprises: Acquire dynamic image resources and image processing effects, wherein the dynamic image resources include multiple original images; Performing image processing on the dynamic image resource according to the image processing effect to obtain a plurality of special effect images corresponding to the original images respectively; Encoding the plurality of original images and the special effect images corresponding to the plurality of original images to obtain a dynamic image resource package, wherein the original images and the special effect images corresponding to the original images in the dynamic resource package have a corresponding relationship; Send the dynamic image resource package.

9. The method according to claim 8, characterized in that The method further comprises: splicing the second target image in the plurality of original images and the special effect image corresponding to the second target image to obtain a combined image corresponding to the second target image; Using the plurality of original images as the second target image, respectively, to obtain a combined image corresponding to each of the original images; The step of encoding the plurality of original images and the special effect images respectively corresponding to the plurality of original images to obtain a dynamic image resource package includes: The plurality of combined images are encoded to obtain the dynamic image resource package.

10. The method according to claim 9, characterized in that If the plurality of combined images have the same order relationship as the plurality of original images, encoding the plurality of combined images to obtain the dynamic image resource package includes: Get the encoding result of the j-th combined image, where j is a positive integer; determining a difference between the j+1th combined image and the jth combined image; performing encoding according to a difference between the j+1th combined image and the jth combined image and an encoding result of the jth combined image to obtain an encoding result of the j+1th combined image; The encoding results of each of the combined images are obtained to obtain the dynamic image resource package.

11. The method according to claim 8, characterized in that The method further comprises: Get the placement position of the preset control; The performing image processing on the dynamic image resource according to the image processing effect to obtain a plurality of special effect images corresponding to the original images respectively includes: According to the placement position of the preset control, the second target image is cropped to obtain a region image corresponding to the placement position; Image processing is performed on the region image according to the image processing effect to obtain a special effect image corresponding to the second target image.

12. A device for determining interactive resources, characterized in that: The device includes: an acquisition unit, a decoding unit, a first rendering unit, a second rendering unit and a display unit; The acquisition unit is used to acquire a dynamic image resource package; The decoding unit is configured to decode the dynamic image resource package to obtain a plurality of original images, a plurality of special effect images, and a correspondence between the original images and the special effect images, wherein the special effect images are images obtained by performing image processing on the original images having the correspondence based on a preset image processing effect; The first rendering unit is configured to render a first target image among the plurality of original images to obtain a resource to be displayed; The second rendering unit is configured to render the preset control in the image area corresponding to the placement position of the resource to be displayed according to the preset control in the special effect image corresponding to the first target image, to obtain a linkage control corresponding to the resource to be displayed, wherein the linkage control has an interactive function; The display unit is used to display interactive resources, and the interactive resources include the resources to be displayed and linkage controls corresponding to the resources to be displayed.

13. A device for determining interactive resources, characterized in that: The device includes: an acquisition unit, an image processing unit, an encoding unit and a sending unit; The acquisition unit is used to acquire dynamic image resources and image processing effects, wherein the dynamic image resources include multiple original images; The image processing unit is configured to perform image processing on the dynamic image resource according to the image processing effect to obtain special effect images corresponding to a plurality of the original images respectively; The encoding unit is configured to encode the plurality of original images and the special effect images corresponding to the plurality of original images to obtain a dynamic image resource package, wherein the original images and the special effect images corresponding to the original images in the dynamic resource package have a corresponding relationship; The sending unit is used to send the dynamic image resource package.

14. A system for determining interactive resources, characterized in that: The system includes a first device and a second device; The first device is configured to execute the method according to any one of claims 8 to 11; The second device is used to execute the method according to any one of claims 1 to 7.

15. A computer device, characterized in that: The computer device includes a processor and a memory: The memory is used to store a computer program and transmit the computer program to the processor; The processor is configured to execute the method according to any one of claims 1 to 7 or the method according to any one of claims 8 to 11 according to the computer program.

16. A computer-readable storage medium, characterized in that The computer-readable storage medium is used to store a computer program, and the computer program is used to execute the method according to any one of claims 1 to 7, or execute the method according to any one of claims 8 to 11.

17. A computer program product comprising a computer program, characterized in that When the method is executed on a computer device, the computer device is enabled to execute the method according to any one of claims 1 to 7 or the method according to any one of claims 8 to 11.

Images