Virtual resource processing method and apparatus, and electronic device and storage medium

Abstract

The embodiments of the present disclosure relate to a virtual resource processing method and apparatus, and an electronic device and a storage medium. The virtual resource processing method comprises: in response to a target trigger operation, determining an image to be processed comprising a target resource action object and a resource identifier of a target virtual resource having color attributes; on the basis of the image to be processed and the resource identifier, generating a resource application request, and sending the resource application request to a server, wherein the resource application request is used for triggering the server to apply a resource package of the target virtual resource to the target resource action object, and to generate and feed back an initial effect image; displaying the initial effect image and an adjustment control for the color attributes; in response to a trigger operation for the adjustment control, determining an adjustment coefficient; and on the basis of the adjustment coefficient, performing fusion processing on the image to be processed and the initial effect image, so as to generate a target effect image. In this way, a target effect image having a plurality of color attribute values can be obtained by means of sending a resource application request to a server only once, thereby improving the application efficiency of a target virtual resource.

Description

Virtual resource processing method and device, electronic device, and storage medium

[0001] Cross-reference to Related Applications

[0002] This application claims priority to Chinese Patent Application No. 202411289106.8, filed on September 13, 2024, the disclosure of which is incorporated herein in its entirety as part of the present application. TECHNICAL FIELD

[0003] The present disclosure relates to a virtual resource processing method, device, electronic device, and storage medium. BACKGROUND

[0004] With the continuous development of image / video technology, more and more users like to use virtual resources (such as virtual items such as electronic stickers, hats, special effects makeup, special effects scenes, etc.) before and after shooting to enhance the visual effect of the image / video they shoot and improve the interest.

[0005] Among various virtual resources, there is a type of virtual resource with a color attribute. Since virtual resources are all designed by developers in advance, the color attribute value of each virtual resource is also fixed and cannot be adjusted. Based on this, in the process of using virtual resources with a color attribute, the user needs to send an application request to the server corresponding to the virtual resource every time the user wants to use a virtual resource with a different color attribute value, and obtain an effect image of the virtual resource application after the server applies the virtual resource. This will result in long application time and low efficiency of the virtual resource, and even cause the virtual resource application to fail when the network condition is poor. SUMMARY

[0006] To solve the above technical problems, the embodiments of the present disclosure provide a virtual resource processing method, device, electronic device, and storage medium.

[0007] In a first aspect, the embodiments of the present disclosure provide a virtual resource processing method, which comprises:

[0008] In response to a target trigger operation, determining a to-be-processed image and a resource identifier of a target virtual resource; wherein the to-be-processed image comprises a target resource action object; the target virtual resource is a virtual resource with a color attribute;

[0009] Based on the to-be-processed image and the resource identifier, generating a resource application request and sending the resource application request to a server; wherein the resource application request is used to trigger the server to apply a resource package of the target virtual resource to the target resource action object, generate and feed back an initial effect image;

[0010] display the initial effect image and the adjustment control of the color attribute;

[0011] determine an adjustment coefficient in response to a triggering operation on the adjustment control;

[0012] perform fusion processing on the initial effect image and the to-be-processed image based on the adjustment coefficient to generate a target effect image.

[0013] In a second aspect, the embodiments of the present disclosure further provide a virtual resource processing apparatus, which comprises:

[0014] a resource identifier determination module configured to determine a resource identifier of a to-be-processed image and a target virtual resource in response to a target triggering operation, wherein the to-be-processed image comprises a target resource action object, and the target virtual resource is a virtual resource with a color attribute;

[0015] an initial effect image request module configured to generate a resource application request based on the to-be-processed image and the resource identifier, and send the resource application request to a server, wherein the resource application request is used to trigger the server to apply a resource package of the target virtual resource to the target resource action object, and generate and feed back an initial effect image;

[0016] an initial effect image display module configured to display the initial effect image and an adjustment control of the color attribute;

[0017] an adjustment coefficient determination module configured to determine an adjustment coefficient in response to a triggering operation on the adjustment control;

[0018] a target effect image generation module configured to perform fusion processing on the initial effect image and the to-be-processed image based on the adjustment coefficient to generate a target effect image.

[0019] In a third aspect, the embodiments of the present disclosure further provide an electronic device, which comprises:

[0020] a processor;

[0021] a memory configured to store executable instructions;

[0022] wherein the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the virtual resource processing method described in any of the embodiments of the present disclosure.

[0023] In a fourth aspect, the embodiments of the present disclosure further provide a computer readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor implements the virtual resource processing method described in any of the embodiments of the present disclosure.

[0024] In a fifth aspect, the present disclosure also provides a computer program product configured to perform the virtual resource processing method according to any of the embodiments of the present disclosure.

[0025] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present disclosure are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation portal for user to choose authorization or refusal. BRIEF DESCRIPTION OF DRAWINGS

[0026] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic, and the original and elements are not necessarily drawn according to the scale.

[0027] FIG. 1 is a flow diagram of a virtual resource processing method according to an embodiment of the present disclosure;

[0028] FIG. 2 is an interactive interface diagram of applying a target virtual resource according to an embodiment of the present disclosure;

[0029] FIG. 3 is a schematic diagram of image fusion according to an embodiment of the present disclosure;

[0030] FIG. 4 is a flow diagram of another virtual resource processing method according to an embodiment of the present disclosure;

[0031] FIG. 5 is an interactive interface diagram of applying a target virtual resource according to an embodiment of the present disclosure;

[0032] FIG. 6 is a schematic diagram of another image fusion according to an embodiment of the present disclosure;

[0033] FIG. 7 is a structural diagram of a virtual resource processing apparatus according to an embodiment of the present disclosure; and

[0034] FIG. 8 is a structural diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It is understood that the drawings of the present disclosure and the embodiments are for exemplary purposes only and are not intended to limit the scope of the present disclosure.

[0036] It should be understood that each step recited in the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0037] The term "comprising" and variations thereof as used herein are used inclusively, i.e., "comprising but not limited to." The term "based on" is "based, at least in part, on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments." Related definitions are given below in the description of the other terms.

[0038] It should be noted that the terms "first", "second", and the like in the present disclosure are merely intended to distinguish different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.

[0039] It should be noted that the adjectives "one", "more" in the present disclosure are illustrative rather than limiting, and those skilled in the art should understand that, unless otherwise explicitly stated in the context, it should be understood as "one or more".

[0040] The names of the messages or information exchanged between the devices in the embodiments of the present disclosure are merely for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0041] The virtual resource processing method provided by the embodiments of the present disclosure can be applied to a shooting scene or a post-processing scene of an image / video of a virtual resource with a color attribute. The method can be executed by a virtual resource processing apparatus, which can be implemented in software and / or hardware, and can be integrated into an electronic device with image processing functions. For example, the electronic device can be an electronic device installed with a shooting program or a post-processing program of an image / video. The electronic device can include, but is not limited to, a smart phone, a Tablet PC, a PDA, a notebook computer, a desktop computer, and the like.

[0042] FIG. 1 shows a flowchart of a virtual resource processing method according to an embodiment of the present disclosure. As shown in FIG. 1, the virtual resource processing method can include the following steps:

[0043] S110, in response to a target trigger operation, determining a to-be-processed image and a resource identifier of a target virtual resource.

[0044] For example, the target trigger operation is an interactive operation for triggering the execution of a virtual resource application function. The to-be-processed image is an image to which a virtual resource is to be applied, which can be a single image or a frame of a video. The to-be-processed image can be a real-time collected image or an already collected image. The to-be-processed image includes one or more target resource action objects. The target resource action object is an entity object in the to-be-processed image, which is a specific action object of the virtual resource, for example, a part of a person (such as the head) or some wearing articles of a person, and the like. The target virtual resource is a virtual resource with a color attribute, for example, a hair color virtual resource, a clothing virtual resource, a sticker virtual resource, and the like. The resource identifier is information that can uniquely locate a certain target virtual resource, for example, a resource name or a resource number of the target virtual resource.

[0045] For example, the user can start the virtual resource processing function through the client. For example, the user opens the application / webpage of the virtual resource processing and starts the virtual resource processing function for post-processing; for another example, the user opens the camera to take a real-time photo or record a video, etc. The client can determine the image to be processed in response to the target trigger operation of the user. For example, the user performs the trigger operation of opening the camera to take a photo, and the image displayed by the camera during image acquisition is the image to be processed; for another example, the user performs the trigger operation of selecting an image from the album, and the image selected by the user becomes the image to be processed. The client can display the image to be processed, as shown in FIG. 2. For the hair color special effect resource, the image to be processed contains a person, and the person is the target resource action object to which the hair color virtual resource can be applied.

[0046] For example, the client can continue to determine the resource identifier of the target virtual resource according to the target trigger operation of the user. For example, when the user opens the camera or starts the virtual resource processing function for post-processing, the client can display a default target virtual resource, and then determine the resource identifier of the default target virtual resource. For another example, the client can display the display information (such as the name or the displayed thumbnail image, etc.) of a plurality of target virtual resources, and after the user selects one of the display information, the client determines the resource identifier of the target virtual resource corresponding to the selected display information.

[0047] In some embodiments, in S110, in response to the target trigger operation, the resource identifier of the target virtual resource is determined, including: displaying a plurality of resource images of target virtual resources; and in response to a trigger operation on any resource image, determining the resource identifier of the target virtual resource corresponding to the triggered resource image.

[0048] For example, the resource image is the display information of the target virtual resource in the form of a picture, for example, it can be a thumbnail of the application effect of the target virtual resource.

[0049] For example, taking the hair color virtual resource as an example, referring to (a) in FIG. 2, after the user selects the “hair color” virtual resource, the client can display a plurality of resource images of hair color virtual resources (hair color 1, hair color 2, hair color 3, hair color 4, …). When the user selects one of the resource images 210, the client can determine the resource identifier of the hair color virtual resource corresponding to the selected resource image 210.

[0050] S120, generating a resource application request based on the image to be processed and the resource identifier, and sending the resource application request to the server; the resource application request is used to trigger the server to apply the resource package of the target virtual resource to the target resource action object, generate and feed back an initial effect image.

[0051] For example, the initial effect image is an image of a resource application effect generated after a target virtual resource is applied to the to-be-processed image. For example, the initial effect image can be an image of an overall effect generated after a hair color resource effect selected by a user is applied to a character in the to-be-processed image.

[0052] For example, the client can package the to-be-processed image and the resource identifier into a resource application request and send the resource application request to the server. The server can identify the to-be-processed image to determine a target resource acting object in the to-be-processed image. Then, the server can download a resource package according to the resource identifier included in the resource application request, and call a related algorithm to apply the resource package to the target resource acting object in the to-be-processed image to generate an initial effect image. Subsequently, the server feeds back the initial effect image to the client.

[0053] S130, display the initial effect image and an adjustment control of the color attribute.

[0054] For example, the adjustment control is an interactive control for adjusting the attribute value of the color attribute, for example, can be a combination control of a slide bar and a slider, can be an input control capable of receiving input information, can be a drop-down box, can be a selection box for displaying selectable information, and the like.

[0055] For example, as shown in (a) of FIG. 2, the client can display the initial effect image 220 received by the client and the adjustment control 230 of the color attribute.

[0056] S140, determine an adjustment coefficient in response to a triggering operation on the adjustment control.

[0057] For example, the user can perform an interactive operation matching the interactive mode of the adjustment control to determine the adjustment coefficient of the color attribute. For example, when the adjustment control is a combination control of a slide bar and a slider, the user can determine the adjustment coefficient by dragging the slider; when the adjustment control is a drop-down box, the user can click the drop-down box and select an item therefrom as the adjustment coefficient; when the adjustment control is an input control, the user can input a numerical value in a given numerical range as the adjustment coefficient, and the like.

[0058] Referring to FIG. 2(a), the user can drag the slider in the adjustment control 230, and when the user stops dragging, the slider is positioned at 34%, so the adjustment coefficient can be determined as 34%.

[0059] S150, perform fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient to generate a target effect image.

[0060] For example, the target effect image is an effect image generated by color adjustment on the target virtual resource application effect in the initial effect image.

[0061] For example, the to-be-processed image is an original image without the target virtual resource applied, and the display effect of the virtual resource in the original image can be considered as 0%. The initial effect image is a result image with the target virtual resource applied, and the display effect of the virtual resource in the initial effect image can be considered as 100%. Then, the degree of the display effect of the virtual resource that the user wants to achieve can be determined by adjusting the coefficient (with a value range of 0% to 100%). Then, the to-be-processed image with a display effect of 0% and the initial effect image with a display effect of 100% are fused to achieve the display effect of the virtual resource corresponding to the coefficient. In this way, when the user adjusts the display effect of the target virtual resource within the range of the display effect of 100% of the initial effect image, the resource application request does not need to be sent to the server, but the image fusion processing can be performed locally, thereby saving the resources and time consumed in the interaction with the server, and the application efficiency of the target virtual resource can be improved.

[0062] In some embodiments, S150 includes determining the adjustment coefficient as a first weight corresponding to the initial effect image, and determining a second weight corresponding to the to-be-processed image based on the total weight and the first weight; and performing weighted fusion processing on the initial effect image and the to-be-processed image based on the first weight and the second weight, respectively, to generate the target effect image.

[0063] For example, the adjustment coefficient is the effect that the user wants to achieve on the basis of the virtual resource application effect of 100%, and therefore, the adjustment coefficient can be converted into the weight (i.e., the first weight) of the initial effect image. For example, the adjustment coefficient is 34%, and therefore, the first weight is 0.34. Then, the difference between the total weight (e.g., 1) and the first weight is used as the weight (i.e., the second weight) of the to-be-processed image. Finally, the initial effect image and the to-be-processed image are added with weights, respectively, and the result is the target effect image.

[0064] Referring to FIG. 3, the target effect image corresponding to the 34% hair color virtual resource = the to-be-processed image corresponding to the 0% hair color virtual resource * (1-adjustment coefficient) + the initial effect image corresponding to the 100% hair color resource object * adjustment coefficient.

[0065] After the client calculates the target effect image, the target effect image can be used to replace the initial effect image to show the target effect image to the user, as shown in (b) of FIG. 2.

[0066] It should be noted that, as shown in (b) of FIG. 2, the client can still display the adjustment control after displaying the target effect image, and the adjustment control displays the last selected adjustment coefficient. In this way, the user can continue to trigger the adjustment control to continue to adjust the display effect of the hair color virtual resource.

[0067] In some embodiments, S150 comprises: determining a first pixel transformation relationship between the to-be-processed image and the initial effect image; and performing pixel interpolation processing on the to-be-processed image and the initial effect image based on the adjustment coefficient and the first pixel transformation relationship to generate the target effect image.

[0068] For example, the first pixel transformation relationship is used to describe a pixel calculation relationship between two images, which can be used to convert one image calculation into another image. The first pixel transformation relationship can be a linear calculation relationship or a nonlinear calculation relationship.

[0069] For example, the server or the client can calculate the first pixel transformation relationship between the to-be-processed image and the initial effect image according to the pixel value distribution of the two images. Then, the target effect image is generated by performing pixel interpolation processing on the to-be-processed image and the initial effect image based on the adjustment coefficient and the first pixel transformation relationship.

[0070] For example, the to-be-processed image can be converted into a three-dimensional curved surface in space, and the initial effect image can be converted into another three-dimensional curved surface in space based on the same conversion rule, and the two three-dimensional curved surfaces coincide in the area except the target resource action object. Then, a new three-dimensional curved surface can be interpolated between the two three-dimensional curved surfaces according to the adjustment coefficient and the first pixel transformation relationship between the two three-dimensional curved surfaces. The target effect image can be obtained by converting the new three-dimensional curved surface to the image space.

[0071] The virtual resource processing method provided by the above embodiments of the present disclosure can respond to a target trigger operation, determine a to-be-processed image and a resource identifier of a target virtual resource with a color attribute, generate a resource application request based on the to-be-processed image and the resource identifier, and send the resource application request to a server to obtain an initial effect image of the target virtual resource, display the initial effect image and an adjustment control for adjusting the color attribute of the target virtual resource, determine an adjustment coefficient in response to a trigger operation on the adjustment control, and perform fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient to generate a target effect image. The image fusion processing of the to-be-processed image and the initial effect image of the target virtual resource is performed on the client side according to the adjustment coefficient, the target effect image of the resource application effect as if the color attribute of the target virtual resource is adjusted is obtained, and thus the resource application request can be sent to the server only once, the target effect image corresponding to multiple color attribute values of the target virtual resource can be obtained, the communication frequency with the server in the target virtual resource application process is reduced, the application time consumption of the target virtual resource is saved, the application success rate and the application efficiency of the target virtual resource are improved, and the user experience is greatly improved.

[0072] FIG. 4 is a flow diagram of another virtual resource processing method according to an embodiment of the present disclosure. The virtual resource processing method is mainly for the case where multiple target resource action objects in a to-be-processed image are applied with a target virtual resource. On this basis, a process of adjusting the color attribute of the application and display effect of the target virtual resource for the selected target resource action object can be added. In addition, the target virtual resource will be taken as an example to be illustrated in subsequent embodiments, but it is not a limitation of the target virtual resource in the embodiments of the present disclosure.

[0073] Referring to FIG. 4, the virtual resource processing method specifically includes the following steps:

[0074] S401, the client determines a to-be-processed image in response to a target trigger operation, and displays resource images of multiple chromogenic virtual resources.

[0075] S402, the client determines a triggered initial resource action object as a target resource action object in response to a trigger operation on any initial resource action object, and determines object position information of the target resource action object.

[0076] For example, the initial resource action object is an object contained in the to-be-processed image and applicable to the target virtual resource, such as a person object or a face object of a person. The object position information is information representing the position of the target resource action object in the to-be-processed image. The object position information may, for example, be a relative position relationship of the target resource action object relative to other objects around it, or absolute position information of the target resource action object in the image. Illustratively, the object position information is the coordinates of the object frame of the target resource action object. For example, the target resource action object is a face of a person, and the object position information can be the coordinates of the region frame circumscribing the face region.

[0077] For example, when multiple initial resource action objects are contained in the to-be-processed object, the user can select any one of them for application of the target virtual resource. Then, the client can take the initial resource action object selected by the user as the target resource action object. Referring to FIG. 5(a), the to-be-processed image displayed by the client has multiple person face objects, and the user can perform a selection operation on any one of them to circumscribe an example selection result with a square frame. After recognizing the selection operation of the user, the client can take the person face object selected by the user as the target resource action object.

[0078] In addition, in order to ensure correct application of the target virtual resource in the case of multiple target resource action objects, the client can obtain the object position information of the target resource action object.

[0079] S403, in response to the triggering operation on any resource image, the client determines the resource identifier of the target virtual resource corresponding to the triggered resource image, and establishes the corresponding relationship between the object position information and the resource identifier.

[0080] For example, after the user selects the target resource action object, the user can further select the target virtual resource to be applied to the resource action object. Therefore, the user can select the resource image of the target virtual resource displayed by the client. After the client detects the triggering operation of the user on any resource image, the client determines the resource identifier of the target virtual resource corresponding to the triggered resource image. For example, referring to (a) in FIG. 5, after the user performs the triggering operation on the resource image of "hair color 1", the client can determine the resource identifier of "hair color 1". Moreover, the client establishes the corresponding relationship between the resource identifier and the object position information of the target resource action object determined in the previous step, so as to ensure that the target virtual resource can be correctly applied to the target resource action object.

[0081] If the user only selects one target resource action object for the application of the target virtual resource, the subsequent operations of S404-S411 can be continued.

[0082] If the user needs to select multiple target resource action objects for the application of the target virtual resource, the above S402-S403 can be repeatedly executed until the user completes the selection operation. At this time, the client can obtain multiple corresponding relationships.

[0083] It should be noted that the target virtual resources corresponding to the target resource action objects can be the same or different.

[0084] S404, the client generates a resource application request based on the to-be-processed image and the corresponding relationship, and sends the resource application request to the server.

[0085] For example, the client packs the to-be-processed image and the above corresponding relationship into a resource application request, and sends the resource application request to the server.

[0086] S405, the server identifies the initial resource action object of the to-be-processed image, determines multiple candidate position information, and determines the target position information from each candidate position information based on the object position information in the corresponding relationship in the resource application request.

[0087] For example, after receiving the resource application request, the server performs object recognition processing on the to-be-processed image in the resource application request to identify object position information of each initial resource action object as candidate position information. Then, the server matches (e.g., calculates the intersection-over-union) each candidate position information with the object position information in each corresponding relationship in the resource application request to filter target position information matching the object position information from each candidate position information. In this way, the server can determine the position of the target resource action object more accurately, thereby improving the accuracy of subsequent virtual resource application.

[0088] It should be noted that the server can also directly use the object position information in each corresponding relationship as the target position information.

[0089] S406, the server downloads the resource package of the corresponding target virtual resource based on the resource identifier in the corresponding relationship, and applies the resource package to the target resource action object corresponding to the target position information to generate an initial effect image of the to-be-processed image.

[0090] For example, the server performs the same virtual resource application processing for each corresponding relationship: downloads the corresponding resource package according to the resource identifier in the corresponding relationship, and calls the related algorithm to apply the resource package to the target resource action object at the target position information corresponding to the object position information indicated by the corresponding relationship to obtain the rendering result of the corresponding target virtual resource application. After each corresponding relationship is processed, the server can obtain an initial effect image in which each target resource action object is applied with the target virtual resource adapted thereto.

[0091] S407, the server generates an object mask based on the target position information and the to-be-processed image, and feeds back the object mask and the initial effect image.

[0092] For example, the object mask is a binary image in which the value in the range of the target resource action object is 1 and the value in the image area outside the range is 0.

[0093] For example, in order for the client to adjust the virtual resource application effect of different color attribute values for each target resource action object, the server can obtain the object mask of each target resource action object according to the obtained target position information and the to-be-processed image. In this way, the server can generate the same number of object masks after the user selects several target resource objects for target virtual resource application processing.

[0094] For example, after generating the object mask, the server feeds back each object mask and the initial effect image to the client.

[0095] S408, the client displays the initial effect image including the plurality of target resource action objects.

[0096] For example, after receiving the initial effect image, the client displays the initial effect image in a display interface of the client, as shown in (b) of FIG. 5. The user applies different hair color virtual resources to the two person objects in the image to be processed in (a) of FIG. 5, and thus the initial effect image in (b) of FIG. 5 can show the application effects of the virtual resources applied to the two person objects respectively.

[0097] Through the above setting of S401-S408, the client can apply different target virtual resources to the multiple target resource application objects in the image to be processed, improve the flexibility and application efficiency of virtual resource application, and further improve the user experience.

[0098] S409. The client determines an adjustment control corresponding to the triggered target resource application object in response to the triggering operation on any target resource application object.

[0099] For example, the client provides a color adjustment function for each target resource application object. When the user adjusts the display effect of the target virtual resource with respect to any target resource application object, the user can first select the target resource application object. When the client detects the selection operation, the client displays the adjustment control corresponding to the target resource application object. Then, S410-S411 can be executed to adjust the display effect of the target resource application object.

[0100] S410. The client determines an adjustment coefficient in response to the triggering operation on the adjustment control.

[0101] S411. The client performs fusion processing on the image to be processed and the initial effect image based on the adjustment coefficient and the target object mask to generate a target effect image.

[0102] For example, the target object mask is the object mask of the triggered target resource application object.

[0103] For example, after determining the adjustment coefficient, the client can determine the target object mask of the target resource application object corresponding to the adjustment coefficient from the plurality of object masks received. Then, by applying the target object mask to the image to be processed and the initial effect image, and combining the adjustment coefficient, the client performs fusion processing on the two images after the mask processing to obtain the adjustment result of the application effect of the target virtual resource of the target resource application object corresponding to the target object mask, while retaining the pixel values of the image regions of the initial effect image except the target resource application object, to obtain the target effect image.

[0104] It should be noted that if the user wants to adjust the display effect of multiple target resource action objects in the initial effect image, and / or the user wants to adjust the display effect of a target resource action object multiple times, the above processes S409-S411 can be repeated. In this way, through the setting of S409-S411, independent adjustment of the color display effect of the target virtual resource of any one of the multiple target resource action objects in the initial effect image can be realized on the client side, thereby further improving the flexibility and efficiency of the color display effect adjustment of the target virtual resource on the basis of reducing the application time and improving the application efficiency of the target virtual resource.

[0105] In some embodiments, S411 includes determining the adjustment coefficient as a first weight corresponding to the initial effect image, and determining a second weight corresponding to the to-be-processed image based on the weight sum and the first weight; performing weighted fusion processing on the multiplication result of the initial effect image and the target object mask and the multiplication result of the to-be-processed image and the target object mask based on the first weight and the second weight, respectively, to generate a color adjustment image corresponding to the triggered target resource action object; and adding the color adjustment image and the region image in the initial effect image except the triggered target resource action object to generate the target effect image.

[0106] For example, referring to FIG. 6, the client can perform image fusion processing according to the following image processing formula: target effect image = initial effect image * adjustment coefficient * target object mask + to-be-processed image * (1-adjustment coefficient) * target object mask + (effect image - effect image * target object mask).

[0107] The client can calculate the multiplication result of the initial effect image and the target object mask (referred to as the first result) to obtain an image in which the pixel values of the region where the selected character object in the initial effect image is located are retained, and the pixel values of other regions are 0. Also, the multiplication result of the to-be-processed image and the target object mask (referred to as the second result) is calculated to obtain an image in which the pixel values of the region where the selected character object in the to-be-processed image is located are retained, and the pixel values of other regions are 0. Then, in order to retain the display effect of the character object that has applied the target virtual resource but has not adjusted the color display effect this time in the target effect image, the client can process the initial effect image using the target object mask to obtain a result (referred to as the third result) in which the pixel values of the target object mask region are 0, and the pixel values of other regions in the initial effect image are retained. Then, the client sets the calculation coefficients of the first result and the second result as the first weight and the second weight, respectively, and performs image addition processing on the first result * the first weight, the second result * the second weight, and the third result to obtain the final target effect image.

[0108] In some embodiments, S411 comprises: determining a second pixel transformation relationship between the to-be-processed image and a multiplication result of the initial effect image and the target object mask; and performing pixel interpolation processing on the multiplication result of the initial effect image and the target object mask based on the adjustment coefficient and the second pixel transformation relationship, to generate the target effect image.

[0109] For example, in this embodiment, the client or the server can establish a pixel transformation relationship (referred to as a second pixel transformation relationship) between the to-be-processed image and a multiplication result of the initial effect image and any object mask. When the target object mask selected by the user is determined, the second pixel transformation relationship adapted to the target object mask can be determined by querying the established second pixel transformation relationships according to the target object mask. Then, the multiplication result of the initial effect image and the target object mask is subjected to pixel interpolation processing based on the second pixel transformation relationship and the adjustment coefficient, to generate the target effect image. The implementation process of this embodiment is similar to that of the above-described embodiment related to the first pixel transformation relationship, and thus will not be described here.

[0110] The following is an embodiment of a virtual resource processing apparatus provided by the embodiments of the present disclosure. The virtual resource processing apparatus belongs to the same inventive concept as the virtual resource processing method described above. Details not described in the embodiment of the virtual resource processing apparatus can be referred to the above-described embodiments of the virtual resource processing method.

[0111] FIG. 7 shows a structural schematic diagram of a virtual resource processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 7, the virtual resource processing apparatus 700 can include:

[0112] The resource identifier determination module 710 is configured to determine a resource identifier of a to-be-processed image and a target virtual resource in response to a target trigger operation; wherein the to-be-processed image includes a target resource-affected object; and the target virtual resource is a virtual resource having a color attribute;

[0113] The initial effect image request module 720 is configured to generate a resource application request based on the to-be-processed image and the resource identifier, and send the resource application request to a server; wherein the resource application request is used to trigger the server to apply a resource package of the target virtual resource to the target resource-affected object, to generate and feed back an initial effect image;

[0114] The initial effect image display module 730 is configured to display the initial effect image and an adjustment control of the color attribute;

[0115] The adjustment coefficient determination module 740 is configured to determine an adjustment coefficient in response to a trigger operation of the adjustment control;

[0116] The target effect image generation module 750 is configured to perform fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient, to generate a target effect image.

[0117] The virtual resource processing apparatus provided by the above-mentioned embodiments of the present disclosure can respond to a target trigger operation, determine a to-be-processed image and a resource identifier of a target virtual resource having a color attribute, generate a resource application request based on the to-be-processed image and the resource identifier, and send the resource application request to a server to obtain an initial effect image of the target virtual resource, display the initial effect image and an adjustment control for adjusting the color attribute of the target virtual resource, determine an adjustment coefficient in response to a trigger operation on the adjustment control, perform fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient, and generate a target effect image. The image fusion processing is performed on the to-be-processed image and the initial effect image of the target virtual resource applied with the target virtual resource on the client side according to the adjustment coefficient, the target effect image like the resource application effect of the target virtual resource with the adjusted color attribute is obtained, and thus the resource application request can be sent to the server only once, the target effect image corresponding to multiple color attribute values of the target virtual resource can be obtained, the communication frequency with the server in the target virtual resource application process is reduced, the application time consumption of the target virtual resource is saved, the application success rate and application efficiency of the target virtual resource are improved, and the user experience is greatly improved.

[0118] In some embodiments, the target effect image generation module 750 is specifically configured to:

[0119] determine the adjustment coefficient as a first weight corresponding to the initial effect image, and determine a second weight corresponding to the to-be-processed image based on the total weight and the first weight;

[0120] perform weighted fusion processing on the initial effect image and the to-be-processed image based on the first weight and the second weight, respectively, to generate the target effect image.

[0121] In other embodiments, the target effect image generation module 750 is specifically configured to:

[0122] determine a first pixel transformation relationship between the to-be-processed image and the initial effect image;

[0123] perform pixel interpolation processing on the to-be-processed image and the initial effect image based on the adjustment coefficient and the first pixel transformation relationship, to generate the target effect image.

[0124] In some embodiments, the resource identifier determination module 710 includes:

[0125] a resource image display sub-module configured to display resource images of multiple target virtual resources;

[0126] The resource identifier determination submodule is configured to determine, in response to a triggering operation on any resource image, a resource identifier of a target virtual resource corresponding to the triggered resource image.

[0127] In some embodiments, the resource identifier determination submodule is specifically configured to:

[0128] In a case where the image to be processed includes a plurality of initial resource action objects, in response to a triggering operation on any initial resource action object, the triggered initial resource action object is determined as a target resource action object, and object position information of the target resource action object is determined.

[0129] In response to a triggering operation on any resource image, a resource identifier of a target virtual resource corresponding to the triggered resource image is determined, and a corresponding relationship between the object position information and the resource identifier is established.

[0130] In some embodiments, the initial effect image request module 720 is specifically configured to:

[0131] Generate a resource application request based on the image to be processed and the corresponding relationship, and send the resource application request to the server;

[0132] The resource application request is used to trigger the server to perform the following processing based on any corresponding relationship:

[0133] Identify the initial resource action objects of the image to be processed, determine a plurality of candidate position information, and determine target position information from the candidate position information based on the object position information in the corresponding relationship;

[0134] Download a resource package of the corresponding target virtual resource based on the resource identifier in the corresponding relationship, and apply the resource package to the target resource action object corresponding to the target position information to generate an initial effect image of the image to be processed;

[0135] Generate an object mask based on the target position information and the image to be processed, and feed back the object mask and the initial effect image.

[0136] In some embodiments, the initial effect image display module 730 is specifically configured to:

[0137] Display the initial effect image; the initial effect image includes a plurality of target resource action objects;

[0138] In response to a triggering operation on any target resource action object, determine an adjustment control corresponding to the triggered target resource action object.

[0139] In some embodiments, the target effect image generation module 750 is further configured to:

[0140] The target effect image is generated by fusing the to-be-processed image and the initial effect image based on the adjustment coefficient and the target object mask, wherein the target object mask is an object mask of the triggered target resource action object.

[0141] In some embodiments, the target effect image generation module 750 is specifically configured to:

[0142] The adjustment coefficient is determined as a first weight corresponding to the initial effect image, and a second weight corresponding to the to-be-processed image is determined based on the weight sum and the first weight.

[0143] Based on the first weight and the second weight, the multiplication results of the initial effect image and the target object mask and the multiplication results of the to-be-processed image and the target object mask are respectively weighted and fused to generate a color adjustment image corresponding to the triggered target resource action object.

[0144] The color adjustment image and the region image of the initial effect image except for the triggered target resource action object are added to generate the target effect image.

[0145] In other embodiments, the target effect image generation module 750 is specifically configured to:

[0146] A second pixel transformation relationship between the to-be-processed image and the multiplication results of the initial effect image and the target object mask is determined.

[0147] Based on the adjustment coefficient and the second pixel transformation relationship, the pixel interpolation processing is performed on the multiplication results of the initial effect image and the target object mask and the to-be-processed image to generate the target effect image.

[0148] In some embodiments, the object position information is a coordinate of an object frame of the target resource action object.

[0149] The virtual resource processing apparatus provided by the embodiments of the present disclosure can perform the virtual resource processing method provided by any of the embodiments of the present disclosure, and has the corresponding function modules and beneficial effects of performing the method.

[0150] It should be noted that in the embodiments of the virtual resource processing apparatus described above, each module and sub-module included is only divided according to the function logic, but is not limited to the above division, as long as the corresponding function can be realized; in addition, the specific names of each functional module / sub-module are only for the convenience of mutual differentiation, and do not limit the protection scope of the present disclosure.

[0151] The electronic device can include a processor and a memory. The memory can be configured to store executable instructions. The processor can be configured to read the executable instructions from the memory and execute the executable instructions to implement the virtual resource processing method in any of the above embodiments.

[0152] FIG. 8 shows a structural schematic diagram of an electronic device according to an embodiment of the present disclosure.

[0153] As shown in FIG. 8, the electronic device 800 can include a processing device 801 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 802 or programs loaded from a storage device 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, the ROM 802, and the RAM 803 are connected to each other through a bus 804. An input / output interface (I / O interface) 805 is also connected to the bus 804.

[0154] Generally, the following devices can be connected to the I / O interface 805: input devices 806 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 808 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 809. The communication devices 809 can allow the electronic device 800 to communicate wirelessly or wired with other devices to exchange data.

[0155] It should be noted that the electronic device 800 shown in FIG. 8 is merely an example and should not impose any limitation on the functions and the scope of use of the embodiments of the present disclosure. That is, although FIG. 8 shows the electronic device 800 with various devices, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices can be alternatively implemented or provided.

[0156] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 809, or installed from the storage devices 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the virtual resource processing method of any embodiment of the present disclosure are performed.

[0157] The embodiment of the present disclosure further provides a computer readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the virtual resource processing method in any embodiment of the present disclosure.

[0158] It should be noted that the computer readable medium in the above disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or apparatus. In the present disclosure, the computer readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer readable program code. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the above. The computer readable signal medium can also be any computer readable medium other than the computer readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or apparatus. The program code contained in the computer readable medium can be transmitted by any suitable medium, including but not limited to a wire, a cable, an RF (radio frequency) or the like, or any suitable combination of the above.

[0159] In some embodiments, the client, server can communicate using any currently known or future developed network protocol, such as HTTP, and can be interconnected with any form or medium of digital data communication (e.g., communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

[0160] The above computer readable medium can be included in the above electronic device; or can exist separately without being assembled into the electronic device.

[0161] The computer readable medium described above can carry one or more programs, which when executed by the electronic device, cause the electronic device to perform the steps of the virtual resource processing method described in any of the embodiments of the present disclosure.

[0162] In the embodiments of the present disclosure, the computer program code for performing the operations of the present disclosure can be written in one or more programming languages or a combination thereof, including an object oriented programming language such as Java, Smalltalk, C++, and a conventional procedural programming language such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0163] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of devices, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a procedure, or a part of a code, which comprises one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in a different order than that noted in the figures. For example, two blocks noted in succession can in fact be executed substantially concurrently or in the opposite order, depending on the functionality involved. It is also noted that each block in the block diagrams and / or flow diagrams, and combinations of blocks in the block diagrams and / or flow diagrams, can be implemented by dedicated hardware-based systems that perform the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0164] The functions described above in the detailed description can be performed by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0165] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include a lined- up electrical connection, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0166] The above description is only preferred embodiments of the present disclosure and the explanation of the applied technical principles. It should be understood by those skilled in the art that the disclosure range involved in the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and also covers other technical solutions formed by any combination of the above technical features or equivalent features without departing from the above disclosed concept. For example, the technical solutions formed by replacing the above features with the technical features disclosed in the present disclosure (but not limited to) having similar functions.

[0167] In addition, although each operation is described in a particular order, this should not be understood as requiring the operations to be performed in the specific order shown or in a sequential order. In certain circumstances, multitasking and parallel processing can be advantageous. Similarly, although several implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments can also be combined in a single embodiment. Conversely, various features described in the context of a single embodiment can also be separated and implemented in multiple embodiments.

[0168] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A virtual resource processing method applied to a client, the method comprising: determining, in response to a target trigger operation, a resource identifier of a target virtual resource and a to-be-processed image; wherein the to-be-processed image comprises a target resource action object; the target virtual resource is a virtual resource having a color attribute; generating a resource application request based on the to-be-processed image and the resource identifier, and sending the resource application request to a server; wherein the resource application request is used to trigger the server to apply a resource package of the target virtual resource to the target resource action object, to generate and feed back an initial effect image; displaying the initial effect image and an adjustment control of the color attribute; determining an adjustment coefficient in response to a trigger operation on the adjustment control; performing fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient, to generate a target effect image. The fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient to generate a target effect image comprises: determining the adjustment coefficient as a first weight corresponding to the initial effect image, and determining a second weight corresponding to the to-be-processed image based on a total weight and the first weight; performing weighted fusion processing on the initial effect image and the to-be-processed image based on the first weight and the second weight, respectively, to generate the target effect image. The fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient to generate a target effect image comprises: determining a first pixel transformation relationship between the to-be-processed image and the initial effect image; performing pixel interpolation processing on the to-be-processed image and the initial effect image based on the adjustment coefficient and the first pixel transformation relationship, to generate the target effect image. The determination of the resource identifier of the target virtual resource in response to a target trigger operation comprises: displaying resource images of a plurality of target virtual resources; determining, in response to a trigger operation on any of the resource images, the resource identifier of the target virtual resource corresponding to the triggered resource image. In the case where the to-be-processed image comprises a plurality of initial resource action objects, the determination of the resource identifier of the target virtual resource corresponding to the triggered resource image in response to a trigger operation on any of the resource images comprises: determining, in response to a trigger operation on any of the initial resource action objects, the triggered initial resource action object as the target resource action object, and determining object position information of the target resource action object; determining, in response to a trigger operation on any of the resource images, the resource identifier of the target virtual resource corresponding to the triggered resource image, and establishing a correspondence between the object position information and the resource identifier. The generation of the resource application request based on the to-be-processed image and the resource identifier, and the sending of the resource application request to the server comprises: generating the resource application request based on the to-be-processed image and the correspondence, and sending the resource application request to the server.

2. The method of claim 1, wherein, ​ ​ ​ 3. The method of claim 1, wherein, ​ ​ ​ 4. The method according to any one of claims 1 to 3, wherein, ​ ​ ​ 5. The method of claim 4, wherein, ​ ​ ​ 6. The method of claim 5, wherein, ​ ​ The resource application request is used to trigger the server to perform the following processing based on any of the corresponding relationships: The initial resource action object of the to-be-processed image is identified to determine a plurality of candidate position information, and target position information is determined from each of the candidate position information based on the object position information in the corresponding relationship; A resource package of a corresponding target virtual resource is downloaded based on the resource identifier in the corresponding relationship, and the resource package is applied to the target resource action object corresponding to the target position information to generate the initial effect image of the to-be-processed image; Based on the target position information and the to-be-processed image, an object mask is generated, and the object mask and the initial effect image are fed back.

7. The method of claim 5 or 6, wherein, The initial effect image and the color attribute adjustment control are displayed, including: The initial effect image includes a plurality of target resource action objects. In response to a triggering operation on any of the target resource action objects, the adjustment control corresponding to the triggered target resource action object is determined.

8. The method of claim 7, wherein, The fusion processing of the to-be-processed image and the initial effect image based on the adjustment coefficient to generate a target effect image includes: The fusion processing of the to-be-processed image and the initial effect image based on the adjustment coefficient and the target object mask to generate a target effect image, wherein the target object mask is the object mask of the triggered target resource action object.

9. The method of claim 8, wherein, The fusion processing of the to-be-processed image and the initial effect image based on the adjustment coefficient and the target object mask to generate a target effect image includes: The adjustment coefficient is determined as a first weight corresponding to the initial effect image, and based on a weight sum and the first weight, a second weight corresponding to the to-be-processed image is determined. Based on the first weight and the second weight, the multiplication results of the initial effect image and the target object mask and the multiplication results of the to-be-processed image and the target object mask are weighted and fused to generate a color adjustment image corresponding to the triggered target resource action object. The color adjustment image and the region image of the initial effect image except the triggered target resource action object are added to generate the target effect image.

10. The method of claim 8, wherein, The fusion processing of the to-be-processed image and the initial effect image based on the adjustment coefficient and the target object mask to generate a target effect image includes: A second pixel transformation relationship between the multiplication results of the to-be-processed image and the initial effect image and the target object mask is determined; Based on the adjustment coefficient and the second pixel transformation relationship, pixel interpolation processing is performed on the multiplication results of the to-be-processed image and the initial effect image and the target object mask to generate the target effect image.

11. The method according to any one of claims 5 to 10, wherein, The object position information is the coordinates of the object box of the target resource action object.

12. A virtual resource processing apparatus, comprising: A resource identifier determination module is configured to determine a resource identifier of a target virtual resource and a to-be-processed image in response to a target trigger operation, wherein the to-be-processed image comprises a target resource-acting object, and the target virtual resource is a virtual resource with a color attribute. An initial effect image request module is configured to generate a resource application request based on the to-be-processed image and the resource identifier, and send the resource application request to a server, wherein the resource application request is used to trigger the server to apply a resource package of the target virtual resource to the target resource-acting object, and generate and feed back an initial effect image. An initial effect image display module is configured to display the initial effect image and an adjustment control of the color attribute. An adjustment coefficient determination module is configured to determine an adjustment coefficient in response to a trigger operation on the adjustment control. A target effect image generation module is configured to perform fusion processing on the to-be-processed image and the initial effect image based on the adjustment coefficient, and generate a target effect image.

13. An electronic device comprising: a processor; a memory storing executable instructions; wherein the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the virtual resource processing method of any one of claims 1-11.

14. A computer readable storage medium storing a computer program, wherein, When the computer program is executed by the processor, the processor implements the virtual resource processing method of any one of claims 1-11.

Images