Wearing effect image generation method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a method and device for generating a wearing effect image, electronic equipment and a storage medium. The method comprises the following steps: in response to a wearing trigger operation, obtaining a to-be-processed image and a virtual wearing object; under the condition that the to-be-processed image comprises a target wearing part corresponding to the virtual wearing object, a target part model corresponding to the target wearing part is determined, and the first model size of the target part model and the actual part size of the target wearing part are in a target display proportion; a target wearing object model corresponding to the virtual wearing object is obtained, and the second model size of the target wearing object model and the wearing object size of an actual wearing object corresponding to the virtual wearing object are in a target display scale; and determining a model action effect of the target part model and the target wearing object model, and displaying a wearing effect image after the virtual wearing object acts on the target wearing part based on the model action effect. And presenting a real wearing effect of the target wearing part and the actual wearing object.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to image processing technology, and more particularly to a method, device, electronic device and storage medium for generating a wearing effect image. Background Art

[0002] With the improvement of living standards, various types of wearables are emerging. When users choose wearables, a large number of users first check the wearables' trial effects before making a choice.

[0003] In the related art, the wearing effect of the wearable item is generally displayed through a model image, but due to individual differences, it is difficult for the model image to truly display the wearing effect of the wearable item. If you want to obtain the most realistic wearing effect of the wearable item, you generally need to wear the wearable item on site. This requires the user to spend time and transportation costs to go to the location of the wearable item. In addition, due to geographical and time constraints, the cost of trying on the wearable item is high, and it is difficult for the user to quickly observe the real wearing effect of the wearable item, which affects the user experience. Summary of the invention

[0004] The present disclosure provides a method, device, electronic device and storage medium for generating a wearing effect image, so as to display the real wearing effect of a wearable object.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for generating a wearing effect image, the method comprising:

[0006] In response to the wearing trigger operation, the image to be processed and the virtual wearable object are obtained; when the image to be processed includes the target wearing part corresponding to the virtual wearable object, the target part model corresponding to the target wearing part is determined, wherein the first model size of the target part model and the actual size of the target wearing part are in a target display ratio; the target wearing object model corresponding to the virtual wearable object is obtained, wherein the second model size of the target wearing object model and the wearing object size of the actual wearable object corresponding to the virtual wearable object are in a target display ratio; the model effect of the target part model and the target wearing object model is determined, and the wearing effect image after the virtual wearable object is applied to the target wearing part is displayed based on the model effect. The real wearing effect of the target wearing part and the actual wearable object can be presented through the wearing effect image.

[0007] In a second aspect, the embodiment of the present disclosure further provides a device for generating a wearing effect image, the device comprising:

[0008] A wearing trigger module, used for acquiring an image to be processed and a virtual wearable object in response to a wearing trigger operation;

[0009] a part model determination module, configured to determine a target part model corresponding to the target wearing part when the image to be processed includes a target wearing part corresponding to the virtual wearing object, wherein a first model size of the target part model is in a target display ratio with an actual part size of the target wearing part;

[0010] an object model determination module, configured to obtain a target object model corresponding to the virtual object, wherein a second model size of the target object model and an object size of an actual object corresponding to the virtual object are in the target display ratio;

[0011] The wearing effect display module is used to determine the model effect of the target part model and the target wearing object model, and based on the model effect, display the wearing effect image after the virtual wearing object acts on the target wearing part.

[0012] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0013] one or more processors;

[0014] a storage device for storing one or more programs,

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for generating a wearing effect image as described in any one of the embodiments of the present disclosure.

[0016] In a fourth aspect, the embodiments of the present disclosure further provide a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute a method for generating a wearing effect image as described in any one of the embodiments of the present disclosure.

[0017] The technical solution of the disclosed embodiment can start the automatic processing of the wearing effect based on a simple interactive operation by obtaining the image to be processed and the virtual wearable object in response to the wearing trigger operation. In the case where the image to be processed includes the target wearing part corresponding to the virtual wearable object, the target part model corresponding to the target wearing part is determined, and the first model size of the target part model and the actual size of the part of the target wearing part are in the target display ratio, so that the display effect of making the target part model more in line with the actual size can be obtained; the target wearable object model corresponding to the virtual wearable object is obtained, wherein the second model size of the target wearable object model and the wearable object size of the actual wearable object corresponding to the virtual wearable object are in the target display ratio, so that the display effect of making the target wearable object model more in line with the actual size can be obtained. Finally, the model effect of the target part model and the target wearable object model is determined, and the wearing effect image after the virtual wearable object is applied to the target wearable part is displayed based on the model effect, which solves the technical problems of high cost of obtaining the wearing effect of the actual wearable object and difficulty in displaying the real wearing effect, and plays an effective effect of intuitively presenting the real wearing effect of the target wearable part and the actual wearable object through the wearing effect image, thereby improving the user's wearing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0019] Figure 1 A schematic diagram of a flow chart of a method for generating a wearing effect image provided by an embodiment of the present disclosure;

[0020] Figure 2 A schematic diagram of a flow chart of a method for generating a wearing effect image provided by an embodiment of the present disclosure;

[0021] Figure 3 A schematic diagram of the structure of a device for generating a wearing effect image provided by an embodiment of the present disclosure;

[0022] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0024] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0025] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0026] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0029] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0030] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0031] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0032] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0033] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0034] Figure 1 A flow chart of a method for generating a wearing effect image provided in an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the situation of XX. The method can be executed by a device for generating a wearing effect image, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server, etc.

[0035] like Figure 1 As shown, the method of this embodiment may specifically include:

[0036] S110: In response to a wearing trigger operation, an image to be processed and a virtual wearable object are obtained.

[0037] Among them, the wearing trigger operation can be understood as an interactive operation used to display the wearing effect of the virtual wearable object after being triggered. From the perspective of the mode of action, the wearing trigger operation can be a contact operation or a contactless operation. Exemplarily, the wearing trigger operation can be a control trigger operation acting on a preset trigger control. The control trigger operation can be an operation of clicking, pressing or sliding a control, etc. Alternatively, the wearing trigger operation can be an operation of inputting preset trigger information such as gestures or sounds. From the perspective of the number of triggers, the wearing trigger operation can be a single trigger operation or a combined operation including multiple operations.

[0038] Among them, the image to be processed may be an image of the target wearing part to be identified. The virtual wearable object may be a virtual wearable object corresponding to the actual wearable object. The target wearing part may be a part or all of the position of the object to be processed. It is understandable that the image to be processed may be a single image or one or more frames of multiple images, for example, an image frame in a video. It should be noted that at different times, the image to be processed may be the same or different. For example, it may be an image frame obtained from a video based on a preset image acquisition rule. Exemplarily, the image acquisition rule may be frame-by-frame acquisition (each frame is acquired), acquisition at intervals of a preset number of frames, random acquisition, or acquisition at intervals of a preset duration, etc. There are many ways to acquire the image to be processed. Optionally, the image to be processed may be an image captured in real time based on a preset image capture device, an image uploaded based on a preset image upload control, or an image obtained from a preset image storage space, or an image transmitted by a third-party platform, etc.

[0039] Optionally, in response to a special effect triggering operation for a target special effect, a special effect action image is acquired as an image to be processed, and a virtual wearable object corresponding to the target special effect is acquired.

[0040] Among them, the target special effect can be understood as the triggered special effect. The special effect triggering operation can be an operation for triggering the target special effect. Exemplarily, the target special effect can be a try-on special effect or a dressing special effect, etc. The special effect effect image can be understood as the original input image used to generate the special effect effect image of the target special effect. Alternatively, the special effect effect image can be understood as the image to which the target special effect is to be applied. Generally, the special effect effect image is an image uploaded or photographed for the target special effect.

[0041] Specifically, responding to a special effect trigger operation for a target special effect includes: responding to a control trigger operation acting on a preset special effect control corresponding to the target special effect; or, responding to an operation of detecting a preset trigger action for enabling the target special effect; or, responding to an operation of detecting that an image displayed in a preset display area includes a target wearing part corresponding to the target special effect, etc.

[0042] In the present technical solution, one or more virtual wearables corresponding to the target special effect are optionally pre-set. In the case where there are multiple virtual wearables corresponding to the target special effect, one or more virtual wearables from the multiple virtual wearables corresponding to the target special effect can be randomly acquired. In the case where there are multiple virtual wearables corresponding to the target special effect, the types corresponding to the multiple virtual wearables can be the same or different, for example, they can be headwear, necklaces, wrist ornaments or clothing, etc. When the target special effect is displayed, different types of virtual wearables can be displayed at the same time, and the same type of virtual wearables can be switched for display. Exemplarily, triggering the switching display of multiple virtual wearables can be to switch the display of multiple virtual wearables according to a preset switching order and / or switching time; or, switching the display of multiple virtual wearables based on a preset switching trigger control or switching trigger operation, etc.

[0043] Optionally, in response to a selection trigger operation acting on a wearable object identifier, an image displayed in a target display area is obtained as an image to be processed, and a virtual wearable object corresponding to the selected wearable object identifier is obtained. Among them, the wearable object identifier can be understood as information used to mark different virtual wearable objects, which can be used by users to identify different virtual wearable objects. In the present technical solution, the wearable object identifier can be used as a control for selecting a virtual wearable object to be worn. The target display area can be understood as a pre-set area for displaying the image to be processed. In the present technical solution, by selecting the wearable object identifier, the user's wearing intention for the virtual wearable object to be worn can be simply, conveniently and accurately captured to meet the user's wearing needs.

[0044] Specifically, the wearable object identification of one or more virtual wearable objects may be displayed for the user to select. Further, based on the selection trigger operation acting on the wearable object identification, the acquisition of the image to be processed and the virtual wearable object is triggered, so as to further generate the wearing effect image based on the image to be processed and the virtual wearable object.

[0045] S120. When the image to be processed includes a target wearing part corresponding to the virtual wearing object, determine a target part model corresponding to the target wearing part, wherein a first model size of the target part model and an actual size of the target wearing part are in a target display ratio.

[0046] It is understandable that the image to be processed may include the target wearing part corresponding to the virtual wearable object, or may not include the target wearing part corresponding to the virtual wearable object. However, the virtual wearable object needs to act on the target wearing part. Therefore, the image to be processed may be detected first to determine whether the image to be processed includes the target wearing part corresponding to the virtual wearable object. Then, if the image to be processed includes the target wearing part corresponding to the virtual wearable object, the subsequent operation of generating the wearing effect image is performed.

[0047] In order to ensure the display effect of the wearing effect image. Optionally, after acquiring the image to be processed and before determining the target part model corresponding to the target wearing part, it also includes: performing quality detection on the image to be processed, and when the quality parameter of the image to be processed meets the preset quality condition, performing the operation of determining the target part model corresponding to the target wearing part to determine whether the quality of the image to be processed meets the quality requirements, thereby ensuring the image generation effect of the wearing effect image.

[0048] Optionally, when the quality parameters of the image to be processed do not meet the preset quality conditions, a prompt message is generated and displayed to prompt the user to reacquire the image to be processed. The prompt message may display guidance information for image acquisition to guide the user to input an image to be processed that meets the quality requirements. For example, please take an eye image and look straight at the camera.

[0049] Optionally, if the quality parameter of the image to be processed does not meet the preset quality condition, the image acquisition interface is automatically displayed to collect a new image to be processed. Alternatively, if the image to be processed is an image frame in a video, if the quality parameter of the image to be processed does not meet the preset quality condition, subsequent image frames can be continuously acquired from the video as the image to be processed, and the image quality can be judged again to obtain the image to be processed that meets the preset quality condition, thereby ensuring the image processing effect.

[0050] In the embodiments of the present disclosure, there are many ways to perform quality detection on the image to be processed. Exemplarily, the quality detection of the image to be processed is performed based on a preset quality detection method, wherein the preset quality detection method includes at least one of the following methods: whether the brightness of the light source in the shooting environment reaches a preset brightness threshold; whether the target wearing part is wearing a virtual wearable object; whether the display posture of the target wearing part is within a preset posture range; whether the display angle of the target wearing part is within a preset angle range; and whether the target wearing part is located in at least one of the preset guide areas.

[0051] Taking the target wearing part as the eye and the virtual wearing object as glasses as an example, the quality of the image to be processed can be detected by detecting features such as light source, presence of glasses, whether the line of sight is looking directly at the lens, and face position. Specifically, light source detection is used to determine whether the light source in the shooting environment is sufficient (such as whether the brightness reaches the preset brightness threshold), whether the user is wearing glasses, and line of sight detection is used to determine whether the user's eyes are looking directly at the camera, and whether the user's face is within the guide frame. When each feature meets the requirements, the target part model corresponding to the target wearing part is determined.

[0052] In the disclosed embodiment, the target part model can be understood as a three-dimensional model that corresponds to the part features of the target wearing part and is in a target display ratio with the actual size of the part of the target wearing part. The target display ratio can be understood as the ratio between the first model size of the preset target part model and the actual size of the part of the target wearing part. Specifically, it can be the ratio of the first model size corresponding to the same part area of ​​the target wearing part to the actual size of the part, or the ratio of the actual size of the part to the first model size. It can be understood that the specific value of the target display ratio can be set according to actual needs, and its specific value is not limited here. For example, the specific value of the target display ratio can be 1:1, 1:2, 2:1 or 1:3, etc.

[0053] Optionally, the first model size of the target part model may be the same as the actual size of the target wearing part. In this case, the target display ratio is 1:1. The advantage of this setting is that a one-to-one simulation of the target wearing part can be achieved, and the target wearing part can be simulated to the greatest extent.

[0054] In the disclosed embodiment, a target part model corresponding to the target wearing part can be constructed based on the part features of the target wearing part in the image to be processed. The target wearing part may include one or more part regions. The part features may include part features corresponding to each part region, such as contour information of each part region and actual size of the region. Optionally, the part features of the target wearing part may be determined by key points of the target wearing part.

[0055] S130: Acquire a target wearing object model corresponding to the virtual wearing object, wherein a second model size of the target wearing object model and an wearing object size of the actual wearing object corresponding to the virtual wearing object are in a target display ratio.

[0056] In order to improve the efficiency of obtaining virtual wearing objects, a target wearing object model corresponding to the actual wearing object can be pre-built. The virtual wearing object is an image of the wearing object corresponding to the actual wearing object displayed after rendering the target wearing object model. The wearing object identifier corresponding to the virtual wearing object can be stored in correspondence with the target wearing object model. Furthermore, the target wearing object model and the target wearing object model corresponding to the virtual wearing object can be obtained through the wearing object identifier corresponding to the virtual wearing object.

[0057] Similarly, a target wearing object model corresponding to the actual wearing object may be constructed based on the wearing object features of the actual wearing object. Specifically, an wearing object image of the actual wearing object may be obtained, and the wearing object features of the actual wearing object may be determined based on the wearing object image of the actual wearing object, and then a target wearing object model corresponding to the actual wearing object may be constructed based on the wearing object features.

[0058] Optionally, obtaining the wearing image of the actual wearing item includes: photographing the wearing image of the actual wearing item, or receiving the wearing image of the actual wearing item uploaded by a user, etc.

[0059] Furthermore, determining the wearing feature of the actual wearing object based on the wearing image of the actual wearing object may be performed by performing image detection on the wearing image, obtaining a plurality of wearing key points corresponding to the actual wearing object, and then using the wearing key points as the wearing feature of the actual wearing object.

[0060] Among them, the key points of the wearing object can be understood as points used to indicate key information of the actual wearing object. Exemplarily, one or more wearing object regions of the actual wearing object can be determined based on the key points of the wearing object of the actual wearing object. The wearing object feature can be a regional feature of each wearing object region of the actual wearing object, such as a regional contour feature. The actual wearing object size of the actual wearing object can include the regional size of each wearing object region of the actual wearing object.

[0061] On this basis, constructing a target wearing object model corresponding to the actual wearing object based on the wearing object features may include: obtaining a standard wearing object model corresponding to the actual wearing object, and determining a preliminary wearing object model corresponding to the actual wearing object based on the standard wearing object model and multiple wearing object key points; and adjusting a first model size of the preliminary wearing object model so that the first model size of the target wearing object model and the actual size of the wearing object of the actual wearing object are in a target display ratio.

[0062] Exemplarily, based on a standard wearing object model and a plurality of wearing object key points, determining a preliminary wearing object model corresponding to the actual wearing object includes: respectively determining a standard key point corresponding to each wearing object key point in the standard wearing object model, adjusting the positions of the plurality of standard key points based on the relative positional relationship of the plurality of wearing object key points, and obtaining a preliminary wearing object model corresponding to the actual wearing object.

[0063] In order to make the first model size of the target wearing object model and the actual wearing object size of the actual wearing object present a target display ratio, it is necessary to obtain the actual wearing object size of the actual wearing object. Specifically, the actual distance between multiple wearing object key points of the actual wearing object is received as input. Then, the target distance between multiple wearing object key points in the target wearing object model is determined based on the actual distance and the target display ratio, and then, the current distance between multiple wearing object key points in the preliminary wearing object model is adjusted to the target distance, so as to adjust the first model size of the preliminary wearing object model.

[0064] In the embodiment of the present disclosure, the relative display ratio of the wearing size of the actual wearing object and the second model size of the corresponding target wearing object model is set to the same value as the relative display ratio of the target wearing part and the target part model target, in order to truly simulate the relative display effect between the target wearing part and the actual wearing object.

[0065] S140: Determine the model effects of the target part model and the target wearing object model, and display a wearing effect image after the virtual wearing object acts on the target wearing part based on the model effects.

[0066] The model effect can be understood as the simulated wearing effect after the target part model and the target wearing object model are superimposed together. Specifically, the target part model and the target wearing object model can be combined according to the way of wearing the actual wearing object on the target wearing part to obtain the model effect.

[0067] Optionally, determining the model effect of the target part model and the target wearing object model includes: determining a first model pose of the target part model, and determining a second model pose of the target wearing object model based on the first model pose; and applying the target wearing object model to the target part model based on the second model pose to obtain the model effect of the target part model and the target wearing object model.

[0068] Specifically, the second model pose of the target wearing object model can be determined based on the standard action pose of the target wearing part and the actual wearing object and the first model pose. Further, the standard action pose of the target part model and the target wearing object model can be determined based on the first default pose of the target wearing part and the second default pose of the actual wearing object.

[0069] By adopting this technical solution, the first model pose of the target part model matches the actual pose of the target wearing part, and then the model pose of the target wearing object model can be adjusted to the second model pose that matches the first model pose. Thus, the model effect of the target wearing object model and the target part model matches the effect of the actual wearing object on the target wearing part.

[0070] Optionally, determining the model effect of the target part model and the target worn object model includes: determining at least one wearing key point corresponding to the target worn object model, and determining the associated key point corresponding to the wearing key point in the target part model; based on the wearing key point and the associated key point, applying the target worn object model to the target part model to obtain the model effect of the target part model and the target worn object model.

[0071] Among them, the wearing key points can be understood as the pre-set wearing key points that need to be paid attention to when the target wearing object model acts on the target part model. Specifically, it can be the wearing key points that are aligned with the preset part key points in the target part model so that the model effect fits the actual wearing effect. In other words, the wearing key points can be the wearing key points that are aligned with the preset part key points in the target part model. The associated key points can be the key points in the target wearing object model that fit the target part model, such as the supporting key points that act on the target part model. Taking the virtual wearing object as glasses as an example, the wearing key points can be the center point of the glasses and one or more key points on the temples of the glasses, etc., and the associated key points can be the part key points in the target part model corresponding to the wearing key points.

[0072] Specifically, the wearing key points may include alignment key points and fitting key points. Optionally, the target wearing object model is applied to the target part model based on the wearing key points and the associated key points, including: determining the interaction position of applying the target wearing object model to the target part model based on the alignment key points and the associated key points corresponding to the alignment key points in the target part model; adjusting the regional morphology of the model area corresponding to the fitting key points in the target wearing object model based on the fitting key points and the associated key points corresponding to the fitting key points in the target part model; applying the adjusted target wearing object model to the target part model based on the interaction position.

[0073] Specifically, the alignment key points in the target wearing object model and the associated key points in the target part model corresponding to the alignment key points can be aligned to obtain the interaction position of the target wearing object model on the target part model. Optionally, the three-dimensional coordinates of the fitting key points in the target wearing object model are adjusted to change the regional morphology of the model area corresponding to the fitting key points in the target wearing object model, so that the fitting key points in the target wearing object model and the associated key points in the target part model corresponding to the fitting key points are aligned.

[0074] Taking the virtual wearable object as glasses as an example, the alignment key point may be the center point of the glasses, and the associated key point corresponding to the alignment key point may be the bridge of the nose key point; the fit key point may be the temple key point, and the associated key point corresponding to the fit key point may be the auricle key point. In an optional embodiment, the target angle of the temple knob to be rotated may be calculated based on the relative position information of the auricle key point and the key point corresponding to the temple knob of the glasses, and then the shape of the temple is adjusted based on the target angle to simulate the effect of the eyes actually wearing glasses.

[0075] The technical solution of the disclosed embodiment can start the automatic processing of the wearing effect based on a simple interactive operation by obtaining the image to be processed and the virtual wearable object in response to the wearing trigger operation. In the case where the image to be processed includes the target wearing part corresponding to the virtual wearable object, the target part model corresponding to the target wearing part is determined, and the first model size of the target part model and the actual size of the part of the target wearing part are in the target display ratio, so that the display effect of making the target part model more in line with the actual size can be obtained; the target wearable object model corresponding to the virtual wearable object is obtained, wherein the second model size of the target wearable object model and the wearable object size of the actual wearable object corresponding to the virtual wearable object are in the target display ratio, so that the display effect of making the target wearable object model more in line with the actual size can be obtained. Finally, the model effect of the target part model and the target wearable object model is determined, and the wearing effect image after the virtual wearable object is applied to the target wearable part is displayed based on the model effect, which solves the technical problems of high cost of obtaining the wearing effect of the actual wearable object and difficulty in displaying the real wearing effect, and plays an effective effect of intuitively presenting the real wearing effect of the target wearable part and the actual wearable object through the wearing effect image, thereby improving the user's wearing experience.

[0076] Figure 2 A flow chart of another method for generating a wearing effect image provided by an embodiment of the present disclosure. The technical solution of this embodiment is based on the above-mentioned embodiment, and further refines how to determine the target part model corresponding to the target wearing part. Optionally, multiple part key points corresponding to the target wearing part are determined based on the image to be processed; a standard part model corresponding to the target wearing part is obtained, and a preliminary part model corresponding to the target wearing part is determined based on the standard part model and multiple part key points; the first model size of the preliminary part model is adjusted so that the first model size of the target part model and the actual size of the target wearing part are in the target display ratio. For specific implementation methods, please refer to the description of this embodiment. Among them, the technical features that are the same or similar to those in the above-mentioned embodiments are not repeated here.

[0077] like Figure 2 As shown, the method of this embodiment may specifically include:

[0078] S210: In response to a wearing trigger operation, an image to be processed and a virtual wearable object are obtained.

[0079] S220: When the image to be processed includes a target wearing part corresponding to the virtual wearing object, determine a plurality of part key points corresponding to the target wearing part based on the image to be processed.

[0080] Optionally, a plurality of key points of parts corresponding to the target wearing parts are determined based on the image to be processed based on a pre-trained key point recognition model. The key point recognition model can be obtained by training an artificial intelligence model based on a sample image of the target wearing part in the image to be processed and an expected label corresponding to the sample image. The expected label is the data of the key points of parts corresponding to the target wearing part output by the expected key point recognition model.

[0081] Optionally, a key point standard image corresponding to the target wearing part is obtained, wherein the key point standard image may be annotated with a plurality of part key points corresponding to the target wearing part. Then, the key point standard image is adjusted so that the target wearing part in the key point standard image is aligned with the target wearing part in the image to be processed, and then, the points in the image to be processed that are aligned with the plurality of part key points annotated in the key point standard image are used as the plurality of part key points corresponding to the target wearing part in the image to be processed.

[0082] S230, obtaining a standard part model corresponding to the target wearing part, and determining a preliminary part model corresponding to the target wearing part based on the standard part model and a plurality of part key points.

[0083] In the disclosed embodiment, the standard part model corresponding to the target wearing part can be pre-constructed. Specifically, the standard part models can be constructed for target wearing parts of different part types. The standard part model corresponding to the target wearing part is obtained based on the part type corresponding to the target wearing part. Among them, the part type can be determined according to the morphological characteristics of the target wearing part. Taking a person as an example, the part type can be divided into the head, upper limbs, lower limbs and torso, etc.

[0084] Specifically, multiple model key points corresponding to the multiple part key points corresponding to the target wearing part in the standard part model are determined, and then the relative position relationship between the multiple model key points is adjusted based on the relative position relationship between the multiple part key points to adjust the standard part model, thereby obtaining a preliminary part model corresponding to the target wearing part.

[0085] S240, adjusting the first model size of the preliminary part model so that the first model size of the target part model and the actual size of the target wearing part are in a target display ratio.

[0086] As can be seen from the above content, the preliminary part model is obtained by adjusting the standard part model, and its size is related to the size of the standard part model. However, due to the individual differences of the target wearing part, the first model size of the preliminary part model is often not the expected model size, that is, it is not in the target display ratio with the actual size of the target wearing part. Therefore, it is necessary to adjust the first model size of the preliminary part model to obtain the expected target part model.

[0087] Optionally, adjusting the first model size of the preliminary part model includes: adjusting the first model size of the preliminary part model based on actual distances of key points corresponding to at least two reference key points among the multiple part key points, key point model distances and target display ratios.

[0088] The reference key points may be all or part of the key points in the multiple part key points. The actual distance of the key points is the actual distance between the multiple reference key points of the target wearing part. The key point model distance is the distance between the multiple reference key points of the target wearing part in the preliminary part model.

[0089] Specifically, based on the actual distances of key points corresponding to at least two reference key points among multiple part key points, the key point model distances and the target display ratio, the first model size of the preliminary part model is adjusted, including: determining the relative distance ratio based on the actual distances of key points corresponding to at least two reference key points among multiple part key points and the key point model distances; determining the deformation ratio corresponding to the preliminary part model based on the distance relative ratio and the target display ratio, and adjusting the first model size of the preliminary part model based on the deformation ratio.

[0090] In the disclosed embodiment, the actual distances of the key points corresponding to at least two reference key points among the multiple part key points may be divided by the corresponding key point model distances to obtain a relative distance ratio. Further, the relative distance ratio and the target display ratio may be multiplied to obtain a deformation ratio corresponding to the preliminary part model. Finally, the first model size of the preliminary part model is multiplied by the deformation ratio to obtain the target part model.

[0091] Considering that the individual differences of the iris or pupil distance of the head are small, in other words, the iris or pupil distance of the heads of different target wearers will not be very different. Optionally, if the target wearing part is the head, the reference key point may include the iris key point, and accordingly, the key point model distance may be the diameter or radius of the iris in the preliminary part model; or, the reference key point may include the iris key point or the pupil key point, and accordingly, the key point model distance may be the pupil distance in the preliminary part model.

[0092] In an optional technical solution of the disclosed embodiment, the diameter or radius of the iris in the preliminary part model may be adjusted to a preset iris diameter or radius, thereby obtaining a target part model that matches the actual size of the target wearing part.

[0093] S250: Acquire a target wearing object model corresponding to the virtual wearing object, wherein a second model size of the target wearing object model and an wearing object size of the actual wearing object corresponding to the virtual wearing object are in a target display ratio.

[0094] S260: Determine the model effects of the target part model and the target wearing object model, and display a wearing effect image after the virtual wearing object acts on the target wearing part based on the model effects.

[0095] The technical solution of the disclosed embodiment can effectively capture the key information of the target wearing part by determining multiple part key points corresponding to the target wearing part based on the image to be processed. Then, by obtaining the standard part model corresponding to the target wearing part, based on the standard part model and multiple part key points, the preliminary part model corresponding to the target wearing part is determined, so that the generated preliminary part model matches the target wearing part. Finally, the first model size of the preliminary part model is adjusted so that the first model size of the target part model and the actual part size of the target wearing part are in the target display ratio, so that the desired model size and the model matching the target wearing part can be obtained, so that the generated wearing effect image can be displayed with the desired display effect.

[0096] Figure 3 A schematic diagram of the structure of a device for generating a wearing effect image provided by an embodiment of the present disclosure, such as Figure 3 As shown, the device for generating the wearing effect image includes: a wearing trigger module 310 , a part model determination module 320 , a target wearing object model determination module 330 and a wearing effect display module 340 .

[0097] Among them, the wearing trigger module 310 is used to obtain the image to be processed and the virtual wearing object in response to the wearing trigger operation; the part model determination module 320 is used to determine the target part model corresponding to the target wearing part when the image to be processed includes the target wearing part corresponding to the virtual wearing object, wherein the first model size of the target part model and the actual size of the target wearing part are in the target display ratio; the wearing object model determination module 330 is used to obtain the target wearing object model corresponding to the virtual wearing object, wherein the second model size of the target wearing object model and the wearing object size of the actual wearing object corresponding to the virtual wearing object are in the target display ratio; the wearing effect display module 340 is used to determine the model effect of the target part model and the target wearing object model, and display the wearing effect image after the virtual wearing object is applied to the target wearing part based on the model effect.

[0098] The technical solution provided by the embodiment of the present disclosure obtains the image to be processed and the virtual wearable object in response to the wearing trigger operation through the wearing trigger module, and can start the automatic processing of the wearing effect based on a simple interactive operation. When the image to be processed includes the target wearing part corresponding to the virtual wearable object, the part model determination module determines the target part model corresponding to the target wearing part, and the first model size of the target part model is in the target display ratio with the actual size of the target wearing part, so that the display effect that makes the target part model fit the actual size can be obtained; the target wearable object model corresponding to the virtual wearable object is obtained through the wearable object model determination module, wherein the second model size of the target wearable object model is in the target display ratio with the wearable object size of the actual wearable object corresponding to the virtual wearable object, so that the display effect that makes the target wearable model fit the actual size can be obtained. Finally, the wearing effect display module is used to determine the model effects of the target part model and the target worn object model. The wearing effect image after the virtual worn object is applied to the target wearing part is displayed based on the model effect. This solves the technical problems of high cost of obtaining the wearing effect of the actual worn object and difficulty in displaying the real wearing effect. It plays a role in intuitively presenting the real wearing effect of the target wearing part and the actual worn object through the wearing effect image, which effectively improves the user's wearing experience.

[0099] On the basis of the optional technical solutions of the disclosed embodiments, the wearing trigger module can be specifically used to: in response to a special effect trigger operation for a target special effect, obtain a special effect image as an image to be processed, and obtain a virtual wearable object corresponding to the target special effect; or, in response to a selection trigger operation acting on a wearable object identifier, obtain an image displayed in a target display area as an image to be processed, and obtain a virtual wearable object corresponding to the selected wearable object identifier.

[0100] Based on the optional technical solution of the embodiment of the present disclosure, the part model determination module may include: a key point detection unit, a preliminary model determination unit and a model size adjustment unit. Among them, the key point detection unit is used to determine multiple part key points corresponding to the target wearing part based on the image to be processed; the preliminary model determination unit is used to obtain a standard part model corresponding to the target wearing part, and determine the preliminary part model corresponding to the target wearing part based on the standard part model and multiple part key points; the model size adjustment unit is used to adjust the first model size of the preliminary part model so that the first model size of the target part model and the actual part size of the target wearing part are in the target display ratio.

[0101] On the basis of the optional technical solutions of the disclosed embodiments, optionally, the model size adjustment unit is specifically used to adjust the first model size of the preliminary part model based on the actual distance of key points corresponding to at least two reference key points among the multiple part key points, the key point model distance and the target display ratio.

[0102] Based on the optional technical solution of the embodiment of the present disclosure, optionally, the model size adjustment unit specifically includes: a relative ratio determination subunit and a model deformation subunit. Among them, the relative ratio determination subunit is used to determine the distance relative ratio based on the actual distance of the key points corresponding to at least two reference key points among the multiple part key points and the key point model distance; the model deformation subunit is used to determine the deformation ratio corresponding to the preliminary part model based on the distance relative ratio and the target display ratio, and adjust the first model size of the preliminary part model based on the deformation ratio.

[0103] Based on the optional technical solution of the embodiment of the present disclosure, the target wearing part includes the head, the reference key points include the iris key points, and the key point model distance includes the diameter or radius of the iris in the preliminary part model.

[0104] Based on the optional technical solution of the embodiment of the present disclosure, the wearing effect display module may include: a model posture determination unit and an effect acquisition unit. The model posture determination unit is used to determine the first model posture of the target part model, and determine the second model posture of the target wearing object model based on the first model posture; the effect acquisition unit is used to act the target wearing object model on the target part model based on the second model posture, and obtain the model effect of the target part model and the target wearing object model.

[0105] Based on the optional technical solution of the embodiment of the present disclosure, the wearing effect display module may include: a key point determination unit and an effect generation unit. The key point determination unit is used to determine at least one wearing key point corresponding to the target wearing object model, and determine the associated key point corresponding to the wearing key point in the target part model; the effect generation unit is used to act on the target wearing object model on the target part model based on the wearing key point and the associated key point, and obtain the model effect of the target part model and the target wearing object model.

[0106] On the basis of the optional technical solutions of the disclosed embodiments, optionally, the wearing key points include alignment key points and fitting key points. Accordingly, the action effect generation unit may specifically include: an interaction position determination subunit, a model area morphology adjustment subunit, and a model interaction subunit. Among them, the interaction position determination subunit is used to determine the interaction position of the target wearing object model acting on the target part model based on the alignment key points and the associated key points corresponding to the alignment key points in the target part model; the model area morphology adjustment subunit is used to adjust the area morphology of the model area corresponding to the fitting key points in the target wearing object model based on the fitting key points and the associated key points corresponding to the fitting key points in the target part model; the model interaction subunit is used to act the adjusted target wearing object model on the target part model based on the interaction position.

[0107] On the basis of the optional technical solution of the disclosed embodiment, the device for generating the wearing effect image may further include: a quality detection module, a model generation trigger module and an image acquisition prompt module. Among them, the quality detection module is used to perform quality detection on the image to be processed after acquiring the image to be processed and before determining the target part model corresponding to the target wearing part; the model generation trigger module is used to perform the operation of determining the target part model corresponding to the target wearing part when the quality parameter of the image to be processed meets the preset quality condition; the image acquisition prompt module is used to generate and display a prompt message for prompting the user to reacquire the image to be processed when the quality parameter of the image to be processed does not meet the preset quality condition.

[0108] On the basis of the optional technical solutions of the disclosed embodiments, the quality detection module can be specifically used to: perform quality detection on the image to be processed based on a preset quality detection method, wherein the preset quality detection method includes at least one of the following methods: whether the brightness of the light source in the shooting environment reaches a preset brightness threshold; whether the target wearing part is worn with a virtual wearable object; whether the display posture of the target wearing part is within a preset posture range; whether the display angle of the target wearing part is within a preset angle range; and whether the target wearing part is located in at least one of the preset guide areas.

[0109] The device for generating a wearing effect image provided in the embodiment of the present disclosure can execute the method for generating a wearing effect image provided in any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the method for generating a wearing effect image.

[0110] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0111] Figure 4 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Figure 4 , which shows an electronic device (eg, Figure 4 The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0112] like Figure 4 As shown, the electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An edit / output (I / O) interface 405 is also connected to the bus 404.

[0113] Typically, the following devices may be connected to the I / O interface 405: an input device 406 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 may allow the electronic device 400 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 4The electronic device 400 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0114] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0115] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0116] The electronic device provided in the embodiment of the present disclosure and the method for generating the wearing effect image provided in the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0117] An embodiment of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the method for generating a wearing effect image provided in the above embodiment is implemented.

[0118] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0119] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0120] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0121] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: in response to a wearing trigger operation, obtains an image to be processed and a virtual wearing object; when the image to be processed includes a target wearing part corresponding to the virtual wearing object, determines a target part model corresponding to the target wearing part, wherein a first model size of the target part model and an actual part size of the target wearing part are in a target display ratio; obtains a target wearing object model corresponding to the virtual wearing object, wherein a second model size of the target wearing object model and a wearing size of an actual wearing object corresponding to the virtual wearing object are in the target display ratio; determines a model effect of the target part model and the target wearing object model, and displays a wearing effect image after the virtual wearing object acts on the target wearing part based on the model effect.

[0122] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0123] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0124] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0125] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0126] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0127] According to one or more embodiments of the present disclosure, [Example 1] provides a method for generating a wearing effect image, including:

[0128] In response to a wearing trigger operation, acquiring an image to be processed and a virtual wearable object;

[0129] In a case where the image to be processed includes a target wearing part corresponding to the virtual wearing object, determining a target part model corresponding to the target wearing part, wherein a first model size of the target part model is in a target display ratio with an actual part size of the target wearing part;

[0130] Acquire a target wearing object model corresponding to the virtual wearing object, wherein a second model size of the target wearing object model and an wearing object size of an actual wearing object corresponding to the virtual wearing object are in the target display ratio;

[0131] The model effects of the target part model and the target wearing object model are determined, and based on the model effects, a wearing effect image after the virtual wearing object acts on the target wearing part is displayed.

[0132] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further comprising:

[0133] Optionally, in response to the wearing trigger operation, obtaining the image to be processed and the virtual wearable object includes:

[0134] In response to a special effect triggering operation for a target special effect, a special effect image is acquired as an image to be processed, and a virtual wearable object corresponding to the target special effect is acquired; or,

[0135] In response to a selection triggering operation acting on a worn object identifier, an image displayed in a target display area is acquired as an image to be processed, and a virtual worn object corresponding to the selected worn object identifier is acquired.

[0136] According to one or more embodiments of the present disclosure, [Example 3] provides the method of Example 1, further comprising:

[0137] Optionally, determining the target part model corresponding to the target wearing part includes: determining a plurality of part key points corresponding to the target wearing part based on the image to be processed; acquiring a standard part model corresponding to the target wearing part, and determining a preliminary part model corresponding to the target wearing part based on the standard part model and the plurality of part key points; and adjusting a first model size of the preliminary part model so that the first model size of the target part model and the actual size of the target wearing part are in a target display ratio.

[0138] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 3, further comprising:

[0139] Optionally, adjusting the first model size of the preliminary part model includes: adjusting the first model size of the preliminary part model based on actual distances of key points corresponding to at least two reference key points among the plurality of part key points, key point model distances and target display ratios.

[0140] According to one or more embodiments of the present disclosure, [Example 5] provides the method of Example 4, further comprising:

[0141] Optionally, the adjusting the first model size of the preliminary part model based on the actual distance of the key points corresponding to at least two reference key points among the multiple part key points, the key point model distance and the target display ratio includes: determining the relative distance ratio based on the actual distance of the key points corresponding to at least two reference key points among the multiple part key points and the key point model distance; determining the deformation ratio corresponding to the preliminary part model based on the distance relative ratio and the target display ratio, and adjusting the first model size of the preliminary part model based on the deformation ratio.

[0142] According to one or more embodiments of the present disclosure, [Example 6] provides the method of Example 4, further comprising:

[0143] Optionally, the target wearing part includes the head, the reference key point includes an iris key point, and the key point model distance includes a diameter or radius of the iris in the preliminary part model.

[0144] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 1, further comprising:

[0145] Optionally, determining the model effect of the target part model and the target wearing object model includes: determining a first model pose of the target part model, and determining a second model pose of the target wearing object model based on the first model pose; and applying the target wearing object model to the target part model based on the second model pose to obtain the model effect of the target part model and the target wearing object model.

[0146] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 1, further comprising:

[0147] Optionally, determining the model effect of the target part model and the target wearing object model includes: determining at least one wearing key point corresponding to the target wearing object model, and determining an associated key point in the target part model corresponding to the wearing key point; based on the wearing key point and the associated key point, applying the target wearing object model to the target part model to obtain the model effect of the target part model and the target wearing object model.

[0148] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 1, further comprising:

[0149] Optionally, the wearing key points include alignment key points and fitting key points; and the applying the target wearing object model to the target part model based on the wearing key points and the associated key points includes: determining an interaction position for applying the target wearing object model to the target part model based on the alignment key points and the associated key points in the target part model corresponding to the alignment key points; adjusting a regional morphology of a model area in the target wearing object model corresponding to the fitting key points based on the fitting key points and the associated key points in the target part model corresponding to the fitting key points; and applying the adjusted target wearing object model to the target part model based on the interaction position.

[0150] According to one or more embodiments of the present disclosure, [Example 10] provides the method of Example 1, further comprising:

[0151] Optionally, after acquiring the image to be processed and before determining the target part model corresponding to the target wearing part, it also includes: performing quality detection on the image to be processed; when the quality parameter of the image to be processed meets the preset quality condition, executing the operation of determining the target part model corresponding to the target wearing part; when the quality parameter of the image to be processed does not meet the preset quality condition, generating and displaying prompt information for prompting the user to re-acquire the image to be processed.

[0152] According to one or more embodiments of the present disclosure, [Example 11] provides the method of Example 10, further comprising:

[0153] Optionally, the quality detection of the image to be processed includes: performing quality detection on the image to be processed based on a preset quality detection method, wherein the preset quality detection method includes at least one of the following methods: whether the brightness of the shooting environment light source reaches a preset brightness threshold; whether the target wearing part is worn with the virtual wearing object; whether the display posture of the target wearing part is within a preset posture range; whether the display angle of the target wearing part is within a preset angle range; and whether the target wearing part is located in at least one of the preset guide areas.

[0154] According to one or more embodiments of the present disclosure, [Example 12] provides a device for generating a wearing effect image, including:

[0155] A wearing trigger module, used for acquiring an image to be processed and a virtual wearable object in response to a wearing trigger operation;

[0156] a part model determination module, configured to determine a target part model corresponding to the target wearing part when the image to be processed includes a target wearing part corresponding to the virtual wearing object, wherein a first model size of the target part model is in a target display ratio with an actual part size of the target wearing part;

[0157] an object model determination module, configured to obtain a target object model corresponding to the virtual object, wherein a second model size of the target object model and an object size of an actual object corresponding to the virtual object are in the target display ratio;

[0158] The wearing effect display module is used to determine the model effect of the target part model and the target wearing object model, and based on the model effect, display the wearing effect image after the virtual wearing object acts on the target wearing part.

[0159] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0160] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0161] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for generating a wearing effect image, characterized in that: include: In response to a wearing trigger operation, acquiring an image to be processed and a virtual wearable object; In a case where the image to be processed includes a target wearing part corresponding to the virtual wearing object, determining a target part model corresponding to the target wearing part, wherein a first model size of the target part model is in a target display ratio with an actual part size of the target wearing part; Acquire a target wearing object model corresponding to the virtual wearing object, wherein a second model size of the target wearing object model and an wearing object size of an actual wearing object corresponding to the virtual wearing object are in the target display ratio; The model effects of the target part model and the target wearing object model are determined, and based on the model effects, a wearing effect image after the virtual wearing object acts on the target wearing part is displayed.

2. The method for generating a wearing effect image according to claim 1, characterized in that: The step of obtaining the image to be processed and the virtual wearable object in response to the wearing trigger operation includes: In response to a special effect triggering operation for a target special effect, a special effect image is acquired as an image to be processed, and a virtual wearable object corresponding to the target special effect is acquired; or, In response to a selection triggering operation acting on a worn object identifier, an image displayed in a target display area is acquired as an image to be processed, and a virtual worn object corresponding to the selected worn object identifier is acquired.

3. The method for generating a wearing effect image according to claim 1, characterized in that: The determining of the target part model corresponding to the target wearing part comprises: Determine a plurality of key points corresponding to the target wearing part based on the image to be processed; Acquire a standard part model corresponding to the target wearing part, and determine a preliminary part model corresponding to the target wearing part based on the standard part model and a plurality of the part key points; The first model size of the preliminary part model is adjusted so that the first model size of the target part model and the actual size of the target wearing part are in a target display ratio.

4. The method for generating a wearing effect image according to claim 3, characterized in that: The adjusting the first model size of the preliminary part model comprises: Based on the actual distance of key points corresponding to at least two reference key points among the plurality of the part key points, the key point model distance and the target display ratio, the first model size of the preliminary part model is adjusted.

5. The method for generating a wearing effect image according to claim 4, characterized in that: The adjusting the first model size of the preliminary part model based on the actual distance of the key points corresponding to at least two reference key points among the plurality of the part key points, the key point model distance and the target display ratio comprises: Determine the relative distance ratio based on the actual distance of the key points corresponding to at least two reference key points among the plurality of the key points of the part and the key point model distance; A deformation ratio corresponding to the preliminary part model is determined based on the distance relative ratio and the target display ratio, and a first model size of the preliminary part model is adjusted based on the deformation ratio.

6. The method for generating a wearing effect image according to claim 4, characterized in that: The target wearing part includes the head, the reference key point includes the iris key point, and the key point model distance includes the diameter or radius of the iris in the preliminary part model.

7. The method for generating a wearing effect image according to claim 1, characterized in that: The determining of the model effect of the target part model and the target wearing object model includes: Determine a first model pose of the target part model, and determine a second model pose of the target worn object model based on the first model pose; The target worn object model is applied to the target part model based on the second model posture to obtain a model effect of the target part model and the target worn object model.

8. The method for generating a wearing effect image according to claim 1, characterized in that: The determining of the model effect of the target part model and the target wearing object model includes: Determine at least one wearing key point corresponding to the target wearing object model, and determine an associated key point corresponding to the wearing key point in the target part model; The target wearing object model is applied to the target part model based on the wearing key points and the associated key points to obtain a model effect of the target part model and the target wearing object model.

9. The method for generating a wearing effect image according to claim 8, characterized in that: The wearing key points include alignment key points and fitting key points; and the step of applying the target wearing object model to the target part model based on the wearing key points and the associated key points includes: Determining an interaction position where the target wearing object model acts on the target part model based on the alignment key point and the associated key point in the target part model corresponding to the alignment key point; Based on the fitting key point and the associated key point in the target part model corresponding to the fitting key point, adjusting the regional morphology of the model area corresponding to the fitting key point in the target worn object model; The adjusted target wearing object model is applied to the target part model based on the interaction position.

10. The method for generating a wearing effect image according to claim 1, characterized in that: After acquiring the image to be processed and before determining the target part model corresponding to the target wearing part, the method further includes: Performing quality detection on the image to be processed; In the case where the quality parameter of the image to be processed meets the preset quality condition, performing an operation of determining a target part model corresponding to the target wearing part; When the quality parameter of the image to be processed does not meet the preset quality condition, a prompt message for prompting the user to reacquire the image to be processed is generated and displayed.

11. The method for generating a wearing effect image according to claim 10, characterized in that: The performing quality detection on the image to be processed includes: The quality of the image to be processed is detected based on a preset quality detection method, wherein the preset quality detection method includes at least one of the following methods: whether the brightness of the light source in the shooting environment reaches a preset brightness threshold; whether the virtual wearable object is worn on the target wearing part; whether the display posture of the target wearing part is within a preset posture range; whether the display angle of the target wearing part is within a preset angle range; and whether the target wearing part is located in at least one of the preset guide areas.

12. A device for generating a wearing effect image, characterized in that: include: A wearing trigger module, used for acquiring an image to be processed and a virtual wearable object in response to a wearing trigger operation; a part model determination module, configured to determine a target part model corresponding to the target wearing part when the image to be processed includes a target wearing part corresponding to the virtual wearing object, wherein a first model size of the target part model is in a target display ratio with an actual part size of the target wearing part; an object model determination module, configured to obtain a target object model corresponding to the virtual object, wherein a second model size of the target object model and an object size of an actual object corresponding to the virtual object are in the target display ratio; The wearing effect display module is used to determine the model effect of the target part model and the target wearing object model, and based on the model effect, display the wearing effect image after the virtual wearing object acts on the target wearing part.

13. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method for generating a wearing effect image as described in any one of claims 1 to 11.

14. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the method for generating a wearing effect image as described in any one of claims 1 to 11 when executed by a computer processor.

Images