Intelligent fitting method, device, electronic device and storage medium
By generating a body model that matches the user's body shape and trying it on it, the problem of low realistic trial-on effect in the prior art is solved, and a higher user experience is achieved.
Patent Information
- Application Number
- CN201911317779.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-19
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2039-12-19
AI Technical Summary
When generating a try-on effect, the existing smart try-on mirror cannot effectively match the user's real body shape, resulting in a low sense of reality in the try-on effect and poor user experience.
By obtaining the user's body shape information, a body shape model that matches the user's real body shape is generated, and a body shape model is tried on, displaying the try-on effect model, and at the same time, the user's actual mirror image is displayed in the parts not covered by the subject.
It improves the reality of the try-on effect, enhances the user experience, and provides a try-on effect that is closer to reality by matching the user's real body shape.
Smart Images

Figure CN113011935B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of household appliance technology, and in particular to an intelligent fitting method, device, electronic device and storage medium. Background Art
[0002] When users buy clothes, they often need to try them on. Users need to use a fitting mirror to try on clothes. Traditional fitting mirrors are ordinary mirrors, and users need to put on clothes themselves and stand in front of the fitting mirror to check the fitting effect. With the continuous development of smart terminal technology, smart fitting mirrors have emerged. Smart fitting mirrors can help users try on clothes virtually without the need for users to put on clothes themselves, reducing the tedious process of trying on clothes in person, and are therefore popular with users.
[0003] The prior art provides a smart fitting mirror that can display a model effect picture of a user trying on clothes. However, the prior art splices the user's facial image with a preset human body model, and then superimposes a two-dimensional picture of the clothes being tried on on a standard human body model to obtain a model effect picture. However, different users have different body shapes and heights, and the reality of the fitting effect presented by the prior art method is low, resulting in a poor user experience. Summary of the invention
[0004] The present application provides an intelligent fitting method, device, electronic device and storage medium, which can generate a body model that matches the user's real body shape, improve the realism of the fitting effect, and thus improve the user experience.
[0005] The first aspect of the present application provides an intelligent fitting method, comprising:
[0006] Acquire the body shape information of the user; generate a body shape model of the user according to the body shape information of the user; generate a first fitting effect model according to the characteristic information of the fitting object and the body shape model, wherein the characteristic information of the fitting object includes the style and size of the fitting object; display the first fitting effect model, and display the actual mirror image of the user at the part of the first fitting effect model not covered by the fitting object.
[0007] Optionally, generating a first fitting effect model according to the feature information of the fitting object and the body model includes: acquiring description information of the first fitting effect model according to the feature information of the fitting object and the body model of the user;
[0008] The first fitting effect model is generated according to the description information of the first fitting effect model.
[0009] Optionally, the size of the body model is equal to the actual body size of the user, the smart fitting mirror comprises an outer perspective mirror and an inner plurality of display screens, the area of the perspective mirror is equal to the area of the plurality of display screens, and the displaying of the first fitting effect model and the displaying of the actual mirror image of the user at a portion of the first fitting effect model not covered by the fitting object comprises: obtaining a first position on the smart fitting mirror of a portion of the fitting object covering the body model and a second position on the smart fitting mirror of a portion of the fitting object not covering the body model;
[0010] Controlling the display screen at the first position to turn on, and controlling the display screen to display the first fitting effect model;
[0011] The display screen at the second position is controlled to be turned off, and the actual mirror image is displayed on the perspective mirror corresponding to the second position.
[0012] Optionally, the method further includes: if the fitting score of the first fitting effect model is less than a preset value, displaying a reminder message and a target size, the target size matches the body shape of the user, and the reminder message is used to indicate that the fitting object does not match the body shape of the user;
[0013] If a selection instruction of the target size by the user is received, a second fitting effect model is generated according to the characteristic information of the fitting object of the target size and the body model;
[0014] The second fitting effect model is displayed, and an actual mirror image of the user is displayed at a portion of the second fitting effect model that is not covered by the fitting object of the target size.
[0015] Optionally, the method further includes: if it is detected that the user rotates, rotating and displaying the first fitting effect model according to the rotation direction of the user.
[0016] Optionally, the method further includes: displaying a matching effect diagram of the tried-on object, wherein the matching effect diagram includes the tried-on object and other objects matched with the tried-on object.
[0017] Optionally, there are multiple fitting objects, and the fitting objects correspond to the same part of the body model. The method further includes: sequentially displaying a first fitting effect model corresponding to each fitting object.
[0018] Optionally, sequentially displaying the first trying-on effect model corresponding to each trying-on object includes: acquiring gesture information of the user, wherein the gesture information is used to instruct to display the first trying-on effect model of the next trying-on object;
[0019] According to the gesture information of the user, a first trying-on effect model of the next trying-on object is displayed.
[0020] The second aspect of the present application provides an intelligent fitting device, comprising:
[0021] a processing module, configured to obtain the body shape information of the user, generate a body shape model of the user according to the body shape information of the user, and generate a first fitting effect model according to the characteristic information of the fitting object and the body shape model, wherein the characteristic information of the fitting object includes the style and size of the fitting object;
[0022] The display module is used to display the first fitting effect model and to display an actual mirror image of the user at a portion of the first fitting effect model that is not covered by the fitting object.
[0023] Optionally, the processing module is specifically used to obtain the description information of the first trying-on effect model according to the feature information of the trying-on object and the body shape information of the user; and generate the first trying-on effect model according to the description information of the first trying-on effect model.
[0024] Optionally, the size of the body model is equal to the actual body size of the user, and the smart fitting mirror comprises an outer perspective mirror and an inner plurality of display screens, and the area of the perspective mirror is equal to the area of the plurality of display screens.
[0025] Correspondingly, the processing module is specifically used to obtain a first position on the smart fitting mirror where the part of the subject being tried on covers the body model, and a second position on the smart fitting mirror where the part of the subject being tried on does not cover the body model, and to control the display screen at the first position to turn on, and to display the first fitting effect model on the display screen; and to control the display screen at the second position to turn off, and to display the actual mirror image on the perspective mirror corresponding to the second position.
[0026] Optionally, the display module is further used to display a reminder message and a target size when the fitting score of the first fitting effect model is less than a preset value, the target size matches the body shape of the user, and the reminder message is used to indicate that the fitting object does not match the body shape of the user;
[0027] A transceiver module, used for receiving a selection instruction of a target size by the user;
[0028] Correspondingly, the processing module is further configured to generate a second fitting effect model according to the characteristic information of the fitting object of the target size and the body model when the transceiver module receives the user's selection instruction for the target size;
[0029] Correspondingly, the display module is further used to display the second fitting effect model, and to display the actual mirror image of the user at a portion of the second fitting effect model that is not covered by the fitting object of the target size.
[0030] Optionally, the processing module is further used to detect the user rotation.
[0031] The display module is further configured to rotate and display the first fitting effect model according to a rotation direction of the user when the processing module detects that the user has rotated.
[0032] Optionally, the display module is further used to display a matching effect diagram of the tried-on object, wherein the matching effect diagram includes the tried-on object and other objects that match the tried-on object.
[0033] Optionally, there are multiple trial objects, and the trial objects correspond to the same part of the body model.
[0034] Correspondingly, the display module is also used to display the first fitting effect model corresponding to each fitting object in sequence.
[0035] Optionally, the processing module is further used to obtain gesture information of the user, where the gesture information is used to instruct to display a first fitting effect model of a next fitting object;
[0036] Correspondingly, the display module is also used to display the first fitting effect model of the next fitting object according to the gesture information of the user.
[0037] A third aspect of the present application provides an electronic device, comprising: at least one processor and a memory;
[0038] The memory stores computer-executable instructions;
[0039] The at least one processor executes the computer-executable instructions stored in the memory, so that the electronic device executes the intelligent try-on method of the first aspect mentioned above.
[0040] A fourth aspect of the present application provides a computer-readable storage medium, on which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, the intelligent fitting method of the first aspect is implemented.
[0041] The present application provides a smart fitting method, device, electronic device and storage medium, the method comprising: receiving the body shape information of a user; generating a body shape model of the user according to the body shape information of the user; generating a first fitting effect model according to the characteristic information of the fitting object and the body shape model, wherein the characteristic information of the fitting object includes the style and size of the fitting object; displaying the first fitting effect model, and displaying the actual mirror image of the user in the part of the first fitting effect model not covered by the fitting object. The smart fitting method in this embodiment can generate a body shape model that matches the real body shape of the user according to the body shape information of the user, and then try on the body shape model, which can improve the realism of the fitting effect and thus improve the user experience; further, in this embodiment, the actual mirror image of the user can also be displayed in the part not covered by the fitting object, which can further improve the realism of the fitting effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The preferred implementation of the intelligent fitting method provided by the present application is described below with reference to the accompanying drawings and in combination with specific embodiments.
[0043] Figure 1 Schematic diagram of the process of the intelligent fitting method provided in this application Figure 1 ;
[0044] Figure 2 Schematic diagram of the interface changes of the smart fitting mirror provided in this application Figure 1 ;
[0045] Figure 3 Schematic diagram of the process of the intelligent fitting method provided in this application Figure 2 ;
[0046] Figure 4 Schematic diagram of the interface changes of the smart fitting mirror provided in this application Figure 2 ;
[0047] Figure 5 A schematic diagram of the structure of the intelligent fitting device provided in this application;
[0048] Figure 6 A schematic diagram of the structure of the electronic device provided in this application. DETAILED DESCRIPTION
[0049] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below in combination with the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0050] In order to solve the problem of low realism of trying on effects in the prior art, the present application provides an intelligent trying on method, which can obtain the user's body shape information, generate a body model that matches the user's real body shape based on the user's body shape information, and then try on the user on the body model, which can improve the realism of the trying on effect and thus improve the user experience.
[0051] The following is an explanation of the smart fitting method provided by the present application in conjunction with specific embodiments. Figure 1 Schematic diagram of the process of the intelligent fitting method provided in this application Figure 1 . Figure 1 The execution subject of the method flow shown can be a smart fitting mirror, which can be implemented by any software and hardware. Figure 1 As shown, the intelligent fitting method provided in this embodiment may include:
[0052] S101, obtaining the user's body shape information.
[0053] In this embodiment, the user's body shape information may include the user's weight, shoulder width, arm length, arm circumference, chest circumference, abdominal circumference, waist circumference, hip circumference, thigh circumference, leg length, etc. Optionally, the user's body shape information may be input by the user into the smart fitting mirror, that is, the smart fitting mirror receives the body shape information input by the user.
[0054] Optionally, a floor mat / weight scale may be provided around the smart fitting mirror, and the floor mat / weight scale is used to obtain the user's weight. After the floor mat / weight scale obtains the user's weight, the user's weight may be sent to the smart fitting mirror.
[0055] A camera may be integrated into the smart fitting mirror, and when the user stands on the mat / scale, the user's image may be captured. It should be understood that the camera in this embodiment may capture images of the user in different positions, and while capturing the images, the distance between each part of the user and the camera may be obtained. It should be understood that the camera in this embodiment may capture images of the user in different positions while the user is rotating, or may capture images by rotating the camera relative to the user.
[0056] After acquiring the images of the user in different positions and the above distance information, the camera can send the images of the user in different positions and the distance information to the smart fitting mirror. The smart fitting mirror acquires the user's shoulder width, arm length, arm circumference, chest circumference, abdominal circumference, waist circumference, hip circumference, leg circumference, leg length and other information based on the user images in different positions and the distance information corresponding to each image. It should be understood that in this embodiment, the distance of each part from the camera can be used as the distance of each part from the smart fitting mirror.
[0057] Exemplarily, when the user faces the smart fitting mirror from the front, the distance between the front leg surface of the user and the smart fitting mirror is A cm, when the user faces the front side of the smart fitting mirror from the side, the distance between the front leg surface of the user and the smart fitting mirror is B cm, and when the user faces the back side of the smart fitting mirror from the side, the distance between the front leg surface of the user and the smart fitting mirror is C cm. The smart fitting mirror can obtain the user's leg circumference based on A cm, B cm, and C cm. Similarly, according to this method, the smart fitting mirror can obtain the user's shoulder width, arm length, arm circumference, chest circumference, abdominal circumference, waist circumference, hip circumference, leg circumference, leg length and other information.
[0058] It should be understood that the smart fitting mirror in this embodiment can start to obtain the user's body shape information when receiving the fitting instruction input by the user. Optionally, in this embodiment, the user can input the fitting instruction by voice interaction with the smart fitting mirror, for example, when the user says "I want to try on", the smart fitting mirror is triggered to obtain the user's body shape information. Alternatively, a "fit-on" control can be displayed on the smart fitting mirror, and when the user selects the "fit-on" control by clicking or other means, the smart fitting mirror is triggered to obtain the user's body shape information.
[0059] It is conceivable that if the user does not trigger the smart fitting mirror to obtain the user's body shape information, the smart fitting mirror can be used as an ordinary mirror.
[0060] Exemplarily, in this embodiment, the interaction between the smart fitting mirror and the floor mat / weight scale is taken as an example to illustrate how the smart fitting mirror obtains the body shape information of the user. Figure 2 Schematic diagram of the interface changes of the smart fitting mirror provided in this application Figure 1 .like Figure 2 As shown in interface 201, a "try on" control is displayed on the interface 201. If the user selects the "try on" control, the interface 201 can jump to the interface 202, which displays something like "please stand on the mat / scale and rotate a circle", and triggers the mat / scale and the camera to obtain the above-mentioned body shape information of the user.
[0061] S102: Generate a body model of the user according to the body information of the user.
[0062] In this embodiment, a body model of the user can be generated according to the body information of the user, and the body model is a virtual 3D body model.
[0063] Among them, a possible way to generate a user's body model is: a preset algorithm is stored in the smart fitting mirror, and the user's body model can be generated according to the preset algorithm and the user's body information. Optionally, the preset algorithm can be obtained through deep learning training with multiple body information as training sets.
[0064] Another possible way to generate a user's body model is: the smart fitting mirror stores a preset body model and the size information of each part of the preset body model. In this embodiment, the size of the corresponding part on the preset body model can be increased or decreased according to the user's body information and the size information of each part of the preset body model to generate the user's body model.
[0065] For example, if the waist circumference of the preset body model is 70 cm and the waist circumference of the user is 80 cm, then the area around the waist of the preset body model will increase by an average of 10 cm.
[0066] S103, generating a first fitting effect model according to feature information of the fitting object and the body model, wherein the feature information of the fitting object includes the style and size of the fitting object.
[0067] It should be understood that the tried-on object in this embodiment may be clothing, shoes, hats, accessories, etc. The characteristic information of the tried-on object includes the style and size of the tried-on object. The style of the tried-on object may be the material, shape, style, etc. of the tried-on object. The size of the tried-on object may include at least one of the following: shoulder width, chest circumference, sleeve length, sleeve circumference, abdominal circumference, hem circumference, length of clothing, trousers length, waist circumference, straight crotch, hip circumference, thigh circumference, and trouser leg circumference.
[0068] It should be understood that the feature information of multiple objects is stored in the smart try-on mirror. The smart try-on mirror can obtain the feature information of the try-on object that the user tries on. Optionally, a possible implementation method for the smart try-on mirror to obtain the feature information of the try-on object is: when the smart try-on mirror obtains images of the user in different orientations, it can obtain images of the try-on object. Among them, when the user tries on the try-on object, he can hold the clothes in his hands, or gesture on his body, and the smart try-on mirror can obtain the image of the try-on object. Optionally, the smart try-on mirror can store the correspondence between the image of the object and the feature information of the object. After obtaining the image of the try-on object, the feature information corresponding to the try-on object can be determined in the correspondence. Among them, the correspondence between the image of the object and the feature information of the object can be shown in the following Table 1:
[0069] Table 1
[0070]
[0071] Optionally, the smart fitting mirror can store the correspondence between the identification (such as the number) of the object and the characteristic information of the object. After acquiring the image of the fitting object, the smart fitting mirror can determine the identification of the fitting object based on the image of the fitting object, and then determine the characteristic information corresponding to the fitting object based on the correspondence between the identification (such as the number) of the object and the characteristic information of the object. It should be understood that the fitting object is one of the objects. Among them, the correspondence between the identification (such as the number) of the object and the characteristic information of the object can be shown in the following Table 2:
[0072] Table 2
[0073]
[0074]
[0075] Optionally, another possible implementation method in which the smart fitting mirror can obtain the characteristic information of the fitting object is: a barcode, a two-dimensional code, or an RFID tag is provided on the fitting object to characterize the identification information of the fitting object. The smart fitting mirror can obtain the characteristic information corresponding to the fitting object according to the barcode, two-dimensional code, or RFID tag provided on the fitting object. It should be understood that the corresponding relationship between the barcode, two-dimensional code, or RFID tag of the object and the characteristic information of the object can be stored in the smart fitting mirror.
[0076] The smart fitting mirror may be integrated with a scanning device, which can be used to scan the barcode or QR code of the fitting object to obtain the characteristic information corresponding to the fitting object; or the smart fitting mirror may be integrated with an RFID reader to read the RFID tag to obtain the characteristic information corresponding to the fitting object. The corresponding relationship between the barcode, QR code or RFID tag and the characteristic information of the object can be shown in Table 3 below:
[0077] Table 3
[0078]
[0079] In this embodiment, a first fitting effect model may be generated according to the feature information and body model of the fitting object. The first fitting effect model is used to represent the effect model of fitting the fitting object on the body model of the user.
[0080] For example, if the tried-on object is a shirt, a first tried-on effect model can be generated based on the shirt's shoulder width, chest circumference, sleeve length, sleeve circumference, waist circumference, hem circumference, and length, as well as the user's weight, shoulder width, arm length, arm circumference, chest circumference, waist circumference, and waist circumference. The first tried-on effect model can characterize whether the tried-on object is suitable for the user, whether it is oversized, thin, too short, too long, sleeve length, and other information.
[0081] Optionally, in this embodiment, different styles and sizes of try-on objects can be worn by users of different body types in advance, and 360-degree videos can be shot. For example, a user with a height of 173cm, a weight of 80kg, and a waist circumference of 114 tries on shirts of models 170 / 88A, 175 / 92A, and 180 / 96A respectively, and shoots a 360-degree video to obtain the try-on effect model of the user of this body type wearing the shirt of different sizes. Similarly, the try-on effect model of users of different body types wearing the shirt of different sizes can be obtained. It should be understood that the try-on effect model of people of different body types wearing shirts of different sizes, for example, when the user with a larger waist circumference wears a 170 / 88A shirt, the wrinkles and the opening of the placket are caused by the larger abdomen. When a user with a smaller chest circumference wears a 170 / 88A shirt, the effects such as a wide chest area are caused by the smaller chest circumference.
[0082] Furthermore, the smart fitting mirror in this embodiment can store fitting effect models of different body types of users wearing different objects with different feature information. Furthermore, in this embodiment, according to the body model of the user and the feature information of the fitting object, the first fitting effect model that meets the user's needs can be generated by referring to the stored fitting effect models.
[0083] S104, displaying a first fitting effect model, and displaying an actual mirror image of the user at a portion of the first fitting effect model that is not covered by the fitting object.
[0084] In this embodiment, after obtaining the first fitting effect model, the first fitting effect model can be displayed, and the actual mirror image of the user can be displayed at the part of the first fitting effect model that is not covered by the fitting object. For example, if the fitting object is a shirt, the first fitting effect model of the upper body of the user trying on the shirt can be displayed, and the actual mirror image of the user displayed by the smart dressing mirror can be displayed at the lower body and head of the user. For example, the first fitting effect model is displayed from the waist to the neck of the user, while the actual mirror image of the user wearing jeans is displayed at the lower body of the user, and the actual mirror image of the user wearing a peaked cap is displayed at the head of the user.
[0085] It should be understood that in this embodiment, the first fitting effect model covering the part of the fitting object and the actual mirror image of the part not covered by the fitting object are spliced to display a picture that is more in line with the user's real feelings in the smart fitting mirror, thereby improving the user experience. The user can also see the matching effect of the fitting object and the objects worn by the user (such as clothes, shoes, accessories, etc.).
[0086] Correspondingly, the above interface 202 can jump to interface 203, in which the first fitting effect model is displayed from the waist to the neck of the user, that is, the first fitting effect model of trying on short sleeves (such as exposing the navel), the actual mirror image of the user wearing jeans is displayed on the lower body of the user, and the actual mirror image of the user's head is displayed at the head position of the user. In order to show the difference between the first fitting effect model and the actual mirror image in interface 203, the first fitting effect model is represented by a dotted line, and the actual mirror image is represented by a realization.
[0087] Optionally, before the interface 202 jumps to the interface 203, the smart fitting mirror may further display an interface 204, on which a text reminder message "generating a fitting effect model" may be displayed to remind the user to wait for the first fitting effect model.
[0088] It should be understood that the above S101-S104 can also be performed by other smart devices, wherein the smart device can obtain the actual mirror image of the user, for example, a smart phone, a smart wardrobe with an integrated mirror, or other electronic devices with an integrated camera (which can obtain the actual mirror image of the user).
[0089] Optionally, in this embodiment, if the smart fitting mirror detects that the user is rotating, the first fitting effect model is displayed by rotating according to the user's rotation direction. It should be understood that in this embodiment, the smart fitting mirror can obtain the user's action to determine that the user is rotating, and obtain the user's rotation direction, and then rotate and display the first fitting effect model according to the same rotation direction as the user. It is worth noting that the position not covered by the fitting object is displayed as the actual mirror image of the user.
[0090] Optionally, if the object to be tried on is a single piece, the smart fitting mirror can display a matching effect diagram of the object to be tried on, which includes the object to be tried on and other objects that match the object to be tried on. For example, if the object to be tried on is a short-sleeved shirt, the matching effect diagram may include the short-sleeved shirt and objects such as pants, skirts or hats that match the short-sleeved shirt.
[0091] The intelligent fitting method provided in this embodiment includes: receiving the body shape information of the user; generating the body shape model of the user according to the body shape information of the user; generating a first fitting effect model according to the characteristic information of the fitting object and the body shape model, wherein the characteristic information of the fitting object includes the style and size of the fitting object; displaying the first fitting effect model, and displaying the actual mirror image of the user in the part of the first fitting effect model not covered by the fitting object. The intelligent fitting method in this embodiment can generate a body shape model that matches the real body shape of the user according to the body shape information of the user, and then try on the body shape model, which can improve the realism of the fitting effect and thus improve the user experience; further, in this embodiment, the actual mirror image of the user can also be displayed in the part not covered by the fitting object, which can further improve the realism of the fitting effect.
[0092] Based on the above embodiments, Figure 3 The intelligent fitting method provided in this application is further explained. Figure 3 Schematic diagram of the process of the intelligent fitting method provided in this application Figure 2 .like Figure 3 As shown, the intelligent fitting method provided in this embodiment may include:
[0093] S301, receiving body shape information of a user.
[0094] S302: Generate a body model of the user according to the body information of the user.
[0095] It should be understood that the implementation of S301-S302 in this embodiment may refer to the relevant description of S101-S102 in the above embodiment, and will not be repeated here.
[0096] S303: Obtain description information of a first fitting effect model according to feature information of the fitting object and body shape information of the user.
[0097] In this embodiment, the description information of the first fitting effect model is used to characterize the characteristics of the part covered by the fitting object in the first fitting effect model. For example, the description information of the first fitting effect model may be such as "the top is short and the navel is exposed".
[0098] It should be understood that the smart fitting mirror in the above embodiment stores fitting effect models with different characteristic information of users of different body shapes wearing different objects, and correspondingly, the smart fitting mirror may store description information of fitting effect models with different characteristic information of users of different body shapes wearing different objects. After acquiring the characteristic information of the fitting object and the body shape information of the user, the description information of the first fitting effect model of the user wearing the fitting object may be determined based on the description information of the fitting effect models with different characteristic information of users of different body shapes wearing different objects stored.
[0099] S304: Generate a first fitting effect model according to the description information of the first fitting effect model.
[0100] In this embodiment, since the description information of the first fitting effect model is used to characterize the characteristics of the part covered by the tried-on object in the first fitting effect model, the first fitting effect model can be generated according to the characteristics of the part covered by the tried-on object in the first fitting effect model.
[0101] For example, if the description information of the first fitting effect model can be such as "short top, navel exposed", the user's body model can be used to generate the first fitting effect model with navel exposed, as described above. Figure 2 As shown in the middle interface 203.
[0102] S305, obtaining a first position of a part of the subject being tried on that covers the body model on the smart fitting mirror, and a second position of a part of the subject being tried on that does not cover the body model on the smart fitting mirror.
[0103] The smart fitting mirror in this embodiment includes an outer perspective mirror and multiple display screens in the inner layer, and the area of the perspective mirror is equal to the area of the multiple display screens. It should be understood that when the user does not trigger the smart fitting mirror to obtain the user's body shape information, the smart fitting mirror controls the outer perspective mirror to act as an ordinary mirror. When the user does not trigger the smart fitting mirror to obtain the user's body shape information and needs to display the first fitting effect model, the display screen at the corresponding position can be controlled to display the first fitting effect model, and the perspective mirror at this position is controlled to be transparent, and the perspective mirrors at other corresponding positions not covered by the fitting object act as ordinary mirrors to display the user's actual mirror image.
[0104] It should be noted that the size of the user's body model generated in this embodiment is equal to the user's actual body size, so as to improve the accuracy of the splicing of the first fitting effect model and the actual mirror image. Among them, the first position of the part of the fitting object covering the body model on the smart fitting mirror and the second position of the part of the fitting object not covering the body model on the smart fitting mirror can be obtained. Exemplarily, if the fitting object is a short-sleeved shirt, the part of the body model covered by the short sleeves, that is, the first position of the user's upper body on the smart fitting mirror is obtained; and the part of the body model not covered by the short sleeves, that is, the second position of the user's lower body and head on the smart fitting mirror is obtained.
[0105] Optionally, if there are multiple try-on objects, and the try-on objects correspond to the same part of the body model (such as all tops), then in this embodiment, the first try-on effect model corresponding to each try-on object can be displayed in sequence. Among them, the acquisition and display method of the first try-on effect model corresponding to each try-on object can refer to the above-mentioned related description. Among them, it should be noted that in this embodiment, the first try-on effect model corresponding to each try-on object can be displayed in sequence according to the order of acquiring the try-on objects (such as the order of scanning the QR code of the try-on objects).
[0106] In this embodiment, the smart fitting mirror can obtain the user's gesture information to determine whether to display the first fitting effect model of the next fitting object. In this embodiment, gesture information for representing and indicating the display of the first fitting effect model of the next fitting object is stored. If the gesture information is the same as the gesture information for indicating the display of the first fitting effect model of the next fitting object, it is determined that the gesture information is used to indicate the display of the first fitting effect model of the next fitting object. Correspondingly, the smart fitting mirror in this embodiment displays the first fitting effect model of the next fitting object according to the user's gesture information and in the order in which the fitting objects are obtained.
[0107] S306, controlling the display screen at the first position to turn on, and controlling the display screen to display a first fitting effect model.
[0108] Since the first position is the position for displaying the first fitting effect model, in this embodiment, the display screen at the first position is controlled to be turned on, and the first fitting effect model is controlled to be displayed on the display screen. It should be understood that the perspective mirror corresponding to the first position is transparent, so that the user can see the first fitting effect model displayed on the display screen at the first position of the inner layer.
[0109] S307, controlling the display screen at the second position to turn off, and displaying the actual mirror image on the perspective mirror corresponding to the second position.
[0110] It should be understood that there is no sequence difference between S306 and S307, and both can be executed simultaneously.
[0111] Corresponding to the above S306, since the second position is the position where the actual mirror image of the user is displayed, in this embodiment, the display screen at the second position is controlled to be turned off, and the actual mirror image is displayed on the perspective mirror corresponding to the second position.
[0112] S308: If the fitting score of the first fitting effect model is less than a preset value, a reminder message and a target size are displayed, the target size matches the user's body shape, and the reminder message is used to indicate that the fitting object does not match the user's body shape.
[0113] In this embodiment, the fitting score of the first fitting effect model can be obtained according to the first fitting effect model and the preset scoring rules. A preset value is stored in the smart fitting mirror. When the fitting score of the first fitting effect model is less than the preset value, a reminder message and a target size are displayed. The target size matches the body shape of the user, and the reminder message is used to indicate that the fitting object does not match the body shape of the user.
[0114] Exemplarily, the first fitting effect model includes an effect model of a user trying on a short-sleeved shirt, and the effect model shows that the user exposes his belly button. Then, according to the first fitting effect model of the user exposing his belly button and a preset scoring rule, a fitting score of the first fitting effect model is obtained.
[0115] Optionally, the preset scoring rules may be: if the clothing is too big or too small, too long or too short, the score is X; if the clothing fits the body well, the score is Y; if the clothing color does not match the user's skin color, the score is Z; etc. In this embodiment, if the first fitting effect model shows that the user's navel is exposed, the clothing is too small, and the corresponding fitting score is X.
[0116] When the fitting score X is less than a preset value, a reminder message is displayed, and a target size matching the user's body shape is displayed. Figure 4 Schematic diagram of the interface changes of the smart fitting mirror provided in this application Figure 2 . Figure 4 The interface 401 in the embodiment may be the same as the above interface 203. The difference from the above interface 203 is that the interface 401 displays a reminder message such as "The clothing size is small. A suitable size has been selected for you. Try it!" and displays a target size such as "XL" to remind the user to try on a short-sleeved shirt of the target size.
[0117] S309: If a selection instruction of the target size is received from the user, a second fitting effect model is generated according to the feature information of the fitting object of the target size and the body model.
[0118] In this embodiment, the user can select the target size by clicking or other operation methods, and correspondingly, the smart fitting mirror receives the user's selection instruction for the target size. If the smart fitting mirror receives the user's selection instruction for the target size, it generates a second fitting effect model based on the characteristic information of the fitting object of the target size and the user's body model. It should be understood that the generation method of the second fitting effect model in this embodiment can refer to the relevant description in the above embodiment.
[0119] S310, displaying a second fitting effect model, and displaying an actual mirror image of the user at a portion of the second fitting effect model that is not covered by the fitting object of the target size.
[0120] It should be understood that the implementation of S310 in this embodiment can refer to the relevant description of S104 in the above embodiment, which will not be repeated here. It is worth noting that the above interface 401 can jump to interface 402, and the difference between the display on the interface 402 and the above interface 203 is that the user is more fitted when wearing the short-sleeved shirt of the target size, without exposing the navel, etc.
[0121] Optionally, before displaying interface 402 , interface 403 may be displayed, and interface 403 is the same as interface 204 in the above embodiment.
[0122] In this embodiment, the size of the body model is equal to the actual body size of the user, and thus when the stitching image of the fitting effect model and the actual mirror image is displayed on the smart fitting mirror, the stitching accuracy can be improved to improve the realism of the fitting effect, thereby improving the user experience; further, in this embodiment, a fitting object of a size suitable for the user can be recommended to the user, and a fitting effect model when the user tries on the fitting object of the size suitable for the user can be displayed, thereby further improving the user experience.
[0123] Figure 5 This is a schematic diagram of the structure of the intelligent fitting device provided in this application. The intelligent fitting device can be an intelligent fitting mirror. Figure 5 As shown, the intelligent try-on device 500 includes: a processing module 501 , a display module 502 and a transceiver module 503 .
[0124] The processing module 501 is used to obtain the body shape information of the user, and generate the body shape model of the user according to the body shape information of the user, and generate a first fitting effect model according to the characteristic information of the fitting object and the body shape model, wherein the characteristic information of the fitting object includes the style and size of the fitting object;
[0125] The display module 502 is used to display the first fitting effect model and to display the actual mirror image of the user at the part of the first fitting effect model that is not covered by the fitting object.
[0126] Optionally, the processing module 501 is specifically configured to obtain description information of a first fitting effect model according to feature information of a fitting object and body shape information of a user; and generate a first fitting effect model according to the description information of the first fitting effect model.
[0127] Optionally, the size of the body model is equal to the actual body size of the user, and the smart fitting mirror includes an outer perspective mirror and an inner plurality of display screens, and the area of the perspective mirror is equal to the area of the plurality of display screens.
[0128] Correspondingly, the processing module 501 is specifically used to obtain the first position of the part of the subject being tried on that covers the body model on the smart fitting mirror, and the second position of the part of the subject being tried on that does not cover the body model on the smart fitting mirror, and to control the display screen at the first position to turn on, and to control the display screen to display the first fitting effect model; and to control the display screen at the second position to turn off, and to display the actual mirror image on the perspective mirror corresponding to the second position.
[0129] Optionally, the display module 502 is further configured to display a reminder message and a target size when the fitting score of the first fitting effect model is less than a preset value, the target size matches the user's body shape, and the reminder message is used to indicate that the fitting object does not match the user's body shape;
[0130] The transceiver module 503 is used to receive the user's selection instruction of the target size;
[0131] Correspondingly, the processing module 501 is further configured to generate a second fitting effect model according to the characteristic information and body model of the fitting object of the target size when the transceiver module 503 receives the user's selection instruction for the target size;
[0132] Correspondingly, the display module 502 is further used to display the second fitting effect model, and to display the actual mirror image of the user at the part of the second fitting effect model that is not covered by the fitting object of the target size.
[0133] Optionally, the processing module 501 is further used to detect user rotation.
[0134] The display module 502 is further configured to rotate and display the first fitting effect model according to the rotation direction of the user when the processing module 501 detects that the user is rotating.
[0135] Optionally, the display module 502 is further used to display a matching effect diagram of the tried-on object, where the matching effect diagram includes the tried-on object and other objects that match the tried-on object.
[0136] Optionally, there are multiple trial objects, and the trial objects correspond to the same part of the body model.
[0137] Correspondingly, the display module 502 is also used to sequentially display the first fitting effect model corresponding to each fitting object.
[0138] Optionally, the processing module 501 is further used to obtain gesture information of the user, where the gesture information is used to instruct to display a first fitting effect model of the next fitting object;
[0139] Correspondingly, the display module 502 is further used to display the first fitting effect model of the next fitting object according to the user's gesture information.
[0140] The intelligent fitting device provided in this embodiment has similar principles and technical effects to those achieved by the intelligent fitting method described above, and will not be elaborated herein.
[0141] Figure 6 This is a schematic diagram of the structure of the electronic device provided in this application. Figure 6 As shown, the electronic device 600 includes: a memory 601 and at least one processor 602 .
[0142] The memory 601 is used to store program instructions.
[0143] The processor 602 is used to implement the intelligent fitting method in this embodiment when the program instructions are executed. The specific implementation principle can be found in the above embodiment, and this embodiment will not be repeated here.
[0144] The electronic device 600 may further include an input / output interface 603 .
[0145] The input / output interface 603 may include an independent output interface and an input interface, or may be an integrated interface integrating input and output, wherein the output interface is used to output data, and the input interface is used to obtain input data.
[0146] The present application also provides a readable storage medium, in which execution instructions are stored. When at least one processor of an electronic device executes the execution instruction, when the computer execution instruction is executed by the processor, the intelligent try-on method in the above embodiment is implemented.
[0147] The present application also provides a program product, which includes an execution instruction, which is stored in a readable storage medium. At least one processor of an electronic device can read the execution instruction from the readable storage medium, and at least one processor executes the execution instruction so that the electronic device implements the intelligent fitting method provided by the various embodiments described above.
[0148] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.
[0149] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0150] In addition, each functional module in each embodiment of the present application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of hardware plus software functional modules.
[0151] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (English: processor) to perform some steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English: Read-Only Memory, abbreviated: ROM), random access memory (English: Random Access Memory, abbreviated: RAM), disk or optical disk and other media that can store program codes.
[0152] In the above-mentioned server or terminal embodiments, it should be understood that the processing module may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present application may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.
[0153] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. An intelligent fitting method, applied to an intelligent fitting mirror, wherein the intelligent fitting mirror comprises an outer perspective mirror and an inner plurality of display screens, wherein the area of the perspective mirror is equal to the area of the plurality of display screens, and wherein: include: Get the user's body shape information; Generating a body model of the user according to the body shape information of the user; Generate a first fitting effect model according to feature information of the fitting object and the body model, wherein the feature information of the fitting object includes the style and size of the fitting object; Acquire a first position on the smart fitting mirror of a part of the subject being tried on that covers the body model, and a second position on the smart fitting mirror of a part of the subject being tried on that does not cover the body model; Controlling the display screen at the first position to turn on, and controlling the display screen to display the first fitting effect model; The display screen at the second position is controlled to be turned off, and an actual mirror image is displayed on the perspective mirror corresponding to the second position, so that the first fitting effect model of the part of the fitting subject covering the body model and the actual mirror image of the part of the fitting subject not covering the body model are spliced and displayed.
2. The method according to claim 1, characterized in that The step of generating a first fitting effect model according to the feature information of the fitting object and the body model comprises: Acquire description information of the first fitting effect model according to the feature information of the fitting object and the body shape information of the user; The first fitting effect model is generated according to the description information of the first fitting effect model.
3. The method according to claim 1, characterized in that The size of the body model is equal to the actual body size of the user.
4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: If the fitting score of the first fitting effect model is less than a preset value, a reminder message and a target size are displayed, the target size matches the body shape of the user, and the reminder message is used to indicate that the fitting object does not match the body shape of the user; If a selection instruction of the target size by the user is received, a second fitting effect model is generated according to the characteristic information of the fitting object of the target size and the body model; The second fitting effect model is displayed, and an actual mirror image of the user is displayed at a portion of the second fitting effect model that is not covered by the fitting object of the target size.
5. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: If it is detected that the user rotates, the first fitting effect model is displayed in a rotation direction according to the user's rotation direction.
6. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: A matching effect diagram of the tried-on object is displayed, wherein the matching effect diagram includes the tried-on object and other objects matched with the tried-on object.
7. The method according to claim 1, characterized in that There are multiple fitting objects, and the fitting objects correspond to the same part of the body model. The method further includes: The first fitting effect model corresponding to each fitting object is displayed in turn.
8. The method according to claim 7, characterized in that The sequentially displaying the first fitting effect model corresponding to each fitting object includes: Acquiring gesture information of the user, where the gesture information is used to instruct to display a first fitting effect model of a next fitting object; According to the gesture information of the user, a first trying-on effect model of the next trying-on object is displayed.
9. An intelligent fitting device, applied to an intelligent fitting mirror, the intelligent fitting mirror comprising an outer perspective mirror and an inner plurality of display screens, the area of the perspective mirror being equal to the area of the plurality of display screens, characterized in that: include: a processing module, configured to obtain the body shape information of the user, generate a body shape model of the user according to the body shape information of the user, and generate a first fitting effect model according to the characteristic information of the fitting object and the body shape model, wherein the characteristic information of the fitting object includes the style and size of the fitting object; The display module is used to obtain a first position of the part of the try-on object covering the body model on the smart try-on mirror, and a second position of the part of the try-on object not covering the body model on the smart try-on mirror; control the display screen at the first position to turn on, and control the display screen to display the first try-on effect model; control the display screen at the second position to turn off, and display the actual mirror image on the perspective mirror corresponding to the second position, so that the first try-on effect model of the part of the try-on object covering the body model and the actual mirror image of the part of the try-on object not covering the body model are spliced and displayed.
10. An electronic device, characterized in that: include: at least one processor and memory; The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the method according to any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Fitting device
CN103679781A
The invention discloses a virtual fitting method and a virtual fitting system based on a mobile terminal
CN109829794A
Virtual fitting method and device, intelligent terminal and storage medium
CN110264574A
A intelligent mirror for barber shop
CN205040886U