Virtual fitting method and electronic equipment

Abstract

The invention discloses a virtual fitting method and electronic equipment, relates to the field of artificial intelligence, and aims to select a virtual fitting object, simplify fitting operation and improve fitting experience of a user. The method includes: displaying a window of a first application, and displaying a first image including first clothing on the window of the first application; in response to a first operation of the user, moving the first image to an icon of a second application; in response to a second operation of the user, displaying a window of a second application, and displaying a configuration button of the fitting object to be added on the window of the second application; in response to a third operation of the user, displaying a second image that the fitting object wears second clothes on the window of the second application; the third operation is clicking a configuration button of the fitting object to be added; and in response to a fourth operation of the user, displaying a third image that the fitting object wears the first clothes on the window of the second application.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence, and in particular to a virtual fitting method and electronic device. Background Art

[0002] With the rapid development of big models in the field of artificial intelligence (AI), virtual fitting has become a major research direction of AI, and many applications (applications, apps) with virtual fitting functions have been generated.

[0003] At present, some virtual fitting apps need to import clothing pictures from the photo apps of mobile phones and other electronic devices to perform virtual fitting on digital humans. During the virtual fitting process, it is necessary to first download clothing pictures from the shopping app and save them in the photo app of the electronic device, and then import the clothing pictures into the corresponding virtual fitting app to perform virtual fitting on the digital human. This will result in poor fitting effects and complicated operations, resulting in a poor fitting experience for users. Summary of the invention

[0004] The embodiments of the present application provide a virtual fitting method and an electronic device, which can select a virtual fitting object, simplify fitting operations, and improve the user fitting experience.

[0005] To achieve the purpose, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, a virtual fitting method is provided, the method comprising: displaying a window of a first application, and displaying a first image including a first clothing item on the window of the first application; in response to a first operation of a user, moving the first image to an icon of a second application; in response to a second operation of a user, displaying a window of the second application, and displaying a configuration button of a fitting object to be added on the window of the second application; in response to a third operation of a user, displaying a second image of the fitting object wearing a second clothing item on the window of the second application; the third operation is clicking the configuration button of the fitting object to be added; in response to a fourth operation of the user, displaying a third image of the fitting object wearing the first clothing item on the window of the second application.

[0007] The virtual fitting method can select a virtual fitting object by clicking a configuration button of the fitting object to be added in the window of the second application to select the fitting object to be added. By moving a first image including a first piece of clothing on the first application to the icon of the second application and opening the window of the second application, a virtual fitting operation is performed on the window of the second application, thereby simplifying the fitting operation and improving the user fitting experience.

[0008] In an implementation of the first aspect, the method further includes: displaying a configuration button of the added fitting object on the window of the second application; in response to a fifth operation of the user, displaying a third image of the fitting object wearing the first clothing on the window of the second application; and the fifth operation is clicking the configuration button of the added fitting object.

[0009] In this implementation, the added fitting objects are selected by clicking the configuration button of the added fitting objects in the window of the second application, and there is no need to repeatedly add fitting objects, thus reducing the operation steps.

[0010] In an implementation manner of the first aspect, in response to the user's third operation, configuration options for at least one of the following information are further displayed on the window of the second application: height, weight, and measurements of the fitting subject.

[0011] In this implementation, the configuration options of the object to be added also include information such as the height, weight, and measurements of the object to be tried on. The recommended size of the clothes to be tried on can be obtained based on this information, so that the user can place an order directly.

[0012] In an implementation of the first aspect, the method also includes: displaying a first payment button on a window of a second application; in response to a user clicking the first payment button, displaying a second payment button and the price of the first clothing on the window of the second application; and in response to the user clicking the second payment button, displaying an image of the paid first clothing on the window of the second application.

[0013] In this implementation, by displaying the first payment button, the price of the first clothing item, and the second payment button on the window of the second application, a payment function is added and the user experience is improved.

[0014] In one implementation of the first aspect, the method further includes: displaying a delete button on the window of the second application; the delete button is on the first clothing; in response to the user clicking the delete button, displaying the second image on the window of the second application.

[0015] In this implementation, by displaying a delete button on the window of the second application, the user does not need to reselect the fitting object, and can delete clothes that do not look good when fitting according to actual needs, which is simple to operate.

[0016] In an implementation of the first aspect, in response to a third operation of the user, a fourth image including a third clothing item is also displayed on the window of the second application; the method also includes: displaying an analysis button on the window of the second application; in response to the user clicking the analysis button, displaying the analysis results of the first clothing item and the fourth clothing item on the window of the second application; the fourth clothing item includes the third clothing item and the paid first clothing item.

[0017] In this implementation, an analysis function is added by displaying an analysis button on the window of the second application. After comparing and matching the first clothing with the first and third clothing that have been paid for, the wearing effect and similarity results are displayed for the user's reference, avoiding repeated purchases of similar clothing and wasting money.

[0018] In an implementation of the first aspect, the method also includes: displaying a fifth image including a fifth item of clothing on a window of a first application; moving the fifth image to the first item of clothing in response to a first operation of a user; and displaying a sixth image of the person being tried on wearing the fifth item of clothing on a window of a second application in response to a second operation of a user.

[0019] In this implementation, multiple clothes of the first application are virtually tried on, and the effects of multiple tries are displayed for the user's reference. There is no need to reselect the try-on objects, and the operation is simple.

[0020] In an implementation of the first aspect, the method also includes: displaying a window of a third application, displaying a fifth image including a fifth item of clothing on the window of the third application; moving the fifth image to the first item of clothing in response to a first operation of the user; and displaying a sixth image of the person being tried on wearing the fifth item of clothing on the window of the second application in response to a second operation of the user.

[0021] In this implementation, multiple clothes from different applications, namely the first application and the third application, are virtually tried on, and the effects of multiple tries are displayed for the user's reference. There is no need to reselect the try-on objects, and the operation is simple.

[0022] In an implementation manner of the first aspect, the method further includes: respectively acquiring first contour information of a first article of clothing and second contour information of a second article of clothing; acquiring a first feature based on the first contour information; acquiring a second feature based on the second contour information; and after matching the first feature with the second feature, deforming the first article of clothing based on the second article of clothing to obtain a third image.

[0023] In this implementation, the contour information of the first clothing and the second clothing is obtained respectively, and then the respective features are obtained based on the respective contour information, and finally, the respective features are matched to obtain a virtual fitting image. The virtual fitting method can deform the first clothing according to the second clothing, so that the clothing fits the body of the person being tried on, thereby improving the effect of virtual fitting.

[0024] In a second aspect, an electronic device is provided, comprising a memory and one or more processors, wherein the memory stores computer program code, and the computer program code comprises computer instructions, which, when executed by the processor, enable the electronic device to execute a virtual fitting method as in the first aspect and any of its embodiments.

[0025] In a third aspect, a computer-readable storage medium is provided, comprising computer instructions, which, when executed on an electronic device, enable the electronic device to execute the virtual fitting method of the first aspect and any of its embodiments.

[0026] In a fourth aspect, a computer program product is provided. When the computer program product is run on an electronic device, the electronic device executes the virtual fitting method of the first aspect and any embodiment thereof.

[0027] Among them, the technical effects brought about by the design methods of the second, third and fourth aspects can refer to the technical effects brought about by the different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of a possible hardware structure of an electronic device provided in an embodiment of the present application;

[0029] Figure 2 A schematic diagram of a possible software structure of an electronic device provided in an embodiment of the present application;

[0030] Figure 3 A flowchart of a virtual fitting method of a virtual fitting app provided for related technology;

[0031] Figure 4 A flowchart of a virtual fitting method for a product page provided in the related art;

[0032] Figure 5 A flowchart of a virtual fitting method for a fitting object provided in an embodiment of the present application;

[0033] Figure 6 A flowchart of a virtual fitting method for displaying a fitting object provided in an embodiment of the present application;

[0034] Figure 7 An interactive diagram of a virtual fitting app, a product of a first shopping app and a virtual fitting method between the cloud provided in an embodiment of the present application;

[0035] Figure 8 A schematic diagram of the structure of a virtual fitting model provided in an embodiment of the present application;

[0036] Fig. 9 A flowchart of a virtual fitting method for performing multiple virtual fittings provided in an embodiment of the present application;

[0037] Fig.10 An interactive diagram of a virtual fitting app, two commodities in a first shopping app and a virtual fitting method between the cloud and provided in an embodiment of the present application;

[0038] Fig.11 An interactive diagram of a virtual fitting app, products of a first shopping app, products of a second shopping app and a virtual fitting method between the cloud provided in an embodiment of the present application;

[0039] Fig.12 A flowchart of a virtual fitting method including a payment function provided in an embodiment of the present application;

[0040] Fig.13 A flowchart of a virtual fitting method including a deletion function provided in an embodiment of the present application;

[0041] Fig.14 A flowchart of a virtual fitting method including an analysis function provided in an embodiment of the present application;

[0042] Fig.15 A flowchart of the analysis results of a virtual fitting method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0043] The technical solution in the embodiment of the present application will be described below in conjunction with the drawings in the embodiment of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. And, in the description of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. It can be understood by those skilled in the art that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not necessarily limit the difference. At the same time, in the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way for easy understanding. The terms "coupling" and "connection" involved in the embodiments of the present application should be understood in a broad sense, for example, it can refer to a physical direct connection, or it can refer to an indirect connection achieved by an electronic device, such as a connection achieved by a resistor, an inductor, a capacitor or other electronic devices.

[0044] Artificial intelligence (AI) is a branch of computer science that seeks to create machines and software that can perform tasks that normally require human intelligence. A machine exhibits intelligent behaviors that are usually associated with the intelligent behaviors of humans or other animals, such as learning, reasoning, problem solving, perception, language understanding, etc.

[0045] Virtual fitting is a technology that uses computer graphics and virtual reality to allow consumers to see how clothes will look on them without actually putting them on.

[0046] The embodiment of the present application provides an electronic device, which is an electronic device with a display function. The electronic device can be mobile or fixed. The electronic device can be deployed on land (for example, indoors or outdoors, handheld or vehicle-mounted, etc.), on the water (for example, ships, etc.), or in the air (for example, airplanes, balloons, and satellites, etc.). The electronic device can be called user equipment (UE), access terminal, terminal unit, subscriber unit, terminal station, mobile station (MS), mobile station, terminal agent or terminal device, etc. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a smart bracelet, a smart screen, a smart watch, a virtual reality (VR) device, an augmented reality (AR) device, a terminal in industrial control, a terminal in self-driving, a terminal in remote medical care, a terminal in smart grid, a terminal in transportation safety, a terminal in smart city, a terminal in smart home, etc. The embodiments of the present application do not limit the specific type and structure of the electronic device. A possible structure of the electronic device is described below.

[0047] Take the mobile phone as an example, Figure 1 A possible structure of the electronic device 100 is shown. The electronic device 100 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a power management module 240, a battery 241, a wireless charging coil 242, a mobile communication module 250, a wireless communication module 260, an antenna 251, an antenna 261, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295. Optionally, in some embodiments, an audio digital signal processor (ADSP) 243 is also included.

[0048] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0049] The processor 210 may include one or more processing units, for example, the processor 210 may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processing unit (CPU), an application processor (AP), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, and a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. For example, the processor 210 may be an application processor AP. Alternatively, the processor 210 may be integrated in a system on chip (SoC). Alternatively, the processor 210 may be integrated in an integrated circuit (IC) chip. The processor 210 may include an analog front end (AFE) and a micro-controller unit (MCU) in an IC chip.

[0050] The processor 210 may also be provided with a memory for storing computer instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store computer instructions or data that the processor 210 has just used or circulated. If the processor 210 needs to use the computer instructions or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0051] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface, etc.

[0052] In some embodiments, the processor may be a processor or a controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the present disclosure. The above-mentioned processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0053] ADSP 243 can be coupled to audio module 270 and sensor module 280, and ADSP 243 can be used to process audio signals and sensor data. When processor 210 is in sleep mode, ADSP 243 can still keep working, thereby reducing power consumption of electronic equipment.

[0054] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the embodiment, or a combination of multiple interface connection methods.

[0055] The external memory interface 220 can be used to connect an external memory card, such as a micro SanDisk (Micro SD) card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0056] The internal memory 221 can be used to store computer executable program codes, which include computer instructions. The processor 210 executes various functional applications and data processing of the electronic device 100 by running the computer instructions stored in the internal memory 221. For example, the internal memory 221 and the processor 210 can be coupled together through a bus. Among them, the bus can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The above-mentioned bus can be divided into an address bus, a data bus, a control bus, etc.

[0057] In the embodiment of the present application, when the computer instructions are executed by the processor 210, the electronic device 100 executes the virtual fitting method in the embodiment of the present application.

[0058] In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

[0059] The memory involved in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0060] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone interface 270D and the application processor.

[0061] The button 290 includes a power button, a volume button, etc. The button 290 may be a mechanical button. It may also be a touch button. The electronic device 100 may receive a button input and generate a key signal input related to the user settings and function control of the electronic device 100. The motor 291 may generate a vibration prompt. The motor 291 may be used for an incoming call vibration prompt or for touch vibration feedback. The indicator 292 may be an indicator light, which may be used to indicate the charging status, the change in power, or may be used to indicate messages, missed calls, notifications, etc. The SIM card interface 295 is used to connect a SIM card. The SIM card may be inserted into or removed from the SIM card interface 295 to achieve contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .

[0062] The electronic device 100 can realize the shooting function through the ISP, the camera 293, the video codec, the GPU, the display screen 294, and the application processor. The ISP is used to process the data fed back by the camera 293. In some embodiments, the ISP can be set in the camera 293. The camera 293 is used to capture a static image or a video. In some embodiments, the electronic device 100 may include 1 or N cameras 293, where N is a positive integer greater than 1.

[0063] In an embodiment of the present application, the camera 293 can capture a full-body front photo of the user as an unadded fitting subject, or can capture a full-body front photo of the user and save it in the virtual fitting app as an added fitting subject.

[0064] The electronic device 100 can realize the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute computer instructions to generate or change display information.

[0065] In the embodiment of the present application, the function of virtual fitting can be executed by the GPU or by the processor 210 , and the effect of virtual fitting can be displayed on the display screen 294 .

[0066] The power management module 240 is used to receive charging input from a charger. The charger may be a wireless charger, such as a wireless charging base, other electronic devices 100 with reverse wireless charging function, etc. The power management module 240 may receive wireless charging input through a wireless charging coil 242 of the electronic device. The charger may also be a wired charger, for example, the power management module 240 may receive charging input from a wired charger through the USB interface 230. The power management module 240 is also called a charging chip.

[0067] The power management module 240 is used to connect to the battery 241. The power management module 240 receives input from the battery 241 and supplies power to the processor 210, the internal memory 221, the display screen 294, the camera 293, and the wireless communication module 260. The power management module 240 can also be used to monitor parameters such as the capacity of the battery 241, the number of cycles of the battery 241, and the health status (leakage, impedance) of the battery 241. In some other embodiments, the power management module 240 can also be set in the processor 210.

[0068] The wireless communication function of the electronic device 100 can be implemented through the antenna 251, the antenna 261, the mobile communication module 250, the wireless communication module 260, the modem processor, etc.

[0069] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The wireless communication module 260 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc., applied to the electronic device 100.

[0070] As attached Figure 2 As shown, taking the electronic device 100 running the Android operating system as an example, the software architecture run by the processor 210 includes an application layer, a framework layer, a system runtime layer, a hardware abstract layer (HAL) layer, and a kernel layer.

[0071] The kernel layer is a layer between hardware and software. Exemplarily, the kernel layer includes display drivers, camera drivers, etc. The display driver is used to drive the display screen to display images or receive user touch operations, and the camera driver is used to drive the camera to capture images.

[0072] In an embodiment of the present application, the camera driver can drive the camera 293 to capture the user's image, the display driver can receive the user's add touch operation, and drive the display screen 294 to display the user's image; it can also receive the user's fitting touch operation, and drive the display screen 294 to display the user's fitting image.

[0073] The HAL layer is used to abstract the hardware. The HAL layer hides the hardware interface details of a specific platform and provides a virtual hardware platform for the operating system, which is hardware-independent. For example, the HAL layer includes a display module, a camera module, etc. The display module is used for a virtual display screen, and the camera module is used for a virtual camera.

[0074] The system runtime layer includes C / C++ program libraries and runtime libraries. Many core components and services of the Android operating system are built from native code and need to be written in C and C++ as C / C++ program libraries. When an application is installed for the first time, it will be pre-compiled into a runtime library in the form of machine code. This process is called pre-compilation. In this way, when the application is started and executed, it can be accelerated by running the machine code.

[0075] The framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The framework layer includes some predefined implementation methods. For example, the framework layer includes window manager, content provider, view system, notification manager, etc.

[0076] The application layer can include a series of application packages, such as photo, camera, shopping, virtual fitting, etc.

[0077] In the related art, for example, see the attached Figure 3 Some virtual fitting apps require importing clothing pictures from photo apps on mobile phones or other electronic devices 100 for fitting. Figure 3 In (a), the user needs to first download the clothing picture from the first shopping app, such as long pressing the clothing picture in the first shopping app; secondly, see the attached Figure 3 (b), the downloaded clothing pictures are saved in the photo app of the electronic device 100; then, see the attached Figure 3 (c) in the virtual fitting app, import the clothing pictures in the photo app to fit the digital human, such as clicking the import button in the virtual fitting app; finally, see the attached Figure 3In (d), the virtual fitting is completed on the digital human in the virtual fitting app. This will result in poor fitting effect and complicated operation, thus resulting in a poor fitting experience for users.

[0078] In addition, in the related art, for example, see the attached Figure 4 , some first-rate shopping apps have added virtual fitting functions to their product pages. Figure 4 In (a), the product page of the first shopping app includes the product title, price, etc., as well as buttons for trying on clothes, adding to shopping cart, and buying now. When trying on clothes on the product page of the first shopping app, for example, clicking the try-on button on the product page; see the attached Figure 4 (b) in the first shopping app, completing virtual fitting in the first shopping app. In this virtual fitting mode, although the first shopping app's product page has a new virtual fitting function, it can only fit the clothes on the current product page, and cannot be matched with other clothes on other product pages in the first shopping app, and cannot be matched with clothes from other shopping apps. Therefore, it cannot meet the user's needs for virtual matching and fitting, resulting in a poor user fitting experience.

[0079] To this end, a virtual fitting method is provided in the embodiment of the present application. Based on the virtual fitting method provided in the embodiment of the present application, a virtual fitting object can be selected, the fitting operation is simplified, and the user fitting experience is improved. It can also meet the user's needs for virtual matching fitting, further improving the user's fitting experience.

[0080] The virtual fitting method provided in the embodiment of the present application can be implemented on the electronic device 100 and can be displayed on the display screen 294 in the electronic device 100. The embodiment of the present application takes the electronic device 100 including the virtual fitting function as an example to specifically illustrate the virtual fitting method of the present application.

[0081] For example, Figure 5 A flowchart of a virtual fitting method provided in an embodiment of the present application is shown in the attached figure. Figure 5 As shown, the method may include steps S501-S506:

[0082] Step S501: display a window of a first application, and display a first image including a first clothing item on the window of the first application.

[0083] The first application includes a first shopping app or a browser app. The browser app can open a shopping website including the first image. In a possible implementation, the first clothing can be a top, or it can be pants, a hat, shoes, jewelry, etc. The embodiment of the present application does not limit the clothing attributes of the first clothing.

[0084] Displaying the window of the first application indicates that the window of the first shopping app is displayed. Displaying the first image including the first clothing on the window of the first application indicates that the first image including the first clothing is displayed on the window of the first shopping app. Figure 6 As shown in (a) of FIG. 1 , when the user wants to view clothing on the first shopping app, the electronic device 100 displays a window 601 of the first shopping app (i.e., the first application), and displays a first image of the first clothing, for example, a link (product 1 link) of the first clothing, i.e., a lapel top, a gallery, a title (attachment Figure 6 (a) lapel shirt), reputation and price (attached Figure 6 Images of (a) ××) etc.

[0085] In a possible implementation, the window of the first application may be displayed in full screen or in split screen. The embodiment of the present application does not limit the display format of the window of the first application.

[0086] Step S502: In response to a first operation of the user, move the first image to an icon of the second application.

[0087] The first operation includes a drag operation, and the second application includes a virtual fitting app. Figure 6 As shown in (b) in FIG. 2 , when the user wants to open the virtual fitting app, the user first drags the first image including the first clothing to the side of the display screen 294. Then, the application bar is displayed on the side of the display screen 294, and the application bar includes icons of various apps, such as a short video app, a music app, a virtual fitting app, a social app, etc. Finally, the icon of the virtual fitting app in the application bar is selected to move the first image to the icon of the virtual fitting app.

[0088] Step S503: in response to the second operation of the user, displaying the window of the second application, and displaying the configuration buttons of the fitting objects to be added and the configuration buttons of the fitting objects that have been added on the window of the second application.

[0089] The second operation includes a release operation. Step S503 indicates that in response to the user moving the first image to the icon of the virtual fitting app, a release operation is performed, jumping from the window 601 of the first shopping app to the window 602 of the virtual fitting app, i.e., the window of the second application, and displaying a configuration button of the fitting object to be added on the window 602 of the virtual fitting app. Figure 6 As shown in (c) in FIG. 1 , when the user releases the first image on the icon of the virtual fitting app, a configuration button for the fitting object to be added is displayed on the window 602 of the virtual fitting app, for example, adding a new user. Figure 6As shown in (c) in FIG. 6 , the window 602 of the virtual fitting app also displays configuration buttons of the added fitting objects, such as user A, user B, user C, and user D.

[0090] In response to the user clicking the configuration button of the fitting object to be added, an import button is further displayed on the window of the second application, and the import button is used to import an image including the third clothing. Figure 6 As shown in (d) in FIG. 6 , an import button is displayed on the window 602 of the virtual fitting app.

[0091] In one possible implementation, the image of the third clothing may be an image of physical clothing taken by a user using an electronic device 100 such as a mobile phone, or may be an image of clothing purchased by a user on a shopping app. The embodiment of the present application does not limit the form of the image of the third clothing.

[0092] Wherein, the virtual fitting app includes a storage unit or the virtual fitting app can perform cloud storage. In the virtual fitting app, the third clothing imported by the user can be stored in the storage unit or the cloud. In response to the user clicking the import button, the imported third clothing is stored in the storage unit or the cloud.

[0093] In the embodiments of the present application, for example, as shown in the attached Figure 7 As shown, after the release operation is performed to enter the window of the virtual fitting app, the link of the product 1 including the first clothing item on the first shopping app window is synchronously transmitted to the virtual fitting generation system in the cloud. The virtual fitting generation system includes a virtual fitting processing module. The virtual fitting processing module obtains information of the product 1 based on the link of the product 1, such as the product picture, i.e., the picture of the first clothing item, the size chart, and the product price.

[0094] If the user clicks the configuration button of the fitting object to be added, the process proceeds to step S504. If the user clicks the configuration button of the fitting object that has been added, the process proceeds to step S506.

[0095] Step S504, in response to the user's third operation, displaying a second image of the fitting subject wearing a second garment on the window of the second application; the third operation is clicking a configuration button of the fitting subject to be added.

[0096] The second image includes the second clothing, and the second image includes an image uploaded by the user of a front-facing full-body photo of the fitting subject wearing the second clothing.

[0097] In one possible implementation, the second image may be an image of a front-facing, full-body photo of the fitting subject wearing the second clothing item currently taken by the user through a camera app, or may be an image of a front-facing, full-body photo of the fitting subject wearing the second clothing item saved by the user in a photo app. The embodiment of the present application does not limit the source of the second image.

[0098] In one possible implementation, the second item of clothing can be the same type of clothing as the first item of clothing, for example, both the first item of clothing and the second item of clothing are tops, or the second item of clothing can be different from the first item of clothing, for example, the first item of clothing is a top and the second item of clothing is pants. The embodiment of the present application does not limit the types of clothing of the first item of clothing and the second item of clothing.

[0099] In response to the user clicking the configuration button of the fitting object to be added, that is, clicking the button to add a new user, a second image of the fitting object wearing the second clothing is displayed on the window of the second application. Figure 6 As shown in (c) in the figure, when the user wants to add a new user, he clicks the button to add a new user, as shown in the attached figure. Figure 6 As shown in (d) in FIG. 1 , a “+” button for importing a full-body front photo of the user and the words “Please import a full-body front photo” are displayed on the window 602 of the virtual fitting app. Click the “+” button. Figure 6 As shown in (e) in FIG. 1 , a second image of the fitting subject wearing a second piece of clothing is displayed on a window 602 of the virtual fitting app, for example, a second image of the fitting subject wearing a collarless top is displayed and stored in a storage unit or a cloud.

[0100] In response to the user clicking the configuration button of the fitting object to be added, in addition to displaying the second image of the front-facing full-body photo of the fitting object wearing the second clothing, the second application window also displays configuration options for at least one of the following information: the fitting object's height, weight, and measurements. Figure 6 As shown in (c), when the user wants to add a new user, click the button to add a new user, as shown in the attached Figure 6 As shown in (d) in FIG. 1 , the configuration options of the height, weight, measurements and other information of the fitting object are displayed on the window 602 of the virtual fitting app. The user inputs the height, weight and measurements and other information of the fitting object in these configuration options, and stores them in the storage unit or the cloud. Figure 6 As shown in (d) in the figure, the user inputs configuration information such as height 175cm, weight 85kg, and measurements 106, 73, 112, and the recommended size of the clothes to be tried on is obtained based on the above input configuration information, so that the user can place an order directly.

[0101] In the embodiments of the present application, for example, as shown in the attached Figure 7 As shown in the following, first, get the user's input. Figure 6 As shown in (c) of FIG. 1 , click Add New User in the configuration options on the window 602 of the virtual fitting app. Figure 6 As shown in (d) in the figure, enter the user's full-body photo, height, weight, measurements and other information. You can also click on the Figure 6The import button shown in (d) in the figure imports the image including the third clothing and stores it in the storage unit or the cloud for subsequent clothing similarity analysis. After the user inputs the user's front full-body photo, height, weight, measurements and other information and imports the image of the third clothing, face detection is performed on the user's front full-body photo, so that the user's front full-body photo, height, weight, measurements and other information and the image of the third clothing are bound to the user. For example, as shown in the attached figure Figure 6 As shown in (c) in the figure, the existing user A or user B or user C or user D is stored in the database for subsequent selection of users and clothing similarity analysis.

[0102] Step S505: In response to a fourth operation of the user, a third image of the person being fitted with the first clothing item is displayed on the window of the second application.

[0103] The fourth operation includes a fitting operation, such as clicking a fitting button, which is used to change the clothes of the fitting object. Figure 6 As shown in (e) in the figure, when the user wants to try on clothes virtually, he clicks the try-on button, as shown in the figure. Figure 6 As shown in (f) in FIG. 1 , a third image of the fitting subject wearing the first clothing is displayed on the window 602 of the virtual fitting app, for example, a third image of the fitting subject wearing a lapel shirt.

[0104] In the embodiments of the present application, for example, as shown in the attached Figure 7 As shown, the virtual fitting processing module pushes information such as product price and recommended size to the virtual fitting app based on the size chart and product price of product 1 obtained in step S503 and the height, weight, measurements and other information input by the user in step S504, and displays it on the window of the virtual fitting app. The virtual fitting processing module includes a virtual fitting model, which inputs the product image of product 1 obtained in step S503 (i.e., the first image including the first clothing) and the front full-body photo information input by the user in step S504 (i.e., the second image including the second clothing) into the virtual fitting model, outputs the clothing attributes of the first clothing and the third image of the fitting subject wearing the first clothing to the virtual fitting app, and displays them on the window of the virtual fitting app.

[0105] In the embodiments of the present application, for example, as shown in the attached Figure 8 As shown, the specific process of inputting a first image including a first piece of clothing and a second image including a second piece of clothing into a virtual fitting model, and outputting clothing attributes of the first piece of clothing and a third image of a fitting subject wearing the first piece of clothing is as follows: First, it is determined whether the first image includes the first clothing.

[0106] In the case where the first image includes the first clothing, clothing attributes of the first clothing are displayed on the window of the second application, and subsequent steps are performed based on the first image including the first clothing and the second image including the fitting object wearing the second clothing. In the case where the first clothing is not included, subsequent steps are not performed.

[0107] The clothing attributes include multiple first attributes, and each first attribute also includes multiple second attributes. For example, see Table 1 below:

[0108] Table 1 Clothing attributes

[0109] Property name Dress category style use Applicable temperature Sleeve Length Collar shape color Attribute Category Upper body clothing; Lower body clothing; One-piece clothing; Accessories; Shoes; Others; T-shirts; POLO shirts; shirts; long gowns; cotton coats; down jackets; trousers; overalls; cropped trousers; short trousers; vests; jackets; dresses; skirts; short skirts; others; Sports; Casual; Denim; Non-mainstream; Business casual; Business formal; Ethnic; Street / Hip-hop; Other; Inner wear; Outer wear; General; Others; <10°；10°-15°；15°-20°；20-25°；>25°； Long sleeve; Short sleeve; Sleeveless; Other; Stand collar; lapel; V-neck; square collar; double-layer collar; straight collar; round collar; high collar; hooded; other; Multiple pockets; cartoons; stripes; color matching; solid color; pattern printing; letter printing; brand LOGO; printing; other; Red; Yellow; Blue; Green; Gray; Others;

[0110] From Table 1 above, we can see that: The first attribute includes clothing, category, style, purpose, applicable temperature, sleeve length, collar type, style, color, etc. Each first attribute also includes multiple second attributes, and different first attributes include different types and quantities of second attributes. For example, the first attribute is style, and the style includes sports, casual, denim, non-mainstream, business casual, business formal, ethnic, hip-hop, etc. The first attribute is applicable temperature, and the applicable temperature includes <10°, 10°-15°, 15°-20°, 20°-25°, and >25°, etc.

[0111] Secondly, when the first image includes the first clothing, the clothing attributes of the first clothing are displayed on the window of the second application, and subsequent steps are performed based on the first image including the first clothing and the second image including the fitting subject wearing the second clothing.

[0112] In a possible implementation, subsequent steps are performed based on a first image including a first item of clothing and a second image including a fitting subject wearing a second item of clothing, including: respectively acquiring first contour information of the first item of clothing and second contour information of the second item of clothing; acquiring a first feature based on the first contour information; acquiring a second feature based on the second contour information; and after matching the first feature with the second feature, deforming the first item of clothing based on the second item of clothing to obtain a third image.

[0113] Specifically, as attached Figure 8 As shown, the first clothing and the second clothing are input into the clothing mask network to obtain the first contour information of the first clothing, i.e., the first clothing Mask, and the second contour information of the second clothing, i.e., the second clothing Mask, respectively. Then, the first clothing Mask is input into the first clothing feature extraction network for feature extraction to obtain the first feature; the second clothing Mask is input into the second clothing feature extraction network for feature extraction to obtain the second feature. Then, after the first feature and the second feature are input into the Gan generation network for matching, the first clothing is deformed based on the second clothing to obtain the third image.

[0114] In the embodiment of the present application, the contour information of the first clothing and the second clothing are obtained respectively, and then the respective features are obtained based on the respective contour information, and finally, the respective features are matched to obtain a virtual fitting image. The virtual fitting method can deform the first clothing according to the second clothing, thereby improving the effect of virtual fitting.

[0115] Step S506: In response to the fifth operation of the user, a third image of the fitting subject wearing the first clothing item is displayed on the window of the second application; the fifth operation is clicking a configuration button of the added fitting subject.

[0116] The fifth operation is to click the configuration button of the added fitting object, which is used to change the clothes of the added fitting object. Figure 6 As shown in (c) in the figure, when the user wants to virtually try on the existing user A, he clicks the user A button, as shown in the figure. Figure 6 As shown in (f) in FIG. 1 , a third image of the fitting subject wearing the first clothing item is displayed on the window 602 of the virtual fitting app, for example, a third image of the fitting subject wearing a lapel shirt.

[0117] In the embodiment of the present application, the difference between the step of selecting the added fitting object for virtual fitting and the step of selecting the fitting object to be added for virtual fitting is that: when selecting the added fitting object for virtual fitting, since the user has completed the configuration, after selecting the user, the second image of the fitting object wearing the second clothing has been stored in the storage unit or the cloud, so the virtual fitting is directly performed without displaying the second image of the added fitting object; when selecting the fitting object to be added for virtual fitting, since the user needs to configure the fitting object, the user needs to input the second image of the unadded fitting object, and also needs to input the configuration options such as the height, weight and measurements of the fitting object and the configuration options of the third clothing of the fitting object. After the user enters these configuration options, the virtual fitting app displays the second image of the unadded fitting object, the configuration options such as the height, weight and measurements of the unadded fitting object, and the configuration options of the third clothing of the fitting object and the fitting button, and after clicking the fitting button, the second image of the fitting object is displayed.

[0118] In the virtual fitting method described in the above steps S501-S506, by directly dragging the first image of the first clothing to be fitted on the first shopping app to the icon of the virtual fitting app, the window of the virtual fitting app can be opened to display the interface for selecting the fitting object, thereby simplifying the fitting operation. After selecting the fitting object, the virtual fitting can be performed based on the selected fitting object, and the virtual fitting object can be selected, thereby improving the user fitting experience.

[0119] In the embodiment of the present application, the virtual fitting method described in the above steps S501-S506 are all steps in the scenario of performing virtual fitting for the first time.

[0120] In a possible implementation, the virtual fitting can be performed once or n times on the fitting object, where n is a positive integer and n>1. The embodiment of the present application does not limit the number of virtual fittings.

[0121] In the following embodiments of the present application, the virtual fitting method of the present application is specifically described by taking the virtual fitting of the fitting object n times as an example. In the case of the virtual fitting of the fitting object n times, since the virtual fitting app has been opened, the nth virtual fitting is performed again after the fitting object is selected for the n-1th time for the virtual fitting, therefore, the nth first clothing item can be directly dragged to the fitting object of the virtual fitting app for the virtual fitting.

[0122] In one possible implementation, the first item of clothing for the nth virtual fitting and the first item of clothing for the n-1th virtual fitting can be clothing with the same type of dressing attributes, such as both are upper body clothing, or they can be clothing with different types of dressing attributes, such as the first item of clothing for the nth virtual fitting is upper body clothing, and the first item of clothing for the n-1th virtual fitting is lower body clothing. The embodiment of the present application does not limit the types of dressing attributes of the first item of clothing for the nth virtual fitting and the first item of clothing for the n-1th virtual fitting.

[0123] In one possible implementation, the first clothing item for the nth virtual fitting and the first clothing item for the n-1th virtual fitting may come from the same shopping app, for example, both from the first shopping app, or from different shopping apps, for example, the first clothing item for the nth virtual fitting comes from the second shopping app. The embodiment of the present application does not limit the source of the first clothing item for the nth virtual fitting.

[0124] In the case that the first item of clothing in the nth virtual fitting and the first item of clothing in the n-1th virtual fitting are items of clothing with the same dressing attributes, when the first item of clothing in the nth virtual fitting and the first item of clothing in the n-1th virtual fitting are from the same shopping app, in the nth virtual fitting, the first item of clothing in the nth virtual fitting is actually a replacement for the first item of clothing in the n-1th virtual fitting, and the nth first item of clothing can be directly dragged to the n-1th first item of clothing of the fitting object in the window of the first shopping app for virtual fitting.

[0125] In a possible implementation, the virtual fitting method further includes: displaying a sixth image including a fifth item of clothing on a window of a first application; in response to a first operation of a user, moving the fifth image onto the first item of clothing; and in response to a second operation of a user, displaying a sixth image of the fitting subject wearing the fifth item of clothing on a window of a second application.

[0126] For example, as shown in the attached Fig. 9 As shown in (a) of FIG. 1 , after the user has tried on the lapel shirt, i.e., the first clothing item, on the window 601 of the first shopping app, i.e., the window of the first application, when the user wants to try on the button shirt, i.e., the fifth clothing item, on the window 601 of the first shopping app; Fig. 9 As shown in (b) of FIG. 1 , in response to the user dragging the button-up shirt image, i.e., the fifth image, the button-up shirt image is moved to the lapel shirt, i.e., the first clothing item, of the object being tried on in the window 602 of the virtual fitting app; Fig. 9 As shown in (c) in FIG. 5 , in response to the user releasing the button-up shirt image, a sixth image of the fitting subject wearing the button-up shirt is displayed on the window 602 of the virtual fitting app, ie, the window of the second application.

[0127] In the case that the first item of clothing for the nth virtual fitting and the first item of clothing for the n-1th virtual fitting are items of clothing with different dressing attributes, when the first item of clothing for the nth virtual fitting and the first item of clothing for the n-1th virtual fitting are from the same shopping app, during the nth virtual fitting, the first item of clothing for the nth virtual fitting is actually matched with the first item of clothing for the n-1th virtual fitting. Similarly, the nth first item of clothing can be directly dragged onto the fitting object in the window of the second shopping app for virtual fitting.

[0128] Similarly, for example, Fig. 9 As shown in (a) of FIG. 1 , after the user has tried on the pants in the window 601 of the first shopping app, i.e., the window of the first application, when the user wants to try on the button-up shirt in the window 601 of the first shopping app; Fig. 9 As shown in (b) of FIG. 1 , in response to the user dragging the button-up shirt image, the button-up shirt image is moved to the upper body of the person being tried on, that is, the lapel shirt, on the window 602 of the virtual fitting app; Fig. 9 As shown in (c) in FIG. 1 , in response to the user releasing the button-up shirt image, a sixth image of the fitting subject wearing a button-up shirt and pants is displayed on the window 602 of the virtual fitting app, ie, the window of the second application.

[0129] In the embodiments of the present application, for example, as shown in the attached Fig.10As shown, the virtual fitting processing module outputs the price, recommended size, clothing attributes (fifth clothing attributes) and picture (sixth image) of product 2 to the virtual fitting app based on the cloud output information of the n-1th virtual fitting (the product price, recommended size, clothing attributes and output picture of product 1 on the first shopping app) and the size chart, product price, product picture (fifth clothing) and other information of product 2 obtained on the first shopping app, and displays them on the window of the virtual fitting app.

[0130] In the case that the first item of clothing in the nth virtual fitting and the first item of clothing in the n-1th virtual fitting are items of clothing with the same dressing attributes, when the first item of clothing in the nth virtual fitting and the first item of clothing in the n-1th virtual fitting are from different shopping apps, similarly, in the nth virtual fitting, the first item of clothing in the nth virtual fitting is actually a replacement for the first item of clothing in the n-1th virtual fitting, and the nth first item of clothing can be directly dragged to the n-1th first item of clothing of the fitting object in the window of the second shopping app for virtual fitting.

[0131] In a possible implementation, the virtual fitting method further includes: displaying a window of a third application, and displaying a fifth image including a fifth item of clothing on the window of the third application; in response to a first operation of the user, moving the fifth image to the first item of clothing; and in response to a second operation of the user, displaying a sixth image of the fitting subject wearing the fifth item of clothing on the window of the second application.

[0132] For example, as shown in the attached Fig. 9 As shown in (a) of FIG. 1 , after the user has tried on the lapel shirt, i.e., the first clothing item, on the window 601 of the first shopping app, i.e., the window of the first application, when the user wants to try on the button shirt, i.e., the fifth clothing item, on the window 603 of the second shopping app; Fig. 9 As shown in (b) of FIG. 1 , in response to the user dragging the button-up shirt image, i.e., the fifth image, the button-up shirt image is moved to the lapel shirt, i.e., the first clothing item, of the object being tried on in the window 602 of the virtual fitting app; Fig. 9 As shown in (c) in FIG. 1 , in response to the user releasing the button-up shirt image, a sixth image of the fitting subject wearing a lapel shirt is displayed on the window 602 of the virtual fitting app, ie, the window of the second application.

[0133] In the case where the first item of clothing in the nth virtual fitting and the first item of clothing in the n-1th virtual fitting are items of clothing with different dressing attributes, when the first item of clothing in the nth virtual fitting and the first item of clothing in the n-1th virtual fitting are from different shopping apps, similarly, in the nth virtual fitting, the first item of clothing in the nth virtual fitting is actually matched with the first item of clothing in the n-1th virtual fitting. Similarly, the nth first item of clothing can be directly dragged to the fitting object in the window of the first shopping app for virtual fitting.

[0134] Similarly, for example, Fig. 9 As shown in (a) of FIG. 1 , after the user has tried on the pants in the window 601 of the first shopping app, i.e., the window of the first application, when the user wants to try on the button-up shirt in the window 601 of the second shopping app; Fig. 9 As shown in (b) of FIG. 1 , in response to the user dragging the button-up shirt image, the button-up shirt image is moved to the upper body of the person being tried on, that is, the lapel shirt, on the window 602 of the virtual fitting app; Fig. 9 As shown in (c) in FIG. 1 , in response to the user releasing the button-up shirt image, a sixth image of the fitting subject wearing a button-up shirt and pants is displayed on the window 602 of the virtual fitting app, ie, the window of the second application.

[0135] In the embodiments of the present application, for example, as shown in the attached Fig.11 As shown, the virtual fitting processing module outputs the price, recommended size, clothing attributes (fifth clothing attributes) and picture (sixth image) of product 2 to the virtual fitting app based on the cloud output information of the n-1th virtual fitting (the product price, recommended size, clothing attributes and output picture of product 1 on the first shopping app) and the size chart, product price, product picture (fifth clothing) and other information of product 2 obtained on the second shopping app, and displays them on the window of the virtual fitting app.

[0136] In an embodiment of the present application, multiple clothes from the same application, i.e., the first shopping app, and multiple clothes from different applications, i.e., the first shopping app and the second shopping app, are virtually tried on, and the effects of multiple tries are displayed for the user's reference. There is no need to reselect the try-on objects, and the operation is simple.

[0137] The virtual fitting method provided in the embodiments of the present application may also include a payment function. In the following embodiments of the present application, the virtual fitting method of the present application is specifically described by taking the virtual fitting method including a payment function as an example.

[0138] In one possible implementation, the virtual fitting method further includes: displaying a first payment button on a window of a second application; in response to a user clicking the first payment button, displaying a second payment button and the price of the first clothing on a window of the second application; and in response to a user clicking the second payment button, displaying an image of the paid first clothing on a window of the second application.

[0139] For example, as shown in the attached Fig.12 As shown, a payment 1 button is also displayed on the window 602 of the virtual fitting app. When the user wants to buy the first clothing that the fitting object is trying on, as shown in the attached figure, Fig.12 As shown in (a) in the figure, click the Pay 1 button, and the Pay 2 button and the price of the clothes to be tried on will be displayed on the window of the second application, i.e., the window of the virtual fitting app, for example, the product link 1 of the first shopping app is RMB XX, the product link 2 of the second shopping app is RMB XX, and the product link 3 of the third shopping app is RMB XX. Fig.12 As shown in (b) in the figure, select product link 1, i.e. tops, product link 2, i.e. pants, and product link 3, i.e. shoes, and click the Pay 2 button. Fig.12 As shown in (c) in FIG. 1 , the paid first clothing product link, unit price, total price and payment completion image are displayed on the window 602 of the virtual fitting app. The paid first clothing product link includes the paid first clothing image.

[0140] In the embodiment of the present application, by displaying the Pay 1 button, the price of the first clothing item, and the Pay 2 button on the window of the virtual fitting app, a payment function is added and the user experience is improved.

[0141] The virtual fitting method provided in the embodiment of the present application may also include a deletion function. In the following embodiments of the present application, the virtual fitting method of the present application is specifically described by taking the virtual fitting method including a deletion function as an example.

[0142] In a possible implementation, the virtual fitting method further includes: displaying a delete button on the window of the second application; the delete button is on the first article of clothing; and in response to the user clicking the delete button, displaying a second image on the window of the second application.

[0143] In the embodiment of the present application, a delete button may be provided on each piece of clothing to selectively delete at least one piece of clothing. Fig.13 As shown, a delete button is also displayed on the window 602 of the virtual fitting app. When the user is not satisfied with the clothes being tried on and wants to delete the first clothes being tried on by the fitting object, as shown in the attached figure, Fig.13 As shown in (a) of the figure, click the delete button (i.e., the θ button) on the first garment (lapel shirt). Fig.13As shown in (b) of FIG. 1 , a second image, that is, an image of the person trying on the second clothing (collarless top), is displayed on the window 602 of the second application, that is, the window of the virtual fitting app. Fig.13 As shown in (a) in FIG. 1 , based on the fact that the subject is wearing a hat, casual pants and Martin boots before being deleted, the user can also click the delete button on the hat (i.e., the θ button), click the delete button on the pants (i.e., the θ button) and click the delete button on the shoes (i.e., the θ button). Fig.13 As shown in (b) in FIG. 1 , a second image of the person being tried on is displayed on a window 602 of the virtual fitting app, in which the person is not wearing a hat but is wearing jeans and sneakers.

[0144] In the embodiment of the present application, by displaying a delete button on the window of the virtual fitting app, the user does not need to reselect the fitting object, and can delete clothes that do not fit well according to actual needs, which is simple to operate.

[0145] The virtual fitting method provided in the embodiment of the present application may also include a clothing similarity analysis function. In the following embodiments of the present application, the virtual fitting method of the present application is specifically described by taking the virtual fitting method including the clothing similarity analysis function as an example.

[0146] In a possible implementation, in response to a third operation by the user, a fourth image including a third clothing item is also displayed on the window of the second application; the virtual fitting method further includes: displaying an analysis button on the window of the second application; in response to the user clicking the analysis button, displaying analysis results of the first clothing item and the fourth clothing item on the window of the second application, the fourth clothing item including the third clothing item and the paid first clothing item.

[0147] The fourth clothing includes the third clothing and the first clothing that has been paid. Similarly, in the virtual fitting app, the paid clothing and the third clothing imported by the user can be stored in the storage unit or the cloud. After the user pays for the clothing, it will be stored in the storage unit or the cloud. The third clothing imported by the user can be stored in the storage unit or the cloud in response to the user's import operation when configuring the fitting object to be added.

[0148] For example, as shown in the attached Figure 6 As shown in (c) in FIG. 1 , in response to the user clicking to add a new user, as shown in FIG. Figure 6 (d) and as shown in the attached Fig.14 As shown in (a) of FIG. 1 , an import button is also displayed on the window 602 of the virtual fitting app. In response to the user clicking the import button, as shown in FIG. Fig.14As shown in (b) of FIG. 1 , a fourth image including a third piece of clothing is also displayed on the window 602 of the virtual fitting app. For example, the third piece of clothing is a button-up top. When the user wants to perform clothing similarity analysis on the first piece of clothing that the fitting object is trying on, as shown in FIG. Fig.14 As shown in (c), an analysis button is also displayed on the window 602 of the virtual fitting app. In response to the user clicking the analysis button, as shown in the attached figure Fig.14 As shown in (d) in FIG. 1 , the analysis results of the first clothing and the fourth clothing are displayed on the window 602 of the virtual fitting app, and the fourth clothing includes the third clothing and the paid first clothing.

[0149] In an embodiment of the present application, the analysis results of the first clothing and the fourth clothing are calculated based on the similarity calculation of the clothing attributes of the first clothing and the first clothing and the third clothing that have been paid. During the similarity calculation process, each feature of the first clothing and the first clothing and the third clothing that have been paid are respectively extracted and encoded to obtain their respective attribute feature sequences, and then the similarity calculation is performed on the attribute feature sequences of the first clothing and the first clothing and the third clothing that have been paid to obtain the analysis result.

[0150] In a possible implementation, the analysis results may include matching results of different clothing items, and may also include similarity analysis results of the same type of clothing items. The embodiment of the present application does not limit the manner of analyzing the results.

[0151] In a possible implementation, the analysis results of the first clothing and the third clothing may be displayed in percentage or in similarity score. The embodiment of the present application does not limit the display method of the analysis results.

[0152] For example, as shown in the attached Fig.15 As shown in (a) of FIG. 1 , a matching image of the first clothing item (lapel shirt) and the third clothing item (pants) and the text “matching degree 95%” are displayed on the window 602 of the virtual fitting app. Fig.15 As shown in (b) in the figure, the window 602 of the virtual fitting app displays images of the fitting subject wearing the first clothing item (lapel top) and the first clothing item (collarless top) that has been paid for, and the text “both the first clothing item and the first clothing item that has been paid for are tops, and the similarity is 70%”.

[0153] In an embodiment of the present application, an analysis function is added by displaying an analysis button on the window of the virtual fitting app. After comparing and matching the first clothing with the first and third clothing that have been paid for, the wearing effect and similarity results are displayed for the user's reference, thereby avoiding repeated purchases of similar clothing and wasting money.

[0154] The virtual fitting method provided in the embodiment of the present application can select a virtual fitting object, simplify the fitting operation, and improve the user's fitting experience. It can also meet the user's needs for virtual matching fitting, further improving the user's fitting experience.

[0155] It is understandable that in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0156] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0157] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the method embodiment.

[0158] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the relevant method steps in the above method embodiment.

[0159] Among them, the electronic device, computer storage medium or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0160] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0161] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0162] The units described above as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0163] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The functions of the above-mentioned integrated units may be implemented in the form of hardware or in the form of software functional units.

[0164] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that makes the contribution or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the above-mentioned methods of each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.

[0165] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A virtual fitting method, characterized in that: The method comprises: displaying a window of a first application, and displaying a first image including a first clothing item on the window of the first application; In response to a first operation of the user, moving the first image to an icon of a second application; In response to a second operation of the user, displaying a window of a second application, and displaying a configuration button of a fitting object to be added on the window of the second application; In response to a third operation of the user, displaying a second image of the fitting subject wearing a second garment on the window of the second application; the third operation is clicking a configuration button of the fitting subject to be added; In response to a fourth operation of the user, a third image of the fitting subject wearing the first clothing is displayed on the window of the second application.

2. The virtual fitting method according to claim 1, characterized in that: The method further comprises: The window of the second application also displays a configuration button for the added fitting object; In response to a fifth operation of the user, the third image of the fitting subject wearing the first clothing is displayed on the window of the second application; the fifth operation is clicking a configuration button of the added fitting subject.

3. The virtual fitting method according to claim 1, characterized in that: In response to the user's third operation, configuration options for at least one of the following information are further displayed on the window of the second application: the height, weight, and measurements of the fitting subject.

4. The virtual fitting method according to any one of claims 1 to 3, characterized in that: The method further comprises: Displaying a first payment button on the window of the second application; In response to the user clicking the first payment button, displaying a second payment button and the price of the first clothing on the window of the second application; In response to the user clicking the second payment button, the paid first clothing is displayed on the window of the second application.

5. The virtual fitting method according to any one of claims 1 to 3, characterized in that: The method further comprises: Displaying a delete button on the window of the second application; the delete button is on the first clothing; In response to the user clicking the delete button, displaying the second image on the window of the second application.

6. The virtual fitting method according to any one of claims 1 to 3, characterized in that: In response to the third operation of the user, a fourth image including a third clothing item is further displayed on the window of the second application; the method further includes: Displaying an analysis button on the window of the second application; In response to the user clicking the analysis button, the analysis results of the first clothing and the fourth clothing are displayed on the window of the second application; the fourth clothing includes the third clothing and the paid first clothing.

7. The virtual fitting method according to any one of claims 1 to 3, characterized in that: The method further comprises: displaying a fifth image including a fifth article of clothing on the window of the first application; In response to the first operation of the user, moving the fifth image to the first clothing; In response to the second operation of the user, a sixth image of the fitting subject wearing the fifth clothing item is displayed on the window of the second application.

8. The virtual fitting method according to any one of claims 1 to 3, characterized in that: The method further comprises: displaying a window of a third application, and displaying a fifth image including a fifth article of clothing on the window of the third application; In response to the first operation of the user, moving the fifth image to the first clothing; In response to the second operation of the user, a sixth image of the fitting subject wearing the fifth clothing item is displayed on the window of the second application.

9. The virtual fitting method according to any one of claims 1 to 3, characterized in that: The method further comprises: respectively acquiring first contour information of the first clothing and second contour information of the second clothing; Acquire a first feature based on the first contour information; Acquire a second feature based on the second contour information; After matching the first feature with the second feature, the first clothing is deformed based on the second clothing to obtain the third image.

10. An electronic device, characterized in that: The electronic device comprises a memory and one or more processors, wherein the memory stores computer program code, and the computer program code comprises computer instructions. When the computer instructions are executed by the processor, the electronic device executes the virtual fitting method as described in any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that: The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the virtual fitting method according to any one of claims 1 to 9.

12. A computer program product, characterized in that When the computer program product is run on an electronic device, the electronic device is enabled to execute the virtual fitting method according to any one of claims 1 to 9.

Images