Virtual fitting method and electronic device

Abstract

The application discloses a virtual fitting method and electronic equipment, and relates to the field of artificial intelligence, which can select a virtual fitting object, simplify fitting operation and improve user fitting experience. The method comprises the following steps: displaying a window of a first application, displaying a first image comprising a first clothing on the window of the first application; moving the first image to an icon of a second application in response to a first operation of a user; displaying a window of the second application in response to a second operation of the user, displaying a configuration button of a fitting object to be added on the window of the second application; displaying a second image of the fitting object wearing the second clothing on the window of the second application in response to a third operation of the user; the third operation is clicking the configuration button of the fitting object to be added; and displaying a third image of the fitting object wearing the first clothing on the window of the second application in response to a fourth operation of the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of artificial intelligence, and in particular to a virtual fitting method and an electronic device. BACKGROUND

[0002] With the rapid development of large models in the field of artificial intelligence (AI), virtual fitting has become a major research direction of AI, and many application programs (apps) with virtual fitting functions have been produced.

[0003] Currently, some virtual fitting apps need to import clothing pictures from the photo app of a mobile phone or other electronic device for virtual fitting on a digital person. In the virtual fitting process, the clothing pictures need to be downloaded from a shopping app and saved in the photo app of the electronic device, and then the clothing pictures are imported into the corresponding virtual fitting app for virtual fitting on the digital person. In this way, the fitting effect is poor, the operation is complex, and the user's fitting experience is poor. SUMMARY

[0004] Embodiments of the present application provide a virtual fitting method and an electronic device, which can select a virtual fitting object, simplify the fitting operation, and improve the user's fitting experience.

[0005] To achieve the purpose, embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, a virtual fitting method is provided. The method includes displaying a window of a first application, displaying a first image including a first clothing on the window of the first application, moving the first image to an icon of a second application in response to a first operation of a user, displaying a window of the second application in response to a second operation of the user, displaying a configuration button of a fitting object to be added on the window of the second application, displaying a second image of the fitting object wearing a second clothing on the window of the second application in response to a third operation of the user, the third operation being clicking the configuration button of the fitting object to be added, and displaying a third image of the fitting object wearing the first clothing on the window of the second application in response to a fourth operation of the user.

[0007] The virtual fitting method described above can select a virtual fitting object by clicking the configuration button of the fitting object to be added on the window of the second application. The first image including the first clothing on the first application is moved to the icon of the second application to open the window of the second application, and thus the virtual fitting operation is performed on the window of the second application, which simplifies the fitting operation and improves the user's fitting experience.

[0008] In an implementation form of the first aspect, the method further comprises: displaying a configuration button of the added fitting object on the window of the second application; and in response to a fifth operation of the user, displaying a third image of the fitting object wearing the first garment on the window of the second application; the fifth operation is clicking the configuration button of the added fitting object.

[0009] In this implementation form, the added fitting object is selected by clicking the configuration button of the added fitting object on the window of the second application, without repeatedly adding the fitting object, thereby reducing the operation steps.

[0010] In an implementation form of the first aspect, in response to a third operation of the user, the configuration options of at least one of the following information of the fitting object are further displayed on the window of the second application: height, weight and three dimensions.

[0011] In this implementation form, the configuration options of the fitting object further include the height, weight and three dimensions of the fitting object, and the recommended size of the garment for fitting can be obtained according to these information, so that the user can directly place an order.

[0012] In an implementation form of the first aspect, the method further comprises: displaying a first payment button on the window of the second application; in response to the user clicking the first payment button, displaying a second payment button and a price of the first garment on the window of the second application; and in response to the user clicking the second payment button, displaying an image of the first garment that has been paid on the window of the second application.

[0013] In this implementation form, by displaying the first payment button, the price of the first garment and the second payment button on the window of the second application, the payment function is increased, and the user experience is improved.

[0014] In an implementation form of the first aspect, the method further comprises: displaying a deletion button on the window of the second application; the deletion button is on the first garment; and in response to the user clicking the deletion button, displaying the second image on the window of the second application.

[0015] In this implementation form, by displaying the deletion button on the window of the second application, the user does not need to reselect the fitting object, thereby deleting the garment with poor fitting effect according to the actual demand, and the operation is simple.

[0016] In an implementation form of the first aspect, in response to a third operation of the user, a fourth image including a third garment is further displayed on the window of the second application; and the method further comprises: displaying an analysis button on the window of the second application; and in response to the user clicking the analysis button, displaying an analysis result of the first garment and the fourth garment on the window of the second application; the fourth garment includes the third garment and the first garment that has been paid.

[0017] In this implementation, the analysis function is added by displaying the analysis button on the window of the second application, and after the analysis of the first clothes, the first clothes that have been paid, and the third clothes, such as comparison and matching, the dressing effect and similarity result are displayed for the user to refer, so as to avoid repeated purchase of similar clothes and thus waste of money.

[0018] In an implementation of the first aspect, the method further includes: displaying a fifth image including a fifth clothes on the window of the first application; in response to a first operation of the user, moving the fifth image to the first clothes; and in response to a second operation of the user, displaying a sixth image of the fitting object wearing the fifth clothes on the window of the second application.

[0019] In this implementation, the effect of multiple virtual try-ons is displayed for the user to refer without reselecting the fitting object, and the operation is simple.

[0020] In an implementation of the first aspect, the method further includes: displaying a window of a third application, displaying a fifth image including a fifth clothes on the window of the third application; in response to a first operation of the user, moving the fifth image to the first clothes; and in response to a second operation of the user, displaying a sixth image of the fitting object wearing the fifth clothes on the window of the second application.

[0021] In this implementation, the effect of multiple virtual try-ons of the clothes of different applications, i.e., the first application and the third application, is displayed for the user to refer without reselecting the fitting object, and the operation is simple.

[0022] In an implementation of the first aspect, the method further includes: respectively acquiring first contour information of the first clothes and second contour information of the second clothes; acquiring a first feature based on the first contour information; acquiring a second feature based on the second contour information; and after matching the first feature and the second feature, deforming the first clothes based on the second clothes to obtain a third image.

[0023] In this implementation, the contour information of the first clothes and the second clothes is respectively acquired, and then the respective features are acquired based on the respective contour information, and finally, the respective features are matched to obtain the virtual fitting image. The virtual fitting method can deform the first clothes based on the second clothes to make the clothes fit the body of the fitting object, thereby improving the effect of virtual fitting.

[0024] In a second aspect, an electronic device is provided, including a memory and one or more processors, the memory storing computer program code, the computer program code including computer instructions that, when executed by the processor, cause the electronic device to perform the virtual fitting method of the first aspect and any of the implementations thereof.

[0025] In a third aspect, a computer-readable storage medium is provided, including computer instructions, when the computer instructions are run on an electronic device, causing the electronic device to perform the virtual fitting method according to the first aspect and any one of the implementation forms thereof.

[0026] In a fourth aspect, a computer program product is provided, when the computer program product is run on an electronic device, causing the electronic device to perform the virtual fitting method according to the first aspect and any one of the implementation forms thereof.

[0027] The technical effects brought by the design manners of the second aspect, the third aspect and the fourth aspect can refer to the technical effects brought by the different design manners of the first aspect, and details are not repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0028] Figure 1 A possible hardware structure schematic diagram of an electronic device provided by the embodiment of the present application;

[0029] Figure 2 A possible software structure schematic diagram of an electronic device provided by the embodiment of the present application;

[0030] Figure 3 A flowchart of a virtual fitting method of a virtual fitting app provided by the related art;

[0031] Figure 4 A flowchart of a virtual fitting method of a commodity page provided by the related art;

[0032] Figure 5 A flowchart of a virtual fitting method of a fitting object provided by the embodiment of the present application;

[0033] Figure 6 A flowchart of a virtual fitting method of a fitting object provided by the embodiment of the present application;

[0034] Figure 7 An interaction diagram of a virtual fitting method between a virtual fitting app, a commodity of a first shopping app and a cloud provided by the embodiment of the present application;

[0035] Figure 8 A structure schematic diagram of a virtual fitting model provided by the embodiment of the present application;

[0036] Figure 9 A flowchart of a virtual fitting method of multiple virtual fittings provided by the embodiment of the present application;

[0037] Figure 10 An interaction diagram of a virtual fitting method between a virtual fitting app, two commodities of a first shopping app and a cloud provided by the embodiment of the present application;

[0038] Figure 11 An interaction diagram of a virtual fitting method between a virtual fitting app, a commodity of a first shopping app, a commodity of a second shopping app, and a cloud provided by an embodiment of the present application;

[0039] Figure 12 A flowchart of a virtual fitting method including a payment function provided by an embodiment of the present application;

[0040] Figure 13 A flowchart of a virtual fitting method including a deletion function provided by an embodiment of the present application;

[0041] Figure 14 A flowchart of a virtual fitting method including an analysis function provided by an embodiment of the present application;

[0042] Figure 15 A flowchart of a virtual fitting method analysis result provided by an embodiment of the present application. DETAILED DESCRIPTION

[0043] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the present application, unless otherwise specified, “ / ” represents an “or” relationship between the objects before and after the “ / ”, for example, A / B can represent A or B; “and / or” in the present application is only a description of the relationship between the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. In addition, in the description of the present application, unless otherwise specified, “multiple” means two or more than two. “At least one of the following (one)” or similar expressions means any combination of the items, including any combination of single (one) or multiple items. For example, at least one of a, b, or c can represent a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the same items or similar items with basically the same functions and effects are distinguished by using “first”, “second”, etc. The skilled in the art can understand that “first”, “second”, etc. do not limit the quantity and execution order, and “first”, “second”, etc. also do not necessarily mean different. At the same time, in the embodiments of the present application, the words “exemplary” or “for example” are used to represent as an example, illustration or description. Any embodiment or design scheme described as “exemplary” or “for example” in the embodiments of the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the use of “exemplary” or “for example” is intended to present the relevant concept in a specific manner, for easy understanding. The terms “coupled”, “connected”, etc. involved in the embodiments of the present application should be understood in a broad sense, for example, it can mean a direct physical connection, or an indirect connection through electronic devices, such as a connection through resistance, inductance, capacitance or other electronic devices.

[0044] Artificial intelligence (AI) is a branch of computer science that aims to create machines and software that can perform tasks that typically require human intelligence. A machine exhibits intelligent behavior, which is usually associated with human or animal intelligence, such as learning, reasoning, problem solving, perception, language understanding, etc.

[0045] Virtual fitting is a technology that uses computer graphics and virtual reality technology to allow consumers to see the effect of clothes on their bodies without actually wearing the clothes.

[0046] This application provides an electronic device with a display function. The electronic device can be mobile or fixed. It can be deployed on land (e.g., indoors or outdoors, handheld or vehicle-mounted), on water (e.g., on ships), or in the air (e.g., airplanes, balloons, and satellites). This electronic device can be referred to as user equipment (UE), access terminal, terminal unit, subscriber unit, terminal station, mobile station (MS), mobile station, terminal agent, or terminal device. For example, it can be a mobile phone, tablet computer, laptop computer, smart bracelet, smart screen, smartwatch, virtual reality (VR) device, augmented reality (AR) device, terminal in industrial control, terminal in self-driving, terminal in remote medical care, terminal in smart grid, terminal in transportation safety, terminal in smart city, terminal in smart home, etc. This application does not limit the specific type and structure of the electronic device. The following describes one possible structure of the electronic device.

[0047] Taking mobile phones as an example, the attached document... Figure 1 A possible structure of an electronic device 100 is shown. The electronic device 100 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a power management module 240, a battery 241, a wireless charging coil 242, a mobile communication module 250, a wireless communication module 260, antennas 251 and 261, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone jack 270D, a sensor module 280, buttons 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc. Optionally, in some embodiments, it may also include an audio digital signal processor (ADSP) 243.

[0048] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0049] The processor 210 can include one or more processing units, for example: the processor 210 can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processing unit (CPU), an application processor (AP), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, and a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors. For example, the processor 210 can be an application processor AP. Or, the processor 210 can be integrated in a system on chip (SoC). Or, the processor 210 can be integrated in an integrated circuit (IC) chip. The processor 210 can include an analog front end (AFE) and a micro-controller unit (MCU) in the IC chip.

[0050] The processor 210 can also include memory that stores computer instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The cache memory can hold computer instructions or data that the processor 210 has recently used or recycled. If the processor 210 needs to use the computer instructions or data again, it can be called directly from the cache memory. This avoids repeated access and reduces the latency of the processor 210, thus improving the efficiency of the system.

[0051] In some embodiments, the processor 210 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface, etc.

[0052] In some embodiments, the processor can be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, transistor logic, hardware component, or any combination thereof. It can implement or execute the various exemplary logical blocks, modules, and circuits described in connection with the present disclosure. The processor can also be a combination of implementing computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0053] The ADSP 243 can be coupled with the audio module 270 and the sensor module 280, and can be used to process audio signals and sensor data. When the processor 210 is in a sleep state, the ADSP 243 can still work, thereby reducing the power consumption of the electronic device.

[0054] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative, and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also use different interface connection modes or combinations of multiple interface connection modes.

[0055] The external memory interface 220 can be used to connect an external memory card, such as a micro SanDisk (Micro SD) card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 210 through the external memory interface 220 to realize data storage functions. For example, music, video, and other files can be saved in the external memory card.

[0056] The internal memory 221 can be used to store computer executable program codes, which include computer instructions. The processor 210 executes various functional applications and data processing of the electronic device 100 by running the computer instructions stored in the internal memory 221. For example, the internal memory 221 and the processor 210 can be coupled together through a bus. The bus can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The above bus can be divided into an address bus, a data bus, a control bus, etc.

[0057] In the embodiments of the present application, when the computer instructions are executed by the processor 210, the electronic device 100 executes the virtual fitting method in the embodiments of the present application.

[0058] In addition, the internal memory 221 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0059] The memory to which embodiments of the application are directed can be volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Among others, the nonvolatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM), electrically EPROM (EEPROM), or flash memory. The volatile memory can be random access memory (RAM) used as an external cache. By way of example, and not limitation, many forms of RAM can be used, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct Rambus RAM (DR RAM). It is to be noted that the memory of the systems and methods described herein is intended to include, among others, these and any other suitable types of memory.

[0060] The electronic device 100 can implement an audio function through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the earphone interface 270D, and the application processor, etc. For example, music play, recording, etc.

[0061] The keys 290 include a power key, a volume key, and the like. The keys 290 can be mechanical keys. The keys 290 can also be touch keys. The electronic device 100 can receive a key input, and generate a key signal input related to a user setting and a function control of the electronic device 100. The motor 291 can generate a vibration prompt. The motor 291 can be used for a call vibration prompt, and can also be used for a touch vibration feedback. The indicator 292 can be an indicator light, and can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 295 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 295 to achieve contact and separation with the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 295 can support a Nano SIM card, a Micro SIM card, a SIM card, and the like. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card, and the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0062] The electronic device 100 can implement a photographing function through an ISP, a camera 293, a video codec, a GPU, a display screen 294, and an application processor, and the like. The ISP is used to process data fed back by the camera 293. In some embodiments, the ISP can be arranged in the camera 293. The camera 293 is used to capture a still image or a video. In some embodiments, the electronic device 100 can include one or N cameras 293, N being a positive integer greater than 1.

[0063] In the embodiments of the present application, the camera 293 can collect a front full-body photo of a user as an unadded fitting object, or can save the front full-body photo of the user in the virtual fitting app as an added fitting object after collecting the front full-body photo of the user.

[0064] The electronic device 100 can implement a display function through a GPU, a display screen 294, and an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations, and is used for graphics rendering. The processor 210 can include one or more GPUs, which execute computer instructions to generate or change display information.

[0065] In the embodiments of the present application, the function of virtual fitting can be executed by the GPU, or can be executed by the processor 210, and the effect of virtual fitting can be displayed on the display screen 294.

[0066] The power management module 240 is used to receive charging input from a charger. The charger can be a wireless charger, such as a wireless charging dock, or other electronic device 100 with reverse wireless charging capability. The power management module 240 can receive wireless charging input via the wireless charging coil 242 of the electronic device. The charger can also be a wired charger; for example, the power management module 240 can receive charging input from a wired charger via a USB interface 230. The power management module 240 is also referred to as a charging chip.

[0067] The power management module 240 is used to connect to the battery 241. The power management module 240 receives input from the battery 241 and supplies power to the processor 210, internal memory 221, display screen 294, camera 293, and wireless communication module 260, etc. The power management module 240 can also be used to monitor parameters such as battery 241 capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 240 may also be located within the processor 210.

[0068] The wireless communication function of the electronic device 100 can be realized through antenna 251, antenna 261, mobile communication module 250, wireless communication module 260, modem processor, etc.

[0069] Mobile communication module 250 can provide wireless communication solutions including 2G / 3G / 4G / 5G for use on electronic device 100. Wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) for use on electronic device 100.

[0070] As attached Figure 2 As shown, taking the Android operating system running on the electronic device 100 as an example, the software architecture running on the processor 210 includes the application layer, framework layer, system runtime library layer, hardware abstraction layer (HAL) layer, and kernel layer.

[0071] The kernel layer is a layer between hardware and software. Exemplarily, the kernel layer includes a display driver, a camera driver, and the like. The display driver is used to drive the display screen to display an image or receive a touch operation of a user, and the camera driver is used to drive the camera to collect an image.

[0072] In the embodiment of the present application, the camera driver can drive the camera 293 to collect an image of a user, the display driver can receive an adding touch operation of the user, and drive the display screen 294 to display the image of the user; and can also receive a trying-on touch operation of the user, and drive the display screen 294 to display an image of the user trying on clothes.

[0073] The HAL layer is used to abstract hardware. The HAL layer hides the hardware interface details of a specific platform, provides a virtual hardware platform for the operating system, and has hardware independence. For example, the HAL layer includes a display module and a camera module. The display module is used to virtually display a screen, and the camera module is used to virtually display a camera.

[0074] The system runtime library layer includes C / C++ libraries and runtime libraries, and the like. Many core components and services of the Android operating system are built from native code, and need to be written in C and C++ as C / C++ libraries. An application is pre-compiled into a runtime library in the form of machine code when it is first installed, and this process is called pre-compilation. In this way, when the application is started and executed, acceleration can be achieved by running the machine code.

[0075] The framework layer provides an application programming interface (API) and a programming framework for the application programs in the application program layer. The framework layer includes some pre-defined implementation methods. For example, the framework layer includes a window manager, a content provider, a view system, a notification manager, and the like.

[0076] The application program layer can include a series of application packages, such as a photo, a camera, a shopping, a virtual trying-on, and the like.

[0077] In the related art, exemplarily, see FIG. 1, a user can use a first shopping app to purchase clothes, and then use a virtual trying-on app to try on the clothes. Figure 3 Some virtual trying-on apps need to import clothes pictures from a photo app of a mobile phone or the like for trying on. First, see (a) in FIG. 1, a user needs to download clothes pictures from a first shopping app, such as long-pressing the clothes pictures in the first shopping app; second, see (b) in FIG. 1, the downloaded clothes pictures are saved in a photo app of the electronic device 100; third, see (c) in FIG. 1, the clothes pictures in the photo app are imported into the virtual trying-on app for trying on a digital human, such as clicking an import button in the virtual trying-on app; and finally, see (d) in FIG. 1, the clothes pictures in the photo app are displayed in the virtual trying-on app. Figure 3 Figure 3 Figure 3 Figure 3 ​​​(d) in the (d), completing the virtual fitting on the digital human of the virtual fitting app. In this way, it will lead to poor fitting effect, complex operation, and thus poor user fitting experience.

[0078] In addition, in the related art, for example, see the attached Figure 4 Some first shopping app's commodity page has added a virtual fitting function. See the attached Figure 4 (a) in the (a), the first shopping app's commodity page includes the title, price, etc. of the commodity, and also includes the buttons of fitting, adding to the shopping cart and buying immediately, etc. When fitting the clothes on the first shopping app's commodity page, such as clicking the fitting button in the commodity page; see the attached Figure 4 (b) in the (b), completing the virtual fitting in the first shopping app. In this virtual fitting way, although the first shopping app's commodity page has added a virtual fitting function, it can only fit the clothes on the current commodity page, and cannot fit other clothes on other commodity pages in the first shopping app, nor can it fit other clothes on other shopping apps, thus it cannot meet the user's virtual fitting needs, and thus leads to poor user fitting experience.

[0079] Therefore, in the embodiments of the present application, a virtual fitting method is provided. Based on the virtual fitting method provided in the embodiments of the present application, the virtual fitting object can be selected, the fitting operation is simplified, and the user's fitting experience is improved. And it can meet the user's virtual fitting needs, and further improve the user's fitting experience.

[0080] The virtual fitting method provided in the embodiments of the present application can be implemented on the electronic device 100, and can be displayed using the display screen 294 in the electronic device 100. The embodiments of the present application take the electronic device 100 including a virtual fitting function as an example to specifically describe the virtual fitting method of the present application.

[0081] For example, see the attached Figure 5 A flowchart of a virtual fitting method provided in the embodiments of the present application is shown in the attached Figure 5 The method can include steps S501-S506:

[0082] Step S501, displaying a window of a first application, and displaying a first image including a first clothing on the window of the first application.

[0083] Wherein, the first application includes a first shopping app or a browser app. The browser app can open a shopping website including the first image. In a possible implementation, the first clothing can be a top, or pants, a hat, shoes, jewelry, etc. The dressing attribute of the first clothing is not limited in the embodiments of the present application.

[0084] Displaying a window of a first application indicates that a window of a first shopping app is being displayed. Displaying a first image including a first garment on the window of the first application indicates that a first image including a first garment is being displayed on the window of the first shopping app. For example, as shown in the attached document... Figure 6 As shown in (a), when a user wants to view clothing on the first shopping app, the electronic device 100 displays a window 601 of the first shopping app (i.e., the first application). The window 601 of the first shopping app displays a first image including the first garment, such as a link to the first garment (product 1 link), an image gallery, and a title (attached). Figure 6 (a) collared top, reviews and price (attached) Figure 6 The image of (a) and others.

[0085] In one possible implementation, the window of the first application can be displayed in full screen or in split screen. This application embodiment does not limit the display form of the window of the first application.

[0086] In step S502, in response to the user's first operation, the first image is moved onto the icon of the second application.

[0087] The first operation includes a drag-and-drop operation, and the second application includes a virtual try-on app. An example is shown below. Figure 6 As shown in (b), when a user wants to open the virtual try-on app, they first drag a first image, including the first garment, to the side of the display screen 294. Then, an application bar is displayed on the side of the display screen 294, which includes icons for various apps, such as short video apps, music apps, virtual try-on apps, and social apps. Finally, the user selects the icon for the virtual try-on app from the application bar and moves the first image onto the icon.

[0088] In step S503, in response to the user's second operation, a window of the second application is displayed, showing configuration buttons for the fitting objects to be added and configuration buttons for the added fitting objects.

[0089] The second operation includes a release operation. Step S503 indicates that in response to the user moving the first image onto the icon of the virtual try-on app, a release operation is performed, jumping from the window 601 of the first shopping app to the window 602 of the virtual try-on app, i.e., the window of the second application, and displaying the configuration button for the try-on object to be added on the virtual try-on app window 602. For example, see attached... Figure 6 As shown in (c), when the user releases the first image on the virtual try-on app icon, a configuration button for the desired try-on object, such as adding a new user, is displayed on window 602 of the virtual try-on app. (See attached image.) Figure 6As shown in (c) of FIG. 6, the configuration button of the added fitting object, such as user A, user B, user C and user D, is also displayed on the window 602 of the virtual fitting app.

[0090] In response to the user clicking the configuration button of the fitting object to be added, an import button is also displayed on the window of the second application, and the import button is used to import an image including the third clothes. For example, as shown in (d) of FIG. 6, the import button is displayed on the window 602 of the virtual fitting app. Figure 6

[0091] In a possible implementation, the image of the third clothes can be an image of a physical clothes taken by the user using the electronic device 100 such as a mobile phone, or an image of clothes purchased by the user on a shopping app, and the form of the image of the third clothes is not limited in the embodiments of the present application.

[0092] In the virtual fitting app, the third clothes imported by the user can be stored in the storage unit or the cloud. In response to the user clicking the import button, the third clothes are stored in the storage unit or the cloud.

[0093] In the embodiments of the present application, for example, as shown in (d) of FIG. 6, after the release operation is performed to enter the window of the virtual fitting app, the link including the first clothes on the first shopping app window is transmitted to the virtual fitting generation system in the cloud at the same time. The virtual fitting generation system includes a virtual fitting processing module. The virtual fitting processing module obtains the information of the first clothes based on the link of the first clothes, such as the product picture, i.e., the picture of the first clothes, the size table and the product price. Figure 7

[0094] If the user clicks the configuration button of the fitting object to be added, step S504 is entered. If the user clicks the configuration button of the added fitting object, step S506 is entered.

[0095] In step S504, in response to the third operation of the user, a second image of the fitting object wearing the second clothes is displayed on the window of the second application. The third operation is clicking the configuration button of the fitting object to be added.

[0096] The second image includes the second clothes, and the second image includes the image of the front full-body shot of the fitting object wearing the second clothes uploaded by the user.

[0097] In a possible implementation, the second image can be the image of the front full-body shot of the fitting object wearing the second clothes currently taken by the user through the camera app, or the image of the front full-body shot of the fitting object wearing the second clothes saved by the user in the photo app, and the source of the second image is not limited in the embodiments of the present application.​​

[0098] In one possible implementation, the second garment can be the same type of clothing as the first garment, for example, both the first garment and the second garment are tops, or they can be different types of clothing, for example, the first garment is a top and the second garment is pants. The embodiments of this application do not limit the types of clothing for the first garment and the second garment.

[0099] In response to a user clicking the configuration button for the desired fitting object (i.e., clicking the "Add New User" button), a second image of the fitting object wearing the second garment is displayed in the second application's window. For example, see attached... Figure 6 As shown in (c), when a user wants to add a new user, they click the "Add New User" button, as shown in the attached image. Figure 6 As shown in (d) of the diagram, a "+" button for importing the user's full-body frontal photo and the words "Please import full-body frontal photo" are displayed on window 602 of the virtual try-on app. Clicking the "+" button will display the following: Figure 6 As shown in (e), a second image of the subject wearing a second garment is displayed on window 602 of the virtual fitting app, for example, a second image of the subject wearing a collarless top is displayed and stored in a storage unit or the cloud.

[0100] In response to a user clicking the configuration button for the person to be added for the fitting, the second application window displays a second image of the person wearing the second garment, showing a full-body frontal view, along with configuration options for at least one of the following information: the person's height, weight, and bust, waist, and hip measurements. For example, see attached... Figure 6 As shown in (c), when a user wants to add a new user, they click the "Add New User" button, as shown in the attached image. Figure 6 As shown in (d) of the diagram, configuration options for the height, weight, and bust / waist / hip measurements of the person being tried on are displayed on window 602 of the virtual fitting app. Users input this information into these options, and it is stored in a storage unit or in the cloud. (See attached diagram.) Figure 6 As shown in (d), the user inputs configuration information such as height 175cm, weight 85kg, and bust, waist, and hip measurements of 106, 73, and 112. Based on the input configuration information, the system obtains the recommended size of the clothing to be tried on, so that the user can place an order directly.

[0101] In the embodiments of this application, exemplarily, as shown in the appendix Figure 7 As shown, first, user input is obtained. (See attached image) Figure 6 As shown in (c), click "Add New User" in the configuration options on window 602 of the virtual try-on app. (See attached image.) Figure 6 As shown in (d), you can enter the user's full-body photo, height, weight, bust, waist, and hip measurements. You can also click on the attached image. Figure 6The import button shown in (d) imports an image of the third garment, which is then stored in a storage unit or in the cloud for subsequent garment similarity analysis. After the user inputs their full-body frontal photo, height, weight, bust, waist, and hip measurements, along with the imported image of the third garment, face detection is performed on the user's full-body frontal photo. This binds the user's full-body frontal photo, height, weight, bust, waist, and hip measurements, along with the image of the third garment, to that user. For example, see attached... Figure 6 As shown in (c), existing users A, B, C, or D are stored in the database for subsequent user selection and clothing similarity analysis.

[0102] In step S505, in response to the user's fourth operation, a third image of the subject wearing the first garment is displayed on the window of the second application.

[0103] The fourth operation includes a try-on operation, such as clicking a try-on button, which is used to change the clothes on the person being tried on. For example, see attached... Figure 6 As shown in (e), when a user wants to virtually try on clothes, they click the "Try On" button, as shown in the attached image. Figure 6 As shown in (f), a third image of the subject wearing the first garment is displayed on window 602 of the virtual fitting app, for example, a third image of the subject wearing a collared top.

[0104] In the embodiments of this application, exemplarily, as shown in the appendix Figure 7 As shown, the virtual try-on processing module, based on the size chart and price of product 1 obtained in step S503 and the height, weight, and bust / waist / hip measurements input by the user in step S504, pushes product price, recommended size, and other information to the virtual try-on app and displays it on the virtual try-on app window. The virtual try-on processing module includes a virtual try-on model. It inputs the product image of product 1 obtained in step S503 (i.e., the first image including the first garment) and the full-body frontal photo information input by the user in step S504 (i.e., the second image including the second garment) into the virtual try-on model, outputs the garment attributes of the first garment and a third image of the user wearing the first garment to the virtual try-on app, and displays it on the virtual try-on app window.

[0105] In the embodiments of this application, exemplarily, as shown in the appendix Figure 8 As shown, the specific process of inputting a first image including a first garment and a second image including a second garment into the virtual fitting model, and outputting the garment attributes of the first garment and a third image of the fitting object wearing the first garment is as follows:

[0106] First, determine whether the first image includes the first garment.

[0107] If the first image includes the first garment, the garment attributes of the first garment are displayed on the window of the second application, and subsequent steps are performed based on the first image including the first garment and the second image including the subject wearing the second garment. If the first garment is not included, no subsequent steps are performed.

[0108] The clothing attributes include multiple primary attributes, and each primary attribute further includes multiple secondary attributes. For example, see Table 1 below:

[0109] Table 1 Clothing Attributes

[0110] Attribute name Dress Category Style Use Temperature Sleeve length Collar type Style Color Attribute category Upper body dress; lower body dress; one-piece dress; accessories; shoes; others; T-shirt; POLO shirt; shirt; gown; coat; down jacket; long pants; overalls; seven-eighths pants; five-eighths pants; vest; jacket; dress; skirt; short skirt; others; Sports; casual; cowboy; non-mainstream; business casual; business formal; ethnic; street / hip-hop; others; Underwear; outerwear; general; others; <10°；10°-15°；15°-20°；20-25°；>25°； Long sleeve; short sleeve; sleeveless; others; Stand-up collar; lapel collar; V-neck; square collar; double-layer collar; straight collar; round collar; high collar; hood; others; Multi-pocket; cartoon; stripe; color block; solid color; pattern print; letter print; brand logo; print; others; Red; yellow; blue; green; gray; others;

[0111] As shown in Table 1 above, the primary attributes include clothing type, style, purpose, applicable temperature, sleeve length, collar type, design, and color. Each primary attribute also includes multiple secondary attributes, with different types and numbers of secondary attributes depending on the primary attribute. For example, if the primary attribute is style, the secondary attributes could include sporty, casual, denim, alternative, business casual, formal business attire, ethnic, and hip-hop. Similarly, if the primary attribute is applicable temperature, the secondary attributes could include <10°C, 10°-15°C, 15°-20°C, 20°-25°C, and >25°C.

[0112] Secondly, if the first image includes the first garment, the garment attributes of the first garment are displayed on the window of the second application. Subsequent steps are then performed based on the first image including the first garment and the second image including the subject wearing the second garment.

[0113] In one possible implementation, subsequent steps are performed based on a first image including a first garment and a second image including a subject wearing a second garment, including: acquiring first contour information of the first garment and second contour information of the second garment respectively; acquiring a first feature based on the first contour information; acquiring a second feature based on the second contour information; matching the first feature and the second feature; and deforming the first garment based on the second garment to obtain a third image.

[0114] For details, see attached. Figure 8 As shown, the first garment and the second garment are input into a garment mask network to obtain the first contour information of the first garment (i.e., the first garment mask) and the second contour information of the second garment (i.e., the second garment mask). Next, the first garment mask is input into a first garment feature extraction network for feature extraction to obtain the first feature; the second garment mask is input into a second garment feature extraction network for feature extraction to obtain the second feature. Then, the first and second features are input into a GA generation network for matching, and the first garment is deformed based on the second garment to obtain the third image.

[0115] In this embodiment, the outline information of the first garment and the second garment are obtained respectively, and then their respective features are obtained based on their outline information. Finally, the respective features are matched to obtain a virtual try-on image. This virtual try-on method can deform the first garment according to the second garment, thereby improving the effect of virtual try-on.

[0116] Step S506: In response to the user's fifth operation, a third image of the fitting object wearing the first garment is displayed on the window of the second application; the fifth operation is clicking the configuration button of the added fitting object.

[0117] The fifth operation involves clicking the configuration button for the added try-on object, which is used to change the outfit of the added try-on object. For example, see attached... Figure 6 As shown in (c), when a user wants to virtually try on clothes for an existing user (User A), they click the User A button, as shown in the attached image. Figure 6 As shown in (f), a third image of the subject wearing the first garment is displayed on window 602 of the virtual fitting app, for example, a third image of the subject wearing a collared top.

[0118] In this embodiment, the difference between selecting an already added virtual try-on object and selecting a new virtual try-on object is as follows: When selecting an already added virtual try-on object, since the user has already configured the settings, the second image of the object wearing the second garment is stored in the storage unit or cloud after the user is selected. Therefore, virtual try-on is performed directly without displaying the second image of the already added object. When selecting a new virtual try-on object, the user needs to configure the object. Therefore, the user needs to input the second image of the unadded object, as well as configuration options such as the object's height, weight, and bust / waist / hip measurements, and the option to import the object's own third garment. After the user inputs these configuration options, the virtual try-on app displays the second image of the unadded object, the configuration options such as the unadded object's height, weight, and bust / waist / hip measurements, the option to import the object's own third garment, and a try-on button. Clicking the try-on button displays the second image of the object.

[0119] The virtual try-on method described in steps S501-S506 above allows users to simply drag the first image of the garment to be tried on onto the virtual try-on app icon in the first shopping app. This opens the virtual try-on app window and displays an interface for selecting the garment, simplifying the try-on process. After selecting the garment, a virtual try-on is performed based on that selection, thus improving the user's try-on experience.

[0120] In the embodiments of the present application, the virtual fitting method described in steps S501-S506 is a step in the scenario of first virtual fitting.

[0121] In a possible implementation, the virtual fitting of the fitting object can be performed once or n times, where n is a positive integer and n>1, and the number of times of virtual fitting is not limited in the embodiments of the present application.

[0122] In the following embodiments of the present application, n times of virtual fitting of the fitting object is taken as an example to specifically describe the virtual fitting method of the present application. In the case of n times of virtual fitting of the fitting object, since the virtual fitting app has been opened, the n-th virtual fitting is a re-virtual fitting after the fitting object is selected for virtual fitting for the n-1-th time, and therefore the n-th first clothes can be directly dragged to the fitting object of the virtual fitting app for virtual fitting.

[0123] In a possible implementation, the first clothes for the n-th virtual fitting and the first clothes for the n-1-th virtual fitting can be clothes of the same dressing attribute, such as both being upper body clothes, or can be clothes of different dressing attributes, such as the first clothes for the n-th virtual fitting being upper body clothes and the first clothes for the n-1-th virtual fitting being lower body clothes, and the dressing attribute types of the first clothes for the n-th virtual fitting and the first clothes for the n-1-th virtual fitting are not limited in the embodiments of the present application.

[0124] In a possible implementation, the first clothes for the n-th virtual fitting and the first clothes for the n-1-th virtual fitting can come from the same shopping app, such as both coming from the first shopping app, or can come from different shopping apps, such as the first clothes for the n-th virtual fitting coming from the second shopping app, and the source of the first clothes for the n-th virtual fitting is not limited in the embodiments of the present application.

[0125] In the case where the first clothes for the n-th virtual fitting and the first clothes for the n-1-th virtual fitting are clothes of the same dressing attribute, when the first clothes for the n-th virtual fitting and the first clothes for the n-1-th virtual fitting come from the same shopping app, in the n-th virtual fitting, the first clothes for the n-th virtual fitting are actually a replacement of the first clothes for the n-1-th virtual fitting, and the n-th first clothes can be directly dragged to the n-1-th first clothes of the fitting object in the window of the first shopping app for virtual fitting.

[0126] In one possible implementation, the virtual try-on method further includes: displaying a sixth image including a fifth garment on a window of a first application; moving the fifth image onto the first garment in response to a first operation by the user; and displaying a sixth image of the subject wearing the fifth garment on a window of a second application in response to a second operation by the user.

[0127] For example, see attached Figure 9 As shown in (a), after the user has tried on the collared shirt (i.e., the first garment) in window 601 of the first shopping app (i.e., the first application window), when the user wants to try on the buttoned shirt (i.e., the fifth garment) in window 601 of the first shopping app; as shown in the attached... Figure 9 As shown in (b), in response to the user's dragging of the button-down shirt image, i.e., the fifth image, the button-down shirt image is moved to the collared shirt, i.e., the first garment, of the virtual try-on object in window 602 of the virtual try-on app; as shown in the appendix Figure 9 As shown in (c), in response to the user's release of the buttoned shirt image, a sixth image of the subject wearing the buttoned shirt is displayed in window 602 of the virtual try-on app, i.e., the window of the second application.

[0128] When the first garment used in the nth virtual try-on is different from the first garment used in the (n-1)th virtual try-on, and when the first garment used in the nth virtual try-on and the first garment used in the (n-1)th virtual try-on come from the same shopping app, the first garment used in the nth virtual try-on is actually paired with the first garment used in the (n-1)th virtual try-on. Similarly, the nth first garment can be dragged and dropped directly onto the try-on object in the window of the second shopping app for virtual try-on.

[0129] Similarly, exemplarily, as shown in the appendix Figure 9 As shown in (a), after a user has tried on the pants in window 601 of the first shopping app (i.e., the window of the first application), when the user wants to try on the button-down shirt in window 601 of the first shopping app; as shown in the attached... Figure 9 As shown in (b), in response to the user's dragging of the button-down shirt image, the button-down shirt image is moved to the upper body of the virtual try-on object, i.e., the collared shirt, in window 602 of the virtual try-on app; as shown in the attached image. Figure 9 As shown in (c), in response to the user's release of the buttoned shirt image, a sixth image of the subject wearing the buttoned shirt and pants is displayed in window 602 of the virtual try-on app, i.e., the window of the second application.

[0130] In the embodiments of this application, exemplarily, as shown in the appendix Figure 10As shown, the virtual fitting processing module outputs the price, recommended size, clothing attribute, and picture of the second item of merchandise to the virtual fitting app according to the cloud output information of the (n-1)th virtual fitting (the price, recommended size, clothing attribute, and output picture of the first item of merchandise on the first shopping app) and the size table, price, and picture of the second item of merchandise (the fifth clothing item) obtained from the first shopping app, and displays the information on the window of the virtual fitting app.

[0131] In the case where the first clothing item for the n-th virtual fitting and the first clothing item for the (n-1)th virtual fitting are clothing items of the same type, when the first clothing item for the n-th virtual fitting and the first clothing item for the (n-1)th virtual fitting are from different shopping apps, in the n-th virtual fitting, the first clothing item for the n-th virtual fitting is actually a replacement of the first clothing item for the (n-1)th virtual fitting, and the first clothing item for the n-th virtual fitting can be directly dragged onto the first clothing item for the (n-1)th virtual fitting in the window of the second shopping app for virtual fitting.

[0132] In one possible implementation, the virtual fitting method further includes: displaying a window of a third application, and displaying a fifth image including a fifth clothing item on the window of the third application; in response to a first operation of the user, moving the fifth image onto the first clothing item; and in response to a second operation of the user, displaying a sixth image of the fitting object wearing the fifth clothing item on the window of the second application.

[0133] As shown in (a) of FIG. 6A, after the user has tried on the first clothing item (the collar shirt) on the window 601 of the first shopping app, when the user wants to try on the fifth clothing item (the button-up shirt) on the window 603 of the second shopping app, as shown in (b) of FIG. 6B, in response to the operation of the user dragging the image of the button-up shirt (the fifth image), the image of the button-up shirt is moved onto the first clothing item (the collar shirt) of the fitting object on the window 602 of the virtual fitting app; as shown in (c) of FIG. 6C, in response to the operation of the user releasing the image of the button-up shirt, the sixth image of the fitting object wearing the collar shirt is displayed on the window 602 of the virtual fitting app (the window of the second application). Figure 9 Figure 9 Figure 9

[0134] ​​​In the case that the first clothes in the n th virtual fitting is different from the first clothes in the (n-1) th virtual fitting in dressing attribute, when the first clothes in the n th virtual fitting is from a different shopping app than the first clothes in the (n-1) th virtual fitting, in the n th virtual fitting, the first clothes in the n th virtual fitting is actually matched with the first clothes in the (n-1) th virtual fitting, and in the same way, the n th first clothes can be directly dragged onto the fitting object in the window of the first shopping app for virtual fitting.

[0135] In the same way, as shown in (a) of FIG. 6B, after the user has tried on the trousers on the window 601 of the first shopping app, when the user wants to try on the button-up shirt on the window 601 of the second shopping app, as shown in (b) of FIG. 6B, in response to the operation of the user dragging the image of the button-up shirt, the image of the button-up shirt is moved to the upper body of the fitting object, i.e., the collar shirt, on the window 602 of the virtual fitting app; as shown in (c) of FIG. 6B, in response to the operation of the user releasing the image of the button-up shirt, the sixth image of the fitting object wearing the button-up shirt and the trousers is displayed on the window 602 of the virtual fitting app, i.e., the window of the second app. Figure 9 Figure 9 In the same way, as shown in (a) of FIG. 6B, after the user has tried on the trousers on the window 601 of the first shopping app, when the user wants to try on the button-up shirt on the window 601 of the second shopping app, as shown in (b) of FIG. 6B, in response to the operation of the user dragging the image of the button-up shirt, the image of the button-up shirt is moved to the upper body of the fitting object, i.e., the collar shirt, on the window 602 of the virtual fitting app; as shown in (c) of FIG. 6B, in response to the operation of the user releasing the image of the button-up shirt, the sixth image of the fitting object wearing the button-up shirt and the trousers is displayed on the window 602 of the virtual fitting app, i.e., the window of the second app. Figure 9 In the same way, as shown in (a) of FIG. 6B, after the user has tried on the trousers on the window 601 of the first shopping app, when the user wants to try on the button-up shirt on the window 601 of the second shopping app, as shown in (b) of FIG. 6B, in response to the operation of the user dragging the image of the button-up shirt, the image of the button-up shirt is moved to the upper body of the fitting object, i.e., the collar shirt, on the window 602 of the virtual fitting app; as shown in (c) of FIG. 6B, in response to the operation of the user releasing the image of the button-up shirt, the sixth image of the fitting object wearing the button-up shirt and the trousers is displayed on the window 602 of the virtual fitting app, i.e., the window of the second app.

[0136] Figure 11 In the same way, as shown in (a) of FIG. 6B, after the user has tried on the trousers on the window 601 of the first shopping app, when the user wants to try on the button-up shirt on the window 601 of the second shopping app, as shown in (b) of FIG. 6B, in response to the operation of the user dragging the image of the button-up shirt, the image of the button-up shirt is moved to the upper body of the fitting object, i.e., the collar shirt, on the window 602 of the virtual fitting app; as shown in (c) of FIG. 6B, in response to the operation of the user releasing the image of the button-up shirt, the sixth image of the fitting object wearing the button-up shirt and the trousers is displayed on the window 602 of the virtual fitting app, i.e., the window of the second app.

[0137] In the same way, as shown in (a) of FIG. 6B, after the user has tried on the trousers on the window 601 of the first shopping app, when the user wants to try on the button-up shirt on the window 601 of the second shopping app, as shown in (b) of FIG. 6B, in response to the operation of the user dragging the image of the button-up shirt, the image of the button-up shirt is moved to the upper body of the fitting object, i.e., the collar shirt, on the window 602 of the virtual fitting app; as shown in (c) of FIG. 6B, in response to the operation of the user releasing the image of the button-up shirt, the sixth image of the fitting object wearing the button-up shirt and the trousers is displayed on the window 602 of the virtual fitting app, i.e., the window of the second app.

[0138] The virtual fitting method provided in the embodiments of the present application can also include a payment function. The virtual fitting method of the present application is specifically described below with the consideration of the virtual fitting method including a payment function.

[0139] ​​In a possible implementation, the virtual fitting method further includes: displaying a first payment button on the window of the second application; in response to the user clicking the first payment button, displaying a second payment button and a price of the first clothing on the window of the second application; in response to the user clicking the second payment button, displaying an image of the first clothing that has been paid on the window of the second application.

[0140] As shown in FIG. 6B, a payment 1 button is further displayed on the window 602 of the virtual fitting app. When the user wants to purchase the first clothing that the fitting object tries on, the payment 1 button is clicked, and a payment 2 button and a price of the fitting clothing to be purchased are displayed on the window of the second application, i.e., the window of the virtual fitting app, as shown in FIG. 6C (a). For example, the price of the fitting clothing to be purchased includes the price of the first shopping app, i.e., RMB 100 for the product link 1, the price of the second shopping app, i.e., RMB 100 for the product link 2, and the price of the third shopping app, i.e., RMB 100 for the product link 3. Figure 12 As shown in FIG. 6C (b), the product link 1, i.e., the top, the product link 2, i.e., the trousers, and the product link 3, i.e., the shoes, are selected, and the payment 2 button is clicked, as shown in FIG. 6C (c). The image of the first clothing that has been paid is displayed on the window 602 of the virtual fitting app. The image of the first clothing that has been paid includes the product link of the first clothing that has been paid, the unit price, the total price, and the image of the payment completion. Figure 12 Figure 12 In the embodiments of the present application, by displaying the payment 1 button, the price of the first clothing, and the payment 2 button on the window of the virtual fitting app, the payment function is increased, and the user experience is improved. Figure 12 The virtual fitting method provided in the embodiments of the present application can further include a deletion function. The virtual fitting method of the present application is specifically described below with the virtual fitting method including the deletion function as an example.

[0141] In a possible implementation, the virtual fitting method further includes: displaying a deletion button on the window of the second application; the deletion button is on the first clothing; in response to the user clicking the deletion button, displaying a second image on the window of the second application.

[0142] In the embodiments of the present application, the deletion button can be set on each piece of clothing, and at least one piece of clothing can be selectively deleted. As shown in FIG. 6D, a deletion button is further displayed on the window 602 of the virtual fitting app. When the user is not satisfied with the clothing that the fitting object tries on and wants to delete the first clothing that the fitting object tries on, the deletion button on the first clothing (the top with a lapel) is clicked, as shown in FIG. 6D (a).

[0143] As shown in FIG. 6D (b), the image of the first clothing that has been deleted is displayed on the window 602 of the virtual fitting app.

[0144] In the embodiments of the present application, the deletion button can be set on each piece of clothing, and at least one piece of clothing can be selectively deleted. As shown in FIG. 6D, a deletion button is further displayed on the window 602 of the virtual fitting app. When the user is not satisfied with the clothing that the fitting object tries on and wants to delete the first clothing that the fitting object tries on, the deletion button on the first clothing (the top with a lapel) is clicked, as shown in FIG. 6D (a). Figure 13 As shown in FIG. 6D (b), the image of the first clothing that has been deleted is displayed on the window 602 of the virtual fitting app. Figure 13 Figure 13 ​​As shown in (b) of FIG. 6A, a second image, i.e., an image of the try-on object wearing a second garment (a collarless shirt), is displayed on the window 602 of the second application, i.e., the window of the virtual fitting app. Similarly, as shown in (b) of FIG. 6B, a second image, i.e., an image of the try-on object wearing a second garment (a pair of jeans), is displayed on the window 602 of the virtual fitting app. Figure 13 As shown in (a) of FIG. 6C, based on the try-on object wearing a hat, a pair of casual pants and a pair of Martin boots before the deletion, the user can also click the delete button (i.e., the button) on the hat, click the delete button (i.e., the button) on the pants and click the delete button (i.e., the button) on the shoes, as shown in (a) of FIG. 6C. Figure 13 As shown in (b) of FIG. 6C, a second image, i.e., an image of the try-on object without wearing a hat, wearing a pair of jeans and wearing a pair of sports shoes, is displayed on the window 602 of the virtual fitting app.

[0145] In the embodiments of the present application, by displaying the delete button on the window of the virtual fitting app, the user does not need to reselect the try-on object, so as to delete the garment with poor fitting effect according to actual needs, and the operation is simple.

[0146] The virtual fitting method provided in the embodiments of the present application can also include a garment similarity analysis function. The virtual fitting method of the present application will be specifically described below with the virtual fitting method including the garment similarity analysis function as an example.

[0147] In a possible implementation, in response to a third operation of the user, a fourth image including a third garment is also displayed on the window of the second application; the virtual fitting method further includes: displaying an analysis button on the window of the second application; and in response to the user clicking the analysis button, displaying an analysis result of the first garment and the fourth garment on the window of the second application, the fourth garment including the third garment and the paid first garment.

[0148] The fourth garment includes the third garment and the paid first garment. Similarly, in the virtual fitting app, the paid garment and the third garment imported by the user can be stored in the storage unit or the cloud. When the user pays for the garment, it will be stored in the storage unit or the cloud. The third garment imported by the user can be stored in the storage unit or the cloud by responding to the import operation of the user when configuring the try-on object to be added.

[0149] For example, as shown in (c) of FIG. 6D, in response to the user clicking Add New User, as shown in (d) of FIG. 6D, a new window 602 of the virtual fitting app is displayed, and the user can click the import button on the window 602 of the virtual fitting app to import a third garment, as shown in (a) of FIG. 6E. Figure 6 For example, as shown in (c) of FIG. 6D, in response to the user clicking Add New User, as shown in (d) of FIG. 6D, a new window 602 of the virtual fitting app is displayed, and the user can click the import button on the window 602 of the virtual fitting app to import a third garment, as shown in (a) of FIG. 6E. Figure 6 For example, as shown in (c) of FIG. 6D, in response to the user clicking Add New User, as shown in (d) of FIG. 6D, a new window 602 of the virtual fitting app is displayed, and the user can click the import button on the window 602 of the virtual fitting app to import a third garment, as shown in (a) of FIG. 6E. Figure 14 For example, as shown in (c) of FIG. 6D, in response to the user clicking Add New User, as shown in (d) of FIG. 6D, a new window 602 of the virtual fitting app is displayed, and the user can click the import button on the window 602 of the virtual fitting app to import a third garment, as shown in (a) of FIG. 6E. Figure 14As shown in (b), a fourth image, including a third garment, is also displayed in window 602 of the virtual try-on app. For example, the third garment is a button-down shirt. When a user wants to perform a garment similarity analysis on the first garment worn by the person trying on the try-on, as shown in the attached... Figure 14 As shown in (c), an analysis button is also displayed on window 602 of the virtual try-on app. In response to the user clicking the analysis button, as shown in the attached diagram... Figure 14 As shown in (d), the analysis results of the first garment and the fourth garment are displayed in window 602 of the virtual fitting app. The fourth garment includes the third garment and the first garment that has been paid for.

[0150] In this embodiment of the application, the analysis results of the first garment and the fourth garment are based on the similarity calculation of the garment attributes of the first garment and the paid first garment and the third garment. In the similarity calculation process, each feature of the first garment and the paid first garment and the third garment are extracted and encoded to obtain their respective attribute feature sequences. Then, the similarity calculation is performed on the attribute feature sequences of the first garment and the paid first garment and the third garment to obtain the analysis results.

[0151] In one possible implementation, the analysis results may include the matching results of different clothing items, or the similarity analysis results of the same clothing items. The embodiments of this application do not limit the method of analysis results.

[0152] In one possible implementation, the analysis results of the first garment and the third garment can be displayed as a percentage or as a similarity score. This application embodiment does not limit the display method of the analysis results.

[0153] For example, see attached Figure 15 As shown in (a), the virtual try-on app displays an image and the text "95% match" showing the combination of the first garment (collared top) and the third garment (trousers) in window 602. An example is shown in the attached image. Figure 15 As shown in (b), the virtual try-on app displays images and text on window 602 showing the first garment (collared top) worn by the try-on subject and the first garment (collarless top) that has already been paid for, along with the text "The first garment and the first garment that has already been paid for are both tops, with a similarity of 70%".

[0154] In this embodiment of the application, an analysis function is added by displaying an analysis button on the window of the virtual fitting app. After comparing and matching the first garment with the paid first and third garments, the matching effect and similarity results are displayed for the user's reference, avoiding the repeated purchase of similar garments and thus avoiding wasting money.

[0155] The virtual fitting method provided in the embodiments of the present application can select a virtual fitting object, simplify the fitting operation, and improve the user fitting experience. The virtual fitting method can meet the virtual fitting and matching needs of the user, and further improve the user fitting experience.

[0156] It can be understood that, in order to achieve the above functions, the electronic device contains hardware and / or software modules corresponding to each function. The algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered beyond the scope of the present application.

[0157] The embodiments can divide the functional modules of the electronic device according to the above method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in the form of hardware. It should be noted that the division of modules in the embodiments is illustrative, and is only a logical functional division. Actual implementation can have another division manner.

[0158] The embodiments of the present application also provide a computer readable storage medium, which stores computer program codes. When the processor executes the computer program codes, the electronic device executes the related method steps in the above method embodiments.

[0159] The embodiments of the present application also provide a computer program product, which makes the computer execute the related method steps in the above method embodiments when the computer program product runs on the computer.

[0160] The electronic device, computer storage medium or computer program product provided by the present application are used to execute the corresponding methods provided above, so the beneficial effects they can achieve can refer to the beneficial effects of the corresponding methods provided above, which will not be repeated here.

[0161] Through the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above division of functional modules is exemplified. In actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above described functions.

[0162] In several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other manners. For example, the described apparatus embodiments are merely schematic. Taking the division of the modules or units as an example, the division can be changed in actual implementation: for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0163] The units described as separate components may or may not be physically separate, and the components shown as units can be one physical unit or multiple physical units, i.e., can be located in one place, or can be distributed in multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0164] In addition, each functional unit in the various embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The functions of the above integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0165] The integrated unit described above, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application essentially or the parts that make contributions or the whole or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions to make a device (which can be a single chip, a chip, etc.) or a processor execute all or part of the steps of the above-mentioned methods of the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0166] The above is merely a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or replacements within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A virtual fitting method, characterized by, The method comprises: displaying a first window of a first application, and displaying a first image comprising a first clothing on the first window of the first application; the first application is an application comprising a shopping function; in response to a first operation of a user, moving the first image onto an icon of a second application; in response to a second operation of a user, displaying a window of the second application, and displaying a configuration button of a fitting object to be added on the window of the second application; the second application is an application comprising a virtual fitting function; the second operation comprises a release operation; in response to a third operation of a user, displaying a second image of the fitting object wearing a second clothing on the window of the second application; the third operation is clicking the configuration button of the fitting object to be added; in response to a fourth operation of a user, displaying a third image of the fitting object wearing the first clothing on the window of the second application; in response to an operation of a user on the window of the second application, displaying a second window of the first application or a window of a third application, and displaying a fifth image comprising a fifth clothing on the second window of the first application or the window of the third application; the third application is an application comprising a shopping function; the third application is different from the first application; in a case where the fifth clothing is different from the first clothing in dressing attribute, in response to the first operation of a user, moving the fifth image onto a target clothing of the second application; the target clothing is a clothing that the fitting object has worn last time and is the same as the fifth clothing in dressing attribute; in response to the second operation of a user, displaying a sixth image of the fitting object wearing the first clothing and the fifth clothing on the window of the second application; in a case where the fifth clothing is the same as the first clothing in dressing attribute, in response to the first operation of a user, moving the fifth image onto the first clothing; in response to the second operation of a user, displaying a seventh image of the fitting object wearing the fifth clothing on the window of the second application.

2. The virtual fitting method of claim 1, wherein, The method further comprises: further displaying a configuration button of an added fitting object on the window of the second application; in response to a fifth operation of a user, displaying the third image of the fitting object wearing the first clothing on the window of the second application; the fifth operation is clicking the configuration button of the added fitting object.

3. The virtual fitting method of claim 1, wherein, in response to a third operation of a user, further displaying a configuration option of at least one of the following information on the window of the second application: height, weight, and three-circumference of the fitting object.

4. The virtual fitting method of any one of claims 1-3, wherein, The method further comprises: displaying a first payment button on the window of the second application; in response to a user clicking the first payment button, displaying a second payment button and a price of the first clothing on the window of the second application; in response to a user clicking the second payment button, displaying the first clothing that has been paid on the window of the second application.

5. The virtual fitting method according to any one of claims 1-3, wherein, The method further comprises: displaying a deletion button on the window of the second application; the deletion button is on the first clothing; in response to a user clicking the deletion button, displaying the second image on the window of the second application.

6. The virtual fitting method of any one of claims 1-3, wherein, In response to the third operation of the user, a fourth image including a third clothing is further displayed on the window of the second application; the method further comprises: displaying an analysis button on the window of the second application; In response to the user clicking the analysis button, an analysis result of the first clothing and a fourth clothing is displayed on the window of the second application; the fourth clothing includes the third clothing and the first clothing that has been paid.

7. The virtual fitting method of any one of claims 1-3, wherein, The method further comprises: obtaining first contour information of the first clothing and second contour information of the second clothing respectively; obtaining a first feature based on the first contour information; obtaining a second feature based on the second contour information; After matching the first feature and the second feature, deforming the first clothing based on the second clothing to obtain the third image.

8. An electronic device, comprising: An electronic device comprising a memory and one or more processors, the memory having computer program code stored therein, the computer program code including computer instructions that, when executed by the processor, cause the electronic device to perform the virtual fitting method of any one of claims 1-7.

9. A computer-readable storage medium, characterized in that, A computer program product comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the virtual fitting method of any one of claims 1-7.

10. A computer program product, characterised in that, A computer program product comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the virtual fitting method of any one of claims 1-7.

Images