Data processing method, device, electronic device and storage medium

Abstract

The embodiments of the present disclosure disclose a data processing method, an apparatus, an electronic device, and a storage medium, the method including: in response to an import operation of a resource file of a try-on object, processing the resource file to obtain an object file whose file format is compatible with the effect editor; in response to an operation of dragging the object file to a preset node of the effect editor, adding a rendering component to the preset node; and rendering a try-on image in which a model of the try-on object is worn on a preset body part model based on the rendering component. The data processing method according to the present disclosure realizes virtual try-on of the try-on object, and facilitates user operation.

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims priority from a Chinese patent application filed on September 7, 2021, bearing application number 202111044347.2 and titled "Data processing method, device, electronic device and storage medium," the entire contents of which are incorporated herein by reference.

[0002] The present disclosure relates to the field of information technology, and in particular to a data processing method, device, electronic device, and storage medium. [Background technology]

[0003] With the continuous development of augmented reality technology, device users can use application programs on electronic devices, such as terminals, to achieve a virtual try-on effect, such as trying on shoes, clothes, accessories, etc., allowing device users to select satisfactory products without leaving home.

[0004] However, the process of realizing the conventional virtual try-on function is complicated. Summary of the Invention [Problem to be solved by the invention]

[0005] To solve or at least partially solve the above technical problem, embodiments of the present disclosure provide a data processing method, an apparatus, an electronic device, and a storage medium to realize virtual try-on of a try-on object. [Means for solving the problem]

[0006] According to a first aspect, an embodiment of the present disclosure provides a data processing method for use in an effect editor, the method comprising: In response to an import operation of a resource file of a try-on object, processing the resource file to obtain an object file whose file format is compatible with the effect editor; adding a rendering component to a preset node of the effect editor in response to an operation of dragging the object file to the preset node; Rendering a try-on image in which the model of the try-on object is fitted onto a preset part model based on the rendering component.

[0007] According to a second aspect, an embodiment of the present disclosure further provides a data processing device, the device comprising: a processing module for processing a try-on object resource file in response to an import operation of the resource file and obtaining an object file whose file format is compatible with the effect editor; a first adding module for adding a rendering component to a preset node of the effect editor in response to an operation of dragging the object file to the preset node; and a rendering module for rendering a try-on image in which the model of the try-on object is fitted onto a preset part model based on the rendering component.

[0008] According to a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising: one or more processors; a storage device for storing one or more programs; The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the data processing method described above.

[0009] According to a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, the program realizing the data processing method described above when executed by a processor. [Effects of the Invention]

[0010] The technical solutions according to the embodiments of the present disclosure have at least the following advantages over the prior art:

[0011] In a data processing method according to an embodiment of the present disclosure, in response to an import operation of a resource file of a try-on object, the resource file is processed to obtain an object file whose file format is compatible with the effect editor; in response to an operation of dragging the object file to a preset node of the effect editor, a rendering component is added to the preset node; and based on the rendering component, the try-on image of the try-on object model is attached to a preset part model. That is, when a user imports a resource file of a try-on object into the effect editor, the effect editor automatically analyzes and converts the resource file to obtain an object file compatible with the effect editor; then, the user drags the object file to a preset node of the effect editor; the effect editor automatically adds a rendering component to the preset node and renders a try-on image of the try-on object model attached to the preset part model, thereby realizing virtual try-on of the try-on object and simplifying user operations. [Brief explanation of the drawings]

[0012] These and other features, advantages, and aspects of each embodiment of the present disclosure will become more apparent with reference to the following specific examples in conjunction with the drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale. [Figure 1] 1 is a flowchart of a data processing method according to an embodiment of the present disclosure. [Figure 2] 10 is a flowchart illustrating processing of a resource file in an embodiment of the present disclosure. [Figure 3]FIG. 1 is a schematic diagram of a left foot node and a right foot node in an embodiment of the present disclosure. [Figure 4] FIG. 10 is a schematic diagram of a virtual try-on effect in an embodiment of the present disclosure. [Figure 5] FIG. 1 is a structural schematic diagram of a data processing device according to an embodiment of the present disclosure; [Figure 6] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, the embodiments of the present disclosure will be described in more detail with reference to the drawings. Although the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described in the present disclosure, but rather, these embodiments are provided for a more transparent and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are used only for illustrative purposes and are not used to limit the protection scope of the present disclosure.

[0014] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders and in parallel, and that method embodiments may include additional steps and / or omit performing illustrated steps, and the scope of the present disclosure is not limited in this respect.

[0015] As used herein, the term "comprises" and variations thereof are open inclusions, including but not limited to. The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "in another embodiment" means "at least one other embodiment," and the term "in some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided in the description below.

[0016] It should be noted that the concepts of "first", "second", etc. referred to in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0017] It should be noted that the modifications "one" and "multiple" referred to in this disclosure are general rather than limiting, and those skilled in the art should understand that they should be understood as "one or more" unless the context explicitly indicates otherwise.

[0018] The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are used for illustrative purposes only and are not used to limit the scope of these messages or information.

[0019] 1 is a flowchart of a data processing method according to an embodiment of the present disclosure. The method may be executed by a data processing device, which may be implemented in software and / or hardware, and which may be disposed in an electronic device, such as a display terminal, including but not limited to electronic devices with displays, such as smartphones, palmtop computers, tablet PCs, portable wearable devices, and smart home devices (e.g., stands).

[0020] As shown in FIG. 1, the method may specifically include the following steps: In step 110, in response to an import operation of a resource file of a try-on object, the resource file is processed to obtain an object file whose file format is compatible with the effect editor.

[0021] Here, the resource file of the try-on object is a 3D format file obtained by tracking the physical entity of the try-on object using a 3D object tracking device. The 3D object tracking device refers to a device that executes a 3D object tracking algorithm. The 3D object tracking algorithm is a commonly used algorithm in computer vision and is widely used in fields such as video surveillance, human-computer interaction, and autonomous driving.

[0022] The resource file of the try-on object refers to a file related to the 3D model that stores the try-on object. By obtaining the 3D model of the try-on object and related resources (e.g., map resources) based on a 3D object tracking algorithm, the efficiency of obtaining the 3D model is improved, the difficulty of obtaining the 3D model is reduced, and the labor costs of modeling are reduced.

[0023] Taking shoes as an example, a 3D object tracking device tracks the left and right shoes, respectively, to obtain 3D left and right foot model resource files. These 3D resource files are typically USDZ files. USDZ is an augmented reality file format for the iOS platform, serving 3D information. The USDZ file itself can function as a container, containing a format that a computer can open to properly display various necessary tools. In other words, a USDZ file is a resource base for 3D rendering. The left and right foot model resource files contain not only the 3D shoe model, but also a shoe map resource. A map is a graphics term that refers to a texture resource used in rendering a 3D model. Maps allow for rendering patterns, colors, and other textures onto the 3D model, and can also simulate the textures and other details of the 3D model. Generally, a user uses a 3D Object Tracking device to collect a left foot usdz file and a right foot usdz file with resources such as shoe models, maps, etc.

[0024] After obtaining a USDZ file, the user simply imports it into the Effect Editor. When the Effect Editor detects the user's import operation, it automatically analyzes and converts the imported USDZ file to obtain an object file with a file or data format compatible with the Effect Editor. A USDZ file can be considered a compressed file containing multiple resources. After decompression, its map resources and model resources can be extracted, i.e., the subdivided resources can be extracted. These model resources have a specified data structure. The iOS system itself supports opening USDZ files and exporting them as OBJ files, while third-party executable programs support exporting them as FBX files. A file analysis program library is officially provided for model files in general formats (e.g., OBJ and FBX). Therefore, using the interface provided by the file analysis program library, model files in a specified format can be analyzed to extract detailed model data, such as vertex positions, texture coordinates, and normal vectors of 3D models. New data structures can then be constructed based on the extracted model data to match model resource objects in different engines. When a user imports a resource file of a try-on object into the effect editor, the effect editor can determine the file format based on the suffix of the resource file, and then perform corresponding analysis on it to extract its model detail data using the interface provided by the corresponding file analysis program library.For example, an effect editor may integrate a third-party usdz parser and fbx parser. If a resource file imported by a user is a usdz file, the effect editor first converts the usdz file to an fbx file using the usdz parser, then parses and manipulates the fbx file using the fbx parser to extract model details, and then constructs a data structure suitable for the effect editor based on the extracted model details. The final result is a model file and map file suitable for the effect editor. Throughout the entire process, the user only needs to import the resource file without performing file parsing or format conversion, thereby achieving the goal of simplifying user operation.

[0025] Generally speaking, said processing the resource file to obtain an object file whose file format is compatible with the effect editor includes:

[0026] The program converts the format of the resource file into a first format based on a first preset file parsing program table interface, obtains the resource file in the first format, i.e., converts the usdz file into an fbx file based on a usdz parser, parses the resource file in the first format based on a second preset file parsing program table interface, obtains at least two key points of the resource object included in the resource file in the first format, i.e., extracts model detail data from the fbx file based on an fbx parser, and generates an object file, the file format of which is compatible with the effect editor, including a map subfile and a model subfile of the try-on object based on the at least two key points.

[0027] 2, which shows a schematic diagram of the process of processing a resource file and obtaining an object file whose file format is compatible with the effect editor, the resource file imported by the user is a usdz file. The effect editor converts the usdz file into an fbx file (i.e., a model file) and a png file (map file) using a usdz parser, extracts model detail data from the fbx file using an fbx file parser, constructs a local model structure mesh compatible with the effect editor, and converts the resources in the png file into a local resource texture compatible with the effect editor using a png parser. Here, a grid mesh is a general structure of a 3D model. The surface of a 3D model is typically composed of multiple interconnected triangular faces, each consisting of three nodes and three edges. Therefore, a 3D model can be understood as being composed of nodes and edges, and the set of nodes and edges that make up a 3D model is a mesh.

[0028] In step 120, in response to an operation of dragging the object file onto a preset node of the effect editor, a rendering component is added to the preset node.

[0029] Illustratively, adding a rendering component to a preset node in response to an operation of dragging the object file to the preset node of the effect editor includes: The method includes loading a preset rendering component into the preset node and transmitting the model sub-file to the rendering component to create a citation relationship between the rendering component and the model sub-file; creating a preset material resource file sub-node to create a citation relationship between the preset material resource file and the rendering component; and creating a citation relationship between the map sub-file and the preset material resource file in response to an operation of dragging the map sub-file to the preset material resource file sub-node.

[0030] That is, the rendering component needs to reference two resources: one is a model resource (i.e., the model subfile) and the other is a material resource (i.e., the predefined material resource file). When the user drags the object file to a predefined node in the effect editor, the effect editor automatically adds the rendering component to the predefined node and simultaneously transfers the model subfile to the rendering component as a reference resource of the rendering component. A predefined material resource file subnode is also created. The user then needs to drag a map subfile to the subnode to create a reference relationship between the map subfile and the predefined material resource file. The rendering effect of the 3D model is determined by the material resource referenced by the rendering component. The effect editor provides PBR materials; that is, the predefined material resources may be PBR materials, which may be set to various physical effects such as metal balls, fabrics, wood products, and shoe textures.

[0031] In step 130, a try-on image is rendered based on the rendering component, in which the try-on object model is fitted onto a preset part model.

[0032] To illustrate the above process, let's take the example of trying on shoes as the object. The user uses a 3D Object Tracking device to collect a left foot usdz file and a right foot usdz file containing resources such as shoe models and maps. The user then imports the left foot usdz file and the right foot usdz file into the effect editor. The effect editor processes the left foot usdz file to obtain a left foot object file, and processes the right foot usdz file to obtain a right foot object file. The user then drags the left foot object file to the left foot node of the effect editor and the right foot object file to the right foot node of the effect editor. The effect editor then adds rendering components to the left foot node and the right foot node, respectively. A reference relationship is created between the rendering component of the left foot node and the left foot model subfile, and a reference relationship is created between the rendering component of the right foot node and the right foot model subfile. At the same time, a new PBR material resource corresponding to the left foot node and a new PBR material resource corresponding to the right foot node are created. The user then drags the left foot map subfile onto the PBR material resource corresponding to the left foot node to create a reference relationship between the PBR material resource corresponding to the left foot node and the left foot map subfile. The user then drags the right foot map subfile onto the PBR material resource corresponding to the right foot node to create a reference relationship between the PBR material resource corresponding to the right foot node and the right foot map subfile. For example, see the schematic diagram of the left foot node and the right foot node shown in FIG. 3, which includes a left foot node 310, a left foot model 311, a right foot node 320, and a right foot model 321. As described above, the user simply drags the resource file corresponding to the shoe onto the corresponding node to view a virtual shoe try-on image, simplifying user operation and allowing users to quickly create a virtual shoe try-on effect for familiar entity shoes with low operational difficulty.

[0033] In some embodiments, the data processing method further includes, in response to an operation of dragging the object file to a preset node of the effect editor, adding a posture component to the preset node and creating a reference relationship between the posture component and a preset foot detection algorithm, thereby transmitting the foot position and posture determined based on the preset foot detection algorithm to the posture component, wherein the preset foot detection algorithm is used to determine the real-time position and posture of the foot based on video frames, and the posture component is used to provide a rendering position during rendering. For example, a fitting area is not a fixed foot model but a user's foot photographed in real time by a camera, and the posture component needs to provide the rendering position of a 3D shoe model based on the preset foot detection algorithm.

[0034] In some embodiments, to achieve a realistic virtual try-on effect and improve the fit between the shoe model and the foot model, it is necessary to adjust the coordinate origin of the shoe model and the coordinate origin of the foot model. Specifically, rendering a try-on image in which the try-on object model is worn on the preset body part model based on the rendering component includes modifying the coordinate origin of the shoe model based on the coordinate origin used by the preset foot detection algorithm to adjust the fit between the shoe model and the foot model. Specifically, based on data of more than 1,000 vertices of the 3D shoe model, a rectangular outline capable of enclosing the 3D shoe model is determined, based on the ratio between the rectangular outline of the 3D shoe model and the rectangular outline of the foot model, a scaling ratio of the 3D shoe model is determined, based on the deviation of the rectangular outline of the 3D shoe model from the coordinate origin, a position to be modified of the 3D shoe model is determined, and the position is provided to the pose component to render a 3D shoe model that matches the size of the foot model and improve the fit between the 3D shoe model and the foot model.

[0035] In some embodiments, to achieve a more realistic virtual clothing effect, the effect editor may include a calf model for providing an occlusion relationship during rendering, thereby making the virtual clothing effect more realistic. Specifically, in response to an operation of dragging the object file to a preset node in the effect editor, a calf model for providing an occlusion relationship during rendering is added to the preset node. For example, see the schematic diagram of the virtual clothing effect shown in FIG. 4, which includes the calf occlusion effect achieved by the calf model, thereby making the virtual clothing effect more realistic.

[0036] In some embodiments, to realize a virtual try-on function on the client, the method further includes generating a try-on effect file package based on the preset nodes, the try-on effect file package including at least one of a shoe map sub-file, a shoe model sub-file, a material resource file, a calf model, a rendering component, a posture component, and a reference relationship between the rendering component and each of the files, for example, the material resource file references the map sub-file, the rendering component references the model sub-file and the material resource file, and the posture component references a foot detection algorithm, and uploading the try-on effect file package to a server, so that the server cooperates with the client to realize a virtual try-on function on the client based on the try-on effect file package. Specifically, when the client performs virtual try-on, the posture component obtains the user's foot position and posture in real time, and the rendering component renders a 3D shoe model based on the user's foot position and posture.

[0037] In a data processing method according to an embodiment of the present disclosure, when a user imports a resource file of a try-on object into an effect editor, the effect editor automatically analyzes and converts the resource file to obtain an object file compatible with the effect editor. After that, the user drags the object file to a preset node in the effect editor. The effect editor automatically adds a rendering component to the preset node, and renders a try-on image in which the model of the try-on object is fitted to a preset body part model, thereby realizing virtual try-on of the try-on object and simplifying user operations.

[0038] 5 is a structural schematic diagram of a data processing device in an embodiment of the present disclosure. As shown in FIG. 5, the data processing device specifically includes: a processing module 510, a first additional module 520, and a rendering module 530.

[0039] Here, the processing module 510 is used to process a resource file of a try-on object in response to an import operation of the resource file and obtain an object file whose file format is compatible with the effect editor; the first adding module 520 is used to add a rendering component to a preset node of the effect editor in response to an operation of dragging the object file to the preset node; and the rendering module 530 is used to render a try-on image in which the model of the try-on object is worn on a preset part model based on the rendering component.

[0040] Optionally, the try-on object resource file is a file in a three-dimensional format obtained by tracking the physical entity of the try-on object with a three-dimensional object tracking device.

[0041] Optionally, the processing module 510 includes: a conversion unit for converting a format of the resource file into a first format based on a first preset file parsing program table interface to obtain a resource file in the first format; an analysis unit for analyzing the resource file in the first format based on a second preset file parsing program table interface to obtain at least two key points of a resource object included in the resource file in the first format; and a generation unit for generating an object file, the file format of which is compatible with the effect editor, based on the at least two key points, the object file including a map sub-file and a model sub-file of the try-on object.

[0042] Optionally, the first additional module 520 includes: a loading unit for loading a preset rendering component into the preset node and transmitting the model sub-file to the rendering component to create a citation relationship between the rendering component and the model sub-file; a new creating unit for creating a preset material resource file sub-node and creating a citation relationship between the preset material resource file and the rendering component; and a creating unit for creating a citation relationship between the map sub-file and the preset material resource file in response to an operation of dragging the map sub-file to the preset material resource file sub-node.

[0043] Selectably, the try-on objects include shoes, the try-on object models include a left shoe model and a right shoe model, the pre-set part models include a left foot model and a right foot model, the resource files include a left foot resource file and a right foot resource file, and the object files include a left foot object file and a right foot object file.

[0044] Optionally, the first adding module 520 is specifically used to add a rendering component to the left foot node in response to an operation of dragging the left foot object file to the left foot node of the effect editor, and to add a rendering component to the right foot node in response to an operation of dragging the right foot object file to the right foot node of the effect editor.

[0045] Optionally, the apparatus further includes a second additional module for, in response to an operation of dragging the object file to a preset node of the effect editor, adding a posture component to the preset node and creating a reference relationship between the posture component and a preset foot detection algorithm, thereby transmitting foot positions and postures determined based on the preset foot detection algorithm to the posture component, wherein the preset foot detection algorithm is used to determine foot positions and postures based on video frames, and the posture component is used to provide rendering positions during rendering.

[0046] Optionally, the rendering module 530 is specifically used to modify the coordinate origin of the shoe model based on the coordinate origin used by the preset foot detection algorithm, to improve the fit between the shoe model and the foot model.

[0047] Optionally, the device further includes a third additional module for, in response to an operation of dragging the object file to a preset node of the effect editor, adding a calf model to the preset node for providing an occlusion relationship during rendering.

[0048] Optionally, the device further includes a generating module for generating a try-on effect file package based on the preset nodes, the try-on effect file package including at least one of a shoe map sub-file, a shoe model sub-file, a material resource file, a calf model, a rendering component, a posture component, and a citation relationship between the rendering component and each of the files; and an uploading module for uploading the try-on effect file package to a server, so that the server can cooperate with a client to realize a virtual try-on function in the client based on the try-on effect file package.

[0049] In a data processing device according to an embodiment of the present disclosure, when a user imports a resource file of a try-on object into an effect editor, the effect editor automatically analyzes and converts the resource file to obtain an object file compatible with the effect editor. After that, the user drags the object file to a preset node in the effect editor. The effect editor automatically adds a rendering component to the preset node, and renders a try-on image in which the model of the try-on object is fitted to a preset body part model, thereby realizing virtual try-on of the try-on object and simplifying user operations.

[0050] The data processing device according to the embodiments of the present disclosure can perform the steps in the data processing method according to the embodiments of the method of the present disclosure, and the performing steps and beneficial effects thereof will not be further described herein.

[0051] FIG. 6 is a structural schematic diagram of an electronic device in an embodiment of the present disclosure. Referring specifically to FIG. 6 below, a structural schematic diagram of an electronic device 600 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 600 in the embodiment of the present disclosure may include, but is not limited to, mobile devices such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet PCs), PMPs (portable multimedia players), in-car devices (e.g., in-car navigation devices), and wearable electronic devices, as well as fixed devices such as digital TVs, desk computers, and smart home devices. The electronic device shown in FIG. 6 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.

[0052] 6, electronic device 600 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 601 that can perform various appropriate operations and processes based on programs stored in read-only memory (ROM) 602 or programs loaded from storage device 608 into random access memory (RAM) 603 to implement the method embodiments described in the present disclosure. RAM 603 further stores various programs and data necessary for the operation of electronic device 600. Processing unit 601, ROM 602, and RAM 603 are connected to each other via bus 604. Input / output (I / O) interface 605 is also connected to bus 604.

[0053] Typically, input devices 606, including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607, including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 608, including, for example, a magnetic tape, hard disk, etc.; and communication devices 609 may be connected to the I / O interface 605. The communication devices 609 may enable the electronic device 600 to communicate wirelessly or via wires to exchange data with other devices. While FIG. 6 illustrates the electronic device 600 with various devices, it should be understood that it need not implement or include all of the devices shown. Alternatively, more or fewer devices may be implemented or included.

[0054] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program including program code for executing the methods illustrated in the flowcharts, thereby implementing the methods. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 609, installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, it performs the functions defined in the methods of the embodiments of the present disclosure.

[0055] It should be noted that the computer-readable medium of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a propagated data signal, in baseband or as part of a carrier, on which computer-readable program code is borne. Such propagated data signals may take various forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied in a computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

[0056] In some embodiments, clients and servers communicate using any now known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), extranets (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any now known or future developed networks.

[0057] The computer-readable medium may be included in the electronic device, or may exist separately from the electronic device.

[0058] The computer-readable medium has one or more programs stored therein, and when the one or more programs are executed by the electronic device, In response to an import operation of a resource file of a try-on object, the electronic device processes the resource file to obtain an object file whose file format is compatible with the effect editor; in response to an operation of dragging the object file to a preset node of the effect editor, the electronic device adds a rendering component to the preset node; and, based on the rendering component, renders a try-on image in which a model of the try-on object is worn on a preset part model.

[0059] Optionally, when the one or more programs are executed by the electronic device, the electronic device can further perform other steps described in the above embodiments.

[0060] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages ​​or combinations thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as general procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. When referring to a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0061] The flowcharts and block diagrams in the figures illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing the specified logical function. It should be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order from the order marked in the figures. For example, two blocks shown in succession may actually be executed essentially in parallel or may be executed in the reverse order depending on the functionality involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs the specified functions or operations, or in a combination of dedicated hardware and computer instructions.

[0062] The units described in the embodiments of the present disclosure may be implemented in software or hardware, and the names of the units do not necessarily limit the units themselves.

[0063] The functionality described herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific general purpose products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0064] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or can store a program used by or in connection with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more wire-based electrical connections, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0065] According to one or more embodiments of the present disclosure, the present disclosure provides a data processing method, which includes: in response to an import operation of a resource file of a try-on object, processing the resource file to obtain an object file whose file format is compatible with the effect editor; in response to an operation of dragging the object file to a preset node of the effect editor, adding a rendering component to the preset node; and rendering a try-on image in which a model of the try-on object is worn on a preset body part model based on the rendering component.

[0066] According to one or more embodiments of the present disclosure, in the data processing method of the present disclosure, optionally, the resource file of the try-on object is a three-dimensional format file obtained by tracking the physical entity of the try-on object using a three-dimensional object tracking device.

[0067] According to one or more embodiments of the present disclosure, in the data processing method of the present disclosure, optionally, the step of processing the resource file to obtain an object file whose file format is compatible with the effect editor includes converting the format of the resource file to a first format based on a first preset file parsing program table interface to obtain a resource file in the first format; analyzing the resource file in the first format based on a second preset file parsing program table interface to obtain at least two key points of a resource object included in the resource file in the first format; and generating an object file whose file format is compatible with the effect editor, the object file including a map subfile and a model subfile of the try-on object based on the at least two key points.

[0068] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, in response to an operation of dragging the object file to a preset node of the effect editor, selectively adding a rendering component to the preset node includes: loading the preset rendering component to the preset node and transmitting the model sub-file to the rendering component to create a citation relationship between the rendering component and the model sub-file; creating a new preset material resource file sub-node to create a citation relationship between the preset material resource file and the rendering component; and creating a citation relationship between the map sub-file and the preset material resource file in response to an operation of dragging the map sub-file to the preset material resource file sub-node.

[0069] According to one or more embodiments of the present disclosure, in the data processing method of the present disclosure, the try-on object selectively includes shoes, the try-on object model includes a left foot shoe model and a right foot shoe model, the pre-set part model includes a left foot model and a right foot model, the resource file includes a left foot resource file and a right foot resource file, and the object file includes a left foot object file and a right foot object file.

[0070] According to one or more embodiments of the present disclosure, in the data processing method of the present disclosure, selectively adding a rendering component to a preset node in response to an operation of dragging the object file to the preset node of the effect editor includes adding a rendering component to the left foot node in response to an operation of dragging the left foot object file to the left foot node of the effect editor, and adding a rendering component to the right foot node in response to an operation of dragging the right foot object file to the right foot node of the effect editor.

[0071] According to one or more embodiments of the present disclosure, the data processing method of the present disclosure further includes, in response to an operation of selectively dragging the object file to a preset node of the effect editor, adding a posture component to the preset node and creating a reference relationship between the posture component and a preset foot detection algorithm, thereby transmitting foot positions and postures determined based on the preset foot detection algorithm to the posture component, wherein the preset foot detection algorithm is used to determine foot positions and postures based on video frames, and the posture component is used to provide rendering positions during rendering.

[0072] According to one or more embodiments of the present disclosure, in the data processing method of the present disclosure, the step of selectively rendering a try-on image in which the model of the try-on object is fitted to a preset part model based on the rendering component includes modifying the coordinate origin of the shoe model based on the coordinate origin used by the preset foot detection algorithm to improve the degree of fit between the shoe model and the foot model.

[0073] According to one or more embodiments of the present disclosure, the data processing method of the present disclosure further includes, in response to an operation of selectively dragging the object file to a pre-defined node of the effect editor, adding a calf model to the pre-defined node to provide an occlusion relationship during rendering.

[0074] According to one or more embodiments of the present disclosure, the data processing method of the present disclosure further includes: selectively generating a try-on effect file package based on the preset nodes, the try-on effect file package including at least one of a shoe map sub-file, a shoe model sub-file, a material resource file, a calf model, a rendering component, a posture component, and a citation relationship between the rendering component and each of the files; and uploading the try-on effect file package to a server, so that the server cooperates with a client to realize a virtual try-on function in the client based on the try-on effect file package.

[0075] According to one or more embodiments of the present disclosure, the present disclosure provides a data processing device, the data processing device including: a processing module for responding to an import operation of a resource file of a try-on object, processing the resource file, and obtaining an object file whose file format is compatible with the effect editor; a first adding module for responding to an operation of dragging the object file to a preset node of the effect editor, and adding a rendering component to the preset node; and a rendering module for rendering a try-on image in which a model of the try-on object is worn on a preset body part model based on the rendering component.

[0076] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the resource file of the try-on object is optionally a three-dimensional format file obtained by tracking a physical entity of the try-on object using a three-dimensional object tracking device.

[0077] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the processing module optionally includes: a conversion unit for converting a format of the resource file into a first format based on a first preset file parsing program table interface to obtain a resource file in the first format; an analysis unit for analyzing the resource file in the first format based on a second preset file parsing program table interface to obtain at least two key points of a resource object included in the resource file in the first format; and a generation unit for generating an object file whose file format is compatible with the effect editor based on the at least two key points, the object file including a map sub-file and a model sub-file of the try-on object.

[0078] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the first additional module optionally includes: a loading unit for loading a configured rendering component into the predetermined node and transmitting the model sub-file to the rendering component to create a citation relationship between the rendering component and the model sub-file; a new creation unit for creating a configured material resource file sub-node and creating a citation relationship between the configured material resource file and the rendering component; and a creation unit for creating a citation relationship between the map sub-file and the predetermined material resource file in response to an operation of dragging the map sub-file to the predetermined material resource file sub-node.

[0079] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the try-on object selectively includes shoes, the try-on object model includes a left foot shoe model and a right foot shoe model, the pre-set body part model includes a left foot model and a right foot model, the resource file includes a left foot resource file and a right foot resource file, and the object file includes a left foot object file and a right foot object file.

[0080] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the first additional module is selectively used to specifically add a rendering component to the left foot node in response to an operation of dragging the left foot object file to the left foot node of the effect editor, and to add a rendering component to the right foot node in response to an operation of dragging the right foot object file to the right foot node of the effect editor.

[0081] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the device optionally further includes a second additional module for, in response to an operation of dragging the object file to a preset node of the effect editor, adding a posture component to the preset node and creating a reference relationship between the posture component and a preset foot detection algorithm, thereby transmitting foot positions and postures determined based on the preset foot detection algorithm to the posture component, wherein the preset foot detection algorithm is used to determine foot positions and postures based on video frames, and the posture component is used to provide rendering positions during rendering.

[0082] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the rendering module is selectively specifically used to modify the coordinate origin of the shoe model based on the coordinate origin used by the preset foot detection algorithm, to improve the fit between the shoe model and the foot model.

[0083] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the device optionally further includes a third additional module for adding a calf model to the preset node in response to an operation of dragging the object file to a preset node of the effect editor to provide an occlusion relationship during rendering.

[0084] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the device optionally further includes: a generation module for generating a try-on effect file package based on the preset nodes, the try-on effect file package including at least one of a shoe map sub-file, a shoe model sub-file, a material resource file, a calf model, a rendering component, a posture component, and a citation relationship between the rendering component and each of the files; and an upload module for uploading the try-on effect file package to a server, so that the server can cooperate with a client and realize a virtual try-on function in the client based on the try-on effect file package.

[0085] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, the electronic device comprising: one or more processors; a memory for storing one or more programs; The one or more programs, when executed by the one or more processors, cause the one or more processors to implement any of the data processing methods according to the present disclosure.

[0086] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the data processing methods described herein.

[0087] An embodiment of the present disclosure further provides a computer program product including a computer program or instructions, which, when executed by a processor, implements the data processing method described above.

[0088] The above description is merely a description of the preferred embodiments of the present disclosure and the technical principles used. As can be understood by those skilled in the art, the scope of the present disclosure is not limited to the technical solution achieved by the specific combination of the above technical features, but also encompasses other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the concept of the above disclosure, such as, for example, the above features and technical features having similar functions (but not limited to) disclosed in the present disclosure, which are substituted for each other.

[0089] It should be noted that although each operation is depicted in a particular sequence, it should not be understood that these operations are required to be performed in the particular sequence or order depicted. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above description includes several specific implementation details, these should not be construed as limitations on the scope of the disclosure. Some features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments, either alone or in any suitable subcombination.

[0090] Although the present subject matter has been described using language specific to structural features and / or methodological logical operations, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. 1. A data processing method comprising: In response to an import operation of a resource file of a try-on object, processing the resource file to obtain an object file whose file format is compatible with the effect editor; adding a rendering component to a preset node of the effect editor in response to an operation of dragging the object file to the preset node; Rendering a try-on image in which the model of the try-on object is worn on a preset body part model based on the rendering component; Processing the resource file to obtain an object file whose file format is compatible with the effect editor includes: Converting the format of the resource file into a first format according to a first preset file parsing program table interface to obtain a resource file in the first format; Parsing the first-format resource file according to a second preset file parsing program table interface to obtain model detail data of resource objects included in the first-format resource file; generating an object file, the file format of which is compatible with the effect editor, including a map sub-file and a model sub-file of the try-on object based on the model detail data; adding a rendering component to a preset node in the effect editor in response to an operation of dragging the object file to the preset node, Loading a configured rendering component into the pre-configured node, and transmitting the model sub-file to the rendering component to create a reference relationship between the rendering component and the model sub-file; creating a subnode of a preset material resource file and creating a reference relationship between the preset material resource file and the rendering component; and creating a citation relationship between the map subfile and the pre-set material resource file in response to an operation of dragging the map subfile to the pre-set material resource file subnode.

2. 2. The method of claim 1, wherein the try-on object resource file is a three-dimensional format file obtained by tracking physical entities of the try-on object with a three-dimensional object tracking device.

3. the try-on objects include shoes, the try-on object models include a left shoe model and a right shoe model, and the preset part models include a left foot model and a right foot model; 2. The method of claim 1, wherein the resource files include a left foot resource file and a right foot resource file, and the object files include a left foot object file and a right foot object file.

4. adding a rendering component to a preset node in the effect editor in response to an operation of dragging the object file to the preset node, adding a rendering component to the left foot node in response to an operation of dragging the left foot object file to the left foot node of the effect editor; 4. The method of claim 3, further comprising: in response to dragging the right foot object file onto a right foot node of the effect editor, adding a rendering component to the right foot node.

5. and further comprising: in response to an operation of dragging the object file to a preset node of the effect editor, adding a posture component to the preset node and creating a reference relationship between the posture component and a preset foot detection algorithm, thereby transmitting the foot position and posture determined based on the preset foot detection algorithm to the posture component; 4. The method of claim 3, wherein the pre-defined foot detection algorithm is used to determine foot position and pose based on video frames, and the pose component is used to provide a rendering position during rendering.

6. Rendering a try-on image in which the model of the try-on object is worn on a preset part model based on the rendering component includes:

6. The method according to claim 5, further comprising: correcting the coordinate origin of the shoe model based on the coordinate origin used by the preset foot detection algorithm to adjust the degree of fit between the shoe model and the foot model.

7. 4. The method of claim 3, further comprising: in response to an operation of dragging the object file onto a preset node of the effect editor, adding a calf model to the preset node for providing an occlusion relationship during rendering.

8. generating a try-on effect file package based on the preset nodes, the try-on effect file package including at least one of a shoe map sub-file, a shoe model sub-file, a material resource file, a calf model, a rendering component, and a posture component, and a citation relationship between the rendering component and each of the files; 4. The method of claim 3, further comprising uploading the try-on effect file package to a server, whereby the server cooperates with a client to realize a virtual try-on function in the client based on the try-on effect file package.

9. 1. A data processing device, comprising: a processing module for processing the resource file of the try-on object in response to an import operation of the resource file of the try-on object to obtain an object file whose file format is compatible with the effect editor; a first adding module for adding a rendering component to a preset node of the effect editor in response to an operation of dragging the object file to the preset node; a rendering module for rendering a try-on image in which the try-on object model is worn on a preset body part model based on the rendering component; The processing module includes: a conversion unit for converting a format of the resource file into a first format according to a first preset file parsing program table interface, and obtaining a resource file in the first format; an analysis unit for analyzing the first-format resource file according to a second preset file analysis program table interface to obtain model detail data of resource objects included in the first-format resource file; a generating unit for generating an object file, the file format of which is compatible with the effect editor, including a map sub-file and a model sub-file of the try-on object based on the model detail data; The first additional module: a loading unit for loading a preset rendering component into the preset node and transmitting the model sub-file to the rendering component to create a reference relationship between the rendering component and the model sub-file; a new creation unit for creating a new preset material resource file subnode and creating a citation relationship between the preset material resource file and the rendering component; a creating unit for creating a citation relationship between the map subfile and the preset material resource file in response to an operation of dragging the map subfile to the preset material resource file subnode.

10. An electronic device, one or more processors; a storage device for storing one or more programs; An electronic device characterized in that, when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method according to any one of claims 1 to 8.

11. A computer-readable storage medium on which a computer program is stored, the computer program implementing the method of any one of claims 1 to 8 when executed by a processor.

Images