Electronic device and method for operating same

The electronic device automatically converts 2D clothing images into 3D attire for avatars by using meta information and 3D modeling, addressing the challenge of manual 3D costume creation and platform compatibility in virtual environments like the metaverse.

WO2025018443A1PCT designated stage expired Publication Date: 2025-01-23LG ELECTRONICS INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/010255
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-18
Publication Date
2025-01-23

AI Technical Summary

Technical Problem

Current technologies cannot automatically generate three-dimensional clothing for avatars in virtual environments like the metaverse, requiring manual creation of 3D costumes for each avatar using 3D authoring tools and lacking the ability to convert 2D clothing images into 3D attire that fits specific avatars and platforms.

Method used

An electronic device with a processor and memory that acquires meta information from 2D clothing images, matches and combines 2D templates to generate 3D reference clothing, adjusts size and positions to fit target avatars, and converts 2D clothing into 3D attire using texture mapping and 3D modeling techniques, enabling automatic creation of 3D costumes without manual intervention.

Benefits of technology

Enables the automatic generation of 3D clothing tailored to specific avatars and platforms, reducing manual effort and providing a scalable solution for metaverse services by allowing 2D images to be directly converted into compatible 3D attire.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023010255_23012025_PF_FP_ABST
    Figure KR2023010255_23012025_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device, according to an embodiment of the present disclosure, may comprise: a memory that stores a plurality of 2D clothing template sets, each of the plurality of 2D clothing template sets including a plurality of 2D clothing templates; and a processor that acquires meta information of a 2D clothing image, acquires the plurality of 2D clothing templates matching the meta information from the memory, generates 3D reference clothing by combining the plurality of acquired 2D clothing templates, and generates 3D clothing by using the 3D reference clothing and texture information included in the meta information.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to electronic devices, and more particularly, to electronic devices for generating three-dimensional clothing.

[0002] The metaverse refers to a virtual world created by combining virtual reality (VR) and augmented reality (AR). The metaverse exists independently of the real world, and its goal is for users to interact and communicate within a virtual space.

[0003] The metaverse is a concept born from the advancement of the internet and digital technology, enabling diverse users to engage and participate in a virtual world. The metaverse can encompass spaces, land, buildings, people, and objects similar to the real world, and users express themselves and interact through virtual avatars.

[0004] The avatar wears a three-dimensional costume (3D costume).

[0005] For 3D clothing, it must be worn over another 3D avatar, so a simulation is absolutely necessary to ensure that the 3D clothing wraps around the 3D avatar.

[0006] Previously, there was only a technology to generate a 3D object image similar to a 2D object image when a 2D object image was input, but it was impossible to generate 3D clothing that took 3D objects into account.

[0007] Additionally, in the past, 3D costumes had to be created manually one by one using 3D authoring tools or 3D costume authoring tools, and there was a problem that 3D costumes had to be created separately for each 3D avatar of the target platform.

[0008] The purpose of this disclosure is to automatically generate a 3D garment by inputting a 2D garment image.

[0009] The purpose of this disclosure is to automatically convert the format of a garment to fit the shape of a 3D avatar to which the garment is to be applied.

[0010] An electronic device according to an embodiment of the present disclosure may include a memory storing a plurality of 2D clothing template sets, each of the plurality of 2D clothing template sets including a plurality of 2D clothing templates; and a processor that obtains meta information of a 2D clothing image, obtains the plurality of 2D clothing templates matching the meta information from the memory, generates a 3D reference clothing by combining the obtained plurality of 2D clothing templates, and generates the 3D clothing by using texture information included in the 3D reference clothing and the meta information.

[0011] An electronic device according to an embodiment of the present disclosure may include a memory that stores shape information on a 2D costume of an original avatar, and a processor that adjusts the size of the 2D costume to fit the size of a target avatar using the shape information, positions the 2D costume, whose size has been adjusted, to fit the shape of the target avatar, and converts the positioned 2D costume into a 3D costume to fit a target platform of the target avatar.

[0012] According to an embodiment of the present disclosure, a 3D costume can be automatically created by inputting only a 2D costume image without the need for manual work using a separate authoring tool for creating a 3D costume. Accordingly, a 3D costume creation service that meets the needs of a company seeking to provide a metaverse service can be provided.

[0013] Additionally, 3D costumes that fit the avatar's shape are provided to suit the needs of the target platform, making it compatible with various platforms.

[0014] FIG. 1 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0015] FIG. 2 is a block diagram illustrating the configuration of a server according to one embodiment of the present disclosure.

[0016] FIG. 3 is a drawing for explaining a method for generating a 3D costume of an electronic device according to an embodiment of the present disclosure.

[0017] FIG. 4 is a drawing illustrating a 3D costume generation process according to an embodiment of the present disclosure.

[0018] FIG. 5 is a drawing illustrating a detailed configuration of a processor according to an embodiment of the present disclosure.

[0019] Figure 6 is a drawing that illustrates the process of extracting texture information from a 2D clothing image.

[0020] FIG. 7 is a flowchart illustrating an operating method of an electronic device according to another embodiment of the present disclosure.

[0021] FIG. 8 is a drawing illustrating 2D clothing templates according to one embodiment of the present disclosure.

[0022] FIGS. 9 to 11 are drawings detailing a process of converting a 2D costume of an original avatar into a 3D costume of a target avatar according to one embodiment of the present disclosure.

[0023] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "part" used in the following description for components are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0024] An electronic device according to an embodiment of the present invention is an intelligent electronic device with added computer support functions, and may be provided with an Internet function, etc., and may have a more convenient interface such as a manual input device, a touch screen, or a space remote control.

[0025] Additionally, with wired or wireless Internet access, it can connect to the Internet and computers, enabling functions such as email, web browsing, banking, and gaming. A standardized, general-purpose operating system can be used for these diverse functions.

[0026] Accordingly, the electronic device described in the present invention can perform various user-friendly functions, for example, since various applications can be freely added or deleted on a general-purpose OS kernel.

[0027] FIG. 1 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0028] The electronic device (100) may be implemented as a fixed device or a movable device, such as a projector, a mobile phone, a smart phone, a desktop computer, a laptop, a digital broadcasting terminal, a PDA (personal digital assistant), a PMP (portable multimedia player), a navigation device, a tablet PC, a wearable device, a desktop computer, or a TV.

[0029] Referring to FIG. 1, an electronic device (100) may include a communication circuit (110), an input interface (120), a memory (130), a display (140), and a processor (190).

[0030] The communication circuit (110) can transmit and receive data with external devices such as other electronic devices or servers using wired or wireless communication technology.

[0031] The communication circuit (110) can perform communication using any one of the communication standards of GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), LTE (Long Term Evolution), 5G, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Bluetooth, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), ZigBee, and NFC (Near Field Communication).

[0032] The input interface (120) may include a camera for inputting a video signal, a microphone for receiving an audio signal, a user input unit for receiving information from a user, etc.

[0033] Here, the camera or microphone is treated as a sensor, and the signal obtained from the camera or microphone can be called sensing data or sensor information.

[0034] The memory (130) can store various software and data related to the operation of the electronic device (100).

[0035] The display (140) can display a video signal received from the outside.

[0036] The processor (190) can control the overall operation of the electronic device (100).

[0037] When connection of an external device is required to perform an operation of the electronic device (100), the processor (190) can generate a control signal for controlling the external device and transmit the generated control signal to the external device.

[0038] The processor (190) can control at least some of the components of the electronic device (100) to run an application program stored in the memory (130).

[0039] The processor (190) can operate two or more of the components included in the electronic device (100) in combination to drive an application program.

[0040] FIG. 2 is a block diagram illustrating the configuration of a server according to one embodiment of the present disclosure.

[0041] Referring to FIG. 2, the server (200) may include a communication interface (210), a database (230), and a controller (290).

[0042] The communication interface (210) can perform Internet communication with an electronic device (100) or an external device. The communication interface (210) can be equipped with a communication circuit for Internet communication.

[0043] The controller (290) can control the overall operation of the server (200).

[0044] FIG. 3 is a drawing for explaining a method for generating a 3D costume of an electronic device according to an embodiment of the present disclosure.

[0045] Referring to FIG. 3, the processor (190) of the electronic device (100) obtains meta information of a 2D (Two-Dimension) clothing image (S301).

[0046] In one embodiment, the meta information may include the type of clothing and characteristic information of the clothing corresponding to the 2D clothing image.

[0047] The type of clothing can indicate the category of the clothing, such as whether it is a shirt or pants.

[0048] The characteristic information of the clothing may include one or more of the clothing attribute information, material (fabric) information, or clothing part information.

[0049] The attribute information of a costume may include one or more of the costume's pattern or color.

[0050] The material information of a garment may include information indicating what material the garment is made of.

[0051] Clothing part information may include information about how the clothing corresponds to a body part of the user. For example, clothing part information may include the length of the arm corresponding to the user's arm, the length of the leg corresponding to the user's leg, and the thickness of the neck corresponding to the user's neck.

[0052] The processor (190) can obtain meta information of a 2D clothing image from a 2D clothing image using a deep learning algorithm.

[0053] The processor (190) can obtain meta information of a 2D image using any one of the image recognition models using artificial intelligence.

[0054] The image recognition model can be either the YOLO (You Only Look Once) model or the Faster R-CNN (Regions with Convolution Neural Networks) model.

[0055] The YOLO (You Only Look Once) model is a model that can predict objects and their locations within an image by looking at the image only once.

[0056] The YOLO (You Only Look Once) model divides the original image into grids of equal size. For each grid, it predicts the number of bounding boxes in a predefined shape centered around the grid center, and calculates a confidence level based on this prediction.

[0057] Afterwards, whether the image contains an object or is just a background is included, and locations with high object confidence are selected so that the object category can be identified.

[0058] Next, we will explain the Faster R-CNN (Regions with Convolution Neural Networks) model in detail.

[0059] First, feature maps are extracted from the image using a Convolution Neural Network (CNN) model. Based on the extracted feature maps, multiple regions of interest (RoIs) are extracted. RoI pooling is performed for each region of interest.

[0060] RoI pooling is a process of setting a grid to a predetermined size of H x W for the feature map onto which the region of interest is projected, extracting the largest value for each cell included in each grid, and extracting a feature map with a size of H x W.

[0061] A feature vector is extracted from a feature map having a size of H x W, and object identification information and object feature information can be obtained from the feature vector.

[0062] The memory (130) of the electronic device (100) may store an image recognition model.

[0063] The processor (190) of the electronic device (100) searches for a plurality of 2D clothing templates that match the meta information obtained from the memory (130) (S303).

[0064] The memory (130) may store multiple sets of 2D costume templates.

[0065] Each 2D costume template set may contain multiple costume templates for one type of costume.

[0066] For example, if the garment is a shirt, the 2D garment templates may include multiple shirt arm templates corresponding to the arm portions and multiple shirt neck templates corresponding to the neck portions.

[0067] Each of the multiple shirt sleeve templates can have a different length. Each of the multiple shirt neck templates can have a different size.

[0068] In this way, a plurality of 2D costume templates for each type of 2D costume may be stored in the memory (130).

[0069] In particular, the processor (190) can extract a plurality of 2D clothing templates matching the type and part information of the 2D clothing image from the memory (130).

[0070] The processor (190) of the electronic device (100) combines a plurality of searched 2D clothing templates to generate a 3D reference clothing (S305).

[0071] The processor (190) can generate a 3D reference costume by simulating a plurality of 2D costume templates extracted from the memory (130).

[0072] The processor (190) can generate a 3D reference costume from a plurality of 2D costume templates using a 3D modeling technique. Various known software can be used for the 3D modeling technique.

[0073] The processor (190) of the electronic device (100) generates a 3D costume through texture mapping on the generated 3D reference costume (S307).

[0074] The processor (190) can obtain texture information from the meta information of the 2D clothing image. The texture information can include one or more of the attribute information or material information of the 2D clothing image included in the meta information.

[0075] Texture mapping can be the process of matching texture information to a 3D reference garment.

[0076] The processor (190) can reflect one or more of the attribute information or material information included in the meta information of the previously acquired 2D costume image to the 3D reference costume.

[0077] That is, the processor (190) can create a 3D costume by matching the pattern, color pattern, and material of the costume to the 3D reference costume.

[0078] FIG. 4 is a drawing illustrating a 3D costume generation process according to an embodiment of the present disclosure.

[0079] Referring to FIG. 4, the processor (190) receives a 2D clothing image (410) corresponding to a shirt as shown in (a) of FIG. 4.

[0080] The processor (190) can obtain meta information from a 2D clothing image (410) using a deep learning algorithm.

[0081] The processor (190) can obtain a plurality of 2D costume templates matching the meta information, as shown in (b) of FIG. 4.

[0082] The processor (190) can extract a plurality of 2D clothing templates matching the meta information from the memory (130) of the electronic device (100).

[0083] In another embodiment, the processor (190) may transmit a 2D clothing image (410) to a server (200) and receive meta information of the 2D clothing image (410) and a plurality of 2D clothing templates from the server (200).

[0084] The server (200) can obtain meta information from a 2D clothing image (410) and extract a plurality of 2D clothing templates matching the meta information from a plurality of 2D clothing template sets stored in a database (230). The server (200) can transmit the extracted plurality of 2D clothing templates and the meta information to the electronic device (100).

[0085] The processor (190) can combine multiple 2D costume templates to generate a 3D reference costume (430) as in FIG. 4(c). The 3D reference costume (430) may be a 3D costume that does not reflect a pattern, color pattern, or material.

[0086] The processor (190) can generate a 3D costume (470) by reflecting texture information (450) to a 3D reference costume (430), as shown in (c) of FIG. 4.

[0087] FIG. 5 is a drawing illustrating a detailed configuration of a processor according to an embodiment of the present disclosure.

[0088] Referring to FIG. 5, the processor (190) of the electronic device (100) may include a clothing meta-analyzer (191), a template extraction unit (192), a 3D clothing generator (193), and a texture generator (194).

[0089] The costume meta-analyzer (191) can analyze meta-information from a 2D costume image (501). The meta-information of the 2D costume image (501) can include the type of costume and characteristic information of the costume.

[0090] The characteristic information of the clothing may include one or more of the clothing attribute information, material (fabric) information, or clothing part information.

[0091] The template extraction unit (192) can calculate the similarity between the type and part information of the clothing and each of a plurality of 2D clothing templates corresponding to the type of clothing stored in the 2D clothing template DB (530).

[0092] The template extraction unit (192) can obtain 2D clothing templates having a similarity level higher than a certain value as the basis for 3D reference clothing.

[0093] The 3D clothing generator (193) can obtain a 3D reference clothing by combining 2D clothing templates with a similarity level of a certain value or higher with the clothing type and part information.

[0094] The 3D clothing generator (193) can compare a 3D combination clothing composed of 2D clothing templates with a plurality of 3D reference clothing stored in a 3D reference DB (550), and determine a 3D reference clothing with a similarity greater than a preset value.

[0095] The texture generator (194) can generate texture information from attribute information of a 2D clothing image (501) analyzed by the clothing meta-analyzer (191).

[0096] The texture generator (194) can compare the attribute information of the 2D clothing image (501) with each of a plurality of texture patterns stored in the texture pattern DB (510), and extract texture patterns having a similarity greater than a preset value.

[0097] Texture patterns may include pattern and color patterns of specific materials.

[0098] The texture generator (194) can transmit the pattern and color pattern of a specific material to the 3D clothing generator (193).

[0099] The texture generator (194) can create a 3D costume (503) by matching a pattern and color pattern of a specific material to a 3D reference costume.

[0100] In this way, according to an embodiment of the present disclosure, a 3D costume (503) can be automatically created by inputting only a 2D costume image (501) without the need for manual work using a separate authoring tool for creating a 3D costume.

[0101] Accordingly, a 3D costume production service that meets the needs of companies seeking to provide metaverse services can be provided.

[0102] Figure 6 is a drawing that illustrates the process of extracting texture information from a 2D clothing image.

[0103] Referring to FIG. 6, the processor (190) can extract a pattern and a color pattern from the attribute information of the clothing included in the meta information of the 2D clothing image.

[0104] The processor (190) can obtain the extracted pattern and color pattern as texture information.

[0105] FIG. 7 is a flowchart illustrating an operating method of an electronic device according to another embodiment of the present disclosure.

[0106] Referring to FIG. 7, the processor (190) of the electronic device (100) obtains 2D clothing shape information for clothing to be worn by the target avatar (S701).

[0107] In one embodiment, the 2D costume shape information may include information about a 2D costume image created based on a reference avatar.

[0108] The 2D garment shape information may include one or more of the vertices, lines, and sewing pairs of each of the multiple garment parts that make up the garment.

[0109] 2D clothing shape information can be stored in memory (130). The 2D clothing shape information can include a plurality of 2D clothing template sets.

[0110] Each of the multiple 2D costume template sets may include multiple 2D costume templates.

[0111] The processor (190) can obtain meta information of a 2D costume image from a 2D costume image and obtain a plurality of 2D costume templates matching the meta information from the memory (130).

[0112] Each of the plurality of 2D garment templates may include one or more of a vertex, a line, or a sewing pair of each of the plurality of garment parts that make up the garment.

[0113] FIG. 8 is a drawing illustrating 2D clothing templates according to one embodiment of the present disclosure.

[0114] Referring to FIG. 8, a plurality of 2D costume templates (810 to 850) are illustrated.

[0115] The plurality of 2D clothing templates (810 to 850) may be templates representing specific types of shirts.

[0116] Each of the plurality of 2D garment templates (810 to 850) may include a plurality of vertices, lines connecting two vertices, and a plurality of sewing indicators.

[0117] Each sewing indicator is assigned a number. The same number can be used as an identification number to link templates, forming a sewing pair.

[0118] For example, a sewing indicator corresponding to No. 1 of the first 2D garment template (810) and a sewing indicator corresponding to No. 1 of the second 2D garment template (820) can be connected to each other to form one sewing pair.

[0119] Again, Figure 7 is explained.

[0120] The processor (190) of the electronic device (100) adjusts the size of the 2D clothing to fit the target avatar using the acquired 2D clothing shape information (S703).

[0121] The processor (190) can adjust the size of a 2D costume made with an original avatar to fit the size of a target avatar using 2D costume shape information.

[0122] A target avatar is an avatar that operates on a platform that provides metaverse services.

[0123] The processor (190) can extract a plurality of first anchor points that identify the shape of the original avatar from the original avatar.

[0124] Each of the plurality of first anchor points may be any of the vertices of the template illustrated in FIG. 8 or any of the points where the sewing indicator is located.

[0125] The processor (190) can extract a plurality of second anchor points that identify the shape of the target avatar from the target avatar.

[0126] Each of the plurality of first anchor points and each of the plurality of second anchor points may correspond to each other according to a body part.

[0127] The processor (190) can adjust the size of a 2D costume created with the original avatar so that each of the plurality of first anchor points matches its corresponding second anchor point.

[0128] The process of adjusting the size of a 2D costume made with an original avatar to fit the size of a target avatar using 2D costume shape information can be called auto fitting.

[0129] The processor (190) of the electronic device (100) positions a 2D costume whose size is adjusted to fit the shape of the target avatar (S705).

[0130] The processor (190) can position a 2D costume with adjusted size on a part of the body of the target avatar.

[0131] The processor (190) of the electronic device (100) converts a 2D costume located on the target avatar into a 3D costume based on the target avatar (S707).

[0132] The processor (190) can simulate 2D costumes and convert them into 3D costumes.

[0133] The processor (190) can simulate a 2D costume as a triangle-shaped mesh to generate a 3D costume in a triangle shape.

[0134] The processor (190) can generate a 3D costume in the shape of a triangle or a 3D costume based on a square-shaped mesh.

[0135] The processor (190) can convert a triangular 3D costume into a square-based 3D costume when a square mesh is used on the target platform where the target avatar is used.

[0136] The processor (190) can generate a square-based 3D costume through quad transformation of a triangle-based 3D costume in a three-dimensional space.

[0137] Afterwards, the processor (190) can generate a 3D costume to be worn on the target avatar through stitching work and mesh counting work on the square-based 3D costume.

[0138] FIGS. 9 to 11 are drawings detailing a process of converting a 2D costume of an original avatar into a 3D costume of a target avatar according to one embodiment of the present disclosure.

[0139] Referring to FIG. 9, the processor (190) may include a size adjuster (910), a garment positioner (920), a 3D simulator (930), and a quad converter (940).

[0140] The size adjuster (910) can adjust the size of the 2D costume based on the shape information of the 2D costume (911) produced based on the original avatar (910) of FIG. 10 and the shape of the target avatar (920).

[0141] The size controller (910) can extract a plurality of first anchor points from the shape information of the 2D costume (911) and extract a plurality of second anchor points from the shape of the target avatar (920).

[0142] The size adjuster (910) can adjust the size of each body part corresponding to the 2D costume by comparing each of the plurality of first anchor points and the plurality of second anchor points, thereby obtaining a 2D costume (921) that fits the size of the target avatar (920).

[0143] The clothing positioner (920) can position a 2D clothing (921) whose size has been adjusted on a body part of the target avatar (920). Since the 2D clothing (921) is a shirt, the 2D clothing (921) can be positioned on the upper body of the target avatar (920).

[0144] The 3D simulator (930) can create a triangle-based 3D costume using a triangle mesh for a 2D costume (921) located on a target avatar (920).

[0145] The quad converter (940) can convert a triangle-based 3D garment into a square-based 3D garment (930) using a square mesh.

[0146] The process of converting a 2D costume adjusted to the size of a target avatar into a 3D costume is described with reference to Fig. 11.

[0147] Referring to FIG. 11, a 2D partial costume (1120) corresponding to the wrist portion (1110) of the target avatar (1100) is illustrated.

[0148] The 2D partial costume (1120) may be composed of multiple triangles.

[0149] The processor (190) can calculate the center of mass of each triangle using the center of mass coordinate system.

[0150] The processor (190) can obtain the calculated center of mass as a corresponding point of the triangular mesh and the quadrilateral mesh.

[0151] The processor (190) can generate a triangle-based 3D partial garment (1130) composed of triangle meshes from a 2D partial garment (1120).

[0152] The processor (190) can use the calculated center of mass points (corresponding points) to convert the triangle-based 3D partial costume (1130) into a square-based 3D partial costume (1150) composed of a square mesh.

[0153] The processor (190) can interpolate a plurality of triangular meshes into a plurality of rectangular meshes using the calculated center of mass points.

[0154] After interpolation, the processor (190) can generate a target avatar wearing a 3D costume.

[0155] According to one embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

[0156] The electronic device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

Claims

1. In electronic devices, A memory storing a plurality of 2D costume template sets, each of the plurality of 2D costume template sets including a plurality of 2D costume templates; and A processor comprising: a processor for obtaining meta information of a 2D costume image, obtaining a plurality of 2D costume templates matching the meta information from the memory, generating a 3D reference costume by combining the obtained plurality of 2D costume templates, and generating a 3D costume by using texture information included in the 3D reference costume and the meta information. Electronic devices.

2. In paragraph 1, The above meta information is Contains information on the type of clothing and characteristics of clothing corresponding to the 2D clothing image, The above feature information is Contains at least one of the attribute information, material information, or part information of the above clothing Electronic devices.

3. In paragraph 2, The above processor Extracting the plurality of 2D clothing templates matching the type of clothing and the part information from the memory Electronic devices.

4. In paragraph 3, The above texture information is Including the above property information and the above material information, The above processor The 3D costume is created by reflecting the above property information and the above material information on the above 3D reference costume. Electronic devices.

5. In paragraph 3, The above processor Calculate the similarity between the type of the above clothing and the part information and each of the plurality of 2D clothing templates corresponding to the type of the above clothing, Obtaining 2D clothing templates with a similarity greater than a certain value Electronic devices.

6. In paragraph 1, The above processor Obtaining the meta information from the 2D clothing image through a model learned through a deep learning algorithm Electronic devices.

7. In electronic devices, Memory that stores shape information for the 2D costume of the original avatar; and A processor that adjusts the size of the 2D clothing to fit the size of the target avatar using the above shape information, positions the 2D clothing with the adjusted size to fit the shape of the target avatar, and converts the positioned 2D clothing into a 3D clothing to fit the target platform of the target avatar. Electronic devices.

8. In paragraph 7, The above processor Extracting a plurality of first anchor points that identify the shape of the original avatar from the original avatar, Extracting a plurality of second anchor points that identify the shape of the target avatar from the target avatar, Adjusting the size of the 2D garment so that each of the plurality of first anchor points matches its corresponding second anchor point. Electronic devices.

9. In paragraph 8, The above processor Generating a triangle-based 3D costume using a triangle mesh from the 2D costume located on the shape of the target avatar Electronic devices.

10. In paragraph 9, The above processor The above triangle-based 3D costume creates a square-based 3D costume using a square mesh. Electronic devices.

11. In paragraph 10, The above processor Calculating the center of mass of each of the plurality of triangles that constitute the 2D costume, obtaining the calculated center of mass as a corresponding point between the triangle mesh and the square mesh, and converting the triangle-based 3D costume into the square-based 3D costume using the obtained corresponding points. Electronic devices.

12. In paragraph 7, The above format information is Contains the vertices of the 2D garment template, the lines connecting the vertices, and the stitching pairs. Electronic devices.

Citation Information

Patent Citations

  • Virtual fitting apparatus and method using digital surrogate

    KR101508161B1

  • Method and apparatus for creating 3D cloth

    KR101808726B1

  • Method and system for generating an image file of a 3D garment model on a 3D body model

    KR1020180069786A

  • System and method for protecting unique information

    KR1020240175879A

  • Image to item mapping

    US20170309075A1