Apparel image generating system, method thereof, and program therefor

Abstract

To realize a service for easily generating an apparel image.SOLUTION: According to an embodiment of the present invention, an apparel image generating system has: a display unit for displaying a selected screen for which a user can select at least one of a model image, an item image, a background image, a face image and a pose image; and an image generating unit for using an image generation model to generate an apparel image from the image selected by the user.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to an apparel image generation system, method, and program. [Background technology]

[0002] In recent years, methods have been proposed for generating appartment images using AI.

[0003] For example, Cited Document 1 discloses a method including the steps of initializing a multi-layer neural network having a reduced topology input section that generates Z vectors and an augmented topology output section that generates a synthesized image based on the Z vectors, and training the multi-layer neural network with training datasets, each training dataset comprising: i) a first training image showing a first item of apparel; ii) two second training images showing two views of a second, different item of apparel; and iii) training target images showing a model wearing the first item of apparel and the second, different item of apparel, the training step being for generating a trained image synthesis network, and the method including: initializing an instance dataset to the training dataset; The method includes providing an instance dataset comprising: I) a first instance image showing a first instance item of apparel; and II) two second instance images showing two views of a second, different instance item of apparel; and obtaining an instance Z vector from the reduced topology input section based on the instance dataset; and exporting a composite instance image from the augmented topology output section based on the instance Z vector; wherein the composite instance image appears to show a model wearing the first instance item of apparel and the second instance item of apparel. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2022-534082 Summary of the Invention [Problem to be solved by the invention]

[0005] However, there were no services that specialized in generating apparel images, so apparel images had to be created manually, which required a lot of effort.

[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to realize a service that allows apparel images to be easily generated. [Means for solving the problem]

[0007] According to one embodiment, the apparel image generation system includes a display unit that displays a selection screen on which a user can select at least one of a model image, an item image, a background image, a face image, and a pose image, and a generation unit that generates an apparel image from the image selected by the user using an image generation model. [Effects of the Invention]

[0008] According to one embodiment, a service that allows apparel images to be easily generated can be realized. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an apparel image generation system 1000. [Figure 2] 1 is a diagram illustrating an example of a hardware configuration of an apparel image generation device 1. FIG. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a user terminal 2. [Figure 4] 1 is a diagram illustrating an example of a functional configuration of an apparel image generating device 1. FIG. [Figure 5]FIG. 2 is a diagram illustrating an example of the functional configuration of a user terminal 2. [Figure 6] FIG. 10 is a diagram illustrating an example of relationship information. [Figure 7] FIG. 10 is a diagram showing an example of a selection screen sc. [Figure 8] FIG. 10 is a diagram showing an example of a selection screen sc. [Figure 9] FIG. 10 is a diagram showing an example of a selection screen sc. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. Note that, in the description of the specification and drawings relating to each embodiment, components having substantially the same functional configuration are designated by the same reference numerals, and redundant description will be omitted.

[0011] <System configuration> First, an overview of the apparel image generation system 1000 according to this embodiment will be described. The apparel image generation system 1000 is an information processing system that provides a service that allows users to easily generate apparel images.

[0012] Apparel images are images that apparel businesses post as product images on e-commerce sites or catalogs, or use in advertising. Specifically, apparel images are images of people wearing items. Items are any wearable products sold by apparel businesses. Examples of items include, but are not limited to, clothes, shoes, accessories, glasses, miscellaneous goods, or bags.

[0013] FIG. 1 is a diagram showing an example of the configuration of an apparel image generation system 1000. As shown in FIG. 1, the apparel image generation system 1000 includes an apparel image generation device 1 and a user terminal 2, which are communicably connected to each other via a network N. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination of these. In the example of FIG. 1, the apparel image generation system 1000 includes one apparel image generation device 1 and one user terminal 2, but may include multiple of each.

[0014] The apparel image generation device 1 is an information processing device that generates an apparel image in response to a request from a user terminal 2. The apparel image generation device 1 is, for example, but is not limited to, a PC (Personal Computer), a smartphone, a tablet terminal, a server device, or a microcomputer. In the example of FIG. 1, the apparel image generation device 1 is a single information processing device, but may also be realized as a system consisting of multiple information processing devices connected via a network N.

[0015] The user terminal 2 is an information processing device used by a user of the apparel image generation system 1000. The user terminal 2 is, for example, but not limited to, a PC, a smartphone, or a tablet terminal. The user is any person who generates apparel images using the apparel image generation system 1000, for example, but not limited to, an employee of an apparel business or an employee of a business that has been commissioned by an apparel business to generate apparel images.

[0016] <Hardware Configuration of Apparel Image Generation Device 1> Next, we will explain the hardware configuration of the apparel image generation device 1. Fig. 2 is a diagram showing an example of the hardware configuration of the apparel image generation device 1. As shown in Fig. 2, the apparel image generation device 1 includes a processor 101, a memory 102, a storage 103, a communication I / F 104, an input device 105, an output device 106, and a drive device 107, which are connected to each other via a bus B1.

[0017] The processor 101 controls each component of the apparel image generation device 1 and realizes the functions of the apparel image generation device 1 by expanding into the memory 102 and executing various programs, including an OS (Operating System) and an apparel image generation program, stored in the storage 103. The processor 101 is, for example, but not limited to, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), or a DSP (Digital Signal Processor).

[0018] The memory 102 is, for example, a read-only memory (ROM), a random access memory (RAM), or a combination thereof. The ROM is, for example, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a combination thereof. The RAM is, for example, but not limited to, a dynamic random access memory (DRAM) or a static random access memory (SRAM).

[0019] The storage 103 stores various programs and data, including an OS and an apparel image generation program. The storage 103 is, for example, but not limited to, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a storage class memory (SCM).

[0020] The communication I / F 104 is an interface for connecting the apparel image generation device 1 to an external device via the network N and controlling communication. The communication I / F 104 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0021] The input device 105 is a device for inputting information to the apparel image generation device 1. The input device 105 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a photographing device (camera), various sensors, or an operation button, but is not limited to these.

[0022] The output device 106 is a device for outputting information from the apparel image generation device 1. The output device 106 is, for example, a display device (display), a projector, a printer, a speaker, or a vibrator, but is not limited to these.

[0023] The drive device 107 is a device that reads and writes data from and to the recording medium 108. The drive device 107 is, for example, but not limited to, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or an SD card reader. The recording medium 108 is, for example, but not limited to, a CD (Compact Disc), a DVD (Digital Versatile Disc), an FD (Floppy Disk), an MO (Magneto-Optical disk), a BD (Blu-ray (registered trademark) Disc), a USB (registered trademark) memory, or an SD card.

[0024] In this embodiment, the apparel image generation program may be written to memory 102 or storage 103 during the manufacturing stage of the apparel image generation device 1, or may be provided to the apparel image generation device 1 via network N, or may be provided to the apparel image generation device 1 via a non-transitory computer-readable recording medium such as recording medium 108.

[0025] <Hardware configuration of user terminal 2> Next, we will explain the hardware configuration of the user terminal 2. Fig. 3 is a diagram showing an example of the hardware configuration of the user terminal 2. As shown in Fig. 3, the user terminal 2 includes a processor 201, a memory 202, a storage 203, a communication I / F 204, an input device 205, and an output device 206, which are interconnected via a bus B2.

[0026] The processor 201 controls each component of the user terminal 2 and realizes the functions of the user terminal 2 by expanding into the memory 202 and executing various programs, including the OS and apparel image generation program, stored in the storage 203. The processor 201 is, for example, but is not limited to, a CPU, an MPU, a GPU, an ASIC, or a DSP.

[0027] The memory 202 is, for example, a ROM, a RAM, or a combination thereof. The ROM is, for example, a PROM, an EPROM, an EEPROM, or a combination thereof. The RAM is, for example, but not limited to, a DRAM or an SRAM.

[0028] The storage 203 stores various programs and data, including the OS and the apparel image generation program. The storage 203 is, for example, a flash memory, an HDD, an SSD, or an SCM, but is not limited to these.

[0029] The communication I / F 204 is an interface for connecting the user terminal 2 to an external device via the network N and controlling communication. The communication I / F 204 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0030] The input device 205 is a device for inputting information to the user terminal 2. The input device 205 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a photographing device (camera), various sensors, or an operation button, but is not limited to these.

[0031] The output device 206 is a device for outputting information from the user terminal 2. The output device 206 is, for example, but is not limited to, a display device (display), a projector, a printer, a speaker, or a vibrator. The user terminal 2 includes a display device 206D as the output device 206.

[0032] In this embodiment, the apparel image generation program may be written to memory 202 or storage 203 during the manufacturing stage of the user terminal 2, may be provided to the user terminal 2 via the network N, or may be provided to the user terminal 2 via a non-transitory computer-readable recording medium such as a recording medium 208.

[0033] <Functional Configuration of Apparel Image Generation Device 1> Next, a description will be given of the functional configuration of the apparel image generation device 1. Fig. 3 is a diagram showing an example of the functional configuration of the apparel image generation device 1. As shown in Fig. 3, the apparel image generation device 1 includes a communication unit 11, a storage unit 12, and a control unit 13.

[0034] The communication unit 11 is realized by the communication I / F 104. The communication unit 11 transmits and receives information to and from the user terminal 2 via the network N.

[0035] The storage unit 12 is realized by a memory 102 and a storage 103. The storage unit 12 stores one or more model images 121, one or more item images 122, one or more background images 123, one or more face images 124, one or more pose images 125, one or more apparel images 126, an image generation model 127, and a human body model 128.

[0036] The model image 121 is an image used as a base when generating the apparel image 126, and is an image of a person (model) wearing the clothing. The apparel image 126 is an image generated based on the model image 121. The model image 121 may be prepared in advance, or may be uploaded by the user from the user terminal 2.

[0037] It is preferable that a plurality of categories (types) of model images 121 are prepared, such as images of men, images of women, images of adults, images of children, images of summer clothes, and images of winter clothes, and a plurality of images are prepared for each category. Furthermore, model image 121 may be an image of the whole body, or an image of a part of the body (for example, the upper body, the lower body, etc.).

[0038] The item image 122 is an image of an item that is used when generating the apparel image 126. The apparel image 126 is an image of a person wearing the item of the item image 122. The item image 122 may be prepared in advance or may be uploaded from the user terminal 2 by the user.

[0039] Examples of items include, but are not limited to, clothes, shoes, accessories, glasses, miscellaneous goods, and bags. Clothes include tops, pants, outerwear, suits, underwear, socks, and swimwear. Shoes include leather shoes, sneakers, high heels, pumps, boots, sandals, and geta. Accessories include rings, necklaces, earrings, pierced earrings, ear cuffs, watches, and bracelets. Miscellaneous goods include hats, ties, gloves, masks, belts, and masks.

[0040] It is preferable to prepare a plurality of item images 122 for each item. The item images 122 may be photographs of the items or may be images of the items synthesized using CG.

[0041] The background image 123 is a background image used when generating the apparel image 126. The apparel image 126 is an image in which a person is present in the background of the background image 123. The background image 123 may be prepared in advance or may be uploaded by the user from the user terminal 2.

[0042] It is preferable that a plurality of categories are prepared for the background image 123, such as indoor images (studios, rooms, offices, coffee shops, hotels, etc.) and outdoor images (towns, parks, forests, mountains, oceans, etc.), with a plurality of images prepared for each category. Furthermore, the background image 123 may be a photograph, or may be an image of a non-existent landscape synthesized using CG.

[0043] The face image 124 is an image of a person's face that is used when generating the apparel image 126. The apparel image 126 is an image in which the person's face is the face of the face image 124. The face image 124 may be prepared in advance or may be uploaded from the user terminal 2 by the user.

[0044] It is preferable that a plurality of categories, such as images of men's faces, images of women's faces, images of adults' faces, and images of children's faces, be prepared for each category as the facial images 124. Furthermore, the facial images 124 may be images of the faces of real people such as fashion models, entertainers, and talents, or may be images of the faces of fictitious people generated by AI.

[0045] The pose image 125 is an image of a person posing (posture) and is used when generating the apparel image 126. The apparel image 126 is an image of a person posing as shown in the pose image 125. The pose image 125 may be prepared in advance or may be uploaded by the user from the user terminal 2.

[0046] It is preferable that multiple categories of pose images 125 are prepared, such as images of men's faces, images of women's faces, images of adults' faces, and images of children's faces, with multiple images prepared for each category. Furthermore, pose images 125 may be images of a real person posing, images of a non-existent person generated by AI posing, or images of a human body model 128 (described later) posing.

[0047] The apparel image 126 is an image of a person wearing an item, generated using an image generation model 127 from the model image 121, the item image 122, the background image 123, the face image 124, and the pose image 125.

[0048] The image generation model 127 is a generation AI that generates an apparel image 126 from a model image 121, an item image 122, a background image 123, a face image 124, and a pose image 125. When the model image 121, the item image 122, the background image 123, the face image 124, and the pose image 125 are input, the image generation model 127 outputs the apparel image 126. When an image of a person and an image of an item are input, the image generation model 127 is trained to output an image of the person wearing the item. The image generation model 127 is preferably a multimodal AI that can input not only images but also at least one of parameter values ​​and text. Any generation AI capable of generating images, such as stable diffusion, can be used as the image generation model 127.

[0049] The control unit 13 is realized by the processor 101 reading and executing a program from the memory 102 and working in cooperation with other hardware components. The control unit 13 controls the overall operation of the apparel image generation device 1. The control unit 13 includes an image generation unit 131.

[0050] The image generation unit 131 uses the image generation model 127 to generate an apparel model 126 from the model image 121, item image 122, background image 123, face image 124, and pose image 125 selected by the user.

[0051] Specifically, when one of the prepared model images 121 is selected by the user, the image generation unit 131 inputs the selected model image 121 into the image generation model 127 to generate the apparel image 126. On the other hand, when none of the prepared model images 121 is selected by the user, the image generation unit 131 may generate the apparel image 126 without inputting the model image 121 into the image generation model 127, or may input the model image 121 prepared as a default into the image generation model 127 to generate the apparel image 126. This also applies to the item image 122, the background image 123, the face image 124, and the pose image 125.

[0052] In addition, if the image generation model 127 is a multimodal AI that can input at least one of parameter values ​​and text, the image generation unit 131 may input at least one of parameter values ​​and text to the image generation model 127 to generate the apparel image 126.

[0053] The functional configuration of the apparel image generation device 1 is not limited to the above example. For example, the apparel image generation device 1 may have some of the above functional configuration, with the user terminal 2 having the rest. The apparel image generation device 1 may also have functional configurations other than those described above. Each functional configuration of the apparel image generation device 1 may be realized by software, as described above, or by hardware such as an IC chip, a SoC (System on Chip), an LSI (Large Scale Integration), or a microcomputer.

[0054] <Functional configuration of user terminal 2> Next, we will explain the functional configuration of the user terminal 2. Fig. 3 is a diagram showing an example of the functional configuration of the user terminal 2. As shown in Fig. 3, the user terminal 2 includes a communication unit 21, a storage unit 22, and a control unit 23.

[0055] The communication unit 21 is realized by the communication I / F 204. The communication unit 21 transmits and receives information to and from the user terminal 2 via the network N.

[0056] The storage unit 22 is realized by a memory 202 and a storage 203. The storage unit 22 stores the model image 121, the item image 122, the background image 123, the face image 124, the pose image 125, the apparel model 126, and the human body model 128 received from the apparel image generation device 1.

[0057] The control unit 23 is realized by the processor 201 reading and executing a program from the memory 202 and working in cooperation with other hardware components. The control unit 23 controls the overall operation of the user terminal 2. The control unit 23 includes a display unit 231 and a model control unit 232.

[0058] Display unit 231 displays various screens on display device 206D in response to user operations. Display unit 231 will be described in detail later.

[0059] The model control unit 232 controls the pose (posture) of the human body model 128 in response to the user's operation.

[0060] The functional configuration of the user terminal 2 is not limited to the above example. For example, the user terminal 2 may have some of the above functional configurations and the user terminal 2 may have the rest. The user terminal 2 may also have functional configurations other than those described above. Each functional configuration of the user terminal 2 may be realized by software, as described above, or by hardware such as an IC chip, SoC, LSI, or microcomputer.

[0061] <Learning Process Executed by Apparel Image Generation System 1000> Next, a description will be given of the processing executed by apparel image generation system 1000. Fig. 6 is a flowchart showing an example of the processing executed by apparel image generation system 1000.

[0062] (Step S101) First, a user operates the user terminal 2, logs in to the apparel image generation system 1000 from the user terminal 2, and requests the display of a selection screen sc. The display control unit 231 of the user terminal 2 displays the selection screen sc in response to the user's operation (step S101). The selection screen sc is a screen for the user to select at least one of the model image 121, the item image 122, the background image 123, the face image 124, and the pose image 125.

[0063] (Step S102) When the display unit 231 displays the selection screen sc on the display device 206D, it requests the model image 121, item image 122, background image 123, face image 124, pose image 125, and human body model 128 from the apparel image generation device 1 (step S102).

[0064] (Step S102) In response to a request from the user terminal 2, the apparel image generation device 1 transmits the model image 121, the item image 122, the background image 123, the face image 124, the pose image 125, and the human body model 128 (step S102). The model image 121, the item image 122, the background image 123, the face image 124, the pose image 125, and the human body model 128 transmitted by the apparel image generation device 1 may be different for each user or may be the same for each user.

[0065] (Step S104) When the display unit 231 of the user terminal 2 receives the model image 121, item image 122, background image 123, face image 124, pose image 125, and human body model 128 from the apparel image generation device 1, it displays them on the selection screen sc (step S104).

[0066] (Step S105) Thereafter, the user selects at least one of the model image 121, item image 122, background image 123, face image 124, and pose image 125 on the selection screen sc (step S105). At this time, the user may input at least one of a parameter value and text indicating a preference for generating the apparel image 126. The user may also manipulate the human body model 128 to generate the desired pose image 125.

[0067] (Step S106) When a user operation requests the generation of an apparel image 126, the display unit 231 transmits the selection results of step S105 to the apparel image generation device 1, and requests the generation of the apparel image 126 (step S106). The selection results include the model image 121, item image 122, background image 123, face image 124, and pose image 125 selected by the user. The selection results may also include parameter values ​​and text.

[0068] (Step S107) Upon receiving a request from the user terminal 2 and the selection results, the image generation unit 131 of the apparel image generation device 1 inputs the selection results into the image generation model 127, generates one or more apparel images 126, and stores them in the memory unit 12 (step S107).

[0069] (Step S108) Then, the image generation unit 131 transmits the generated apparel image 126 to the user terminal 2 (step S108).

[0070] (Step S109) When the user terminal 2 receives the apparel image 126, the display unit 231 of the user terminal 2 displays the received apparel image 126 on the selection screen sc (step S109).

[0071] <Selection screen sc> The selection screen sc will now be described. Figures 7 to 9 are diagrams showing an example of the selection screen sc. The selection screen sc shown in the figures includes a model image display area a1, an image selection area a2, and an apparel image display area a3.

[0072] The model image display area a1 includes a preview display area a11 and a change button b1.

[0073] The preview display area all displays a preview of a default model image 121 or a user-selected model image 121. In the example shown in the figure, a model image 121 of a woman wearing a skirt is displayed.

[0074] The change button b1 is a button for changing the model image 121. When the change button b1 is selected by the user, a model image selection area a4 is displayed, as shown in FIG.

[0075] The model image selection area a4 includes a preview display area a41, a candidate display area a42, a category button b7, a text box tb, and a parameter setting area p.

[0076] The preview display area a41 displays a preview of a default model image 121 or a user-selected model image 121. In the example shown in the figure, a model image 121 of a woman wearing a skirt is displayed.

[0077] The candidate display area a42 displays one or more model images 121 that the user can select. In the example of FIG. 8, three female model images 121 are displayed as selectable candidates. The user can select a desired model image 121 from the displayed candidate model images 121. The selected model image 121 is displayed in the preview display areas a11 and a41.

[0078] The category selection button b7 is a button for selecting the category of the model image 121. In the example of FIG. 8, the female and male category selection buttons b7 are displayed, and the female category selection button b7 is selected. Therefore, female model images 121 are displayed in the preview display area a41 and the candidate display area a42. Note that the category of the model image 121 is not limited to female and male, as described above.

[0079] The text box tb is a text box in which text indicating a desired image can be input when generating the apparel image 126. In the example of Fig. 8, "smiling woman" is input. The input text is input to the image generation model 127 as a prompt.

[0080] The parameter setting area p is an area where parameter values ​​can be set that indicate preferences when generating the apparel image 126. In the example of FIG. 8, skin color and height are provided as parameters, which can be set arbitrarily by the user. The parameter values ​​set here are input to the image generation model 127. Note that, as described above, the parameters are not limited to skin color and height, and can also be set arbitrarily, including facial expression, physique, bone structure, body orientation, hairstyle, clothing size, image brightness, image color tone, image size, etc.

[0081] 8, the model image selection area a4 is displayed as an overlay on the selection screen sc, but it may also be displayed as a tab, in a separate window, or within the selection screen sc. Furthermore, the text box tb and the parameter setting area p may be provided outside the model image selection area a4.

[0082] As shown in FIG. 7, the image selection area a2 includes category buttons b2 and b3, a candidate display area a21, an upload button b3, and a create button b4.

[0083] The category button b2 is a button for the user to select a category of image to be selected. In the example of Fig. 7, category buttons b2 for items, faces, backgrounds, and poses are provided, and the item category button b2 is selected.

[0084] The category button b2 is a button for selecting a subcategory of the image selected by the user. In the example of FIG. 7, category buttons b3 for tops, pants, outerwear, dresses, and shoes are provided, and the pants category button b3 is selected. The subcategories selectable with the category button b3 are set according to the categories selectable with the category button b2. For example, male and female may be set as subcategories for faces.

[0085] The candidate display area a21 displays one or more images that the user can select that correspond to the category and subcategory of the image selected by the user. In the example of FIG. 7, since "item" is selected as the category and "pants" as the subcategory, an item image 122 for pants is displayed as a selectable candidate. The user can select a desired item image 122 from the displayed candidate item images 122. In the example of FIG. 7, the upper left item image 122 is selected. The same applies to the face image 123, background image 124, and pose image 125. In other words, the user can select a desired item image 122, face image 123, background image 124, and pose image 125 from the candidates displayed in the candidate display area a21.

[0086] It is possible to select multiple item images 122. For example, it is possible to select one item image 122 for each subcategory. This allows the user to select item images 122 of tops, pants, and shoes, and generate an apparel image 126 wearing these items.

[0087] Furthermore, a human body model may be displayed on the selection screen sc, and the model control unit 232 may control the human body model and change the pose in response to a user's operation on the human body model, thereby making the human body model assume a desired pose, and an image of the human body model assuming that pose may be selected as the pose image 125. This allows the user to freely generate the pose image 125 on the selection screen sc.

[0088] The upload button b3 is a button for the user to upload an image. When the user selects the upload button b3, the user can select an image to upload, and can upload any image as the model image 121, item image 122, face image 123, background image 124, or pose image 125. The uploaded image is saved in the storage unit 12 of the apparel image generation device 1 as one of the model image 121, item image 122, face image 123, background image 124, or pose image 125.

[0089] The generate button b5 is a button for requesting the apparel image generation device 1 to generate an apparel image 126. When the user selects the generate button b5, the display unit 231 of the user terminal 2 transmits the selection result of step S105 in FIG. 6 to the apparel image generation device 1, and requests the generation of the apparel image 126 (step S106).

[0090] As shown in FIG. 9, the apparel image display area a3 includes an apparel image selection area a31 and a button b6.

[0091] The apparel image selection area a31 displays one or more selectable apparel images 126 generated by the apparel image generation device 1. In the example shown in the figure, five apparel images 126 of women wearing pants (trousers) are displayed. Each apparel image 126 has a check box that allows the user to select the apparel image 126, and in the example shown in FIG. 9, the leftmost apparel image 126 is selected.

[0092] The download button b6 is a button for downloading an apparel image 126 selected by the user. When the user selects an apparel image 126 and selects the download button b6, the selected apparel image 126 is downloaded to the user terminal 2 together with information on the model image 121, item image 122, background image 123, face image 124, and pose image 125 used to generate the apparel image 126, and is stored in the storage unit 22. The display unit 231 can display one or more apparel images 126 stored in the storage unit 22 on the display device 206D.

[0093] The display unit 231 may display an editing screen on which the apparel image 126 can be edited. On the editing screen, the user may be able to edit the color and outline of the apparel image 126, may be able to overwrite an image on the apparel image 126, or may be able to generate a new apparel image 126 by changing at least a part of the model image 121, item image 122, background image 123, face image 124, and pose image 125 used to generate the apparel image 126. The user may also be able to select an edited portion of the apparel image 126 by making a selection on the apparel image 126 (for example, clicking on the face portion) or by inputting text (entering "face").

[0094] In this embodiment, an example is described in which the user can select all of the model image 121, item image 122, background image 123, face image 124, and pose image 125, but at least some of the model image 121, item image 122, background image 123, face image 124, and pose image 125 may be selectable.

[0095] For example, if the model (face) of the model image 121 prepared by the user can be used as is, there is no need to make the face image 124 selectable. In this case, the face image 124 is made unselectable, and the model of the model image 121 can be used as the model for the apparel image 126 as is.

[0096] <Summary> As described above, according to this embodiment, an apparel image generation system 1000 can be realized, which includes a display unit 221 that displays a selection screen sc on which a user can select at least one of a model image 121, an item image 122, a background image 123, a face image 124, and a pose image 125, and an image generation unit 131 that uses an image generation model 127 to generate an apparel image 126 from the image selected by the user.

[0097] By using this apparel image generation system 1000, a user can easily generate a desired apparel image 126 simply by selecting an image that the user wants to incorporate into the apparel image 126.

[0098] <Additional Notes> The present embodiment includes the following disclosure.

[0099] (Appendix 1) a display unit that displays a selection screen on which a user can select at least one of a model image, an item image, a background image, a face image, and a pose image; an image generation unit that generates an apparel image from the image selected by the user using an image generation model; An apparel image generation system comprising:

[0100] (Appendix 2) A plurality of item images can be selected. 2. The apparel image generation system according to claim 1.

[0101] (Appendix 3) The display unit displays the apparel image on the selection screen. 2. The apparel image generation system according to claim 1.

[0102] (Appendix 4) The model image is an image of a clothed person. 2. The apparel image generation system according to claim 1.

[0103] (Appendix 5) The model image is uploaded by the user. 2. The apparel image generation system according to claim 1.

[0104] (Appendix 6) The item images include images of clothes, shoes, accessories, glasses, miscellaneous goods, or bags. 2. The apparel image generation system according to claim 1.

[0105] (Appendix 7) the pose image is an image of a person posing, The pose can be changed on the selection screen. 2. The apparel image generation system according to claim 1.

[0106] (Appendix 8) the selection screen allows a parameter value to be set; The parameters include at least one of skin color, height, facial expression, physique, bone structure, body orientation, hairstyle, clothing size, image brightness, image color tone, and image size; The set parameter values ​​are input to the image generation model. 2. The apparel image generation system according to claim 1.

[0107] (Appendix 9) the selection screen allows input of text; The input text is input to the image generation model. 2. The apparel image generation system according to claim 1.

[0108] (Appendix 10) The apparatus further includes a storage unit that stores the apparel image generated by the image generation unit. 2. The apparel image generation system according to claim 1.

[0109] (Appendix 11) Displaying an editing screen on which at least a part of the apparel image stored in the storage unit can be edited 2. The apparel image generation system according to claim 1.

[0110] (Appendix 12) The display unit displays the apparel image stored in the storage unit. 2. The apparel image generation system according to claim 1.

[0111] (Appendix 13) displaying a selection screen that allows a user to select at least one of a model image, an item image, a background image, a face image, and a pose image; generating apparel images from the user-selected images using an image generation model; An apparel image generation method comprising:

[0112] (Appendix 14) displaying a selection screen that allows a user to select at least one of a model image, an item image, a background image, a face image, and a pose image; generating apparel images from the user-selected images using an image generation model; A program that causes a computer to execute the following.

[0113] The embodiments disclosed herein are illustrative in all respects and should not be considered limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. Furthermore, the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0114] 1: Apparel image generation device 2: User terminal 121: Model image 122: Item image 123: Background image 124:Facial image 125: Pose image 126: Apparel images 127: Image generation model 128: Human body model 131: Image generation unit 231: Display section 232: Model control section

Claims

1. a display unit that displays a selection screen on which a user can select at least one of a model image, an item image, a background image, a face image, and a pose image; an image generation unit that generates an apparel image from the image selected by the user using an image generation model; An apparel image generation system comprising:

2. A plurality of item images can be selected. The apparel image generation system according to claim 1 .

3. The display unit displays the apparel image on the selection screen. The apparel image generation system according to claim 1 .

4. The model image is an image of a clothed person. The apparel image generation system according to claim 1 .

5. The model image is uploaded by the user. The apparel image generation system according to claim 1 .

6. The item images include images of clothes, shoes, accessories, glasses, miscellaneous goods, or bags. The apparel image generation system according to claim 1 .

7. the pose image is an image of a person posing, The pose can be changed on the selection screen. The apparel image generation system according to claim 1 .

8. the selection screen allows a parameter value to be set; The parameters include at least one of skin color, height, facial expression, physique, bone structure, body orientation, hairstyle, clothing size, image brightness, image color tone, and image size; The set parameter values ​​are input to the image generation model. The apparel image generation system according to claim 1 .

9. the selection screen allows input of text; The input text is input to the image generation model. The apparel image generation system according to claim 1 .

10. The apparatus further includes a storage unit that stores the apparel image generated by the image generation unit. The apparel image generation system according to claim 1 .

11. Displaying an editing screen on which at least a part of the apparel image stored in the storage unit can be edited The apparel image generation system according to claim 1 .

12. The display unit displays the apparel image stored in the storage unit. The apparel image generation system according to claim 1 .

13. displaying a selection screen that allows a user to select at least one of a model image, an item image, a background image, a face image, and a pose image; generating apparel images from the user-selected images using an image generation model; An apparel image generation method comprising:

14. displaying a selection screen that allows a user to select at least one of a model image, an item image, a background image, a face image, and a pose image; generating apparel images from the user-selected images using an image generation model; A program that causes a computer to execute the following.

Images