Information processing device, control method, and program

Abstract

To present clothing that suitably reproduces an image of a motif.SOLUTION: An information processing apparatus has presentation means that applies, to a wearer model, a clothing model formed on the basis of a costume of a character to be a motif and presents a resultant model, and the information processing apparatus has: first acquisition means that acquires information on the body shape of a wearer; first formation means that forms a first wearer model on the basis of the information on the body shape of the wearer; second acquisition means that acquires information on the body shape and the costume of the character; deformation means that forms a second wearer model by deforming the first wearer model on the basis of the information on the body shape of the character; and second formation means that forms a first clothing model suited to the second wearer model on the basis of the information on the costume of the character. The presentation means presents the second wearer model applied with the first clothing model.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a control method, and a program, and more particularly to a technology for simulating the feeling of wearing clothing. [Background technology]

[0002] There is a technology for generating a 3D avatar that reflects a person's appearance. Patent Document 1 discloses a technology for generating a 3D avatar of a person that reflects the characteristics of the person's skeleton, face, hair, skin color, and clothing based on various images obtained of the person.

[0003] A 3D avatar that reflects the appearance of a person, such as that in Patent Document 1, can be used to check the fit and adjust the size by newly applying a clothing model, for example (Patent Document 2). In particular, in the field of custom-made or handmade clothing, it is difficult to check the fit before or during the production process, so a 3D model of the person who will wear it (wearer) can be used to check the image, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-522536 [Patent Document 2] Japanese Patent Application Publication No. 2020-170394 Summary of the Invention [Problem to be solved by the invention]

[0005] Some custom-made or handmade clothing has a fixed motif, such as clothing (costumes) that imitate the outfits of characters from movies, animations, games, etc. In such cases, the image of the motif may be formed by incorporating the physical characteristics (body shape) of the character. Therefore, if the clothing is simply made to fit the user's body shape, there is a possibility that the image of the motif will not be reproduced when the clothing is worn, depending on the degree of difference between the character's body shape and the wearer's body shape.

[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an information processing device, a control method, and a program for constructing a wearer model that matches the image of a motif. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device having a presentation means for applying a clothing model constructed based on the costume of a motif character to a wearer model and presenting it, and has a first acquisition means for acquiring body type information of the wearer, a first construction means for constructing a first wearer model based on the body type information of the wearer, a second acquisition means for acquiring body type information and costume information of the character, a transformation means for constructing a second wearer model by transforming the first wearer model based on the body type information of the character, and a second construction means for constructing a first clothing model that fits the second wearer model based on the costume information of the character, and is characterized in that the presentation means presents the second wearer model to which the first clothing model has been applied. [Effects of the Invention]

[0008] With this configuration, the present invention makes it possible to create a wearer model that matches the image of the motif. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating the configuration of a support system according to an embodiment and a modification of the present invention. [Figure 2] FIG. 1 is a block diagram illustrating a functional configuration of a support server 100 according to an embodiment and a modification of the present invention. [Figure 3] FIG. 1 is a block diagram illustrating a functional configuration of a client device 200 according to an embodiment and a modification of the present invention. [Figure 4] FIG. 10 is a diagram illustrating a provision screen displayed in relation to the provision of a support service according to an embodiment and a modification of the present invention. [Figure 5] FIG. 1 is a diagram illustrating measurement information according to an embodiment and a modification of the present invention. [Figure 6] FIG. 10 is a diagram illustrating a color adjustment function of the support service according to the embodiment and modified examples of the present invention. [Figure 7] FIG. 1 is a diagram illustrating skin color classification according to an embodiment and a modification of the present invention; [Figure 8] 1 is a flowchart illustrating an example of an image generation process executed by the support server 100 according to the first embodiment of the present invention. [Figure 9] 10 is a flowchart illustrating an example of an image generation process executed by the support server 100 according to the second embodiment of the present invention. [Figure 10] FIG. 10 is a diagram illustrating a provision screen displayed in relation to the provision of a support service according to the second embodiment of the present invention; [Figure 11] 10 is a flowchart illustrating an example of an image generation process executed by the support server 100 according to the third embodiment of the present invention. [Figure 12] FIG. 13 is a diagram illustrating a body shape correction function of a support service according to a ninth modified example of the present invention. [Figure 13] FIG. 10 is a diagram showing an example of the data structure of various information used in the support system according to the embodiment and the modification of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] [Embodiment 1] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] In the embodiment described below, the present invention is applied to a support server, which is an example of an information processing device, capable of presenting a wearer model to which a clothing model configured based on the clothing of a motif character is applied. However, the present invention can be applied to any device capable of creating a wearer model to which a clothing model configured based on the clothing of a motif character is applied. Furthermore, in this specification, the term "character" does not refer to fictional characters in manga, anime, picture books, novels, movies, etc., but also includes real-world characters such as actors, people, animals, and living beings whose appearance is fixed by clothing. Furthermore, a "wearer model" is computer graphics whose appearance is configured to reflect the wearer's appearance (body shape, skin color), and a "clothing model" is computer graphics whose appearance is configured based on the clothing of a motif character.

[0012] <<Support system configuration>> 1 is a diagram showing the configuration of a support system that provides a support service for supporting clothing production according to an embodiment of the present invention. As shown in the figure, the support system includes a support server 100 that executes various processes for the support service, a client device 200 used by a user, and a network 300 that connects these devices so that they can communicate with each other.

[0013] The support service provided by the support system is a service that provides a function of constructing a clothing model to be made and applying it to a wearer model to visualize it in order to support the user in making clothing. More specifically, the support server 100 constructs a clothing model and a wearer model in response to receiving information about the clothing the user wants to make from the client device 200, and realizes a support service that presents the clothing model and the wearer model in a displayable form on the client device 200.

[0014] The support service may be provided in any manner, but in this embodiment, the support service is provided as a Web service. That is, a user can use the support service by accessing a specific website where the support server 100 provides functions using a Web browsing application (hereinafter simply referred to as a browser) executed on the client device 200. Specifically, a user can view a wearer model to which a clothing model corresponding to a desired outfit has been applied by performing the necessary operation input on the website.

[0015] In the following description, to facilitate understanding of the invention, the user of the support service is assumed to be a wearer who wears the created clothing, and the wearer model is assumed to be an avatar associated with the user. That is, the user can check the clothing they wish to create as applied to the avatar associated with the user, and can check the fit and appearance of the clothing when worn by the user at an incomplete stage. For this reason, in the following description, the user of the support service may be referred to as the "wearer." It goes without saying that the user of the support service is not limited to the wearer, but may also include a person who has been requested by the wearer to create clothing.

[0016] The client device 200 may be a general-purpose device equipped with information and communication functions, such as a smartphone or a PC. The network 300 is described as a wide-area network such as the Internet, enabling use by users in various locations in the support system of this embodiment. However, in a case where services are provided in a limited location, such as a clothing store, the network 300 may be a LAN.

[0017] The functional configuration involved in realizing the functions according to the present invention will be further described below with reference to the drawings.

[0018] <Functional configuration of the support server 100> First, the functional configuration of the support server 100 of this embodiment will be described with reference to the block diagram of FIG.

[0019] The control unit 101 is a control device such as a CPU, and controls the operation of each block of the support server 100. Specifically, the control unit 101 reads out the operation program of each block stored in the storage device 102, expands it into the memory 103, and executes it to control the operation of each block.

[0020] The storage device 102 is a non-volatile storage device capable of permanently storing information, such as a ROM or HDD. The storage device 102 stores not only the operation programs of each block possessed by the support server 100, but also information such as parameters required for the operation of each block. The storage device 102 of this embodiment also includes a group of databases (wearer DB 110, characteristic DB 120, character DB 130, and adjustment DB 140) that manage information referenced in various processes. The memory 103 is a volatile storage device, such as a RAM. The memory 103 is used not only as an area for expanding the operation programs of each block and a work area for each function, but also as a storage area for temporarily recording information output by the operation of each block.

[0021] The wearer DB 110 is a database that manages various information (wearer information) about each user (wearer) for the support service of this embodiment. When a user registers to use the support service, wearer information about the user is configured and stored in the wearer DB 110 and managed. For example, as shown in FIG. 13(a), the wearer information may include, in association with a wearer ID 1301 that identifies the wearer, body type information 1302 for specifying the body type of the wearer, skin color information 1303 that indicates the skin color of the wearer, a wearer model 1304 configured for the wearer, and a clothing model 1305 configured for the wearer model. Here, the clothing model 1305 is not limited to one type of clothing, but may include multiple types of clothing configured by the wearer using the support service.

[0022] The characteristic DB 120 is a database that manages information (characteristic information) used to identify the skin color of a wearer. As will be described in detail later, the support service of this embodiment derives the skin color of a user (wearer) based on a captured image of the user. Here, the hue of the user's skin color in the captured image varies depending on the lighting conditions at the time of capturing the image and the conversion characteristics of the imaging device used for capturing the image. Therefore, in order to derive the wearer's true skin color from the captured image, information on the color conversion characteristics for each combination of imaging device and lighting conditions is managed as characteristic information in the characteristic DB 120. For example, as shown in FIG. 13(b), the characteristic information may include conversion characteristics 1313 that indicate how the true color of the subject is converted to appear in the captured image, in association with an imaging device ID 1311 that uniquely identifies the imaging device and an illumination condition ID 1312 that uniquely identifies the illumination condition.

[0023] The character DB 130 is a database that manages information (character information) about each of a plurality of characters that are selectable as motifs in the support service. In the support service of this embodiment, a user can select a character to use as a motif and create a clothing model based on the clothing associated with the character. For this reason, the character information may include, for example, as shown in FIG. 13(c), a character ID 1321 that uniquely identifies the character, associated with profile information 1322 that indicates the name of the character and the title of the work in which the character appears, and clothing information 1323 that indicates the clothing associated with the character.

[0024] The adjustment DB 140 is a database that stores adjustment information, including adjustment parameters referenced in the color adjustment of clothing models, as described below. The overall image (appearance) of a motif is formed by a combination of the color of a character's clothing and the character's skin color. Therefore, differences in skin color between the character and the wearer may prevent the image from being reproduced properly. For this reason, the support service of this embodiment has a function for adjusting the color of the clothing model based on the wearer's skin color when constructing the clothing model, thereby improving the reproducibility of the image. Furthermore, in the field of cosplay, it is customary for a wearer to wear clothing created with a character as the motif and capture an image of themselves wearing the clothing to create a work of art. Therefore, it is preferable that the color of the clothing be adjusted so that the image of the wearer is properly depicted in the captured image. More specifically, it is preferable that the color of the clothing model be adjusted taking into account the imaging conditions (hereinafter referred to as the planned imaging conditions) for the intended imaging of the wearer wearing the clothing. Therefore, in the support service, to enable the user to check such adjustment results, the imaging device to be used for imaging and the lighting conditions at the time of imaging can be set as planned imaging conditions, and adjustment parameters according to the skin color of the wearer are managed for each planned imaging condition. The adjustment information may include, for example, as shown in Fig. 13(d), an adjustment ID 1331 that uniquely identifies the adjustment information, an imaging device ID 1332 that uniquely identifies the imaging device to be used and an illumination condition ID 1333 that uniquely identifies the illumination condition as planned imaging conditions, associated with skin color classification information 1334 that specifies skin color classifications for different adjustments, and adjustment parameters 1335 related to each skin color classification.

[0025] The construction unit 104 constructs various models used in the support service. In this embodiment, the construction unit 104 constructs a wearer model corresponding to each user and a clothing model to be applied to the wearer model. In the support service aspects described below, the various models constructed by the construction unit 104 will be described as 3D models.

[0026] The rendering unit 105 performs rendering processing of the model configured by the configuration unit 104. In the support system of this embodiment, the model is rendered by the support server 100, and the rendering results are sent to the client device 200 and presented to the user via a browser. Therefore, the rendering unit 105 performs rendering processing of the model based on predetermined rendering conditions, and stores the obtained image in the memory 103 as the rendering result.

[0027] The output unit 106 outputs information other than that for presentation purposes regarding the clothing model constructed via the support service. In this embodiment, the output unit 106 outputs information for producing clothing based on the clothing model. Here, the information for producing clothing may include, for example, a pattern for cutting the necessary fabric, information on the fabric to be used, and information on products that can be used for processing. Alternatively, the information output by the output unit 106 may be a wearer model (3D model) to which the clothing model has been applied, a three-dimensional drawing (2D image) constructed based on this, or the like.

[0028] The communication unit 107 is a communication interface with external devices that the support server 100 has. The communication unit 107 communicates information with each client device 200 via the network 300 in the support system of this embodiment.

[0029] In this embodiment, in order to facilitate understanding of the invention, various functions relating to the provision of support services will be described as being realized by the support server 100 alone, but the implementation of the present invention is not limited to this. Various functional configurations may be distributed among multiple devices connected in communication in the support system, and the corresponding functions may be realized by the cooperation of the multiple devices.

[0030] <Functional Configuration of Client Device 200> Next, the functional configuration of the client device 200 of this embodiment will be described with reference to the block diagram of Fig. 3. In the description of the functional configuration of the client device 200, a configuration that realizes the same functions as the configuration of the support server 100 will be indicated with the prefix "client" to clearly distinguish it from the configuration of the support server 100.

[0031] The client control unit 201 is a control device such as a CPU, and controls the operation of each block of the client device 200. Specifically, the client control unit 201 reads out the operation program of each block stored in the client storage device 202, expands it into the client memory 203, and executes it to control the operation of each block.

[0032] The client storage device 202 is a non-volatile storage device capable of permanently storing information, such as a ROM or HDD. The client storage device 202 stores not only the operation programs of each block of the client device 200 but also information such as parameters required for the operation of each block. The client memory 203 is a volatile storage device, such as a RAM. The client memory 203 is used not only as an area for expanding the operation programs of each block and a work area for each function, but also as a storage area for temporarily recording information output by the operation of each block.

[0033] The display control unit 204 controls the display of information via the display unit 210 in the client device 200. The display control unit 204 includes a drawing device such as a GPU or a drawing chip, and performs a predetermined drawing process to generate a screen to be displayed on the display unit 210. Since the support service of this embodiment is provided via a browser, the display control unit 204 generates a screen including display items in the display area of ​​the browser based on information on necessary display elements received from the support server 100. The display unit 210 that realizes the information display is a display device such as a liquid crystal display, and displays the display screen generated by the display control unit 204.

[0034] The operation input unit 205 is a user interface included in the client device 200, such as operation members such as buttons and various sensors. When the operation input unit 205 detects that an operation input has been made to an operation member or that a predetermined sensor output has been obtained, it outputs a control signal corresponding to the operation input to the client control unit 201. The operation input unit 205 may include, for example, a touch detection sensor or a touch panel that detects a touch input made on the display screen of the display unit 210.

[0035] The client communication unit 206 is a communication interface with an external device that the client device 200 has. The client communication unit 206 communicates information with the support server 100 via the network 300 in the support system of this embodiment.

[0036] Service Overview An outline of the support service provided by the support system of this embodiment will be described below. As described above, the support service provides a function for constructing a clothing model adapted to a wearer model and presenting the clothing model after applying it to the wearer model in order to support a user in creating clothing. Therefore, the functions provided by the support service include the functions of constructing a wearer model based on the wearer's physique information, constructing a clothing model based on costume information of a motif character, adjusting the clothing model, and presenting the wearer model in a state in which the clothing model has been applied. Furthermore, the functions provided by the support service further include the function of outputting information for creating clothing corresponding to the constructed clothing model.

[0037] 4(a) shows an example of a provision screen 400 presented in relation to the provision of a support service. The provision screen 400 is a screen received by the client device 200 used by each user and displayed on the display unit 210. The support server 100 generates various display elements required to configure the provision screen 400 and transmits the display elements to the client device 200 via the network 300, thereby realizing the presentation of the display elements.

[0038] The provided screen 400 includes a wearer model image 401 to which a predetermined clothing model has been applied. In the state shown in FIG. 4( a), the wearer model image 401 is presented with the clothing model applied. However, if the clothing model has not yet been configured, the wearer model image 401 may be presented without the clothing model applied. The user can select a character costume to be used as a motif for the clothing model in the wearer model image 401 by operating the clothing menu 402. In the support service of this embodiment, character information related to characters that can be associated with the character DB 130 is managed, and the user can select one character from this information to select the character's costume as a motif. Once the motif character costume is determined, a clothing model is configured to fit the wearer model, and the provided screen 400 displays the wearer model image 401 to which the configured clothing model has been applied.

[0039] <Wearer model configuration functions> First, the configuration function of the wearer model presented on the presentation screen 400 will be described.

[0040] To present the wearing comfort of the clothing in a suitable manner, the wearer model is configured to conform to the wearer's body shape. In this embodiment, the wearer's body shape information is assumed to be measurement information input by the user acquired when using the support service. The measurement information includes circumferences such as neck circumference 501, bust 502, armholes 503, waist 504, mid-hip 505, hips 506, arm circumference 507, elbow circumference 508, and wrist circumference 509, as shown in FIG. 5(a). The measurement information also includes widths such as chest width 511, breast width 512, back width 513, shoulder width 514, and back-shoulder width 515, as shown in FIG. 5(b). 5(c), the measurement information includes length dimensions such as front length 521, bust drop 522, back length 523, back length 524, total back length 525, mid-hip length 526, waist length 527, rise 528, sleeve length 529, and sleeve length 530. When the measurement information is input by the user, the control unit 101 updates the body type information 1302 of the wearer information related to the user managed in the wearer DB 110.

[0041] 5 does not necessarily require input of all of the measurement information. For example, the system may be configured to request input of the dimensions necessary for producing the clothing associated with a motif character costume after the costume has been finalized. That is, once a character has been selected, the system may be configured to request input of measurement information as required information for the body parts that form the character's external characteristics (for example, sleeve length for a character with long arms, or bust for a character with large breasts). Therefore, the construction of a wearer model and the selection of a motif character may be performed in either order.

[0042] The wearer's skin color is reflected in the wearer model so that the contrast between the wearer's skin color and the color of the clothing and the reproducibility of the overall motif image can be confirmed. In this embodiment, information about the wearer's skin color (skin color information) is acquired based on a captured image of the wearer received from the client device 200. More specifically, the control unit 101 analyzes the captured image to detect a person's skin area in the image and determines the wearer's skin color, for example, based on the most frequently occurring pixel value in the skin area. Here, the skin area may be identified, for example, by detecting a person's face area and identifying it based on the face area. Furthermore, how a person's skin color is expressed in a captured image varies depending on the characteristics of the imaging device that captured the image and the lighting conditions at the time of capture. Therefore, the control unit 101 determines the wearer's skin color based on this information. Therefore, the control unit 101 determines the wearer's skin color by correcting the color of the wearer's skin area in the captured image based on the characteristic information of the imaging device and the lighting conditions. The characteristic information of the imaging device and the information on the lighting conditions may be acquired from EXIF ​​information included in the captured image, or may be acquired based on user input. When the control unit 101 determines the skin color of the wearer, it updates the skin color information 1303 of the wearer information related to the user (wearer) managed in the wearer DB 110.

[0043] Note that the skin color of the wearer derived by this method does not strictly represent the natural skin color of the wearer, but represents the skin color of the wearer under the conditions at the time of image capture. For example, if the wearer is wearing makeup such as foundation at the time of image capture, the skin color of the wearer derived by this method represents the skin color under makeup, not the natural skin color.

[0044] When meaningful information is input to the body type information 1302 and skin color information 1303 of the wearer information in this way, the configuration unit 104 can configure a wearer model. The configuration of the wearer model may be executed, for example, when the provision screen 400 shown in FIG. 4(a) is displayed or when the input of the body type information 1302 and skin color information 1303 is completed. The configuration unit 104 configures the wearer model based on the body type information 1302 and skin color information 1303 of the wearer information related to the target user. The wearer model configured by the configuration unit 104 is stored in the wearer model 1304 of the wearer information related to the target user managed in the wearer DB 110.

[0045] <Clothing model composition> Next, a description will be given of the function of constructing a clothing model that is applied to a wearer model and presented on the presentation screen 400. Once a motif character is selected as described above, the construction unit 104 constructs a clothing model that fits the wearer model based on the character information associated with the character and managed in the character DB 130. In this embodiment, the clothing information 1323 of the character information stores a 3D model that represents clothing that fits the character's defined body type. The construction unit 104 constructs a clothing model that fits the wearer model by applying deformations that stretch each part of the 3D model to fit the dimensions of the corresponding part of the wearer. For example, the 3D model defined in the clothing information 1323 has reference points (such as vertices or bone endpoints) that serve as references for stretching and shrinking, and the construction unit 104 moves the reference points according to the corresponding dimensions of the wearer. The construction unit 104 also constructs a clothing model that fits the wearer model by moving other vertices between the reference points to positions that correspond to the positions of the moved reference points. The clothing model configured by the configuration unit 104 is additionally stored in the clothing model 1305 of the wearer information related to the target user and managed in the wearer DB 110.

[0046] <Wearing status notification function> When a wearer model related to the user and a clothing model related to the selected character are configured in this manner, it becomes possible to present a wearer model image 401 wearing the clothing related to the clothing model on the provided screen 400. In the support system of this embodiment, a two-dimensional image generated by drawing a 3D model in the support server 100 is provided to the client device 200 as an element (display element) required for displaying the provided screen 400. Therefore, the drawing unit 105 draws a wearer model to which the clothing model is applied, thereby generating a display element (two-dimensional image) related to the wearer model image 401 and presenting it on the client device 200.

[0047] <Color adjustment function> However, the color scheme used in the 3D model of each character previously stored in the character DB 130 may not create a favorable image when matched with the skin color of the wearer. This is because, when the motif is an existing character, the character's unique image (appearance impression) is already formed by the character's skin color and the color scheme of the character's clothing. For this reason, in the support service of this embodiment, a color-adjusted clothing model is further created by adjusting the color of a clothing model, which is configured only by modifying it to fit the wearer model, to match the wearer's skin color. Hereinafter, a clothing model configured by modifying a pre-existing 3D model for a character will be referred to as the "pre-adjusted clothing model," and a clothing model configured by further adjusting the color of the pre-adjusted clothing model based on the wearer's skin color information will be referred to as the "adjusted clothing model."

[0048] The adjusted clothing model is constructed, for example, in response to an operation input to the color adjustment menu 403 on the provision screen 400 of FIG. 4( a). In the support service of this embodiment, the construction unit 104 adjusts the color of the pre-adjusted clothing model so that the color will create a character-specific image in a planned image capture in which a wearer wears clothing created based on the adjusted clothing model. That is, the construction unit 104 adjusts the color of the pre-adjusted clothing model so that the image of the wearer wearing the clothing will have a color scheme that creates a character-specific image in the captured image obtained by the image capture. Therefore, in this embodiment, the color scheme of the adjusted clothing model is determined not only based on the skin color of the wearer, but also taking into account the imaging conditions (planned imaging conditions) of the actual imaging to be performed.

[0049] When an operation input to the color adjustment menu 403 is accepted, a setting screen 600 is presented, as shown in Fig. 6, which has a setting item 601 for setting the imaging device to be used for imaging and a setting item 602 for setting the lighting conditions during imaging. By setting and confirming these setting items for the planned imaging, the user can perform color adjustments to make the image of the wearer and their clothing in a suitable state in the captured image. Here, the lighting conditions during imaging may be set based on, for example, the location where imaging will be performed (a studio, an event venue, or a facility) and the lighting equipment to be used.

[0050] When the planned imaging conditions are set using these setting items, the control unit 101 acquires adjustment parameters for color adjustment of the unadjusted clothing model from the adjustment information for the planned imaging conditions managed in the adjustment DB 140, and causes the configuration unit 104 to perform color correction using the adjustment parameters. The adjustment parameters are set in advance according to the skin color of the wearer, and in this embodiment, the adjustment parameters differ depending on which skin color classification defined in the skin color classification information 1334 of the adjustment information the wearer's skin color belongs to. More specifically, the adjustment parameters 1335 of the adjustment information include adjustment parameters for each skin color classification defined in the skin color classification information 1334, and the control unit 101 acquires the adjustment parameters defined for the skin color classification corresponding to the wearer. That is, the control unit 101 acquires the adjustment parameters related to the skin color classification to which the wearer's skin color belongs from the adjustment information corresponding to the planned imaging conditions, transmits them to the configuration unit 104, and causes the configuration unit 104 to perform color adjustment of the unadjusted clothing model.

[0051] Here, the skin color classification defined in the skin color classification information 1334 of the adjustment information for one planned imaging condition may be determined by a distribution in a color space, such as that shown in FIG. 7(a). In the example of FIG. 7(a), subspaces defining four types of skin color classifications are defined in a color space represented by three RGB axes. When the RGB values ​​of a wearer's skin color are mapped to the color space, it is determined which subspace the skin color belongs to. Here, each subspace is defined so that similar skin colors under the planned imaging condition are classified into the same skin color classification. Therefore, in the example of FIG. 7(a), the skin color classification information 1334 includes information defining the range of each subspace, and the adjustment parameters 1335 include adjustment parameters (adjustment coefficients) for adjusting the color of the unadjusted clothing model for each subspace, as shown in FIG. 7(b). For example, if the wearer's skin color belongs to subspace B, the color adjustment parameters of the pre-adjusted clothing model applied to the wearer model for that wearer are an R component adjustment coefficient of 0.99, a G component adjustment coefficient of 0.99, and a B component adjustment coefficient of 1.01. The adjustment coefficients are experimentally determined values ​​that adapt the color of the pre-adjusted clothing model to the colors in the skin color classification. Therefore, the construction unit 104 constructs the adjusted clothing model by adjusting the RGB values ​​of each color in the color scheme information used in the pre-adjusted clothing model to values ​​obtained by multiplying the R component, G component, and B component adjustment coefficients, respectively. The adjusted clothing model constructed by the construction unit 104 is additionally stored in the clothing model 1305 of the wearer information related to the target user managed in the wearer DB 110 in a manner that allows it to be distinguished from the pre-adjusted clothing model.

[0052] When the planned image capturing conditions are set in this manner, the display returns from the setting screen 610 to the provision screen 400, and the wearer model image 401 is presented in a state in which the adjusted clothing model has been applied. That is, the drawing unit 105 draws the wearer model to which the adjusted clothing model has been applied, thereby generating display elements related to the wearer model image 401 and presenting them on the client device 200.

[0053] <Output function> Furthermore, the support service of this embodiment can output information for producing clothing corresponding to the clothing models thus constructed (pre-adjustment clothing model and post-adjustment clothing model). The output of information for producing clothing is triggered by receiving an output request from the client device 200. The clothing model to be output may be selectable between the pre-adjustment clothing model and the post-adjustment clothing model. For example, if an output request is received while the color adjustment function is in use, information corresponding to the post-adjustment clothing model may be output, and if an output request is received without the color adjustment function in use, information corresponding to the pre-adjustment clothing model may be output.

[0054] In this embodiment, the information for producing clothing corresponding to a clothing model includes information indicating a fabric corresponding to the color of the clothing model, and information on a pattern for cutting from the fabric.

[0055] Image generation processing Hereinafter, the image generation process for generating display elements (two-dimensional images) to be presented on the client device 200 used by the user in the support server 100 of this embodiment will be specifically described with reference to the flowchart in Fig. 8. The process corresponding to the flowchart can be realized by the control unit 101 reading out a corresponding processing program stored in the storage device 102, for example, and expanding and executing the program in the memory 103. This image generation process will be described as being started when a display request for the provided screen 400 or a display update request for the wearer model image 401 is received from the client device 200 using the support service, for example.

[0056] It is assumed that, prior to execution of this image generation process, a wearer model of the user (target wearer) using the client device 200 and a clothing model of the costume of the motif character (target character) are configured. That is, it is assumed that the wearer information related to the target wearer managed in the wearer DB 110 already stores necessary information in body type information 1302, skin color information 1303, and wearer model 1304. It is also assumed that a clothing model before adjustment related to the target character is stored in clothing model 1305 of the wearer information.

[0057] In S801, the control unit 101 determines whether the color adjustment function is currently being used. The usage status of the color adjustment function may be changed, for example, each time an operation input is made to the color adjustment menu 403 on the display of the provision screen 400. In this case, the control unit 101 updates the value of an adjustment in progress flag (logical type) stored in the memory 103 in response to receiving information from the client device 200 indicating that the operation input has been made, and makes the determination in this step by referencing the adjustment in progress flag. The adjustment in progress flag may, for example, be “True” indicating that the color adjustment function is being used, or “False” indicating that the color adjustment function is not being used, and may be updated to a value different from the current value in response to receiving information indicating that an operation input has been made to the color adjustment menu 403. If the control unit 101 determines that the color adjustment function is being used, the control unit 101 proceeds to S802; if it determines that the color adjustment function is not being used, the control unit 101 proceeds to S807.

[0058] In S802, the control unit 101 determines whether or not the scheduled imaging conditions have been set. If the control unit 101 determines that the scheduled imaging conditions have been set, the process proceeds to S806, and if the control unit 101 determines that the scheduled imaging conditions have not been set, the process proceeds to S803.

[0059] In S803, the control unit 101 accepts the setting of the scheduled imaging conditions. Then, when the scheduled imaging conditions are confirmed, the control unit 101 shifts the processing to S804.

[0060] In S804, the control unit 101 acquires adjustment parameters related to color adjustment of the pre-adjustment clothing model. More specifically, the control unit 101 identifies the skin color classification to which the color indicated in the skin color information 1303 of the wearer information related to the target wearer belongs, based on the skin color classification information 1334 of the adjustment information corresponding to the planned image capturing conditions confirmed in S803. Then, the control unit 101 acquires adjustment parameters related to the identified skin color classification from the adjustment parameters 1335 of the adjustment information.

[0061] In S805, the configuration unit 104 configures an adjusted clothing model by adjusting the color of the pre-adjustment clothing model for the target character using the adjustment parameters acquired in S804 under the control of the control unit 101. The configured adjusted clothing model is stored in the clothing model 1305 of the wearer information for the target wearer.

[0062] In S806, under the control of the control unit 101, the drawing unit 105 draws a wearer model of the target wearer to which the adjusted clothing model related to the target character is applied, and generates a display element (two-dimensional image).

[0063] On the other hand, if it is determined in S801 that the color adjustment function is not in use, the drawing unit 105, under the control of the control unit 101, draws a wearer model of the target wearer to which the pre-adjustment clothing model related to the target character is applied in S807, and generates a display element.

[0064] In S808, the control unit 101 presents the generated display elements to the client device 200 associated with the target wearer, thereby completing the image generation process. More specifically, the control unit 101 transmits the display elements to the communication unit 107 and causes the communication unit 107 to transmit the display elements to the client device 200, thereby presenting the display elements to the client device 200. Note that in the present embodiment, the presentation of the wearer model to which the clothing model has been applied has been described as being realized by rendering the wearer model and providing (transmitting) a generated two-dimensional image, but the present invention is not limited to this. The presentation may also be realized, for example, by constructing a wearer model to which the clothing model has been applied (generating a 3D model by combining the clothing model and the wearer model) and providing the same.

[0065] As described above, the information processing device according to this embodiment can create a clothing model that appropriately reproduces the image of a motif, and can apply it to a wearer model and present it.

[0066] [Variation 1] In the above-described embodiment, the skin color of the wearer is determined by adjusting the color of the skin region in the captured image of the wearer based on the characteristic information of the imaging device and the information on the lighting conditions, but the implementation of the present invention is not limited to this. It goes without saying that, in an aspect where at least one of the imaging device used and the lighting conditions at the time of capturing the captured image is fixed for the captured image captured when determining the skin color information of the wearer, it is not necessary to acquire either or both of the characteristic information of the imaging device and the information on the lighting conditions.

[0067] [Variation 2] In the above-described embodiment and modified examples, the skin color information of the wearer is described as being acquired by analyzing the captured image of the wearer, but the present invention is not limited to this. The skin color information of the wearer may be acquired based on, for example, information specifying the foundation used by the wearer.

[0068] [Variation 3] In the above-described embodiment, input measurement information is used as the wearer's physique information, but the present invention is not limited to this. The wearer's physique information may be obtained, for example, by analyzing a captured image or depth image of the wearer's entire body. The analysis process may include identifying joint positions from an image of the wearer and deriving the distance between the joints based on preset information such as the wearer's height.

[0069] [Variation 4] In the above-described embodiment, the wearer model is configured based on the body shape information of the wearer, but the implementation of the present invention is not limited to this. For example, in an application simply aiming to compare the skin color of the wearer with the color of the clothing, the body shape information of the wearer does not need to be reflected in the wearer model, and a 3D model of a fixed human body shape that reflects only the skin color information of the wearer may be used as the wearer model.

[0070] [Variation 5] In the above-described embodiment, the adjustment parameters for color adjustment to construct the adjusted clothing model are determined based on the skin color classification of the skin color of the wearer, as determined for the scheduled image capture conditions. However, the present invention is not limited to this. For example, instead of the scheduled image capture conditions, adjustment information may be provided for each costume of the motif character and managed in the adjustment DB 140. That is, in this modification, the adjustment information managed in the adjustment DB 140 includes skin color classification information 1334 and adjustment parameters 1335 associated with an adjustment ID 1331 and a costume ID 1341 that uniquely identifies the costume information, as shown in FIG. 13(e). In this case, the adjustment parameters used for color adjustment of the pre-adjusted clothing model may be obtained based on the skin color information of the wearer from the adjustment information associated with the costume information of the target character.

[0071] Note that multiple types of costumes may be provided for the same character. In this case, the costume information 1323 of the character information managed in the character DB 130 includes 3D models corresponding to each of the multiple types of costumes. For example, when a character with multiple pieces of costume information is selected as a motif, the user is further requested to select which costume of the character the user wishes to create. That is, the user is requested to select which of the character's costumes the clothing model to be applied to and presented on the presentation screen 400 corresponds to. After the costume is selected, the construction unit 104 constructs an unadjusted clothing model using one type of 3D model corresponding to the selected costume. When color adjustment is performed, the control unit 101 acquires adjustment parameters by referring to the adjustment information for the selected costume (the costume ID 1341 identifies the costume). In this case, the color adjustment of the unadjusted clothing model is performed not taking into account any planned imaging conditions, but is performed to match the skin color of the wearer so as to form an overall image of the motif under specific imaging conditions.

[0072] In addition, the adjustment information is not limited to information defined for either the planned imaging conditions or the selected costume, but may be information provided for each combination of the type of costume and the planned imaging conditions. That is, the adjustment information may be configured to manage the skin color classification information 1334 and the adjustment parameters 1335 in association with the adjustment ID 1331, the planned imaging conditions (image capture device ID 1332 and lighting condition ID 1333), and the costume ID 1341. In this case, when performing color adjustment, the control unit 101 acquires the adjustment parameters corresponding to the wearer's skin color from the adjustment information related to the planned imaging conditions of the selected costume.

[0073] [Variation 6] In the above-described embodiment and Modification 6, a skin color classification is defined in the skin color classification information 1334 included in the adjustment information, the skin color classification to which the wearer's skin color belongs is identified, and adjustment parameters related to the skin color classification are acquired for constructing an adjusted clothing model. However, the present invention is not limited to this. An LUT (Look Up Table) may be provided that defines adjustment parameters not for each skin color classification but for each skin color of the wearer, and adjustment parameters corresponding to the wearer's skin color may be directly acquired from the LUT.

[0074] [Embodiment 2] In the above-described first embodiment and modifications 1 to 6, it has been described that when color adjustment is performed to match the skin color of the wearer, the wearer model image 401 in a state in which the adjusted clothing model is applied is presented on the provided screen 400. That is, the presentation of the wearer model image 401 is switched between applying the adjusted clothing model to the wearer model representing the skin color of the wearer or applying the unadjusted clothing model, depending on whether the color adjustment function is used. That is, the user can switch on the provided screen 400 between viewing a state in which a clothing model with a color that approximates the overall image of the motif is applied to the wearer model representing the wearer's skin color, and viewing a state in which a clothing model with a color unique to the motif is applied.

[0075] However, the image originally formed by the motif character may be different from the image formed by the wearer model to which the adjusted clothing model has been applied. In other words, if the skin color of the wearer is different from the skin color of the character, the wearer model to which the adjusted clothing model has been applied merely approximates the motif within the range of the wearer's skin color, making it difficult for the user to grasp the difference from the original image.

[0076] For this reason, the support service of this embodiment provides the following presentation switching function during use of the color adjustment function so that the user can grasp the difference between the image originally formed by the motif character and the image formed by a wearer model to which the adjusted clothing model has been applied. The presentation switching function is a function for switching, during use of the color adjustment function, between a presentation in which the adjusted clothing model has been applied to the wearer model shown in embodiment 1, and a presentation in which the pre-adjusted clothing model has been applied to a wearer model showing the character's original skin color. That is, the user can view the wearer model related to the user in two states: (1) a state in which the user's own skin color is displayed and the wearer model is wearing clothing that has been color-adjusted to match the skin color, and (2) a state in which the user's own skin color is displayed and the wearer model is wearing clothing that shows the motif character's original skin color and the color scheme unique to the character's costume.

[0077] For this reason, in the support system of this embodiment, the character information managed in the character DB 130 for each character further includes skin color information 1351 indicating a skin color specific to the character, as shown in Fig. 13(f). Therefore, the configuration unit 104 configures the wearer model for presentation (hereinafter referred to as the motif color wearer model) described in (2) above by changing the skin color of the wearer model based on the skin color information 1351 related to the motif character. The motif color wearer model configured by the configuration unit 104 is stored in the wearer model 1304 of the wearer information related to the target user managed in the wearer DB 110 in a manner separable from the wearer model configured based on the wearer's skin color information.

[0078] Note that the presentation switching may be triggered by an operation input to a unique color scheme display button 411 provided on a presentation screen 400 presented while the color adjustment function is being used, as shown in FIG. 4(b), for example. The unique color scheme display button 411 is a GUI configured to switch its selection state each time an operation input is made. When the button is selected (ON), the unique color scheme display is performed, i.e., a model wearing a motif color to which a pre-adjustment clothing model is applied is presented. When the button is not selected (OFF), the unique color scheme display button 411 does not display the unique color scheme, i.e., a model wearing a motif color to which a post-adjustment clothing model is applied is presented. The selection state of the unique color scheme display button 411 is managed by, for example, a unique color scheme in progress flag (logical type) stored in the memory 103, and the value may be changed each time an operation input is made to the unique color scheme display button 411 on the presentation screen 400. For example, when the unique coloring flag is "True," it indicates that the unique coloring display button 411 is selected and the unique coloring display is performed, and when the flag is "False," it indicates that the unique coloring display button 411 is not selected and the unique coloring display is not performed. Therefore, in response to receiving information from the client device 200 indicating that an operation input has been made to the unique coloring display button 411, the control unit 101 updates the value of the unique coloring flag to a value different from the current value.

[0079] Image generation processing Hereinafter, specific processing will be described with reference to the flowchart in Fig. 9 regarding image generation processing (while using the color adjustment function) for generating display elements (two-dimensional images) to be presented on the client device 200 used by the user in the support server 100 of this embodiment. The processing corresponding to the flowchart can be realized by the control unit 101 reading out a corresponding processing program stored in, for example, the storage device 102, expanding it in the memory 103, and executing it. This image generation processing will be described as being started when, for example, a request to use the color adjustment function while the provided screen 400 is being displayed or a display update request for the wearer model image 401 while using the function is received from the client device 200 using the support service.

[0080] It is assumed that, prior to execution of this image generation process, a wearer model of a user (target wearer) using client device 200, and pre-adjusted and post-adjusted clothing models of the costume of a motif character (target character) have been constructed. That is, it is assumed that the wearer information related to the target wearer managed in wearer DB 110 already stores necessary information in body type information 1302, skin color information 1303, and wearer model 1304. It is also assumed that setting of planned image capture conditions has been completed, and pre-adjusted and post-adjusted clothing models related to the target character have been stored in clothing model 1305 of the wearer information. In the following description, steps that perform the same processes as those in the image generation process of embodiment 1 are denoted by the same reference numerals, and description thereof will be omitted.

[0081] In S901, the control unit 101 determines whether or not to display the unique color scheme. The determination in this step is made by referencing the unique color scheme in progress flag. If the control unit 101 determines that the unique color scheme should be displayed, the process proceeds to S902. If the control unit 101 determines that the unique color scheme should not be displayed, the process proceeds to S806.

[0082] In S902, the control unit 101 determines whether a motif color wearer model has been configured. The determination in this step is made based on whether a motif color wearer model is stored in the wearer model 1304 of the wearer information of the target wearer. If the control unit 101 determines that a motif color wearer model has been configured, it proceeds to S904, and if it determines that a motif color wearer model has not been configured, it proceeds to S903.

[0083] In S903, the configuration unit 104 configures a motif color wearer model by changing the color of the wearer model of the target wearer based on the skin color information 1351 of the character information related to the target character under the control of the control unit 101. The configured motif color wearer model is stored in the wearer model 1304 of the wearer information related to the target wearer.

[0084] In S904, under the control of the control unit 101, the drawing unit 105 draws a motif color wearer model of the target wearer to which the pre-adjustment clothing model related to the target character is applied, and generates a display element (two-dimensional image).

[0085] In this way, it is possible to switch between presenting a wearer model to which the adjusted clothing model has been applied and a motif color wearer model to which the pre-adjustment clothing model has been applied, allowing the user to easily determine whether the motif image is suitably reproduced. In this embodiment, the display elements related to the wearer model image 401 are changed by switching the selection state of the unique color scheme display button 411 on the provision screen 400, thereby allowing the user to grasp the image formed by the wearer model to which the adjusted clothing model has been applied. However, the implementation of the present invention is not limited to this. It is sufficient that the wearer model to which the adjusted clothing model has been applied and the motif color wearer model to which the pre-adjustment clothing model have been applied are presented in a manner that allows them to be compared; for example, both may be presented simultaneously.

[0086] [Variation 7] In the above-described second embodiment, the character information includes skin color information 1351 indicating a skin color specific to the character, and the configuration unit 104 configures a motif color wearer model by referring to the information. However, the present invention is not limited to this. The character's specific skin color may be acquired from a character image indicating the character, which is transmitted from the client device 200.

[0087] Here, the character image may be, for example, an illustration depicting a character in a specific scene or an image of a single frame of video in which a character appears. In this case, the character's image in the character image has a color that is affected by the lighting conditions of the scene. For example, in an illustration depicting a character in a night scene, the character's skin color may be depicted as being bluer than the character's actual skin color. Simply extracting the color of the character's skin area may therefore fail to capture the character's actual skin color. Therefore, in the support service of this embodiment, when a character image is acquired from the client device 200 for character skin color information, the lighting conditions for the character image are also accepted. This setting may involve, for example, selecting a scene depicted in the character image or selecting a lighting color. Alternatively, the control unit 101 may identify the lighting conditions by analyzing the character image.

[0088] Once the character image and the lighting conditions for the character image are set, the control unit 101 corrects the color of the skin area in the character image based on the lighting conditions to estimate the character's original skin color and acquires it for use in constructing a motif color wearer model. This makes it possible to realize the unique color scheme display of the second embodiment even in a case where the skin color information 1351 is not stored in the character DB 130.

[0089] [Variation 8] The color adjustment described in the above-described embodiment and modified example has been described as being performed using adjustment parameters corresponding to the wearer's skin color based on color information (color information) defined in the motif character's clothing information. In this method, the adjustment parameters are determined once the wearer's skin color and the planned imaging conditions, etc., are determined. This limits customization, such as reflecting user preferences in the color adjustment. On the other hand, there is also demand for creating clothing with a user-defined color scheme, such as a color scheme that is brighter than the motif character's original color scheme, a color scheme closer to a specific theme color, monochrome, or an original color scheme. Therefore, the color adjustment function described above may be enabled only when it is determined that color information related to the character's clothing information is to be adopted. If the color information is not to be adopted, an interface may be provided that allows the color of the clothing model to be customized. In other words, the construction of an adjusted clothing model is performed only when a setting is made to adopt predetermined color information in the character's clothing information.

[0090] [Embodiment 3] In the above-described embodiment and modified examples, a clothing model is configured to fit a wearer model configured based on the wearer's physique information, and the clothing model is applied to the wearer model for presentation. However, the present invention is not limited to this. The image (appearance) of a motif character may be formed based on the character's physique. For example, for a muscular / thin character or a character with a large / small chest, the appearance impression (e.g., muscular or large chest) is formed based on the character's physique, not just the costume and its color scheme. Therefore, if the physique of the motif character differs from the physique of the wearer, configuring a clothing model to fit the wearer model will not adequately reproduce the character's appearance, even when the wearer wears clothing created based on the clothing model. Such a difference in physique is not limited to cases where the character's physique has distinctive features. It can also occur, for example, when a female wearer wears a male character's clothing (cross-dressing) or when a male wearer wears a female character's clothing (cross-dressing). In order to absorb the discrepancy between the character's and the wearer's body shape, some wearers use body-shaping materials such as padding, shapewear, and artificial body parts to enhance the reproducibility of the character's appearance.

[0091] On the other hand, when using body-shaping components, the wearer's body shape will naturally differ from their original body shape, so the wearer must obtain the necessary body-shaping components, take measurements while wearing them, create a clothing pattern, and then begin production. This increases the number of steps required for clothing production, which can be difficult for inexperienced wearers. In other words, if the body shape of the desired character differs from the wearer's own body shape, the wearer may abandon the creation and wearing of clothing based on that character. For this reason, the support service of this embodiment further provides a function for creating a wearer model that matches the image of the motif and a clothing model that matches the wearer model.

[0092] Body shape correction function Hereinafter, a body shape correction function provided in the support service of this embodiment will be described, which transforms a wearer model into a form corresponding to the body shape of a motif character and configures a new wearer model (hereinafter referred to as a body shape-corrected wearer model). In the support system of this embodiment, the character information managed in the character DB 130 for each character further includes body shape information 1361 indicating the body shape of the character, as shown in FIG. 13(g). Therefore, on the condition that a motif character has been selected, the configuration unit 104 transforms the wearer model configured based on the body shape information of the wearer based on the body shape information 1361 of the character information related to the character, and configures a body shape-corrected wearer model.

[0093] The body type information 1361 related to the character is configured to include information on the dimensions of multiple body parts that make up the character. The information on the dimensions of multiple body parts holds values ​​corresponding to the character for at least some of the measurement points of the wearer described with reference to FIG. 5. Here, the body parts whose dimension information is included in the body type information 1361 are assumed to include at least body parts that are characteristic in forming the impression of the character's appearance. For example, in the case of a muscular character, the body type information 1361 may include at least the dimensions of the neck circumference, bust, armholes, waist, arm circumference, elbow circumference, chest width, back width, shoulder width, back-shoulder width, and back height, which are characteristic body parts.

[0094] The provision screen presented in connection with the provision of the support service of this embodiment may be, for example, the one shown in Fig. 10(a). Similar to the provision screen 400, the provision screen 1000 is a screen on which necessary information is received in the client device 200 used by each user and displayed on the display unit 210. The support server 100 generates various display elements required to configure the provision screen 1000 and transmits the display elements to the client device 200 via the network 300, thereby realizing the presentation of the display elements.

[0095] FIG. 10(a) shows an example of a provided screen 1000 displayed with a motif character (and costume) selected, and a wearer model image 1001 to which a clothing model related to the character's costume is applied is presented. In addition, a character image related to the selected character is arranged in the upper right corner of the provided screen 1000, allowing the user to refer to the image that the character originally formed. The user can change the character's costume as the motif by performing an operation input to a costume menu 1003.

[0096] Furthermore, by performing an operation input on the body shape correction menu 1004, the user can change the wearer model image to a presentation mode (wearer model image 1011) that reflects the body shape information of the motif character, as in the provided screen 1010 shown in FIG. 10(b). Whether the wearer model image is a display element drawn using a wearer model corresponding to the body shape of the wearer or a body-corrected wearer model corresponding to the body shape of the character may be managed, for example, by a body shape correction flag (logical type) stored in the memory 103. That is, whether the provided screen 1000 shown in FIG. 10(a) or the provided screen 1010 shown in FIG. 10(b) is presented is managed by the body shape correction flag. When the body shape correction flag is "True," for example, it indicates that a display element (wearer model image 1011) drawn using a body-corrected wearer model is presented. Furthermore, when the body shape correction flag is "false," it indicates that a display element (wearer model image 1001) drawn using a wearer model is presented. The value of the body shape correction flag may be changed every time an operation input is made to the body shape correction menu 1004 on the provision screen 1000 or the provision screen 1010. Therefore, in response to receiving information indicating that an operation input has been made to the body shape correction menu 1004 from the client device 200, the control unit 101 updates the value of the body shape correction flag to a value different from the current value.

[0097] <Deformation Overview> Here, the configuration of the body-corrected wearer model used to draw the provided screen 1010 when the provided screen 1010 is presented, i.e., the deformation of the wearer model, will be described in detail. In this embodiment, the deformation of the wearer model is performed by adjusting the dimensional ratio between multiple parts constituting the wearer model to the dimensional ratio between the same parts defined in the body type information of the character. To make it easier to understand the outline of the deformation, the following description will be given taking as an example an example a mode in which dimensions are defined for four types of parts, namely height, bust, waist, and hips, as the body type information of the wearer and the body type information of the character.

[0098] For example, the wearer's body shape information and the character's body shape information are Assume that the dimensions are defined as follows: JPEG0007792804000001.jpg82155. In this case, in order to express the character's body shape in the scale of the wearer, firstly each dimension of the character's body shape information is converted to a value that matches the wearer's height. In the above numerical example, the wearer's height is 160cm and the character's height is 144cm, so each dimension of the character's body shape information is 160cm / 144cm=10 / 9 times is converted to the value JPEG0007792804000002.jpg54149. Therefore, the construction unit 104 constructs a body-corrected wearer model by transforming the bust, waist, and hip dimensions of the wearer model so that they match the dimensions of the corresponding parts in the body type information of the converted character. More specifically, the body-corrected wearer model is constructed by transforming the part of the wearer model corresponding to the bust from 75 cm to 90 cm, the part corresponding to the waist from 55 cm to 57.8 cm, and the part corresponding to the hips from 78 cm to 87.8 cm.

[0099] Here, since each dimension of the character after conversion is a value obtained by multiplying the dimension specified in the character's body type information by 10 / 9, the ratio of dimensions between each part remains unchanged. That is, for example, the ratio of height to bust (81 / 144), height to waist (52 / 144), and height to hip (79 / 144) are maintained even after conversion. Therefore, the body-corrected wearer model obtained by performing transformations to match each dimension of the converted character has the same ratio of dimensions between the same parts as the character's body type information.

[0100] In this way, by modifying the dimensions of the multiple parts constituting the wearer model configured based on the body shape information of the wearer based on the body shape information of the motif character, it is possible to configure a body shape corrected wearer model whose shape is closer to that of the character. The configured body shape corrected wearer model is additionally stored in the wearer model 1304 of the wearer information related to the target user managed in the wearer DB 110 in a manner that allows it to be identified as the wearer model.

[0101] Furthermore, a clothing model configured to fit the wearer model (hereinafter referred to as a pre-correction clothing model) does not fit the body-corrected wearer model. Therefore, when the configuration unit 104 configures a body-correction wearer model, it configures a new clothing model (hereinafter referred to as a post-correction clothing model) that fits the body-correction wearer model. The configured post-correction clothing model is similarly added to and stored in clothing model 1305 of the wearer information related to the target user in a manner that allows it to be distinguished from the pre-correction clothing model.

[0102] <<Body shape correction material suggestion function>> Furthermore, when producing and wearing clothing corresponding to the corrected clothing model, the wearer's body shape needs to be changed to a shape corresponding to the body-corrected wearer model. Therefore, when outputting information for producing clothing corresponding to the corrected clothing model, the output unit 106 of this embodiment outputs information about body-correcting components for adjusting the wearer's body shape to that of the body-corrected wearer model. The information about the body-correcting components may include, for example, information about products to be used for body correction. The information about the body-correcting components may be stored in, for example, a database (not shown) included in the storage device 102. For example, the output unit 106 may identify the body-correcting components to be used based on the difference between the body-corrected wearer model and the wearer model, and output the information.

[0103] Image generation processing Hereinafter, the image generation process for generating display elements (two-dimensional images) to be presented on the client device 200 used by the user in the support server 100 of this embodiment will be specifically described with reference to the flowchart in Fig. 11. The process corresponding to the flowchart can be realized by the control unit 101 reading out a corresponding processing program stored in the storage device 102, for example, and expanding and executing the program in the memory 103. This image generation process will be described as being started when a display request for the provided screen 1000 or the provided screen 1010 or a display update request for the wearer model image is received from the client device 200 using the support service, for example.

[0104] It is assumed that, prior to execution of this image generation process, a wearer model of the user (target wearer) using the client device 200 and a pre-correction clothing model of the costume of the motif character (target character) are configured. That is, it is assumed that the wearer information related to the target wearer managed in the wearer DB 110 already stores necessary information in body shape information 1302, skin color information 1303, and wearer model 1304. It is also assumed that a pre-correction clothing model of the target character is stored in clothing model 1305 of the wearer information. In addition, in the image generation process of this embodiment, processing related to the use of the color adjustment function is omitted to clarify the characteristics of the processing related to the use of the body shape correction function.

[0105] In S1101, the control unit 101 determines whether or not to perform body shape correction in accordance with the body shape information of the character. The determination in this step is made by referencing the body shape correction flag. If the control unit 101 determines that body shape correction should be performed, the process proceeds to S1102, and if it determines that body shape correction should not be performed, the process proceeds to S1106.

[0106] In S1102, the control unit 101 determines whether a body-corrected wearer model has been configured. The determination in this step is made based on whether a body-corrected wearer model is stored in the wearer model 1304 of the wearer information of the target wearer. If the control unit 101 determines that a body-corrected wearer model has been configured, it proceeds to S1105, and if it determines that a body-corrected wearer model has not been configured, it proceeds to S1103.

[0107] In S1103, the configuration unit 104 configures a body-type corrected wearer model by transforming the wearer model of the target wearer based on body type information 1361 of the character information related to the target character under the control of the control unit 101. The configured body-type corrected wearer model is stored in the wearer model 1304 of the wearer information related to the target wearer.

[0108] In S1104, the configuration unit 104 configures a corrected clothing model that fits the body-corrected wearer model configured in S1103, based on the clothing information 1323 of the character information related to the target character, under the control of the control unit 101. The configured corrected clothing model is stored in the clothing model 1305 of the wearer information related to the target wearer.

[0109] In S1105, under the control of the control unit 101, the drawing unit 105 draws a body-corrected wearer model of the target wearer to which the corrected clothing model related to the target character has been applied, and generates a display element (two-dimensional image).

[0110] On the other hand, if it is determined in S1101 that no body shape correction will be performed, the drawing unit 105, under the control of the control unit 101, draws a wearer model of the target wearer by applying the pre-correction clothing model related to the target character in S1106, and generates display elements.

[0111] In S1107, the control unit 101 presents the generated display elements to the client device 200 associated with the target wearer, and completes this image generation process.

[0112] In this way, a post-correction clothing model can be constructed that matches a body-corrected wearer model that reflects the body shape of the motif character, allowing the user to confirm the wearing comfort and appearance impression. Furthermore, the user can construct a preferred post-correction clothing model without actually wearing body-correction components and taking measurements, and can obtain information for producing clothing corresponding to the post-correction clothing model and information on the body-correction components. In this embodiment, a mode has been described in which display elements related to the wearer model image differ depending on whether or not an operation input has been made to the body correction menu 1004 on the provision screen 1000. However, the present invention is not limited to this. It is sufficient to present a wearer model to which a pre-correction clothing model has been applied and a body-corrected wearer model to which a post-correction clothing model has been applied in a manner that allows comparison; for example, both may be presented simultaneously.

[0113] [Variation 9] In the above-described third embodiment, the wearer model is modified to match the dimensional ratios between multiple body parts defined in the character's body shape information. However, this body shape correction is not possible for all body parts. For example, the sleeve length and arm length, or the length of the upper arm and forearm, are dimensions related to body parts whose dimensions cannot be physically changed (hereinafter referred to as invariable body parts). In other words, for such body parts of the wearer whose body shape cannot be changed, when constructing a body shape-corrected wearer model, the wearer model cannot be modified to match the character's body shape information.

[0114] On the other hand, since a character's clothing is designed to suit the character's body shape, if a body-corrected wearer model is constructed without changing the dimensions of such invariant parts, the character's appearance may not be properly created when the corrected clothing model is applied. More specifically, if the character's clothing information is transformed using the scaling factor used to construct the body-corrected wearer model to construct the corrected clothing model, the design of the clothing of the invariant parts may differ between the original character's clothing and the wearer model image applied to the body-corrected wearer model.

[0115] For example, if a character is wearing a three-quarter sleeve outfit as shown in Figure 12(a), the sleeve length of the outfit is determined depending on the length of the character's upper arm. However, since the upper arm is an invariant body part, if the ratio of the wearer's upper arm to their height is greater than the ratio of the same body part to the character's height, i.e., if the wearer's upper arms are longer than the character's, the sleeve length of the outfit may change as shown in Figure 12(b). As shown in the figure, if the wearer's upper arms are longer than the character's, simply constructing a corrected clothing model will reduce the proportion of the sleeve length to the upper arm, resulting in the creation of clothing with sleeves shorter than three-quarter sleeves.

[0116] Therefore, when constructing a corrected clothing model adapted to the body-corrected wearer model, the construction unit 104 further performs a process of adapting the dimensions of the invariant parts to the character design. This process includes, for example, identifying the difference in dimensions of the invariant parts between the wearer and the character based on the ratio of the dimensions of the invariant parts to the height in the wearer's body type information and the ratio of the dimensions of the invariant parts to the height in the character's body type information. The process also includes changing the dimensions of the clothing corresponding to the invariant parts in the character's clothing information based on the difference in dimensions, and constructing a corrected clothing model based on the changed character's clothing information. In this way, the balance between the body type and clothing of the motif character can be reproduced for the wearer's body type, as shown in FIG. 12(c).

[0117] For example, consider a case where the ratio of the wearer's upper arm (25 cm) to their height (160 cm) in the wearer's physique information is 25 / 160≒0.156, and the ratio of the character's upper arm (21 cm) to their height (144 cm) in the character's physique information is 21 / 144≒0.146. These ratios indicate that the wearer's upper arm is larger in proportion to their height (i.e., longer) than the character's upper arm. If the character's clothing sleeve length is set to 12.6 cm, covering up to 3 / 5 of the upper arm, the construction unit 104 changes the clothing sleeve length to 12.6 cm × 0.156 / 0.146≒13.5 cm, and constructs a corrected clothing model based on the value (15 cm) obtained by multiplying this by the scaling factor (160 / 144). Here, the sleeve length of 15 cm is 3 / 5 of the wearer's upper arm (25 cm), matching the balance of the sleeve length on the character's clothing upper arm.

[0118] In this way, it is possible to create a clothing model that fits the wearer's body shape and that ensures the reproduction of the impression of the motif character's appearance.

[0119] In this modified example, a modified clothing model is constructed so that the balance between the clothing and body shape of invariant parts matches the character design, but a customization function for each dimension of the clothing model may be provided so that sleeve length, etc., can be changed without being based on dimensional ratios. This allows the user to adjust the modified clothing model to a mode that reflects their desires, such as hiding a specific part or providing more room for easier movement, rather than simply conforming to the character design.

[0120] [Variation 10] In the above-described third embodiment and ninth modification, a form-corrected wearer model is constructed by scaling the character's body shape information to match the wearer's height and expressing the character's body shape at the scale of the wearer. However, the implementation of the present invention is not limited to this. For example, in a form in which the dimensions of a specific part of a character are widely known, the wearer model may be modified to match the dimensions of that part to construct a form-corrected wearer model.

[0121] For example, if a character has a distinctive chest size and the bust dimensions are published in a video work or the like in which the character appears, the bust dimensions of the body-corrected wearer model may be configured to be the same as those of the character (the published values). That is, instead of transforming each part of the wearer model to the dimensions obtained by scaling the character's body type information to match the wearer's height, the dimensions of a specific distinctive part of the wearer model may be transformed to be the same as the dimensions of the same part of the character's body type information. In this way, a body-corrected wearer model can be configured in which the distinctive parts have the same shapes as those of the character.

[0122] [Variation 11] In the above-described third embodiment and the ninth and tenth modifications, the character information includes the body shape information of the character, and the configuration unit 104 configures the body shape correction wearer model by referring to the information. However, the present invention is not limited to this. The body shape information of the character may be acquired from a character image representing the corresponding character transmitted from the client device 200.

[0123] Here, as described in the seventh modification, the character image may be, for example, an illustration depicting a character in a specific scene or an image of one frame of a video in which a character appears. To acquire the character's physique information from the character image, information for estimating the character's size (original dimensions) is required. In the support service of this modification, the user is required to input reference dimension information for estimating the character's original dimensions, such as the character's height, for the character image transmitted from the client device 200. The control unit 101 executes an analysis process on the character image to identify the area of ​​the character's image and further identify the positions of predetermined joints and feature points for the character's image. The control unit 101 then sets the dimensions of the joints and feature points (e.g., the top of the head and the heel in the case of height) corresponding to the reference dimension information to the input values, thereby identifying the scale of the character image, and deriving the dimensions of each part based on the scale to construct the character's physique information.

[0124] In this way, it is possible to obtain the character's body shape information from the character image and construct a body shape correction wearer model without managing body shape information as character information. This method is also effective when it is necessary to construct a clothing model for a character that is not registered in the character DB 130. In this case, it is also possible to obtain the character's clothing information from the obtained character image.

[0125] [Variation 12] In the above-described embodiment and modified example, a 3D model of the clothing is stored in advance in the character information as the clothing information of the character, and the 3D model can be used to construct a clothing model for the character. In such an embodiment, a 3D model can be constructed in advance to make it easier to produce clothing corresponding to the clothing model, and appropriate patterns can be easily output according to the wearer's body type information.

[0126] However, preparing a 3D model of clothing that takes into consideration the ease of outputting information for creating the clothing requires more effort than constructing a 3D model that simply reflects the appearance of the clothing, and therefore it may be difficult to store in advance in the character DB 130 3D models that make it easy to output information for creating clothing for a variety of characters.

[0127] Furthermore, to create clothing using patterns output based on clothing models, users must have a certain level of sewing skill and be able to secure a certain amount of time for production. In other words, users who are short on time or lack sewing skills find it difficult to adopt a method of making clothing entirely by hand.

[0128] On the other hand, clothing that matches a character's outfit can also be produced by remaking and combining ready-made products that resemble the character's outfit. This method reduces the time required for production and allows a wide range of users to obtain clothing with a desired character motif.

[0129] Therefore, the support system of this modified example provides a function that allows a user to construct a clothing model corresponding to a character's clothing by combining 3D models of ready-made clothing products as clothing parts, even if the character information does not include a 3D model of the character's clothing. Therefore, a clothing parts DB (not shown) is provided in the storage device 102, which manages information on ready-made products that can be used to construct clothing. Then, when a motif character is selected on the provided screen, the user may select clothing parts corresponding to the character from a group of clothing parts managed in the clothing parts DB, for example, while referring to the character image on the provided screen. Once the clothing parts are selected, the construction unit 104 may use the 3D models of the selected clothing parts to resize them to fit the wearer model and construct a clothing model. In other words, acquiring information on the selected clothing parts in this modified example corresponds to acquiring the character's clothing information.

[0130] To facilitate the user's selection of costume parts, color information and shape information about the character's costume may be acquired, and costume parts with similar shapes and color schemes may be extracted and presented for selection. In this case, the color information and shape information may be managed as character information in the characteristic DB 120, or may be acquired by analyzing the character image.

[0131] Furthermore, in implementing the present invention, clothing parts are not limited to ready-made products, but may be clothing templates for conventional clothing with known shapes and manufacturing methods. In this case, pattern information and the like for the clothing templates are easily available, allowing for customization beyond the scope of remaking ready-made products. Specifically, by allowing the user to select a clothing template with a shape that corresponds to the character's clothing and allowing the user to set the color scheme, pattern, various dimensions, and the like for that clothing template, the user can easily create a clothing model with the desired appearance. For clothing models constructed in this way, the output unit 106 can output information for creating clothing based on information such as the pattern of the clothing template that served as the base.

[0132] Such clothing parts may also include body shape correction components, and may be configured to be able to deform and present a wearer model rather than a clothing model depending on the selection of the body shape correction component.

[0133] Furthermore, the selection of costume parts is not limited to being performed by the user, but may instead be performed by the control unit 101 analyzing the character image to select corresponding costume parts, for example.

[0134] [Variation 13] In the above-described embodiment and modified examples, the wearer model and clothing model constructed by construction unit 104 are described as 3D models, but the present invention is not limited to this. The wearer model and clothing model constructed by construction unit 104 may be in the form of, for example, two-dimensional images related to three-view drawings.

[0135] [Variation 14] In the above-described embodiment and modified example, the assistance service is provided via a browser, and therefore it has been described that various models are drawn in the assistance server 100 and the drawing results are transmitted to the client device 200. However, the present invention is not limited to this. For example, a wearer model and a clothing model constructed in the assistance server 100 may be provided to the client device 200, and drawing may be performed in the client device 200. Furthermore, the construction, drawing, and display of the models may be performed in a single device.

[0136] [Other embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0137] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0138] 100: Support server, 101: Control unit, 102: Storage device, 103: Memory, 104: Configuration unit, 105: Drawing unit, 106: Output unit, 107: Communication unit, 110: Wearer DB, 120: Characteristics DB, 130: Character DB, 140: Adjustment DB

Claims

1. An information processing device having a presentation means for applying a clothing model configured based on a costume of a character as a motif to a wearer model and presenting the clothing model, a first acquisition means for acquiring body type information of a wearer; a first configuration means for configuring a first wearer model based on the body type information of the wearer; a second acquisition means for acquiring body type information and clothing information of the character; a transformation means for transforming the first wearer model based on the body type information of the character to form a second wearer model; a second configuration means for configuring a first clothing model that fits the second wearer model based on clothing information of the character; and The presentation means presents the second wearer model to which the first clothing model is applied.

1. An information processing device comprising:

2. the character's body type information includes information on the dimensions of a plurality of body parts that constitute the character; The transformation by the transformation means includes a first transformation that sets a dimensional ratio between a plurality of parts constituting the first wearer model to a dimensional ratio between the same parts of the character.

2. The information processing apparatus according to claim 1, wherein:

3. 3. The information processing device according to claim 2, wherein the transformation by the transformation means includes a second transformation that makes the dimensions of at least some of the multiple parts constituting the first wearer model the same as the dimensions of the same part of the character.

4. The parts constituting the first wearer model include an invariable part whose dimensions cannot be changed, the transformation means constructs the second wearer model without transforming the first wearer model based on the body type information of the character with respect to the invariant parts; The second configuration means configures the first clothing model by changing the dimensions of the clothing corresponding to the invariant portion of the clothing information of the character based on the body type information of the wearer and the body type information of the character.

4. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

5. The method further includes a third acquisition means for acquiring a character image showing the character and information on reference dimensions for estimating the original dimensions of the character, The second acquisition means acquires the body type information of the character based on the character image and the reference dimension information.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

6. 6. The information processing apparatus according to claim 5, wherein the second acquisition means further acquires costume information of the character based on the character image.

7. a first selection means for accepting a selection of the character from a plurality of types of characters; a storage means for storing body type information relating to each of the plurality of types of characters; and The second acquisition means acquires, from the storage means, body type information of the character whose selection has been accepted by the first selection means.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

8. the storage means further stores costume information relating to each of the plurality of types of characters; The second acquisition means further acquires, from the storage means, costume information of the character selected by the first selection means.

8. The information processing apparatus according to claim 7,

9. the storage means stores a plurality of types of costume information for each of the plurality of types of characters; the information processing device further includes second selection means for accepting a selection of one of the plurality of types of costume information related to the character, for the character whose selection has been accepted by the first selection means; The second acquisition means further acquires the one type of costume information selected by the second selection means as costume information for the character.

9. The information processing apparatus according to claim 8,

10. the storage means further stores, for each of the plurality of types of characters, a group of costume parts associated with the character; the information processing device further comprises third selecting means for accepting a selection of clothing parts to be reflected in the first clothing model from the clothing parts group associated with the character, for the character whose selection has been accepted by the first selecting means; The second acquisition means further acquires information on the costume parts selected by the third selection means as costume information for the character.

8. The information processing apparatus according to claim 7,

11. a third configuration means for configuring a second clothing model that fits the first wearer model based on the clothing information of the character; a switching means for accepting switching of the wearer model to be presented by the presentation means; and The presenting means, in response to the acceptance of the switching by the switching means, switches between presenting the second wearer model to which the first clothing model is applied and presenting the first wearer model to which the second clothing model is applied.

11. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

12. 12. The information processing apparatus according to claim 1, wherein the wearer model and the clothing model include 3D models.

13. 13. The information processing apparatus according to claim 1, wherein the wearer model and the clothing model include two-dimensional images.

14. 14. The information processing apparatus according to claim 1, further comprising first output means for outputting information for producing clothing corresponding to the first clothing model.

15. 15. The information processing device according to claim 1, further comprising a second output means for outputting information about a body shape correction member for adjusting the body shape of the wearer to the body shape of the second wearer model.

16. 1. A control method for an information processing device having a presentation means for applying a clothing model configured based on a costume of a character as a motif to a wearer model and presenting the applied clothing model, a first acquisition step of acquiring body type information of a wearer; a first constructing step of constructing a first wearer model based on the body type information of the wearer; a second acquisition step of acquiring body type information and clothing information of the character; a transformation step of transforming the first wearer model based on body shape information of the character to construct a second wearer model; a second construction step of constructing a first clothing model that fits the second wearer model based on clothing information of the character; causing the presentation means to present the second wearer model to which the first clothing model is applied; A control method comprising:

17. a computer having a presentation means for applying a clothing model based on a costume of a character as a motif to a wearer model and presenting the clothing model; A process of acquiring body shape information of a wearer; A process of constructing a first wearer model based on the body type information of the wearer; A process of acquiring body type information and clothing information of the character; a process of constructing a second wearer model by transforming the first wearer model based on body type information of the character; constructing a first clothing model that fits the second wearer model based on clothing information of the character; a process of causing the presentation means to present the second wearer model to which the first clothing model is applied; A program that executes the following.

Images