Simulation Equipment

Abstract

A simulation device in which each of a plurality of clothing data includes shape data which expresses the three-dimensional shape of clothing and tag data which expresses what number in a sequence said clothing is to be put on by the user, said simulation device having a processing device equipped with: a receiving unit for receiving two or more pieces of clothing selected by a user from among a plurality of pieces of clothing; an identification unit for identifying the overlap order of the two or more pieces of clothing on the basis of the two or more clothing data which correspond to the two or more pieces of clothing received by the receiving unit; and an image generation unit for generating a first synthesized image in which a three-dimensional image of two or more pieces of clothing overlaps a three-dimensional image of the user according to the identified overlap order, on the basis of body shape data which expresses the three-dimensional body shape of the user, and the two or more clothing data.

Description

[Technical Field]

[0001] The present invention relates to a simulation device. [Background technology]

[0002] In recent years, simulation devices that simulate the appearance of a user trying on virtual clothing have been used. In particular, simulation devices that generate a video of a user moving in a state where the user is trying on virtual clothing in accordance with the user's own movements are sometimes used.

[0003] For example, Patent Document 1 discloses a virtual try-on system that generates motion body data by moving a user's three-dimensional body data in three dimensions, and then dresses the three-dimensional body data at each time included in the motion body data with clothing indicated by clothing data, thereby generating a try-on image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5605885 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the virtual try-on system disclosed in Patent Document 1 does not take into consideration the layering order when multiple outfits are layered. Specifically, Patent Document 1 describes, as an example, the case of wearing a T-shirt and jeans. However, the technology disclosed in Patent Document 1 does not consider which of the T-shirt and jeans will be closest to the user's body.

[0006] Therefore, an object of the present invention is to provide a simulation device that can specify the order in which two or more outfits are layered when a user wears two or more outfits at once and perform a simulation. [Means for solving the problem]

[0007] A preferred embodiment of the present invention provides a simulation device that includes a processing device that simulates a user layering costumes by referencing multiple costume data that correspond one-to-one to multiple costumes, each of which includes shape data indicating the three-dimensional shape of the costume and tag data that corresponds to the shape data and indicates the order in which the costume will be worn by the user. The processing device includes: a reception unit that receives input of two or more costumes selected by the user from the multiple costumes; an identification unit that identifies an overlapping order indicating that the two or more costumes are to be layered on top of each other, based on two or more costume data corresponding to the two or more costumes received by the reception unit; and an image generation unit that generates a first composite image by overlaying three-dimensional images of the two or more costumes on a three-dimensional image of the user in accordance with the identified overlapping order, based on body shape data that indicates the three-dimensional body shape of the user and the two or more costume data. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a simulation device that can specify the order in which two or more outfits are layered when a user wears two or more outfits at once and perform a simulation. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing the overall configuration of a simulation system 1 according to a first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a scanning device 20. [Figure 3] 10 shows an example of the configuration of the first dataset DS1. [Figure 4] An example of the composition of a costume data CD. [Figure 5] 10 is a table showing an example of the correspondence between costume IDs and overlapping order indices. [Figure 6] An example of installation of the imaging device 24. [Figure 7]FIG. 2 is a block diagram showing an example of the configuration of a server 30. [Figure 8] Example configuration of the first database DB1. [Figure 9] FIG. 2 is a block diagram showing an example of the configuration of a terminal device 10. [Figure 10] Example of configuration for the second database DB2. [Figure 11] 10 shows an example of the configuration of corresponding data RD. [Figure 12] An example of the operation screen OM. [Figure 13] FIG. 2 is a functional block diagram of an image generation unit 116. [Figure 14A] FIG. 3 is an explanatory diagram of the operation of an image generating unit 116. [Figure 14B] FIG. 3 is an explanatory diagram of the operation of an image generating unit 116. [Figure 15] 4 is a flowchart showing the operation of the terminal device 10. DETAILED DESCRIPTION OF THE INVENTION

[0010] 1: First embodiment Hereinafter, the configuration of a simulation system 1 including a terminal device 10 as a simulation device according to a first embodiment of the present invention will be described with reference to FIGS.

[0011] 1-1: Configuration of the first embodiment 1-1-1: Overall structure FIG. 1 shows the overall configuration of a simulation system 1 according to the first embodiment. As shown in FIG. 1, the simulation system 1 includes a terminal device 10, a scanning device 20, and a server 30. In the simulation system 1, the terminal device 10, the scanning device 20, and the server 30 are communicably connected to each other via a communication network NET. In FIG. 1, an end user U is assumed to use the terminal device 10. The end user U is an example of a "user."

[0012] The terminal device 10 is a device that allows the end user U to simulate his or her appearance wearing two or more virtual outfits. In particular, the terminal device 10 specifies the order in which the multiple outfits are superimposed on one another, i.e., the overlapping order, and then simulates a full-body image of the end user U wearing two or more virtual outfits. The terminal device 10 is an example of a "simulation device."

[0013] The scanning device 20 performs a 3D scan of two or more actual garments and generates image data showing three-dimensional images of the garments and garment data relating to the features of the garments, which are used when the terminal device 10 performs a simulation. The garment data includes a layering order index used by the terminal device 10 to identify the layering order of the two or more garments. The scanning device 20 outputs the generated image data and garment data to the server 30 as a single data set.

[0014] The server 30 acquires image data and costume data from the scanning device 20. The server 30 also outputs the image data to the terminal device 10. The server 30 further acquires a costume ID indicating the ID of the costume that the end user U will try on from the terminal device 10, and outputs costume data corresponding to the acquired costume ID to the terminal device 10.

[0015] 1-1-2: Scanning device configuration 2 is a block diagram showing an example configuration of scanning device 20. Scanning device 20 includes a processing device 21, a storage device 22, a communication device 23, an imaging device 24, a display 25, and an input device 26. The elements of scanning device 20 are connected to each other using one or more buses for communicating information.

[0016] The processing device 21 is a processor that controls the entire scanning device 20. The processing device 21 is configured, for example, using one or more chips. The processing device 21 is configured, for example, using a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 21 may be realized using hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 21 executes various processes in parallel or sequentially.

[0017] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. The storage device 22 also stores a plurality of programs including a control program PR2 executed by the processing device 21. The storage device 22 also stores a first data set DS1. The first data set DS1 is a data set corresponding to a three-dimensional model of each costume.

[0018] FIG. 3 shows an example of the configuration of the first dataset DS1. As shown in FIG. 3, the first dataset DS1 is a set of a costume ID, image data PD, and costume data CD. The costume ID indicates the ID of the costume scanned by the scanning device 20. For example, the first alphabet of the costume ID corresponds to the type of costume, such as a T-shirt, a long-sleeved shirt, or pants. The number following the alphabet indicates the costume's product number. The image data PD indicates a three-dimensional image obtained by three-dimensionally scanning the costume. The costume data CD is data related to the characteristics of the costume. The costume data CD includes data obtained by analyzing the three-dimensional image and data input by the user of the scanning device 20. In the example shown in FIG. 3, the dataset with costume ID=A001 includes data "H001.dae" as image data PD and data "O001.dst" as costume data CD.

[0019] FIG. 4 shows an example of the structure of costume data CD. The costume data CD includes shape data FD and tag data GD. The shape data FD represents the three-dimensional shape of the costume. The shape data FD includes structure data SD, texture data TD, and joint data JD. The structure data SD is data related to the structure of the costume. Specifically, the structure data SD includes data indicating the shape and thickness of fabric, its position, and how the fabric pieces are joined together in a piece of costume. The texture data TD includes data indicating the material, rigidity, color, pattern, gloss, and texture of each fabric. The joint data JD includes data indicating the positions of the joints of a typical wearer of the costume when the typical wearer wears the costume. Furthermore, the joint data JD includes data indicating the relative positions of the skeletal structure of the typical wearer with respect to the costume when the typical wearer wears the costume. The joint data JD indicates a predetermined range as the positions in a piece of costume corresponding to the positions of the skeleton and joints of the wearer of the costume.

[0020] The tag data GD is data used to classify the outfits, and includes, for example, an overlapping order index used by the terminal device 10 to identify the overlapping order indicating that multiple outfits are overlapped with each other.

[0021] Fig. 5 is a table showing an example of the correspondence between costume IDs and overlay order indices. For ease of explanation, Fig. 5 also shows an example of a 3D image of each costume represented by image data PD corresponding to each costume ID.

[0022] In the example shown in FIG. 5, the overlap order index corresponding to an outfit whose outfit ID begins with the letter "A," i.e., a T-shirt, is "1." The overlap order index corresponding to an outfit whose outfit ID begins with the letter "B," i.e., a long-sleeved shirt, is "3." The overlap order index corresponding to an outfit whose outfit ID begins with the letter "C," i.e., a sweater or hoodie, is "4." The overlap order index corresponding to an outfit whose outfit ID begins with the letter "D," i.e., a jacket, is "5." The overlap order index corresponding to an outfit whose outfit ID begins with the letter "E," i.e., pants, is "2." The overlap order index corresponding to an outfit whose outfit ID begins with the letter "F," i.e., a coat, is "6."

[0023] When the terminal device 10 described below uses three-dimensional images of two or more outfits to simulate an appearance of the end user U trying on the two or more outfits, the terminal device 10 specifies the overlapping order of the two or more outfits using overlapping order indices exemplified in Fig. 5. Specifically, the terminal device 10 overlaps the three-dimensional image of an outfit with a relatively large overlapping order index on top of the three-dimensional image of an outfit with a relatively small overlapping order index. The outfits shown in the example of Fig. 5 are positioned closer to the center of the three-dimensional image showing the body shape of the end user U, in the order of T-shirt → pants → long-sleeved shirt → sweater or hoodie → jacket → coat, for each outfit type.

[0024] Returning to the explanation of Fig. 4, a part or all of the costume data CD may be automatically generated by the generating unit 212 using the analysis result of the analyzing unit 213 (described later). Alternatively, a part or all of the costume data CD may be generated based on input information input by the user of the scanning device 20 via the input device 26.

[0025] Returning to the explanation of FIG. 2, the communication device 23 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 23 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 23 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 23 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0026] The imaging device 24 captures an image of the external world in which an object exists. In particular, in this embodiment, the imaging device 24 captures an image of the costume. The imaging device 24 also outputs imaging information indicating the captured image obtained by capturing an image of the costume. The imaging device 24 further includes, for example, a lens, an imaging element, an amplifier, and an AD converter. The imaging element converts light collected through the lens into an imaging signal, which is an analog signal. The amplifier amplifies the imaging signal and outputs it to the AD converter. The AD converter converts the amplified imaging signal, which is an analog signal, into imaging information, which is a digital signal. The converted imaging information is output to the processing device 21.

[0027] FIG. 6 shows an example of the installation of the imaging devices 24 in this embodiment. In the example shown in FIG. 6, the scanning device 20 includes eight imaging devices 24-1 to 24-8. Incidentally, the scanning device 20 including eight imaging devices 24 is merely an example. The scanning device 20 can include any number of imaging devices 24. In the example shown in FIG. 6, the imaging devices 24-1 to 24-8 are fixed to a frame F and capture images of a garment C arranged in the air within the frame F from 360° directions along three axes: up, down, left, right, front, and back. The generating unit 212, which will be described later, generates a three-dimensional image of the garment C based on imaging information indicating the multiple captured images captured by the imaging devices 24-1 to 24-8.

[0028] Returning to Fig. 2 for explanation, the display 25 is a device that displays images and text information. The display 25 displays various images under the control of the processing device 21. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display 25.

[0029] The input device 26 accepts operations from a user of the scanning device 20. For example, the input device 26 may include a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. Here, if the input device 26 includes a touch panel, it may also serve as the display 25.

[0030] The processing device 21 reads and executes the control program PR2 from the storage device 22. As a result, the processing device 21 functions as an acquisition unit 211, a generation unit 212, an analysis unit 213, and a communication control unit 214.

[0031] The acquiring unit 211 acquires imaging information indicating a captured image of the costume C from the imaging device 24. The acquiring unit 211 also acquires input information from the input device 26 that is input by the user of the scanning device 20 via the input device 26. The input information includes, for example, an overlapping order index.

[0032] The generating unit 212 generates image data PD representing a three-dimensional image of the costume C based on the imaging information acquired by the acquiring unit 211 from the imaging device 24. The generating unit 212 also generates costume data CD using input information acquired by the acquiring unit 211 from the input device 26. The generating unit 212 also generates analysis information representing the analysis results of the three-dimensional image of the costume C analyzed by the analyzing unit 213 (described later). The generating unit 212 also generates a first dataset DS1, which is a dataset including a costume ID and a set of image data PD and costume data CD corresponding to the costume ID. The generating unit 212 stores the generated first dataset DS1 in the storage device 22.

[0033] The analysis unit 213 analyzes the three-dimensional image of the costume C generated by the generation unit 212. As a result of analyzing the three-dimensional image, the analysis unit 213 extracts, for example, features related to the shape of the costume C. Analysis information indicating the extracted features is output to the generation unit 212. As described above, the generation unit 212 generates the costume data CD using the analysis information acquired from the analysis unit 213.

[0034] The communication control unit 214 causes the communication device 23 to transmit the first data set DS1 stored in the storage device 22 to the server 30.

[0035] As a result, the user of the scanning device 20 can easily create the image data PD and the garment data CD without manually inputting all of the data elements that make up the image data PD and the garment data CD one by one. Furthermore, the simulation system 1 can simulate a virtual try-on experience using the easily created image data PD and garment data CD.

[0036] 1-1-3: Server configuration 7 is a block diagram showing an example of the configuration of the server 30. The server 30 includes a processing device 31, a storage device 32, a communication device 33, a display 34, and an input device 35. The elements of the server 30 are connected to each other using one or more buses for communicating information.

[0037] The processing device 31 is a processor that controls the entire server 30. The processing device 31 is configured, for example, using one or more chips. The processing device 31 is configured, for example, using a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 31 may be realized using hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 31 executes various processes in parallel or sequentially.

[0038] The storage device 32 is a recording medium that can be read from and written to by the processing device 31. The storage device 32 also stores a plurality of programs including a control program PR3 executed by the processing device 31. The storage device 32 also stores a first database DB1.

[0039] 8 shows an example of the configuration of the first database DB1. The first database DB1 is a database in which a first data set DS1 acquired from the scanning device 20 via the communication device 33 by an acquisition unit 311 (described later) is accumulated.

[0040] Returning to the explanation of FIG. 7, the communication device 33 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 33 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 33 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 33 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0041] The display 34 is a device that displays images and text information. The display 34 displays various images under the control of the processing device 31. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display 34.

[0042] The input device 35 accepts operations from a user of the server 30. For example, the input device 35 includes a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. Here, if the input device 35 includes a touch panel, it may also serve as the display 34.

[0043] The processing device 31 reads and executes the control program PR3 from the storage device 32. As a result, the processing device 31 functions as an acquisition unit 311, an extraction unit 312, and a communication control unit 313.

[0044] The acquisition unit 311 acquires the first data set DS1 from the scanning device 20 via the communication device 33. The acquisition unit 311 stores the acquired first data set DS1 in the first database DB1. The acquisition unit 311 also acquires selection information indicating the selection result of the outfit selected by the end user U from the terminal device 10 via the communication device 33, as will be described later.

[0045] The extracting unit 312 extracts the costume data CD from the first database DB1 based on the selection information acquired by the acquiring unit 311. More specifically, the extracting unit 312 uses a costume ID included in the selection information to extract the costume data CD associated with the costume ID from the first database DB1.

[0046] The communication control unit 313 causes the communication device 33 to transmit pairs of costume IDs and image data PD stored in the first database DB1 to the terminal device 10. As an example, the communication control unit 313 causes the communication device 33 to transmit all pairs of costume IDs and image data PD stored in the first database DB1 to the terminal device 10. The communication control unit 313 also outputs the costume data CD extracted by the extraction unit 312 to the terminal device 10 via the communication device 33 as corresponding data RD in which the costume data CD is paired with the corresponding costume ID.

[0047] 1-1-4: Terminal device configuration 9 is a block diagram showing an example configuration of the terminal device 10. The terminal device 10 includes a processing device 11, a storage device 12, a communication device 13, an imaging device 14, a display 15, and an input device 16. The elements of the terminal device 10 are connected to each other using one or more buses for communicating information.

[0048] The processing device 11 is a processor that controls the entire terminal device 10. The processing device 11 is configured, for example, using one or more chips. The processing device 11 is configured, for example, using a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 11 may be realized using hardware such as a DSP, an ASIC, a PLD, and an FPGA. The processing device 11 executes various processes in parallel or sequentially.

[0049] The storage device 12 is a recording medium that can be read and written by the processing device 11. The storage device 12 also stores a plurality of programs including a control program PR1 executed by the processing device 11. The storage device 12 also stores a second database DB2, correspondence data RD, body shape data BD, and a learning model LM.

[0050] 10 shows an example of the configuration of the second database DB2. The second database DB2 is a database that stores pairs of costume IDs and image data PD acquired by the acquisition unit 111 (described later) from the server 30 via the communication device 13. As an example, the second database DB2 stores all pairs of costume IDs and image data PD stored in the server 30.

[0051] 11 shows an example of the structure of the correspondence data RD. The correspondence data RD is the correspondence data RD acquired by the acquisition unit 111 (described later) from the server 30 via the communication device 13. As described above, the correspondence data RD is a combination of a costume ID included in the selection information output from the terminal device 10 to the server 30 and costume data CD extracted by the server 30 using the costume ID.

[0052] Returning to FIG. 9 for explanation, the body shape data BD is data that represents the body shape of the end user U in three dimensions. Specifically, the body shape data BD is data that represents a three-dimensional image that represents the body shape of the end user U. The body shape data BD includes skeletal data KD that represents the skeleton of the end user U. More specifically, the skeletal data KD represents changes in the posture of the end user U's skeleton in accordance with the movements of the end user U. As an example, the skeletal data KD includes time-varying and discrete data that represents the posture of the skeleton of the end user U at multiple points in time during the period in which the end user U uses the terminal device 10. Furthermore, the skeletal data KD includes data related to the joints of the end user U.

[0053] The trained model LM is a trained model used by the data generation unit 112 (described later) when generating body shape data BD of the end user U based on a captured image of the end user U captured by the imaging device 14 (described later). That is, the trained model LM receives the captured image of the end user U as input and body shape data BD as output. The trained model LM is a trained model that has learned the relationship between the captured images of multiple different end users and multiple body shape data that correspond one-to-one to the multiple end users. The trained model LM is generated by learning training data in the learning phase. The training data used to generate the trained model LM includes multiple pairs of data indicating the captured image of the end user and the body shape data. The trained model LM is also generated outside the terminal device 10. In particular, it is preferable that the trained model LM be generated in a server (not shown). In this case, the terminal device 10 acquires the trained model LM from the server (not shown) via the communication network NET.

[0054] The communication device 13 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 13 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 13 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0055] The imaging device 14 captures an image of the external world in which an object exists. In particular, in this embodiment, the imaging device 14 captures a full-body image of the end user U. For example, if the terminal device 10 is installed in a store that sells clothing, the imaging device 14 captures a full-body image of the end user U who visits the store, wearing clothes at the time of the visit. The imaging device 14 also outputs imaging information indicating the captured image obtained by capturing an image of the end user U. Furthermore, the imaging device 14 includes, for example, a lens, an imaging element, an amplifier, and an AD converter. The imaging element converts light collected through the lens into an imaging signal, which is an analog signal. The amplifier amplifies the imaging signal and outputs it to the AD converter. The AD converter converts the amplified imaging signal, which is an analog signal, into imaging information, which is a digital signal. The converted imaging information is output to the processing device 11.

[0056] The display 15 is a device that displays images and text information. The display 15 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display 15.

[0057] FIG. 12 is an example of an operation screen OM displayed on the display 15. In the operation screen OM illustrated in FIG. 12, a list of 3D images of candidate outfits for the end user U to try on is displayed in the leftmost column. In the example of FIG. 12, 3D images of candidate outfits are displayed, from top to bottom, including a T-shirt, a long-sleeved shirt, a sweater or hoodie, a jacket, pants, and a coat. These 3D images are represented by image data PD associated with the outfit ID of each outfit in the second database DB2. The end user U selects the outfit to try on from these candidate outfits using the input device 16, which will be described later. In the operation screen OM illustrated in FIG. 12, a 3D image of the outfit selected by the end user U is displayed to the right of the candidate outfit column. Furthermore, in the operation screen OM illustrated in FIG. 12, a first composite image SP1, which is a 3D image of the end user U's whole body, is displayed as a virtual outfit result to the right of the column displaying the outfit selection result of the end user U. The three-dimensional image of the end user U's entire body moves in accordance with the end user U's actual movements.

[0058] Returning to the explanation of Fig. 9, the input device 16 receives operations from the end user U. For example, the input device 16 includes a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. Here, if the input device 16 includes a touch panel, it may also serve as the display 15.

[0059] The processing device 11 reads and executes the control program PR1 from the storage device 12. As a result, the processing device 11 functions as an acquisition unit 111, a data generation unit 112, a reception unit 113, a communication control unit 114, an overlapping order identification unit 115, an image generation unit 116, and a display control unit 117.

[0060] The acquiring unit 111 acquires a pair of a costume ID and image data PD, and corresponding data RD, from the server 30 via the communication device 13. The acquiring unit 111 stores the pair of the costume ID and image data PD acquired from the server 30 in the second database DB2. The acquiring unit 111 also stores the corresponding data RD acquired from the server 30 in the storage device 12. Furthermore, the acquiring unit 111 acquires imaging information indicating a captured image of a full-body image of the end user U from the imaging device 14.

[0061] The data generation unit 112 generates body shape data BD that represents the body shape of the end user U in three dimensions by inputting the imaging information acquired by the acquisition unit 111 into the learning model LM. The body shape of the end user U represented by the body shape data BD is data that represents the body shape of the end user U when not wearing any clothes. Furthermore, as described above, the body shape data BD includes skeletal data KD of the end user U. The skeletal data KD is data that represents the skeleton of the end user U.

[0062] The reception unit 113 receives two or more costumes selected by the end user U from among the multiple costumes. Specifically, the reception unit 113 receives selection information indicating the selection result of two or more costumes input by the end user U using the input device 16 while viewing the operation screen OM.

[0063] The communication control unit 114 causes the communication device 13 to transmit the selection information received by the receiving unit 113 to the server 30. As described above, in response to the output of the selection information to the server 30, the acquisition unit 111 acquires the corresponding data RD via the communication device 13. The corresponding data RD includes costume data CD corresponding to the costume selected by the end user U. As shown in FIG. 4, the costume data CD includes tag data GD. Furthermore, the tag data GD includes a stacking order index.

[0064] The overlapping order specifying unit 115 specifies the overlapping order of two or more costumes selected by the end user U based on the tag data GD included in the costume data CD acquired by the acquiring unit 111. As described above, the overlapping order specifying unit 115 specifies that the costume with the larger overlapping order index should be overlapped on the outer side as viewed from the three-dimensional image showing the body shape of the end user U. The overlapping order specifying unit 115 is an example of an "specifying unit."

[0065] The image generation unit 116 generates a first composite image SP1 based on the body shape data BD and two or more pieces of costume data CD included in the correspondence data RD. Specifically, the image generation unit 116 generates the first composite image SP1 by overlaying three-dimensional images of two or more costumes on a three-dimensional image of the end user U's body shape in accordance with the overlay order specification unit 115. More specifically, the image generation unit 116 reads a costume ID and costume data CD from the correspondence data RD. Next, the image generation unit 116 references the second database DB2 using the read costume ID to read image data PD associated with the costume ID. The image generation unit 116 also generates the first composite image SP1 by overlaying three-dimensional images of the costumes indicated by the image data PD on the three-dimensional image of the end user U's body shape in the overlay order specification unit 115. When the image generating unit 116 superimposes a three-dimensional image of the clothing on a three-dimensional image of the body shape of the end user U, a more natural first composite image SP1 is generated by using the shape data FD included in the clothing data CD. Here, the three-dimensional image of the body shape of the end user U is represented by the body shape data BD.

[0066] As a result, when the end user U wears two or more outfits layered on top of each other, the terminal device 10 can identify the layering order and perform a simulation. In particular, when the end user U uses the terminal device 10 and wears two or more outfits layered on top of each other, there is no need for the end user U to input information about the layering order of the two or more outfits from the terminal device 10. The end user U can visually view a full-body image of himself or herself virtually trying on the multiple outfits, with the layering order automatically identified.

[0067] 13 is a functional block diagram of the image generation unit 116. The image generation unit 116 includes a region identification unit 116-1 and a correction unit 116-2.

[0068] The region identification unit 116-1 identifies a first region. The first region is a region in which a part of the three-dimensional image of the first outfit worn by the end user U is included within the three-dimensional image of the end user U's body shape when the three-dimensional image of the first outfit worn by the end user U is superimposed on the three-dimensional image showing the end user U's body shape without any other outfit between them.

[0069] The modifying unit 116-2 performs modification to push out a part of the three-dimensional image of the first costume included in the first region from the three-dimensional image of the end user U.

[0070] 14A and 14B are explanatory diagrams of the operation of the image generation unit 116, which includes the region identification unit 116-1 and the correction unit 116-2. As shown in Fig. 14A, the image generation unit 116 overlays the three-dimensional image CM of the first costume on the three-dimensional image BM of the body shape of the end user U. As a result, a second composite image SP2 corresponding to the pair of the three-dimensional image BM of the body shape of the end user U and the three-dimensional image CM of the first costume is generated. For ease of explanation, only the outlines of the three-dimensional image BM of the end user U and the three-dimensional image CM of the first costume are shown in Fig. 14A.

[0071] 14A, in a first region AR1 including a portion corresponding to the shoulder of the three-dimensional image BM of the body shape of the end user U, a part of the three-dimensional image CM of the first costume is included within the three-dimensional image BM of the body shape of the end user U. The region identification unit 116-1 identifies the first region AR1.

[0072] Fig. 14B is an enlarged view of the vicinity of the first region AR1 shown in Fig. 14A. As indicated by the arrow in Fig. 14B, the modifying unit 116-2 performs a modification to push out a part of the 3D image CM of the first costume included in the first region AR1 from the 3D image BM of the end user U.

[0073] This correction prevents the three-dimensional image of the underwear from cutting into the three-dimensional image BM showing the body shape of the end user U when the end user U virtually tries on underwear, for example. As a result, the end user U can view a full-body image of himself wearing the underwear in a more natural state.

[0074] 14A and 14B, the region identification unit 116-1 identifies a second region. The second region is a region that includes a portion of the three-dimensional image of the second garment when a three-dimensional image of the second garment worn by the end user U over the first garment is superimposed on the second composite image SP2 corrected by the correction unit 116-2. The correction unit 116-2 performs correction to push out the portion of the three-dimensional image of the second garment included in the second region from the second composite image SP2.

[0075] For example, when an end user U virtually tries on underwear and then virtually tries on a jacket, this correction prevents the 3D image of the jacket from cutting into the composite image of the 3D image BM showing the body shape of the end user U and the 3D image showing the underwear. As a result, the end user U can view a more natural whole-body image of himself wearing the jacket.

[0076] In the correspondence data RD, the costume IDs corresponding to the first and second costumes are linked to costume data CD. As described above, the costume data CD includes joint data JD. As described above, the joint data JD also includes data indicating the ranges of the costume that correspond to the joint positions of a typical wearer of the costume when the typical wearer wears the costume.

[0077] On the other hand, the skeletal data KD included in the body shape data BD includes data indicating the positions of the joints of the end user U. The modification unit 116-2 may further stretch or shrink the first and second costumes so that the positions of the joints of the end user U included in the skeletal data KD fall within a range corresponding to the positions of the joints of a typical wearer of one outfit.

[0078] Returning to FIG. 9 for explanation, the image generation unit 116 further compares the skeletal data KD, which represents changes in the posture of the end user U in accordance with the movements of the end user U, with the joint data JD to generate a moving image as a first composite image SP1. As described above, the joint data JD includes data indicating where the skeleton of a typical wearer of the costume would be located relative to the costume, assuming that the typical wearer wears the costume. The image generation unit 116 deforms the three-dimensional image of the costume in accordance with the movements of the end user U, while ensuring that the range in which the skeleton of a typical wearer would be located relative to the costume includes the position of the skeleton of the end user U indicated by the skeletal data KD. The structure data SD and texture data TD included in the costume data CD are used to deform the three-dimensional image of the costume.

[0079] As a result, the terminal device 10 can simulate, as a moving image, a full-body image of the end user U moving while trying on multiple outfits. The end user U can view a moving image of the virtual full-body image of the end user U trying on multiple outfits moving in accordance with the end user's own movements. In particular, the terminal device 10 moves the joint data JD included in the shape data FD indicating the three-dimensional shape of the outfit in accordance with the movement of the skeletal data KD that deforms in accordance with the movements of the end user U, thereby making it possible to make the virtual full-body image of the end user U move more naturally.

[0080] 12 on the display 15. In particular, the display control unit 117 causes the display 15 to display the first composite image SP1 generated by the image generation unit .

[0081] 1-2: Operation of the first embodiment FIG. 15 is a flowchart showing the operation of the terminal device 10 according to the first embodiment.

[0082] In step S1, the processing device 11 functions as an acquisition unit 111. The processing device 11 acquires imaging information indicating a captured image of the end user U's whole body from the imaging device .

[0083] In step S2, the processing device 11 functions as the data generation unit 112. The processing device 11 generates body shape data BD that represents the body shape of the end user U in three dimensions, using the imaging information acquired in step S1.

[0084] In step S3, the processing device 11 functions as the reception unit 113. The processing device 11 receives selection information input by the end user U using the input device 16, which information indicates the selection result of two or more costumes.

[0085] In step S4, the processing device 11 functions as the communication control unit 114. The processing device 11 causes the communication device 13 to transmit, to the server 30, selection information indicating the selection result received in step S3.

[0086] In step S5, the processing device 11 functions as an acquisition unit 111. The processing device 11 acquires the correspondence data RD from the server 30 via the communication device 13.

[0087] In step S6, the processing device 11 functions as the overlapping order specifying unit 115. The processing device 11 specifies the overlapping order of two or more costumes based on the costume data CD included in the correspondence data RD acquired in step S5.

[0088] In step S7, the processing device 11 functions as the image generation unit 116. The processing device 11 generates a first composite image SP1 based on body shape data BD that three-dimensionally represents the body shape of the end user U and two or more pieces of costume data CD. Specifically, the processing device 11 generates the first composite image SP1 by superimposing the three-dimensional images of two or more costumes on the three-dimensional image of the end user U by referring to the shape data FD included in the costume data CD in accordance with the superimposing order of the two or more costumes identified in step S6.

[0089] In step S8, the processing device 11 functions as the display control unit 117. The processing device 11 causes the display 15 to display the first composite image SP1 generated in step S7.

[0090] 1-3: Effects of the First Embodiment According to the above description, the terminal device 10 as a simulation device simulates the end user U layering outfits by referencing multiple pieces of costume data CD that correspond one-to-one to multiple outfits. Each of the multiple pieces of costume data CD includes shape data FD indicating the three-dimensional shape of the outfit and tag data GD that is associated with the shape data FD and indicates the order in which the outfit will be worn by the end user U. The terminal device 10 includes a receiving unit 113, a layering order specifying unit 115, and an image generating unit 116. The receiving unit 113 receives two or more outfits selected by the end user U from the multiple outfits. The layering order specifying unit 115 specifies the layering order of the two or more outfits based on the two or more pieces of costume data CD corresponding to the two or more outfits received by the receiving unit 113. The image generation unit 116 generates a first composite image SP1 by superimposing three-dimensional images of two or more outfits on a three-dimensional image of the end user U in accordance with the specified order of superimposition of the two or more outfits, based on body shape data BD that represents the body shape of the end user U in three dimensions and two or more outfit data CD.

[0091] The terminal device 10 has the above-described configuration, and therefore, when the end user U wears two or more layers of outfits, the order in which the outfits are layered can be identified and a simulation can be performed. In particular, when the end user U uses the terminal device 10 to wear two or more layers of outfits, the end user U can visually view a full-body image of himself virtually trying on the multiple outfits, with the order in which the outfits are layered automatically identified, without having to input information about the order in which the outfits are layered from the terminal device 10.

[0092] Furthermore, according to the above description, the two or more outfits include a first outfit worn by end user U without any other outfits between end user U and the body of end user U. The image generation unit 116 includes an area identification unit 116-1 and a correction unit 116-2. The area identification unit 116-1 identifies a first area AR1. The first area AR1 is an area where a part of the three-dimensional image of the first outfit is inserted into the three-dimensional image of end user U when the three-dimensional image of the first outfit is superimposed on the three-dimensional image of end user U. The correction unit 116-2 performs a correction to push a part of the three-dimensional image of the first outfit included in the first area AR1 out of the three-dimensional image of end user U.

[0093] The terminal device 10 has the above-described configuration, so that when the end user U virtually tries on, for example, underwear, it is possible to prevent the three-dimensional image of the underwear from cutting into the three-dimensional image showing the body shape of the end user U. As a result, the end user U can visually recognize a full-body image of himself wearing the underwear in a more natural state.

[0094] Furthermore, according to the above description, the two or more outfits include a second outfit that the end user U wears over the first outfit. The area identification unit 116-1 identifies the second area. The second area is an area where a part of the 3D image of the second outfit is included in the second composite image SP2 when the 3D image of the second outfit is superimposed on the second composite image SP2 corresponding to the set of the 3D image of the end user U and the 3D image of the first outfit. The correction unit 116-2 performs correction to push a part of the 3D image of the second outfit included in the second area out of the second composite image SP2.

[0095] The terminal device 10 has the above configuration, so that, for example, when an end user U who has virtually tried on underwear also virtually tries on a jacket, it is possible to prevent the 3D image of the jacket from cutting into the composite image of the 3D image of the body shape of the end user U and the 3D image of the underwear. As a result, the end user U can view a full-body image of himself wearing the jacket in a more natural state.

[0096] Furthermore, according to the above explanation, the body shape data BD includes skeleton data KD representing the skeleton of the end user U. The shape data FD includes joint data JD indicating the relative positions of the skeleton of the end user U with respect to the above-mentioned outfit when it is assumed that the end user U is wearing the above-mentioned outfit, and the positions of the above-mentioned outfit corresponding to the joints of the end user U. The image generation unit 116 compares the skeleton data KD, which deforms in accordance with the movements of the end user U, with the joint data JD, to generate a moving image as the first composite image SP1.

[0097] Since the terminal device 10 has the above configuration, the end user U can view a video in which a virtual full-body image of the end user U trying on two or more outfits moves in accordance with the end user's movements. In particular, the terminal device 10 moves the joint data JD included in the shape data FD indicating the three-dimensional shape of the outfit in accordance with the movement of the skeleton data KD that deforms in accordance with the movements of the end user U. As a result, the terminal device 10 can move the virtual full-body image of the end user U more naturally.

[0098] As described above, the simulation system 1 includes the scanning device 20 and the terminal device 10. The scanning device 20 performs a three-dimensional scan of the costume and generates costume data CD.

[0099] The simulation system 1 has the above-described configuration, so that the administrator of the simulation system 1 can easily create the image data PD and the costume data CD of a costume without manually inputting each data element that makes up the image data PD and the costume data CD one by one. Furthermore, the simulation system 1 can simulate a virtual try-on using the easily created image data PD and the costume data CD.

[0100] 2: Variation The present disclosure is not limited to the above-described exemplary embodiments. Specific modified embodiments are exemplified below. Two or more embodiments selected arbitrarily from the following examples may be combined.

[0101] 2-1: Variation 1 In the above embodiment, the tag data GD includes overlapping order indices that the terminal device 10 uses to determine the overlapping order of two or more outfits. However, the tag data GD may include type data indicating the outfit type instead of the overlapping order indices. In this case, the storage device 12 of the terminal device 10 stores a correspondence table that lists the correspondence between outfit types, such as T-shirts, long-sleeved shirts, and sweaters, and the overlapping order indices. The overlapping order determination unit 115 may determine the outfit order by comparing the outfit types specified in the outfit data CD obtained from the server 30 with the correspondence table.

[0102] 2-2: Variation 2 In the above embodiment, the user of the scanning device 20 inputs the overlapping order index indicating the overlapping order of the costumes from the input device 26. However, the scanning device 20 may generate the costume overlapping order index using a trained model. More specifically, the generation unit 212 of the scanning device 20 may input image data PD indicating a 3D image of the costume C generated by the scanning device 20 into the trained model, thereby outputting the overlapping order index of the costume C from the trained model. The trained model is generated by machine learning using training data including multiple pairs of image data PD indicating the 3D image of the costume and the costume overlapping order index.

[0103] Alternatively, as described in Modification 1, when the tag data GD includes type data indicating the type of costume instead of the stacking order index, the scanning device 20 may generate the type of costume using a trained model. More specifically, the generation unit 212 included in the scanning device 20 may input image data PD indicating a 3D image of the costume C generated by itself into the trained model, thereby outputting the type of the costume C from the trained model. The trained model is generated by machine learning using training data including multiple pairs of image data PD indicating the 3D image of the costume and the costume type.

[0104] 2-3: Variation 3 In the above embodiment, the terminal device 10 outputs selection information indicating the selection results of two or more costumes accepted by the accepting unit 113 to the server 30, and acquires the correspondence data RD corresponding to the selection information from the server 30. However, the terminal device 10 may not output the selection information to the server 30, and may unconditionally acquire the correspondence data RD for all costumes from the server 30.

[0105] 2-4: Variation 4 In the overall configuration shown in Fig. 1, the terminal device 10, the scanning device 20, and the server 30 are separate entities. However, two or more of the terminal device 10, the scanning device 20, and the server 30 may be housed in the same housing. In other words, two or more of the devices shown in the overall configuration of Fig. 1 may be realized as a single device.

[0106] 3:Other (1) In the above-described embodiment, storage device 12, storage device 22, and storage device 32 are exemplified by ROM and RAM, but may be a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory device (e.g., a card, a stick, a key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or any other suitable storage medium. The program may also be transmitted from a network via a telecommunications line. The program may also be transmitted from a communications network NET via a telecommunications line.

[0107] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0108] (3) In the above-described embodiment, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0109] (4) In the above-described embodiment, the determination may be made by a value (0 or 1) represented using one bit, by a Boolean value (true or false), or by a comparison of numerical values ​​(e.g., comparison with a predetermined value).

[0110] (5) The order of the process procedures, sequences, flowcharts, etc. illustrated in the above-described embodiments may be rearranged unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0111] (6) Each function illustrated in Figures 1 to 15 is realized by any combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically coupled, or may be realized by using two or more devices that are physically or logically separated and connected directly or indirectly (for example, by wire, wirelessly, etc.). A functional block may also be realized by combining software with the one device or the multiple devices.

[0112] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other names.

[0113] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0114] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0115] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or corresponding other information.

[0116] (10) In the above-described embodiments, the terminal device 10, the scanning device 20, and the server 30 may be mobile stations (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, a mobile unit, a subscriber unit, a wireless unit, a remote unit, a mobile device, a wireless device, a wireless communication device, a remote device, a mobile subscriber station, an access terminal, a mobile terminal, a wireless terminal, a remote terminal, a handset, a user agent, a mobile client, a client, or some other appropriate term. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0117] (11) In the above-described embodiments, the terms "connected," "coupled," or any variations thereof refer to any direct or indirect connection or coupling between two or more elements, including the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements are considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0118] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0119] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judgment" or "decision." In other words, "judgment" and "decision" can include regarding some action as having been "judgment" or "decision." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0120] (14) In the above embodiments, when "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive or.

[0121] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, this disclosure may include that the nouns following these articles are plural.

[0122] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0123] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0124] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure. [Explanation of symbols]

[0125] 1...Simulation system, 10...Terminal device, 11...Processing device, 12...Storage device, 13...Communication device, 14...Imaging device, 15...Display, 16...Input device, 20...Scanning device, 21...Processing device, 22...Storage device, 23...Communication device, 24...Imaging device, 25...Display, 26...Input device, 30...Server, 31...Processing device, 32...Storage device, 33...Communication device, 34...Display, 35...Input device, 111...Acquisition unit, 112...Data generation unit, 113...Reception unit , 114...output unit, 115...overlay order identification unit, 116...image generation unit, 116-1...area identification unit, 116-2...correction unit, 117...display control unit, 211...acquisition unit, 212...generation unit, 213...analysis unit, 214...output unit, 311...acquisition unit, 312...extraction unit, 313...output unit, AR1...first area, DB1...first database, DB2...second database, DS1...first dataset, PR1, PR2, PR3...control program, SP1...first composite image, SP2...second composite image

Claims

1. a processing device that simulates a case where a user wears multiple layers of clothes by referring to multiple pieces of clothing data that correspond one-to-one to multiple pieces of clothing; Each of the plurality of costume data includes: Shape data indicating a three-dimensional shape of the garment; tag data corresponding to the shape data and including an overlapping order index used to identify an overlapping order representing an order in which the plurality of garments are overlapped on one another; The processing device includes: a receiving unit that receives input of two or more costumes selected by the user from the plurality of costumes; an identification unit that identifies an overlapping order indicating that the two or more costumes are overlapped with each other based on a relative magnitude relationship between two or more overlapping order indices corresponding to the two or more costumes received by the reception unit; an image generating unit that generates a first composite image by superimposing three-dimensional images of the two or more costumes on a three-dimensional image of the user in accordance with the specified superimposition order, based on body shape data representing a three-dimensional body shape of the user and the two or more costume data; Equipped with The tag data is generated based on an analysis result of the three-dimensional image of the garment. Simulation device.

2. the two or more outfits include a first outfit worn by the user without any other outfit between the corresponding outfit and the user's body; The image generation unit a region specifying unit that specifies a first region, in which a part of the three-dimensional image of the first costume is included, within the three-dimensional image of the user when the three-dimensional image of the first costume is superimposed on the three-dimensional image of the user; a correction unit that pushes a part of the three-dimensional image of the first costume included in the first area out of the three-dimensional image of the user; The simulation device according to claim 1 , comprising:

3. the two or more outfits include a second outfit that the user wears over the first outfit, the region identifying unit identifies, when the three-dimensional image of the second costume is superimposed on a second composite image corresponding to a set of the three-dimensional image of the user corrected by the correcting unit and the three-dimensional image of the first costume corrected by the correcting unit, a second region including a part of the three-dimensional image of the second costume within the second composite image; The simulation device according to claim 2 , wherein the correction unit pushes a part of the three-dimensional image of the second costume included in the second region out of the second composite image.

4. the body shape data includes skeletal data representing a change in posture of the user's skeleton in accordance with the user's movement; the shape data includes joint data relating to the user's joints when the user wears the costume represented by the shape data; the joint data indicates relative positions of the skeleton of the user with respect to the garment and corresponding positions of the joints of the user in the garment; The simulation device according to claim 1 , wherein the image generating unit compares the skeletal data with the joint data to generate a moving image as the first composite image.

Images