Information processing systems, information processing methods, programs

Abstract

To improve the efficiency of the work involved in generating 3D models. [Solution] The information processing system includes a reception unit that receives selections from the user regarding a first adjustment parameter relating to the body shape of a three-dimensional model of a living organism, and a second adjustment parameter different from the first adjustment parameter, and a display control unit that displays a first display content in which data points corresponding to multiple body shape data are plotted on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes, and when any position on the two-dimensional map is selected, the display control unit displays a three-dimensional model based on the values ​​of the first adjustment parameter and the second adjustment parameter corresponding to the position as a second display content.

Description

Technical Field

[0001] The present technology relates to an information processing system, an information processing method, and a program, and particularly relates to a technology for generating a three-dimensional model of a living organism.

Background Art

[0002] Conventionally, an apparatus has been proposed that displays on a monitor an avatar representing the actual body shape of a user and an avatar representing the target body shape of the user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, when creating a three-dimensional model of a living organism such as a digital human, adjustment parameters are changed via a one-dimensionally movable slider. In such an adjustment method, since the plurality of adjustment parameters are each independent, it has been difficult to rationally understand and edit the overall balance while maintaining consistency between the adjustment parameters. That is, intuitive and easy-to-understand operations cannot be performed, and labor and time are required when generating the three-dimensional model.

[0005] The present technology has been made in view of the above circumstances, and an object thereof is to improve work efficiency when generating a three-dimensional model.

Means for Solving the Problems

[0006] The information processing system relating to this technology includes a reception unit that receives selections from the user regarding a first adjustment parameter relating to the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter, and a display control unit that displays a first display content in which data points corresponding to multiple body shape data are plotted on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes, wherein when any position on the two-dimensional map is selected, the display control unit displays the three-dimensional model based on the values ​​of the first adjustment parameter and the second adjustment parameter corresponding to the selected position as a second display content. The information processing device allows users to intuitively change adjustment parameters, thereby improving the efficiency of work when generating 3D models. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram showing an example of the hardware configuration of an information processing device, which is one embodiment of the information processing system related to this technology. [Figure 2] This is a diagram showing an example of the generation screen. [Figure 3] This figure shows an example of adjustment parameters. [Figure 4] This diagram illustrates the dropdown display for the X-axis item selection area. [Figure 5] This diagram illustrates the dropdown display for the Y-axis item selection area. [Figure 6] This figure shows the generation screen when the X-axis item selection area and the Y-axis item selection area are selected and displayed. [Figure 7] This diagram shows an example of displaying a dropdown menu sorted by importance. [Figure 8] This figure shows an example of displaying a pull-down menu sorted by correlation. [Figure 9] This figure shows the distribution and safe area of ​​body shape data plots when the adjustment parameters are "height" and "waist." [Figure 10]This is a diagram showing the distribution of body shape data plots and a safe area when the adjustment parameters are "hips" and "thighs". [Figure 11] This is a diagram illustrating an example of the selection order of combinations of adjustment parameters. [Figure 12] This is a diagram illustrating an example of the selection order of combinations of external features and anatomical features or linguistic features. [Figure 13] This is a functional block diagram showing the functions possessed by the processor of the information processing apparatus. [Figure 14] This is a functional block diagram showing the functions possessed by the preprocessing unit. [Figure 15] This is a functional block diagram showing the functions possessed by the display control unit. [Figure 16] This is a block diagram showing the flow of preprocessing. [Figure 17] This is a block diagram showing the flow of display control processing. [Figure 18] This is a flowchart of preprocessing. [Figure 19] This is a flowchart of display control processing. [Figure 20] This is a flowchart of generation screen display processing. [Figure 21] This is a flowchart of item selection processing. [Description of Embodiments]

[0008] Hereinafter, with reference to the accompanying drawings, embodiments of the present technology will be described in the following order. <1. Configuration example of information processing system as an embodiment> <2. About digital human> <3. Generation screen as an embodiment> <4. Functions possessed by the information processing apparatus as an embodiment> <5. Processing procedure> <6. Modification example> <7. Summary of the embodiment> <8. Present technology>

[0009] <1. Example of an information processing system configuration as an embodiment> Figure 1 is a block diagram showing an example of the hardware configuration of an information processing device 1 as one embodiment of the information processing system related to this technology. Herein, the term "system" in this specification is not limited to a configuration consisting of multiple devices, but also encompasses a configuration consisting of a single device. In this case, a "system" can also be a configuration consisting solely of a processor, which is an arithmetic processing circuit.

[0010] The information processing device 1 of this embodiment is used as a device that displays the generation screen for generating a digital human on the display unit 17.

[0011] As shown in Figure 1, the information processing device 1 includes a processor 11. The processor 11 is configured to have at least an arithmetic processing circuit such as a CPU, and executes various processes according to a program stored in the ROM 12 or a program loaded from the storage unit 19 into the RAM 13. Here, in order to efficiently perform various image signal processing, the processor 11 may also be configured to have a GPU (Graphics Processing Unit) in addition to the CPU.

[0012] RAM13 also stores data necessary for the processor 11 to perform various processes. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output interface (I / F) 15 is also connected to this bus 14.

[0013] An input unit 16, consisting of an operator or operating device, is connected to the input / output interface 15. For example, the input unit 16 could be various operators or operating devices such as a keyboard, mouse, keys, dial, touch panel, touchpad, or remote controller. In this embodiment, the input unit 16 is assumed to be a mouse or touch panel capable of screen operation. The input unit 16 detects user operations, and the signal corresponding to the input operation is interpreted by the processor 11.

[0014] Furthermore, the input / output interface 15 is connected either as an integrated unit or separately to a display unit 17 consisting of an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) panel, and to an audio output unit 18 consisting of a speaker or the like.

[0015] The display unit 17 displays images for various image processing tasks and videos to be processed on the display screen based on instructions from the processor 11. The display unit 17 also displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the processor 11.

[0016] The input / output interface 15 may also be connected to a storage unit 19 consisting of an HDD (Hard Disk Drive) or solid memory, and a communication unit 20 consisting of a modem or the like.

[0017] The communication unit 20 performs wired or wireless data communication with an external device. For example, it may be configured to perform wired data communication with an external device in accordance with a predetermined wired communication standard such as the USB (Universal Serial Bus) communication standard, wireless data communication with an external device in accordance with a predetermined wireless communication standard such as the Bluetooth communication standard, or wireless or wired data communication with an external device via a predetermined communication network such as the Internet. The processor 11 can send and receive data with external devices via the communication unit 20.

[0018] Furthermore, a drive 21 is connected to the input / output interface 15 as needed, and a removable recording medium 22 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory is appropriately mounted.

[0019] Drive 21 allows data (including computer programs, etc.) used for various processes to be read from the removable recording medium 22. The read data is stored in the storage unit 19, or, if the read data is image data or audio data, the image or audio is output by the display unit 17 or the audio output unit 18. The computer program read from the removable recording medium 22 is installed in the storage unit 19 as needed.

[0020] In the information processing device 1 having the hardware configuration described above, for example, the software for processing in this embodiment can be installed via network communication by the communication unit 20 or via the removable recording medium 22. Alternatively, the software may be pre-stored in the ROM 12 or the storage unit 19, etc. The processor 11 performs processing operations based on various programs, thereby executing the necessary information processing and communication processing as the information processing device 1.

[0021] Specific examples of the information processing device 1 include PCs (personal computers), smartphones, and tablet devices.

[0022] Furthermore, the information processing system as an embodiment is not limited to being composed of a single computer device such as the information processing device 1 shown in Figure 1, but may be composed of multiple computer devices. The multiple computer devices may be systematized using a LAN (Local Area Network), or they may be located in remote locations using a VPN (Virtual Private Network) via the Internet, etc. The multiple computer devices may include computer devices that function as a group of servers (cloud) available through cloud computing services.

[0023] <2. About Digital Humans> As described above, the information processing device 1 of this embodiment is used as a device that displays the generation screen for generating a digital human on the display unit 17.

[0024] A digital human is a three-dimensional model of a human being displayed on a computer screen. Digital humans are used, for example, as game characters, avatars used on social media, or in the metaverse.

[0025] In this embodiment, 3DMM (3D Morphable Mode) is used as the method for creating digital humans. 3DMM is a generative technology for parametrically modeling three-dimensional faces and human bodies. In 3DMM, Principal Component Analysis (PCA) is used to represent the shape of a person using multiple parameters. Below, the parameters of Principal Component Analysis in 3DMM will be referred to as 3DMM parameters or principal component parameters.

[0026] As will be explained in more detail later, the information processing device 1 pre-calculates 3DMM parameters by performing 3DMM analysis on multiple body shape data, and then generates a digital human on the generation screen based on the 3DMM parameters corresponding to the adjustment parameters selected by the user.

[0027] Furthermore, the method for generating digital humans is not limited to 3DMM; other generation methods may also be used. Additionally, in 3DMM, the shape of a person may be represented using multiple parameters, using methods other than principal component analysis.

[0028] <3. Generation screen as an embodiment> Referring to Figures 2 to 11, the generation screen 100, as an embodiment used when generating a digital human, will be described. Here, the generation screen 100 is displayed on the display unit 17 based on the control of the processor 11. That is, the processor 11 causes the generation screen 100 to be displayed on the display unit 17.

[0029] Figure 2 shows an example of the generation screen 100. As shown in Figure 2, the generation screen 100 consists of a digital human display area 101, a 2D map display area 102, an X-axis item selection area 103, a Y-axis item selection area 104, and an example display area 105 (105A, 105B, 105C).

[0030] The digital human display area 101 displays the digital human 131 in two dimensions as it is being generated. In the digital human display area 101, the digital human 131 can be enlarged, reduced, or rotated in response to operations on the input unit 16, allowing the user to display the digital human 131 in the manner desired by the user.

[0031] The 2D map display area 102 displays a 2D map 121 where the adjustment parameters displayed in the X-axis item selection area 103 and the Y-axis item selection area 104 are used as the X-axis and Y-axis, respectively.

[0032] The X-axis item selection area 103 and the Y-axis item selection area 104 display the adjustment parameters selected by the user from among several adjustment parameters that can be adjusted when generating the digital human 131.

[0033] In the X-axis item selection area 103 and the Y-axis item selection area 104, multiple adjustment parameters that can be selected according to the operation of the input unit 16 are displayed, for example, by a pull-down menu, and the adjustment parameter selected by the user via the operation of the input unit 16 from among the displayed multiple adjustment parameters is displayed.

[0034] In Figure 2, the X-axis item selection area 103 and the Y-axis item selection area 104 are labeled "X-axis adjustment item selection" and "Y-axis adjustment item selection," respectively. This indicates that no adjustment parameters are selected in the initial settings. However, in the initial settings, one of several adjustment parameters may be set as the default and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104.

[0035] Figure 3 shows an example of adjustment parameters. The information processing device 1 is provided with adjustment parameters for external features, anatomical features, and linguistic features. Both adjustment parameters and 3DMM parameters are common to all parameters used to change the shape of the digital human 131. However, 3DMM parameters are parameters used in 3DMM and are difficult for users to understand intuitively. On the other hand, adjustment parameters are parameters that users can understand intuitively.

[0036] The external features adjustment parameters are parameters for adjusting the digital human 131 from an external perspective, and there are 12 parameters provided: height, weight, shoulder width, waist, inseam, thigh, hip, ankle, arm length, upper body / lower body ratio, and arm circumference. For example, height is an adjustment parameter for adjusting the height of digital human 131. Similarly, weight, shoulder width, waist, inseam, thigh, hip, ankle, arm length, upper body / lower body ratio, and arm circumference are adjustment parameters for adjusting the weight, shoulder width, waist, inseam, thigh, hip, ankle, arm length, upper body / lower body ratio, and arm circumference of digital human 131, respectively.

[0037] The anatomical feature adjustment parameters are parameters used to adjust the digital human 131 from an anatomical perspective, and for example, there are three parameters: body fat percentage, muscle mass, and degree of kyphosis (hunchback). Body fat percentage, muscle mass, and degree of kyphosis are adjustment parameters used to control the body fat percentage, muscle mass, and degree of kyphosis of Digital Human 131.

[0038] The linguistic feature adjustment parameters are parameters for adjusting the digital human 131 from a linguistic perspective, and two such parameters are provided, for example, the inverted triangle degree and the model body type degree. The inverted triangle degree and model body type degree are adjustment parameters for adjusting the inverted triangle degree and model body type degree of Digital Human 131.

[0039] Figure 4 illustrates the dropdown display for the X-axis item selection area 103. Figure 5 illustrates the dropdown display for the Y-axis item selection area 104. Figure 6 shows the generation screen 100 when adjustment parameters are displayed in the X-axis item selection area 103 and the Y-axis item selection area 104. Note that in Figure 4, displays other than the X-axis item selection area 103 are omitted. Similarly, in Figure 5, displays other than the X-axis item selection area 103 and the Y-axis item selection area 104 are omitted.

[0040] When the X-axis item selection area 103 is selected via the input unit 16, multiple adjustment parameters are displayed as a pull-down menu 141 below the X-axis item selection area 103, as shown in Figure 4. However, if all adjustment parameters were displayed as a pull-down menu 141, the menu would become too long vertically. Therefore, only a portion of the multiple adjustment parameters are displayed as a pull-down menu 141. In the example in Figure 4, five adjustment parameters are displayed in the pull-down menu 141. Then, when the pull-down menu 141 is scrolled by the input unit 16, the adjustment parameters are scrolled and displayed according to the scroll operation, and the adjustment parameters that were previously hidden are displayed in the pull-down menu 141.

[0041] When the Y-axis item selection area 104 is selected via the input unit 16, as shown in Figure 5, multiple adjustment parameters are displayed below the Y-axis item selection area 104 as a pull-down menu 142. Similar to the pull-down menu 141, only a portion of the multiple adjustment parameters are displayed in the pull-down menu 142. The adjustment parameters displayed in the X-axis item selection area 103 will not be shown in the pull-down menu 142. As shown in Figure 5, if the adjustment parameter for "height" is displayed in the X-axis item selection area 103, the pull-down menu 142 will display adjustment parameters excluding "height". Similarly, the adjustment parameters displayed in the Y-axis item selection area 104 will not be displayed in the pull-down menu 141.

[0042] Thus, when adjustment parameters selected by the user are displayed in the X-axis item selection area 103 and the Y-axis item selection area 104, a 2D map 121 is displayed in the 2D map display area 102, where the X-axis becomes the adjustment parameters displayed in the X-axis item selection area 103 and the Y-axis becomes the adjustment parameters displayed in the Y-axis item selection area 104.

[0043] As shown in Figure 6, when the adjustment parameter for "height" is displayed in the X-axis item selection area 103 and the adjustment parameter for "weight" is displayed in the Y-axis item selection area 104, the 2D map display area 102 will display a 2D map 121 where the X-axis is "height" and the Y-axis is "weight".

[0044] On the 2D map 121, a selection cursor 122, multiple example plots 123, a body shape data plot 124, and a safe area 125 are displayed overlaid on top of each other.

[0045] The selection cursor 122 is a cursor that allows the user to select any position on the 2D map 121. The user can move the selection cursor 122 on the 2D map 121 via the input unit 16.

[0046] When the selection cursor 122 is moved via the input unit 16, the digital human 131, with its adjustment parameter values ​​changed according to the position of the moved 2D map 121, is displayed in the digital human display area 101. In the following, the adjustment parameter values ​​may be referred to as features.

[0047] Specifically, when "Height" is displayed in the X-axis item selection area 103, when the selection cursor 122 is moved along the X-axis, the digital human 131, with its "Height" feature quantity modified according to the position of the selection cursor 122, is displayed in the digital human display area 101. Note that the X-axis is set so that values ​​increase as you move to the right and decrease as you move to the left. Therefore, in the example shown in Figure 6, when the selection cursor 122 is moved to the right in the 2D map 121, the height of the digital human 131 is adjusted to increase, and when the selection cursor 122 is moved to the left, the height of the digital human 131 is adjusted to decrease.

[0048] Similarly, if "Weight" is displayed in the Y-axis item selection area 104, when the selection cursor 122 is moved along the Y-axis, the digital human 131, with its "Weight" feature quantity modified according to the position of the selection cursor 122, will be displayed in the digital human display area 101. Note that the Y-axis is set so that values ​​increase as you move upwards and decrease as you move downwards. Therefore, in the example in Figure 6, when the selection cursor 122 is moved upwards in the 2D map 121, the digital human 131 appears to have gained weight, and when the selection cursor 122 is moved downwards, the digital human 131 appears to have lost weight.

[0049] Furthermore, if the feature quantities of the adjustment parameters displayed in the X-axis item selection area 103 and the Y-axis item selection area 104 are changed on the 2D map 121, the feature quantities of other adjustment parameters may also be changed. For example, if the adjustment parameter displayed in the Y-axis item selection area 104 is "weight," moving the selection cursor 122 upwards will cause the digital human 131 to appear fatter. In this case, the digital human 131 will appear to bulge horizontally overall. At this time, the feature quantities of the adjustment parameters for shoulder width, threat, waist, hips, ankles, and arm circumference will also be changed accordingly.

[0050] Example plot 123 shows the feature quantities of the adjustment parameters, which are previously stored (bookmarked) in the memory unit 19, plotted on the two-dimensional map 121. Here, the information processing device 1 has a bookmark function that saves and stores characteristic quantities of adjustment parameters in the memory unit 19 during the process of generating a digital human 131 using the generation screen 100.

[0051] Three example plots 123 are displayed as icons of different shapes or colors. However, there may be any number of example plots 123, and example plots 123 may not be displayed at all. In the examples in Figures 2 and 6, three example plots 123 are shown as example plots 123A, 123B, and 123C, respectively.

[0052] The example display area 105 displays a digital human 151 corresponding to the example plot 123 on the 2D map 121. Therefore, the same number of example display areas 105 are provided as the number of example plots 123 plotted on the 2D map 121. In the examples of Figures 2 and 6, example display areas 105A, 105B, and 105C are provided as example display areas 105.

[0053] Then, for example, the digital human 151A corresponding to example plot 123A is displayed in the example display area 105A on the left, the digital human 151B corresponding to example plot 123B is displayed in the example display area 105B in the center, and the digital human 151C corresponding to example plot 123C is displayed in the example display area 105C on the right.

[0054] Furthermore, the example display area 105 includes an example icon 152, for example, in the upper left corner, to make the correspondence with the example plot 123 plotted on the 2D map 121 easier to understand. The example icon 152 may have the same shape and color as the example plot 123, or it may have the same shape or color only. In the examples of Figures 2 and 6, example plots 123A, 123B, and 123C are displayed as example plot 123, respectively.

[0055] Thus, on the generation screen 100, the example plot 123 is displayed on the 2D map 121, and the digital human 151 corresponding to the example plot 123 is displayed in the example display area 105. This allows the user to see the example digital human 151 and digital human 131 simultaneously. Therefore, the user can easily imagine how the digital human 131 will be adjusted by moving the selection cursor 122 on the 2D map 121, by referring to the digital human 151. In other words, by displaying the digital human 151 on the generation screen 100, the user can intuitively grasp the adjustments needed to generate the desired digital human 131.

[0056] In this case, the information processing device 1 stores multiple (for example, on the order of thousands) of feature quantities of multiple adjustment parameters of an actual person as body shape data in the storage unit 19. In other words, multiple body shape data are stored in the storage unit 19.

[0057] Then, when either of the adjustment parameters is displayed in the X-axis item selection area 103 or the Y-axis item selection area 104, a body shape data plot 124 is plotted on the 2D map 121 based on the feature quantities of the X-axis and Y-axis adjustment parameters shown in the body shape data stored in the memory unit 19. For each body shape data, one point will be plotted on the 2D map 121.

[0058] The body shape data plot 124 may be plotted for all body shape data stored in the storage unit 19, or a predetermined number of body shape data may be extracted from the body shape data stored in the storage unit 19 and plotted.

[0059] For example, as shown in Figure 6, by displaying numerous body shape data plots 124 based on the features of actual people's adjustment parameters on a two-dimensional map 121, users can intuitively grasp the trends in the shape, mean, variance, etc., of the distribution of actual people.

[0060] Furthermore, the 2D map 121 displays a safe area 125, which is within 95% of the mean, based on the assumption that the feature quantities of the adjustment parameters for the X and Y axes in the multiple body shape data stored in the memory unit 19 follow a normal distribution.

[0061] The safe area 125 is defined as the range within which a human-like shape, or in other words, human-likeness, can be maintained. Therefore, the user can intuitively understand the range within which human-likeness can be maintained by the safe area 125. Furthermore, the information processing device 1 can generate a digital human 131 with a human-like shape by moving the selection cursor 122 within the safe area 125.

[0062] Figure 7 shows an example of displaying pull-down menus 141 and 142 in order of importance.

[0063] As mentioned above, multiple adjustment parameters are provided for adjusting the digital human 131. Each adjustment parameter has a different degree of deformation of the digital human 131's shape. For example, if the adjustment parameter is "height," changing the value of this parameter will cause the digital human 131 to deform significantly, either larger or smaller overall, thus having a large impact on the digital human 131's shape. On the other hand, if the adjustment parameter is "arm circumference," changing this parameter will only deform the digital human 131's arm circumference, either larger or smaller, thus having a small impact on the digital human 131's shape.

[0064] Therefore, several adjustment parameters are assigned a pre-assigned importance level. This importance level is determined during the pre-processing described later. The higher the importance of an adjustment parameter, the greater the impact that changing the value of that parameter has on the deformation of the shape of the digital human 131. In this embodiment, the importance of the parameters is set to decrease in the following order: height, weight, shoulder width, chest circumference, waist, inseam, and thigh circumference. In other words, height is set to be the most important parameter, and weight is set to be the second most important parameter.

[0065] Furthermore, as shown in Figure 7, the importance level may also be displayed for the adjustment parameters shown in the X-axis item selection area 103, the Y-axis item selection area 104, and the pull-down menus 141 and 142. In the example in Figure 8, the adjustment parameter "height" has the highest importance level, so it is displayed as "1: Height" in the Y-axis item selection area 104.

[0066] In this way, by indicating the importance level alongside the adjustment parameters displayed in the X-axis item selection area 103, the Y-axis item selection area 104, and the pull-down menus 141 and 142, it is possible to show the user which adjustment parameter to operate first to deform the digital human 131 overall.

[0067] Additionally, the adjustment parameters displayed in the pull-down menus 141 and 142 may be displayed in order of importance. As shown in Figure 7, the pull-down menu 142 displays the parameters in order of importance, namely "shoulder width," "chest circumference," "waist," "inseam," and "thigh circumference."

[0068] Thus, the adjustment parameters displayed in the pull-down menus 141 and 142, that is, the adjustment parameters that are candidates for the X and Y axes of the 2D map 121, may be displayed in order of importance, or the order of importance may be listed alongside the parameters, or they may be color-coded according to their importance, as will be described later for the correlation.

[0069] Figure 8 shows an example of displaying pull-down menus 141 and 142 in order of correlation. Figure 9 shows the distribution of body shape data plots 124 and the safe area 125 when the adjustment parameters are "height" and "waist". Figure 10 shows the distribution of body shape data plots 124 and the safe area 125 when the adjustment parameters are "hips" and "thighs".

[0070] When two adjustment parameters are selected from the above-mentioned set of adjustment parameters to form the X and Y axes, there are cases where one adjustment parameter and the other adjustment parameter have a proportional relationship. Such two adjustment parameters can be said to have a high correlation.

[0071] For example, as shown in Figure 9, the adjustment parameters "hip" and "thigh" have a high correlation. Therefore, in a 2D map 121 with the adjustment parameters "hip" and "thigh" as the X and Y axes, the body shape data plot 124 will be distributed in a long, narrow shape from the bottom left to the bottom right on the 2D map 121, and the area of ​​the safe area 125 will be narrow. In such a case, if a user wants to change the adjustment parameters "hip" and "thigh" within a range that maintains a human-like shape, they must select from a range that is almost a straight line from the bottom left to the top right on the 2D map 121.

[0072] In other words, if you select two highly correlated adjustment parameters as the X and Y axes, the changes to the adjustment parameters become one-dimensional, narrowing the range of choices.

[0073] On the other hand, changing one adjustment parameter may have little effect on the other. Such two adjustment parameters can be said to have a low correlation.

[0074] For example, as shown in Figure 10, the adjustment parameters "height" and "waist" have a low correlation. Therefore, in a 2D map 121 with the adjustment parameters "height" and "waist" as the X and Y axes, the body shape data plot 124 will be distributed two-dimensionally over a wide range, and the area of ​​the safe area 125 will also be large. In such a case, when a user tries to select the adjustment parameters "height" and "waist" within a range that maintains a human-like shape, they can select from a wide range on the 2D map 121.

[0075] In other words, by selecting and displaying two adjustment parameters with low correlation in the X-axis item selection area 103 and the Y-axis item selection area 104, the adjustment parameter changes become two-dimensional, and the range of selection is broadened.

[0076] Therefore, in the information processing device 1, the degree of correlation between each of the multiple adjustment parameters and other adjustment parameters is predetermined. The degree of correlation is determined by the pre-processing described later. For example, with the adjustment parameter "weight," the correlation is set to be lowest in the order of "waist," "thigh," "chest circumference," "shoulder width," and "inseam." In other words, with the adjustment parameter "weight," the correlation is set to be lowest for "inseam" and second lowest for "shoulder width."

[0077] As shown in Figure 8, the adjustment parameters displayed in the pull-down menus 141 and 142 may be displayed in order of correlation, or they may be color-coded according to their correlation. In the example in Figure 9, assume that the adjustment parameter "weight" is selected in the X-axis item selection area 103. When the pull-down menu 142 is displayed, the adjustment parameters with a lower correlation to the selected adjustment parameter "weight" in the X-axis item selection area 103 will be displayed at the top, and those with a higher correlation will be displayed at the bottom. Additionally, the "waist" measurement, which has the highest correlation, is displayed in blue, for example; the "thigh" measurement, which has the second highest correlation, is displayed in light blue, for example; and the "inseam" measurement, which has the lowest correlation, is displayed in red, for example.

[0078] In this way, by showing the correlation between the adjustment parameters displayed in the pull-down menus 141 and 142, it becomes easy and intuitive to understand combinations of adjustment parameters that broaden the range of maintaining a human-like shape.

[0079] Note that the display examples of adjustment parameters shown in the X-axis item selection area 103, Y-axis item selection area 104, and pull-down menus 141 and 142 in Figures 7 and 8 are merely examples, and other display methods are possible based on either or both of the importance and correlation of the adjustment parameters. For example, possible display methods include displaying the importance or correlation order together, color-coding, or sorting.

[0080] For example, when displaying adjustment parameters in pull-down menus 141 and 142 based on importance, the adjustment parameters in pull-down menus 141 and 142 may be color-coded, or they may not be displayed in order of importance. Also, in the example in Figure 8, when displaying adjustment parameters in pull-down menus 141 and 142 based on correlation, importance is also displayed, but importance does not have to be displayed. Furthermore, when displaying adjustment parameters in pull-down menus 141 and 142 based on correlation, the order of correlation may also be displayed.

[0081] The display method for the adjustment parameters shown in the X-axis item selection area 103, the Y-axis item selection area 104, and the pull-down menus 141 and 142 may be selected by the user or may be pre-set.

[0082] Figure 11 illustrates an example of the selection order for a combination of adjustment parameters. In the generation screen 100, as described above, two adjustment parameters are selected from multiple adjustment parameters and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104, and a 2D map 121 in which the selected adjustment parameters are orthogonal axes is displayed in the 2D map display area 102.

[0083] Furthermore, one possible method for selecting two adjustment parameters from multiple adjustment parameters is to refer to at least one of the importance and correlation values ​​of the selection parameters displayed in the pull-down menus 141 and 142.

[0084] When generating a digital human 131, it is easier to generate a digital human 131 with the desired shape by first determining the general shape and then sequentially determining the local shape.

[0085] Therefore, it is conceivable to continuously change two adjustment parameters, starting with the combination of adjustment parameters that determines the general shape, and then the combination of adjustment parameters that determines the local shape. For example, as shown in Figure 11, first, the adjustment parameters for "height" and "waist" are selected and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104. The adjustment parameter for "height" has the highest importance, and "height" and "waist" are a combination with a low correlation. Therefore, by selecting the adjustment parameters for "height" and "waist," the general shape of the digital human 131 can be selected by moving the selection cursor 122 from a wide range on the 2D map 121.

[0086] Subsequently, the adjustment parameters for "height" and "upper body / lower body ratio" are selected and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104. Since "upper body / lower body ratio" is an adjustment parameter that determines the upper body / lower body ratio of the digital human 131, it can be used to determine the general shape of the digital human 131.

[0087] Subsequently, the adjustment parameters are selected and displayed in the X-axis item selection area 103 and Y-axis item selection area 104 in the following order: combination of "waist" and "hips", combination of "hips" and "thighs", combination of "thighs" and "ankles", and combination of "shoulder width" and "arm length". These combinations gradually determine the shape of the digital human 131 locally.

[0088] In this way, by selecting two adjustment parameters that form the axes of the 2D map 121 as a reference for the importance and correlation of the adjustment parameters, it is possible to get an idea of ​​how coarse or local the shape of the digital human 131 is.

[0089] Figure 12 illustrates an example of the selection of combinations of external features and anatomical or linguistic features. As mentioned above, the adjustment parameters include adjustment parameters for anatomical and linguistic features in addition to external features.

[0090] Furthermore, on the generation screen 100, it is possible to select not only combinations of adjustment parameters for external features, but also combinations of adjustment parameters for external and anatomical features, and combinations of adjustment parameters for external and linguistic features.

[0091] For example, as shown in Figure 12, combinations of adjustment parameters for external and anatomical features, such as "waist" and "body fat percentage," "arm circumference" and "muscle mass," and "height" and "degree of hunchback," are selected and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104. This allows for the generation of a digital human 131 by changing not only external but also anatomical features, thereby enabling the creation of a digital human 131 with a shape more closely matched to the user's preferences.

[0092] Furthermore, combinations of adjustment parameters for external and linguistic features, such as "chest circumference" and "inverted triangle shape," and "weight" and "model body type," are selected and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104. This allows the digital human 131 to be generated by changing not only external but also linguistic features, making it possible to intuitively generate a digital human 131 with a shape that more closely matches the user's desires.

[0093] <4. Functions of the Information Processing Device as an Embodiment> [4.1. Functional blocks of Processor 11] Figure 13 is a functional block diagram showing the functions of the processor 11 of the information processing device 1 in order to realize the display function of the generated screen 100 as described above. Figure 14 is a functional block diagram showing the functions of the pre-processing unit 31. Figure 15 is a functional block diagram showing the functions of the display control unit 32. As shown in Figure 13, the processor 11 has the functions of a pre-processing unit 31 and a display control unit 32.

[0094] The pre-processing unit 31 calculates the values ​​of the adjustment parameters based on the numerous body shape data stored in the memory unit 19, and also calculates the values ​​of the 3DMM parameters based on the body shape data. Furthermore, the pre-processing unit 31 uses machine learning to determine the relationship between the values ​​of the adjustment parameters and the 3DMM parameters based on the numerous body shape data, and calculates their correlation and importance. At this point, the preprocessing unit 31 functions in more detail as a 3DMM parameter measurement unit 41, a feature measurement unit 42, a calculation unit 43, and a learning unit 44, as shown in Figure 14. Details of these functional units will be described later.

[0095] The display control unit 32 performs various processes to display the generated screen 100 on the display unit 17. As shown in Figure 15, the display control unit 32 functions in more detail as a reception unit 51, a 3DMM parameter estimation unit 52, a 3DMM processing unit 53, a bookmark management unit 54, a feature measurement unit 55, an index distribution management unit 56, and a UI display unit 57. Details of these functional units will be described later.

[0096] [4.2. Pre-processing] Next, we will explain the pre-processing performed by the pre-processing unit 31. Figure 16 is a block diagram showing the flow of the pre-processing steps.

[0097] As shown in Figure 16, the 3DMM parameter measurement unit 41 reads a set of body shape data (hereinafter referred to as the body shape dataset 61) stored in the storage unit 19. The 3DMM parameter measurement unit 41 then performs principal component analysis of the 3DMM parameters for each body shape data included in the body shape dataset 61 and calculates the values ​​of the 3DMM parameters. The calculated values ​​of the 3DMM parameters for each body shape data are referred to as the 3DMM parameter set 62.

[0098] The feature measurement unit 42 extracts values ​​(features) of multiple external feature adjustment parameters for each body shape data contained in the body shape dataset 61 stored in the memory unit 19. Note that the body shape data contained in the body shape dataset 61 already includes the values ​​of the external feature adjustment parameters.

[0099] Furthermore, the feature measurement unit 42 labels each body type data contained in the body type dataset 61 stored in the memory unit 19 with a value for the linguistic feature adjustment parameter on a scale of 1 to 10, for example. Here, a base model capable of understanding images (e.g., VLM (Vision-Language Model)) can be used. When using a base model, it is possible to obtain the value of the linguistic feature adjustment parameter by performing a labeling task with prompts such as "Is this body type slender?", "How chubby is this body type?", "Describe this person's body type", and "What category does this body type belong to?", and classifying the output.

[0100] Furthermore, if the body shape data in the body shape dataset 61 stored in the memory unit 19 contains anatomical feature values, the feature measurement unit 42 extracts values ​​for multiple anatomical feature adjustment parameters for each body shape data. If the body shape data in the body shape dataset 61 stored in the memory unit 19 does not contain anatomical feature values, the feature measurement unit 42 may calculate the values ​​for multiple anatomical feature adjustment parameters for each body shape data by performing a predetermined machine learning operation on the body shape dataset 61.

[0101] The feature measurement unit 42 then stores the values ​​of the adjustment parameters (features) extracted or calculated based on the body shape dataset 61 stored in the memory unit 19 as a feature dataset 63 in the memory unit 19.

[0102] The calculation unit 43 substitutes the 3DMM parameter set 62 and the feature dataset 63 into the following equation (1) to obtain the correlation matrix r ij Calculate.

number

[0103] Furthermore, the calculation unit 43 uses equations (2) and (3) below to determine the importance of the adjustment parameter I i Calculate.

number

number

[0104] The calculation unit 43 calculates the correlation matrix r calculated by equation (1). ij The correlation of the adjustment parameters calculated based on (2) and the importance of the adjustment parameters calculated by equation (2) are stored in the storage unit 19 as importance-correlation data 65.

[0105] The learning unit 44 uses the 3DMM parameter set 62 and the feature dataset 63 as training data to perform machine learning using methods such as a regressor or MLP (Multi-Layer Perceptron). This allows the learning unit 44 to generate a learning model 64 that estimates the values ​​of multiple 3DMM parameters from the values ​​of multiple tuning parameters. The learning unit 44 then stores the generated learning model 64 in the storage unit 19.

[0106] In this way, the preprocessing unit 31 acquires the feature dataset 63, the learning model 64, and the importance / correlation data 65 based on the body shape dataset 61. Although the acquisition of the feature dataset 63, the learning model 64, and the importance / correlation data 65 only needs to be performed once, it may also be performed each time the body shape dataset 61 is updated.

[0107] [4.3. Display Control Processing] Next, the display control process performed by the display control unit 32 will be described. Figure 17 is a block diagram showing the flow of the display control process.

[0108] First, we will explain the initialization process for displaying the generation screen 100 for the first time. The reception unit 51 of the pre-processing unit 31 obtains the initial values ​​of several adjustment parameters that are set by default.

[0109] The 3DMM parameter estimation unit 52 estimates the values ​​of multiple 3DMM parameters by inputting the initial values ​​of multiple adjustment parameters obtained by the reception unit 51 into the learning model 64.

[0110] The 3DMM processing unit 53 generates a digital human 131 using 3DMM with the estimated 3DMM parameter values. The feature measurement unit 55 analyzes the generated digital human 131 to calculate the values ​​of multiple adjustment parameters (features) for the digital human 131.

[0111] The index distribution management unit 56 extracts the features of two adjustment parameters, which are selected and displayed by default in the X-axis item selection area 103 and the Y-axis item selection area 104, from the feature dataset 63 stored in the memory unit 19, for each body shape data. The index distribution management unit 56 also calculates the safe area 125 based on the extracted features of the two adjustment parameters.

[0112] The UI display unit 57 displays the generation screen 100 based on the various values ​​calculated in this way and the generated digital human 131. Specifically, the UI display unit 57 displays two adjustment parameters that are selected by default in the X-axis item selection area 103 and the Y-axis item selection area 104. The UI display unit 57 also displays the generated digital human 131 in the digital human display area 101.

[0113] Furthermore, the UI display unit 57 plots body shape data plots 124 for each body shape data point on the 2D map 121, which is shown by the feature quantities of the two adjustment parameters extracted by the indicator distribution management unit 56, and also displays the calculated safe area 125 on the 2D map 121.

[0114] Furthermore, the UI display unit 57 extracts the feature quantities of two adjustment parameters that are selected and displayed by default from among the feature quantities of multiple adjustment parameters for the digital human 131 calculated by the feature quantity measurement unit 55, and plots the selection cursor 122 on the two-dimensional map 121 based on those feature quantities.

[0115] Furthermore, if the feature quantities of the adjustment parameters are bookmarked in the memory unit 19, the UI display unit 57 plots an example plot 123 based on the bookmarked feature quantities of the adjustment parameters and displays a digital human 151 based on the bookmarked feature quantities of the adjustment parameters in the example display area 105. In this way, the generation screen 100 as the initial screen is displayed on the display unit 17.

[0116] Subsequently, when the X-axis item selection area 103 or Y-axis item selection area 104 of the generation screen 100 is selected via the input unit 16, as shown in Figure 17, the UI display unit 57 refers to the importance / correlation data 65 and obtains the correlation and importance of each adjustment parameter corresponding to the adjustment parameters of the unselected X-axis item selection area 103 or Y-axis item selection area 104. Then, based on the obtained importance and correlation, the UI display unit 57 displays the pull-down menus 141 and 142 for the selected X-axis item selection area 103 or Y-axis item selection area 104.

[0117] The reception unit 51 then receives one of the adjustment parameters displayed in the pull-down menus 141 and 142 via the input unit 16. Once the reception unit 51 has received a selection of an adjustment parameter, the UI display unit 57 displays the newly selected adjustment parameter in the X-axis item selection area 103 or the Y-axis item selection area 104.

[0118] Furthermore, the indicator distribution management unit 56 extracts the features of the two newly selected adjustment parameters from the feature dataset 63 stored in the memory unit 19 for each body shape data, similar to when the initial screen is displayed. The indicator distribution management unit 56 also calculates the safe area 125 based on the features of the two new adjustment parameters for each body shape data.

[0119] The UI display unit 57 plots a body shape data plot 124 on the two-dimensional map 121 based on the feature quantities of the two new adjustment parameters extracted by the indicator distribution management unit 56, and also displays the calculated safe area 125 on the two-dimensional map 121. In addition, the UI display unit 57 plots a selection cursor 122 on the two-dimensional map 121 based on the feature quantities of the two new adjustment parameters for the digital human 131 displayed in the digital human display area 101.

[0120] Furthermore, if the feature quantities of the adjustment parameters are bookmarked in the memory unit 19, the UI display unit 57 plots an example plot 123 based on the bookmarked feature quantities of the adjustment parameters.

[0121] Subsequently, when the position of the selection cursor 122 is moved via the input unit 16, the reception unit 51 obtains the X and Y axis values ​​in the 2D map 121, that is, the feature quantities of multiple adjustment parameters including the feature quantities specified by the selection cursor 122 for the two new adjustment parameters, as updated feature quantities 72.

[0122] The 3DMM parameter estimation unit 52 estimates the values ​​of multiple 3DMM parameters (referred to as 3DMM parameter values ​​73 in Figure 17) by inputting the updated feature quantities 72 obtained by the reception unit 51 into the learning model 64.

[0123] The bookmark management unit 54 can save and store the updated feature quantities 7 and 3DMM parameter values ​​73 as bookmarks 74, along with the values ​​of other adjustment parameters and 3DMM parameters, in response to user instructions via the input unit 16.

[0124] The 3DMM processing unit 53 generates a digital human 131 using the 3DMM with the re-estimated 3DMM parameter values ​​73. The feature measurement unit 55 analyzes the generated digital human 131 to calculate feature quantities 71 for multiple adjustment parameters of the digital human 131.

[0125] The UI display unit 57 then displays the newly generated digital human 131 in the digital human display area 101. Subsequently, if the X-axis item selection area 103 or the Y-axis item selection area 104 is changed, or if the position of the selection cursor 122 is changed, the display control unit 32 updates and displays the generated screen 100 by repeating the same process.

[0126] <5. Processing Procedure> An example of a specific processing procedure that the processor 11 should execute in order to realize the functionality of the embodiment described above will be explained with reference to the flowcharts in Figures 18 to 21. The processes shown in Figures 18 to 21 are executed by the processor 11 based on a program stored in a predetermined storage device, such as the ROM 12 or the memory unit 19.

[0127] Figure 18 is a flowchart of the pre-processing steps. As shown in Figure 18, in step S1, the processor 11 obtains a 3DMM parameter set 62 by running 3DMM on the body shape dataset 61. In the subsequent step S2, the processor 11 extracts or calculates the features of multiple adjustment parameters from the body shape dataset 61 stored in the memory unit 19 as a feature dataset 63.

[0128] In step S3, the learning unit 44 performs machine learning using the 3DMM parameter set 62 and the feature dataset 63 as training data to generate a learning model 64. In step S4, the calculation unit 43 calculates importance and correlation data 65 by substituting the values ​​shown in the 3DMM parameter set 62 and the feature dataset 63 into equations (1), (2), and (3) described above, and then completes the preprocessing.

[0129] Figure 19 is a flowchart of the display control process. Figure 20 is a flowchart of the generated screen display process. Figure 21 is a flowchart of the item selection process. As shown in Figure 19, in step S11, the processor 11 performs feature initialization to obtain initial values ​​for several tuning parameters that are selected by default.

[0130] In step S12, the processor 11 estimates the values ​​of multiple 3DMM parameters by inputting the features of multiple tuning parameters into the learning model 64. In step S13, the processor 11 generates a digital human 131 using the estimated 3DMM parameter values ​​via the 3DMM. In step S14, the processor 11 calculates the features of multiple tuning parameters for the digital human 131 by analyzing the generated digital human 131.

[0131] In step S15, the processor 11 performs a generation screen display process to display or update the generation screen 100. As shown in Figure 20, when the generation screen display process starts, in step S21, the processor 11 extracts the values ​​of two adjustment parameters to be selected and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104 from the feature dataset 63 stored in the memory unit 19. In step S22, the processor 11 calculates the safe area 125 based on the extracted values ​​of the two adjustment parameters.

[0132] In step S23, the processor 11 generates a generation screen 100 based on the generation, extraction, or calculation results from each of the above steps, displays it on the display unit 17, and terminates the generation screen display process. Specifically, the processor 11 displays a digital human 131 in the digital human display area 101. The processor 11 also displays a two-dimensional map 121 in the two-dimensional map display area 102, and plots a selection cursor 122, an example plot 123, a body shape data plot 124, and a safe area 125. In addition, it displays the selected adjustment parameters in the X-axis item selection area 103 and the Y-axis item selection area 104, and displays a digital human 151 in the example display area 105.

[0133] Returning to Figure 19, in step S16, the processor 11 determines whether the X-axis item selection area 103 or the Y-axis item selection area 104 has been operated via the input unit 16. If the X-axis item selection area 103 or the Y-axis item selection area 104 is selected (Yes in step S16), in step S17, the processor 11 displays the pull-down menus 141 and 142 for the X-axis item selection area 103 or the Y-axis item selection area 104 and performs an item selection process to change the adjustment parameters.

[0134] As shown in Figure 21, when the item selection process is started, in step S31 the processor 11 refers to the importance and correlation data 65 and obtains the importance and correlation of each adjustment parameter corresponding to the adjustment parameter selected in the unselected X-axis item selection area 103 or Y-axis item selection area 104. Then, based on the obtained importance and correlation, the processor 11 updates and displays the pull-down menus 141 and 142 of the selected X-axis item selection area 103 or Y-axis item selection area 104.

[0135] In step S32, the processor 11 determines whether one of the adjustment parameters displayed in the pull-down menus 141 and 142 has been selected via the input unit 16. If one of the adjustment parameters displayed in the pull-down menus 141 and 142 has been selected (Yes in step S32), in step S33, the processor 11 extracts the features of the two new adjustment parameters shown in the feature dataset 63, calculates the safe area 125 based on those features, and ends the item selection process, returning to step S15. Here, the updated safe area 125 will be plotted on the 2D map 121 in the returned step S15. Also in the returned step S15, the two new adjustment parameters will be displayed in the X-axis item selection area 103 and the Y-axis item selection area 104, and the selection cursor 122, example plot 123, and body shape data plot 124 based on the two new adjustment parameters will be updated and displayed on the 2D map 121.

[0136] On the other hand, if none of the adjustment parameters displayed in the pull-down menus 141 and 142 are selected (No in step S32), the processor 11 hides the pull-down menus 141 and 142 and terminates the item selection process.

[0137] If neither the X-axis item selection area 103 nor the Y-axis item selection area 104 is selected (No in step S16), the process in step S17 is skipped and the process moves to step S18. In step S18, the processor 11 determines whether the selection cursor 122 on the 2D map 121 has moved, that is, whether the feature length of the adjustment parameter has changed. If the feature quantity of the adjustment parameter has changed (Yes in step S18), the process returns to step S12; if the adjustment parameter has not changed (No in step S18), the display control process ends.

[0138] <6. Variation> The specific examples described so far are merely examples, and this technology can take on a variety of configurations as variations. For example, the adjustment parameters shown in Figure 3 are just one example; other adjustment parameters may be included, or some adjustment parameters may be omitted.

[0139] Furthermore, although the above-described embodiment was used to generate a digital human 131, it may also be adapted to generate a 3D model of other living organisms, such as animals.

[0140] <7. Summary of Embodiments> As described above, the information processing system (information processing device 1) as an embodiment includes a reception unit that receives selections from the user regarding a first adjustment parameter relating to the body shape of a three-dimensional model of a living organism (digital human 131), and a second adjustment parameter different from the first adjustment parameter. The first and second adjustment parameters correspond to the adjustment parameters that are selected and displayed in the X-axis item selection area 103 and the Y-axis item selection area 104. Furthermore, the information processing system includes a display control unit 32 that displays a first display content, which plots data points (example plots 123) corresponding to multiple body shape data on a two-dimensional map 121 with a first adjustment parameter and a second adjustment parameter as axes. The first display content corresponds to the two-dimensional map 121, selection cursor 122, example plots 123, body shape data plots 124, and safe area 125 displayed in the two-dimensional map display area 102. When a position on the 2D map 121 is selected, the display control unit 32 displays a 3D model based on the values ​​of the first and second adjustment parameters corresponding to that position as a second display content. The second display content is the image displayed in the digital human display area 101, i.e., the digital human 131. As a result, the information processing device 1 can simultaneously change the feature quantities of the adjustment parameters of the X-axis item selection area 103 and the Y-axis item selection area 104 by moving the selection cursor 122 on the 2D map 121, and display the digital human 131 according to the changes. Therefore, the information processing device 1 allows the user to intuitively change the adjustment parameters. In addition, the information processing device 1 can visualize the overall picture using the two-dimensional map 121. Furthermore, since the information processing device 1 can change two adjustment parameters at once, it enables efficient work. Thus, the information processing device 1 can improve the work efficiency when generating 3D models.

[0141] It includes a storage unit 19 that stores multiple body shape data. This allows the information processing device 1 to perform pre-processing in advance for displaying the 2D map 121 and generating the digital human 131.

[0142] The display control unit 32 displays candidates for the first adjustment parameter and the second adjustment parameter based on the correlation between the first adjustment parameter and the second adjustment parameter. This allows the information processing device 1 to display pull-down menus 141 and 142, enabling the user to understand the correlation between the adjustment parameters in the X-axis item selection area 103 or the Y-axis item selection area 104. The user can then select the adjustment parameters in the X-axis item selection area 103 or the Y-axis item selection area 104 based on the correlation. As a result, the information processing device 1 can perform adjustments that maintain human-like characteristics over a wide area on the 2D map 121 by selecting two adjustment parameters with low correlation.

[0143] The display control unit 32 displays the candidates for the first adjustment parameter and the second adjustment parameter in order of increasing correlation. This allows the information processing device 1 to intuitively and easily identify the adjustment parameters that have a low correlation with the adjustment parameters in the X-axis item selection area 103 or the Y-axis item selection area 104, among the multiple adjustment parameters displayed in the pull-down menus 141 and 142.

[0144] The display control unit 32 displays the first adjustment parameter and the candidate for the second adjustment parameter, color-coded according to their correlation. This allows the information processing device 1 to intuitively and easily grasp the correlation between the multiple adjustment parameters displayed in the pull-down menus 141 and 142 and the adjustment parameters in the X-axis item selection area 103 or the Y-axis item selection area 104.

[0145] The display control unit 32 displays the candidates for the first adjustment parameter and the second adjustment parameter along with their correlation order. This allows the information processing device 1 to intuitively and easily grasp the correlation between the multiple adjustment parameters displayed in the pull-down menus 141 and 142 and the adjustment parameters in the X-axis item selection area 103 or the Y-axis item selection area 104.

[0146] The display control unit 32 displays the candidates for the first adjustment parameter and the second adjustment parameter based on their importance. This allows the information processing device 1 to intuitively and easily grasp the important adjustment parameters when deforming the shape of the digital human 131.

[0147] The display control unit 32 displays the candidates for the first adjustment parameter and the second adjustment parameter in order of importance. This allows the information processing device 1 to intuitively and easily grasp the important adjustment parameters when deforming the shape of the digital human 131.

[0148] The display control unit 32 displays the first adjustment parameter and the candidate for the second adjustment parameter, color-coding them according to their importance. This allows the information processing device 1 to intuitively and easily grasp the important adjustment parameters when deforming the shape of the digital human 131.

[0149] The display control unit 32 displays the candidates for the first adjustment parameter and the second adjustment parameter along with their order of importance. This allows the information processing device 1 to intuitively and easily grasp the important adjustment parameters when deforming the shape of the digital human 131.

[0150] The display control unit 32 displays candidates for the first adjustment parameter and the second adjustment parameter based on the correlation and importance of the first adjustment parameter and the second adjustment parameter. This allows the information processing device 1 to intuitively and easily grasp the correlation and importance of the multiple adjustment parameters displayed in the pull-down menus 141 and 142.

[0151] The display control unit 32 displays on the 2D map 121 the range (safe area 125) in which biological-likeness (human-likeness) can be maintained based on the multiple body shape data. As a result, when the information processing device 1 moves the selection cursor 122 on the 2D map 121, the safe area 125 allows the digital human 131 to easily understand the range in which it can maintain human-like behavior.

[0152] The first and second tuning parameters include tuning parameters that have linguistic characteristics. As a result, the information processing device 1 can display a two-dimensional map 121 based on adjustment parameters that have not only shape characteristics but also linguistic characteristics, thereby improving flexibility and expressiveness in adjusting the shape of the digital human 131.

[0153] The first and second adjustment parameters include adjustment parameters that have anatomical characteristics. As a result, the information processing device 1 can display a two-dimensional map 121 based on adjustment parameters that have not only shape characteristics but also anatomical characteristics. This allows for adjustment of the shape of the digital human 131 based on internal indicators that are not visible in the external form, thereby improving flexibility and expressiveness.

[0154] The system includes a bookmark management unit 54 that stores the values ​​of the first adjustment parameter and the second adjustment parameter. This allows the information processing device 1 to display the digital human 151 to be compared, making it easier to perform comparisons when generating the digital human 131.

[0155] The display control unit displays example plots on the 2D map at positions corresponding to the bookmarked values ​​of the first and second adjustment parameters. This allows the information processing device 1 to grasp the feature quantities of the digital human 151 to be compared on the two-dimensional map 121, which can then be used as a reference when moving the selection cursor 122.

[0156] The system includes a pre-processing unit 31 that calculates the correlation and importance of a first adjustment parameter and a second adjustment parameter in advance, based on multiple body shape data. This allows the information processing device 1 to instantly display multiple adjustment parameters when displaying pull-down menus 141 and 142.

[0157] It includes a pre-processing unit 31 that calculates in advance the range within which a biological appearance can be maintained, based on multiple body shape data. This allows the information processing device 1 to instantly display the safe area 125 on the two-dimensional map 121.

[0158] In one embodiment of the information processing method, the information processing system receives from the user a selection of a first adjustment parameter relating to the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter. It then displays a first display content in which data points corresponding to multiple body shape data are plotted on a two-dimensional map with the first and second adjustment parameters as axes. When any position on the two-dimensional map is selected, it displays a three-dimensional model based on the first and second adjustment parameters corresponding to that position as a second display content. This information processing method can also provide the same functions and effects as the information processing system described in the above-described embodiment.

[0159] The program of the embodiment is a computer-readable program that accepts from the user selections regarding a first adjustment parameter relating to the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter. It displays a first display content in which data points corresponding to multiple body shape data are plotted on a two-dimensional map with the first and second adjustment parameters as axes. When any position on the two-dimensional map is selected, it displays a three-dimensional model based on the first and second adjustment parameters corresponding to that position as a second display content. Such a program enables the function of the display control unit 32 described above to be realized in a computer device.

[0160] Such programs can be pre-recorded on a storage medium built into a computer device, such as an HDD (Hard Disk Drive), or on ROM within a microcomputer with a CPU. Alternatively, the data can be temporarily or permanently stored (recorded) on removable recording media such as flexible disks, CD-ROMs (Compact Disc Read Only Memory), MO (Magneto Optical) disks, DVDs (Digital Versatile Discs), Blu-ray Discs (registered trademark), magnetic disks, semiconductor memory, and memory cards. Such removable recording media can be provided as so-called packaged software. In addition to installing such programs from removable storage media to personal computers, they can also be downloaded from download sites via networks such as LANs (Local Area Networks) and the Internet.

[0161] Furthermore, such a program is suitable for providing a wide range of functions of the rendering control unit and display processing unit as embodiments. For example, by downloading the program to a personal computer, portable information processing device, mobile phone, game console, video equipment, PDA (Personal Digital Assistant), etc., the personal computer, etc. can be used as a device to realize the functions of the rendering control unit and display processing unit of this disclosure.

[0162] Furthermore, the effects described herein are merely illustrative and not limited to those described herein, and other effects may also occur.

[0163] <8. This Technology> Furthermore, this technology can also be configured as follows. (1) A receiving unit that receives selections from the user regarding a first adjustment parameter for the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter, The system includes a display control unit that displays a first display content plotted on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes, with data points corresponding to multiple body shape data plotted on it. When any position on the two-dimensional map is selected, the display control unit displays the three-dimensional model, based on the values ​​of the first and second adjustment parameters corresponding to the selected position, as the second display content. Information processing system. (2) The system includes a storage unit that stores the aforementioned multiple body shape data. (1) The information processing system described above. (3) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter based on the correlation between the first adjustment parameter and the second adjustment parameter. The information processing system described in (1) or (2). (4) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter in order of increasing correlation. (3) The information processing system described above. (5) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter, color-coded according to their correlation. (3) or (4) The information processing system described above. (6) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter along with the order of their correlations. An information processing system as described in any of (3) to (5). (7) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter based on their importance. An information processing system as described in any of (1) to (6). (8) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter in order of importance. (7) The information processing system described above. (9) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter, color-coded according to their importance. The information processing system described in (7) or (8). (10) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter along with their order of importance. An information processing system as described in any of (7) to (9). (11) The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter based on the correlation and importance of the first adjustment parameter and the second adjustment parameter. An information processing system as described in any of (1) through (9). (12) The display control unit displays on the two-dimensional map the range in which the organism can maintain its biological appearance based on the plurality of body shape data. An information processing system as described in any of (1) through (11). (13) The first and second adjustment parameters include adjustment parameters having linguistic characteristics. An information processing system as described in any of (1) to (12). (14) The first and second adjustment parameters include adjustment parameters having anatomical features. An information processing system as described in any of (1) to (13). (15) The system includes a bookmark management unit that stores the values ​​of the first adjustment parameter and the second adjustment parameter, The display control unit displays the three-dimensional model based on the bookmarked values ​​of the first and second adjustment parameters. An information processing system as described in any of (1) through (14). (16) The system includes a pre-processing unit that calculates the correlation and importance of the first adjustment parameter and the second adjustment parameter in advance, based on the aforementioned multiple body shape data. An information processing system as described in any of (1) to (15). (17) The display control unit displays example plots on the two-dimensional map at positions corresponding to the bookmarked values ​​of the first and second adjustment parameters. An information processing system as described in any of (1) through (16). (18) Information processing system, The system accepts selections from the user regarding a first adjustment parameter for the body shape of a 3D model of an organism, and a second adjustment parameter different from the first adjustment parameter. A first display content is shown, which plots data points corresponding to multiple body shape data on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes. When any position on the two-dimensional map is selected, the three-dimensional model based on the first and second adjustment parameters corresponding to that position is displayed as the second display content. Information processing methods. (19) A program that can be read by a computer device, The system accepts selections from the user regarding a first adjustment parameter for the body shape of a 3D model of an organism, and a second adjustment parameter different from the first adjustment parameter. A first display content is shown, which plots data points corresponding to multiple body shape data on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes. When any position on the two-dimensional map is selected, the three-dimensional model based on the first and second adjustment parameters corresponding to that position is displayed as the second display content. program. [Explanation of Symbols]

[0164] 1. Information Processing Device 11 processors 12 ROM 16 Input section 17 Display section 19 Memory section 22 Removable recording media 31 Pre-processing 42 Adjustment parameter calculation unit

Claims

1. A receiving unit that receives from the user a selection of a first adjustment parameter related to the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter. The system includes a display control unit that displays a first display content, which plots data points corresponding to multiple body shape data on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes, When any position on the two-dimensional map is selected, the display control unit displays the three-dimensional model, based on the values ​​of the first and second adjustment parameters corresponding to the selected position, as the second display content. Information processing system.

2. The system includes a storage unit that stores the aforementioned multiple body shape data. The information processing system according to claim 1.

3. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter based on the correlation between the first adjustment parameter and the second adjustment parameter. The information processing system according to claim 1.

4. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter in order of increasing correlation. The information processing system according to claim 3.

5. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter, color-coded according to their correlation. The information processing system according to claim 3.

6. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter along with the order of their correlations. The information processing system according to claim 3.

7. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter based on their importance. The information processing system according to claim 1.

8. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter in order of importance. The information processing system according to claim 7.

9. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter, color-coded according to their importance. The information processing system according to claim 7.

10. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter along with their order of importance. The information processing system according to claim 7.

11. The display control unit displays the candidates for the first adjustment parameter and the second adjustment parameter based on the correlation and importance of the first adjustment parameter and the second adjustment parameter. The information processing system according to claim 1.

12. The display control unit displays on the two-dimensional map the range in which the organism can maintain its biological appearance based on the plurality of body shape data. The information processing system according to claim 1.

13. The first and second adjustment parameters include adjustment parameters having linguistic characteristics. The information processing system according to claim 1.

14. The first and second adjustment parameters include adjustment parameters having anatomical features. The information processing system according to claim 1.

15. The system includes a bookmark management unit that stores the values ​​of the first adjustment parameter and the second adjustment parameter, The display control unit displays the three-dimensional model based on the bookmarked values ​​of the first and second adjustment parameters. The information processing system according to claim 1.

16. The system includes a pre-processing unit that calculates the correlation and importance of the first adjustment parameter and the second adjustment parameter in advance, based on the aforementioned plurality of body shape data. The information processing system according to claim 1.

17. The display control unit displays example plots on the two-dimensional map at positions corresponding to the bookmarked values ​​of the first and second adjustment parameters. The information processing system according to claim 1.

18. Information processing system, The system accepts selections from the user regarding a first adjustment parameter for the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter. A first display content is shown, which plots data points corresponding to multiple body shape data on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes. When any position on the two-dimensional map is selected, the three-dimensional model based on the first and second adjustment parameters corresponding to that position is displayed as the second display content. Information processing methods.

19. A program that can be read by a computer device, The system accepts selections from the user regarding a first adjustment parameter for the body shape of a three-dimensional model of an organism, and a second adjustment parameter different from the first adjustment parameter. A first display content is shown, which plots data points corresponding to multiple body shape data on a two-dimensional map with the first adjustment parameter and the second adjustment parameter as axes. When any position on the two-dimensional map is selected, the three-dimensional model based on the first and second adjustment parameters corresponding to that position is displayed as the second display content. program.

Images