Program, information processing apparatus, method and system
The program addresses the inconvenience of re-inputting text by allowing users to generate and customize 3D models efficiently using a predefined template with changeable parameters, resulting in a freely usable 3D model.
Patent Information
- Application Number
- JP2023193154
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-13
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2043-11-13
AI Technical Summary
In existing technologies, users must re-input text to modify generated images, making it cumbersome to create and customize 3D models that match their characters.
A program that uses a predefined 3D model template with a bone structure and changeable parameters, allowing users to input character information once to generate a 3D model with specified parameter values, enabling easy customization and future use.
Enables users to generate and customize 3D models efficiently, providing a 3D model that can be freely used and modified later without the need for repeated input of text or adjustments to parameter values.
Smart Images

Figure 2025080123000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a program, an information processing device, a method, and a system. [Background technology]
[0002] There is a demand for 3D (three-dimensional) models that can move in virtual space. For example, VTubers, people who distribute videos by moving their 3D model avatars, which move their limbs, expressions, etc. in accordance with their own movements, want to use 3D models that match their characters.
[0003] In relation to the above-mentioned technology, a technology is known in which, when text is input, an image that matches the text is generated (Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2003-178286 A Summary of the Invention [Problem to be solved by the invention]
[0005] In the technology described in Patent Document 1, in order for a user to subsequently modify a generated image, the user must re-input text.
[0006] Therefore, the present disclosure provides a technology that easily provides a 3D model that a user can use freely in the future. [Means for solving the problem]
[0007] A program for operating a computer having a processor and a memory. The memory stores in advance a template of a 3D model in which a bone model is predefined, and parameters defining each part of the 3D model and the parameter values are changeable. The program causes the processor to execute a first step of receiving first information representing a character that a user wishes to generate, a second step of specifying parameter values defining each part of the 3D model in accordance with the first information received from the user without the user having to set the parameter values defining each part of the 3D model for each part, and a third step of outputting a 3D model having the parameter values specified in the second step by using the template of the 3D model stored in the memory. Effect of the Invention
[0008] According to the present disclosure, it is possible to provide a technology that easily provides a 3D model that a user can freely use in the future. [Brief description of the drawings]
[0009] [Figure 1] 1 is a diagram showing an overall configuration of a system according to an embodiment; [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of a terminal device according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating a functional configuration of a server according to an embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a data structure of a user database according to an embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a data structure of a 3D model template database according to an embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a data structure of a user-generated 3D model database according to an embodiment. [Figure 7] 11 is a flowchart illustrating an example of a processing flow in a system according to an embodiment. [Figure 8]8 is a flowchart showing an example of a processing flow in a system according to an embodiment, which is a flowchart following the processing flow of FIG. 7. [Figure 9] FIG. 11 is a schematic diagram illustrating an example of a screen displayed on a terminal device according to an embodiment. [Figure 10] FIG. 11 is a schematic diagram illustrating another example of a screen displayed on a terminal device according to an embodiment. [Figure 11] FIG. 11 is a schematic diagram illustrating yet another example of a screen displayed on the terminal device according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. In all the drawings explaining the embodiment, the same reference numerals are given to common components, and repeated explanations are omitted. Note that the following embodiment does not unduly limit the contents of the present disclosure described in the claims. In addition, not all of the components shown in the embodiment are essential components of the present disclosure. In addition, each figure is a schematic diagram and is not necessarily illustrated strictly.
[0011] In the following description, a "processor" refers to one or more processors. The at least one processor is typically a microprocessor such as a CPU (Central Processing Unit), but may be another type of processor such as a GPU (Graphics Processing Unit). The at least one processor may be a single-core or multi-core.
[0012] Furthermore, the at least one processor may be a processor in the broad sense, such as a hardware circuit (for example, a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC)) that performs part or all of the processing.
[0013] In the following explanation, information that gives an output for an input may be described using an expression such as "xxx table", but this information may be data of any structure or a learning model such as a neural network that generates an output for an input. Therefore, the "xxx table" may be called "xxx information".
[0014] Furthermore, in the following description, the configuration of each table is an example, and one table may be divided into two or more tables, or all or part of two or more tables may be one table.
[0015] In addition, in the following explanation, the processing may be described with the "program" as the subject, but since the program is executed by a processor to perform a specified processing step by appropriately using a memory unit and / or an interface unit, etc., the subject of the processing may be the processor (or a device such as a controller having the processor).
[0016] The program may be installed in a device such as a computer, or may be, for example, in a program distribution server or a computer-readable (e.g., non-transitory) recording medium. In the following description, two or more programs may be realized as one program, or one program may be realized as two or more programs.
[0017] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general purpose processors, application specific processors, integrated circuits, ASICs, CPUs, conventional circuits, and / or combinations thereof, programmed to perform the functions described. Processors include transistors and other circuits and are considered to be circuitry or processing circuitry. A processor may be a programmed processor that executes a program stored in a memory.
[0018] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed in this specification or any hardware known to be programmed to realize or perform the described functions.
[0019] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.
[0020] In the following description, identification numbers are used as identification information for various objects, but other types of identification information (for example, identifiers including alphabetic characters or symbols) may be used instead.
[0021] In addition, in the following description, when describing elements of the same type without distinguishing between them, reference signs (or common signs among the reference signs) may be used, and when describing elements of the same type with distinction between them, the identification numbers (or reference signs) of the elements may be used.
[0022] In the following description, the control lines and information lines are those that are considered necessary for the description, and not all control lines and information lines in the product are necessarily shown. All components may be connected to each other.
[0023] <0 System Overview>
[0024] Below, the outline of the system according to the present disclosure will be described, but the following description should not be construed in a limiting manner, and the contents of the present disclosure should be understood based on the disclosure of this specification and the ordinary technical knowledge and common sense of a person of ordinary skill in the art.
[0025] The system according to the present disclosure allows a user of the system to generate a 3D model that the user desires and obtain the data that constitutes this 3D model.
[0026] In this specification, a 3D model is a model for expressing an object that occupies a certain area in a three-dimensional space, such as a living organism (not limited to humans, but may be a virtual living organism) that has a shape that resembles a human body, a living organism such as an animal or a plant (which may also be a virtual living organism), or an inanimate object such as a building or a box. Preferably, this object occupies a three-dimensional area in the three-dimensional space, but even if an object (such as an image) that occupies a two-dimensional area exists in the three-dimensional space, it may be a model for expressing such an object in the three-dimensional space.
[0027] The 3D model is preferably such that, when expressed in a three-dimensional space, a part of the above-mentioned living organism can move. Here, being movable means that, for example, if the living organism has a shape that imitates a human body, at least a part of the head, torso, and limbs of the human body can move. Particularly preferably, the 3D model is such that a part of the living organism can move according to an instruction from a user (the instruction here is not direct, but is conceptual, for example, including "raise your arms up"). More preferably, the 3D model is such that the movement of a part of the user can be traced by a sensor or the like, and the living organism can perform the same or similar movement. The technology for tracing the movement of a part of the user and reflecting it in the movement of a 3D model is known, so a detailed description will be omitted here.
[0028] In the following description, the 3D model is described in detail as a 3D model of a living organism having a shape that mimics a human body, but the present disclosure is not limited to the 3D model being a 3D model of a living organism having a shape that mimics a human body.
[0029] 3D models are used as avatars, such as VTubers, more specifically when the VTuber gives specific instructions to the avatar to make the avatar perform a specific action, or when a game creator gives specific instructions to a game character that exists in a game space that the game creator has created, and the game player or game program system gives specific instructions to the game character to perform a specific action within the game space. Of course, it goes without saying that 3D models may also be used for other purposes.
[0030] In this case, it takes a considerable amount of effort for VTubers and game creators to create 3D models that reflect their own intentions for expression, tastes, etc. Applications and tools for generating 3D models are commercially available, and VTubers and game creators generally use these applications and tools to configure various settings to create 3D models that reflect their own intentions for expression, tastes, etc. However, in order to create 3D models that reflect their own intentions for expression, tastes, etc., VTubers need to have considerable skills, and even if they have the skills, it takes a considerable amount of time to actually generate a 3D model using the application or tool.
[0031] In particular, games may include scenes in which a large number of characters, known as mob characters (non-player characters), who do not have individual names, are generated and made to move. Taking the time and effort described above to generate 3D models for each and every one of these mob characters may result in a lack of time and economic merit.
[0032] Therefore, in the system disclosed herein, when a user inputs first information including keywords describing the character they wish to generate, gender, race, age, and free text, the server identifies parameters and parameter values that define each part of the 3D model based on this first information, and generates and outputs a 3D model having the identified parameter values.
[0033] In order to output a 3D model based on such first information input by a user, the server stores a 3D model template in which a bone model is predefined and in which parameters defining each part of the 3D model and parameter values are changeable. The server outputs a 3D model in which the values of parameters identified from the first information are changed for the 3D model template based on the first information input by the user.
[0034] As a result, the user is simply provided with a 3D model that the user can use freely in the future, simply by inputting the first information. "Simply" here means that a 3D model that reflects the user's intention to express, taste, etc. is provided without the user having to adjust the parameter values of the 3D model himself, and the user can then adjust the parameter values of the provided 3D model to realize a 3D model that further reflects the user's intention to express, taste, etc. In this sense, a 3D model that the user can use freely in the future is provided to the user.
[0035] <One embodiment> <1 Overall system configuration> FIG. 1 is a diagram showing the overall configuration of a 3D model providing system (hereinafter simply referred to as the "system") 1 of this embodiment. As shown in FIG. 1, the system 1 includes a plurality of terminal devices (terminal devices 10A and 10B are shown in FIG. 1. Hereinafter, they may be collectively referred to as "terminal devices 10") and a server 20. The terminal devices 10 and the server 20 are connected to each other via a network 80 so as to be able to communicate with each other. The network 80 is configured as a wired or wireless network. In this embodiment, the server 20 is a server having a function as a Web server (including a cloud server), and exchanges information with the terminal device 10 through Web pages. In addition, a Web page browser for viewing Web pages is installed in the terminal device 10, but a dedicated application for providing the services of the server 20 may be installed and configured to be viewable through the dedicated application.
[0036] The terminal device 10 is a device operated by a user who receives support for building an e-commerce site using the system 1 according to the present disclosure. The user of the terminal device 10 inputs product names, product photos, etc. for items to be put up for sale on the e-commerce site, and puts the items up for sale on the e-commerce site that the server 20 of the system 1 supports in building. The terminal device 10 is realized by a stationary PC (Personal Computer), a laptop PC, etc. Alternatively, the terminal device 10 may be, for example, a tablet compatible with a mobile communication system, a mobile terminal such as a smartphone, etc.
[0037] The terminal device 10 is communicatively connected to the server 20 via a network 80. The terminal device 10 is connected to the network 80 by communicating with communication devices such as a wireless base station 81 compatible with communication standards such as 4G, 5G, and LTE (Long Term Evolution), and a wireless LAN router 82 compatible with wireless LAN (Local Area Network) standards such as IEEE (Institute of Electrical and Electronics Engineers) 802.11. As shown in FIG. 2 , the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage unit 16, and a processor 19.
[0038] The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 can communicate with an external device. The input device 13 is an input device (e.g., a keyboard, a touch panel, a touch pad, a pointing device such as a mouse, etc.) for receiving an input operation from a user. The output device 14 is an output device (a display, a speaker, etc.) for presenting information to a user. The memory 15 is for temporarily storing a program and data processed by the program, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage unit 16 is a storage device for saving data, and is, for example, a flash memory or a HDD (Hard Disc Drive). The processor 19 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, a register, a peripheral circuit, etc.
[0039] The server 20 is managed by an administrator of the system 1 of this embodiment, and the stored contents are appropriately modified / added / deleted by users of the terminal devices 10 .
[0040] The server 20 is a computer connected to a network 80. The server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29.
[0041] The communication IF 22 is an interface for inputting and outputting signals so that the server 20 can communicate with an external device. The input / output IF 23 functions as an interface with an input device for receiving input operations from a user and an output device for presenting information to a user. The memory 25 is for temporarily storing programs and data processed by the programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage 26 is a storage device for saving data, such as a flash memory or a HDD (Hard Disc Drive). The processor 29 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, a register, a peripheral circuit, etc.
[0042] <1.1 Functional configuration of the terminal device 10> FIG. 2 is a block diagram showing a functional configuration of the terminal device 10 constituting the system 1 of the first embodiment. As shown in FIG. 3, the terminal device 10 includes a plurality of antennas (antenna 111, antenna 112), wireless communication units (first wireless communication unit 121, second wireless communication unit 122) corresponding to the respective antennas, an operation reception unit 130 (including a keyboard 131 and a mouse 132), a voice processing unit 140, a microphone 141, a speaker 142, a display 150, a storage unit 170, and a control unit 180. The terminal device 10 also has functions and configurations (for example, a battery for storing power, a power supply circuit for controlling the supply of power from the battery to each circuit, etc.) that are not particularly shown in FIG. 3. As shown in FIG. 2, each block included in the terminal device 10 is electrically connected by a bus or the like.
[0043] The antenna 111 emits a signal generated by the terminal device 10 as a radio wave. The antenna 111 also receives a radio wave from space and provides the received signal to the first wireless communication unit 121.
[0044] The antenna 112 radiates a signal generated by the terminal device 10 as a radio wave. The antenna 112 also receives the radio wave from space and provides the received signal to the second radio communication unit 122.
[0045] The first wireless communication unit 121 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 111 so that the terminal device 10 can communicate with other wireless devices. The second wireless communication unit 122 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 112 so that the terminal device 10 can communicate with other wireless devices. The first wireless communication unit 121 and the second wireless communication unit 122 are communication modules including a tuner, a Received Signal Strength Indicator (RSSI) calculation circuit, a Cyclic Redundancy Check (CRC) calculation circuit, a high-frequency circuit, and the like. The first wireless communication unit 121 and the second wireless communication unit 122 perform modulation / demodulation and frequency conversion of wireless signals transmitted and received by the terminal device 10, and provide the received signals to the control unit 180.
[0046] The operation reception unit 130 has a mechanism for receiving input operations from a user. Specifically, the operation reception unit 130 includes a keyboard 131 and a mouse 132. Note that the operation reception unit 130 may be configured as a touch screen that detects the user's contact position on the touch panel, for example, by using a capacitive touch panel.
[0047] The keyboard 131 accepts input operations by the user of the terminal device 10. The keyboard 131 is a device for inputting characters, and outputs input character information to the control unit 180 as an input signal.
[0048] The mouse 132 accepts input operations by the user of the terminal device 10. The mouse 132 is a pointing device for selecting an object displayed on the display 150, and outputs position information of an object selected on the screen and information indicating that a button has been pressed to the control unit 180 as input signals.
[0049] The audio processing unit 140 modulates and demodulates an audio signal. The audio processing unit 140 modulates a signal provided from the microphone 141 and provides the modulated signal to the control unit 180. The audio processing unit 140 also provides the audio signal to the speaker 142. The audio processing unit 140 is realized by, for example, a processor for audio processing. The microphone 141 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 140. The speaker 142 converts the audio signal provided from the audio processing unit 140 into audio and outputs the audio to the outside of the terminal device 10.
[0050] Display 150 displays data such as images, videos, and text under the control of control unit 180. Display 150 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display.
[0051] Storage unit 170 is configured with, for example, a flash memory, and stores data and programs used by terminal device 10. In one aspect, storage unit 170 stores user information 1701.
[0052] User information 1701 is information about a user who uses the terminal device 10 to perform 3D model generation, which is a function of the system 1.
[0053] The control unit 180 reads a program stored in the storage unit 170 and executes instructions included in the program to control the operation of the terminal device 10. The control unit 180 is, for example, an application that is pre-installed in the terminal device 10. The control unit 180 operates according to the program to fulfill the functions of an input operation reception unit 1801, a transmission / reception unit 1802, a data processing unit 1803, and a notification control unit 1804.
[0054] The input operation receiving unit 1801 performs processing for receiving input operations by a user via an input device such as the keyboard 131 .
[0055] The transmitting / receiving unit 1802 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol.
[0056] The data processing unit 1803 performs calculations on the data input by the terminal device 10 according to a program, and outputs the calculation results to a memory or the like.
[0057] The notification control unit 1804 performs processing to present information to the user. The notification control unit 1804 performs processing to display a display image on the display 150, processing to output sound to the speaker 142, and the like.
[0058] <1.2 Functional configuration of server 20> 4 is a diagram showing an example of a functional configuration of the server 20. As shown in FIG. 4, the server 20 exerts the functions of a communication unit 201, a storage unit 202, and a control unit 203.
[0059] The communication unit 201 performs processing for the server 20 to communicate with external devices.
[0060] The storage unit 202 stores data and programs used by the server 20. The storage unit 202 stores a user database (DB) 2022, a 3D model template DB 2023, a 3D model template 2024, a parameter list 2025, a user-generated 3D model DB 2026, a user-generated 3D model 2027, a prompt history 2028, and the like.
[0061] The user DB2022 is a database in which information about a user who uses the system 1 of this embodiment is stored. The server 20 performs authentication using an authentication module 2033 (described later) to determine whether or not the user using the terminal device 10 is a registered user based on information input by the user using the terminal device 10 when logging in to the server 20 using the terminal device 10 used by the user and user information stored in the user DB2022, and permits the generation process of a 3D model using the server 20 when an authentication result indicating that the user is a registered user is obtained. Alternatively, the server 20 may perform authentication using the authentication module 2033 to determine whether or not the user using the terminal device 10 is a registered user based on the user information 1701 stored in the storage unit 170 of the terminal device 10 used by the user and the user information stored in the user DB2022. Details of the user DB2022 will be described later.
[0062] The 3D model template DB 2023 is a database for managing the 3D model templates 2024 stored in the storage unit 202. As described later, the 3D model template has bone models, and parameters and their values that define each part of the 3D model. The 3D model template DB 2023 is a database for managing which bone models each 3D model template 2024 uses and which parameter values are set in advance (preset) for each parameter. The 3D model template DB 2023 will also be described in detail later.
[0063] The 3D model template 2024 is data that serves as a template for a 3D model to be presented to a user. As described above, the 3D model template 2024 has a bone model and parameters and their values that define each part of the 3D model. In the system 1 of this embodiment, the values of the parameters set in the 3D model template 2024 are set to predetermined values in advance.
[0064] One 3D model template 2024 has a plurality of parameters, and each parameter has its own value. The parameters and their values set in the 3D model template 2024 define each part of the 3D model. Although a specific description of what parameters are set in the 3D model template 2024 is omitted, as an example, tens or hundreds of parameters and their values can be set in one 3D model template 2024. An example of a parameter is the thickness, width, etc. of the upper lip of the 3D model, and in the system 1 of this embodiment, a large number of parameters are set in the 3D model template 2024, so that the fine shape, etc. of the 3D model can be defined.
[0065] In this specification, it is assumed that there are multiple types of "parameters" and "parameter values," so in the following description, the fact that there are multiple types of parameters is not explicitly stated individually. Naturally, the possibility that one 3D model template 2024 has a single parameter and its value is not excluded, but if only a single parameter and its value can be set in the 3D model template 2024, it is difficult for a user who has obtained a 3D model to change the 3D model to his or her liking by changing the parameter value setting at a later date.
[0066] In the system 1 of this embodiment, one type of 3D model template 2024 may be stored in the storage unit 202, or multiple types of 3D model templates 2024 may be stored in the storage unit 202. The multiple types here mean that there may be multiple types of 3D model templates 2024 with different bone models, or there may be multiple types of preset parameter values even if the bone model is common. In addition, the presence of multiple types of preset parameters means that there are multiple types of parameter sets having different parameter values, since it is assumed that there are multiple types of parameters, as described above.
[0067] Preferably, the 3D model template 2024 has a mesh model set based on the bone model. When the 3D model template 2024 has a mesh model, the parameters and their values preferably define at least a part of the mesh model.
[0068] More preferably, the parameter values preset in the 3D model template 2024 are set based on first information input by the user via the terminal device 10, which will be described later.
[0069] The parameter list 2025 is a list of parameters that can be set in the 3D model template 2024 .
[0070] The user-generated 3D model DB 2026 is a database for managing 3D models generated by a 3D model generation module 2035 (described later) based on first information input by the user via the terminal device 10. The user-generated 3D model DB 2026 will be described in detail later.
[0071] The user-generated 3D model 2027 is a 3D model generated by a 3D model generation module 2035 (described later) based on first information input by the user via the terminal device 10. As already described, parameters and parameter values are set in this user-generated 3D model 2027, and after obtaining the user-generated 3D model 2027, the user can change the parameter values themselves to create a 3D model that is more to the user's liking.
[0072] Prompt history 2028 is a history of first information input by the user. Preferably, prompt history 2028 is stored in a database. Information required for database storage includes, in addition to the first information, information for identifying the user, such as a user ID described below, and the date and time of input by the user. In addition, if the user inputs the same or similar word multiple times, the number of times the word appears may also be stored in a database.
[0073] The control unit 203 performs functions indicated by various modules, such as a reception control module 2031, a transmission control module 2032, an authentication module 2033, an information acceptance module 2034, a 3D model generation module 2035, a 3D model correction module 2036, a 3D model output module 2037, and a presentation control module 2038, by the processor of the server 20 performing processing in accordance with the application program 2021 stored in the memory unit 202.
[0074] The reception control module 2031 controls the process in which the server 20 receives a signal from an external device in accordance with a communication protocol.
[0075] The transmission control module 2032 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.
[0076] The authentication module 2033 performs authentication based on the authentication information of the user input by the user of the system 1 of this embodiment via the terminal device 10, and permits the use of the system 1 of this embodiment if the authentication is successful. Since the authentication operation by the authentication module 2033 is known, detailed description will be omitted. As an example, a method may be given in which if the user information stored in the user DB 2022 of the storage unit 202 matches the user information input by the user via the terminal device 10, the authentication is determined to be successful, and if they do not match, the authentication is determined to be unsuccessful. In addition, the user information 1701 stored in the storage unit 170 of the terminal device 10 may be sent to the server 20, and a match between the sent user information 1701 and the user information stored in the user DB 2022 may be determined.
[0077] The information acceptance module 2034 accepts first information representing a character that the user wishes the server 20 to generate, inputted via the terminal device 10 by the user, and temporarily stores the accepted first information in the memory unit 202.
[0078] The method by which the information receiving module 2034 receives the first information is arbitrary, and the first information may be received based on a known information receiving method. A common method is a method in which the user inputs the first information in text form via the operation receiving unit 130 of the terminal device 10, and the transmitting / receiving unit 1802 of the terminal device 10 transmits the first information input by the user to the server 20. Alternatively, a method is also possible in which the user inputs the first information by voice using the microphone 141 of the voice processing unit 140 of the terminal device 10, the control unit 180 performs voice recognition on the first information to convert it into text, and the transmitting / receiving unit 180 similarly transmits it to the server 20.
[0079] In addition to text, the information acceptance module 2034 can also accept an image, which is a picture of a character that the user recognizes as a template for the character that the user wants the server 20 to generate. In this case, the information acceptance module 2034 generates text that represents the image that it accepts as input.
[0080] Any method may be used to generate text representing an image from an image. One example is a method of inputting an image into a search database (not shown in FIG. 1) outside the system 1 and acquiring text representing the characteristics of the image. Alternatively, a machine learning model (not shown) may be prepared in the storage unit 202, features of a product photo may be calculated, and objects may be classified and detected based on the features. Examples of such methods include those using R-CNN (Region Based Convolutional Neural Networks) as a machine learning model, YOLO (You Only Look Once), and SSD (Single Shot MultiBox Detector).
[0081] The first information input by the user represents the character the user wishes to generate, and typical examples include words including keywords that characterize the 3D model the user wishes server 20 to generate, and sentences including at least one of the gender, race, age, and free text that characterize the 3D model. However, there are no particular limitations other than these specific examples, as long as the 3D model generation module 2035 described below is capable of generating a 3D model.
[0082] For example, the user may input a natural sentence representing a character as the first information. In this case, the information receiving module 2034 extracts words from the natural sentence, which is the input first information, and temporarily stores them in the storage unit 202. A known word extraction method can be suitably applied, and detailed description thereof will be omitted here. Examples include a word extraction method used in a kana-kanji conversion system and a word extraction method using a morphological analyzer. Alternatively or additionally, a syntax analyzer may be used to perform natural language processing to delete unnecessary information (i.e., information that is not very relevant to semantic interpretation) from the first information input by the user.
[0083] When storing the first information input by the user in the storage unit 202, the information receiving module 2034 stores the first information in a database as the prompt history 2028.
[0084] Based on the first information accepted by the information acceptance module 2034, the 3D model generation module 2035 identifies parameter values defining each part of the 3D model without the user having to set parameter values defining each part of the 3D model for each part, and generates a 3D model having the identified parameter values using the 3D model template 2024 stored in the storage unit 202. Then, the 3D model generation module 2035 stores the generated 3D model in the storage unit 202 as a user-generated 3D model 2027, and stores information about the user-generated 3D model 2027 stored in the storage unit 202 in the user-generated 3D model DB 2026.
[0085] First, the 3D model generation module 2035 identifies parameter values that define each part of the 3D model based on the first information accepted by the information acceptance module 2034 and further based on the words, etc. generated by the information acceptance module 2034 based on this first information.
[0086] There is no particular limitation on the method by which the 3D model generation module 2035 specifies parameter values based on the first information, etc., and various methods are applicable. One example is a method in which a rule-based DB is stored in the storage unit 202, and when a user inputs a specific word as the first information, the 3D model generation module 2035 searches the DB and outputs parameters and parameter values that are predefined for the word.
[0087] Next, the 3D model generation module 2035 generates a 3D model having the specified parameter values, using the 3D model template 2024 stored in the storage unit 202. More specifically, since a plurality of parameters and parameter values are set in the 3D model template 2024, the 3D model generation module 2035 changes the set parameter values to the specified parameter values, thereby generating a 3D model based on the first information.
[0088] When the 3D model template 2024 has a bone model and a mesh model set based on the bone model, the parameters and the parameter values are assumed to define at least a part of the mesh model. Therefore, a parameter value change (setting to a specified parameter value) by the 3D model generation module 2035 corresponds to a change of at least a part of the mesh model based on the parameter value.
[0089] Furthermore, when the 3D model templates 2024 stored in the memory unit 202 include a plurality of 3D model templates 2024 each having a preset parameter value, the 3D model generation module 2035 selects one of the plurality of 3D model templates 2024 based on the first information, and outputs a 3D model having the identified parameter value using the selected 3D model template 2024.
[0090] Alternatively, when the 3D model templates 2024 stored in the memory unit 202 are multiple 3D model templates 2024 each having a different number of bone models, and the memory unit 202 stores a first learning model (not shown) that receives first information as input and outputs a bone model, the 3D model generation module 2035 inputs the first information input by the user into the first learning model, selects a 3D model template 2024 having the bone model obtained as an output, and generates a 3D model having the identified parameter values using the selected 3D model template 2024.
[0091] Alternatively, if the memory unit 202 stores a second learning model (not shown) that takes the first information as input and outputs a 3D model having a specific parameter value, the 3D model generation module 2035 inputs the first information input by the user into the second learning model and generates a 3D model having the specific parameter value obtained as output.
[0092] The first and second learning models are obtained by making the machine learning model perform machine learning based on the teacher data in accordance with the model learning program (not shown). The first learning model is a learning model in which the first information is an explanatory variable and the 3D model template 2024 having a specific bone model is an objective variable. Therefore, when the first information is input to the first learning model, the 3D model template 2024 having a specific bone model is output. The second learning model is a learning model in which the first information is an explanatory variable and the 3D model template 2024 having a specific parameter value is output. Therefore, when the first information is input to the first learning model, the 3D model template 2024 having a specific parameter value is output.
[0093] The learning model according to the present embodiment is, for example, a parameterized composite function in which a plurality of functions are combined. The parameterized composite function is defined by a combination of a plurality of adjustable functions and parameters. The prediction model according to the present embodiment may be any parameterized composite function that satisfies the above requirements, but is assumed to be a multi-layer network model (hereinafter referred to as a multi-layer network). A prediction model using a multi-layer network has an input layer, an output layer, and at least one intermediate layer or hidden layer provided between the input layer and the output layer. The prediction model is expected to be used as a program module that is a part of artificial intelligence software.
[0094] As the multi-layered network according to the present embodiment, for example, a deep neural network (DNN) that is a multi-layered neural network that is the subject of deep learning may be used. As the DNN, for example, a convolution neural network (CNN) that targets images may be used.
[0095] Furthermore, the above is merely an example of a prediction model, and the prediction model may have other configurations.
[0096] In addition, the 3D model generation module 2035 changes the parameter values of the 3D model template 2024 based on the history of the first information stored in the database as the prompt history 2028.
[0097] The 3D model correction module 2036 performs fine adjustments on the 3D model generated by the 3D model generation module 2035 by changing parameter values of the 3D model based on instructions from the user.
[0098] The 3D model output module 2037 outputs the user-generated 3D model 2027 that was generated by the 3D model generation module 2035 and whose parameter values have been modified by the 3D model modification module 2036 as necessary. Any method for outputting the user-generated 3D model 2027 by the 3D model output module 2037 may be used, and one example is a method of sending data constituting the user-generated 3D model 2027 to the terminal device 10. However, since the user-generated 3D model 2027 is large-volume data, the amount of data may be reduced using a data compression method or the like.
[0099] The presentation control unit 2038 generates a display control signal for displaying a predetermined screen on the display 150 of the terminal device 10, transmits it to the terminal device 10, and acquires an operation input input by the user operating the operation reception unit 130 of the terminal device 10. In particular, when the presentation control unit 2038 in the system 1 of this embodiment accepts first information from the user through the information acceptance module 2034, the presentation control unit 2038 refers to the prompt history 2028 and displays the first information that the user has frequently input, more specifically, a predetermined number of times or more, on the display 150 of the terminal device 10 as a candidate for the first information to be input by the user. Then, when the user performs an operation such as clicking on the display 150, the first information that has been clicked and input among the first information displayed as candidates may be accepted by the information acceptance module 2034 as the first information input by the user.
[0100] <2 Data Structure> 4 to 6 are diagrams showing the data structures of the databases stored in the server 20. Note that, Figs. 4 to 6 are merely examples, and do not exclude data that is not shown.
[0101] The databases shown in Figures 4 to 6 are relational databases, which are used to manage data sets called tables in a tabular format that are structurally defined by rows and columns, by associating them with each other. In a database, a table is called a table, a column in a table is called a column, and a row in a table is called a record. In a relational database, it is possible to set relationships between tables and associate them.
[0102] Usually, a column that serves as a primary key for uniquely identifying a record is set in each table, but setting a primary key to a column is not essential. The control unit 203 of the server 20 can cause the processor 29 to add, delete, or update records in a specific table stored in the storage unit 202 according to various programs.
[0103] FIG. 4 is a diagram showing an example of a data structure of the user DB 2022. As shown in FIG. 4, each record of the user DB 2022 includes, for example, an item "user ID", an item "user name", an item "user password", and an item "user address". Among the items of the user DB 2022, the items "user name", "user password", and "user address" are input by the user who wishes to register the user when the user of the terminal device 10 registers the user in the system 1 of this embodiment, and are accepted by the reception control module 2031 and input by this reception control module 2031. Furthermore, the item "user ID" is generated and input by the reception control module 2031 when the reception control module 2031 accepts the item "user name" and inputs it to the user DB 2022. The information stored in the user DB 2022 can be changed and updated as appropriate.
[0104] The item "User ID" is information for identifying a user who has registered with the system 1 (more precisely, the server 20) of this embodiment. The item "User name" is information indicating the name in the system 1 of the user identified by the "User ID". The item "User password" is information indicating the password used by the user identified by the "User ID" when logging in to the system 1. Note that in the system 1 of this embodiment, the password entered by the user when registering the user is encrypted and stored in the user DB 2022, so the password itself is expressed in an unspecified manner in FIG. 4. The item "User address" is information indicating the email address item used by the user identified by the "User ID".
[0105] Fig. 5 is a diagram showing an example of a data structure of the 3D model template DB2023. As shown in Fig. 5, each record of the 3D model template DB2023 includes, for example, an item "template ID", an item "bone model ID", and an item "parameter". Furthermore, the item "parameter" includes an item "parameter ID" and an item "parameter numerical value". Each item of the 3D model template DB2023 is generated in advance by an administrator of the system 1 of this embodiment and stored in the 3D model template DB2023. The information stored in the 3D model template DB2023 can be changed and updated as appropriate.
[0106] The item "template ID" is information for identifying a 3D model template 2024 managed by the 3D model template DB 2023. The item "bone model ID" is information for identifying a bone model possessed by the 3D model template 2024 identified by the "template ID". The item "parameter ID" is information for identifying a parameter possessed by the 3D model template 2024 identified by the "template ID". The item "parameter numerical value" is information indicating the value of the parameter identified by the "parameter ID".
[0107] 6 is a diagram showing an example of a data structure of the user-generated 3D model DB2026. As shown in FIG. 6, each record of the user-generated 3D model DB includes, for example, an item "model ID", an item "user ID", an item "template ID", an item "bone model ID", and an item "parameter". The item "parameter" includes an item "parameter ID" and an item "parameter numerical value". When the 3D model generation module 2035 generates a 3D model, the 3D model generation module 2035 stores each item of the user-generated 3D model DB2026 for the generated 3D model. The information stored in the user-generated 3D model DB2026 can be changed and updated as appropriate.
[0108] The item "model ID" is information for identifying a user-generated 3D model 2027 managed by the user-generated 3D model DB2026. The item "user ID" is information for identifying a user who generated the user-generated 3D model 2027 identified by the "model ID" (more precisely, who inputted the first information that is the basis for generating the user-generated 3D model 2027), and is common to the item "user ID" of the user DB2022. The item "bone model ID" is information for identifying a bone model possessed by the user-generated 3D model 2027 identified by the "model ID". The item "parameter ID" is information for identifying a parameter possessed by the user-generated 3D model 2027 identified by the "model ID". The item "parameter numerical value" is information indicating the value of the parameter identified by the "parameter ID".
[0109] <3 Example of operation> An example of the operation of the server 20 and the terminal device 10 will now be described.
[0110] FIG. 7 is a flowchart showing an example of the operation of the server 20 and the terminal device 10. As shown in FIG.
[0111] In step S700, the control unit 203 of the server 20 sends a display control signal to the display 150 of the terminal device 10 carried by the user who is attempting to log in to the system 1 of this embodiment, to display a login screen, and the control unit 180 of the terminal device 10 causes the display 150 to display the login screen based on the display control signal sent from the server 20.
[0112] Specifically, for example, the authentication module 2033 of the control unit 203 sends a display control signal for displaying a login screen to the display 150 of the terminal device 10 held by a user attempting to log in to the system 1 of this embodiment, and the control unit 180 of the terminal device 10 causes the display 150 to display the login screen based on the display control signal sent from the server 20. Note that communication between the terminal device 10 and the server 20 is encrypted in a predetermined manner, and it is assumed that an outsider cannot steal the contents of the communication during the communication session between the terminal device 10 and the server 20.
[0113] Then, the user inputs user information into the login screen via the operation reception unit 130 of the terminal device 10, so that the input operation reception unit 1801 of the control unit 180 receives the input contents, and the transmission / reception unit 1802 transmits the input user information to the server 20. The control unit 203 of the server 20, more specifically, the authentication module 2033, for example, performs an authentication operation by comparing the user information transmitted from the terminal device 10 with the user information stored in the user DB 2022, and if the authentication is successful, it is determined that the user has successfully logged in, and the user's subsequent operations are permitted. In the flowchart shown in FIG. 7, it is determined that the authentication is successful based on the user information input by the user.
[0114] In step S701, the control unit 203 of the server 20 sends a display control signal to the display 150 of the terminal device 10 carried by the user who has been successfully authenticated, to display an input screen for the first information, and the control unit 180 of the terminal device 10 causes the display 150 to display a login screen based on the display control signal sent from the server 20.
[0115] Specifically, for example, the information reception module 2034 of the control unit 203 sends a display control signal to the display 150 of the terminal device 10 held by the user who has been successfully authenticated, to display an input screen for the first information, and the control unit 180 of the terminal device 10 causes the display 150 to display a login screen based on the display control signal sent from the server 20.
[0116] Then, the user inputs the first information into the input screen via the operation reception unit 130 of the terminal device 10, so that the input operation reception unit 1801 of the control unit 180 receives the input contents, and the transmission / reception unit 1802 transmits the input first information to the server 20. The control unit 203 of the server 20, more specifically, for example, the information reception module 2034, receives the first information transmitted from the terminal device 10 in step S702, and stores it in the memory unit 202 as a prompt history 2028.
[0117] In step S703, the control unit 203 of the server 20 reads the 3D model template 2024 stored in the storage unit 202. Specifically, for example, the 3D model generation module 2035 of the control unit 203 reads the 3D model template 2024 stored in the storage unit 202. At this time, when a plurality of 3D model templates 2024 are stored in the storage unit 202, the 3D model generation module 2035 selects one of the 3D model templates 2024 based on the first information received in step S702.
[0118] In step S704, the control unit 203 of the server 20 specifies parameter values to be set for the 3D model template 2024 read in step S703 based on the first information accepted in step S702, and adjusts the parameter values of the 3D model template 2024 read in step S703 using the specified parameter values. Specifically, for example, the 3D model generation module 2035 of the control unit 203 specifies parameter values to be set for the 3D model template 2024 read in step S703 based on the first information accepted in step S702, and adjusts the parameter values of the 3D model template 2024 read in step S703 using the specified parameter values.
[0119] In step S705, the control unit 203 of the server 20 generates a display control signal for displaying the 3D model template 2024 (which is also the user-generated 3D model 2027 generated by the user) whose parameter values have been adjusted in step S704 on the display 150 of the terminal device 10, and sends this display control signal to the terminal device 10 to display the user-generated 3D model 2027 on the display 150 of the terminal device 10. Specifically, for example, the 3D model generation module 2035 of the control unit 203 generates a display control signal for displaying the user-generated 3D model 2027 whose parameter values have been adjusted in step S704 on the display 150 of the terminal device 10, and sends this display control signal to the terminal device 10 to display the user-generated 3D model 2027 on the display 150 of the terminal device 10.
[0120] In step S706, the control unit 180 of the terminal device 10 determines whether or not a parameter value requiring correction has been input for the user-generated 3D model 2027 displayed on the display 150 via the operation receiving unit 130. If the determination is affirmative (YES in step S706), the program proceeds to step S707, and if the determination is negative (NO in step S706), the program proceeds to step S800 in FIG.
[0121] In step S707, the control unit 180 of the terminal device 10 sends the parameter values input in step S706 to the server 20, and the control unit 203 of the server 20 accepts the sent parameter values and modifies the user-generated 3D model 2027 based on the accepted parameter values. Specifically, for example, the 3D model modification module 2036 of the control unit 203 accepts the sent parameter values and modifies the user-generated 3D model 2027 based on the accepted parameter values. After this, the program returns to step S706 and determines whether or not the user has input a modification to the parameter values.
[0122] 8, in step S800, the control unit 180 of the terminal device 10 determines whether or not an output instruction has been issued for the user-generated 3D model 2027 displayed on the display 150 via the operation receiving unit 130. If the determination is affirmative (YES in step S800), the program proceeds to step S801, and if the determination is negative (NO in step S800), the program returns to step S706 in FIG.
[0123] In step S801, the control unit 203 of the server 20 outputs the user-generated 3D model 2027, for which an output instruction was given in step S800, by sending the user-generated 3D model 2027 to the terminal device 10. Specifically, for example, the 3D model output module 2037 of the control unit 203 outputs the user-generated 3D model 2027, for which an output instruction was given in step S800, by sending the user-generated 3D model 2027 to the terminal device 10.
[0124] <4 Screen example> An example of a screen output to the terminal device 10 will be described below with reference to FIGS.
[0125] Fig. 9 is a diagram showing an example of a screen displayed on the display 150 of the terminal device 10 in the system 1 of this embodiment. The screen shown in Fig. 9 is an input screen for allowing the user of the terminal device 10 to input the first information in step S701 of Fig. 7. The screen 900 is provided with an input window 901 for inputting the first information. The user of the terminal device 10 inputs the first information into this input window 901 using the operation reception unit 130 and clicks an input button (not shown), thereby instructing the server 20 to transmit the first information to the server 20 and generate a user-generated 3D model 2027 based on the first information.
[0126] Fig. 10 is a diagram showing another example of a screen displayed on the display 150 of the terminal device 10 in the system 1 of this embodiment. The screen shown in Fig. 10 is a screen on which a legend of the user-generated 3D model 2027 generated by the system 1 of this embodiment, which is prepared in the server 20, is displayed. The screen 1000 is provided with a designation area 1001 for designating each part of the user-generated 3D model 2027 (e.g., face shape, hair, etc.), an area 1002 for displaying parameters that can be set for each part, an area 1003 for displaying each value of the parameter displayed in the area 1002 in a slide bar format, and an area 1004 for displaying the current user-generated 3D model 2027.
[0127] The user specifies the part for which a parameter value is to be set by, for example, clicking on the part's icon displayed in specification area 1001 via operation acceptance unit 130, specifies the parameter for the specified part by, for example, clicking on the parameter name displayed in area 1002 via operation acceptance unit 130, and further specifies the detailed parameter value for the specified parameter by adjusting the parameter value slide bar displayed in area 1003 via operation acceptance unit 130.
[0128] Fig. 11 is a diagram showing yet another example of a screen displayed on the display 150 of the terminal device 10 in the system 1 of this embodiment. The screen shown in Fig. 11 is a screen displaying a user-generated 3D model 2027 generated based on the first information in step S705 of Fig. 7.
[0129] <5. Effects of one embodiment> As described above in detail, according to the system 1 of this embodiment, it is possible to generate and output a user-generated 3D model 2027 according to the user's intention, without the user having to set parameter values that define each part of the 3D model for each part, based on the first information input by the user. Furthermore, even after the user-generated 3D model 2027 generated by the system 1 of this embodiment is output, the user can change the parameter values to make the user-generated 3D model 2027 more in line with the user's intention. Therefore, according to this embodiment, it is possible to provide a technology that easily provides a 3D model that the user can freely use later.
[0130] <6 Notes> In addition, the above-described embodiments are described in detail to clearly explain the present disclosure, and are not necessarily limited to those including all of the described configurations. In addition, some of the configurations of each embodiment can be added to, deleted from, or replaced with other configurations.
[0131] In addition, each of the above-described configurations, functions, processing units, processing means, etc. may be realized in hardware by designing a part or all of them, for example, by using an integrated circuit. Further, the present invention can also be realized by a program code of software that realizes the functions of the embodiments. In this case, a storage medium storing the program code is provided to a computer, and a processor included in the computer reads the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the same constitute the present invention. As a storage medium for supplying such a program code, for example, a flexible disk, a CD-ROM, a DVD-ROM, a hard disk, an SSD, an optical disk, a magneto-optical disk, a CD-R, a magnetic tape, a non-volatile memory card, a ROM, etc. are used.
[0132] In addition, the program code for realizing the functions described in the present embodiment can be implemented in a wide range of programs or script languages such as assembler, C / C++, perl, Shell, PHP, Java (registered trademark), etc.
[0133] Furthermore, by distributing the program code of the software that realizes the functions of the embodiments via a network, it can be stored in a storage means such as a hard disk or a memory of a computer or a storage medium such as a CD-RW or a CD-R, and a processor included in the computer reads and executes the program code stored in the storage means or the storage medium.
[0134] The matters described in each of the above embodiments are appended below. (Supplementary Note 1) A program for operating a computer (20) having a processor (29) and a memory (25, 26), the memory (25, 26) pre-stores a 3D model template (2024) having a pre-defined bone model, the 3D model template (2024) having parameters defining each part of the 3D model and changeable values of the parameters, the program causing the processor (29) to execute a first step (S702) of receiving first information representing a character that a user wishes to generate, a second step (S704) of specifying parameter values defining each part of the 3D model (2027) in accordance with the first information received from the user without the user having to set parameter values defining each part of the 3D model (2027) for each part, and a third step (S801) of outputting a 3D model (2027) having the parameter values specified in the second step (S704) by using the 3D model template (2024) stored in the memory (25, 26). (Appendix 2) The program of claim 1, wherein the first information is at least one of a word including a keyword characterizing the 3D model (2027), a sentence including at least one of gender, race, age, and free text characterizing the 3D model (2027). (Appendix 3) The memory (25, 26) stores a history of first information accepted from the user, and the program further causes the processor (29) to execute a fourth step of presenting to the user the first information that has been accepted from the user a predetermined number of times or more based on the history, and in the first step (S702), accepts designation of the first information presented in the fourth step. (Appendix 4) The program according to any one of appendices 1 to 3, wherein the 3D model template (2024) has a bone model and a mesh model set based on the bone model. (Appendix 5) 5. The program of claim 4, wherein the parameters and values of the parameters define at least a portion of the mesh model. (Appendix 6) The program according to any one of appendices 1 to 5, wherein a parameter value is preset in the 3D model template (2024), and the parameter value is preset based on the first information. (Appendix 7) The program described in Appendix 6, in which a plurality of 3D model templates (2024) having parameter values set in advance are stored in the memory (25, 26), and in a third step (S801), a 3D model template (2024) is selected from the plurality of 3D model templates (2024) based on the first information, and a 3D model (2027) having the parameter values identified in the second step (S704) is output using the selected 3D model template (2024). (Appendix 8) 5. The program of claim 4, wherein the memory (25, 26) stores a plurality of 3D model templates (2024) each having a plurality of different bone models. (Appendix 9) The memory (25, 26) stores a first learning model that receives first information as input and outputs a bone model, and in a third step (S801), the program described in Appendix 8 inputs the first information into the first learning model, selects a 3D model template (2024) having the bone model obtained as an output, and uses the selected 3D model template (2024) to output a 3D model (2027) having parameter values identified in the second step (S704). (Appendix 10) A program described in any of Appendices 1 to 9, in which a second learning model is stored in the memory (25, 26) that receives the first information as input and outputs a 3D model (2027) having a specific parameter value, and in a second step (S704) and a third step (S801), the first information is input into the second learning model and a 3D model (2027) having a specific parameter value obtained as output is output. (Appendix 11) The memory (25, 26) stores a history of the first information accepted from the user, and the program further causes the processor (29) to change parameter values of a 3D model template (2024) stored in the memory (25, 26) based on the history. The program described in Appendix 6. (Appendix 12) An information processing device (20) including a processor (29) and a memory (25, 26), the memory (25, 26) storing in advance a 3D model template (2024) having a predefined bone model, the 3D model template (2024) having parameters defining each part of a 3D model (2027) and parameter values that are changeable, the processor (29) includes a first step (S702) of receiving first information representing a character that a user wishes to generate, a second step (S704) of specifying parameter values defining each part of the 3D model (2027) in accordance with the first information received from the user without the user having to perform an operation of setting parameter values defining each part of the 3D model (2027) for each part, and a third step (S801) of outputting a 3D model (2027) having the parameter values specified in the second step (S704) by using the 3D model template (2024) stored in the memory (25, 26). An information processing device (20) that executes the above. (Appendix 13) A method executed by a computer (20) comprising a processor (29) and memories (25, 26), wherein the memories (25, 26) pre-store a template (2024) of a 3D model in which a bone model is pre-defined, the template (2024) being a 3D model in which parameters defining each part of the 3D model (2027) and values of these parameters are changeable. The processor (29) executes a first step (S702) of receiving first information representing a character that the user desires to generate, a second step (S704) of specifying parameter values defining each part of the 3D model (2027) according to the first information received from the user without depending on an operation of setting parameter values defining each part of the 3D model (2027) for each part by the user, and a third step (S801) of outputting a 3D model (2027) having the parameter values specified in the second step (S704) using the template (2024) of the 3D model stored in the memories (25, 26). (Appendix 14) A system comprising a memory (25, 26) that pre-stores a template (2024) of a 3D model in which a bone model is pre-defined, the template (2024) being a 3D model in which parameters defining each part of the 3D model (2027) and values of these parameters are changeable, means (2034) for receiving first information representing a character that the user desires to generate, means (2035) for specifying parameter values defining each part of the 3D model (2027) according to the first information received from the user without depending on an operation of setting parameter values defining each part of the 3D model (2027) for each part by the user, and means (2037) for outputting a 3D model (2027) having the parameter values specified by the specifying means (2035) using the template (2024) of the 3D model stored in the memory (25, 26).
Explanation of Signs
[0135] 1: system, 10: terminal device, 20: server, 25: memory, 26: storage, 29: processor, 2021: application program, 2022: user DB, 2023: 3D model template DB, 2024: 3D model template, 2025: parameter list, 2026: user-generated 3D model DB, 2027: user-generated 3D model, 2028: prompt history, 2031: receiving control module, 2032: sending control module, 2033: authentication module, 2034: information acceptance module, 2035: 3D model generation module, 2036: 3D model correction module, 2037: 3D model output module, 2038: presentation control module
Claims
1. A program for operating a computer having a processor and a memory, the memory stores in advance a template of a 3D model in which a bone model is predefined, the template having parameters defining each part of the 3D model and parameter values that are changeable; The program causes the processor to: a first step of accepting first information representing a character a user wishes to generate; a second step of specifying the parameter values defining each part of the 3D model in accordance with the first information received from the user, without the user having to perform an operation of setting the parameter values defining each part of the 3D model for each part; a third step of outputting the 3D model having the parameter values determined by the second step using a template of the 3D model stored in the memory; A program to execute.
2. The first information is at least one of a word including a keyword that characterizes the 3D model, a sentence including at least one of a gender, a race, an age, and a free text that characterizes the 3D model, The program according to claim 1.
3. the memory stores a history of the first information received from the user; The program further causes the processor to execute a fourth step of presenting to the user the first information that has been received from the user a predetermined number of times or more based on the history; In the first step, accepting the designation of the first information presented in the fourth step; The program according to claim 2.
4. The program according to claim 1 , wherein the template of the 3D model includes the bone model and a mesh model set based on the bone model.
5. The computer-readable medium according to claim 4 , wherein the parameters and the values of the parameters define at least a portion of the mesh model.
6. The program according to claim 1 , wherein values of the parameters are preset in the template of the 3D model, and the values of the parameters are preset based on the first information.
7. The memory stores a plurality of templates of the 3D model in which values of the parameters are preset, In the third step, a 3D model template is selected from the plurality of 3D model templates based on the first information, and the 3D model having the parameter values identified in the second step is output using the selected 3D model template. The program according to claim 6.
8. The program according to claim 4 , wherein the memory stores a plurality of templates of the 3D model, each of the templates having a different plurality of the bone models.
9. the memory stores a first learning model that receives the first information as an input and outputs the bone model; In the third step, the first information is input to the first learning model, a template of the 3D model having the bone model obtained as an output is selected, and the 3D model having the parameter values identified in the second step is output using the selected template of the 3D model. The program according to claim 8.
10. The memory stores a second learning model that receives the first information as an input and outputs the 3D model having a specific parameter value; In the second step and the third step, the first information is input to the second learning model, and the 3D model having the specific parameter values obtained as an output is output. The program according to claim 1.
11. the memory stores a history of the first information received from the user; The program further causes the processor to change values of the parameters of the template of the 3D model stored in the memory based on the history. The program according to claim 6.
12. An information processing device including a processor and a memory, the memory stores in advance a template of a 3D model in which a bone model is predefined, the template having parameters defining each part of the 3D model and parameter values that are changeable; The processor, a first step of accepting first information representing a character a user wishes to generate; a second step of specifying the parameter values defining each part of the 3D model in accordance with the first information received from the user, without the user having to perform an operation of setting the parameter values defining each part of the 3D model for each part; a third step of outputting the 3D model having the parameter values determined by the second step using a template of the 3D model stored in the memory; An information processing device that executes the above.
13. 1. A method implemented by a computer having a processor and a memory, comprising: the memory stores in advance a template of a 3D model in which a bone model is predefined, the template having parameters defining each part of the 3D model and parameter values that are changeable; The processor, a first step of accepting first information representing a character a user wishes to generate; a second step of specifying the parameter values defining each part of the 3D model in accordance with the first information received from the user, without the user having to perform an operation of setting the parameter values defining each part of the 3D model for each part; a third step of outputting the 3D model having the parameter values determined by the second step using a template of the 3D model stored in the memory; A method for performing.
14. a memory in which a bone model is a template of a 3D model that is predefined, the template having parameters defining each part of the 3D model and parameter values that are changeable; and means for accepting first information representative of a character a user wishes to generate; means for identifying the parameter values defining each part of the 3D model in accordance with the first information received from the user, without the user having to perform an operation of setting the parameter values defining each part of the 3D model for each part; means for outputting the 3D model having the parameter values identified by the identifying means, using a template of the 3D model stored in the memory; The system has:
Citation Information
Patent Citations
Image acquisition system
JP2009199438A
Virtual character generation device and virtual character generation program
JP2011113135A
Virtual character generation method, apparatus, electronic device, storage medium and computer program
JP2023022222A
Image forming system by sentence
JP2003178286A