Information processing device, method, program and system

Abstract

To provide a technique for facilitating adjustment of an expression style of three-dimensional CG.SOLUTION: A program causes a computer to execute as means of: acquiring input information relating to at least one of an image and a text; determining, based on the input information, values of a plurality of parameters for controlling an external appearance of a three-dimensional CG (Computer Graphics) in software for generating the three-dimensional CG by performing rendering processing on a three-dimensional model; and creating a taste file containing a plurality of determined parameter values.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, a method, a program, and a system. [Background technology]

[0002] For example, by using software such as Unity (registered trademark), a wide variety of three-dimensional CG (Computer Graphics) can be generated. On the other hand, such software provides a huge number of graphically related parameters. Therefore, in order to generate three-dimensional CG with the desired expression, a skilled person with sufficient knowledge and skill regarding parameters must carry out trial and error with the parameters.

[0003] Patent document 1 describes illuminating a real object with an illumination means, receiving light reflected by the real object with a light receiving element, estimating surface attributes of the real object based on an output signal from the light receiving element, and creating surface attribute data to be applied to three-dimensional computer graphics based on the estimated surface attributes. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-216969 A Summary of the Invention [Problem to be solved by the invention]

[0005] The technical idea described in Patent Document 1 may be useful for generating 3D CG that faithfully reproduces real objects. However, to generate 3D CG of imaginary objects or 3D CG that adds deformation or other modifications to real objects as desired, trial and error of parameters by an expert is still required.

[0006] An object of the present disclosure is to provide a technique for facilitating adjustment of the expression style of 3D CG. [Means for solving the problem]

[0007] A program according to one embodiment of the present disclosure causes a computer to function as: a means for acquiring input information relating to at least one of an image or text; a means for determining, based on the input information, values ​​of a number of parameters that control the appearance of three-dimensional computer graphics (CG) in software that generates the three-dimensional CG by performing a rendering process on a three-dimensional model; and a means for creating a taste file including the determined values ​​of the multiple parameters. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a block diagram showing a configuration of a client device according to the present embodiment. [Diagram 3] FIG. 2 is a block diagram showing a configuration of a server according to the present embodiment. [Figure 4] FIG. 1 is an explanatory diagram of one aspect of the present embodiment. [Diagram 5] FIG. 13 is an explanatory diagram of a taste file. [Figure 6] FIG. 4 is a diagram showing the data structure of a taste file according to the present embodiment. [Figure 7] 11 is a flowchart of a taste file creation process according to the present embodiment. [Figure 8] 11 is a flowchart of a taste file editing process according to the present embodiment. [Figure 9] 13A to 13C are diagrams showing examples of screens displayed in the taste file editing process of the present embodiment. [Figure 10] 13 is a flowchart of a three-dimensional CG generation process according to the first modification. [Figure 11] 13 is a flowchart of a three-dimensional CG generation process according to the second modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are generally designated by the same reference numerals, and the repeated description will be omitted.

[0010] (1) Information Processing System Configuration The configuration of the information processing system will be described below. Fig. 1 is a block diagram showing the configuration of the information processing system according to the present embodiment.

[0011] As shown in FIG. 1, the information processing system 1 includes a client device 10 and a server 30. The client device 10 and the server 30 are connected via a network (eg, the Internet or an intranet) NW.

[0012] The client device 10 is an example of an information processing device that transmits a request to the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0013] The server 30 is an example of an information processing device that provides the client device 10 with a response in response to a request transmitted from the client device 10. The server 30 is, for example, a server computer.

[0014] (1-1) Client device configuration The configuration of the client device will now be described with reference to Fig. 2, which is a block diagram showing the configuration of the client device of this embodiment.

[0015] 2, the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, and a communication interface 14. The client device 10 is connected to a display 21.

[0016] The storage device 11 is configured to store programs and data. The storage device 11 is, for example, a combination of a Read Only Memory (ROM), a Random Access Memory (RAM), and a storage (for example, a flash memory or a hard disk).

[0017] The programs include, for example, the following programs: ·OS (Operating System) programs · Programs for applications that process information (e.g. web browsers)

[0018] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)

[0019] The processor 12 is a computer that realizes the functions of the client device 10 by running a program stored in the storage device 11. The processor 12 is, for example, at least one of the following: ·CPU(Central Processing Unit) ·GPU(Graphic Processing Unit) ·ASIC(Application Specific Integrated Circuit) ·FPGA(Field Programmable Array)

[0020] The input / output interface 13 is configured to obtain information (eg, a user's instruction) from an input device connected to the client device 10, and to output information (eg, an image) to an output device connected to the client device 10.

[0021] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display 21, a speaker, or a combination thereof.

[0022] The communication interface 14 is configured to control communications between the client device 10 and an external device (eg, a server 30).

[0023] The display 21 is configured to display an image (a still image or a moving image). The display 21 is, for example, a liquid crystal display or an organic EL display.

[0024] (1-2) Server configuration The configuration of the server will now be described with reference to Fig. 3, which is a block diagram showing the configuration of the server according to this embodiment.

[0025] As shown in FIG. 3, the server 30 includes a storage device 31, a processor 32, an input / output interface 33, and a communication interface .

[0026] The storage device 31 is configured to store programs and data, and is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).

[0027] The programs include, for example, the following programs: -OS programs Application programs that perform information processing

[0028] The data includes, for example, the following data: Databases referenced in information processing Results of information processing

[0029] The processor 32 is a computer that realizes the functions of the server 30 by starting a program stored in the storage device 31. The processor 32 is, for example, at least one of the following. ·CPU GPU ·ASIC FPGA

[0030] The input / output interface 33 is configured to obtain information (eg, a user's instruction) from an input device connected to the server 30, and to output information (eg, an image) to an output device connected to the server 30.

[0031] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0032] The communication interface 34 is configured to control communications between the server 30 and external devices (eg, the client device 10).

[0033] (2) One aspect of the embodiment An embodiment of this embodiment will be described below. Fig. 4 is an explanatory diagram of an embodiment of this embodiment. Fig. 5 is an explanatory diagram of a taste file.

[0034] As shown in Fig. 4, the server 30 acquires input information IN1 from the client device 10. The input information IN1 relates to an image (which may include multiple images, or one or more videos), text (i.e., a character string), or a combination thereof. As an example, the input information IN1 may be an image constituting content (e.g., an illustration, a comic, an animation, a movie, or a video game, etc.) that serves as a reference for a style of expression that the user wishes to incorporate into the three-dimensional CG.

[0035] The server 30 determines the values ​​of a plurality of parameters based on the input information IN1. These parameters are used to control the appearance of three-dimensional CG (Computer Graphics) in the predetermined software. The predetermined software has a function of generating three-dimensional CG by performing rendering processing on a three-dimensional model. The predetermined software is typically, but is not limited to, a game engine such as Unity or Unreal Engine (registered trademark).

[0036] The server 30 optimizes the values ​​of the parameters so as to reproduce the taste of the input information IN1 by applying, for example, a parameter prediction model described later to model input data based on the input information IN1. Here, the taste means the expression style of the virtual space. The taste includes at least one of the base setting (static element) of the virtual space and the environmental setting (dynamic element) of the virtual space.

[0037] The base settings of the virtual space may include, for example, at least one of the following: - The balance between realistic expression and deformed expression (for example, whether the boundaries (edges) and colors of objects are clearly expressed like in comics and animations) - Presence or absence of borders on objects, and their shading -Color (dark, pastel, primary colors, etc.)

[0038] The virtual space environment settings may include, for example, at least one of the following: Time of day (e.g. dawn, daytime, dusk, night, etc.) Season (e.g. spring, summer, autumn, winter, etc.) Meteorological conditions (e.g. weather, atmospheric conditions, etc.) Region (e.g. Europe, America, Asia, Africa, etc.) - Era (e.g. Middle Ages, Edo Period, etc.)

[0039] Then, the server 30 creates a taste file TF2 including the determined values ​​of the multiple parameters. The taste file TF2 created in this way can be used to generate three-dimensional CG that inherits the taste of the above-mentioned input information IN1 by using a specific software.

[0040] Specifically, it is assumed that a taste file TF2 is provided to a client device 10. In this case, as shown in FIG. 5, the client device 10 acquires a three-dimensional model TG3. The client device 10 sets the values ​​of a plurality of parameters described in the taste file TF2 by using a predetermined software (i.e., imports the taste file TF2), and performs rendering processing on the three-dimensional model TG3 to generate a three-dimensional CG TG4. Thus, according to this embodiment, the user can easily reflect the taste of the input information IN1 in the three-dimensional CG TG4 without having to carry out trial and error of parameters while comparing the reference material with the three-dimensional CG TG4. In other words, according to this embodiment, it becomes easy to adjust the expression style of the three-dimensional CG.

[0041] (3) Taste file The taste file of this embodiment will now be described with reference to Fig. 6, which shows the data structure of the taste file of this embodiment.

[0042] In the taste file, values ​​of a plurality of parameters used by a specific software are described. As shown in Fig. 6, the taste file may include light-related parameters, shadow-related parameters, boundary-related parameters, color-related parameters, reflection-related parameters, sky-related parameters, cloud-related parameters, atmosphere-related parameters, and time-of-day-related parameters. Since the specific data structure of the taste file depends on the specifications of the specific software, the taste file may not include all or part of the parameters shown in Fig. 6, or may include parameters not shown in Fig. 6. Furthermore, the taste file may only describe values ​​for part of the parameters determined by the specific software (for example, only parameters related to input information).

[0043] The light-related parameters include one or more light parameters. Details of the light parameters included in the light-related parameters depend on the specifications of a given software. The light parameters control the expression of light in the virtual space to which the taste file is applied. As an example, the light parameters control at least one of the following: Number, type, position, or orientation of light sources The intensity, radiation characteristics, or wavelength of light emitted by a light source

[0044] The shadow-related parameters include one or more shadow parameters. Details of the shadow parameters included in the shadow-related parameters depend on the specifications of a given software. The shadow parameters control the expression of a shadow that occurs on an object placed in a virtual space to which the taste file is applied. As an example, the shadow parameters control at least one of the direction, size, or shade of the shadow.

[0045] The border-related parameters include one or more border parameters. Details of the border parameters included in the border-related parameters depend on the specifications of a given software. The border parameters control the expression of the border (edge) of an object placed in the virtual space to which the taste file is applied. As an example, the border parameters control at least one of the presence or absence, the shade, the color, or the thickness of the border.

[0046] The color-related parameters include one or more color parameters. Details of the color parameters included in the color-related parameters depend on the specifications of the given software. The color parameters control the expression of the color of an object placed in the virtual space to which the taste file is applied. As an example, the color parameters control the colors (color palette) available for the object.

[0047] The reflection-related parameters include one or more reflection parameters. Details of the reflection parameters included in the reflection-related parameters depend on the specifications of a given software. The reflection parameters control the expression of the reflection of an object placed in the virtual space to which the taste file is applied. As an example, the reflection parameters control the light reflectance of the object surface.

[0048] The sky-related parameters include one or more sky parameters. Details of the sky parameters included in the sky-related parameters depend on the specifications of a given software. The sky parameters control the expression of the sky in the virtual space to which the taste file is applied. As an example, the sky parameters control the weather (e.g., sunny, cloudy, rain, thunder, or snow, etc.) to be applied to the virtual space.

[0049] The cloud-related parameters include one or more cloud parameters. Details of the cloud parameters included in the cloud-related parameters depend on the specifications of a given software. The cloud parameters control the expression of clouds placed in the virtual space to which the taste file is applied. As an example, the cloud parameters control at least one of the number, type, shape, size, position, or attitude of clouds.

[0050] The atmosphere-related parameters include one or more atmosphere parameters. Details of the atmosphere parameters included in the atmosphere-related parameters depend on the specifications of a given software. The atmosphere parameters control the expression of the atmosphere of the virtual space to which the taste file is applied. As an example, the atmosphere parameters control at least one of the following: The density of particles in the air (e.g. sand, dust, etc.), or the type, shape, size, color, or weight of each particle The speed or direction of wind in the atmosphere

[0051] The fog-related parameters include one or more fog parameters. Details of the fog parameters included in the fog-related parameters depend on the specifications of a given software. The fog parameters control the expression of fog in the virtual space to which the taste file is applied. As an example, the fog parameters control the density of the fog, or the shape, color, size, or weight of each water particle.

[0052] The time zone related parameters include one or more time zone parameters. Details of the time zone parameters included in the time zone related parameters depend on the specifications of a given software. The time zone parameters control the expression of the time zone of the virtual space to which the taste file is applied. As an example, the time zone parameters control the type of time zone (e.g., dawn, daytime, dusk, nighttime, etc.).

[0053] The taste file created by the server 30 is stored, for example, in the storage device 31 or a storage device accessible to the server 30. The server 30 may also transmit the created taste file to the client device 10, in which case the taste file may be stored in the storage device 11 or a storage device accessible to the client device 10.

[0054] (4) Information processing The information processing of this embodiment will be described.

[0055] (4-1) Taste File Creation Process The taste file creation process of this embodiment will be described with reference to Fig. 7, which is a flowchart of the taste file creation process of this embodiment.

[0056] The taste file creation process of this embodiment can be started, for example, when the client device 10 accesses the server 30 and applies for the use of a taste file creation service.

[0057] As shown in FIG. 7, the client device 10 receives a user instruction (S110). Specifically, the client device 10 accepts user instructions for creating a taste file from the user. For example, the client device 10 accepts user instructions for designating an image that will be the basis of the taste file, or a text that expresses the concept of the taste file. The client device 10 acquires input information based on the user instructions.

[0058] As an example, the client device 10 may obtain at least one of the following as input information: -Images specified by the user Features extracted from images specified by the user User-specified text Features extracted from text specified by the user Images contained in the results of searching the Internet or other data sources using text specified by the User (hereinafter referred to as "Search Images") Features extracted from search images It should be noted that the extraction of features or the image search may be performed by the server 30 instead of the client device 10.

[0059] After step S110, the client device 10 executes a request to create a taste file (S111). Specifically, the client device 10 generates a request for creating a taste file, which includes at least the input information acquired in step S110. The client device 10 transmits the generated request to the server 30. The request to create a taste file may further include information capable of identifying the software that uses the taste file.

[0060] After step S111, the server 30 executes acquisition of input information (S130). Specifically, in step S111, the server 30 receives the creation request transmitted by the client device 10. The server 30 acquires input information based on the creation request. Here, the server 30 may extract the above-mentioned feature amount or perform an image search.

[0061] After step S130, the server 30 executes a parameter value determination (S131). Specifically, the server 30 determines the parameter values ​​by applying a parameter prediction model to the input information acquired in step S130 (particularly, the feature amount of an image (which may include a search image) or the feature amount of a text).

[0062] Here, the parameter prediction model can be constructed by supervised learning using a large amount (for example, several thousand) of teacher data. The parameter prediction model may be constructed for each parameter or parameter group (for example, a group of parameters constituting light parameters) constituting a taste file, or may be constructed commonly across multiple parameters or multiple parameter groups constituting a taste file. Different model input data may be generated for each parameter prediction model. Each teacher data includes learning input data based on learning images (images expressed in various tastes) or text (text reminiscent of various tastes) and correct answer data representing parameter values ​​(correct answers) to be predicted from the learning input data. The parameter prediction model may be constructed on the server 30 or on an external device (for example, a cloud server).

[0063] The server 30 determines the values ​​of the light parameters to be described in the taste file, for example, by applying a light-related parameter prediction model to the model input data.

[0064] The server 30 determines the values ​​of the shadow parameters to be described in the taste file, for example, by applying the shadow-related parameter prediction model to the model input data.

[0065] The server 30 determines the values ​​of the boundary parameters to be described in the taste file, for example, by applying a boundary-related parameter prediction model to the model input data.

[0066] The server 30 determines the values ​​of color parameters to be described in the taste file, for example, by applying a color-related parameter prediction model to the model input data.

[0067] The server 30 determines the values ​​of the reflection parameters to be described in the taste file, for example, by applying a reflection-related parameter prediction model to the model input data.

[0068] The server 30 determines the value of the sky parameter to be described in the taste file, for example, by applying a sky-related parameter prediction model to the model input data.

[0069] The server 30 determines the values ​​of cloud parameters to be described in the taste file, for example, by applying a cloud-related parameter prediction model to the model input data.

[0070] The server 30 determines the values ​​of the atmospheric parameters to be described in the taste file, for example, by applying an atmosphere-related parameter prediction model to the model input data.

[0071] The server 30 determines the value of the fog parameter to be described in the taste file, for example, by applying a fog-related parameter prediction model to the model input data.

[0072] The server 30 determines the value of the time zone parameter to be described in the taste file, for example, by applying a time zone-related parameter prediction model to the model input data.

[0073] After step S131, the server 30 creates a taste file (S132). Specifically, the server 30 creates a taste file including the parameter values ​​determined in step S131.

[0074] After step S132, the server 30 outputs the taste file (S133). Specifically, the server 30 transmits the taste file created in step S132 to the client device 10 as a response to the creation request in step S111.

[0075] After step S133, the client device 10 executes import of the taste file (S112). Specifically, the client device 10 receives the taste file transmitted by the server 30 in step S133. The client device 10 sets the parameter values ​​described in the received taste file in a specific software. The specific software may be started at the stage of step S112, or may be started before the start of step S112.

[0076] After step S112, the client device 10 generates a three-dimensional CG (S113). Specifically, the client device 10 performs rendering processing on the three-dimensional model specified by the user based on the parameter values ​​set in step S112, thereby generating a three-dimensional CG expressed in a style corresponding to the input information. With step S113, the client device 10 ends the taste file creation process shown in Fig. 7. This process may be limited to providing the taste file, in which case the client device 10 may end this process by receiving the taste file transmitted by the server 30 in step S133 and storing the taste file in the storage device 11.

[0077] (4-2) Editing taste files The taste file editing process of this embodiment will be described below. Fig. 8 is a flowchart of the taste file editing process of this embodiment. Fig. 9 is a diagram showing an example of a screen displayed in the taste file editing process of this embodiment.

[0078] The taste file editing process shown in FIG. 8 is initiated, for example, when a user of the taste file (for example, a person who has received, for a fee or free of charge, the taste file generated by the taste file creation process shown in FIG. 7) performs a predetermined operation on the client device 10.

[0079] This process can be executed in various forms. As a first example, the server 30 may execute this process in response to a request from the client device 10. As a second example, the taste file may be stored in a user environment (including the client device 10 or a cloud environment used by the user), and the client device 10 or a server in the user environment (including a cloud server) may execute this process. In the following explanation, it is assumed that the client device 10 executes this process, but the "client device 10" can be appropriately read as the "server 30" or a "server in the user environment."

[0080] As shown in FIG. 8, the client device 10 executes modeling and rendering (S210). Specifically, the client device 10 reads attribute information corresponding to an object placed in a virtual space to which the taste file to be edited is applied, and generates (models) a three-dimensional model of the object from the attribute information by executing a predetermined software. The client device 10 then sets the taste file to be edited in the predetermined software, and performs rendering processing on the three-dimensional model to generate three-dimensional CG.

[0081] Here, the attribute information that is the basis for generating a three-dimensional model can be defined in various ways. As a first example, in the case of a three-dimensional model of an object, the attribute information can include information on the positional relationship, shape, optical properties, color, or accessories of the elements (parts) that constitute the object. The object means a movable property that is a tangible object. The object can include not only man-made objects, but also natural objects (e.g., plants, animals, stones, etc.), or objects made by processing natural objects. The man-made objects can include not only industrial products, but also works of art (e.g., sculptures, paintings, etc.). As a second example, in the case of a three-dimensional model of a building, the attribute information can include information on the height, shape, side structure, top structure, signboard, color, or building materials of the building. As a third example, in the case of a three-dimensional model of land, the attribute information can include information on the topography, ground, or use (land use) of the land. As a fourth example, in the case of a three-dimensional model of a road or railway, the attribute information can include information on the shape of the road or railway, or the number of lanes.

[0082] After step S210, the client device 10 executes the display of the three-dimensional CG (S211). Specifically, the client device 10 displays the three-dimensional CG generated in step S210 and a UI (User Interface) for receiving an editing instruction for the taste file to be edited from the user on the display 21. As an example, the client device 10 displays a screen shown in FIG. 9 on the display 21.

[0083] The screen shown in FIG. 9 includes objects J21 to J25. The object J21 displays the three-dimensional CG generated in step S210. The client device 10 rotates the three-dimensional CG around the roll axis, pitch axis, or yaw axis, or enlarges or reduces the three-dimensional CG in response to a user instruction for the object J21, and displays it on the object J21. The object J21 may switch between displaying three-dimensional CG corresponding to the entire virtual space to which the taste file is applied, three-dimensional CG corresponding to each object, and three-dimensional CG corresponding to some of the elements that make up each object, for example, in response to a user instruction. Furthermore, when a three-dimensional CG corresponding to an object is selected on the object J21, the client device 10 may receive an instruction to edit the three-dimensional model (attribute information) of the object. When a three-dimensional CG corresponding to a part of an element constituting an object is selected on the object J21, the client device 10 may receive an instruction to edit the three-dimensional model (attribute information) of the element.

[0084] The object J22 displays the values ​​of each parameter described in the taste file to be edited, and accepts an instruction to edit the parameter values. The client device 10 can arrange various input forms (e.g., text fields, menus, check boxes, radio buttons, etc.) on the object J22 to accept an editing instruction. The user gives the desired editing instruction to the client device 10 by operating an input device of the client device 10. In response to the editing instruction accepted by the object J22, the client device 10 (temporarily) updates the corresponding parameter values ​​described in the taste file to be edited, and displays the three-dimensional CG based on the updated parameter values ​​on the object J21. This allows the user to freely customize the taste file while checking the change in appearance of the three-dimensional CG accompanying the editing of the parameter values.

[0085] The user can issue the following editing instructions to the object J22, for example: Editing light-related parameters Editing shadow-related parameters Editing border-related parameters Editing color-related parameters Editing reflection-related parameters Editing weather-related parameters Editing cloud-related parameters Editing atmospheric parameters -Editing fog-related parameters Editing time-related parameters

[0086] The object J23 accepts a user instruction to add input information. When the object J23 is selected, the client device 10 modifies the taste file to be edited based on the added input information. As a first example, the client device 10 may obtain a revised version of the taste file to be edited by including the input information used to create the taste file to be edited and the added input information in a request to generate the taste file and executing the taste file creation process of this embodiment. As a second example, the client device 10 includes the added input information in a taste file creation request, and executes the taste file creation process of this embodiment to obtain an additional taste file based on the input information. The client device 10 then blends (weighted average or simple average) the parameter values ​​described in the additional taste file with the parameter values ​​described in the taste file to be edited, thereby modifying the taste file to be edited.

[0087] The object J24 receives an instruction to cancel the previous editing instruction for the three-dimensional model. The user issues a cancel instruction to the client device 10 by operating the input device of the client device 10 to select the object J24. Upon receiving the cancel instruction, the client device 10 cancels the previous editing instruction. As a result, the parameter values ​​described in the taste file are returned to the state before the previous editing instruction was issued.

[0088] The object J25 receives an instruction to confirm the editing of a taste file. The user issues a confirmation instruction to the client device 10 by operating the input device of the client device 10 to select the object J25. When the client device 10 receives the confirmation instruction, it overwrites the taste file to be edited with the latest taste file at the time of the confirmation instruction (i.e., a taste file that reflects a series of valid editing instructions). This confirms the editing of the taste file. Note that overwriting is not essential, and the client device 10 may save the edited taste file separately from the taste file to be edited. This allows the pre-edit (original) taste file and the edited taste file to coexist.

[0089] If the user issues an edit instruction (for example, an operation on the object J22) before the editing of the taste file is finalized in step S211 (for example, before the selection of the object J25 is detected), the client device 10 executes acquisition of the edit instruction (S212). Specifically, the client device 10 acquires an editing instruction (for example, attribute information to be edited and an edited value of the attribute information) according to the selected object or a value held by the object.

[0090] After step S212, the client device 10 updates the taste file (S213). Specifically, the client device 10 updates the taste file to be edited so as to reflect the editing instruction acquired in step S212. After step S213, the client device 10 re-executes modeling and rendering (S210) and display of the three-dimensional CG (S211). That is, the client device 10 re-sets the updated taste file, performs rendering processing on the three-dimensional model to generate new three-dimensional CG, and displays the three-dimensional CG. This makes it possible to present to the user the three-dimensional CG that reflects the editing instructions acquired in step S212.

[0091] On the other hand, if the editing of the taste file is confirmed in step S211, the client device 10 saves the taste file (S214). Specifically, the client device 10 stores the latest taste file in the storage device 11. With step S214, the client device 10 ends the taste file editing process shown in FIG.

[0092] The server 30 may obtain, as input information, the feature quantity of image information included in the results of a search performed by a search engine based on the specified text. This allows a taste file to be created even when the user specifies text, by the same process as when the user specifies an image.

[0093] (5) Summary As described above, the server 30 of this embodiment determines the values ​​of multiple parameters that control the appearance of a three-dimensional CG in software that generates the three-dimensional CG by performing a rendering process on a three-dimensional model, based on input information related to at least one of an image or text. The server 30 creates a taste file that includes the determined values ​​of the multiple parameters. This allows the user to easily create a taste file that reflects a desired taste in the three-dimensional CG without having to carry out trial and error with parameters.

[0094] The server 30 may receive a request for creating a taste file including input information, and output the taste file as a response to the request. This allows a user to easily obtain a taste file for reflecting the taste of the input information in the three-dimensional CG by simply specifying the input information.

[0095] The client device 10 (or the server 30) may display the three-dimensional CG and information for receiving a user instruction to edit the values ​​of a plurality of parameters set in the software to generate the three-dimensional CG. The client device 10 (or the server 30) may overwrite a taste file in which the values ​​of a plurality of parameters before editing are described with the editing results, or may save the editing results as a new taste file, in response to a user instruction. This allows the user to visually confirm the result of the taste file created based on the input information being reflected in the three-dimensional CG, and to fine-tune the parameter values ​​described in the taste file, thereby improving the quality of the taste.

[0096] The client device 10 (or the server 30) may set the values ​​of multiple parameters included in the taste file overwritten by the editing results or in a new taste file in software, and generate a new three-dimensional CG corresponding to the three-dimensional model using the software. This allows the user to instantly and easily check the effect of updating the taste file on the appearance of the three-dimensional CG, and efficiently fine-tune the parameter values.

[0097] The multiple parameters may control the expression of at least one of light, shadow, boundary, color, reflection, time of day, sky pattern, clouds, atmosphere, or fog in the virtual space in which the three-dimensional model is placed. This makes it possible to control the expression of various elements of the virtual space via the taste file.

[0098] The server 30 may determine the values ​​of a plurality of parameters by applying at least one trained model (parameter prediction model) to model input data based on the input information. This makes it possible to determine the values ​​of the parameters appropriately without creating a parameter optimization logic.

[0099] The server 30 may determine the value of the first parameter by using a first trained model constructed by supervised learning using a plurality of pieces of input information for learning and a correct answer value of the first parameter determined for each of the plurality of pieces of input information for learning. This makes it possible to determine the value of the first parameter according to the learning content without creating an optimization logic for the first parameter.

[0100] (6) Variations A modification of this embodiment will now be described.

[0101] (6-1) Variation 1 A description will now be given of Modification 1. Modification 1 is an example in which a user is provided with a three-dimensional CG generated based on the taste file, rather than a created taste file.

[0102] The following describes the three-dimensional CG generation process of Modification 1. FIG.

[0103] The three-dimensional CG generation process of the first modification may be started, for example, when the client device 10 accesses the server 30 and applies for use of a three-dimensional CG generation service.

[0104] As shown in FIG. 10, the client device 10 executes reception of a user instruction (S310). Specifically, the client device 10 receives a user instruction for generating a three-dimensional CG (including creating a taste file) from the user. Specifically, the client device 10 acquires input information based on a user instruction, similar to step S110 (FIG. 7).

[0105] Furthermore, the client device 10 accepts a user instruction that specifies information that can identify a three-dimensional model to be placed in the virtual space to which the created taste file is applied (for example, attribute information corresponding to the three-dimensional model, or information indicating the location where the attribute information is stored).

[0106] After step S310, the client device 10 executes a request to generate a three-dimensional CG (S311). Specifically, the client device 10 generates a request for generating a three-dimensional CG image, the request including at least the input information acquired in step S310 and information capable of identifying a three-dimensional model. The client device 10 transmits the generated request to the server 30. The request for generating 3D CG may further include information capable of identifying software that generates the 3D CG (that is, uses the taste file).

[0107] After step S311, the server 30 executes information acquisition (S330). Specifically, in step S311, the server 30 receives the generation request transmitted by the client device 10. The server 30 acquires input information and information capable of identifying a three-dimensional model based on the generation request. Here, the server 30 may extract the above-mentioned feature amount or perform an image search.

[0108] After step S330, the server 30 performs the steps of determining the parameter values ​​(S131) ​​to A taste file is created (S132).

[0109] After step S132, the server 30 imports the taste file (S333). Specifically, the server 30 sets the parameter values ​​described in the taste file created in step S132 to the predetermined software. The predetermined software may be started at the stage of step S333, or may be started before the start of step S333.

[0110] After step S333, the server 30 generates a three-dimensional CG (S334). Specifically, the server 30 generates a three-dimensional CG expressed in a style according to the input information by performing a rendering process on the three-dimensional model corresponding to the information acquired in step S330 based on the parameter values ​​set in step S333. The server 30 transmits the generated three-dimensional CG to the client device 10 as a response to the generation request in step S311.

[0111] After step S334, the client device 10 executes screen display (S312). Specifically, the client device 10 receives the three-dimensional CG transmitted by the server 30 in step S334. The client device 10 displays the three-dimensional CG on the display 21.

[0112] After step S312, the client device 10 ends the three-dimensional CG generation process shown in FIG.

[0113] As described above, the server 30 of the first modification may acquire a request for generating a three-dimensional CG including input information and information capable of identifying a three-dimensional model. The server 30 may set the values ​​of a plurality of parameters included in the created taste file in software, generate a three-dimensional CG corresponding to the three-dimensional model by the software, and output the three-dimensional CG as a response to the generation request. This allows the user to obtain a three-dimensional CG in which the desired taste is reflected in the specified three-dimensional model without having to carry out trial and error of parameters.

[0114] (6-2) Variation 2 A description will now be given of Modification 2. Modification 2 is an example in which a selection of an already created taste file is accepted from the user, and a three-dimensional CG generated based on the selected taste file is provided to the user.

[0115] The following describes the three-dimensional CG generation process of Modification 2. FIG.

[0116] The three-dimensional CG generation process of the second modification may be started, for example, when the client device 10 accesses the server 30 and applies for use of a three-dimensional CG generation service.

[0117] As shown in FIG. 11, the client device 10 receives a user instruction (S410). Specifically, the client device 10 receives a user instruction for generating a three-dimensional CG (including selection of a taste file) from the user.

[0118] Specifically, the client device 10 accepts a user instruction to select one of a plurality of available taste files. The plurality of available taste files may include taste files previously generated in response to a request from the user himself or the organization to which the user belongs, or may include taste files previously generated in response to a request from another user or another organization (which may include the administrator of the information processing system 1).

[0119] As an example, in step S410, the client device 10 may display a screen for selecting a taste file on the display 21. On such a screen, at least one of the following pieces of information may be displayed for each taste file to be selected. -Taste file title Description of the taste file Sample image of a virtual space created by applying a taste file

[0120] Furthermore, the client device 10 accepts a user instruction to specify information capable of identifying a three-dimensional model to be placed in the virtual space to which the selected taste file is applied, in the same manner as in step S310 (FIG. 10).

[0121] After step S410, the client device 10 executes a request to generate a three-dimensional CG (S411). Specifically, the client device 10 generates a three-dimensional CG generation request including at least the taste file selection result acquired in step S410 (i.e., information that can identify the taste file selected by the user) and information that can identify the three-dimensional model. The client device 10 transmits the generated request to the server 30. The request for generating 3D CG may further include information capable of identifying software that generates the 3D CG (that is, software that uses the selected taste file).

[0122] After step S411, the server 30 executes information acquisition (S430). Specifically, the server 30 receives the generation request transmitted by the client device 10 in step S411. The server 30 acquires information capable of identifying the taste file selected by the user and information capable of identifying the three-dimensional model based on the generation request.

[0123] After step S430, the server 30 specifies a taste file (S431). Specifically, the server 30 identifies one of a plurality of available taste files based on the information acquired in step S430.

[0124] After step S132, the server 30 executes import of the taste file (S432). Specifically, the server 30 sets the parameter values ​​described in the taste file identified in step S431 to the predetermined software. The predetermined software may be started at the stage of step S432, or may be started before the start of step S432.

[0125] After step S432, the server 30 generates a three-dimensional CG (S334), similar to FIG. After step S334, the client device 10 executes screen display (S312) in the same manner as in FIG. After step S312, the client device 10 ends the three-dimensional CG generation process shown in FIG.

[0126] As described above, the server 30 of the second modification may acquire a request for generating a three-dimensional CG, which includes information for identifying a taste file selected by a user from among a plurality of available taste files, and information for identifying a three-dimensional model. The server 30 may set the values ​​of a plurality of parameters included in the taste file selected by the user in software, generate a three-dimensional CG corresponding to the three-dimensional model by the software, and output the three-dimensional CG as a response to the generation request. This allows the user to obtain a three-dimensional CG in which a desired taste is reflected in a specified three-dimensional model by simply selecting a desired taste file, without having to carry out trial and error with parameters.

[0127] (7) Other modifications The storage device 11 may be connected to the client device 10 via a network NW. The display 21 may be built into the client device 10. The storage device 31 may be connected to the server 30 via the network NW.

[0128] Each step of the above information processing can be executed by either the client device 10 or the server 30. For example, a process described as being performed by one device may be executed by another device, and a process described as being performed by the interaction of multiple devices may be executed by a single device. In addition, although the above description shows an example in which each step is executed in a specific order in each process, the execution order of each step is not limited to the described example as long as there is no dependency between the steps.

[0129] Although the embodiment of the present invention has been described in detail above, the scope of the present invention is not limited to the above embodiment. Furthermore, the above embodiment can be improved or modified in various ways without departing from the spirit of the present invention. Furthermore, the above embodiment and the modified examples can be combined. [Explanation of symbols]

[0130] 1: Information processing system 10: Client device 11:Storage device 12: Processor 13: Input / Output Interface 14: Communication interface 21: Display 30: Server 31:Storage device 32 : Processor 33: Input / Output Interface 34: Communication interface

Claims

1. Computer, a means for generating a three-dimensional model of an article based on attribute information including at least one of information on the positional relationship, shape, optical characteristics, color, and attachments of elements constituting the article, and generating three-dimensional CG (Computer Graphics) by performing a rendering process on the three-dimensional model; a means for displaying the three-dimensional CG and information for receiving editing instructions for the attribute information; means for updating the attribute information in response to the editing instruction; a means for generating a new three-dimensional model of the article based on the updated attribute information, and performing a rendering process on the new three-dimensional model to generate a new three-dimensional CG image; A program that functions as a

2. 2. The program according to claim 1, wherein the display means accepts a selection operation by a user on the displayed three-dimensional CG, and the information for accepting editing instructions for the attribute information is information for accepting editing instructions for attribute information corresponding to an item selected by the selection operation or an element constituting the item.

3. the attribute information includes information relating to each of a plurality of elements constituting the article, and the information for accepting the editing instruction is information for accepting an editing instruction for attribute information corresponding to a specific element among the plurality of elements, The program according to claim 1 , wherein said updating means updates attribute information corresponding to said specific element.

4. The program according to claim 1 , wherein the editing instruction is an editing instruction for information about optical properties or colors of the item or elements that constitute the item, the information being included in the attribute information.

5. 2. The program according to claim 1, wherein the means for generating the three-dimensional CG and the means for newly generating the three-dimensional CG perform the rendering process by applying a taste file including values ​​of a plurality of parameters that control the expression of at least one of light, shadow, boundary line, time of day, sky pattern, clouds, atmosphere, or fog in a virtual space in which the three-dimensional model is placed.

6. 6. The program according to claim 5, wherein the displaying means displays, together with the three-dimensional CG, information for accepting an editing instruction for the attribute information and information for accepting a user instruction for editing values ​​of the plurality of parameters included in the taste file.

7. causing the computer to further function as a means for updating the taste file in response to the user's instruction to edit the values ​​of the plurality of parameters included in the taste file; 7. The program according to claim 6, wherein the new generating means generates the new three-dimensional CG in response to the editing instruction for the attribute information or the user instruction for updating the taste file.

8. The program according to claim 1 , wherein the article includes at least one of an industrial product and an art object.

9. 1. A computer-implemented method having one or more computer processors, comprising: The method further comprises the step of: generating a three-dimensional model of the item based on attribute information including at least one of information regarding the positional relationship, shape, optical characteristics, color, or attachments of elements constituting the item, and generating three-dimensional CG (Computer Graphics) by performing a rendering process on the three-dimensional model; displaying the three-dimensional CG and information for receiving editing instructions for the attribute information; updating the attribute information in response to the editing instruction; A method for generating a new three-dimensional model of the article based on the updated attribute information, and generating new three-dimensional CG by performing a rendering process on the new three-dimensional model.

10. An information processing device including a control unit, The control unit generating a three-dimensional model of the item based on attribute information including at least one of information regarding the positional relationship, shape, optical characteristics, color, or attachments of elements constituting the item, and generating three-dimensional CG (Computer Graphics) by performing a rendering process on the three-dimensional model; displaying the three-dimensional CG and information for receiving editing instructions for the attribute information; updating the attribute information in response to the editing instruction; The information processing device generates a new three-dimensional model of the item based on the updated attribute information, and generates new three-dimensional CG by performing rendering processing on the new three-dimensional model.

Images