Computer system and program

The computer system automates the setting of multiple characters and objects in a virtual scene, reducing the time and effort needed for scene creation by using machine learning and user interaction to enhance the scene creation process.

JP2025123060APending Publication Date: 2025-08-22BANDAI NAMCO ENTERTAINMENT INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024018914
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-02-09
Publication Date
2025-08-22

AI Technical Summary

Technical Problem

Creating a scene in a virtual space with multiple characters requires significant time and effort, making the process cumbersome.

Method used

A computer system that supports scene creation by variably setting the positions, orientations, appearances, and associated objects of second characters based on the settings of a first character, using machine learning and user interaction to assist in the scene creation process.

Benefits of technology

Reduces the effort required for scene creation by automating the setting of multiple characters and objects, allowing users to focus on customization and composition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025123060000001_ABST
    Figure 2025123060000001_ABST
Patent Text Reader

Abstract

To provide a technique for supporting scene creation.SOLUTION: Scene creation is supported when a user creates a given scene by arranging a plurality of characters in a virtual space. The plurality of characters at least include a first character 3 and a second character 4. When a first setting is set with regard to the first character 3 on the basis of the user's operation, a second setting is automatically set to be variable with regard to the second character 4 according to the first setting so that the user may be supported.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a computer system or the like that controls and supports scene creation when a user creates a given scene by placing a plurality of characters in a virtual space. [Background technology]

[0002] Patent document 1 describes a technology in which a user operates a device to capture an image seen from the player character's perspective during game play, and if the captured image includes an enemy character, a figure corresponding to that enemy character appears in a virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-98611 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a user creates a scene by placing multiple characters in a virtual space, a large number of tasks are required, which takes time and effort. Therefore, it would be very convenient if the effort required for scene creation could be reduced.

[0005] The problem to be solved by the present invention is to provide a technique for supporting scene creation. [Means for solving the problem]

[0006] A first invention for solving the above problems is a computer system for supporting a user in creating a given scene by placing a plurality of characters in a virtual space, the computer system comprising: the plurality of characters includes at least a first character and a second character; a first setting setting means for setting a first setting related to the first character (for example, the control board 1150 in FIG. 1, the first setting setting unit 216 in FIG. 15, the first setting data 840A in FIG. 26, or step S86 in FIG. 31); A computer system including a second setting variable setting means (for example, the control board 1150 in FIG. 1, the second setting variable setting unit 222 in FIG. 15, the second setting data 840B in FIG. 26, and step S94 in FIG. 31) that variably sets the second setting for the second character according to the first setting.

[0007] According to the first aspect of the present invention, when a first setting is set, the computer system variably sets a second setting for a second character in accordance with the first setting. In other words, the computer system can assist in creating a given scene by placing the first character and the second character in a virtual space.

[0008] A second invention is a computer system in which, in the above-mentioned computer system, when the first setting is reset by the first setting setting means after the second setting is set, the second setting variable setting means resets the second setting in accordance with the first setting after the reset (for example, steps S90 to S94 in Figure 31).

[0009] According to the second invention, the computer system can reset the second setting of the second character in response to the first setting of the first character being reset.

[0010] A third invention is a computer system in which the first setting includes any one of the following five elements: a) the position of the first character in the virtual space, b) the orientation of the first character, c) the posture of the first character, d) the appearance of the first character, and e) an associated object to be associated with the first character (for example, first setting data 840A in Figure 26).

[0011] According to the third aspect of the present invention, the user can set any one of five elements of the position, orientation, posture, appearance, and associated object as the first setting related to the first character.

[0012] A fourth invention is a computer system in which the second setting includes any one of the following five elements: 1) the relative position of the second character with respect to the first character, 2) the relative orientation, 3) the posture of the second character, 4) the appearance of the second character, and 5) an associated object to be associated with the second character (for example, second setting data 840B in Figure 26).

[0013] According to the fourth aspect of the present invention, the computer system can variably set the relative position and orientation between the first character and the second character as the second setting. Also, any of the posture, appearance, and associated objects of the second character can be set as the second setting.

[0014] A fifth invention is the computer system, wherein the posture of the second character includes a pose of the second character.

[0015] According to the fifth aspect of the present invention, the computer system can variably set the pose of the second character as the second setting.

[0016] A sixth invention is a computer system in which, in the above-mentioned computer system, the second setting variable setting means variably sets some or all of the remaining elements based on the first setting and the selective setting of some of the five elements based on the user's operation (for example, each element corresponding to the element-specific support content setting operation icon 24 (24a, 24b, ...) in Figure 8, the element-specific support content setting data 804 in Figure 25, steps S32 to S34 in Figure 30, and step S94 in Figure 31).

[0017] According to the sixth aspect of the present invention, the computer system can variably set the remaining elements of the five elements of the first setting that have not been set based on the user's operation.

[0018] A seventh invention is a computer system in which the setting of the second setting by the second setting variable setting means is tentatively determined, and the computer system further comprises a second setting change means (for example, the second setting change unit 224 in Figure 15, steps S96 to S98 in Figure 31) that changes the second setting set by the second setting variable setting means based on the user's operation.

[0019] According to the seventh aspect of the present invention, the computer system can provide the user with an opportunity to adjust and confirm the second setting.

[0020] An eighth aspect of the invention is the computer system described above, wherein the second setting includes the posture of the second character, and the second setting variable setting means variably sets the posture of the second character based on the type of the first character and the type of the second character (for example, first character type condition 633f, second character type condition 633j, second character posture designation data 636c in application requirements 632 of Figure 19).

[0021] According to the eighth aspect of the present invention, the computer system can variably set the posture of the second character based on the type of the first character and the type of the second character.

[0022] A ninth aspect of the present invention is the computer system described above, wherein the second setting includes the posture of the second character, and the second setting variable setting means variably sets the posture of the second character based on information about the virtual space (for example, space configuration setting conditions 633b in FIG. 19, second character posture designation data 636c, step S94 in FIG. 31).

[0023] According to the ninth aspect of the present invention, the computer system can variably set the posture of the second character based on information about the virtual space.

[0024] A tenth aspect of the present invention is the computer system described above, wherein the information on the virtual space includes information on placement objects to be placed in the virtual space, and the second setting variable setting means variably sets the posture of the second character based on the placement objects (for example, placement object condition 634b in Figure 19, second character posture designation data 636c, step S94 in Figure 31).

[0025] According to the tenth aspect, the computer system can variably set the posture of the second character based on information about placed objects placed in the virtual space.

[0026] An eleventh invention is a computer system in which, in the above-mentioned computer system, the information on the virtual space includes information on an effect object to be placed in the virtual space, and the second setting variable setting means variably sets the posture of the second character based on the effect object (for example, effect object condition 634c in Figure 19, second character posture designation data 636c, step S94 in Figure 31).

[0027] According to the eleventh aspect, the computer system can variably set the posture of the second character based on information about an effect object placed in the virtual space.

[0028] A twelfth aspect of the invention is the computer system described above, wherein the information on the virtual space includes environmental settings for the scene, and the second setting variable setting means variably sets the posture of the second character based on the environmental settings (for example, environmental setting conditions 634a in FIG. 19, second character posture designation data 636c, step S94 in FIG. 31).

[0029] According to the twelfth aspect, the computer system can variably set the posture of the second character based on the environmental settings of the scene related to the virtual space.

[0030] A thirteenth aspect of the invention is the computer system described above, wherein the second setting includes the posture of the second character, and the second setting variable setting means variably sets the posture of the second character based on the appearance or accompanying object of the first character included in the first setting (for example, first character appearance condition 633g, first character accompanying object condition 633h, second character posture designation data 636c in Figure 19).

[0031] According to the thirteenth aspect, the computer system can variably set the posture of the second character based on the appearance or accompanying object of the first character.

[0032] A fourteenth aspect of the invention is a computer system in which the second setting variable setting means variably sets the appearance or accompanying object of the second character included in the second setting based on the appearance or accompanying object of the first character included in the first setting (for example, first character appearance condition 633g, first character accompanying object condition 633h, second character appearance designation data 636d, second character accompanying object designation data 636e in Figure 19).

[0033] According to the fourteenth aspect of the present invention, the computer system can variably set the appearance or accompanying object of the second character based on the appearance or accompanying object of the first character.

[0034] A fifteenth aspect of the present invention is a computer system further comprising a camera setting setting means (e.g., the camera setting setting unit 242 in FIG. 15, the camera setting data 852 in FIG. 27, steps S152 to S154 in FIG. 32) for setting camera settings of a virtual camera for photographing the scene.

[0035] According to the fifteenth aspect of the present invention, the computer system is capable of setting the camera settings of the virtual camera.

[0036] A sixteenth invention is a computer system in which, in the above-mentioned computer system, the camera setting setting means sets the camera setting based on the first setting and the second setting (for example, the first setting condition 702f, the second setting condition 702h, and the camera setting candidate data 710 in Figure 21).

[0037] According to the sixteenth aspect of the present invention, the computer system can set the camera settings based on the first setting and the second setting.

[0038] A seventeenth aspect of the invention is the computer system further comprising an additional object placement means (for example, the emitted beam object 16 in FIG. 4, the third object 83 in FIG. 12, the additional object placement unit 226 in FIG. 15, the additional object definition data 640 in FIG. 20, the object addition data 730 in FIG. 21, and step S120 in FIG. 31 to step S126 in FIG. 32) for placing a given additional object between the first character and the second character based on the first setting and the second setting.

[0039] According to the seventeenth aspect of the present invention, the computer system can place an additional object between the first character and the second character based on the first setting and the second setting.

[0040] An eighteenth aspect of the present invention is the computer system, comprising: first character type setting means (for example, the first character type setting unit 214 of FIG. 15, the character type 842 of the first setting data 840A of FIG. 26, steps S60 to S62 of FIG. 30) for setting the type of the first character based on an operation by the user; The computer system further includes a second character type variable setting means (for example, second character type variable setting unit 220 in FIG. 15, second character type variable setting definition data 620 in FIG. 17, step S68 in FIG. 30) that variably sets the type of the second character depending on the type of the first character.

[0041] According to the eighteenth aspect, the computer system can variably set the type of the second character depending on the type of the first character.

[0042] A nineteenth aspect of the present invention is the computer system, wherein the first character and / or the second character is a character model having a pose-changeable joint structure adapted to given character appearance data.

[0043] According to the nineteenth aspect of the present invention, the computer system can variably set the settings of the first character and / or the second character as a character model in which a posture-changeable joint structure is adapted to the character appearance data.

[0044] A 20th invention is a computer system in which, in the above-mentioned computer system, the second setting variable setting means variably sets the second setting using a machine learning model (for example, first machine learning model data 902 in Figure 37) that has been machine learned based on training data that uses the first setting as input and the second setting as output.

[0045] According to the twentieth aspect of the present invention, the computer system can variably set the second setting using a machine learning model.

[0046] A 21st invention is a program for causing a computer system to execute control to assist a user in creating a given scene by placing multiple characters in a virtual space, wherein the multiple characters include at least a first character and a second character, and the program causes the computer system to function as a first setting setting means for setting a first setting for the first character, and a second setting variable setting means for variably setting a second setting for the second character depending on the first setting.

[0047] According to the twenty-first aspect of the present invention, it is possible to realize a program that can provide the same effects as those of the first aspect of the present invention. [Brief explanation of the drawings]

[0048] [Figure 1] FIG. 1 is a system configuration diagram showing an example of the configuration of a game system. [Figure 2] FIG. 10 is a diagram showing an example of a scene creation screen display for creating a virtual diorama. [Figure 3] FIG. 10 is a diagram for explaining a support function relating to setting of a second character. [Figure 4] FIG. 10 is a diagram for explaining a support function relating to setting of a second character. [Figure 5] FIG. 10 is a diagram for explaining a support function relating to setting of a second character. [Figure 6] FIG. 10 is a diagram for explaining a support function relating to setting of a second character. [Figure 7] FIG. 10 is a diagram for explaining a support function relating to setting of a second character. [Figure 8] FIG. 10 is a diagram for explaining customization of support content settings. [Figure 9] A diagram showing how the position of the second character is manually changed and reset. [Figure 10] FIG. 10 is a diagram showing a display example of a viewing screen. [Figure 11] FIG. 10 is a diagram showing a display example of a shooting support screen. [Figure 12] 10A and 10B are diagrams for explaining the display of object candidates and the addition of objects in association with photography support. [Figure 13] FIG. 10 is a diagram for explaining perspective emphasis. [Figure 14] FIG. 10 is a diagram showing an example of a diorama image (scene image). [Figure 15] FIG. 2 is a block diagram showing an example of the functional configuration of a server system. [Figure 16] FIG. 3 is a diagram showing examples of programs and data stored in a server storage unit. [Figure 17] FIG. 4 is a diagram showing an example of the data structure of scene creation support definition data. [Figure 18] FIG. 10 is a diagram showing an example of the data configuration of space configuration setting support definition data. [Figure 19] FIG. 10 is a diagram showing an example of the data configuration of second setting variable setting definition data. [Figure 20] FIG. 10 is a diagram showing an example of the data configuration of additional object definition data. [Figure 21] FIG. 4 is a diagram showing an example of the data structure of shooting support definition data. [Figure 22] FIG. 4 is a diagram showing an example of the data configuration of camera setting candidate data. [Figure 23] FIG. 10 is a diagram showing an example of the data structure of object addition data. [Figure 24] FIG. 10 is a diagram showing an example of the data structure of object addition data. [Figure 25] FIG. 2 is a diagram showing an example of the data structure of scene creation data. [Figure 26] FIG. 3 is a diagram showing an example of the data configuration of first setting data and second setting data. [Figure 27] FIG. 10 is a diagram showing an example of the data configuration of viewing setting data. [Figure 28] FIG. 2 is a functional block diagram showing an example of the functional configuration of a user terminal. [Figure 29] 10 is a flowchart illustrating the flow of processing executed by the server system. [Figure 30] 10 is a flowchart illustrating the flow of a scene creation process. [Figure 31] Flowchart continued from Figure 30. [Figure 32] Flowchart continued from Figure 31. [Figure 33] Flowchart continued from Figure 32. [Figure 34] FIG. 10 is a functional block diagram showing an example of the functional configuration of a modified example of a user terminal. [Figure 35] FIG. 10 is a diagram showing examples of programs and data stored in a terminal storage unit in a modified example of the user terminal. [Figure 36] FIG. 10 is a diagram illustrating a modified example of the game system. [Figure 37] FIG. 10 is a diagram showing an example of the data configuration of a modified example of scene creation support definition data. [Figure 38] FIG. 10 is a diagram showing an example of a data configuration in a modified example of the photographing support definition data. [Figure 39] FIG. 10 is a diagram showing an example of the data configuration of first automatic setting definition data. DETAILED DESCRIPTION OF THE INVENTION

[0049] Hereinafter, examples of embodiments of the present invention will be described, but it goes without saying that the forms to which the present invention can be applied are not limited to the following embodiments. FIG. 1 is a system configuration diagram showing an example of the configuration of a game system according to this embodiment. The game system 1000 is a computer system including a server system 1100 and a user terminal 1500 for each user 2, which are connected via a network 9 so as to enable data communication.

[0050] The network 9 refers to a communication path that allows data communication. That is, the network 9 includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and the like.

[0051] The server system 1100 is a computer system that also functions as a game server that performs various processes such as providing a predetermined user registration procedure, managing registered user information, and generating and managing various data for running the game.

[0052] The server system 1100 has a main unit equipped with a control board 1150. The control board 1150 is equipped with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as a VRAM, RAM, and ROM, and a communication device 1153. Note that some or all of the functions equipped on the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or an SoC (System on a Chip).

[0053] Although the server system 1100 is depicted as if it were a single server device, it may be configured to be realized by multiple devices. For example, the server system 1100 may be configured to include multiple blade servers that share functions and are connected to each other via an internal bus so that data can be communicated. The server system 1100 may also include a database and online storage.

[0054] The user terminal 1500 is a computer system that serves as a man-machine interface (MMIF) in the game system 1000. In the example of Fig. 1, only one user terminal 1500 is depicted, but in actual operation, multiple user terminals 1500 may be connected to the server system 1100.

[0055] The user terminal 1500 is a computer system connectable to the network 9, such as a personal computer, a smartphone, a wearable computer, a portable game device, a home game device, or a tablet computer.

[0056] The user terminal 1500 includes an operation input device, an image display device, and a control board 1550. Examples of the operation input device include a touch panel 1506, a keyboard, a game controller, a mouse, etc. Examples of the image display device include the touch panel 1506, a head-mounted display, a glasses-type display, etc.

[0057] The control board 1550 is equipped with a CPU 1551, various microprocessors such as a GPU and a DSP, various IC memories 1552 such as a VRAM, a RAM and a ROM, a communication module 1553 connected to the network 9, etc. These elements equipped on the control board 1550 are electrically connected via a bus circuit or the like, and are connected so as to be able to read and write data and send and receive signals. Part or all of the control board 1550 may be configured using an ASIC, an FPGA, or an SoC.

[0058] The control board 1550 stores in the IC memory 1552 programs and various data for realizing the functions of the user terminal 1500. The user terminal 1500 executes a predetermined application program to realize the functions of a man-machine interface for the game system 1000 and as a game client.

[0059] The user terminal 1500 is configured to download the programs and various data necessary to play the game from the server system 1100, but it may also be configured to read them from a separately obtained storage medium such as a memory card.

[0060] The game system 1000 has a function for realizing the game, and also a function for supporting scene creation in which the user 2 creates a virtual diorama using game world settings and game data created for the game. Creation of the virtual diorama begins when the user 2 performs a predetermined scene creation request operation on the user terminal 1500.

[0061] FIG. 2 is a diagram showing an example of a scene creation screen W2 for creating a virtual diorama. In the example of FIG. 2, a user 2 is attempting to create a diorama space 5 in which a first character 3 and a second character 4 are placed, using a world setting of a fighting game in which weapons such as combat robots appear.

[0062] The first character 3 and the second character 4 are first and second objects, respectively, modeled after weapons that appear in the game. In the example of Fig. 2, the first character 3 and the second character 4 are character objects modeled after humanoid combat robots. That is, the first character 3 and the second character 4 are character models that have joint structures that can change their postures based on given character appearance data, and can be made to assume a variety of poses (postures).

[0063] The scene creation screen W2 displays various menu icons 10 (10a, 10b, . . . ), function icons 12 (12a, 12b, . . . ), a viewing start operation icon 13, and an image of the diorama space 5 being created.

[0064] Operating the situation menu icon 10a displays a menu for selecting a situation theme that will be the basis for the scene you are about to create. Situation theme candidates include, for example, "during close combat," "during long-range combat," "after combat," "combat within a colony," and "fighting game screen style." The user selects and sets one of the themes.

[0065] Operating the space configuration menu icon 10b displays a menu for setting the space configuration of the diorama space 5. The menu is prepared for a plurality of setting categories related to the space configuration. The setting categories may be, for example, field type (e.g., terrestrial city / terrestrial grassland / underwater / outer space / ...), time period (e.g., day / night / sunrise / ...), weather (e.g., sunny / rain / snow / fog / ...), etc. The user selects and sets one of the setting categories for the space configuration.

[0066] Once the theme and spatial configuration of the situation are set, a spatial configuration template prepared in advance for the combination of these settings is selected. Then, the field 6 and placement objects 7 indicated by the selected template are automatically placed in the virtual three-dimensional space for creating the diorama, and the diorama space 5 that will be the basis for creating the scene is preset.

[0067] Based on the preset diorama space 5, the user 2 calls up various functions using the function icons 12 (12a, 12b, ...), changes the shape and color of the field 6, and adds, deletes, rearranges, etc. the placement objects 7 to customize the desired spatial configuration. These are called "spatial configuration setting operations." Information about the settings of the field 6, placement objects 7, etc., made through the spatial configuration setting operations is managed as "spatial configuration settings."

[0068] Once the spatial configuration has been customized, the user operates the character menu icon 10c to call up a menu listing character candidates that can be placed. Then, when the user selects the first character 3 and the second character 4 and specifies their initial placement positions within the diorama space 5, the objects of the selected characters are placed in their initial states (for example, standing upright, with initial equipment).

[0069] The user 2 calls up various functions using the function icons 12 (12a, 12b, ...) to customize the first character 3 and the second character 4 by changing their poses, equipment, and color schemes. To express the damaged state of the first character 3 and the second character 4, the character models may be disassembled or cut. These operations related to the first character 3 are called "first setting operations," and these operations related to the second character 4 are called "second setting operations." The character setting information related to the first character 3 set by the first setting operation is managed as "first settings." The character setting information related to the second character 4 set by the second setting operation is managed as "second settings."

[0070] Of course, the first character 3 and the second character 4 may be customized as desired, and the field 6 and the placed objects 7 may be customized as desired. Furthermore, the number of character objects and placed objects to be placed in the diorama space 5 is not limited to the example shown in the figure.

[0071] 3 to 7 are diagrams for explaining the support function relating to the setting of the second character 4 in conjunction with the resetting of the setting of the first character 3. FIG.

[0072] As shown in FIG. 3, the user 2 customizes the pose of the first character 3 placed in the initial state. Specifically, the user 2 causes the first character 3 to assume a pose in which the first character 3 is shooting with a rifle at the second character 4 placed on top of a building placement object 7. This customization results in the first setting of the first character 3 being changed or reset. Then, when the first setting is changed or reset, the server system 1100 executes setting assistance control to automatically set the second setting of the second character 4.

[0073] FIG. 4 is a diagram showing an example of setting support control based on the customization of FIG. The server system 1100 infers the content of the scene that the user wants to create and automatically performs the settings required for that scene.

[0074] The scene content is inferred based on the combination of information contained in the spatial configuration setting and the first setting. For example, in the example in Figure 3, From the fact that "the theme of the situation is long-range combat," "the first character is equipped with a rifle," and "the rifle is pointed at the second character," it can be inferred that "the user is trying to create a scene in which the first character shoots the second character."

[0075] Then, based on the result of the analogy, the server system 1100 changes the second setting of the second character 4. In the example of Fig. 4, the following steps (1) to (4) are executed.

[0076] (1) The second character 4 is automatically changed to assume a pose (posture) that represents the moment when the character is shot. At this time, the posture of the second character is set variably based on the spatial configuration. Even if the character is in the same standing position, if the field 6 is on the ground, the posture will be one in which the character is supporting its own weight in a gravitational environment, but if the field 6 is underwater or in outer space, the posture will be one in which the character is not supporting its own weight.

[0077] (2) The relative position and orientation of the second character 4 to the first character 3 are changed so that the second character 4 receives the gunfire directly in the chest. At this time, the position and orientation of the second character 4 are changed and set based on the spatial configuration of the diorama space 5 at that time. In the example of FIG. 4, the change destination is determined based on the rooftop position of the placement object 7 representing a building. In other words, the relative position and orientation of the second character are set variably based on the spatial configuration.

[0078] (3) To make it appear as if a beam has entered the second character 4, an entrance weathering is added to the appearance of the second character 4, making it appear as if the chest has been burned and melted by the beam. If the entrance is to be expressed three-dimensionally, an additional object that expresses the unevenness of the entrance may be added.

[0079] (4) To make it appear as if the beam has penetrated the second character 4, a flare effect is added to the back of the second character 4 to represent the beam diffusing and the materials melted by the beam scattering.

[0080] Furthermore, the server system 1100 changes the placed objects and the light source based on the result of the analogy. In the example of Fig. 4, the following steps (5) to (7) are executed. (5) A projected beam object 16 representing the light trail of the projected beam is additionally placed. At this time, the position and length of the object are automatically adjusted so that it follows the line of fire of the rifle, from the muzzle of the rifle of the first character 3 to the second character 4.

[0081] (6) A piercing beam object representing the piercing beam is added behind the second character 4 along the rifle's firing direction.

[0082] (7) A light source is added that projects light in front of the second character 4 from near the rifle's line of fire, so that a strong shadow is cast on the second character 4 due to the intense light of the beam entering the second character 4.

[0083] When adding an object, if multiple candidate objects are prepared, a candidate selection menu 14 is displayed as appropriate, and the object to be placed is confirmed by receiving a selection operation from the user 2. Incidentally, Fig. 4 shows an example of the display of the candidate selection menu 14 for the emission beam objects 16 (16a, 16b, ...).

[0084] Such resetting of the second setting and the spatial configuration setting is repeatedly performed every time the first setting is reset. For example, FIG. 5 shows an example of resetting the second setting and the spatial configuration setting when the user 2 changes the position of the first character 3 from the situation in FIG. 4 so as to move closer to the second character 4.

[0085] The server system 1100 executes the following steps (8) to (13) due to the change in the relative positions of the first character 3 and the second character 4. (8) The position of the second character 4 is moved downward to match the change in position with the first character 3. (9) Since the relative distance between the first character 3 and the second character 4 has become shorter, the length of the emitted beam object 16 is adjusted. (10) Increased the length of the piercing beam object to make the beam piercing look more dramatic. (11) Increased and brightened flare effects to make beam penetration appear more spectacular. (12) Addition of splash objects to represent molten metal splattering to make the beam penetration look more spectacular. (13) Placement of the light trail addition object that represents the light trail of the scattering addition object.

[0086] In Figure 6, user 2 changes and resets the first setting from the state in Figure 4 to change the type of equipment (attached object) of first character 3. Specifically, the rifle 31 of the equipment of first character 3 is changed to a beam saber 32.

[0087] As shown in FIG. 7, the server system 1100 cancels the setting change for this first setting, assuming that the above steps (1) to (13) did not occur, and then executes the following steps (14) to (18).

[0088] (14) It is determined that the fighting style in the scene to be created has changed from shooting to slashing with melee weapons, and an additional object of a shield 41 is added to the second character 4. (15) In accordance with the change in fighting style, the pose of the second character 4 is changed to a pose that makes it appear as if the second character 4 is slashing at the first character 3. (16) In accordance with the change in fighting style, a reflection effect that expresses reflection or light emission from the blade surface is set on the battle axe 42 of the second character 4. Alternatively, a point light source may be added. (17) The position of the second character 4 is changed to a position suitable for the changed pose. In the example of Fig. 7, the position is changed to one that looks like the second character 4 is jumping off the building placement object 7, but the position may also be changed to one that drops the second character 4 down onto the field 6 next to the building. (18) Added a thruster effect to represent the thrusters on the back of the second character 4 to match the changed pose.

[0089] Note that the setting changes exemplified in (1) to (18) are basically confirmed based on the user's confirmation operation after going through a stage of provisional settings presented to the user. Of course, the setting changes exemplified in (1) to (18) can also be realized manually by the user by making full use of the function icons 12. In any case, the user can be supported by being automatically executed in response to the change or resetting of the first setting.

[0090] Furthermore, with regard to such support functions, the user can selectively enable / disable support for the support functions related to the second setting for each of the multiple elements that make up the second setting. For example, as shown in Fig. 8, the user may be able to selectively enable / disable support in a menu called up by the character menu icon 10c.

[0091] When the user operates the character menu icon 10c, an additional operation icon 17 and an assistance setting operation icon 18 are displayed.

[0092] When the add operation icon 17 is operated, a list of candidate character models that can be added is displayed.

[0093] When the support setting operation icon 18 is operated, setting target selection icons 19 (19a, 19b) for selecting a placed character as the setting target are displayed. When the user operates the setting target selection icon 19 for any character, a fully automatic support icon 20 and a custom icon 22 are displayed.

[0094] When the fully automatic support icon 20 is selected, the support function for all elements that make up the setting of the character in question is enabled. When the custom icon 22 is selected, element-specific support content setting operation icons 24 (24a, 24b, ...) are further displayed. By operating the element-specific support content setting operation icons 24, the user can arbitrarily select whether to enable or disable the support function for each corresponding setting element.

[0095] For example, if the element-specific support content setting operation icon 24a for "character type" is set to "enabled," the type of second character 4 is automatically set according to the type of first character 3. Alternatively, a character object of a type that is pre-associated with a combination of the type of first character 3 and the theme of the situation is automatically selected. One of the automatically selected character objects is then automatically placed in diorama space 5, and the remaining automatically selected character objects may be presented to the user as other options.

[0096] The elements of the second setting for which the support function is disabled are not automatically set, so the user must manually set them by using the function icons 12 (12a, 12b, . . . ).

[0097] For example, Figure 9 shows the user manually changing and resetting the position of the second character 4 when the settings for the "relative position" and "associated (meaning changes to associated objects)" elements of the second setting are "disabled."

[0098] Returning to FIG. 2, on the scene creation screen W2, by operating the viewing start operation icon 13, it becomes possible to generate and view images taken by a virtual camera set in the diorama space 5.

[0099] FIG. 10 is a diagram showing an example of the viewing screen W4 that is displayed when the viewing start operation icon 13 is operated. The viewing screen W4 includes various camera setting menu icons 50 (50a, 50b, . . . ), a photography support operation icon 52, a camera layout diagram 54, a position and attitude operation icon 56, a diorama image 58, and a photography operation icon 59.

[0100] The camera setting menu icons 50 include a frame type selection icon 50a, a view angle selection icon 50b, an aperture value selection icon 50c, a shutter speed selection icon 50d, a filter selection icon 50e, and a focus operation icon 50f.

[0101] The photography support operation icon 52 calls up a support function for camera settings of the virtual camera. The camera layout diagram 54 shows where the virtual camera is located in the diorama space 5 and what kind of shooting range it has. For example, a camera mark 55 is displayed on the perspective image of the entire diorama space 5.

[0102] The position and attitude operation icon 56 corresponds to an operation for changing the position and attitude (photographing direction) of the virtual camera in the diorama space 5. The diorama image 58 is an image of the diorama space 5 captured with the current virtual camera settings. When the photographing operation icon 59 is photographed, the data of the diorama image 58 is saved.

[0103] FIG. 11 is a diagram showing a display example of the shooting support screen W6. The shooting support screen W6 is displayed when the shooting support operation icon 52 is operated and the support function for setting the virtual camera settings is enabled. The shooting support screen W6 includes a viewing type setting section 70, a support content setting section 72, and a setting candidate display section 74.

[0104] The viewing type setting unit 70 displays an icon that allows the user to select whether to view the video as a "single still image" taken with a single specified virtual camera, or as a "video" taken with multiple virtual cameras with different camera settings. In the example of Figure 11, "single still image" has been selected.

[0105] The support content setting unit 72 displays various icons for selecting conditions for automatically setting the camera settings. Each touch operation of the icons in the support content setting unit 72 switches between a selected state and a non-selected state. In the example of FIG. 11, the icons displayed with a shaded area are in a selected state.

[0106] In the support content setting section 72, icons are displayed according to support categories. Support categories include what to use as the subject ("Subject" in Fig. 11), what kind of composition to use ("Composition Theme" in Fig. 11), and elements that can be automatically added or changed among the components of the diorama space 5 ("Add / Change" in Fig. 11). It is also a good idea to prepare categories such as "Filling in gaps in the composition," "Emphasizing perspective," and "Suggesting a change in the type of second character."

[0107] The setting candidate display unit 74 displays camera layout diagrams 75 (75a, 75b, ...; corresponding to the camera layout diagram 54 in FIG. 10) for the virtual camera set by the user and the virtual camera setting candidates prepared as a result of camera setting support. The camera layout diagram 75 also serves as an icon for selecting and operating the camera settings.

[0108] When the viewing mode is set to "single still image," if the user selects any of the camera layout plans 75 in the setting candidate display section 74, a still image taken by the virtual camera corresponding to that camera layout plan 75 is generated. The still image is then displayed as a diorama image 58 (see FIG. 10). When the viewing mode is set to "video," a video is generated in which the virtual cameras corresponding to all of the camera layout plans 75 are cycled through in order. The video is then displayed as a diorama image 58. Depending on the number of virtual cameras cycled through and the duration of the cycle, the video can end up being either a relatively short video or a relatively long video.

[0109] FIG. 12 is a diagram for explaining the display of object candidates and the addition of objects in association with photography support in an example of the spatial configuration of a diorama space 5B different from that of FIG. The user sets up the diorama space 5B and the virtual camera 80, assuming that the user will be viewing a composition in which the first character 3 holding the long sword 33 is photographed from the tip of the long sword 33. However, suppose that at the stage of setting up the diorama space 5B, the user has only placed the first character 3 and posed.

[0110] When "complementing compositional deficiencies" is enabled in the photography support content setting unit 72, the server system 1100 detects objects that appear in the diorama image captured by the virtual camera 80. Then, based on the relative positional relationships between the detected objects in the photography direction and the positions and areas of the objects captured in the diorama space, the server system 1100 selects additional objects to compensate for compositional deficiencies in the diorama image to be captured and presents them to the user.

[0111] "Compositional deficiency" may be, for example, "objects in the foreground, middle, and background are not captured in the diorama image captured by the virtual camera." It may also be "there is an area of ​​a certain size or more in which nothing is captured in the diorama image captured by the virtual camera," or "the composition line is broken because nothing is captured on the composition line."

[0112] As an example of filling in missing components in a composition, for example, if "foreground, middle, or background objects are not captured in the diorama image captured by the virtual camera," the server system 1100 determines whether each detected object corresponds to the foreground, middle, or background. For example, this is determined based on the relative positional relationship of the shooting direction from the accelerating camera. Then, additional objects are selected and presented to the user in positions corresponding to the missing foreground, middle, or background.

[0113] In the example of Fig. 12, the first character 3, which is the first object, is considered to be in the foreground, and the middle and background are insufficient. Therefore, the server system 1100 presents candidates for the second object 82 (for example, the battleship of the first character 3, or a huge second character) to the user to be placed in a background position (far away, which corresponds to outside the drawing in Fig. 12). The presented candidates for the second object 82 are narrowed down from a plurality of candidates based on information on the first setting, such as the type and pose of the first character 3.

[0114] The relative position of the second object 82 with respect to the virtual camera 80 and the first character 3 may be set to a position that fills in a region of a predetermined size or larger that is empty in the diorama image captured by the virtual camera 80. Similarly, a third object 83, which is a tree in the middle ground, is presented to the user 2 so that it should be placed in the middle ground position (between the first character 3 and the second object 82). When the user 2 performs a confirmation operation, the second object 82 and the third object 83 are fixedly placed in the diorama space 5B.

[0115] In addition, the second object 82 and the third object 83 may be displayed in a form that shows their characteristics, such as semi-transparency or outline enhancement, during the candidate stage, and once they are finally placed, the characteristic display form is canceled and they are displayed in their original display form.

[0116] When "emphasis on perspective" is set to be valid in the photography support content setting unit 72, the server system 1100 performs a process of transforming an object to emphasize the perspective and a process of adding an effect, as exemplified in FIG.

[0117] Specifically, the server system 1100 searches for an object whose longitudinal dimension faces the perspective direction, and performs processing to enlarge and / or deform the portion of the object that is closest to the virtual camera 80. In the example of Fig. 13, the object of the long sword 33 is searched for, and the tip side of the teeth that is closest to the virtual camera 80 is subjected to enlargement and deformation processing.

[0118] Furthermore, since the enlarged and deformed part appears larger and more emphasized in the diorama image, the server system 1100 adds effect processing to the part (for example, a reflection effect 84 that expresses the reflection of the blade surface, a highlight effect, etc.). The server system 1100 also adjusts the longitudinal direction of the placed object in accordance with the perspective. For example, the server system 1100 changes the settings so that the longitudinal direction and front-to-back direction of the second object 82 are in accordance with the perspective.

[0119] FIG. 14 is a diagram showing an example of a diorama image 58B taken by a virtual camera 80 of a diorama space 5B in which support for "deficiencies in composition" and "emphasis on perspective" has been provided. In the diorama image 58B of FIG. 14, the first character 3 is positioned in the foreground, the third object 83 in the middle, and the second object 82 in the background, in a well-balanced arrangement. Furthermore, the area above the first character 3 would have been empty, but the addition of the second object 82 nicely fills in the empty space, creating a balanced composition and a sense of spaciousness and depth. Furthermore, the longitudinal direction of the second object 82 follows the perspective, creating a sense of depth as well as a sense of stability in the diagonal composition. By utilizing the support function, user 2 can easily obtain a "stunning" diorama image 58.

[0120] Next, the functional configuration will be described. FIG. 15 is a block diagram showing an example of the functional configuration of the server system 1100. As shown in FIG. The server system 1100 includes an operation input unit 100s, a server processing unit 200s, a sound output unit 390s, an image display unit 392s, a communication unit 394s, and a server storage unit 500s.

[0121] The operation input unit 100s is a means for inputting various operations for managing the server system 1100. For example, a keyboard, a touch panel, a mouse, etc., correspond to this.

[0122] The server processing unit 200s is realized by electronic components such as processors serving as arithmetic circuits, such as CPUs, GPUs, ASICs, and FPGAs, as well as IC memories, and controls the input and output of data between the server processing unit 200s and each functional unit, including the operation input unit 100s and the server storage unit 500s.The server processing unit 200s performs various types of arithmetic processing based on predetermined programs and data, data received from operation input signals from the operation input unit 100s, and the like, and comprehensively controls the operation of the server system 1100.

[0123] The server processing unit 200s includes a user management unit 202, a game management unit 210, a timekeeping unit 280s, a sound generation unit 290s, an image generation unit 292s, and a communication control unit 294s.

[0124] The user management unit 202 performs processing related to user registration procedures for the game system 1000 and stores and manages various information linked to user accounts.

[0125] The game management unit 210 includes a game progress control unit 211, a space configuration setting unit 212, a first character type setting unit 214, and a first setting setting unit 216. It also includes a second character type variable setting unit 220, a second setting variable setting unit 222, a second setting change unit 224, an additional object placement unit 226, and a photography support unit 240. Of course, functional units other than these may be included.

[0126] The game progress control unit 211 controls the progress of the game. For example, it configures a game space by arranging various objects in a virtual three-dimensional space, and arranges game objects such as a player character and an NPC. It controls the movement of the player character in response to operation inputs by the user 2, and automatically controls the movement of the NPC using a predetermined algorithm. It also determines the game results.

[0127] The space configuration setting unit 212 sets the space configuration of the virtual space for creating a virtual diorama based on the user's operation, which corresponds to the setting of the diorama space 5 in FIG.

[0128] The first character type setting unit 214 sets the type of the first character based on the user's operation.

[0129] The first setting setting unit 216 sets a first setting for the first character based on a user operation.

[0130] The second character type variable setting unit 220 variably sets the type of the second character according to the type of the first character.

[0131] The second setting variable setting unit 222 variably sets the second setting for the second character according to the first setting. Specifically, if the first setting is reset after the second setting is set, the second setting variable setting unit 222 resets the second setting according to the reset first setting.

[0132] The second setting change unit 224 changes the second setting set by the second setting variable setting unit 222 based on a user operation.

[0133] The additional object placement unit 226 places a given additional object between the first character and the second character based on the first setting and the second setting. For example, this applies to the addition of the emission beam object 16 in Fig. 4 and the addition of the third object 83 in Fig. 12.

[0134] The photography support unit 240 performs support control related to the photography of a scene (see FIGS. 10 to 13). The photography support unit 240 includes a camera setting setting unit 242.

[0135] The camera setting setting unit 242 sets the camera settings of the virtual camera related to the shooting of the scene (shooting of the diorama space 5).

[0136] The timekeeping unit 280s uses a system clock to measure various times such as the current date and time and time limits.

[0137] The sound generation unit 290s is realized by executing an IC or software that generates and decodes audio data. The sound generation unit 290s outputs the generated audio signal to the sound output unit 390s. The sound output unit 390s is realized by a speaker or the like, and emits sound based on the audio signal.

[0138] The image generation unit 292s generates images of various management screens for system management of the server system 1100, and outputs the image data to the image display unit 392s. The image generation unit 292s also generates some or all of the images to be displayed on the user terminal 1500. The image display unit 392s is realized by a device that displays images, such as a flat panel display, a head-mounted display, or a projector.

[0139] The communication control unit 294s executes data processing related to data communication and realizes data exchange with external devices via the communication unit 394s. The communication unit 394s realizes communication by connecting to the network 9. For example, this is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In the example of FIG. 1, this corresponds to the communication device 1153.

[0140] The server storage unit 500s stores programs and various data for implementing various functions that allow the server processing unit 200s to comprehensively control the server system 1100. The server storage unit 500s is also used as a work area for the server processing unit 200s, and temporarily stores the results of calculations executed by the server processing unit 200s in accordance with the various programs. These functions are implemented by, for example, IC memory such as RAM or ROM, magnetic disks such as hard disks, optical disks such as CD-ROMs or DVDs, online storage, etc. In the example of FIG. 1, these correspond to storage media such as the IC memory 1152 and hard disks installed in the server system 1100.

[0141] FIG. 16 is a diagram showing an example of programs and data stored in the server storage unit 500s. The server storage unit 500s stores a server program 501, a distribution client program 503, game initial setting data 510, and scene creation support definition data 600. It also stores user management data 790, game play data 800, and a current date and time 900. The server storage unit 500s also stores other programs and data (for example, timers, counters, various flags, etc.) as appropriate.

[0142] The server program 501 is a program for realizing the functions of the user management unit 202 and the game management unit 210 .

[0143] The delivery client program 503 is the original client program provided to the user terminal 1500 and executed.

[0144] The game initial setting data 510 includes various initial setting data related to the game. For example, the game initial setting data 510 includes game scenario data 512, game space initial setting data 514, and game object initial setting data 520. Of course, data other than these may also be included as appropriate.

[0145] The game space initial setting data 514 stores various data that define the game space, such as data about the placement and control of field objects, placement objects, and environmental effect objects such as snow, clouds, and dust.

[0146] The game object initial setting data 520 includes initial setting data for various objects that appear in the game, such as character object initial setting data 522, incidental object initial setting data 524, placement object initial setting data 526, and effect object initial setting data 528.

[0147] Character object initial setting data 522 is prepared for each type of character object. One character object initial setting data 522 includes object type, object category, character appearance data, joint structure data, etc. The character appearance data includes, for example, character model data and standard skin data.

[0148] The associated object initial setting data 524 is prepared for each type of object corresponding to equipment used in association with a character object. One associated object initial setting data 524 includes the object type, object category, associated object appearance data, etc. The associated object appearance data includes, for example, object model data and standard texture data.

[0149] The placement object initial setting data 526 is prepared for each type of placement object to be placed as a background. One placement object initial setting data 526 includes the object type, object category, and associated object appearance data.

[0150] The effect object initial setting data 528 is prepared for each type of object to visually display effects such as light emission, smoke, meteorological phenomena, magic circles, energy fields, etc. One piece of effect object initial setting data 528 includes the object type, object category, object model data, texture data, etc.

[0151] The scene creation support definition data 600 stores various initial setting data and definition data relating to support functions for diorama creation and scene creation. 17, the scene creation support definition data 600 includes field initial setting data 602, space composition setting support definition data 610, and second character type variable setting definition data 620. It also includes second setting variable setting definition data 630, additional object definition data 640, and photography support definition data 700.

[0152] The field initial setting data 602 is prepared for each type of field 6 (see FIG. 2) in the diorama space 5, and stores various initial setting data related to that type. For example, the field initial setting data 602 includes the field type, field topography data, color scheme data by time of day, additional object placement data by weather, additional effect data by weather, etc.

[0153] The spatial configuration setting support definition data 610 is prepared for each content that supports the setting of the spatial configuration of the diorama space 5, and stores various data that define that content. For example, as shown in Fig. 18, one piece of spatial configuration setting support definition data 610 includes a support ID 611, one piece of primary support data 612, and multiple pieces of secondary support data 616. Of course, data other than these may also be included as appropriate.

[0154] The primary support data 612 includes primary application requirements 613 and primary space configuration setting template data 615 .

[0155] The primary application requirement 613 describes the first requirement that must be met in order for the definition data to be selected and applied, by combining one or more sub-conditions 614 (614a, 614b). For example, the primary application requirement 613 includes, as sub-conditions, a situation theme condition 614a regarding the theme of the situation and a space configuration setting condition 614b regarding the basic settings of the space configuration (settings of field type, time of day, weather, etc.). One of the situation theme condition 614a and the space configuration setting condition 614b may be unset or unlimited.

[0156] The primary space configuration setting template data 615 is a group of detailed setting data relating to the field 6 and placement objects 7. In other words, when the user 2 selects the theme of the situation and the basic settings of the space configuration, a diorama space 5 corresponding to that combination is preset.

[0157] The secondary support data 616 includes secondary application requirements 617 and secondary space configuration setting template data 619 .

[0158] The secondary application requirement 617 is written as a combination of a first character type condition 618a and a second character type condition 618b, one of which may be left unset or unlimited.

[0159] The secondary space configuration setting template data 619 is a group of more detailed setting data relating to the field 6 and the placed objects 7. The secondary space configuration setting template data 619 is determined according to a combination of the theme of the situation, the basic setting of the space configuration, the type of first character 3, and the type of second character 4.

[0160] 17, multiple types of second character type variable setting definition data 620 are prepared according to application requirements that indicate the conditions that must be met to apply the definition data. One set of second character type variable setting definition data 620 includes an application requirement and a second character type candidate list.

[0161] The application requirements referred to here are described as, for example, one or a combination of the following: situation theme conditions, space configuration conditions, first character type conditions, and second character type conditions (see FIG. 18). The second character type candidate list stores one or more character types that are candidates for the second character 4.

[0162] A plurality of types of second setting variable setting definition data 630 are prepared according to application requirements that indicate the conditions that must be met to apply the definition data. For example, as shown in FIG. 19, one second character type variable setting definition data 620 includes an application requirement 632 and one or more second setting designation data 635.

[0163] The application requirement 632 is described by a combination of multiple sub-conditions 633 (633a, 633b, ...). As the sub-conditions 633, for example, a situation theme condition 633a, a space configuration setting condition 633b, a first character type condition 633f, a first character appearance condition 633g may be used. Also, a first character associated object condition 633h, a second character type condition 633j, etc. may be used. Note that the sub-conditions 633 may be set to be other than these. Also, one or more of the sub-conditions 633 may be set to be undetermined or unlimited.

[0164] The space configuration setting condition 633b is written as a combination of one or more sub-conditions 634 (634a, 634b, ...). The sub-conditions 634 may be, for example, an environmental setting condition 634a, a placement object condition 634b, and an effect object condition 634c. The environmental setting condition 634a indicates conditions that must be met regarding the field type, time of day, weather, etc. of the diorama space 5. The placement object condition 634b indicates conditions that must be met regarding placement objects 7 that have already been placed in the diorama space 5. The effect object condition 634c indicates conditions that must be met regarding effect objects that have already been placed in the diorama space 5.

[0165] One second setting designation data 635 stores designation values ​​for each element of the second setting. For example, it includes second character relative position designation data 636a based on the position of the first character 3, and second character relative orientation designation data 636b based on the direction of the first character 3. It also includes second character posture designation data 636c indicating the pose (posture) of the second character 4, second character appearance designation data 636d, and second character associated object designation data 636e.

[0166] Therefore, the application requirements 632 of the second setting variable setting definition data 630 can be said to indicate criteria for inferring the content of the scene the user wants to create, and the second setting designation data 635 can be said to indicate the second setting content appropriate for the second character 4 in the content of the inferred scene.

[0167] FIG. 20 is a diagram showing an example of the data structure of the additional object definition data 640. As shown in FIG. Multiple types of additional object definition data 640 are prepared according to application requirements that indicate the conditions that must be met to apply the definition data. Each additional object definition data 640 includes application requirements 642 and additional content data 644.

[0168] The application requirement 642 is written as a combination of one or more sub-conditions 643 (643a, 643b, ...). As the sub-conditions 643, for example, a situation theme condition 643a, a space configuration setting condition 643b, and a first character type condition 643c may be used. Also, a first setting condition 643d, a second character type condition 643e, and a second setting condition 643f may be used. One or more of these sub-conditions 643 may be left unset or unlimited.

[0169] The additional content data 644 is prepared for each additional object, and stores the type of the additional object, the size of the additional object (magnification of the additional object when placed relative to the standard size), the attitude of the additional object, and the like.

[0170] FIG. 21 is a diagram showing an example of the data structure of the photographing support definition data 700. As shown in FIG. The shooting support definition data 700 is prepared in multiple types according to the application requirements 701 that indicate the conditions that must be met in order to apply the definition data, and stores various data related to the shooting support functions that are applied when the application requirements are met.

[0171] One piece of photography support definition data 700 includes, for example, application requirements 701, at least one piece of camera setting candidate data 710, basic camerawork setting data 728, and object addition data 730. It also includes second character type variable setting data 740, effect addition data 742, light source addition data 744, weathering addition data 746, and the like.

[0172] The application requirement 701 is described as a combination of one or more sub-conditions 702 (702a, 702b, ...). Examples of the sub-conditions 702 include a situation theme condition 702a, a subject condition 702b, a composition theme condition 702c, and a spatial composition setting condition 702d. Also, a first character type condition 702e, a first setting condition 702f, a second character type condition 702g, a second setting condition 702h, a viewing type condition 702j, and a photography support content condition 702k may be used. One or more of these sub-conditions 702 may be left unset or unlimited.

[0173] The subject condition 702b indicates the condition that must be met for the setting related to the support content "subject" (see FIG. 11). The composition theme condition 702c indicates the condition that must be met for the setting related to the support content "composition theme." Specifically, it is described as a set combination (see FIG. 11).

[0174] The viewing type condition 702j is a condition for the type selected in the viewing type setting section 70 (see FIG. 11) of the shooting support screen W6. The photographing support content conditions 702k are conditions for the type selected in the support content setting section 72 of the photographing support screen W6. The conditions are written as a combination of sub-conditions for each item of the support content.

[0175] 22, the camera setting candidate data 710 includes a camera setting candidate ID 711, shooting position setting data 712, shooting direction setting data 713, angle of view setting data 714, and aperture value setting data 715. It also includes shutter speed setting data 716, image processing setting data 717, and focus setting data 718. Of course, data other than these may also be included as appropriate.

[0176] The photographing position setting data 712 may be described using predetermined coordinate values ​​in the diorama space 5, or may be described using a relative position with respect to the first character 3, depending on the composition to be adopted.

[0177] The shooting direction setting data 713 may be described as a predetermined direction in the diorama space 5 depending on the composition to be adopted. Alternatively, it may be described as a relative direction from a reference direction from the virtual camera toward the main subject (the object selected and set in the setting item "Subject" in the support content setting section 72 in FIG. 11), or a relative direction with the front direction of the main subject as the reference direction.

[0178] The image processing setting data 717 indicates the settings of the image processing to be applied to the image captured by the virtual camera of the setting, including, for example, the filter type, filter strength, and mask data for the filter.

[0179] The focus setting data 718 specifies the focus position of the virtual camera for that setting. For example, it may be specified by a specific character such as the first character 3 or the second character 4, or by a focus distance such as distant view, close view, or middle view.

[0180] 21, the basic camerawork setting data 728 is data that is referenced when the viewing type is set to "video" in the viewing type setting section 70 of the shooting support screen W6 (see FIG. 11). The basic camerawork setting data 728 is written as a list of the camera setting candidate IDs 711 of the camera setting candidate data 710, and the camerawork is realized by following the order of the list while using the camera settings as key positions (for example, by sequentially circulating the virtual cameras corresponding to the camera layout diagram 75 shown in FIG. 11).

[0181] 23 and 24 are diagrams showing examples of the data structure of the object addition data 730. FIG. The object addition data 730 is referenced when "compositional deficiency supplement" is enabled in the shooting support settings (see FIG. 11).

[0182] FIG. 23 shows an example of object addition data 730 that is applied to a case where the "deficiency in composition" is "objects in the foreground, middle distance, and background are not captured in the diorama image captured by the virtual camera."

[0183] The object addition data 730 indicates that application requirement 731 indicates "insufficient objects corresponding to any of the foreground, middle distance, or background." The object addition data 730 includes a foreground additional object candidate list 733 that is referenced when there are insufficient objects corresponding to the foreground, and a middle distance additional object candidate list 734 that is referenced when there are insufficient objects corresponding to the middle distance. The object addition data 730 also includes a background additional object candidate list 735 that is referenced when there are insufficient objects corresponding to the background.

[0184] In the example of Figure 12, the list of candidate additional objects for distant background 735 includes the object type of the second object 82, and the list of candidate additional objects for middle background 734 includes the object type of the third object 83.

[0185] FIG. 24 shows an example of object addition data 730 that is applied to a case where the "deficiency in composition" is "the presence of an area of ​​a predetermined size or larger in which nothing is captured in the diorama image captured by the virtual camera."

[0186] The object addition data 730 includes an application requirement 731 indicating "there is a sky area with no objects in it" and includes a criterion for determining the sky area (for example, the ratio to the total image area). The object addition data 730 also includes one or more sky area position-specific addition object candidate lists 736. The sky area position-specific addition object candidate list 736 stores a list of object types of the addition object candidates in association with a coordinate range of a sky area, which is an application requirement that must be met in order for the list to be applied.

[0187] 21, the second character type variable setting data 740 is data that is applied when "Proposal to change type of second character" is enabled in the support content setting unit 72 (see FIG. 11). The second character type variable setting data 740 stores a second character type candidate list in association with the first character type list as an application requirement.

[0188] The effect addition data 742 is data that is applied when "add / change effect" is enabled in the support content setting unit 72 (see FIG. 11). The effect addition data 742 is prepared for each application requirement and stores effect data to be added or deleted. An application requirement may be, for example, "when no highlight occurs on an object in the foreground." The corresponding effect data may be a reflected light effect 84 (see FIG. 13), etc.

[0189] The light source addition data 744 is data that is applied when "add / change light source" is enabled in the support content setting unit 72 (see FIG. 11). The light source addition data 744 is prepared for each application requirement and stores light source data to be added or deleted. An application requirement may be, for example, "the difference in luminance between the light and dark areas of the main subject is equal to or less than a reference value." Setting data such as the type of added light source, the added position, the light emission color, and the light intensity may also be stored.

[0190] The additional weathering data 746 is data that is applied when "add / change weathering" is enabled in the support content setting unit 72 (see FIG. 11). The additional weathering data 746 is prepared for each application requirement, and stores settings for the weathering to be added. An application requirement may be, for example, "an object that has been hit within a predetermined short distance from the virtual camera (for example, the second character 4 in FIG. 4)." The additional weathering data may then be stored.

[0191] The virtual camera settings can be supported by appropriately setting effect additional data 742, light source additional data 744, and weathering additional data 746 according to the content described in the application requirements 701. In addition, it is possible to add a "look" to the captured image, helping to generate a higher quality diorama image.

[0192] The application requirements for the effect additional data 742 may include the camera setting candidate ID 711 of the camera setting candidate data 710 so that the effect additional data 742 can be selectively applied to a specific camera setting. The same applies to the application requirements for the light source additional data 744 and the weathering additional data 746.

[0193] 16, user management data 790 is prepared for each user 2 who has completed a predetermined registration procedure, and stores the registration information of that user 2 and various data associated with that user 2. One piece of user management data 790 includes, for example, a user account, game save data, save data related to scene creation, etc. Of course, data other than these may also be included as appropriate.

[0194] The game play data 800 is created for each game play and includes various data related to the game progress control of the game play. The game play data 800 also includes scene creation data 801.

[0195] FIG. 25 is a diagram showing an example of the data structure of the scene creation data 801. Scene creation data 801 stores various data related to the execution of a function for creating a virtual diorama and creating a scene. For example, the scene creation data 801 includes a scene creation ID 802, element-specific support content setting data 804, situation theme data 806, and virtual space information 808. It also includes a character-specific setting data group 828 and viewing setting data 850. Of course, other data may also be included as appropriate.

[0196] The element-specific support content setting data 804 stores the content set by the user through selection operation using the element-specific support content setting operation icon 24 (see FIG. 8).

[0197] The virtual space information 808 stores various information related to the diorama space 5. For example, the virtual space information 808 includes space configuration setting data 810.

[0198] The space configuration setting data 810 includes environment setting data 812, placement object data 822 for each placement object 7, light source setting data 824 for each light source, and effect data 826 for each effect.

[0199] The environment setting data 812 further includes field type data 813 , time period data 814 , and weather data 815 . The placement object data 822 stores the object type, placement position, placement orientation, texture data, and the like. The light source setting data 824 stores data such as the type of light source, the light source position, the light projection direction, the light emission color, and the light amount. The effect data 826 stores the effect type (object type if an object is used), placement position, posture, effect setting data, and the like.

[0200] The character-specific setting data group 828 includes character-specific setting data such as first setting data 840A and second setting data 840B. The first setting data 840A and the second setting data 840B are data indicating the settings of the setting elements of the first character 3 and the second character 4, respectively.

[0201] 26, the first setting data 840A includes, for example, a character type 842, a character position 843, a character direction 844, a character posture data 845, a character appearance data 846, and character-associated object data 847. Of course, other data may also be included as appropriate.

[0202] Character appearance data 846 includes, for example, the character model data type, skin data type, texture data, weathering data, etc. used. The character attached object data 847 is prepared for each attached object (for example, equipment), and includes the type, attached position, attached posture, weathering data, etc., of each attached object.

[0203] The second setting data 840B has the same data configuration as the first setting data 840A, and includes, for example, a character type 842, a character position 843, a character direction 844, a character posture data 845, a character appearance data 846, and character-associated object data 847. Of course, other data may also be included as appropriate.

[0204] The character position 843 may be described as absolute coordinates in the diorama space 5, or may be described as a relative position with respect to the first character 3. The character position 843 may be described as an absolute direction in the diorama space 5, or may be described as a relative direction with respect to the direction of the first character 3.

[0205] FIG. 27 is a diagram showing an example of the data configuration of the viewing setting data 850. As shown in FIG. The viewing setting data 850 stores data on various settings based on user operations on the viewing screen W4 (see FIG. 10) and the shooting support screen W6 (see FIG. 11).

[0206] The viewing setting data 850 includes, for example, camera setting data 852, shooting support setting data 855, a suggested camera setting candidate ID list 858, and applied camerawork setting data 860. Of course, data other than these may also be included as appropriate.

[0207] One camera setting data 852 includes a setting ID 853a, a frame type 853b, a shooting position 853c, a shooting direction 853d, and a shooting angle of view 853e. It also includes an aperture value 853f, a shutter speed 853g, an image processing setting (filter setting) 853h, and a focus setting 853j.

[0208] The photography support setting data 855 includes an applied viewing type 856 and support content setting data 857. The support content setting data 857 indicates the valid / invalid setting result in the support content setting section 72 of the photography support screen W6 (see FIG. 11).

[0209] The proposed camera setting candidate ID list 858 shows the camera setting candidates presented in the setting candidate display section 74 of the photography support screen W6 (see FIG. 11).

[0210] The applied camerawork setting data 860 includes various setting data for camerawork that is actually applied when generating the video. For example, it includes a list of setting IDs 853a described in the order of tracing, data on the course to be traced, in-between data for camera settings during tracing, etc. The applied camerawork setting data 860 can be considered as second camera setting data 862 that is determined based on multiple camera settings 853.

[0211] FIG. 28 is a functional block diagram showing an example of the functional configuration of the user terminal 1500. The user terminal 1500 includes an operation input unit 100 , a device processing unit 200 , a sound output unit 390 , an image display unit 392 , a communication unit 394 , and a terminal storage unit 500 .

[0212] The operation input unit 100 outputs operation input signals corresponding to various operation inputs made by the player to the device processing unit 200. For example, it can be realized by a push switch, a touch panel, a joystick, a touchpad, a trackball, an acceleration sensor, a gyro, or the like.

[0213] The device processing unit 200 is realized by electronic components such as a microprocessor such as a CPU or GPU, and an IC memory, and controls data input / output between the device and each functional unit including the operation input unit 100 and the terminal storage unit 500. The device processing unit 200 controls the operation of the user terminal 1500 by executing various arithmetic processes based on predetermined programs and data, operation input signals from the operation input unit 100, and various data received from the server system 1100.

[0214] The device processing unit 200 includes a client control unit 260 , a timing unit 280 , a sound generation unit 290 , an image generation unit 292 , and a communication control unit 294 .

[0215] The client control unit 260 performs various controls to make the user terminal 1500 function as a man-machine interface, as a control unit acting as a client in the game system 1000. Specifically, the client control unit 260 has an operation input information providing unit 261 and a display control unit 262.

[0216] The operation input information providing unit 261 controls transmission of operation input information to the server system 1100 in response to input from the operation input unit 100 .

[0217] The display control unit 262 performs control to display various images based on the data received from the server system 1100 .

[0218] The timekeeping unit 280 uses a system clock to keep track of the current date and time, time limit, and the like.

[0219] The sound generation unit 290 is realized by, for example, a digital signal processor (DSP), a processor such as a voice synthesis IC, an audio codec capable of reproducing audio files, or the like, and generates sound signals of music, sound effects, and various operation sounds, and outputs them to the sound output unit 390. The sound output unit 390 is realized by a device that outputs (emits sound) based on the sound signals input from the sound generation unit 290, such as a speaker.

[0220] The image generation unit 292 generates and outputs an image signal that causes the image display unit 392 to display an image based on the control of the client control unit 260. In the example of Fig. 1, this corresponds to a GPU (Graphics Processing Unit), a graphics controller, a graphics board, etc., mounted on the control board 1550. The image display unit 392 is realized by a device that displays images, such as a flat panel display, a head-mounted display, or a projector.

[0221] The communication control unit 294 executes data processing related to data communication and realizes data exchange with external devices via the communication unit 394. The communication unit 394 realizes communication by connecting to the network 9. For example, this is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In the example of FIG. 1, this corresponds to the communication module 1553.

[0222] The device storage unit 500 stores programs for causing the device processing unit 200 to realize given functions, various data, etc. It is also used as a work area for the device processing unit 200, and temporarily stores the results of calculations executed by the device processing unit 200 in accordance with the various programs, input data input from the operation input unit 100, etc. These functions are realized by, for example, IC memory such as RAM or ROM, magnetic disks such as hard disks, optical disks such as CD-ROMs or DVDs, etc. In the example of FIG. 1, this corresponds to the IC memory 1552 mounted on the control board 1550.

[0223] Specifically, the terminal storage unit 500 stores a client program 750 (application program) for causing the user terminal 1500 to function as the client control unit 260. It also stores received data 752 received from the server system 1100 and the current date and time 900. Of course, data other than these can also be stored as appropriate.

[0224] FIG. 29 is a flowchart illustrating the flow of processing executed by the server system 1100. When the server system 1100 detects a game play request operation (YES in step S10), it accepts the player character selection and equipment setting operation (step S12) and executes game play processing (step S14). When the game ends, the game play processing ends.

[0225] When the server system 1100 detects a scene creation request operation (step S16), it executes a scene creation process (step S18).

[0226] 30 to 33 are flowcharts for explaining the flow of the scene creation process. As shown in FIG. 30, in the scene creation process, the server system 1100 initializes all support items in the element-specific support content setting data 804 (see FIG. 25) of the scene creation data 801 to "valid" (step S30).

[0227] If a custom operation is detected using the element-specific support content setting operation icon 24 (see FIG. 8) (YES in step S32), the server system 1100 changes the enable / disable setting of the element-specific support content setting data 804 in accordance with the custom operation (step S34).

[0228] Next, the server system 1100 starts displaying the scene creation screen W2 (see FIG. 2) (step S40), accepts a selection operation of a situation theme (step S42), and accepts an operation to set the space configuration (step S44).

[0229] Next, the server system 1100 presets the diorama space 5 based on the situation theme and spatial configuration settings (step S46). Specifically, the server system 1100 references the spatial configuration setting support definition data 610 (see FIG. 18) to search for definition data that meets the requirements indicated by the primary application requirements 613. Then, the server system 1100 copies the primary spatial configuration setting template data 615 to the spatial configuration setting data 810 (see FIG. 25) of the scene creation data 801.

[0230] Next, the server system 1100 accepts a selection operation of the first character type (step S60), and initially places the first character 3 of the selected type in the diorama space 5 at the position pointed to and operated by the user (step S62). The initial state setting indicated by the character object initial setting data 522 of that type is copied to the first setting data 840A.

[0231] Next, if the support setting for the second character type is "invalid" (invalid in step S64), the server system 1100 accepts a selection operation for the second character type (step S66). If the support setting is "valid" (valid in step S64), the server system 1100 refers to the second character type variable setting definition data 620 (see FIG. 17) and automatically arranges the type of the second character 4 (step S68). If multiple second character type candidates are set in the referenced definition data, these may be presented to the user as provisional settings and a selection operation may be accepted from among the candidates.

[0232] Then, the server system 1100 initially places the second character 4 of the type determined in step S66 or step S68 in the diorama space 5 in an initial state (step S70). The initial state setting indicated by the character object initial setting data 522 of that type is copied to the second setting data 840B.

[0233] Next, the server system 1100 searches the spatial configuration setting support definition data 610 (see FIG. 18) for definition data that satisfies the primary application requirement 613 and the secondary application requirement 617. Then, the content of the secondary spatial configuration setting template data 619 is reflected in the spatial configuration setting data 810 (see FIG. 25) (step S72).

[0234] Moving to FIG. 31, when a space configuration setting operation is detected (YES in step S80), the server system 1100 changes the space configuration setting data 810 accordingly (step S82).

[0235] Furthermore, when the server system 1100 detects a first setting operation that changes the position, posture, etc. of the first character 3 (YES in step S84), it changes or resets the first setting of the first character 3 accordingly (step S86). The processes from step S84 to step S86 may be performed between step S62 and step S64.

[0236] When the first setting is reset (YES in step S90), the server system 1100 searches the second setting variable setting definition data 630 (see FIG. 19) for definition data that satisfies the application requirements 632. Then, a provisionally set second character that reflects the content of the searched second setting designation data 635 is provisionally set in the diorama space 5, separate from the second character 4 that has already been placed (step S94). The provisionally set second character 4 is displayed in a characteristic display form (for example, semi-transparent, outline-enhanced, etc.) to indicate to the user that the provisionally set second character is a candidate option for the support content of the second setting.

[0237] Then, the server system 1100 accepts a confirmation operation to confirm any of the provisionally set second characters (step S96). The setting of the provisionally set second character confirmed is reflected in the second setting, and the support related to the setting of the second character is confirmed and reflected in the diorama space (step S98). In the scene creation screen W2, the position and posture of the second character 4 in the initial state placed by the user will change with the confirmation operation.

[0238] Apart from the support related to the setting of the second character, if the user arbitrarily operates the second setting (YES in step S110), the server system 1100 changes the second setting accordingly (step S112).

[0239] Next, if there is additional object definition data 640 (see FIG. 20) that satisfies the application requirements 642 (YES in step S120), the server system 1100 temporarily places the additional object in the diorama space 5 in accordance with the additional content data 644 (step S122). The temporarily placed additional object is displayed in a characteristic display form, indicating to the user that it is a support option.

[0240] Moving to FIG. 32, the server system 1100 accepts a confirmation operation to confirm the temporarily placed additional object (step S124), and reflects the confirmed additional object in the diorama space 5 (step S126).

[0241] When the server system 1100 detects the viewing start operation (YES in step S150), it displays the viewing screen W4 (see FIG. 10) (step S152) and accepts the setting operation of the virtual camera that captures the diorama image 58 (step S154).

[0242] Then, a virtual camera is set and placed in the diorama space 5 in accordance with the setting operation (step S154), and a diorama image 58 captured by the virtual camera is generated and displayed (step S156). The diorama image 58 may be saved in the user management data 790 by a predetermined image saving operation.

[0243] Next, when the server system 1100 detects a shooting support operation (YES in step S170), it displays the shooting support screen W6 (see FIG. 11) and accepts a viewing support setting operation such as a viewing type and support content (step S172).

[0244] The server system 1100 automatically sets virtual cameras only for the camera setting candidate data 710 of the photography support definition data 700 (see FIG. 21) that satisfies the application requirements 701, and causes the setting candidate display unit 74 to additionally display the camera layout diagram 75 (step S174). Accordingly, camera setting data 852 (see FIG. 27) for the automatically set virtual camera is copied from the camera setting candidate data 710 and added.

[0245] Furthermore, the server system 1100 temporarily places additional objects in the diorama space 5 in accordance with the object addition data 730 (see FIGS. 23 and 24) of the photography support definition data 700 that satisfies the application requirements 701 (step S176). The temporarily placed additional objects are in a characteristic display form.

[0246] Then, the server system 1100 accepts a confirmation operation to confirm the temporarily placed additional object (step S178), and reflects the confirmed additional object in the diorama space 5 (step S180).

[0247] Furthermore, effect objects, light sources, and weathering are added in accordance with the effect addition data 742, light source addition data 744, and weathering addition data 746 of the photography support definition data 700 that satisfy the application requirements 701 (step S182), provided that these support items are set to "enabled" in the support content settings.

[0248] 33, the server system 1100 further proposes a change in the type of the second character 4 in accordance with the second character type variable setting data 740 (see FIG. 21) of the photographing support definition data 700 that satisfies the application requirements 701 (step S184).

[0249] Specifically, for example, a character image from the second character type candidate list of the setting data is displayed as a pop-up that also serves as a selection operation icon, and the user is asked to choose whether to use the second character 4 set by the user as is, or to use a candidate character. If a candidate character is selected, the second character 4 is replaced with the selected candidate character. However, this is only possible if the support item "Suggest changing second character type" is set to "enabled."

[0250] Next, when the viewing type is set to "single still image" (single still image in step S190), the server system 1100 accepts the selection of a virtual camera to be used for viewing from among the virtual cameras set by the user and the automatically set virtual cameras (step S192). Specifically, the camera layout diagram 75 in the setting candidate display section 74 is used as an operation icon for the selection operation (see FIG. 11).

[0251] The server system 1100 then generates a captured image taken by the virtual camera used for viewing (step S194), processes the captured image in accordance with the image processing settings 853h of the camera setting data 852 of the virtual camera (step S196), and displays and saves the processed image on the viewing screen W4 as a diorama image 58 for viewing (step S198).

[0252] On the other hand, if the viewing type is set to "moving image" (moving image in step S190), the server system 1100 generates the applied camerawork setting data 860 (see FIG. 27) (step S202). Specifically, when only automatically set virtual cameras are used, the tracing order follows the basic camerawork setting data 728 (see FIG. 21). When a mixture of virtual cameras set by the user and automatically set virtual cameras is used, a tracing course is generated that moves continuously through the positions of these multiple virtual cameras. Then, the settings of the virtual cameras are set in an in-between manner during the course movement so that the settings of the virtual cameras change gradually in the tracing order.

[0253] Next, the server system 1100 generates a provisional video by continuously shooting images with a virtual camera controlled by the tracing course and the in-between setting (step S204), and performs image processing on the provisional video to complete the video (step S206).Then, the completed video is displayed and saved as a diorama image 58 on the viewing screen W4 (step S208). If the number of virtual cameras and camera settings used is small, the finished video will end up being a short video with a short playback time, but if the number of virtual cameras and camera settings used is large, it can end up being a long video with a long playback time.

[0254] The server system 1100 stores the scene creation data 801 in the user management data 790 (step S210), and ends the series of processes.

[0255] As described above, according to this embodiment, a technology can be realized to assist in scene creation when providing user 2 with the experience of creating a virtual diorama (scene creation) by placing multiple characters in a virtual space to create a given scene.

[0256] That is, when the user 2 sets the first setting for the first character 3, the second setting for the second character 4 is automatically changed and set, thereby supporting the scene creation work of creating the diorama space 5. Also, the setting of the virtual camera for viewing the diorama space 5 is also supported.

[0257] [Modification] Although examples of embodiments to which the present invention is applied have been described above, the forms to which the present invention can be applied are not limited to the above forms, and constituent elements can be added, omitted, or modified as appropriate.

[0258] (Variation 1) The game content exemplified in the above embodiment is merely an example, and the present invention can be applied to games with other content, regardless of the number of users 2 (players) participating in the game, the number of player characters operated by one user 2 (player), the game genre, or PvP / PvC format.

[0259] (Variation 2) In the above embodiment, a client-server configuration is exemplified, but the present invention is not limited to this. For example, a game may be realized in a system in which multiple user terminals 1500 are connected via P2P (peer-to-peer) connections. In this case, one of the user terminals 1500 constituting the P2P network functions as the server system 1100.

[0260] (Variation 3) The above embodiment can also be applied to a case where a game is executed on a stand-alone user terminal 1500. For example, as shown in FIG. 34, a user terminal 1500B may be configured to function as a stand-alone game device by implementing the functions of a game management unit 210. In this case, as shown in FIG. 35, the terminal storage unit 500 of the user terminal 1500B implements the functions of the game management unit 210 and stores a game program 754 and game initial setting data 510. The terminal storage unit 500 also stores scene creation support definition data 600, user management data 790, game play data 800, and current date and time 900.

[0261] The flow of the process executed by the user terminal 1500B in this modified example is the same as that shown in FIGS. 30 to 33, and it is sufficient to read the process as being executed by the user terminal 1500B. In this modified example, the same effects as in the first embodiment can be obtained.

[0262] (Variation 4) In the above embodiment, an example was shown in which existing data used in the game is used as the character object data for the first character 3 and the second character 4, but the present invention is not limited to this.

[0263] For example, as shown in FIG. 36, a character object may be generated by taking a picture of a construction toy 8 that the user himself / herself has created in the real world using an all-around camera 1600 that is connected to a user terminal 1500 for communication.

[0264] The assembly toy 8 may be an assembly-type plastic model of a character appearing in a game. The assembly toy 8 may also be a unique type of character that is created by combining parts of multiple characters according to the user's preferences.

[0265] The omnidirectional imaging device 1600 has a turntable 1601, a camera 1602, and a camera support device 1603, and its operation is controlled by a control board 1650. An operation unit for starting imaging and the like may be provided as appropriate, or remote control operation may be performed from the user terminal 1500.

[0266] The turntable 1601 is a movable base for fixing a subject, which is pivotally supported on a vertical rotation axis, and its rotation is controlled by a control board 1650 .

[0267] The camera 1602 is a device that takes digital color photographs. The photographed data (photographed data: image data) is transmitted to the user terminal 1500.

[0268] Camera support device 1603 is a device for supporting camera 1602 and changing the shooting position and shooting posture, and its operation is controlled by control board 1650. Camera support device 1603 is realized by mounting remote control platform 1605 on elevator 1604, for example.

[0269] The configuration of the omnidirectional imaging device 1600 is not limited to this and can be set appropriately. For example, if a configuration is adopted in which multiple fixed cameras can capture images of the entire circumference of a subject, the turntable 1601 and the camera support device 1603 can be omitted.

[0270] The user terminal 1500 generates a three-dimensional model of the construction toy 8 from the omnidirectional photographed images received from the omnidirectional photographing device 1600, and uses this as character model data. Then, indirect structure data that matches the structure of the three-dimensional model is added, and the resulting data is transmitted to the server system 1100 as user-provided data equivalent to the character object initial setting data 522.

[0271] The server system 1100 treats the received user-provided data in the same manner as the character object initial setting data 522 .

[0272] (Variation 5) Furthermore, the function of variably setting the second setting for the second character according to the first setting may be realized by a first machine learning model. This may be realized by machine learning based on training data in which the content of the application requirement 632 of the second setting variable setting definition data 630 is used as input and the second setting is used as output. In this case, as shown in FIG. 37, the scene creation support definition data 600 includes first machine learning model data 902 instead of the second setting variable setting definition data 630.

[0273] Note that if a sufficient number of scene creation data 801 are saved in the user management data 790 in step S210, the saved scene creation data 801 (the user's past creations) may be used as input of training data for the first machine learning model. Re-learning may be performed at a given timing, and the first machine learning model data 902 may be updated as needed. Furthermore, other users' scene creation data 801 may be statistically processed to determine the first setting of a popular first character 3 and the second setting of a popular second character 4, and these may be used as input of training data for the first machine learning model.

[0274] Similarly, if the user management data 790 includes a sufficient amount of game history information about the user, the game history information may be used as input for training data for the first machine learning model. Specifically, the user's favorite missions and the types of actions that the player character likes to perform may be statistically determined from the game history information, and the determined missions and types of actions may be used as input training data for the first machine learning model.

[0275] Furthermore, if the game is based on an anime or manga, video cuts from the original work in which the first character 3 and the second character 4 appear may be used as input training data for the first machine learning model.

[0276] Furthermore, the camera settings of the virtual camera for capturing a scene (diorama space image 85) for viewing the diorama space 5 may be realized by a second machine learning model. The second machine learning model may be realized by machine learning based on training data that uses the application requirements 701 of the photographing support definition data 700 as input and camera settings as output. In this case, as shown in FIG. 38, the photographing support definition data 700 will include second machine learning model data 904 instead of the camera setting candidate data 710.

[0277] (Variation 6) In the above embodiment, an example was given in which the first setting setting unit 216 sets the first setting data 840A (see Figure 25) based on user operation, but it is also possible to configure the server system 1100 to set this automatically.

[0278] For example, first automatic setting definition data 650 as shown in Fig. 39 is prepared in advance. The first automatic setting definition data 650 includes application requirements 652 indicating conditions that must be met to apply the definition data, and at least one first setting specification data 655.

[0279] The sub-conditions constituting the application requirement 652 may include a situation theme condition 653a, a space configuration setting condition 653b, a first character type condition 653f, a first character appearance condition 653g, and a first character accompanying object condition 653h. These correspond to the sub-conditions 634 (634a, 634b, ...) constituting the application requirement 632 of the second setting variable setting definition data 630 (see FIG. 19).

[0280] The first setting designation data 655 includes first character position designation data 655a, first character orientation designation data 656b, first character posture designation data 656c, second character appearance designation data 656d, and second character accompanying object designation data 656e.

[0281] The first setting designation data 655 describes suitable setting contents for the first character 3 in a situation that satisfies the application requirements 652. The setting contents may be a "signature pose" for each type of first character 3 that is reproduced in advance. When the user management data 790 stores operation history information for the first character 3, the setting contents may be a pose for a special action (for example, a special attack rather than a general action) that appears frequently with respect to the first character 3 by the user based on the operation history information.

[0282] The process flow for automatically setting the first setting is as follows. That is, when the server system 1100 detects a predetermined first setting automatic setting request operation, it searches the first setting automatic setting definition data 650 for definition data that satisfies the application requirements 652. Then, for each of the first setting designation data 655, it places the automatically set first character 3 in the diorama space. Although multiple first characters 3 are placed, these are options, temporary placements and temporary settings. Each temporarily placed first character 3 is presented to the user as an option (candidate option for the support content of the first setting) having a characteristic display form (e.g., semi-transparent, outline-enhanced, etc.). Next, the server system 1100 accepts a confirmation operation from the user to select one of the first characters 3 of the options, and confirms the setting of the first character 3 of the option confirmed by the confirmation operation.

[0283] According to this configuration, the user support function is further improved.

[0284] (Variation 7) Furthermore, in the above embodiment, the first character 3 and the second character 4 placed in the diorama space 5 are described as stationary objects that do not move, but they may also be configured to perform given actions or movements.

[0285] Each of the first setting data 840A and the second setting data 840B (see FIG. 26) includes "character repetitive motion data" that specifies the action / motion to be applied to the corresponding character.

[0286] The actions and behaviors to be applied can be set on the scene creation screen W2 (see Figure 2). For example, a setting menu can be added as a submenu of the character menu icon 10c. The setting menu can present a list of actions and behaviors that the first character 3 and the second character 4 can perform in the game, and the user can select one or more.

[0287] When controlling the display of the viewing screen W4, the server system 1100 automatically applies and repeatedly executes the actions and movements indicated by the character repetitive movement data for the first character 3 and the second character 4 in the diorama space 5.

[0288] When the viewing type is set to "single still image" on the shooting support screen W6 (see FIG. 11), the first character 3 and the second character 4 are photographed in the state of being in action at the time when the shooting operation icon 59 is operated. When the viewing type is set to "video", the first character 3 and the second character 4 are photographed in the video, performing the action / motion indicated by the character repetitive motion data.

[0289] In this configuration, "second character repeat action designation data" is prepared in the second setting designation data 635 of the second setting variable setting definition data 630 (see FIG. 19). Then, the repeat action of the second character 4 may also be set automatically as one of the variable settings of the second setting. [Explanation of symbols]

[0290] 3...First character 4...Second character 5...Diorama space 7...Placement object 10...Menu icon 10a…Situation menu icon 10b…Spatial composition menu icon 10c...Character menu icon 13...Start viewing operation icon 24…Support content setting operation icon for each element 50...Camera settings menu icon 52...Shooting support operation icon 72…Support content setting section 86...Diorama image 200s...Server processing section 212…Spatial composition setting section 214...First character type setting section 216...First setting section 220... Second character type variable setting section 222... Second setting variable setting section 224...Second setting change section 226...Additional object placement section 242...Camera settings section 500s...Server storage section 501...Server program 510... Game initial setting data 600...Scene creation support definition data 610…Spatial configuration setting support definition data 620... Second character type variable setting definition data 630... Second setting variable setting definition data 640...Additional object definition data 700...Shooting support definition data 710...Camera setting candidate data 730...Additional object data 740... Second character type variable setting data 800...Gameplay data 801...Scene creation data 804...Support content setting data by element 808...Virtual space information 810...Spatial configuration setting data 812...Preferences data 822...Placement object data 840A...First setting data 840B...Second setting data 850... Viewing setting data 852...Camera setting data 855...Shooting support setting data 857...Support content setting data 902…First machine learning model data 904…Second machine learning model data 1000...Game System 1100...Server system 1500...User terminal 1600...Circumferential camera

Claims

1. A computer system that controls scene creation support when a user creates a given scene by placing a plurality of characters in a virtual space, comprising: the plurality of characters includes at least a first character and a second character; a first setting setting means for setting a first setting related to the first character; a second setting variable setting means for variably setting a second setting for the second character in accordance with the first setting; A computer system comprising:

2. When the first setting is reset by the first setting setting means after the second setting is set, the second setting variable setting means resets the second setting according to the first setting after the reset.

10. The computer system of claim 1.

3. The first setting includes any one of five elements: a) the position of the first character in the virtual space; b) the orientation of the first character; c) the posture of the first character; d) the appearance of the first character; and e) an associated object associated with the first character.

10. The computer system of claim 1.

4. The second setting includes any one of five elements: 1) a relative position of the second character with respect to the first character, 2) a relative orientation, 3) a posture of the second character, 4) an appearance of the second character, and 5) an associated object associated with the second character.

10. The computer system of claim 1.

5. the posture of the second character includes a pose of the second character; 5. The computer system of claim 4.

6. the second setting variable setting means variably sets some or all of the remaining elements based on the first setting and a selection setting of some of the five elements based on the user's operation; 5. The computer system of claim 4.

7. the setting of the second setting by the second setting variable setting means is a provisional decision, a second setting change means for changing the second setting set by the second setting variable setting means based on an operation by the user; The computer system of claim 1 further comprising:

8. the second setting includes a posture of the second character; the second setting variable setting means variably sets the posture of the second character based on the type of the first character and the type of the second character; 5. The computer system of claim 4.

9. the second setting includes a posture of the second character; the second setting variable setting means variably sets the posture of the second character based on information about the virtual space; 5. The computer system of claim 4.

10. the information about the virtual space includes information about placed objects to be placed in the virtual space; the second setting variable setting means variably sets the posture of the second character based on the placed object; 10. The computer system of claim 9.

11. the information about the virtual space includes information about an effect object to be placed in the virtual space; the second setting variable setting means variably sets the posture of the second character based on the effect object; 10. The computer system of claim 9.

12. the information about the virtual space includes an environmental setting for the scene; the second setting variable setting means variably sets the posture of the second character based on the environmental setting; 10. The computer system of claim 9.

13. the second setting includes a posture of the second character; the second setting variable setting means variably sets the posture of the second character based on the appearance of the first character or an associated object included in the first setting; 5. The computer system of claim 4.

14. the second setting variable setting means variably sets the appearance or the accompanying object of the second character included in the second setting based on the appearance or the accompanying object of the first character included in the first setting; 10. The computer system of claim 1.

15. camera setting setting means for setting camera settings of a virtual camera for photographing the scene; The computer system of claim 1 further comprising:

16. the camera setting setting means sets the camera setting based on the first setting and the second setting.

16. The computer system of claim 15.

17. an additional object placing means for placing a given additional object between the first character and the second character based on the first setting and the second setting; The computer system of claim 1 further comprising:

18. a first character type setting means for setting the type of the first character based on an operation by the user; a second character type variable setting means for variably setting the type of the second character in accordance with the type of the first character; The computer system of claim 1 further comprising:

19. The first character and / or the second character is a character model having a pose-changeable joint structure adapted to given character appearance data.

10. The computer system of claim 1.

20. the second setting variable setting means variably sets the second setting using a machine learning model that is machine-learned based on training data that has the first setting as an input and the second setting as an output.

10. The computer system of claim 1.

21. A program for causing a computer system to execute control to support scene creation when a user creates a given scene by placing a plurality of characters in a virtual space, the program comprising: the plurality of characters includes at least a first character and a second character; a first setting setting means for setting a first setting related to the first character; a second setting variable setting means for variably setting a second setting for the second character in accordance with the first setting; A program for causing the computer system to function as a

Citation Information

Patent Citations

  • Game program, game system, game device, and game processing method

    JP2023098611A