Game program, information processing system, information processing device and game processing method

The game program enhances voxel-based game rendering by generating and updating meshes with material-aware vertex simplification, addressing inefficiencies in material reflection and collision detection for improved game performance and realism.

JP2025113122AActive Publication Date: 2025-08-01NINTENDO CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024103661
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-06-27
Publication Date
2025-08-01
Estimated Expiration
2044-06-27

AI Technical Summary

Technical Problem

Existing game programs struggle to effectively reflect materials on object appearances and in-game actions using voxel data, leading to inefficiencies in rendering and collision detection.

Method used

A game program that generates and updates display and determination meshes based on voxel data, utilizing material IDs and density to determine vertex materials and simplify polygon structures, allowing for natural appearance and efficient collision processing.

Benefits of technology

Enables realistic material reflection and efficient in-game action processing by reducing texture usage and simplifying collision detection, while maintaining detailed object appearances.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025113122000001_ABST
    Figure 2025113122000001_ABST
Patent Text Reader

Abstract

To reflect material in terms of appearance and action occurring in a game, for voxel data-based objects.SOLUTION: An information processing system generates a display mesh based on voxel data. The information processing system generates a voxel update range in a virtual space on the basis of game processing, and updates at least any of density and a material ID for each voxel corresponding to the voxel update range in the voxel data. The information processing system updates the display mesh in accordance with the updated voxel data. The information processing system generates an action in a game according to a material of a determination mesh at a collision position on the basis of collision determination between the determination mesh and a determination shape corresponding to a determination target. The information processing system draws a virtual space including the display mesh on the basis of texture corresponding to the material of the display mesh.SELECTED DRAWING: Figure 31
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a game program, an information processing system, an information processing apparatus, and a game processing method for generating an object in a virtual space using voxel data.

Background Art

[0002] Conventionally, objects have been managed using voxel data, and an object mesh has been generated in a virtual space based on the voxel data (see, for example, Non-Patent Document 1).

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a game, it is desired to reflect a material on the appearance of an object and the actions that occur in the game.

[0005] Therefore, an object of the present invention is to provide a game program, an information processing system, an information processing apparatus, and a game processing method capable of executing a game in which a material is reflected on the appearance of an object based on voxel data and the actions that occur in the game.

Means for Solving the Problems

[0006] In order to solve the above problems, the present invention adopts the following configurations (1) to (13).

[0007] (1) An example of the present invention is a game program that causes a computer of an information processing apparatus to perform the following processes. · Based on voxel data defined in a virtual space, for each of a plurality of voxels, a density indicating the degree to which the space defined by the voxel is virtually occupied by its content, and a material ID indicating the type of the content, and at least the material ID that can be set up to a first number of pluralities are set, generating a display mesh corresponding to the voxel data and drawn based on a virtual camera, wherein the vertex coordinates of the display mesh are determined based on at least the density included in the voxel data, and the material of the display mesh is determined based on at least the plurality of material IDs included in the voxel data · Generating a voxel update range in the virtual space based on game processing · In response to the generation of the voxel update range, for each of the voxels in the voxel data that correspond to the voxel update range in the virtual space, updating at least one of the density and the material ID · Updating the display mesh corresponding to the updated voxel data · Based on a collision determination between a determination mesh used for collision determination in the virtual space, wherein the vertex coordinates of the determination mesh are determined based on at least the density included in the voxel data, and the material of the determination mesh is determined based on at least the plurality of material IDs included in the voxel data, and a determination shape corresponding to a determination target based on game processing, generating an in-game action corresponding to the material of the determination mesh at the collision position · Performing drawing of the virtual space including the display mesh based on the vertex coordinates of the display mesh and a texture corresponding to the material of the display mesh

[0008] According to the configuration of (1) above, for an object based on voxel data, the material can be reflected in terms of appearance and the effects that occur in the game.

[0009] (2) In the configuration of (1) above, the material of the display mesh may be determined by setting material IDs up to a second number, which is plural, for each of the plurality of polygons included in the display mesh. The material of the determination mesh may be determined by setting one material ID for each of the plurality of polygons included in the determination mesh. The game program may cause the computer to execute the following processing based on material data including at least drawing setting information including texture information set for the material for each type of material corresponding to the material ID and property information indicating the in-game effects set for the material. · Processing to generate an in-game effect based on the property information corresponding to the material ID set for the polygon for which a collision has been determined among the polygons included in the determination mesh · Processing to perform drawing of the virtual space including the display mesh by causing drawing of each polygon based on the drawing setting information corresponding to each material ID set for each polygon included in the display mesh, based on texture mapping using one texture or blending of a plurality of textures

[0010] According to the configuration of (2) above, for the polygons of the display mesh, natural appearance can be displayed using up to two types of textures, and for the determination mesh, it is possible to suppress the complication of the processing performed according to the result of the collision determination using the determination mesh. [[ID=S16]]

[0011] (3) In the configuration of (2) above, the game program may cause the computer to execute the following processing based on voxel data. · For a portion where a voxel having a density of a setting indicating existence and a voxel having a density of a setting indicating non - existence are adjacent, based on a method of setting vertices at coordinates based on the positions and densities of a plurality of surrounding voxels, a process of generating and updating the vertices of a display mesh · For each vertex, for the material IDs included in the voxel data of a plurality of surrounding voxels, calculate a priority parameter for each material ID based on the voxel data, and based on the priority parameter, select the material IDs up to a third number with high priority and determine them as the material ID of the vertex · For each polygon, among the material IDs set for the vertices included in the polygon, select the material IDs up to a second number and determine them as the material ID of the polygon, thereby generating and updating the material of the display mesh

[0012] According to the configuration of (3) above, while reflecting the material set for the vertex in the appearance of the display mesh, it is possible to perform a rendering process while suppressing the number of textures used

[0013] (4) In the configuration of (3) above, the game program further causes the computer to replace a plurality of vertices with a new single vertex for which coordinates and a material ID are set based on the plurality of vertices for the vertices for which the coordinates and the material ID are determined based on a plurality of surrounding voxels, thereby performing a simplification to reduce the number of vertices, and generating a polygon based on the vertices after the simplification

[0014] According to the configuration of (4) above, the number of polygons constituting the mesh can be reduced

[0015] (5) In the configuration of (3) or (4) above, the game program may cause the computer to calculate the priority parameter based on the densities of a plurality of surrounding voxels so that the priority of the material ID set for the voxel with a high density becomes high

[0016] According to the configuration of (5) above, the material of the vertex can be determined by reflecting the height of the density set for the voxel.

[0017] (6) In any of the configurations from (3) to (5) above, the game program may cause the computer to calculate the priority parameter such that the priority of the material ID set for the voxel closer to the vertex is higher based on the distance from the reference positions of a plurality of surrounding voxels to the vertex.

[0018] According to the configuration of (6) above, the material of the vertex can be determined by reflecting the distance between the voxel and the vertex.

[0019] (7) In any of the configurations from (3) to (6) above, an in-voxel ratio indicating the ratio of the material indicated by the material ID within the voxel may be further set for each voxel in the voxel data. The game program may cause the computer to calculate the priority parameter such that the priority of the material ID with a higher in-voxel ratio is higher based on the in-voxel ratios of a plurality of surrounding voxels.

[0020] According to the configuration of (7) above, the material of the vertex can be determined by reflecting the ratio of a plurality of materials set for one voxel.

[0021] (8) In any of the configurations from (3) to (7) above, the game program may cause the computer to generate and update the material of the display mesh by setting the material ID as the material ID of the polygon when the number of material IDs is less than or equal to a second number based on the material IDs of all vertices constituting the polygon, and selecting the second number with a higher priority based on the priority parameter of each vertex and determining it as the material ID of the polygon when the number of material IDs exceeds the second number.

[0022] According to the configuration of (8) above, even when more than a predetermined number of materials are set for each vertex, the material of the polygon can be set to a material equal to or less than the predetermined number considering the priority.

[0023] (9) In the configuration of (8) above, the game program causes the computer to perform mapping for rendering the polygon by blending a plurality of textures at each vertex position at an interpolation blend rate obtained by interpolating the blend rates of the respective vertices between the vertices at a blend rate corresponding to the priority parameter of the vertex based on the rendering setting information corresponding to each material ID set for each polygon included in the display mesh.

[0024] According to the configuration of (9) above, the appearance at the boundary between different materials in the display mesh can be made more natural.

[0025] (10) In any of the configurations from (2) to (9) above, the game program may cause the computer to execute the following processes. · A process of determining the vertices of the determination mesh by a method of setting vertices at coordinates based on the positions and densities of a plurality of surrounding voxels for a portion where a voxel having a set density where voxels exist and a voxel having a set density where voxels do not exist are adjacent, based on the voxel data · For each vertex, calculate the priority parameter for each material ID included in the voxel data of a plurality of surrounding voxels based on the voxel data, and select the fourth highest number of material IDs with high priority based on the priority parameter and determine them as the material IDs of the vertex · For each polygon, determine the material ID of the polygon by determining the most frequent or the highest-priority one among the material IDs of each vertex constituting the polygon based on the priority parameter, thereby determining the material of the mesh for determination

[0026] According to the configuration of (10) above, the material set for a polygon can be determined based on the materials set for the surrounding voxels. Also, it is possible to suppress the complication of the process of generating in-game effects according to the result of collision determination using the mesh for determination.

[0027] (11) In any of the configurations from (2) to (10) above, the first number may be 2, and the second number may be 2.

[0028] According to the configuration of (11) above, it is possible to reflect the information of the materials set in the voxel data in the materials of the mesh for display while suppressing the data amount of the voxel data.

[0029] (12) In any of the configurations from (3) to (9) above, the first number may be 2, the second number may be 2, and the third number may be 2.

[0030] According to the configuration of (12) above, it is possible to reflect the information of the materials set in the voxel data in the materials of the mesh for display without loss of material information during the process of obtaining the mesh for display from the voxel data while suppressing the data amount of the voxel data.

[0031] (13) In the configuration of (10) above, the first number may be 2, the second number may be 2, and the fourth number may be 1 or 2.

[0032] According to the configuration of the above (13), it is possible to reflect the information of the material set in the voxel data on the display mesh, and it is possible to suppress the complication of the processing performed according to the result of the collision determination using the determination mesh.

[0033] In addition, another example of the present invention may be an information processing apparatus or an information processing system that executes the processing in the above (1) to (13). Further, another example of the present invention may be a game processing method that executes the processing in the above (1) to (13).

Effect of the Invention

[0034] According to the above game program, information processing system, information processing apparatus, or game processing method, it is possible to reflect the material on the appearance and the actions occurring in the game of the object based on the voxel data.

Brief Description of the Drawings

[0035]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Mode for Carrying Out the Invention

[0036] [1. Configuration of Game System] Hereinafter, a game system according to an example of the present embodiment will be described. An example of the game system 1 in the present embodiment includes a main body device (information processing device; which functions as a game device main body in the present embodiment) 2, a left controller 3, and a right controller 4. The left controller 3 and the right controller 4 are each detachable from the main body device 2. That is, the game system 1 can be used as a device in which the left controller 3 and the right controller 4 are each attached to the main body device 2 and integrated. Also, the game system 1 can be used with the main body device 2, the left controller 3, and the right controller 4 as separate entities (see FIG. 2). Hereinafter, the hardware configuration of the game system 1 of the present embodiment will be described, and then the control of the game system 1 of the present embodiment will be described.

[0037] FIG. 1 is a diagram showing an example of a state in which the left controller 3 and the right controller 4 are attached to the main body device 2. As shown in FIG. 1, the left controller 3 and the right controller 4 are each attached to the main body device 2 and integrated. The main body device 2 is a device that executes various processes (for example, game processing) in the game system 1. The main body device 2 includes a display 12. The left controller 3 and the right controller 4 are devices provided with operation units for the user to input.

[0038] FIG. 2 is a diagram showing an example of a state in which the left controller 3 and the right controller 4 are removed from the main body device 2. As shown in FIGS. 1 and 2, the left controller 3 and the right controller 4 are detachable from the main body device 2. In the following, the left controller 3 and the right controller 4 may be collectively referred to as a "controller".

[0039] FIG. 3 is a six-sided view showing an example of the main body device 2. As shown in FIG. 3, the main body device 2 includes a substantially plate-shaped housing 11. In the present embodiment, the main surface of the housing 11 (in other words, the front surface, that is, the surface on which the display 12 is provided) is generally rectangular in shape.

[0040] Note that the shape and size of the housing 11 are arbitrary. As an example, the housing 11 may be of a portable size. Also, the main body device 2 alone or the integrated device in which the left controller 3 and the right controller 4 are attached to the main body device 2 may be a portable device. Also, the main body device 2 or the integrated device may be a hand-held device. Also, the main body device 2 or the integrated device may be a transportable device.

[0041] As shown in FIG. 3, the main body device 2 includes a display 12 provided on the main surface of the housing 11. The display 12 displays an image generated by the main body device 2. In the present embodiment, the display 12 is a liquid crystal display (LCD). However, the display 12 may be any type of display device.

[0042] Also, the main body device 2 includes a touch panel 13 on the screen of the display 12. In the present embodiment, the touch panel 13 is of a type capable of multi-touch input (for example, a capacitance type). However, the touch panel 13 may be of any type, for example, a type capable of single-touch input (for example, a resistive film type).

[0043] The main body device 2 includes a speaker (i.e., the speaker 88 shown in FIG. 6) inside the housing 11. As shown in FIG. 3, speaker holes 11a and 11b are formed on the main surface of the housing 11. And the output sound of the speaker 88 is output from these speaker holes 11a and 11b respectively.

[0044] Also, the main body device 2 includes a left terminal 17 which is a terminal for the main body device 2 to perform wired communication with the left controller 3, and a right terminal 21 for the main body device 2 to perform wired communication with the right controller 4.

[0045] As shown in FIG. 3, the main body device 2 includes a slot 23. The slot 23 is provided on the upper surface of the housing 11. The slot 23 has a shape capable of mounting a predetermined type of storage medium. The predetermined type of storage medium is, for example, a storage medium dedicated to the game system 1 and the same type of information processing device (e.g., a dedicated memory card). The predetermined type of storage medium is used to store, for example, data used in the main body device 2 (e.g., save data of an application, etc.) and / or programs executed in the main body device 2 (e.g., programs of an application, etc.). Also, the main body device 2 includes a power button 28.

[0046] The main body device 2 includes a lower terminal 27. The lower terminal 27 is a terminal for the main body device 2 to communicate with the cradle. In this embodiment, the lower terminal 27 is a USB connector (more specifically, a female connector). When the integrated device or the main body device 2 alone is placed on the cradle, the game system 1 can display the image generated and output by the main body device 2 on the stationary monitor. Also, in this embodiment, the cradle has a function of charging the placed integrated device or the main body device 2 alone. Also, the cradle has a function of a hub device (specifically, a USB hub).

[0047] FIG. 4 is an orthographic view showing an example of the left controller 3. As shown in FIG. 4, the left controller 3 includes a housing 31. In the present embodiment, the housing 31 has a vertically long shape, that is, a shape that is long in the vertical direction (i.e., the y-axis direction shown in FIGS. 1 and 4). The left controller 3 can also be gripped in a vertically long orientation when removed from the main body device 2. The housing 31 has a shape and size that can be gripped with one hand, particularly the left hand, when gripped in a vertically long orientation. Also, the left controller 3 can be gripped in a horizontally long orientation. When the left controller 3 is gripped in a horizontally long orientation, it may be gripped with both hands.

[0048] The left controller 3 includes an analog stick 32. As shown in FIG. 4, the analog stick 32 is provided on the main surface of the housing 31. The analog stick 32 can be used as a direction input unit capable of inputting a direction. The user can input a direction corresponding to the tilting direction (and an input of a magnitude corresponding to the tilted angle) by tilting the analog stick 32. Note that the left controller 3 may include, as a direction input unit, a cross key or a slide stick capable of slide input instead of the analog stick. Also, in the present embodiment, it is possible to input by pressing the analog stick 32.

[0049] The left controller 3 is provided with various operation buttons. The left controller 3 has four operation buttons 33 to 36 (specifically, a right direction button 33, a down direction button 34, an up direction button 35, and a left direction button 36) on the main surface of the housing 31. Further, the left controller 3 is provided with a recording button 37 and a -(minus) button 47. The left controller 3 has a first L button 38 and a ZL button 39 at the upper left of the side surface of the housing 31. Also, the left controller 3 has a second L button 43 and a second R button 44 on the side surface of the housing 31 on the side where it is attached when attached to the main body device 2. These operation buttons are used to give instructions according to various programs (for example, an OS program or an application program) executed by the main body device 2.

[0050] Also, the left controller 3 is provided with a terminal 42 for the left controller 3 to perform wired communication with the main body device 2.

[0051] FIG. 5 is a six-sided view showing an example of the right controller 4. As shown in FIG. 5, the right controller 4 includes a housing 51. In the present embodiment, the housing 51 has a vertically long shape, that is, a shape that is long in the vertical direction. The right controller 4 can also be gripped in a vertically long orientation when removed from the main body device 2. The housing 51 has a shape and size that can be gripped with one hand, particularly the right hand, when gripped in a vertically long orientation. Also, the right controller 4 can be gripped in a horizontally long orientation. When the right controller 4 is gripped in a horizontally long orientation, it may be gripped with both hands.

[0052] Similar to the left controller 3, the right controller 4 is provided with an analog stick 52 as a direction input unit. In the present embodiment, the analog stick 52 has the same configuration as the analog stick 32 of the left controller 3. Further, instead of the analog stick, the right controller 4 may be provided with a cross key or a slide stick capable of slide input. Also, similar to the left controller 3, the right controller 4 is provided with four operation buttons 53 to 56 (specifically, an A button 53, a B button 54, an X button 55, and a Y button 56) on the main surface of the housing 51. Furthermore, the right controller 4 is provided with a + (plus) button 57 and a home button 58. Also, the right controller 4 is provided with a first R button 60 and a ZR button 61 at the upper right of the side surface of the housing 51. Also, similar to the left controller 3, the right controller 4 is provided with a second L button 65 and a second R button 66.

[0053] Also, the right controller 4 is provided with a terminal 64 for the right controller 4 to perform wired communication with the main body device 2.

[0054] FIG. 6 is a block diagram showing an example of the internal configuration of the main body device 2. In addition to the configuration shown in FIG. 3, the main body device 2 includes each of the components 81 to 91, 97, and 98 shown in FIG. 6. Some of these components 81 to 91, 97, and 98 may be mounted on an electronic circuit board as electronic components and housed in the housing 11.

[0055] The main body device 2 includes a processor 81. The processor 81 is an information processing unit that executes various information processes to be executed in the main body device 2. For example, it may be composed of only a CPU (Central Processing Unit), or it may be composed of a SoC (System-on-a-chip) including a plurality of functions such as a CPU function and a GPU (Graphics Processing Unit) function. The processor 81 executes various information processes by executing an information processing program (for example, a game program) stored in a storage unit (specifically, an internal storage medium such as a flash memory 84, or an external storage medium mounted on the slot 23, etc.).

[0056] As an example of an internal storage medium built into the main body device 2, the main body device 2 includes a flash memory 84 and a DRAM (Dynamic Random Access Memory) 85. The flash memory 84 and the DRAM 85 are connected to the processor 81. The flash memory 84 is mainly a memory used to store various data (which may be a program) stored in the main body device 2. The DRAM 85 is a memory used to temporarily store various data used in information processing.

[0057] The main body device 2 includes a slot interface (hereinafter abbreviated as "I / F") 91. The slot I / F 91 is connected to the processor 81. The slot I / F 91 is connected to the slot 23 and reads and writes data to and from a predetermined type of storage medium (for example, a dedicated memory card) mounted on the slot 23 in accordance with an instruction from the processor 81.

[0058] The processor 81 appropriately reads and writes data between the flash memory 84, the DRAM 85, and each of the above storage media to execute the above information processes.

[0059] The main body device 2 includes a network communication unit 82. The network communication unit 82 is connected to the processor 81. The network communication unit 82 communicates (specifically, wirelessly) with an external device via a network. In the present embodiment, the network communication unit 82 connects to a wireless LAN and communicates with an external device by a method compliant with the Wi-Fi standard as a first communication mode. Further, the network communication unit 82 performs wireless communication with other main body devices 2 of the same type by a predetermined communication method (for example, communication by a proprietary protocol or infrared communication) as a second communication mode. Note that the wireless communication by the second communication mode enables wireless communication with other main body devices 2 arranged within a closed local network area, and realizes a function that enables so-called "local communication" in which data is transmitted and received by direct communication between a plurality of main body devices 2.

[0060] The main body device 2 includes a controller communication unit 83. The controller communication unit 83 is connected to the processor 81. The controller communication unit 83 performs wireless communication with the left controller 3 and / or the right controller 4. The communication method between the main body device 2 and the left controller 3 and the right controller 4 is arbitrary. However, in the present embodiment, the controller communication unit 83 communicates with the left controller 3 and the right controller 4 in accordance with the Bluetooth (registered trademark) standard.

[0061] The processor 81 is connected to the above-described left terminal 17, right terminal 21, and lower terminal 27. When the processor 81 performs wired communication with the left controller 3, it transmits data to the left controller 3 via the left terminal 17 and receives operation data from the left controller 3 via the left terminal 17. Further, when the processor 81 performs wired communication with the right controller 4, it transmits data to the right controller 4 via the right terminal 21 and receives operation data from the right controller 4 via the right terminal 21. Also, when the processor 81 communicates with the cradle, it transmits data to the cradle via the lower terminal 27. Thus, in the present embodiment, the main body device 2 can perform both wired communication and wireless communication with the left controller 3 and the right controller 4, respectively. Further, when the left controller 3 and the right controller 4 are attached to the main body device 2 as an integrated device or when the main body device 2 alone is attached to the cradle, the main body device 2 can output data (e.g., image data and audio data) to a stationary monitor or the like via the cradle.

[0062] Here, the main body device 2 can communicate with a plurality of left controllers 3 simultaneously (in other words, in parallel). Also, the main body device 2 can communicate with a plurality of right controllers 4 simultaneously (in other words, in parallel). Therefore, a plurality of users can simultaneously input to the main body device 2 using sets of the left controller 3 and the right controller 4, respectively. As an example, while the first user inputs to the main body device 2 using the first set of the left controller 3 and the right controller 4, it is possible for the second user to input to the main body device 2 using the second set of the left controller 3 and the right controller 4.

[0063] Also, the display 12 is connected to the processor 81. The processor 81 displays an image generated (e.g., by executing the above-described information processing) and / or an image acquired from the outside on the display 12.

[0064] The main body device 2 includes a codec circuit 87 and speakers (specifically, a left speaker and a right speaker) 88. The codec circuit 87 is connected to the speakers 88 and the audio input / output terminal 25, and is also connected to the processor 81. The codec circuit 87 is a circuit that controls the input / output of audio data to / from the speakers 88 and the audio input / output terminal 25.

[0065] The main body device 2 includes a power control unit 97 and a battery 98. The power control unit 97 is connected to the battery 98 and the processor 81. Also, although not shown, the power control unit 97 is connected to each part of the main body device 2 (specifically, each part that receives power supply from the battery 98, the left terminal 17, and the right terminal 21). The power control unit 97 controls the power supply from the battery 98 to each of the above parts based on a command from the processor 81.

[0066] Also, the battery 98 is connected to the lower terminal 27. When an external charging device (for example, a cradle) is connected to the lower terminal 27 and power is supplied to the main body device 2 via the lower terminal 27, the supplied power is charged to the battery 98.

[0067] FIG. 7 is a block diagram showing an example of the internal configuration of the main body device 2, the left controller 3, and the right controller 4. Note that the details of the internal configuration regarding the main body device 2 are shown in FIG. 6, and thus are omitted in FIG. 7.

[0068] The left controller 3 includes a communication control unit 101 that communicates with the main body device 2. As shown in FIG. 7, the communication control unit 101 is connected to each component including the terminal 42. In the present embodiment, the communication control unit 101 can communicate with the main body device 2 both by wired communication via the terminal 42 and by wireless communication without using the terminal 42. The communication control unit 101 controls the communication method that the left controller 3 performs with respect to the main body device 2. That is, when the left controller 3 is attached to the main body device 2, the communication control unit 101 communicates with the main body device 2 via the terminal 42. Further, when the left controller 3 is removed from the main body device 2, the communication control unit 101 performs wireless communication with the main body device 2 (specifically, the controller communication unit 83). The wireless communication between the controller communication unit 83 and the communication control unit 101 is performed according to, for example, the Bluetooth (registered trademark) standard.

[0069] Further, the left controller 3 includes a memory 102 such as a flash memory. The communication control unit 101 is composed of, for example, a microcomputer (also referred to as a microprocessor), and executes various processes by executing the firmware stored in the memory 102.

[0070] The left controller 3 includes each button 103 (specifically, buttons 33 to 39, 43, 44, and 47). Further, the left controller 3 includes an analog stick (described as "stick" in FIG. 7) 32. Each button 103 and the analog stick 32 output information regarding the operation performed on themselves to the communication control unit 101 repeatedly at appropriate timings.

[0071] The communication control unit 101 acquires information related to input (specifically, information related to operations or detection results by sensors) from each input unit (specifically, each button 103 and the analog stick 32). The communication control unit 101 transmits operation data including the acquired information (or information obtained by performing predetermined processing on the acquired information) to the main body device 2. Note that the operation data is repeatedly transmitted at a rate of once every predetermined time. Note that the intervals at which the information related to input is transmitted to the main body device 2 may be the same or different for each input unit.

[0072] By transmitting the above operation data to the main body device 2, the main body device 2 can obtain the input performed on the left controller 3. That is, the main body device 2 can determine operations on each button 103 and the analog stick 32 based on the operation data.

[0073] The left controller 3 includes a power supply unit 108. In the present embodiment, the power supply unit 108 has a battery and a power control circuit. Although not shown, the power control circuit is connected to the battery and is also connected to each part of the left controller 3 (specifically, each part that receives power supply from the battery).

[0074] As shown in FIG. 7, the right controller 4 includes a communication control unit 111 that communicates with the main body device 2. The right controller 4 also includes a memory 112 connected to the communication control unit 111. The communication control unit 111 is connected to each component including the terminal 64. The communication control unit 111 and the memory 112 have the same functions as the communication control unit 101 and the memory 102 of the left controller 3. Therefore, the communication control unit 111 can communicate with the main body device 2 both by wired communication via the terminal 64 and by wireless communication without using the terminal 64 (specifically, communication conforming to the Bluetooth (registered trademark) standard), and controls the communication method that the right controller 4 performs with the main body device 2.

[0075] The right controller 4 includes the same input parts as each input part of the left controller 3. Specifically, it includes each button 113 and the analog stick 52. These input parts have the same functions as the input parts of the left controller 3 and operate in the same manner.

[0076] The right controller 4 includes a power supply unit 118. The power supply unit 118 has the same function as the power supply unit 108 of the left controller 3 and operates in the same manner.

[0077] [2. Outline of Processing in the Game System] Next, with reference to FIGS. 8 to 29, an outline of the processing executed in the game system 1 will be described. In the present embodiment, the game system 1 generates a game image in which terrain objects and characters (for example, player characters operated by a player) are arranged in a game space that is a three-dimensional virtual space, and displays it on a display device. In the present embodiment, the display device on which the game image is displayed may be the above-described display 12 or a stationary monitor.

[0078] [2-1. Voxel] In the present embodiment, for some objects in the game space, the shape is defined by voxel data. Here, a voxel is a rectangular parallelepiped (more specifically, a cubic) region arranged in a grid pattern in the game space, and voxel data is data indicating information regarding each voxel. Hereinafter, an object whose shape is defined by voxel data will be referred to as a "voxel object". In the present embodiment, the game system 1 stores voxel data as data for generating voxel objects in the game space for a plurality of voxels set in the game space.

[0079] FIG. 8 is a diagram showing an example of a terrain object that is a voxel object. As shown in FIG. 8, in the present embodiment, a terrain object representing a terrain such as the ground is defined in shape by voxel data (that is, it is a voxel object). Each cube shown in FIG. 8 represents a terrain object. In FIG. 8, the portions that are the sides of the terrain object are shown in thick lines, but this thick line is added for the purpose of making the drawing easier to view, and in reality, the sides of the terrain object do not need to be shown thickly.

[0080] Note that the terrain object shown in FIG. 8 is generated, for example, according to the rule that "if the parameter included in the voxel data set for a voxel is greater than a predetermined value, a cube is placed at the position of the voxel, and if it is less than or equal to the predetermined value, nothing is placed at the position of the voxel". The terrain object shown in FIG. 8 is shown for the purpose of easily exemplifying the relationship between voxels and voxel objects. In the present embodiment, in reality, for example, like the terrain object shown in FIG. 13 described later, a voxel object is generated according to a rule that results in a complex shape (based on voxel data). Note that the rule for determining the shape of the voxel object based on voxel data is arbitrary. In other embodiments, the game system 1 may generate a voxel object as shown in FIG. 8 or a voxel object as shown in FIG. 13 based on object data.

[0081] Regarding the voxel object, the shape can be changed by changing the voxel data of each voxel. FIGS. 9 and 10 are diagrams showing an example of the state before and after a part of the terrain object shown in FIG. 8 is deleted. That is, when the hatched portion of the terrain object shown in FIG. 9 is destroyed, the terrain object changes to the shape shown in FIG. 10. At this time, the game system 1 can easily erase the terrain object by rewriting the voxel data described later so as to indicate that there is no terrain object for the voxels in the hatched portion. Note that when the game system 1 adds a terrain object, it can also easily change the shape of the terrain object by changing the voxel data of each voxel, in the same manner as when erasing the terrain object.

[0082] In this way, the game system 1 can freely change the shape of the voxel object by rewriting the voxel data. For example, when the shape of a terrain object in a game is changed as a result of being destroyed for some reason (e.g., a player character strikes the terrain object), the game system 1 does not directly change the data indicating the outer shape of the terrain object (i.e., the mesh described later), but can freely change the shape of the terrain object by changing the voxel data used for generating the terrain object.

[0083] In the present embodiment, it is assumed that voxels are defined throughout the game space (that is, the voxel space in which voxels are set corresponds to the entire game space). However, the voxel space does not necessarily have to be set throughout the game space and may be set in a partial region of the game space. When the voxel space is set in a partial region of the game space, the shape of the voxel object is defined by voxel data regarding the voxels in the voxel space, and the position of the voxel object in the game space is defined by the position of the voxel space in the game space. Also, in the game space, a main voxel space set throughout the game space and a sub-voxel space set in a partial region of the game space may be set. At this time, the game system 1 stores voxel data for each voxel space.

[0084] FIG. 11 is a diagram showing an example of voxel data. The voxel data includes density data, a first material ID, a second material ID, material mixing ratio data, and state data for each voxel defined in the game space. In the voxel data in the present embodiment, these data are set for each voxel.

[0085] The density data indicates the density, which is an index used to define the shape of the voxel object based on the voxel (specifically, the shape defined by a mesh described later). Although details will be described later, the position and shape of the surface of the voxel object (that is, the mesh described later) are determined based on the above density.

[0086] In this embodiment, the density can take integer values in the range from a lower limit value (e.g., 0) to an upper limit value (e.g., 255). In this embodiment, in the game system 1, when the value of the density set for a voxel is high, the ratio of the volume occupied by the region within the voxel object in the voxel tends to be large, and when the value of the density is low, the ratio tends to be small. Based on the density, the surface shape of the voxel object is determined. In this way, the density is an index that affects the ratio of the volume occupied by the region within the voxel object in the voxel. It can also be said that the density is an index indicating the degree to which the space of the voxel is virtually occupied by the content (i.e., the virtual content of the voxel object). For example, when the density is 0, the inside of the voxel is empty, when the density is 255, all of the inside of the voxel is the content of the voxel object, and when the density is a value between 0 and 255, the inside of the voxel can be occupied by the content of the voxel object at a ratio corresponding to the value. Then, based on the above density, the shape of the mesh, that is, the surface shape of the voxel object can be determined. The mesh can also be said to be the surface of the part where the content exists in the voxel, or the boundary between the part where the content exists and the part where it does not exist in the voxel. Note that the volume occupied by the region within the voxel object generated based on the above density does not necessarily have to be exactly the volume corresponding to the ratio indicated by the density. For example, in the method of generating a voxel object as shown in FIG. 8 and the method of generating a voxel object as shown in FIG. 13, even if based on the same density, the volume of the voxel object may be different.

[0087] In other embodiments, the density may indicate either a state where the volume occupied by the region within the voxel object occupies the entire region within the voxel, or a state where the volume occupied by the region within the voxel object is not included in the region within the voxel. For example, the density data may be data that can only take values of 0 or 1.

[0088] The first material ID and the second material ID are information indicating the material (in other words, substance) of the voxel. Here, in the present embodiment, materials such as sand, rock, or soil are set for the voxel. Note that in the game system 1, a plurality of types of materials are prepared as materials that can be set for the voxel (refer to the material data shown in FIG. 12). In the present embodiment, up to two materials out of the plurality of types of prepared materials can be set for one voxel. The first material ID is an ID indicating the first material set for the voxel, and the second material ID is an ID indicating the second material set for the voxel. Although details will be described later, the material of the voxel object (that is, the material set for the polygon of the voxel object) is determined based on the material set for the voxel.

[0089] As described above, in the present embodiment, the voxel data includes the ID indicating the material. However, in other embodiments, the voxel data may be a data structure including data directly indicating the content of the material (that is, the name, properties, and drawing setting information described later).

[0090] The material mixing ratio data is an example of data indicating the ratio of each material in the voxel. In the present embodiment, since the number of material IDs set for one voxel is up to two, the material mixing ratio data indicating the ratio of one of the materials indicated by the first material ID and the material indicated by the second material ID can also represent the other ratio. In the present embodiment, the material mixing ratio is a value indicating the ratio of the second material to the whole composed of the first material and the second material by a value of 0 or more and 1 or less. For example, when the material mixing ratio set for a certain voxel is 0.4, it represents that in the voxel, the first material and the second material are composed in a ratio of 0.6:0.4. Although details will be described later, the appearance and properties of the voxel object are determined based on the material. The material mixing ratio is used to determine the appearance and properties of the voxel object. In other embodiments, the material mixing ratio may be a value indicating the ratio of the first material. Also, the ratio of the materials in the voxel may be represented by respective values indicating the ratio of each material. In particular, in other embodiments, when three or more types of materials can be set instead of up to two types, the ratio of the materials in the voxel is represented as a plurality of values respectively indicating the ratio of each material.

[0091] Note that in the present embodiment, it is not always necessary to set two types of materials for the voxel, and one type of material may be set. For example, when one type of material is set for a certain voxel, the first material ID indicates the material, and the material mixing ratio is set to 0.

[0092] The state data indicates the state set for the voxel. The specific content and number of types of the state data are arbitrary. In the present embodiment, the state data includes data indicating the amount of damage set for the voxel. Note that in other embodiments, the state data may include, for example, data indicating whether the voxel is in a wet state (and the degree thereof).

[0093] As described above, since the voxel data includes the material ID in this embodiment, the game system 1 stores material data that defines the content of the material indicated by the material ID. FIG. 12 is a diagram showing an example of the material data. As shown in FIG. 12, in the material data in this embodiment, for each material, the material ID, the name, properties, and drawing setting information set for the material are associated with each other.

[0094] The name included in the material data is the name set for the material (for example, soil, sand, grass, etc.). Although details will be described later, during the game, the name of the material of the voxel object may be displayed (see FIG. 28). In order to perform such a display, the material data includes information on the name of the material.

[0095] The properties included in the material data are the properties set for the material. The properties of the material are the properties that the voxel object to which the material is set has in the game. Note that the specific content and number of types of the properties of the material are arbitrary. For example, at least any of the following information may be set as the properties of the material. · Hardness · Weight · Slipperiness · Damage setting when the player character touches · Temperature · Whether another object can adhere to the voxel object · Amount of recovery of the player character's physical strength when the player character destroys or acquires the voxel object · Amount of in-game currency that the player character acquires when the player character destroys or acquires the voxel object In other embodiments, information different from the above may be set as the information indicating the properties of the material.

[0096] In this embodiment, material data includes an ID indicating the property as information specifying the property of the material (see FIG. 12). Although not shown, the game system 1 stores property information in which the content of the property (for example, a value indicating the above-described weight or slipperiness) is associated with the property ID for each property to be prepared. By referring to the above property information, the game system 1 can specify the specific content of the property set for the material.

[0097] The rendering settings included in the material data are information indicating settings related to rendering, such as a texture used for rendering the voxel object to which the material is set. In this embodiment, the material data includes an ID of a texture used for rendering the voxel object to which the material is set as information on the rendering settings (see FIG. 12). Although not shown, the game system 1 stores texture information in which the texture ID and the texture indicated by the texture ID are associated with each other for each texture to be prepared. By referring to the above texture information, the game system 1 can specify the specific content of the texture set for the material. In other embodiments, as information on the rendering settings, in addition to the texture information, any information related to the shading settings may be set. For example, the reflectivity, information related to the normal, or the like may be set.

[0098] Also, the material data may include other data than the data shown in FIG. 13. For example, the material data may include data related to sound settings. For example, the data related to sound settings may be data that defines the footstep sound output when the player character walks on the voxel object based on the voxel.

[0099] Note that the material data may be data in any format that can identify the properties of the material and / or rendering settings. For example, in other embodiments, the material data may have a data structure that includes data directly indicating the properties of the material and / or rendering settings, instead of a data structure including a material ID and a texture ID.

[0100] [2-2. Update of Voxel Data] During the game, when the above-described voxel data is updated, the voxel object is deformed. In the present embodiment, when a game event (hereinafter referred to as an "update event") for updating the voxel object occurs, the game system 1 updates the voxel data. The specific content of the update event is arbitrary. The update event may be, for example, that a character appearing in the game performs an action to deform the voxel object (for example, the player character punches the voxel object), or an event that deforms the voxel object occurs (for example, an object thrown by the character contacts the voxel object, or a bomb explodes).

[0101] FIG. 13 is a diagram showing an example of the game space when an update event occurs. The situation shown in FIG. 13 is a situation where the player character 201 performs a punch action on the terrain object 202 which is a voxel object. Although details will be described later, in the example shown in FIG. 13, the voxel data is updated so that the terrain object 202 around the position where the punch action by the player character 201 hits is deleted. As a result, the state where the terrain object 202 is destroyed by the punch action of the player character 201 is expressed.

[0102] In this embodiment, when an update event occurs, the game system 1 sets an update range (update range 203 shown in FIG. 13) for updating the voxel object in the game space. The position, shape, and size of the update range are arbitrary. The position of the update range may be determined based on, for example, the position where the object related to the occurred update event (for example, the player character who performed a punch) and the voxel object are in contact. In the example shown in FIG. 13, the position of the update range 203 may be determined based on the position where the punch by the player character 201 hits, and for example, the hit position or the position a predetermined distance forward from the hit position may be the center position of the update range 203. The shape and size of the update range may be determined in advance to be a shape corresponding to the type of the update event. For example, when an update event due to the punch of the player character 201 occurs, the shape and size of the update range may be determined as a sphere with a predetermined size as shown in FIG. 13. Also, the size of the update range may be determined according to a value indicating the degree of influence of the occurred update event (for example, the strength of the punch or the size of the explosion).

[0103] The game system 1 changes the density of the voxels corresponding to the set update range. Note that the voxels corresponding to the update range are, for example, the voxels within the update range or the voxels overlapping with the update range. As a result of the change in density, the mesh of the voxel object is changed by the process described later, so that the shape of the voxel object (the visible shape and the shape used for collision determination) is changed. Note that in other embodiments, in addition to changing the density of the voxels included in the update range, the game system 1 may change the material (that is, the first material, the second material, and the material mixing ratio) in the voxels or change the state of the voxels.

[0104] In this embodiment, the game system 1 determines whether a voxel is included in the update range by using an SDF (Signed Distance Field). The game system 1 sets an SDF indicating the update range set in the game space, and makes the above determination based on the value of the SDF. The SDF represents, with a sign, the distance from a defined shape for any position. FIG. 14 is a diagram showing an example of the update range. In the example shown in FIG. 14, a spherical update range is set in the game space. For example, in the example shown in FIG. 14, among the positions in the game space, the SDF value becomes negative for the positions inside the shape represented by the SDF, and the SDF value becomes positive for the positions outside the shape represented by the SDF. In this example, it is possible to determine whether or not it is included in the update range depending on whether the value of the SDF is positive or negative. Also, by using the value of the signed distance, not only simple inside / outside determination but also processes such as correction and interpolation can be performed.

[0105] In the above, an example in which a change is added to the voxel object such that the voxel object within the update range is deformed as if it were erased has been described, but the changes added to the voxel object using the update range are not limited to this. For example, a change in which a voxel object is newly added within the update range (that is, the volume occupied by the region within the voxel object increases by the amount of the update range) may be added to the voxel object (see FIG. 29 described later). Also, a change may be added to the voxel object such that only the material of the voxels within the update range changes without changing the density of the voxels. Further, a change combining a change in the density of the voxels and a change in the material may be added.

[0106] [2-3. Calculation of Vertices] When the density of the voxels is updated as described above, the game system 1 sets vertices based on the updated voxel data. The above vertices can be the vertices of the mesh of the voxel object. Although details will be described later, in this embodiment, the above vertices are simplified, and the simplified vertices become the vertices of the mesh of the voxel object.

[0107] FIG. 15 is a diagram showing an example of a method for setting vertices. In FIGS. 15 to 24 described below, for the purpose of making the drawings easier to view and the explanations easier to understand, voxels, vertices, meshes, etc. are represented two-dimensionally, but in reality, vertices and meshes are set in a three-dimensional space based on voxels in the three-dimensional space. In this embodiment, the game system 1 uses a method of setting vertices at coordinates based on the positions and densities of a plurality of surrounding voxels for a portion where a voxel having a set density indicating its existence (that is, a density equal to or higher than a reference value described later) and a voxel having a set density indicating its non-existence (that is, a density less than the reference value described later) are adjacent. Details of this method will be described below.

[0108] As described above, in this embodiment, the density set for each voxel is set within the range of 0 to 255. A voxel with a density of 0 is completely in the air, and a voxel with a density of 255 represents a state where it is completely filled. Densities between 0 and 255 are treated interpolatively and used for vertex determination. And in this embodiment, voxels with a density equal to or higher than a reference value are virtually treated as being inside the object, and voxels with a density lower than the reference value are treated as being outside the object. It can also be said that voxels with a density equal to or higher than the reference value are virtually treated as voxels indicating existence, and voxels with a density lower than the reference value are virtually treated as voxels indicating non-existence. It is not necessary to define only voxels with a density of 0 as being outside the object (i.e., set the reference value = 1), and the reference value can be, for example, 128. In the example shown in FIG. 15, assume that in voxel 211 and other outer voxels, the density is 0, in voxel 212, the density is 100 which is lower than the reference value, and in voxels 213 and 214, the densities are 150 and 210 which are equal to or higher than the reference value. In this embodiment, the game system 1 generates vertices between voxels with a density equal to or higher than the reference value and voxels with a density lower than the reference value. Specifically, for each region spanning eight (four in the drawing) adjacent voxels (the region surrounded by the dotted line in the drawing), it is determined whether to generate a vertex. That is, a vertex is generated in a region spanning both voxels with a density equal to or higher than the reference value and voxels with a density lower than the reference value. The coordinates of the vertex are determined by comparing the densities of adjacent voxels for each of the X, Y, and Z axes and performing interpolation based on the density difference. Note that by setting normal information that defines the position and orientation of the straight line connecting the vertices, the coordinates of the vertex can be further calculated based on the normal information. The normal information may be retained in advance for at least some of the voxels, or if it is not retained, the normal information may also be calculated based on the densities of adjacent voxels. In FIG. 15, since the density of voxel 212 is lower than the reference value, in the determination of the presence or absence of vertices, voxel 212 is treated as being outside the object, but the density value of voxel 212 itself is used for the calculation of the coordinates of the generated vertices.If the reference value is set to a value lower than the density of voxel 212, the result is that more vertices will be added to the upper right and upper left sides of voxel 212 in Fig. 15.

[0109] By setting the vertices as described above, when generating a mesh that connects each of the set vertices (or each vertex after performing the simplification process described later on each of the set vertices), a shape with a volume that reflects the density of each voxel to some extent can be generated. However, depending on the relationship with adjacent voxels, it is possible that a voxel with a density of 0 may include a region within the object, or a voxel with a density of 255 may include a region outside the object. Also, in this embodiment, since voxels with a value less than the reference value are treated as outside the object, the volume is smaller by the amount that the number of vertices is less compared to the case of treating them as inside the object. Thus, it is not necessary to calculate the polygon mesh so as to have a volume that exactly corresponds to the density value.

[0110] [2-4. Determination of Vertex Material] The game system 1 determines the material for each of the vertices set as described above. The material of a vertex is determined based on the materials of the voxels around the vertex. The voxels around the vertex are, for example, the voxels used to determine whether to generate the vertex (that is, the voxels that overlap with the "region spanning voxels" described above). Note that in other embodiments, the voxels used to determine the material of the vertex do not have to be the same as the voxels used to determine the generation of the vertex and may be different.

[0111] FIG. 16 is a diagram showing an example of a method for determining the material of a vertex. In the example shown in FIG. 16, it is assumed that a vertex 219 is set for four voxels 215 to 218, and the four voxels 215 to 218 are the above-mentioned "voxels around the vertex". In the actual three-dimensional space, the number of voxels around the vertex is eight. Also, in the example shown in FIG. 16, for voxel 215, the density is set to 255, the first material is "sand", and the material mixing ratio is 0 (that is, the first material: the second material = 1:0, or the second material may not be set). For voxel 216, the density is set to 0 (the first and second materials may not be set). For voxel 217, the density is set to 204, the first material is "sand", the second material is "grass", and the material mixing ratio is 0.3 (that is, the first material: the second material = 0.7:0.3). For voxel 218, the density is set to 153, the first material is "soil", the second material is "grass", and the material mixing ratio is 0.4 (that is, the first material: the second material = 0.6:0.4). Also, the coordinates indicating the position of vertex 219 are assumed to be (X, Y) = (0.8, 0.6). Note that the coordinate system of these coordinates has the left-right direction in FIG. 16 as the X coordinate, the up-down direction as the Y coordinate, and the center position of the lower-left voxel 217 (the position of the white circle shown in FIG. 13) among the center positions of voxels 215 to 218 as (0, 0).

[0112] When determining the material of a vertex, the game system 1 calculates an evaluation value for each material in the surrounding voxels based on the density of the material and a weight value based on the distance from the voxel to the vertex. First, the weight value is calculated for each voxel, and is calculated so that it becomes larger as the distance from the center position of the voxel to the vertex is closer. In the present embodiment, when the center position of the voxel is (x1, y1) and the coordinates of the vertex are (x2, y2), the weight value for a certain voxel is calculated according to the following formula (1). (Weight value) = |(1 - x1) - x2|·|(1 - y1) - y2|…(1) In the example shown in FIG. 16, the weight values of each of the voxels 215 to 218 calculated according to the above formula (1) are as follows. (Weight value of voxel 215)=|(1 - 0) - 0.8|·|(1 - 1) - 0.6| = 0.12 (Weight value of voxel 216)=|(1 - 1) - 0.8|·|(1 - 1) - 0.6| = 0.48 (Weight value of voxel 217)=|(1 - 0) - 0.8|·|(1 - 0) - 0.6| = 0.08 (Weight value of voxel 218)=|(1 - 1) - 0.8|·|(1 - 0) - 0.6| = 0.32

[0113] Also, the game system 1 calculates the density of the material for each voxel. Here, the density of the material is a value obtained by multiplying the ratio occupied by the material among the materials set in the voxel by the density of the voxel. In the present embodiment, as the density of the voxel, a value obtained by normalizing the values from 0 to 255 described above to values from 0 to 1 is used. In the example shown in FIG. 16, for voxel 215, since the only material set is sand, the above ratio regarding the sand material is 1, and the density of the voxel is 1, so the density of the sand material is 1. For voxel 216, since the density is 0 and no material is set, the density of the material is not calculated. Or, if some material is set, the density of the material is 0. For voxel 217, the above ratios of the set sand material and grass material are 0.7 and 0.3 respectively, and the density of the voxel is 204 / 255 = 0.8, so the density of the sand material is 0.7·0.8 = 0.56, and the density of the grass material is 0.3·0.8 = 0.24. For voxel 218, the above ratios of the set soil material and grass material are 0.6 and 0.4 respectively, and the density of the voxel is 153 / 255 = 0.6, so the density of the soil material is 0.6·0.6 = 0.36, and the density of the soil material is 0.4·0.6 = 0.24.

[0114] Then, the game system 1 calculates the above evaluation value for each material based on the above weight value and the density of the material. In the present embodiment, the evaluation value of the material is a value obtained by adding weights according to the weight value for each voxel to the density of the material calculated for each voxel and summing for each surrounding voxel. In the example shown in FIG. 16, for the evaluation value of the sand material, the density of the material for voxel 215 is 1 and the weight value is 0.12, and the density of the material for voxel 217 is 0.56 and the weight value is 0.08. Therefore, 1·0.12 + 0.56·0.08 = 0.1648. Also, for the evaluation value of the grass material, the density of the material for voxel 217 is 0.24 and the weight value is 0.08, and the density of the material for voxel 218 is 0.24 and the weight value is 0.32. Therefore, 0.24·0.08 + 0.24·0.32 = 0.096. Also, for the evaluation value of the soil material, the density of the material for voxel 218 is 0.36 and the weight value is 0.32. Therefore, 0.36·0.32 = 0.1152.

[0115] The game system 1 determines the vertex materials based on the evaluation values for each material. Specifically, a predetermined number of materials are determined as the vertex materials in descending order of the evaluation values. In this embodiment, two materials with large evaluation values are determined as the vertex materials. In the example shown in FIG. 16, since the evaluation values of the materials of sand, grass, and soil are 0.1648, 0.096, and 0.1152 respectively, the vertex materials are determined as the sand material and the soil material. Also, the game system 1 calculates the ratio of the two determined materials based on the above evaluation values. In this embodiment, the ratio of the two materials may be represented as a second material ratio, which is the ratio of the second material to the whole, similar to the above material mixing ratio. In the example shown in FIG. 16, for example, when the first material is the soil material and the second material is set as the sand material, the above second material ratio is represented as 0.1648 / (0.1648 + 0.1152) ≈ 0.59. Note that in other embodiments, as the value representing the ratio of the two materials, a value indicating the ratio of the first material may be used. Also, respective values indicating the ratio of each material may be used.

[0116] In this embodiment, the game system 1 generates and stores vertex data indicating the position of the vertex, the material IDs of the first and second materials set for the vertex, and the ratio of the materials. However, the method of managing the materials set for the vertex is arbitrary. In other embodiments, the vertex data may be a data structure including data directly indicating the contents of the first and second materials.

[0117] As described above, in the present embodiment, for each vertex, the game system 1 calculates, based on the voxel data of a plurality of surrounding voxels, a priority parameter (for example, an evaluation value) for each material ID included in the voxel data. Then, based on the priority parameter, the material IDs up to a predetermined number (here, two) with high priority are selected and determined as the material ID of the vertex. Note that the specific parameter used as the priority parameter is not limited to the above evaluation value. For example, in other embodiments, an evaluation value calculated using the density of the material instead of the above weight value may be used as the priority parameter.

[0118] In the present embodiment, an evaluation value, which is an example of the priority parameter, is calculated based on the densities of a plurality of voxels around the vertex so that the priority of the material set in the voxel with a higher density becomes higher (that is, the evaluation value of the material becomes larger and the material is more likely to be selected). According to this, the material of the vertex can be determined reflecting the magnitude of the density set in the voxel.

[0119] Also, in the present embodiment, an evaluation value, which is an example of the priority parameter, is calculated based on the distance from the reference position (specifically, the center position) of a plurality of voxels around the vertex to the vertex so that the priority of the material set in the voxel closer to the vertex becomes higher. According to this, the material of the vertex can be determined reflecting the distance between the voxel and the vertex.

[0120] Also, in the present embodiment, it can be said that an evaluation value, which is an example of the priority parameter, is calculated based on the material mixing ratio of a plurality of voxels around the vertex so that the priority of the material with a higher material mixing ratio becomes higher. According to this, when a plurality of materials are set in one voxel, the material of the vertex can be determined reflecting the ratio of each material.

[0121] [2-5. Simplification of Vertex] In this embodiment, the game system 1 simplifies each vertex calculated as described above. That is, the game system 1 reduces the number of vertices by grouping some of the vertices calculated as described above and replacing them with a single vertex. Although details will be described later, the coordinates (i.e., positions) and materials of the vertices to be replaced are set based on a plurality of vertices before replacement. By such simplification, the number of vertices and polygons constituting the mesh of the voxel object can be reduced, and the amount of memory used for processing and the processing load can be reduced.

[0122] In this embodiment, the game system 1 simplifies by expressing each vertex using an SVO (Sparse Voxel Octree). FIG. 17 is a diagram showing an example of vertex simplification. In FIG. 17, one square indicated by a solid line shown in FIG. 17(a) represents one vertex division region. Here, the vertex division region is a square region having the center position of the voxel as a vertex (in the actual three-dimensional space, the vertex division region is a cube or a rectangular parallelepiped), and is a region having the dotted lines in FIGS. 15 and 16 described above as sides. Further, in FIG. 17, the vertex division region in which the letter "v" is shown inside indicates the vertex division region in which vertices are set.

[0123] In this embodiment, the game system 1 determines whether or not it is possible to simplify the vertices within a predetermined number (four in FIG. 17, eight in the actual three-dimensional space) of adjacent vertex division regions. When it is determined that simplification is possible, the vertices within the predetermined number of vertex division regions are simplified.

[0124] Fig. 17(a) shows the state before simplification. In the example shown in Fig. 17, it is assumed that the vertex division regions within the range enclosed by the dotted line can be simplified. At this time, the game system 1 simplifies the vertices within each of the predetermined number of vertex division regions determined to be simplifiable so that they are replaced by one vertex (see Fig. 17(b)). As a result, the vertices within the predetermined number of vertex division regions are simplified to one vertex.

[0125] In this embodiment, the game system 1 performs simplification in multiple stages. The number of stages is arbitrary, but in Fig. 17, only the first two stages are illustrated and described. Fig. 17(b) shows the state after the first-stage simplification, and Fig. 17(c) shows the state after the second-stage simplification. In the second-stage simplification, it is determined whether simplification is possible for the vertices generated by the first-stage simplification. In the example shown in Fig. 17, as a result of determining that the vertex division region within the range enclosed by the dotted line in Fig. 17(b) can be simplified, the vertices of the vertex division region are simplified, resulting in the state shown in Fig. 17(c). Note that the determination conditions for whether the first-stage simplification is possible and the determination conditions for whether the second-stage simplification is possible may be the same or different.

[0126] Regarding the determination of whether simplification is possible, the specific method is arbitrary. In this embodiment, as conditions for the above determination, conditions related to the shape of the voxel object and conditions related to the material are used. In this embodiment, when both the conditions related to the shape of the voxel object and the conditions related to the material are satisfied, it is determined that simplification is possible, and when at least one of the conditions related to the shape of the voxel object and the conditions related to the material is not satisfied, it is determined that simplification is impossible.

[0127] The condition regarding the shape means, for example, that the shape formed by each vertex before simplification and the shape formed by each vertex after simplification are not greatly changed. For example, whether the shape formed by each vertex is not greatly changed before and after simplification can be determined by calculating an index indicating the error between the mesh before simplification and the mesh after simplification and checking whether the index is less than or equal to a predetermined allowable value. Also, for example, when the shape formed by each vertex before simplification is a hollow shape, but the shape formed by each vertex after simplification is not a hollow shape (that is, the information that it is hollow is lost due to simplification), it is also determined that the condition regarding the shape is not satisfied. Whether the above situation occurs can be determined, for example, based on the density of each voxel corresponding to the vertex division region to be determined. Also, for example, when the shape formed by each vertex before simplification is a shape that can be represented only by two or more vertices and cannot be represented by a single vertex, it is also determined that the condition regarding the shape is not satisfied. Note that as the condition regarding the shape of the voxel object, the same condition as the conventional method using SVO may be used.

[0128] In addition, as a condition regarding materials, in the present embodiment, a condition regarding the number of types of materials set for each vertex within the above-mentioned predetermined number of vertex division regions to be simplified is used. FIG. 18 is a diagram showing an example of the condition regarding materials. FIG. 18(a) shows a case where the materials of vertices 221 to 224 are (grass), (grass), (grass and soil), and (grass and soil) respectively, and FIG. 18(b) shows a case where the materials of vertices 221 to 224 are (grass and sand), (grass), (grass and soil), and (grass and soil) respectively. In the present embodiment, the condition regarding materials is that the total number of types of materials set for each of the above vertices to be simplified is equal to or less than a predetermined number. For example, the condition regarding materials is that it is equal to or less than the number of materials that can be set for one vertex. In the present embodiment, the above-mentioned predetermined number is 2. For example, in the case of FIG. 18(a), the total number of types of materials set for each of the vertices 221 to 224 to be simplified is two types, namely grass and soil, so the condition regarding materials is satisfied. At this time, on the condition that the above-mentioned condition regarding the shape of the object is satisfied, each of the vertices 221 to 224 is determined to be simplifiable. On the other hand, in the case of FIG. 18(b), the total number of types of materials set for each of the vertices 221 to 224 to be simplified is three types, namely grass, soil, and sand, so the condition regarding materials is not satisfied. At this time, regardless of whether the above-mentioned condition regarding the shape of the object is satisfied, each of the vertices 221 to 224 is determined to be non-simplifiable.

[0129] Note that in the game system 1, even materials that are strictly classified into different types, as long as the set properties are the same, a plurality of types of materials with different appearances may be prepared. For some of such a plurality of types of materials, in the determination of the condition regarding materials, they may be regarded as the same type and the determination may be made. For example, regarding the material of soil, there may be a case where a plurality of types of soil materials with the same properties but similar appearances (for example, the color or pattern of the texture) are prepared. In such a case, the game system 1 may regard the plurality of types of soil materials as the same type and make a determination regarding the condition regarding materials.

[0130] Here, in the present embodiment, similar to voxels, up to two types of materials can be set for vertices. On the other hand, in the present embodiment, when the total number of types of materials set for each vertex to be simplified is three or more, simplification is not performed. That is, when the total number of types of materials exceeds the number of materials that can be set for one vertex, simplification is not performed. Therefore, even if the number of vertices is reduced by simplification, the information on the materials set for the vertices is not lost due to simplification, and the material information can be maintained.

[0131] In the present embodiment, the material of the vertex after simplification is determined based on the material of each vertex before simplification. Specifically, the game system 1 sets one or two types of materials set for the vertex before simplification as the first material and the second material for the vertex after simplification. Thereby, the material information can be maintained. Note that the ratio of the materials after simplification is determined based on the ratio of the materials of each vertex before simplification. In the present embodiment, the ratio of the materials after simplification is calculated in the same manner as the method of calculating the ratio of the materials of each vertex using the above evaluation value. That is, the game system 1 calculates a weight value based on the distance between the vertex after simplification and the vertex before simplification, and based on the weight value and the density of the material at the vertex before simplification (note that the evaluation value of the material described in [2-4. Determination of the material of the vertex] above can be used as the density of the material here), calculates an evaluation value for each material. Then, the ratio of the materials is calculated based on the calculated evaluation value of each material.

[0132] [2-6. Mesh Generation] In this embodiment, based on each vertex simplified as described above, a mesh of the voxel object is generated. FIG. 19 is a diagram showing an example of a mesh generated based on each vertex. Note that the square shown in FIG. 19 indicates the above-described vertex division region, or a vertex division region in which a plurality of vertex division regions are combined into one by simplification. As shown in FIG. 19, the game system 1 generates a mesh composed of polygons having straight lines connecting adjacent vertices of the vertex division region as sides. Each polygon constituting the mesh is a triangle or a quadrilateral.

[0133] In this embodiment, the game system 1 generates two types of meshes: a display mesh and a determination mesh. The display mesh is a mesh used for displaying the voxel object. The determination mesh is a mesh used for collision determination of the voxel object. Although details will be described later, the game system 1 can perform processing using meshes suitable for displaying and collision determination of the voxel object by using the above two types of meshes.

[0134] In this embodiment, the game system 1 generates the display mesh and the determination mesh based on the data of the above-described SVO (that is, based on each simplified vertex). According to this, by sharing the vertex data used for generating the two types of meshes, the processing efficiency can be improved. Note that in other embodiments, the game system 1 may not perform vertex simplification and may generate the display mesh and / or the determination mesh based on non-simplified vertices.

[0135] In this embodiment, the game system 1 generates the determination mesh to have a simpler shape than the display mesh. Specifically, the game system 1 ensures that the number of vertices of the determination mesh is less than the number of vertices of the display mesh. Here, in this embodiment, the SVO data is data that holds the data of the vertices before simplification and the data of the simplified vertices in an octree structure, and also includes the data used for determining whether simplification is possible. This data includes, for example, the data of the vertices calculated as candidates for the vertices after simplification (referred to as temporary vertices), and the data of the above-mentioned index indicating the error between the vertices before simplification and the temporary vertices. For example, the game system 1 may use, for generating the determination mesh, among the temporary vertices, those vertices for which the above index is equal to or less than a predetermined threshold (this threshold is set to be larger than the above allowable value). According to this, the number of vertices of the determination mesh can be made less than the number of vertices of the display mesh. By making the number of vertices of the determination mesh less than the number of vertices of the display mesh, the processing load due to collision determination can be reduced. Also, since the number of vertices of the display mesh is not excessively reduced, the appearance of the voxel object can be expressed in detail.

[0136] Note that in other embodiments, the display mesh and the determination mesh may be generated based on the same data or different data. Also, the display mesh and the determination mesh may have the same shape (however, even in this case, the materials set for both may be different). Also, the number of vertices of the determination mesh may be the same as the number of vertices of the display mesh, or may be more than the number of vertices of the display mesh.

[0137] [2-6-1. Determination of the Material of the Display Mesh] Next, an example of a method for determining the material and appearance of the display mesh will be described. In the present embodiment, the game system 1 determines the material for each polygon constituting the display mesh. Although details will be described later, in the present embodiment, the polygon corresponding to the above polygon is drawn using up to two textures corresponding to up to two materials. Therefore, the game system 1 ensures that for each polygon constituting the mesh, ultimately, the number of materials set for one polygon is two or less. In other embodiments, three or more materials may be set. For example, in embodiments where there are three or more materials for voxels and vertices, the same number of materials may be set for the polygon.

[0138] In the present embodiment, a quadrilateral may be formed as the polygon constituting the display mesh (see FIG. 19). When determining the material of the display mesh, the game system 1 first divides the quadrilateral constituting the display mesh into two triangles under certain conditions. Hereinafter, with reference to FIG. 20, the process of dividing the quadrilateral into two triangles will be described.

[0139] FIG. 20 is a diagram showing an example in which a quadrilateral constituting a mesh is divided into two triangles. (a) shown in FIG. 20 shows the quadrilateral before division formed by vertices 231 to 234, which are part of the vertices of the mesh, and (b) shown in FIG. 20 shows the two triangles obtained by dividing the quadrilateral. In the example shown in FIG. 20, assume that the materials of each of the vertices 231 to 234 are grass, soil, sand, grass, and grass, respectively.

[0140] In this embodiment, when there are three or more types of materials set at each vertex of a quadrilateral in total, the game system 1 determines whether the division condition is satisfied. In this embodiment, the division condition is that by dividing the quadrilateral into two triangles, the total number of types of materials set at each vertex of the triangles can be two or less. When the division condition is satisfied, the game system 1 divides the quadrilateral into two triangles such that the total number of types of materials set at each vertex is two or less. In the example shown in FIG. 20, the materials set at each vertex 231 to 234 forming the quadrilateral are three types: grass, soil, and sand. Also, when the above quadrilateral is divided into a triangle formed by vertices 231, 232, 234 and a triangle formed by vertices 231, 233, 234, the materials set at each vertex of the former triangle are two types: sand and grass, and the materials set at each vertex of the latter triangle are two types: grass and soil (see (b) of FIG. 20). Therefore, for the above quadrilateral, the division condition is satisfied, so the game system 1 divides the quadrilateral into two triangles.

[0141] Note that since there are two ways to divide a quadrilateral into two triangles, when the division condition is satisfied for the triangles divided by at least one of the two ways, the game system 1 performs the above division by the method that satisfies the division condition. On the other hand, when the division condition is not satisfied for the triangles divided by either of the two ways, the division is performed by either method.

[0142] By performing the division as described above, the game system 1 can generate two triangles in which the materials set at each vertex are two or less so as to minimize the omission of information on three or more types of materials set at each vertex of the quadrilateral. Here, as described above, each polygon constituting the mesh is drawn using up to two types of textures. Therefore, by performing the above division, the game system 1 can draw the polygon using two types of textures so as to minimize the omission of information on the materials set at each vertex.

[0143] In this embodiment, the game system 1 sets a polygon corresponding to the polygon after the above division. That is, the vertices of the polygon after the above division become the vertices of the polygon of the display mesh.

[0144] In this embodiment, for each polygon constituting the display mesh, when there are three or more types of materials set for each vertex of one polygon in total, the game system 1 determines the material of the polygon by selecting two types of materials. FIG. 21 is a diagram showing an example of a method for determining the material of a polygon constituting the display mesh. In the example shown in FIG. 21, for vertex 241 of the triangular polygon constituting the display mesh, let the first material be "grass", the second material be "soil", and the material ratio of the first material: the second material = 0.8:0.2. Also, for vertex 242 of the above polygon, let the first material be "grass", the second material be "sand", and the material ratio of the first material: the second material = 0.5:0.5. Also, for vertex 243 of the above polygon, let the first material be "sand", the second material be "soil", and the material ratio of the first material: the second material = 0.7:0.3.

[0145] When there are three or more types of materials set for each vertex of the polygon in total, the game system 1 calculates a determination value for each material. The determination value is calculated as the value obtained by summing the ratios for each vertex where the material is set. Then, the game system 1 selects two materials in order from the ones with larger determination values as the materials of the polygon. In the example shown in FIG. 21, the determination value of the grass material is 0.8 + 0.5 = 1.3, the determination value of the sand material is 0.5 + 0.7 = 1.2, and the determination value of the soil material is 0.2 + 0.3 = 0.5. Therefore, as the materials of the polygon shown in FIG. 21, the grass and sand materials are selected (see (a) of FIG. 21).

[0146] Incidentally, the specific method of selecting the material of the polygon of the display mesh is arbitrary. In other embodiments, the material of the polygon of the display mesh may be selected by any method based on the information set at the vertices of the polygon. For example, for the material of the polygon of the display mesh, the material with the largest ratio at one vertex is specified for each vertex, and the material with the largest number of times specified for each vertex may be selected as the material of the polygon.

[0147] In the present embodiment, the material of the polygon selected as described above is indicated by the materials set at the respective vertices of the polygon. That is, when the material of the polygon is selected, the game system 1 changes the materials set at the respective vertices of the polygon (that is, the material IDs included in the vertex data) to the selected material. In the example shown in FIG. 21, for vertices 241 and 243, before the selection of the material of the polygon, the materials of grass and soil, and sand and soil are set respectively (see (a) of FIG. 21). When the materials of grass and sand are selected as the material of the polygon as described above, the materials set at each of vertices 241 and 243 are changed to grass and sand (see (b) of FIG. 21). Incidentally, for vertex 242, since the material set before the selection is the same as the selected material of the polygon, the material is not changed. As described above, when two types of materials are selected as the material of the polygon, the information of the materials of the third type and later set at each vertex of the polygon will be deleted.

[0148] In addition, the game system 1 changes the ratio of the materials set at the vertices according to the change of the materials set at the vertices. For example, for vertex 241, the content is changed from the first material being grass and the second material being soil to the first material being grass and the second material being sand. Here, since the ratio of the sand material is 0, the material ratio is the first material: the second material = 1:0. In this way, the above change formally changes the material of each vertex in order to represent the material of the polygon by the materials of the respective vertices of the polygon.

[0149] According to the above, since the materials set at each vertex of one polygon are only the materials corresponding to the textures used for the drawing described later, it is possible to facilitate the execution of the drawing process using the textures.

[0150] Note that due to the above change, there may be a case where all the materials of a certain vertex are changed (that is, none of the materials before the change match the materials after the change). Such a case is, for example, a case where the material set at the vertex before the change is soil, and the materials selected as the materials of the polygon are grass and sand. In such a case, the ratio of the materials at the vertex may be set based on the ratio of the materials at the other vertices of the polygon. For example, in the above example, if the first material set at one of the other vertices of the triangular polygon is grass and the material ratio is grass: sand = 1:0, and the material set at another vertex is sand and the material ratio is sand: grass = 1:0, the material ratio at the vertex may be set to grass: sand = 0.5:0.5. In addition, the game system 1 may determine the ratio of the materials at the vertex in consideration of the distance between the vertex and the other vertices (for example, based on a weight value that increases as the distance gets closer).

[0151] As described above, in the present embodiment, for each polygon, the game system 1 selects up to a predetermined number (here, two) of the material IDs set for the vertices included in the polygon (that is, the material IDs set for the vertices of the polygon corresponding to the polygon), and determines them as the material ID of the polygon. According to this, the game system 1 can perform the drawing process while suppressing the number of textures used while reflecting the material set for the vertex in the appearance of the polygon.

[0152] In the present embodiment, for all the materials of the vertices constituting the polygon, when the number of the materials is less than or equal to the predetermined number, the game system 1 determines the material as the material of the polygon, and when the material exceeds the predetermined number, based on the priority parameter of each vertex (specifically, based on the determination value calculated based on the above-described evaluation value), it selects a predetermined number of materials with high priority and determines them as the material of the polygon. As a result, even when more than a predetermined number of materials are set for each vertex in total, the material of the polygon can be set to a predetermined number or less of materials considering the priority.

[0153] As described above, in the present embodiment, the first and second materials set for each vertex of one polygon are changed to be two types of materials set for the polygon. Here, when such a change is made, there is a possibility that a discrepancy may occur in the first and second materials set for the vertices shared by two adjacent polygons.

[0154] FIG. 22 is a diagram showing an example of materials set for each vertex of two adjacent polygons. FIG. 22 shows a state (FIG. 20(b)) in which two polygons are formed by the respective vertices 231 to 234 shown in FIG. 20. In the example shown in FIG. 22, since the material of the first polygon formed by vertices 231, 233, and 234 is determined to be grass and sand, the first and second materials of these vertices should be set to grass and sand, respectively. On the other hand, since the material of the second polygon formed by vertices 231, 232, and 234 is determined to be grass and soil, the first and second materials of these vertices should be set to grass and soil, respectively. Therefore, in the example shown in FIG. 22, there is a conflict in the materials to be set for vertices 231 and 234 shared by the two polygons.

[0155] Therefore, in the present embodiment, when there is a conflict in the materials to be set for a vertex shared by two polygons, the game system 1 adds another vertex at the same position with respect to the said vertex. FIG. 22(b) is a diagram showing an example of a state in which vertex 231' is added for vertex 231 and vertex 234' is added for vertex 234. In the example of FIG. 22, the game system 1 sets the first and second materials as grass and sand according to the material of the first polygon for vertices 231 and 234. Also, for vertices 231' and 234', the first and second materials are set as grass and soil according to the material of the second polygon. In this way, by formally setting two vertices as the vertices shared by the two polygons (that is, generating two vertex data with the same position but different materials), it is possible to suppress the occurrence of a conflict in the materials set for the vertices.

[0156] The game system 1 generates a display mesh composed of polygons in which the vertices and materials are determined as described above. Also, the game system 1 performs the drawing of the voxel object by performing the drawing of the polygon based on the information of the materials set for each vertex (that is, the first material and the second material).

[0157] FIG. 23 is a diagram showing an example of applying a texture to a polygon. FIG. 23 shows a triangular polygon formed by the respective vertices 241 to 243 shown in FIG. 21. Note that the materials set for the respective vertices 241 to 243 are those shown in FIG. 21(b).

[0158] Regarding the positions of the vertices of the polygon, drawing is performed by mapping that blends the texture of the first material and the texture of the second material set for the vertex at the ratio of the material set for the vertex (that is, using the ratio as the blend rate). Note that the textures of the first and second materials used for drawing are the textures indicated by the drawing setting information associated with the respective material IDs associated with the vertex data in the above-described material data (see FIG. 12). In the example shown in FIG. 23, regarding the position of vertex 241, since the material ratio is grass:sand = 1:0, drawing is performed using only the grass texture. Also, regarding the position of vertex 243, since the first material is sand and the material ratio is sand:grass = 1:0, drawing is performed using only the sand texture. Further, regarding the position of vertex 242, since the first material is grass, the second material is sand, and the material ratio is grass:sand = 0.5:0.5, drawing is performed by blending the grass texture and the sand texture at a blend rate of 0.5:0.5.

[0159] Also, for positions other than the vertices of the polygon, the game system 1 determines the blend rate by interpolating the blend rates at each vertex. Then, the textures of the two materials set at each vertex are drawn by a mapping that blends them based on the interpolated blend rate. Note that the specific method of interpolation is arbitrary. As an example, the blend rate between vertices is linearly interpolated. In FIG. 23, the positions where the ratio of applying the texture of the grass material is high are shown in white, and the positions where the ratio of applying the texture of the sand material is high are shown in black. In the example shown in FIG. 23, the grass texture is applied at vertex 241. As it goes towards vertex 243, the blend ratio of the sand texture increases. At the position of vertex 242, the blend rate of grass and sand is 1:1, and at the position of vertex 243, only the sand texture is applied. In this way, by blending and drawing the two textures set for the polygon (that is, set for each vertex of the polygon) at a blend rate according to the ratio of the materials, the appearance at the boundary between different materials in the display mesh can be made natural. As a result, the appearance of the display mesh with multiple types of materials set can be made natural.

[0160] [2-6-2. Determination of the Material of the Mesh for Judgment] Next, an example of a method for determining the material of the mesh for judgment will be described. Although details will be described later, in this embodiment, collision detection of the voxel object is performed using the mesh for judgment, and processing may be executed according to the material of the voxel object for which collision is detected. Therefore, in this embodiment, the material is also determined for the mesh for judgment.

[0161] In this embodiment, for each polygon constituting the determination mesh, the game system 1 ensures that only one type of material is set for each polygon. Specifically, the game system 1 determines the material set for the polygon of the determination mesh based on the material information (i.e., the first and second materials and the information on the ratio of the materials) set for the vertices of the polygon.

[0162] FIG. 24 is a diagram showing an example of a method for determining the material of a polygon constituting the determination mesh. FIG. 24 shows an example of determining the material for a triangular polygon formed by the respective vertices 241 to 243 shown in FIG. 21. The materials set for the respective vertices 241 to 243 are those shown in FIG. 21(a).

[0163] When determining the material of the polygon, the game system 1 calculates a determination value for each material set for each vertex of the polygon. In this embodiment, the method for calculating the above determination value is the same as the method for calculating the determination value used for selecting the material of the polygon of the display mesh. Note that the specific method for calculating the determination value is arbitrary. In other embodiments, the above determination value may be calculated by any method based on the information set for the vertices of the polygon of the determination mesh.

[0164] In the example shown in FIG. 24, for each material, the determination value is as follows: for the grass material, the determination value is 1.3; for the sand material, the determination value is 1.2; and for the soil material, the determination value is 0.5, similar to the case shown in FIG. 21 described above. Therefore, the grass material is selected as the material of the polygon shown in FIG. 24.

[0165] As described above, in this embodiment, for each polygon, the game system 1 selects up to a predetermined number (here, 1) of the material IDs set for the vertices included in the polygon (that is, the material IDs set for the vertices of the polygon corresponding to the polygon) and determines them as the material IDs of the polygon. According to this, the game system 1 can suppress the number of materials set for the determination mesh to a predetermined number or less. Thereby, it is possible to suppress the complication of the processing according to the type of material that is performed according to the result of the collision determination using the determination mesh. Note that the method of determining the material of the polygon of the determination mesh is arbitrary and is not limited to the above. In other embodiments, the material of the polygon of the determination mesh may be determined by any method based on the information set for the vertices of the polygon.

[0166] Also, in this embodiment, up to two types of materials are set for the polygons of the display mesh, while only one type of material is set for the polygons of the determination mesh. According to this, for the polygons of the display mesh, two types of textures can be used to achieve a natural appearance, and for the determination mesh, it is possible to suppress the complication of the processing that is performed according to the result of the collision determination using the determination mesh. Note that in other embodiments, the types of materials that can be set for the polygons of the display mesh and the determination mesh are arbitrary. The number of materials that can be set for the polygons of the display mesh and the number of materials that can be set for the polygons of the determination mesh may both be plural, may be the same, or may be different.

[0167] In addition, in the present embodiment, the number of types of materials set for one voxel is up to two, and the number of types of materials set for one polygon in the display mesh is up to two. According to this, while suppressing the data amount of the voxel data, the information of the materials set in the voxel data can be reflected in the materials of the display mesh. Further, in the present embodiment, the number of types of materials set for the vertices set based on the voxel data is also up to two (see FIG. 16). According to this, since two types of materials can be set for the vertices generated during the process of obtaining the display mesh from the voxel data, the information of the materials set in the voxel data can be reflected in the display mesh without loss of material information during the process.

[0168] Also, in other embodiments, the game system 1 may set materials differently for vertices used for generating a display mesh and vertices used for generating a determination mesh with respect to vertices set based on voxel data. For example, the game system 1 may set up to two types of materials for vertices used for generating a display mesh as described above, and may set one type of material for vertices used for generating a determination mesh. And for the materials of the polygons of the display mesh, two types of materials may be set in the same manner as above, and as the material of the polygon of the determination mesh, one type of material may be set based on the one type of material set for each vertex of the polygon. In addition, when setting one type of material for vertices used for generating a determination mesh, the material for which the above-described determination value calculated for each material is the largest may be set as the material of the vertex. Also by the above, as in this embodiment, the number of types of materials set for one polygon in the display mesh can be up to two, and the number of types of materials set for one polygon in the determination mesh can be one. Therefore, it is possible to reflect the material information set in the voxel data in the display mesh, and it is possible to suppress the complication of the processing performed according to the result of the collision determination using the determination mesh.

[0169] As described above, in this embodiment, a display mesh and a determination mesh can be set for one voxel object. However, depending on the game situation, it is not necessary to set both the display mesh and the determination mesh for one voxel object at the same time (for example, it is not necessary to set both in the processing within one frame). For example, the determination mesh may be generated in the range in the game space where collision determination is performed, and may not be generated in the range where collision determination is not performed. As an example, the game system 1 may generate a determination mesh for voxel objects within a predetermined range centered on the player character, and may not generate a determination mesh for voxel objects outside the predetermined range, but only generate a display mesh.

[0170] Also, for the display mesh, the game system 1 may store the data related to the generated mesh in the memory, and in the frame after the mesh is generated, use the data without re-executing the process of generating the mesh except for the updated range. According to this, the processing load for generating the display mesh can be reduced. Also, for the determination mesh, the data related to the generated mesh may not be stored in the memory, and the mesh may be sequentially generated as needed (for example, every time collision determination needs to be performed). According to this, the memory area used for generating the mesh can be saved.

[0171] In the above, the method of generating each mesh (that is, the display mesh and the determination mesh) based on the changed voxel data when the voxel data is changed from the initial state has been described. Note that the above method can also be used when generating each mesh based on the voxel data in the initial state, for example, at the start of the game. However, each mesh based on the voxel data in the initial state does not necessarily need to be generated based on the voxel data in the initial state at the start of the game, and may be prepared in advance before the game starts.

[0172] [Processing Using a Mesh of 2 - 7] Next, an example of processing using the mesh generated as described above for the voxel object will be described. In the following, it is assumed that terrain objects such as the ground and walls are voxel objects, and a player character performs an action, and as a result of collision detection, an in - game effect occurs. An example of this case will be described.

[0173] FIG. 25 is a diagram showing an example of a game image representing the movement of a player character on a terrain object. In the example shown in FIG. 25, the material for the polygon in a part of the region 251 of the mesh for determining the terrain object, which is the ground, is set to "lava". Note that the material for the polygons other than the region 251 in the mesh for determining the terrain object is set to "rock". In the example shown in FIG. 25, the game system 1 performs a collision detection between the terrain object and the player character 201 using the determination mesh. That is, a collision detection is performed to determine whether or not the determination mesh of the terrain object and the determination area set for the player character (for example, an area with a predetermined shape set based on the position of the player character) are in contact. And when a collision is determined between the polygon whose material is lava and the player character 201, as a process for generating an in - game effect, a process of reducing the physical strength of the player character 201 is performed. Also, in the above case, a process of causing the player character 201 to perform a predetermined reaction is performed.

[0174] Note that in this embodiment, as the property information included in the above - mentioned material data, for the lava material, a property of reducing the physical strength of the contacted player character (for example, the property that the temperature is equal to or higher than a predetermined value) is set. The game system 1 generates an in - game effect (in the above example, the reduction of the physical strength of the player character) based on the property information corresponding to the material set for the polygon in the determination mesh for which a collision has been determined by the collision detection.

[0175] In addition, when a collision between a polygon whose material is rock and the player character 201 is determined, the process of reducing the physical strength of the player character is not executed. Also, based on the collision, the player character 201 is controlled so that it cannot enter the inside of the polygon. Therefore, the player character can stand on or walk on the above polygon. In this way, in the present embodiment, by setting the material for each polygon, the game system 1 can execute different processes according to which part of the voxel object another object has contacted. Also, the content of the process to be executed can be made according to the type of material. In the present embodiment, since the player character can change the terrain object (for example, deform it or change the material), for example, it is possible to erase the lava part of the terrain object or change the lava to another material. Therefore, the player can avoid a decrease in the physical strength of the player character due to contact with lava by changing the terrain object.

[0176] The content of the process executed when a collision between a voxel object and another object is determined is arbitrary. For example, when the other object is a moving object such as a player character or an enemy character, the process may be a process of outputting the footsteps of the object or displaying an effect (for example, an effect representing dust or water splashes) at the contact location. At this time, the game system 1 can make the footsteps different or the effects different according to the type of material set for the polygon of the part of the voxel object that has contacted.

[0177] FIG. 26 is a diagram showing an example of a game image representing a state in which a player character extracts a fragment object from a terrain object. As shown in FIG. 26, in this embodiment, the player can cause the player character 201 to perform an action (referred to as a "pull-out action") of grasping the terrain object 202 by a predetermined operation input, pulling out a part thereof as the fragment object 252, and gripping it. The game system 1, as an in-game effect caused by the pull-out action, erases a part of the terrain object 202 and generates the fragment object 252.

[0178] When the pull-out action is performed, the game system 1 specifically executes the following processing. That is, when an operation input for causing the player character to perform the pull-out action is performed by the player, the game system 1 causes the player character to perform an action of digging forward and grasping, and performs a collision determination. Then, when a collision between the player character performing the pull-out action and the terrain object is determined, an update range 253 is generated based on the position and orientation of the player character. For example, the update range 253 is generated in a predetermined direction (for example, the front) with respect to the player character. Note that the shape and size of the update range may be determined in advance according to the type of action of the player character. Further, the game system 1 decreases the density of the voxels corresponding to the update range 253. Then, by updating the mesh according to the decrease in the voxel density, the terrain object 202 is deformed so that the portion within the update range 253 is erased (see (b) in FIG. 26). In this embodiment, the density of each voxel corresponding to the update range 253 is decreased, but the voxels to be decreased in density may be at least a part of the voxels corresponding to the update range 253.

[0179] Also, in the above, it was assumed that the voxel object corresponding to the update range 253 is unconditionally deformed by the extraction action. However, in other embodiments, the deformation of the voxel object corresponding to the update range 253 may be performed on the condition of the amount of damage set for the voxel. For example, instead of unconditionally deforming the voxel object corresponding to the update range 253, the game system 1 may increase the amount of damage set for the voxels corresponding to the update range 253, and decrease the density in the voxels when the amount of damage exceeds a predetermined value. At this time, the increase amount of damage may be determined according to the action performed on the voxel object.

[0180] Also, the game system 1 generates a fragment object 252 representing the portion of the terrain object 202 that has been erased. That is, the game system 1 generates the fragment object 252 while having the player character hold it, based on the above extraction action. The fragment object 252 may be generated to have a shape corresponding to the portion of the terrain object 202 that has been erased, or may have a predetermined shape. The fragment object 252 may be a voxel object or may not be a voxel object. When the fragment object is a voxel object, a voxel space different from the voxel space of the voxels corresponding to the terrain object 202 or the like is defined for the fragment object 252.

[0181] The game system 1 determines the material of the above fragment object 252. The material of the fragment object 252 is determined based on the material set for the polygon within the determination mesh that contacts the update range 253 among the determination meshes of the terrain object 202. The material of the fragment object 252 is determined to be the same as any one of the materials set for the polygons within the determination mesh that contacts the update range 253. According to this, the material of the fragment object 252 can be made the same as the material of the erased part of the terrain object. As is clear from the above description, the fragment object 252 is not actually a part of the terrain object. However, by being generated along with the erasure of a part of the terrain object and having the material of the erased part of the terrain object inherited by the fragment object 252, it is possible to give the player an impression as if the player character 201 has taken out a part of the terrain object 202 by a pulling action.

[0182] In this embodiment, a priority is set for each type of material to be prepared, and the game system 1 determines the material with the highest priority among the materials set for each polygon of the determination mesh within the update range 253 as the material of the fragment object 252. Here, for example, consider a case where the determination mesh within the update range 253 includes a polygon with a material of rock and a polygon with a material of lava. In such a case, if the material of the fragment object 252 is set to lava, there is a possibility of inconvenience such that when the player character grips the fragment object 252 by a pulling action, the physical strength of the player character decreases (assuming that, as described in FIG. 25, the material of lava is set to have the property of decreasing the physical strength of the player character when contacted). Also, as described above, when the determination mesh within the update range 253 includes polygons with different types of materials set, it is considered difficult for the player to predict what the material of the fragment object 252 will be, and it is also considered that the above-mentioned inconvenience may occur contrary to the player's intention. On the other hand, in this embodiment, by setting a priority for the material set as the material of the fragment object, the possibility of the above-mentioned inconvenience occurring can be reduced.

[0183] FIG. 27 is a diagram showing an example of a game image representing a state in which fragment objects are generated when a player character destroys a terrain object. As shown in FIG. 27, in the present embodiment, the player can cause the player character 201 to perform a punch action by a predetermined operation input. Further, as an in-game effect caused by the punch action, the game system 1 erases a part of the terrain object 202 and generates a fragment object 255, as in the case of the above punch action. Specifically, the terrain object 202 is deformed as if a part of it is erased. Note that, when the punch action is performed, unlike the above-described extraction action, after the punch action, the fragment object 255 is not held by the player character 201 but is arranged around the position where the punch action is performed (see (b) of FIG. 27). Note that the fragments corresponding to the destruction of the terrain object 202 may not be generated in some cases.

[0184] When a punch action is performed, the game system 1 specifically executes the following processes. That is, when a player performs an operation input to cause a player character to perform a punch action, the game system 1 causes the player character to perform an action of punching forward and performs a collision determination. Then, when a collision between the player character performing the punch action and the terrain object is determined, an update range 254 is generated based on the position and orientation of the player character. For example, the update range 254 is generated in a predetermined direction (e.g., forward) with respect to the player character. Note that the position, shape, and size of the update range 254 due to the punch action may be the same as or different from those of the update range 253 due to the extraction action. Then, the game system 1 decreases the density of the voxels corresponding to the update range 254. As a result, similar to the extraction action, the terrain object 202 is deformed so that the portion within the update range 254 is erased by the punch action (see (b) in FIG. 27). Note that, similar to the extraction action, for the punch action, instead of unconditionally deforming the voxel object corresponding to the update range 254, the game system 1 may increase the amount of damage set for the voxels within the update range 254 according to the punch action, and decrease the density of the voxels when the amount of damage exceeds a predetermined value. Also, the voxels whose density is to be decreased by the punch action may be at least some of the voxels corresponding to the update range 254.

[0185] In addition, the game system 1 generates a fragment object 255 corresponding to the portion of the terrain object 202 that has been erased. That is, the game system 1 generates the fragment object 255 in a state where the player character does not have it (for example, in a state where it is arranged around the position where the punch action was performed) based on the above punch action. The fragment object 255 may be generated to have a shape corresponding to the portion of the terrain object 202 that has been erased, or may have a predetermined shape. The fragment object 255 may be a voxel object or may not be a voxel object.

[0186] The game system 1 determines the material of the above fragment object 255. The material of the fragment object 255 is determined based on the material set for the polygon in the determination mesh that contacts the update range 254 among the determination meshes of the terrain object 202. The material of the fragment object 255 is determined to be the same as any one of the materials set for the polygons in the determination mesh that contacts the update range 254. According to this, the material of the fragment object 255 can be made the same as the material of the erased portion of the terrain object. In addition, the fragment object 255 is generated as the terrain object is partially erased, and the material of the erased portion of the terrain object is inherited by the fragment object 255, so that the player can be given the impression that a part of the terrain object destroyed by the punch action of the player character has occurred as a fragment object.

[0187] In this embodiment, the material of the fragment object 255 is determined to be the material with the largest degree of decrease in density in the voxel among the materials set for the polygons in the determination mesh that contacts the update range 254. According to this, it is possible to generate a fragment object that more accurately reflects the material composition of the portion of the terrain object erased by the punch action.

[0188] The method for determining the material of the fragment object generated by the above-described extraction action or punch action is arbitrary. For example, the method for determining the material of the fragment object may be the same for the extraction action and the punch action. Also, for example, among the materials set for each polygon of the determination mesh within the update range, the material set for the most polygons may be determined as the material of the fragment object. Also, for example, among each polygon of the determination mesh within the update range, the material set for a polygon that satisfies a predetermined condition (for example, a polygon at a position in contact with the hand of the player character that performs the extraction action or punch action) may be determined as the material of the fragment object. Also, in other embodiments, a plurality of types of materials may be set for the fragment object.

[0189] In the present embodiment, the player can cause the player character to perform an action of throwing the fragment object 252 or 255 generated as described above (hereinafter referred to as "throwing action"). Note that the player can cause the player character to perform an action of holding the fragment object generated in response to the punch action and placed on the ground by a predetermined operation input. By the above-described extraction action or the action of holding the fragment object after the above-described punch action, the player character is in a state of holding the fragment object. In this state, the game system 1 causes the player character to perform an action of releasing the held fragment object in a predetermined direction as a throwing action according to the operation input by the player.

[0190] FIG. 28 is a diagram showing an example of a game image in a scene where a player character is in a state where a throwing action is possible and is determining the throwing direction in a state of assuming a throwing stance. As shown in FIG. 28, in a state where the player character 201 holds the fragment object 261, the player character 201 can perform a throwing action. In this state, as shown in FIG. 28, the game system 1 displays the aiming image 262 and the object information image 263 over the image showing the game space as a process for generating an action in the game.

[0191] The aiming image 262 indicates the direction in which the fragment object is released by the throwing action (also referred to as the aim direction). That is, in response to an operation input by the player to perform a throwing action, the game system 1 moves the fragment object 261 from the position of the player character 201 toward the position in the virtual space indicated by the aiming image 262. Note that the aim direction is controlled based on the operation input by the player. For example, the game system 1 may change the aim direction in response to an operation input for changing the direction of the virtual camera. Specifically, the game system 1 controls the virtual camera in response to an operation input so as to rotate around the player character while maintaining the state where the player character is included in the field of view, and controls the aim direction so as to be in the direction corresponding to the line-of-sight direction of the virtual camera. At this time, the aiming image 262 indicating the position where the straight line extending in the aim direction from the position of the player character intersects the terrain object 253 is displayed. Specifically, the game system 1 performs a collision determination between the aim direction (that is, the straight line extending in the aim direction) and the determination mesh of the terrain object 253, and when a collision is determined, the aiming image 262 is displayed. The aiming image 262 is arranged so as to indicate the position of the polygon that intersects the straight line extending in the aim direction among the determination meshes.

[0192] When the player character performs a throwing action using the aiming image 262 described above, the player can be presented with the position where the fragment object contacts the voxel object. This can make it easier for the player to perform the throwing action operation. Note that the specific control method for the aiming direction and the aiming image 262 is arbitrary, and a conventional method may be used. For example, in other embodiments, when the aiming image 262 is displayed, the aiming image 262 may be displayed in a first-person perspective game image where the player character is not displayed.

[0193] In a state where the player character is in a posture of throwing a fragment object, in response to a predetermined operation input by the player, a throwing action of throwing the fragment object in the aiming direction is performed.

[0194] The object information image 263 shows information about the terrain object 253 at the position indicated by the aiming image 262. In the present embodiment, the object information image 263 shows the name of the material (rock in the example shown in FIG. 28) set for the polygon of the determination mesh at the position indicated by the aiming image 262. This can present to the player the material of the voxel object that the fragment object released by the throwing action contacts. Also, the object information image 263 shows information regarding the nature of the material (here, hardness). This can present to the player the nature of the voxel object that the fragment object released by the throwing action contacts. Note that the content shown by the object information image 263 is arbitrary. For example, in other embodiments, the object information image 263 may show any property regarding the material set for the polygon at the position indicated by the aiming image 262, or may show the state of the polygon (for example, the amount of damage described above). In the present embodiment, since there is one type of material for the polygon of the determination mesh, the material corresponding to the aiming position is specified to one. Therefore, it is suitable for displaying information regarding the material.

[0195] In this embodiment, in response to the fragmented object released by a throwing action being determined to have contacted the voxel object as a result of a collision determination, the game system 1 makes a change to the voxel object as an action within the game. FIG. 29 is a diagram showing an example of a game image after the terrain object 253 shown in FIG. 28 has been changed due to the fragmented object 261 contacting it. In the example shown in FIG. 29, the terrain object 253 is deformed so as to have a shape as if the fragmented object is attached at the contact position between the fragmented object and the terrain object 253. Specifically, the game system 1 generates an update range so as to include the contact position, and deforms the terrain object 253 into the above shape by increasing the density of the voxels within the update range. For example, the update range may be set to a shape corresponding to the shape of the fragmented object, and the terrain object 253 may be deformed so that the inside of the update range is within the terrain object 253. As described above, in the example shown in FIG. 29, it becomes a shape in which an additional part 265 is added to the terrain object before deformation. Note that in the example shown in FIG. 29, the fragmented object is erased in response to contacting the terrain object 253.

[0196] Also, the material of the polygon in the additional part 265 is determined based on the material of the fragmented object that has contacted the terrain object 253. Specifically, the game system 1 sets the material of the voxels within the update range to be the material of the fragmented object. Then, based on the material of the voxels, the materials of the display mesh and the determination mesh are determined. According to this, since the appearance of the attached additional part 265 can be made the same as the appearance of the fragmented object, (although in reality, the terrain object 253 has been deformed as described above), it becomes easier for the player to be given the impression that the fragmented object is attached to the terrain object 253.

[0197] In the example shown in FIG. 29, the change applied to the voxel object in response to the fragment object contacting the voxel object was a transformation to add an additional part to the voxel object, but the change applied to the voxel object is not limited to this. The above change may change the density of the voxels or may change the material. For example, if the fragment object has the property of exploding, the fragment object may explode in response to contacting the voxel object, and at this time, the voxel object may be deformed as if a part of the voxel object has been erased. Specifically, the game system 1 sets an update range to include the contact position and decreases the density of the voxels within the update range. Also, for example, when the material of the voxel object is lava and the material of the fragment object is ice, the material of the voxel object may be changed in response to the fragment object contacting it. Specifically, the game system 1 sets an update range including the contact position and may change the material that is lava among the materials of the voxels within the update range to obsidian or rock. According to this, it is possible to represent a situation where a lava object is cooled by an ice object and becomes obsidian or rock.

[0198] The content of the above change may be determined based on the material of the voxel object, based on the material of the fragment object, or based on a combination of the material of the voxel object and the material of the fragment object. According to this, various changes can be caused to the voxel object.

[0199] Further, the game system 1 may determine whether to perform the above-described change based on the material of the voxel object, based on the material of the fragment object, or based on a combination of the material of the voxel object and the material of the fragment object. For example, when a fragment object with a material of rock contacts a voxel object with a material of rock, the game system 1 performs the change as shown in FIG. 29, while when a fragment object with a material of rock contacts a voxel object with a material of iron, the game system 1 may not perform the change as shown in FIG. 29.

[0200] In this embodiment, as described above, one type of material is set for the polygon of the determination mesh and the fragment object. Here, if multiple types of materials are set for at least either the polygon of the determination mesh or the fragment object, it becomes difficult to determine the content of the change added to the voxel object according to the types of the materials of both when the determination mesh and the fragment object come into contact. On the other hand, in this embodiment, since the materials of the determination mesh and the fragment object determined to be in contact by collision determination are each one type, it becomes easy to determine the content of the change added to the voxel object.

[0201] [3. Specific Example of Processing in Game System] Next, with reference to FIGS. 30 and 31, a specific example of information processing in the game system 1 will be described.

[0202] FIG. 30 is a diagram showing an example of various data used for information processing in the game system 1. Each data shown in FIG. 30 is stored in a memory accessible by the main body device 2 (for example, flash memory 84, DRAM 85, and / or a memory card or the like mounted on the slot 23). As shown in FIG. 30, the game system 1 stores a game program. The game program is for executing the game processing in the present embodiment (specifically, the game processing shown in FIG. 31). Note that the game program includes the above-described material data (see FIG. 12). Further, the above memory stores the above-described voxel data (see FIG. 11), update range data, mesh data, object data, etc. (see FIG. 30).

[0203] The update range data is data indicating the above-described update range. In the present embodiment, the update range is represented by the above-described SDF.

[0204] The mesh data includes various data related to the mesh of the voxel object. As shown in FIG. 30, in the present embodiment, the mesh data includes SVO data, display mesh data, and determination mesh data. The SVO data is data that holds each vertex calculated from the voxel data in the above-described SVO structure. Note that in the present embodiment, the SVO data includes, in addition to the data indicating the position of each vertex, data indicating the material set for each vertex (for example, data indicating the ID of the material). The display mesh data includes various data related to the display mesh. Specifically, the display mesh data includes data indicating each vertex of the display mesh and data indicating the material set for each vertex (for example, data indicating the ID of the material). The determination mesh data includes various data related to the determination mesh. Specifically, the determination mesh data includes data indicating each vertex of the determination mesh and data indicating the material set for each vertex (for example, data indicating the ID of the material).

[0205] Object data includes various data related to objects other than voxel objects (for example, player characters, fragment objects, etc.). Object data is stored for each object that appears in the game space. Object data includes, for example, data indicating the position, speed, and state of the object.

[0206] FIG. 31 is a flowchart showing an example of the flow of game processing executed by the game system 1. The execution of the game processing is started, for example, in response to an instruction from the player during the execution of the game program, when the game is started. Note that the processing loop consisting of a series of processes from steps S1 to S14 is executed in one cycle per frame.

[0207] In the present embodiment, the processor 81 of the main body device 2 executes the processing of each step shown in FIG. 31 by executing the game program stored in the game system 1. However, in other embodiments, some of the processing of each step may be executed by a processor (for example, a dedicated circuit, etc.) different from the processor 81. Also, when the game system 1 can communicate with another information processing device (for example, a server), a part of the processing of each step shown in FIG. 31 may be executed in the other information processing device. Also, the processing of each step shown in FIG. 31 is merely an example, and if the same result can be obtained, the processing order of each step may be changed, or another process may be executed in addition to (or instead of) the processing of each step.

[0208] Also, the processor 81 executes the processing of each step shown in FIG. 31 using a memory (for example, DRAM 85). That is, the processor 81 stores the information (in other words, data) obtained by each processing step in the memory, and when using the information in subsequent processing steps, reads the information from the memory and uses it.

[0209] In step S1 shown in FIG. 31, the processor 81 acquires the operation data indicating the operation input by the player. That is, the processor 81 acquires the operation data received from each controller via the controller communication unit 83 and / or each of the terminals 17 and 21. The process of step S2 is executed after step S1.

[0210] In step S2, the processor 81 designates, as a processing target, any one of the objects in the game space that require processing and for which the processing has not been completed, and for the designated object, executes a process of calculating the speed and a process of reflecting the result of contact between the objects in the previous frame. The speed of the object is used to calculate the position of the object in the current frame in the process of step S12 described later. For example, when the designated object is the player character, the speed of the player character is calculated based on the operation data acquired in step S1. Also, when the designated object is an object not operated by the player (for example, a fragment object), the speed of the object is calculated based on a rule predetermined in the game program. For example, the speed of a fragment object is set to 0 when it is placed on a terrain object and not moving, is set to the same speed as the player character when held by the player character, and is set to the speed of moving in the above-described aiming direction with a magnitude determined by the above rule when released by a throwing action by the player character. Specifically, the speed of the object is calculated based on virtual physical calculations including the interaction between the objects. For example, interactions such as repulsion due to collision between objects, friction due to contact, falling due to virtual gravity, and deceleration due to virtual air resistance are reflected in the speed determination.

[0211] In addition, for the process of reflecting the result of contact between objects in the previous frame, when it is determined in the collision determination (step S11) in the previous frame that the objects are in contact with each other, the process includes applying the influence of contact to the object. The above process is, for example, the following process. · When it is determined that the player character has come into contact with the lava terrain object in the previous frame, a process of reducing the physical strength of the player character · When it is determined that the player character has come into contact with the terrain object by a pulling action or a punching action in the previous frame, a process of generating a fragment object · When it is determined that the fragment object has come into contact with the rock terrain object in the previous frame, a process of disappearing the fragment object When the state regarding the object is changed in the process of step S2 above, the processor 81 updates the object data stored in the memory regarding the object so as to indicate the content after the change. The process of step S3 is executed next to step S2.

[0212] In step S3, the processor 81 determines whether an update event for updating the voxel object has occurred due to the object specified in step S2. For example, the determination in step S3 is made based on the result of the collision determination (step S11) in the previous frame. For example, when it is determined that the player character has come into contact with the terrain object by a pulling action or a punching action in the previous frame, it is determined that an update event of deleting a part of the terrain object (see FIGS. 26 and 27) has occurred. Also, for example, when it is determined that the fragment object has come into contact with the rock terrain object in the previous frame, it is determined that an update event of increasing the volume of the terrain object (see FIG. 29) has occurred. If the determination result of step S3 is affirmative, the process of step S4 is executed. On the other hand, if the determination result of step S3 is negative, the process of step S6 is executed.

[0213] In step S4, the processor 81 sets an update range for updating the voxel object in the game space. For example, the specific content of the update range (i.e., position, shape, and size) is associated with each type of update event in the game program. The update range set in step S4 is set to be associated with the content related to the type of update event determined to occur in step S3. The processor 81 stores the data indicating the set update range in the memory as update range data. The process of step S5 is executed after step S4.

[0214] In step S5, the processor 81 makes changes corresponding to the update event for the voxels corresponding to the update range set in step S4. For example, when deforming the voxel object within the update range as if it were erased or deforming it as if a voxel object were added within the update range, the voxel data stored in the memory is updated so as to change the density of the voxels corresponding to the update range (see the above [2-2. Update of voxel data]). Also, for example, when changing the material of the voxel object within the update range, the voxel data stored in the memory is updated so as to update the first and second material IDs and the material mixing ratio of the voxels corresponding to the update range. The process of step S6 is executed after step S5.

[0215] In step S6, the processor 81 determines whether the processing of steps S2 to S5 has been completed for all the objects that require processing. If the determination result in step S6 is affirmative, the process of step S7 is executed. On the other hand, if the determination result in step S6 is negative, the process of step S2 is executed again.

[0216] In step S7, the processor 81 updates the vertices of the voxel object in the game space. That is, when the voxel data is updated in the process of step S5, new vertices are calculated based on the updated voxel data. Note that the positions of the new vertices are calculated according to the method described in the above [2-3. Calculation of vertices]. Also, the materials of the new vertices are calculated according to the method described in the above [2-4. Determination of vertex materials]. The process of step S8 is executed after step S7.

[0217] In step S8, the processor 81 performs vertex simplification. That is, the processor 81 simplifies each vertex updated by the process of step S7 according to the method described in the above [2-5. Vertex simplification]. The SVO data stored in the memory is updated to indicate each vertex obtained by the processes of steps S7 and S8 above. Therefore, the SVO data is updated by the processes of steps S7 and S8. Note that the processes of steps S7 and S8 do not necessarily recalculate the vertices for the entire voxel data, and may be executed only for the part where the content of the voxel is changed in the process of step S5. The process of step S9 is executed after step S8.

[0218] In step S9, the processor 81 updates the display mesh of the voxel object based on the SVO data stored in the memory. Note that the position of each vertex of the display mesh and the material of each polygon of the display mesh (that is, the material set for each vertex of the polygon) are calculated according to the methods described in the above [2-6. Generation of Mesh] and [2-6-1. Determination of the Material of the Display Mesh]. The processor 81 updates the display mesh data stored in the memory so as to indicate the position and material of each vertex of the updated display mesh. The process of step S10 is executed after step S9. Note that the processor 81 may start the processes after step S10 and execute them in parallel without waiting for the completion of step S9. In that case, step S9 needs to be completed before the start of step S13.

[0219] In step S10, the processor 81 updates the determination mesh of the voxel object based on the SVO data stored in the memory. Note that the position of each vertex of the determination mesh and the material of each polygon of the determination mesh (that is, the material set for each vertex of the polygon) are calculated according to the methods described in the above [2-6. Generation of Mesh] and [2-6-2. Determination of the Material of the Determination Mesh]. The processor 81 updates the determination mesh data stored in the memory so as to indicate the position and material of each vertex of the updated determination mesh. The process of step S11 is executed after step S10.

[0220] In the example shown in FIG. 31, the generation process of the determination mesh (step S10) is executed every frame. However, the generation process of the determination mesh does not necessarily have to be executed every frame. For example, when the collision determination process in step S11 is executed only in frames that satisfy a predetermined condition, the processor 81 may execute the generation process of the determination mesh in the frames in which the collision determination in step S11 is performed. Further, the processor 81 may execute the generation process of the determination mesh for the voxels within the area in the game space where the collision determination in step S11 is performed. For example, in a situation where there are no objects to be collided with other than voxel objects around the player character in the game space (that is, a situation where only the collision determination between the player character and the surrounding voxel objects needs to be performed), the processor 81 may execute the generation process of the determination mesh for the voxels within a predetermined range based on the player character.

[0221] In step S11, the processor 81 performs a collision determination for each object in the game space based on the determination mesh data and the object data stored in the memory. That is, the processor 81 uses the determination mesh for voxel objects and uses a determination area of a predetermined shape set for the object for objects that are not voxel objects to perform the collision determination. In the present embodiment, the collision determination in step S11 is performed in consideration of the speed calculated in step S2 above. That is, the processor 81 performs the collision determination using the position when moving at the above speed as the position of each object.

[0222] In the present embodiment, for example, the presence or absence of the following contacts is determined by the collision determination in step S11. · Contact between the player character performing a movement, punch action, or pull-out action and the terrain object · Contact between the character performing an action of lifting (a fragment object) and the fragment object · Contact between the terrain object and the straight line extending in the aiming direction from the position of the player character · Contact between the fragment object released by the throwing action of the player character and the terrain object If it is determined in the collision determination in step S11 that the objects are in contact with each other, then in the process of step S2 in the next frame, a process reflecting the result of the contact between the objects is executed, or in the process of step S3 in the next frame, it is determined that an update event has occurred. The process of step S12 is executed after step S11.

[0223] In step S12, the processor 81 controls the operations of the respective objects in the game space. For example, for the player character, the processor 81 performs control to cause the player character to move and perform various actions based on the operation data acquired in step S1. When a predetermined action occurs, a region for collision determination corresponding to the action is generated within the game space. Also, for example, the fragment object is controlled to move in the above-described aiming direction in response to being released by the throwing action of the player character. In one execution of the process of step S12, the processor 81 controls each object so as to advance the operation for one frame for operations (for example, actions by the player character) performed over a plurality of frames. By repeatedly executing the process of step S12 over a plurality of frames, each object performs a series of operations related to movement and various actions. Also, the position of the object is basically determined to be the position after moving at the speed calculated in step S2 above. However, if it is determined by the collision determination in step S11 that the object is in contact with another object and the movement is obstructed by the other object in contact, the position of the object is determined not to change. The object data stored in the memory is updated to indicate the object after the control in step S12. The process of step S13 is executed after step S12.

[0224] In step S13, the processor 81 generates a game image. That is, the processor 81 generates a game image by performing drawing on each polygon of the display mesh of the voxel object and each polygon of the object other than the voxel object based on the virtual camera. Note that each polygon of the display mesh is drawn using drawing settings such as a texture corresponding to the material set for the polygon according to the method described in the above [2-6-1. Determination of the material of the display mesh]. Also, in the present embodiment, when the player character is in a state where a throwing action is possible, the processor 81 generates a game image including the above-described aiming image and object information image (see FIG. 28). The game image generated in step S13 is output to the display device and displayed at a cycle of once per frame.

[0225] In step S14, the processor 81 determines whether to end the game. For example, when a predetermined operation input for ending the game is performed by the player, the processor 81 determines to end the game. If the determination result in step S14 is negative, the process of step S1 is executed again. Thereafter, a series of processes of steps S1 to S14 are repeatedly executed until it is determined in step S14 to end the game. On the other hand, if the determination result in step S14 is positive, the processor 81 ends the game process shown in FIG. 31.

[0226] [4. Operational effects and modification examples of the present embodiment] As described above, in the above embodiment, the game program is configured to cause the computer of the information processing apparatus to execute the following processes. · A process of generating a display mesh based on voxel data (note that the voxel data is defined in a virtual space, and for each of a plurality of voxels, it includes a density indicating the degree to which the space defined by the voxel is virtually occupied by the content, and a material ID indicating the type of the content. The material ID can be set up to a first number (e.g., 2) of a plurality. Also, the display mesh corresponds to the voxel data and is drawn based on a virtual camera. The vertex coordinates of the display mesh are determined based on at least the density included in the voxel data, and the material of the display mesh is determined based on at least the plurality of material IDs included in the voxel data.) · A process of generating a voxel update range in a virtual space based on game processing · A process of updating at least one of the density and the material ID for each of the voxels in the voxel data that corresponds to the voxel update range in the virtual space in response to the generation of the voxel update range · A process of updating the display mesh corresponding to the updated voxel data · A process of generating an in-game action corresponding to the material of the determination mesh at the collision position based on the collision determination between the determination mesh and the determination shape corresponding to the determination target based on game processing (note that the determination mesh is used for collision determination in the virtual space. The vertex coordinates of the determination mesh are determined based on at least the density included in the voxel data. The material of the determination mesh is determined based on at least the plurality of material IDs included in the voxel data.) · A process of drawing the virtual space including the display mesh based on the vertex coordinates of the display mesh and the texture corresponding to the material of the display mesh

[0227] According to the above configuration, the appearance of the object based on voxels can be made to be the appearance based on the material of the voxels updated during the game, and the action based on the material can be generated in the game. That is, for the object based on voxel data, the material can be reflected in the appearance and the action in the game.

[0228] Note that the above "action in the game" is any change that occurs in the game. For example, in the above embodiment, it is a change caused by "processing that reflects the result of contact between objects". Also, in the above embodiment, the display of the object information image based on the collision determination between the straight line extending in the above aiming direction and the terrain object is also an example of the above "action in the game". In the above configuration, the "action in the game" may be based on the collision determination between the determination mesh and the determination shape corresponding to the determination target based on the game process (for example, the determination area set for an object such as a player character, or the straight line extending in the aiming direction). The above action may occur on the object corresponding to the determination mesh, or may occur on the object corresponding to the determination target. As in the above embodiment, the content of the action in the game may be associated with the material set for the polygon in which the collision is determined in the collision determination that is the factor for the occurrence of the action (that is, the content of the action may be determined by the material).

[0229] Note that in the above embodiment, when processing is executed using data (in the sense including a program) in a certain information processing device, a part of the data necessary for the processing may be transmitted from another information processing device different from the certain information processing device. At this time, the certain information processing device may execute the above processing using the data received from another information processing device and the data stored in itself.

[0230] In other embodiments, the information processing system may not include some of the configurations in the above embodiments, or may not execute some of the processes executed in the above embodiments. For example, in order for the information processing system to achieve some specific effects in the above embodiments, it may be sufficient to include the configurations for achieving the effects and execute the processes for achieving the effects, and it may not include other configurations or execute other processes.

Industrial Applicability

[0231] The above embodiments can be used, for example, as a game system or a game program for the purpose of reflecting materials on the appearance of an object based on voxel data or on the actions occurring in a game.

Description of Signs

[0232] 1 Game system 2 Main body device 81 Processor 201 Player character 202 Terrain object 203, 253, 254 Update range 211 - 218 Voxels 262 Aiming image 263 Object information image

Claims

1. To the computer of the information processing apparatus, Based on voxel data defined in a virtual space, for each of a plurality of voxels, a density indicating the degree to which the space defined by the voxel is virtually occupied by its content, and a material ID indicating the type of the content, the material ID being settable up to a plurality of first numbers, at least the set voxel data, generate a display mesh corresponding to the voxel data and drawn based on a virtual camera, wherein the vertex coordinates of the display mesh are determined based on at least the density included in the voxel data, and the material of the display mesh is determined based on at least the plurality of material IDs included in the voxel data, Based on game processing, generate a voxel update range in the virtual space, In response to the generation of the voxel update range, for each of the voxels in the voxel data corresponding to the voxel update range in the virtual space, update at least one of the density and the material ID, Update the display mesh corresponding to the updated voxel data, Based on a collision determination between a determination mesh used for collision determination in the virtual space, the vertex coordinates of the determination mesh being determined based on at least the density included in the voxel data, and the material of the determination mesh being determined based on at least the plurality of material IDs included in the voxel data, and a determination shape corresponding to an object to be determined based on game processing, generate an in-game effect corresponding to the material of the determination mesh at the collision position, Based on the vertex coordinates of the display mesh and a texture corresponding to the material of the display mesh, cause the virtual space including the display mesh to be drawn, A game program.

2. The material of the display mesh is determined by setting the material IDs up to a plurality of second numbers for each of the plurality of polygons included in the display mesh, The material of the determination mesh is determined by setting one of the material IDs for each of the plurality of polygons included in the determination mesh, To the computer, Based on material data including at least rendering setting information including texture information set for the material and property information indicating the in-game effects set for the material, for each type of material corresponding to the material ID, generate in-game effects based on the property information corresponding to the material ID set for the polygon for which collision is determined among the polygons included in the determination mesh, cause the virtual space including the display mesh to be rendered by causing each polygon included in the display mesh to be rendered based on the rendering setting information corresponding to each material ID set for each polygon, based on texture mapping by one texture or blending of multiple textures. The game program according to claim 1.

3. On the computer, Based on the voxel data, For a portion where a voxel having the density of a setting indicating existence and a voxel having the density of a setting indicating non-existence are adjacent, generate and update the vertices of the display mesh based on a method of setting vertices at coordinates based on the positions and the density of a plurality of surrounding voxels. For each vertex, calculate a priority parameter for each material ID based on the voxel data of the plurality of surrounding voxels included in the voxel data for the material ID, and based on the priority parameter, select up to a third number of the material IDs with high priority and determine them as the material ID of the vertex. Generate and update the material of the display mesh by, for each polygon, selecting up to the second number of the material IDs among the material IDs set for the vertices included in the polygon and determining them as the material ID of the polygon. The game program according to claim 2.

4. Further on the computer, For the vertices for which the coordinates and the material ID are determined based on the plurality of surrounding voxels, further perform simplification to reduce the number of vertices by replacing the plurality of vertices with a new single vertex for which coordinates and the material ID are set based on the plurality of vertices, and generate the polygon based on the vertices after the simplification. The game program according to claim 3.

5. to cause the computer to calculate the priority parameter based on the density of the plurality of surrounding voxels such that the priority of the material ID set for the voxels with higher density becomes higher, the game program according to claim 3.

6. to cause the computer to calculate the priority parameter based on the distance from the reference position of the plurality of surrounding voxels to the vertex such that the priority of the material ID set for the voxels closer to the vertex becomes higher, the game program according to claim 3.

7. Furthermore, in the voxel data, a voxel ratio indicating the ratio of the material indicated by the material ID in each voxel is further set for each voxel. to cause the computer to calculate the priority parameter based on the voxel ratio of the plurality of surrounding voxels such that the priority of the material ID with a higher voxel ratio becomes higher, the game program according to claim 3.

8. to cause the computer to based on the material IDs of all vertices constituting the polygon, when the number of the material IDs is less than or equal to the second number, set the material ID as the material ID of the polygon, when the number of the material IDs exceeds the second number, select the second number with higher priority based on the priority parameter of each vertex and determine it as the material ID of the polygon, to generate and update the material of the display mesh, the game program according to claim 3.

9. to cause the computer to perform mapping to blend the plurality of textures at an interpolation blend rate obtained by interpolating the blend rates of the respective vertices between the vertices at a blend rate corresponding to the priority parameter of the vertex at the position of each vertex based on the drawing setting information corresponding to each material ID set for each polygon included in the display mesh, thereby causing the polygon to be drawn, the game program according to claim 8.

10. to cause the computer to Based on the voxel data, for a portion where a voxel having the density of the setting where voxels exist and a voxel having the density of the setting where voxels do not exist are adjacent, a method is used to set vertices at coordinates based on the positions and the density of a plurality of surrounding voxels, thereby determining the vertices of the determination mesh. For each vertex, for the material IDs included in the voxel data of the plurality of surrounding voxels, a priority parameter for each material ID is calculated based on the voxel data, and based on the priority parameter, a fourth number of the material IDs with high priority is selected and determined as the material ID of the vertex. For each polygon, among the material IDs of the respective vertices constituting the polygon, the most frequent or the one material ID with the highest priority based on the priority parameter is determined as the material ID of the polygon, thereby determining the material of the determination mesh. The game program according to claim 2.

11. The first number is 2, The second number is 2. The game program according to any one of claims 2 to 10.

12. The first number is 2, The second number is 2, The third number is 2. The game program according to any one of claims 3 to 9.

13. The first number is 2, The second number is 2, The fourth number is 1 or 2. The game program according to claim 10.

14. Voxel data defined in a virtual space, for each of a plurality of voxels, a density indicating the degree to which the space defined by the voxel is virtually occupied by the content, and a material ID indicating the type of the content, at least a material ID that can be set up to a first number that is plural are set. Based on the voxel data, a display mesh corresponding to the voxel data and drawn based on a virtual camera is generated. The vertex coordinates of the display mesh are determined based on at least the density included in the voxel data, and the material of the display mesh is determined based on at least the plurality of material IDs included in the voxel data. Based on game processing, a voxel update range is generated in the virtual space. In response to the generation of the voxel update range, for each voxel in the voxel data that corresponds to the voxel update range within the virtual space, at least one of the density and the material ID is updated. The display mesh is updated corresponding to the updated voxel data. A determination mesh used for collision determination within the virtual space, wherein vertex coordinates of the determination mesh are determined based on at least the density included in the voxel data, and the material of the determination mesh is determined based on at least a plurality of the material IDs included in the voxel data. Based on a collision determination between the determination mesh and a determination shape corresponding to an object to be determined based on game processing, an in-game effect corresponding to the material of the determination mesh at the collision position is generated. Based on vertex coordinates of the display mesh and a texture corresponding to the material of the display mesh, the virtual space including the display mesh is drawn. An information processing system.

15. The material of the display mesh is determined by setting the material IDs up to a second number, which is plural, for each of a plurality of polygons included in the display mesh. The material of the determination mesh is determined by setting one of the material IDs for each of a plurality of polygons included in the determination mesh. The information processing system Based on material data including at least rendering setting information including at least texture information set for the material and property information indicating an in-game effect set for the material, for each type of material corresponding to the material ID. An in-game effect based on the property information corresponding to the material ID set for a polygon for which a collision has been determined among the polygons included in the determination mesh is generated. Based on the rendering setting information corresponding to each of the material IDs set for each of the polygons included in the display mesh, the polygon is rendered based on texture mapping using one texture or blending of a plurality of textures, thereby rendering the virtual space including the display mesh. The information processing system according to claim 14.

16. The information processing system Based on the voxel data, for a portion where a voxel having the density of the setting indicating existence and a voxel having the density of the setting indicating non-existence are adjacent, based on a method of setting vertices at coordinates based on the positions and the density of a plurality of surrounding voxels, generate and update the vertices of the display mesh, for each vertex, for the material ID included in the voxel data of the plurality of surrounding voxels, calculate a priority parameter for each material ID based on the voxel data, and based on the priority parameter, select up to a third number of the material IDs with high priority and determine them as the material ID of the vertex, for each polygon, by selecting up to the second number of the material IDs among the material IDs set for the vertices included in the polygon and determining them as the material ID of the polygon, generate and update the material of the display mesh, the information processing system according to claim 15.

17. The information processing system further for the vertices determined based on the coordinates and the material ID with respect to the plurality of surrounding voxels, further perform simplification to reduce the number of vertices by replacing the plurality of vertices with a new single vertex for which the coordinates and the material ID are set based on the plurality of vertices, and generate the polygon based on the vertices after the simplification, the information processing system according to claim 16.

18. The information processing system calculates the priority parameter so that the priority of the material ID set for a voxel with high density is higher based on the density of the plurality of surrounding voxels, the information processing system according to claim 16.

19. The information processing system calculates the priority parameter so that the priority of the material ID set for a voxel closer to the vertex is higher based on the distance from the reference position of the plurality of surrounding voxels to the vertex, the information processing system according to claim 16.

20. The voxel data further has a voxel ratio set for each voxel, which indicates the ratio of the material indicated by the material ID within the voxel, The information processing system The information processing system according to claim 16, wherein the priority parameter is calculated based on the in-voxel ratio of the plurality of surrounding voxels, such that the higher the in-voxel ratio, the higher the priority of the material ID.

21. The information processing system: Based on the material IDs of all vertices constituting the polygon, When the number of the material IDs is less than or equal to the second number, set the material ID as the material ID of the polygon. When the number of the material IDs exceeds the second number, select the second number with high priority based on the priority parameter of each vertex, and determine it as the material ID of the polygon, to generate and update the material of the display mesh. The information processing system according to claim 16.

22. The information processing system: Based on the drawing setting information corresponding to each material ID set for each polygon included in the display mesh, at the position of each vertex, with a blend rate corresponding to the priority parameter of the vertex, between vertices, by mapping that blends the plurality of textures with an interpolated blend rate obtained by interpolating the blend rates of each vertex, draw the polygon. The information processing system according to claim 21.

23. The information processing system: Based on the voxel data, for a portion where a voxel having the density of the setting where voxels exist and a voxel having the density of the setting where voxels do not exist are adjacent, determine the vertices of the determination mesh by a method of setting vertices at coordinates based on the positions and the density of a plurality of surrounding voxels. For each vertex, for the material IDs included in the voxel data of the plurality of surrounding voxels, calculate the priority parameter for each material ID based on the voxel data, and based on the priority parameter, select the fourth number of material IDs with high priority and determine it as the material ID of the vertex. For each polygon, determine the material of the determination mesh by determining, as the material ID of the polygon, the most frequent or the one with the highest priority based on the priority parameter among the material IDs of each vertex constituting the polygon. The information processing system according to claim 15.

24. An information processing apparatus including a processor, wherein the processor generates a display mesh corresponding to voxel data defined in a virtual space and drawn based on a virtual camera, the voxel data having at least a density indicating the degree to which the space defined by each of a plurality of voxels is virtually occupied by content and a material ID indicating the type of the content, the material ID being settable up to a first plurality, based on the voxel data in which at least the density and the material ID are set for each of the plurality of voxels, wherein vertex coordinates of the display mesh are determined based on at least the density included in the voxel data, and a material of the display mesh is determined based on at least the plurality of material IDs included in the voxel data; generates a voxel update range in the virtual space based on game processing; in response to generation of the voxel update range, updates at least one of the density and the material ID for each of the voxels in the voxel data corresponding to the voxel update range in the virtual space; updates the display mesh corresponding to the updated voxel data; causes an in-game effect corresponding to a material of the determination mesh at a collision position to occur based on a collision determination between the determination mesh used for collision determination in the virtual space, the vertex coordinates of the determination mesh being determined based on at least the density included in the voxel data, and the material of the determination mesh being determined based on at least the plurality of material IDs included in the voxel data, and a determination shape corresponding to a determination target based on game processing; performs rendering of the virtual space including the display mesh based on vertex coordinates of the display mesh and a texture corresponding to the material of the display mesh; an information processing apparatus.

25. the material of the display mesh is determined by setting the material ID up to a second plurality for each of a plurality of polygons included in the display mesh; the material of the determination mesh is determined by setting one of the material IDs for each of a plurality of polygons included in the determination mesh; the processor Based on material data including at least rendering setting information including texture information set for the material for each type of material corresponding to the material ID, and property information indicating the in-game effects set for the material, Among the polygons included in the determination mesh, generate an in-game effect based on the property information corresponding to the material ID set for the polygon for which a collision has been determined, Based on the rendering setting information corresponding to each material ID set for each polygon included in the display mesh, perform rendering of the polygon based on texture mapping using one texture or a blend of multiple textures, thereby performing rendering of the virtual space including the display mesh. The information processing apparatus according to claim 24.

26. In an information processing system, Generate a display mesh corresponding to the voxel data and rendered based on a virtual camera, the voxel data defined in a virtual space, and including at least a density indicating the degree to which the space defined by each voxel is virtually occupied by content, and a material ID indicating the type of the content, the material ID being settable up to a first plurality, and the vertex coordinates of the display mesh being determined based at least on the density included in the voxel data, and the material of the display mesh being determined based at least on the plurality of material IDs included in the voxel data. Generate a voxel update range in the virtual space based on game processing. In response to the generation of the voxel update range, for each voxel in the voxel data corresponding to the voxel update range in the virtual space, update at least one of the density and the material ID. Update the display mesh corresponding to the updated voxel data. A determination mesh used for collision determination in the virtual space, wherein vertex coordinates of the determination mesh are determined based on at least the density included in the voxel data, and a material of the determination mesh is determined based on at least a plurality of the material IDs included in the voxel data. Based on a collision determination between the determination mesh and a determination shape corresponding to a determination target based on game processing, an in-game action corresponding to the material of the determination mesh at the collision position is generated. Based on vertex coordinates of the display mesh and a texture corresponding to the material of the display mesh, rendering of the virtual space including the display mesh is performed. Game processing method.

27. The material of the display mesh is determined by setting the material IDs up to a plurality of second numbers for each of a plurality of polygons included in the display mesh. The material of the determination mesh is determined by setting one of the material IDs for each of a plurality of polygons included in the determination mesh. In the information processing system, Based on material data including at least rendering setting information including at least texture information set for the material and property information indicating an in-game action set for the material for each type of material corresponding to the material ID, Among the polygons included in the determination mesh, an in-game action based on the property information corresponding to the material ID set for the polygon for which a collision is determined is generated. Based on the rendering setting information corresponding to each of the material IDs set for each of the polygons included in the display mesh, rendering of the polygon is performed based on texture mapping by one texture or blending of a plurality of textures, thereby performing rendering of the virtual space including the display mesh. The game processing method according to claim 26.

28. In the information processing system, Based on the voxel data, Based on a method of setting vertices at coordinates based on the positions and the density of a plurality of surrounding voxels for a portion where a voxel having the density set to indicate existence and a voxel having the density set to indicate non-existence are adjacent, the vertices of the display mesh are generated and updated. For each vertex, for the material IDs included in the voxel data of the plurality of surrounding voxels, calculate the priority parameter for each material ID based on the voxel data, and based on the priority parameter, select the material IDs up to the third highest number of priorities and determine them as the material ID of the vertex. For each polygon, by selecting the material IDs up to the second highest number among the material IDs set for the vertices included in the polygon and determining them as the material ID of the polygon, generate and update the material of the display mesh. The game processing method according to claim 27.

29. In the information processing system, further, For the vertex whose coordinates and material ID are determined based on the plurality of surrounding voxels, further simplify by replacing the plurality of vertices with a new single vertex whose coordinates and material ID are set based on the plurality of vertices, thereby reducing the number of vertices, and generate the polygon based on the simplified vertices. The game processing method according to claim 28.

30. In the information processing system, Calculate the priority parameter based on the density of the plurality of surrounding voxels so that the priority of the material ID set for the voxel with high density is high. The game processing method according to claim 28.

31. In the information processing system, Calculate the priority parameter based on the distance from the reference position of the plurality of surrounding voxels to the vertex so that the priority of the material ID set for the voxel close to the vertex is high. The game processing method according to claim 28.

32. The voxel data further includes a voxel ratio indicating the ratio of the material indicated by the material ID in each voxel for each voxel. In the information processing system, Calculate the priority parameter based on the voxel ratio of the plurality of surrounding voxels so that the priority of the material ID with a high voxel ratio is high. The game processing method according to claim 28.

33. In the information processing system, Based on the material IDs of all the vertices constituting the polygon, When the material ID is less than or equal to the second number, set the material ID to the material ID of the polygon. When the material ID exceeds the second number, select the second number with the highest priority based on the priority parameters of each vertex and determine it as the material ID of the polygon. The game processing method according to claim 28, which generates and updates the material of the display mesh.

34. In the information processing system, Based on the drawing setting information corresponding to each material ID set for each polygon included in the display mesh, at the position of each vertex, with a blend rate corresponding to the priority parameter of the vertex, between vertices, the plurality of textures are blended by a mapping that interpolates the blend rate of each vertex with an interpolated blend rate, and the polygon is drawn. The game processing method according to claim 33.

35. In the information processing system, Based on the voxel data, for the part where a voxel with the density of the setting where voxels exist and a voxel with the density of the setting where voxels do not exist are adjacent, determine the vertices of the determination mesh by a method of setting vertices at coordinates based on the positions and densities of a plurality of surrounding voxels. For each vertex, calculate the priority parameter for each material ID included in the voxel data of the plurality of surrounding voxels based on the voxel data, and based on the priority parameter, select the fourth number of material IDs with the highest priority and determine it as the material ID of the vertex. For each polygon, determine the material of the determination mesh by determining the most frequent or the one with the highest priority based on the priority parameter among the material IDs of each vertex constituting the polygon as the material ID of the polygon. The game processing method according to claim 27.

Citation Information

Patent Citations

  • Shell texture function

    JP2006053911A

  • Information processing device and information processing program

    JP2021124784A

  • Generating surface meshes from voxel models of 3D environments.

    JP2024521128A

  • Systems and methods for efficient point cloud visualization based on a hybrid rendering of data points and meshes

    WO2023039422A1