Mobile sound generation system

Abstract

A mobile sound generating system (1) generates a mobile sound when a mobile body moves on a given moving surface in a virtual space. A volume of the mobile sound is determined in accordance with a mass of the mobile body in the virtual space. A tone quality of the mobile sound is determined in accordance with material information of a ground-contacting portion of the mobile body in the virtual space and material information of the moving surface with which the ground-contacting portion of the mobile body contacts. A pronunciation timing of the mobile sound is determined in accordance with a timing at which the ground-contacting portion of the mobile body contacts the moving surface. The mobile sound of the mobile body is played in the virtual space with the thus determined volume, tone quality, and pronunciation timing.

Description

TECHNICAL FIELD

[0001] The present application relates to a moving sound generation system that generates a moving sound when a moving body moves in a virtual space. BACKGROUND

[0002] In the past, a moving sound generation system that generates a moving sound when a moving body moves in a virtual space has been proposed. For example, a method of moving a sound source in a certain direction at a given moving speed has been proposed in order to express the movement of a moving object (a non-player character, a non-commercial object, a vehicle, or the like) in a virtual space (for example, refer to Patent Literature 1).

[0003] However, in the existing method, although the moving sound of the moving object around the moving body (character) operated by the user is played, achieving a certain degree of realism, the moving sound of the moving body (character) itself and / or other moving bodies is not generated, and thus the user's experience in the virtual space is low. For example, in a real space, when a person is moving, the volume and / or tone, rhythm of the moving sound of the person himself / herself is heard, which enables the person to perceive what kind of ground environment and at what speed the person is moving by analogy. In addition, it is also possible to locate the sound image of the sound source without relying on vision, and to analogize the approach and / or passage of other people and / or vehicles from the moving sound.

[0004] PRIOR ART DOCUMENTS

[0005] PATENT LITERATURE

[0006] Patent Literature 1: Japanese Patent Application Publication No. 2018-201790 SUMMARY

[0007] (PROBLEMS TO BE SOLVED BY THE INVENTION)

[0008] The present application has been made in the above-described background. An object of the present application is to provide a moving sound generation system that can generate a moving sound with realism in a manner that reproduces analogy and perception in a real space in a virtual space, and can improve the user's experience in the virtual space.

[0009] (Technical Solution for Solving the Problems)

[0010] One embodiment of the present application is a mobile sound generating system that generates a mobile sound when a mobile body moves on a given moving surface in a virtual space, the mobile sound generating system including: a volume determining section that determines a volume of the mobile sound in accordance with a mass of the mobile body in the virtual space; a tone quality determining section that determines a tone quality of the mobile sound in accordance with material information of a ground-contacting portion of the mobile body that contacts the moving surface and material information of the moving surface that the ground-contacting portion of the mobile body contacts in the virtual space; a sound emission timing determining section that determines a sound emission timing of the mobile sound in accordance with a timing at which the ground-contacting portion of the mobile body contacts the moving surface; and a mobile sound playing section that plays the mobile sound of the mobile body in the virtual space at the volume determined by the volume determining section, the tone quality determined by the tone quality determining section, and the sound emission timing determined by the sound emission timing determining section.

[0011] Another embodiment of the present application is a method executed in a mobile sound generating system that generates a mobile sound when a mobile body moves on a given moving surface in a virtual space, the method including: a step of determining a volume of the mobile sound in accordance with a mass of the mobile body in the virtual space; a step of determining a tone quality of the mobile sound in accordance with material information of a ground-contacting portion of the mobile body that contacts the moving surface and material information of the moving surface that the ground-contacting portion of the mobile body contacts in the virtual space; a step of determining a sound emission timing of the mobile sound in accordance with a timing at which the ground-contacting portion of the mobile body contacts the moving surface; and a step of playing the mobile sound of the mobile body in the virtual space at the volume, the tone quality, and the sound emission timing determined in the above steps.

[0012] Still another embodiment of the present application is a program that generates a mobile sound when a mobile body moves on a given moving surface in a virtual space, the program causing a computer to execute: a process of determining a volume of the mobile sound in accordance with a mass of the mobile body in the virtual space; a process of determining a tone quality of the mobile sound in accordance with material information of a ground-contacting portion of the mobile body that contacts the moving surface and material information of the moving surface that the ground-contacting portion of the mobile body contacts in the virtual space; a process of determining a sound emission timing of the mobile sound in accordance with a timing at which the ground-contacting portion of the mobile body contacts the moving surface; and a process of playing the mobile sound of the mobile body in the virtual space at the volume, the tone quality, and the sound emission timing determined in the above steps.

[0013] As described below, the present application has other embodiments. Therefore, the disclosure of the present application is not intended to be limited to the embodiments described here, but is intended to be accorded the full scope of the claims. BRIEF DESCRIPTION OF DRAWINGS

[0014] Figure 1 is a block diagram showing the structure of a moving sound generation system in an embodiment of the present application.

[0015] Figure 2 is an explanatory diagram showing an example of determining the sound quality of a moving sound.

[0016] Figure 3 is an explanatory diagram showing an example of predicting the contact portion of a moving surface.

[0017] Figure 4 is an explanatory diagram showing an example of setting a virtual speaker.

[0018] Figure 5 is an explanatory diagram showing another example of setting a virtual speaker.

[0019] Figure 6 is a timing chart for explaining the action of a moving sound generation system in an embodiment of the present application. DETAILED DESCRIPTION

[0020] The following detailed description of the present application is made. However, the following detailed description and drawings do not limit the present application.

[0021] The moving sound generation system of the present application is a moving sound generation system that generates a moving sound when a moving body moves on a given moving surface in a virtual space, the moving sound generation system including: a volume determination unit that determines the volume of the moving sound in accordance with the mass of the moving body in the virtual space; a sound quality determination unit that determines the sound quality of the moving sound in accordance with the material information of the ground contact portion of the moving body in the virtual space that contacts the moving surface and the material information of the moving surface that the ground contact portion of the moving body contacts; a sound emission timing determination unit that determines the sound emission timing of the moving sound in accordance with the timing at which the ground contact portion of the moving body contacts the moving surface; and a moving sound playback unit that plays back the moving sound of the moving body in the virtual space at the volume determined by the volume determination unit, the sound quality determined by the sound quality determination unit, and the sound emission timing determined by the sound emission timing determination unit.

[0022] According to this structure, a moving sound when a moving body (for example, an avatar or the like) moves on a given moving surface (for example, a ground surface and / or a floor surface or the like) in a virtual space (for example, a VR space or the like) can be automatically generated. In this case, the volume of the moving sound is determined in accordance with the mass of the moving body, the sound quality of the moving sound is determined in accordance with the material information of the ground contact portion of the moving body and the moving surface, and the sound emission timing of the moving sound is determined in accordance with the timing at which the ground contact portion of the moving body contacts the moving surface. In this way, a moving sound having reality can be generated for each moving body (including a moving body operated by a user) in a virtual space, and the experience of a user in a virtual space can be improved.

[0023] That is, according to this structure, realistic moving sounds can be generated in a way that reproduces analogies and perceptions in real space, both in virtual space and in real space. In this case, moving sounds generated by the moving objects themselves can be generated, thus enhancing realism. Furthermore, by generating the moving sounds of all moving objects, the sound images of other moving object sound sources can be located and inferred.

[0024] Furthermore, in the mobile sound generation system of the present invention, the sound quality determination unit can predict the contact portion of the moving surface that the ground portion of the moving body will contact based on the movement information of the moving body, and read only the material information of the predicted contact portion of the moving surface in advance.

[0025] According to this structure, when determining the sound quality of a moving tone, the contact portion of the moving surface that the ground part of the moving body contacts is predicted, and only the material information of that contact portion of the moving surface is read in advance. Therefore, compared to reading the material information of the entire moving surface, the processing load for generating the moving tone can be reduced.

[0026] Furthermore, in the mobile sound generation system of the present invention, the mobile sound playback unit may provide a virtual speaker for playing the mobile sound of the mobile body at the contact portion of the mobile surface that is in contact with the ground portion of the mobile body.

[0027] According to this structure, a virtual speaker is provided at the contact portion of the moving surface that is in contact with the grounding portion of the moving body to play the movement sound of the moving body. By playing the movement sound of the moving body from the virtual speaker set in this way, realistic movement sound can be generated.

[0028] Furthermore, in the mobile sound generation system of the present invention, when the mass of the mobile body in the virtual space is not set, the volume determination unit can estimate the mass of the mobile body based on the volume of the mobile body.

[0029] According to this structure, even without setting the mass of the moving object in the virtual space, the mass of the moving object can be estimated based on its volume, and the volume of the moving sound can be determined appropriately.

[0030] Furthermore, in the mobile sound generation system of the present invention, the sound timing determination unit can determine the timing of the contact between the ground part of the mobile body and the mobile surface based on the timing when the potential energy of the ground part of the mobile body is at its minimum.

[0031] According to this structure, the timing of the contact between the ground part of the moving body and the moving surface can be appropriately determined based on the timing when the potential energy of the ground part of the moving body is at its minimum. Therefore, the timing of the sounding of the moving tone can be appropriately determined.

[0032] The method of the present application is a method of generating a moving sound when a moving body moves on a given moving surface in a virtual space, which is executed in a moving sound generation system, and includes a step of deciding a volume of the moving sound in accordance with a mass of the moving body in the virtual space; a step of deciding a timbre of the moving sound in accordance with material information of a ground-contacting portion of the moving body in the virtual space and material information of the moving surface contacted by the ground-contacting portion of the moving body; a step of deciding a pronunciation timing of the moving sound in accordance with a timing at which the ground-contacting portion of the moving body contacts the moving surface; and a step of playing the moving sound of the moving body in the virtual space at the volume, the timbre, and the pronunciation timing decided in the steps.

[0033] According to the method, as with the above-described system, a moving sound with reality can be generated for each moving body (including a moving body operated by a user) in a virtual space, and the experience of a user in the virtual space can be improved.

[0034] The program of the present application is a program of generating a moving sound when a moving body moves on a given moving surface in a virtual space, which causes a computer to execute the following processes: a process of deciding a volume of the moving sound in accordance with a mass of the moving body in the virtual space; a process of deciding a timbre of the moving sound in accordance with material information of a ground-contacting portion of the moving body in the virtual space and material information of the moving surface contacted by the ground-contacting portion of the moving body; a process of deciding a pronunciation timing of the moving sound in accordance with a timing at which the ground-contacting portion of the moving body contacts the moving surface; and a process of playing the moving sound of the moving body in the virtual space at the volume, the timbre, and the pronunciation timing decided in the steps.

[0035] According to the program, as with the above-described system, a moving sound with reality can be generated for each moving body (including a moving body operated by a user) in a virtual space, and the experience of a user in the virtual space can be improved.

[0036] According to the present application, a moving sound with reality can be generated, and the experience of a user in a virtual space can be improved.

[0037] (Embodiment)

[0038] A moving sound generation system according to an embodiment of the present application will be described below with reference to the drawings. In the present embodiment, a case in which a system of generating a moving sound when a moving body (avatar, etc.) moves on a given moving surface (ground surface and / or floor surface, etc.) in a virtual space is exemplified.

[0039] The structure of the moving sound generation system according to the present embodiment will be described with reference to the drawings. Figure 1is a block diagram showing the structure of a mobile sound generation system according to the present embodiment. As shown in Figure 1 The mobile sound generation system 1 is configured to include a user device 2 and a server device 3 connected to each other by a network N.

[0040] The user device 2 is a device operated by a user, and is provided with, for example, a head-mounted display 4 (HMD) and a controller 5. Note that the user device 2 is not limited to a device provided with the head-mounted display 4. The user device 2 can be provided with, for example, a personal computer and / or a smartphone, a tablet terminal, and the like.

[0041] The head-mounted display 4 is a display device of a type worn on the head of a user and covering the field of view of both eyes of the user. The user wearing the head-mounted display 4 can see an image displayed on the head-mounted display 4. The display mode of the head-mounted display 4 is not limited, and can be a mode in which an object is displayed at an arbitrary position in a virtual space (virtual reality space) having a depth, or a mode in which an object is displayed at an arbitrary position in a virtual plane.

[0042] The controller 5 is an input interface that accepts an operation input from a user. Although illustration is omitted here, the controller 5 has, for example, at least one operation button, and is internally provided with various sensors that detect the direction and / or movement (acceleration, rotation, and the like) of the controller 5. Through the operation input from the controller 5, the user can move an avatar in a virtual reality space. In addition, the avatar can be moved in synchronization with the movement of the user himself / herself in a real environment, in addition to the operation by the controller.

[0043] The server device 3 is provided with a control section 6 and a storage section 7. The control section 6 is configured by, for example, a processor or the like, and the storage section 7 is configured by, for example, a large-capacity storage or the like.

[0044] The control section 6 is provided with a volume determination section 8, a sound quality determination section 9, a sound emission timing determination section 10, and a mobile sound playback section 11. In the storage section 7, user information (for example, user account information and the like), avatar information (for example, the type, size, mass, material of the grounding portion, and the like of the avatar), movement information (for example, the position (coordinates) of the avatar, the moving direction, the moving speed, the moving posture (walking on two legs, running on two legs, walking on four legs, running on four legs, running on wheels, and the like), and the like), and world information (for example, the gravitational acceleration, the material of the moving surface, and the like) are stored.

[0045] The type of the avatar includes, for example, a human type, an animal type, an insect type, a plant type, a food type, an imaginary biological type (dragon, griffin, snowman, and the like), a robot type, and an object type having wheels (a character of a car and the like).

[0046] Materials used as the grounding part of the embodiment include, for example, bare feet, cloth (sock cloth, tabi cloth, slipper cloth), rubber (shoe rubber, running shoe rubber, rubber boot rubber, tire rubber, etc.), wood and / or plants such as grass (clog wood, sandal grass, etc.), leather (leather shoe leather, slipper leather, etc.), metal (metal of wheels, etc.), etc.

[0047] Materials used as moving surfaces include, for example, asphalt, concrete, tiles, pebbles, puddles, soil, sand, gravel, rocks, wetlands, grasslands, trees, grass, moss, frost, snow, hail, fallen leaves, etc., in outdoor cases, and flooring, carpets, floor tiles, tatami mats, cork, jute, rugs, floor mats, etc., in indoor cases.

[0048] The volume determination unit 8 determines the volume of the movement sound based on the mass of the moving entity (avatar) in the virtual space. For example, it determines the volume of the movement sound in a manner that the greater the mass, the greater the volume. Furthermore, the volume determination unit 8 can also determine the volume of the movement sound based on the weight of the moving entity (avatar) in the virtual space (=mass × gravitational acceleration). Additionally, the volume determination unit 8 can determine the volume of the movement sound based on the swing-up position (Z-coordinate) of the grounding part of the moving entity (avatar's foot). For example, it determines the volume of the movement sound in a manner that the higher the swing-up position, the greater the volume.

[0049] Furthermore, if the mass of the moving object in the virtual space is not set, the volume determination unit 8 can estimate the mass of the moving object based on its volume. For example, by estimating that the larger the volume of the moving object, the greater its mass, and thus determining the volume of the moving sound in a manner that the larger the volume, the greater the volume.

[0050] The sound quality determination unit 9 determines the sound quality of the moving sound based on the material information of the ground part (the avatar's feet) of the moving body in contact with the moving surface in the virtual space and the material information of the moving surface (ground and / or floor surface) that the ground part of the moving body contacts.

[0051] Figure 2 This is an explanatory diagram showing examples that determine the timbre of a moving tone. For example... Figure 2 As shown, for example, if the material of the grounding part of the mobile entity (the incarnation's feet) is "barefoot" and the material of the moving surface (ground) is "asphalt," then the tone quality of the mobile sound is determined as "tone quality a." The data for the tone quality of the mobile sound (tone quality a, b, ...) can be prepared in advance as a library. Alternatively, the tone quality of the mobile sound can be calculated each time based on the material information of the grounding part of the mobile entity (the incarnation's feet) and the material information of the moving surface (ground and / or floor surface) that the grounding part of the mobile entity contacts.

[0052] Further, the sound quality determining section 9 can predict the contact area of the moving surface contacted by the ground-contacting portion of the moving body based on the moving information of the moving body, and read only the material information of the predicted contact area of the moving surface in advance.

[0053] Figure 3 is an explanatory diagram showing an example of determining the sound quality of the moving sound. In Figure 3 , the contact portion of the moving surface contacted by the left foot of the moving body (Avatar A) is illustrated as Rl, and the contact portion of the moving surface contacted by the right foot is illustrated as R2. In this case, the contact portions R3, R4, R5 of the moving surface contacted by the ground-contacting portion of the moving body can be predicted based on the moving information (position of the avatar, moving direction, moving speed, moving posture, etc.) of the moving body (Avatar A). Then, the material information of the predicted contact portions R3, R4, R5 is read only in advance.

[0054] The sound timing determining section 10 determines the sound timing of the moving sound based on the timing at which the ground-contacting portion of the moving body contacts the moving surface. For example, the sound timing determining section 10 can determine whether the ground-contacting portion of the moving body contacts the moving surface, and determine the sound timing of the moving sound based on the determination result.

[0055] The sound timing determining section 10 can determine the timing at which the ground-contacting portion of the moving body contacts the moving surface based on the timing at which the potential energy of the ground-contacting portion of the moving body is the smallest. In this case, the potential energy of the ground-contacting portion of the moving body can be calculated based on the following formula.

[0056] Potential energy = mass of the avatar x gravitational acceleration x height of the ground-contacting portion of the moving body

[0057] Here, the height of the ground-contacting portion of the moving body is the Z coordinate of the lowest point or the center of gravity of the ground-contacting portion (e.g., each of the left and right feet) of the moving body.

[0058] Further, in a case where the mass of the avatar and the gravitational acceleration are constant, the sound timing determining section 10 can determine the timing at which the ground-contacting portion of the moving body contacts the moving surface based on the timing at which the height of the ground-contacting portion of the moving body is the smallest.

[0059] The moving sound playing section 11 plays the moving sound of the moving body in the virtual space at the volume determined by the volume determining section 8, the sound quality determined by the sound quality determining section 9, and the sound timing determined by the sound timing determining section 10. For example, by providing a virtual speaker that plays the moving sound of the moving body at the contact portion of the moving surface contacted by the ground-contacting portion of the moving body, it is possible to play the moving sound of the moving body.

[0060] Figure 4 is an explanatory diagram showing an example of the provision of a virtual speaker. In Figure 4In the example of Fig. 6, a virtual speaker S is provided at a contact portion R1 of a moving surface contacted by the left foot of the mobile body (Avatar A) and a contact portion R2 of the moving surface contacted by the right foot of the mobile body.

[0061] Figure 5 Fig. 7 is an explanatory diagram of another example of the provision of a virtual speaker. In the example of Fig. 7, a virtual speaker S is provided at a contact portion of a moving surface contacted by both feet of the mobile body (Avatar A) walking on two feet, a contact portion of a moving surface contacted by one foot of the mobile body (Avatar B) running on two feet, and a contact portion of a moving surface contacted by a foot of the mobile body (Avatar C) walking on four feet. Figure 5

[0062] The operation of the mobile sound generation system 1 configured as described above will be described with reference to the timing chart of Fig. 8. Figure 6

[0063] In the case of using the mobile sound generation system 1 of the present embodiment, first, when login information is input by the user device 2 (S1), the input login information is transmitted from the user device 2 to the server device 3 (S2), and a user authentication process is performed by the server device 3 (S3). When the user authentication is successful, a login permission is transmitted from the server device 3 to the user device 2 (S4).

[0064] Next, the user whose login is permitted operates the user device 2 to generate an avatar in the virtual reality space (S5), and when the avatar is moved in the virtual space (S6), the movement information of the avatar is transmitted from the user device 2 to the server device 3 (S7).

[0065] In the server device 3, the volume of the mobile sound is decided in accordance with the mass of the mobile body in the virtual space (S8), the timbre of the mobile sound is decided in accordance with the material information of the ground contact portion of the mobile body in contact with the moving surface and the material information of the moving surface contacted by the ground contact portion of the mobile body (S9). Further, the timing of the sound emission of the mobile sound is decided in accordance with the timing at which the ground contact portion of the mobile body comes into contact with the moving surface (S10).

[0066] Then, a request for the provision of a virtual speaker is transmitted from the server device 3 to the user device 2 (S11), and a virtual speaker that plays the mobile sound of the mobile body is provided at the contact portion of the moving surface contacted by the ground contact portion of the mobile body (S12).

[0067] Further, at the time point that becomes the timing of the sound emission decided in step S10 (S13), a request for the play of the mobile sound is transmitted from the server device 3 to the user device 2 (S14). Then, the mobile sound of the volume and the timbre decided in steps S8 and S9 is played by the virtual speaker provided in step S12 (S15).

[0068] ​​According to the mobile sound generation system 1 of the present embodiment, it is possible to automatically generate a mobile sound when a mobile body (e.g., an avatar, etc.) moves on a given moving surface (e.g., a ground surface and / or a floor surface, etc.) in a virtual space (e.g., a VR space, etc.). In this case, the volume of the mobile sound is determined in accordance with the mass of the mobile body, the timbre of the mobile sound is determined in accordance with the material information of the mobile body's ground-contacting portion and the moving surface, and the pronunciation timing of the mobile sound is determined in accordance with the timing at which the mobile body's ground-contacting portion comes into contact with the moving surface. In this way, it is possible to generate a mobile sound with a sense of reality for each mobile body (including a mobile body operated by a user) in a virtual space, and to improve the user's experience in the virtual space (see Figure 5 ).

[0069] That is, according to the mobile sound generation system 1 of the present embodiment, it is possible to generate a mobile sound with a sense of reality in a manner that makes it possible to reproduce analogies and perceptions in a real space in a virtual space. In this case, it is possible to generate a mobile sound produced by a mobile body itself, and to improve the sense of reality. Furthermore, by generating a mobile sound for all mobile bodies, it is possible to localize and analogize the sound image of a sound source of another mobile body.

[0070] Furthermore, in the present embodiment, when determining the timbre of the mobile sound, the contact portion of the moving surface contacted by the mobile body's ground-contacting portion is predicted, and only the material information of the contact portion of the moving surface is read in advance. Therefore, compared to a case in which the material information of the entire moving surface is read, it is possible to reduce the load of the processing for generating the mobile sound.

[0071] Furthermore, in the present embodiment, a virtual speaker that plays a mobile sound of a mobile body is provided at the contact portion of the moving surface contacted by the mobile body's ground-contacting portion. By playing the mobile sound of the mobile body from the virtual speaker set as described above, it is possible to generate a mobile sound with a sense of reality.

[0072] Furthermore, in the present embodiment, even in a case in which the mass of a mobile body in a virtual space is not set, it is possible to estimate the mass of the mobile body in accordance with the volume of the mobile body, and to appropriately determine the volume of the mobile sound.

[0073] Furthermore, in the present embodiment, it is possible to appropriately determine the timing at which the mobile body's ground-contacting portion comes into contact with the moving surface in accordance with the timing at which the potential energy of the mobile body's ground-contacting portion is minimized, and thus it is possible to appropriately determine the pronunciation timing of the mobile sound.

[0074] Although the embodiments of the present application have been described above by way of examples, the scope of the present application is not limited to the above-described embodiments, and can be changed and modified as appropriate within the scope of the content of the claims.

[0075] While the above has been a description of the preferred embodiments of the present application set forth in accordance with the pertinent parts of the patent statutes, it should be realized that various modifications could be made to the preferred embodiments, and the generic principles and specific examples set forth herein are intended to be illustrative only and not limiting of the present application.

[0076] (Industrial Applicability)

[0077] As described above, the mobile sound generating system according to the present application has an effect of being able to generate a mobile sound having reality and being able to improve the experience of a user in a virtual space, and is useful as a virtual reality space system or the like.

[0078] (Label Explanation)

[0079] 1 Mobile sound generating system

[0080] 2 User device

[0081] 3 Server device

[0082] 4 Head-mounted display

[0083] 5 Controller

[0084] 6 Control section

[0085] 7 Storage section

[0086] 8 Sound volume determining section

[0087] 9 Sound quality determining section

[0088] 10 Sound timing determining section

[0089] 11 Mobile sound playing section

[0090] N Network.

Claims

1. A motion sound generation system for generating motion sounds when a moving body moves on a given motion surface in virtual space, the motion sound generation system being characterized by comprising: A volume determining unit determines the volume of the movement sound based on the mass of the moving object in the virtual space; The sound quality determination unit determines the sound quality of the moving sound based on the material information of the grounding part of the moving body in contact with the moving surface in the virtual space and the material information of the moving surface in contact with the grounding part of the moving body; The sound production timing determination unit determines the sound production timing of the moving tone based on the timing of the contact between the ground portion of the moving body and the moving surface; and The mobile sound playback unit plays the movement sound of the mobile body in the virtual space at a volume determined by the volume determination unit, a sound quality determined by the sound quality determination unit, and a sound timing determined by the sound timing determination unit. The sound quality determination unit predicts the contact portion of the moving surface that the ground portion of the moving body will contact after the moving body moves, based on the movement information of the moving body, before the ground portion of the moving body contacts the contact portion of the moving surface due to the movement of the moving body, and reads the predicted material information of the contact portion of the moving surface before the ground portion of the moving body contacts the contact portion of the moving surface due to the movement of the moving body.

2. The mobile sound generation system as described in claim 1, wherein, The mobile sound playback unit is provided with a virtual speaker at the contact portion of the mobile surface that is in contact with the ground portion of the mobile body, which plays the mobile sound of the mobile body.

3. The mobile sound generation system as described in claim 1, wherein, Without setting the mass of the moving object in the virtual space, the volume determination unit estimates the mass of the moving object based on its volume.

4. The mobile sound generation system as described in claim 1, wherein, The sound timing determination unit determines the timing of contact between the ground part of the moving body and the moving surface based on the timing when the potential energy of the ground part of the moving body is at its minimum.

5. A method for generating motion sounds when a moving body moves on a given motion surface in virtual space, executed in a motion sound generation system, the method being characterized by comprising: The step of determining the volume of the moving sound based on the mass of the moving object in the virtual space; The step of determining the sound quality of the moving sound based on the material information of the grounding part of the moving body in contact with the moving surface in the virtual space and the material information of the moving surface in contact with the grounding part of the moving body; The step of determining the timing of the sound production of the moving sound based on the timing of the contact between the grounding part of the moving body and the moving surface; as well as The step of playing the movement sound of the moving body in the virtual space with the volume, sound quality and pronunciation timing determined in the above steps. In the step of determining the sound quality of the moving sound, based on the movement information of the moving body, before the ground part of the moving body comes into contact with the contact part of the moving surface due to the movement of the moving body, the contact part of the moving surface that the ground part of the moving body will contact after the movement of the moving body is predicted, and before the ground part of the moving body comes into contact with the contact part of the moving surface due to the movement of the moving body, the material information of the predicted contact part of the moving surface is read.

6. A computer program product for generating motion sounds as a moving body moves on a given motion surface in virtual space, the computer program product being characterized in that it causes a computer to perform the following processes: The volume of the moving sound is determined based on the mass of the moving object in the virtual space. The sound quality processing of the moving sound is determined based on the material information of the grounding part of the moving body in contact with the moving surface in the virtual space and the material information of the moving surface in contact with the grounding part of the moving body. The timing of the sound production of the moving sound is determined based on the timing of the contact between the grounding part of the moving body and the moving surface; as well as The processing of playing the movement sound of the moving body in the virtual space with the volume, sound quality and pronunciation timing determined in the above steps. In the process of determining the sound quality of the moving sound, based on the movement information of the moving body, before the ground part of the moving body comes into contact with the contact part of the moving surface due to the movement of the moving body, the contact part of the moving surface that the ground part of the moving body will contact after the movement of the moving body is predicted, and before the ground part of the moving body comes into contact with the contact part of the moving surface due to the movement of the moving body, the material information of the predicted contact part of the moving surface is read.

Images