Sound conversion system in virtual space and method thereof
By forming a virtual atmosphere in the virtual space and generating physical forces, the problem that sound generation in the virtual space is restricted by location is solved, and the sound generation is generated independent of the position is realized, which enhances the flexibility and diversity of sound generation.
Patent Information
- Application Number
- CN202380028617.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-08
- Filing Date
- 2023-04-10
- Publication Date
- 2024-11-29
AI Technical Summary
When generating sound in a virtual space, the prior art cannot generate sounds caused by physical forces unrelatedly due to limitations of the specified location of the virtual space.
By forming a virtual atmosphere in the virtual space, physical forces are generated, and virtual data is generated based on these physical forces, and then the virtual data is converted into fluctuating data, and finally converted into sound, so that sound generation independent of the specified location of the virtual space is achieved.
It realizes that no matter how the position changes in the virtual space, sound caused by physical forces can be generated, enhancing the flexibility and diversity of sound generation.
Smart Images

Figure CN119054305A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a sound conversion system and method in a virtual space, and more particularly, to a sound conversion system and method in a virtual space for converting sounds audible to a user based on physical forces generated in the virtual space. Background Art
[0002] In a VR (Virtual Reality) environment, stereo sound reproduction can be achieved by adjusting multi-channel virtual speakers according to changes in the head direction based on headphones through head tracking, thereby reproducing stereo sound.
[0003] In the case of object-based audio using computer graphics such as in games, the direction and distance of the target sound source are rendered based on head tracking, thereby reproducing the three-dimensional position of the target sound source in more detail.
[0004] However, in the case of recording a real space, it is difficult to express all sounds in object-based audio, and therefore, audio in a hybrid format including channel-based audio and object-based audio is used.
[0005] Currently, with movie content as the center, Dolby's ATMOS and DTS's DTS-X are using hybrid audio formats, and with broadcast content as the center, Dolby's AC4 and MPEG's MPEG-H 3D Audio are using hybrid audio formats.
[0006] On the other hand, Korean registered patent No. 10-2271395 (June 24, 2021) discloses a sound effect method and a computing device for performing the same.
[0007] However, since radiation is emitted at a predetermined point in a virtual space in order to produce an acoustic effect (sound), there is a limitation that the acoustic effect is produced only at the predetermined point. Summary of the invention
[0008] Technical issues
[0009] The present invention is intended to solve the above-mentioned problems, and its object is to provide a sound conversion system and method in a virtual space that can generate sounds caused by physical forces in the virtual space regardless of a predetermined position in the virtual space.
[0010] The problems to be solved by the present invention are not limited to the above-mentioned problems, and a person skilled in the art can clearly understand the unmentioned problems from this specification and the attached drawings.
[0011] Solutions to the problem
[0012] A method for sound conversion in a virtual space implemented by a sound conversion system in a virtual space according to an embodiment of the present invention comprises: a step of forming a virtual atmosphere in the virtual space; a step of generating physical force in the virtual space; and a step of generating virtual data on the virtual atmosphere based on the physical force, wherein the virtual data may be data on the state of the virtual atmosphere that has changed due to the physical force.
[0013] Effects of the Invention
[0014] The sound conversion method in a virtual space according to an embodiment of the present invention has the advantage of being able to generate a sound caused by a physical force in the virtual space regardless of a predetermined position in the virtual space.
[0015] The effects of the present invention are not limited to the above-mentioned effects, and those skilled in the art can clearly understand the unmentioned effects from this specification and the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 A simplified diagram for explaining communication of a sound conversion system in a virtual space according to an embodiment of the present invention.
[0017] Figure 2 A simplified structural block diagram of a server of a sound conversion system in a virtual space according to an embodiment of the invention.
[0018] Figure 3 A simplified diagram of virtual data for illustrating a sound conversion system in a virtual space according to an embodiment of the present invention.
[0019] Figure 4 A simplified diagram of virtual data, wave data, and sound of a sound conversion system in a virtual space for illustrating an embodiment of the present invention.
[0020] Figure 5 The figure is a simplified flowchart for explaining a method for converting sound in a virtual space according to an embodiment of the present invention.
[0021] The specific embodiments of the present invention are described in detail below with reference to the accompanying drawings. However, the concept of the present invention is not limited to the embodiments provided, and a person skilled in the art who understands the concept of the present invention can easily propose other inventions or other embodiments within the concept of the present invention by adding, changing, or deleting other structural elements within the same concept, and these also belong to the concept of the present invention. DETAILED DESCRIPTION
[0022] A method for sound conversion in a virtual space implemented by a sound conversion system in a virtual space according to an embodiment of the present invention comprises: a step of forming a virtual atmosphere in the virtual space; a step of generating physical force in the virtual space; and a step of generating virtual data on the virtual atmosphere based on the physical force, wherein the virtual data may be data on the state of the virtual atmosphere that has changed due to the physical force.
[0023] Furthermore, the present invention may further include: a step of specifying a specified position in the virtual space; a step of specifying the virtual data corresponding to the specified position; a step of converting the virtual data into wave data; and a step of converting the wave data into sound.
[0024] Furthermore, the present invention may further include a step of transmitting the virtual data or the fluctuation data to other electronic devices.
[0025] Furthermore, the present invention may further include a step of changing the characteristics of the character based on the virtual data.
[0026] A sound conversion system in a virtual space according to another embodiment of the present invention includes: an atmosphere forming unit, which forms a virtual atmosphere in the virtual space; a physical force generating unit, which generates physical force in the virtual space; and a virtual data generating unit, which generates virtual data on the virtual atmosphere based on the physical force, and the virtual data may be data on the state of the virtual atmosphere that has changed due to the physical force.
[0027] Furthermore, the present invention may further include: a position specifying unit for specifying a specified position in the virtual space; a virtual data specifying unit for specifying the virtual data corresponding to the specified position; a wave data conversion unit for converting the virtual data into wave data; and a sound conversion unit for converting the wave data into sound.
[0028] Furthermore, the present invention may further include a communication unit for transmitting the virtual data or the fluctuation data to other electronic devices.
[0029] Furthermore, the present invention may further include a characteristic changing unit configured to change the characteristics of the character based on the virtual data.
[0030] The same reference numerals are used to describe the same functional components within the scope of the same concept shown in the drawings of the various embodiments.
[0031] Figure 1 A simplified diagram for explaining communication of a sound conversion system in a virtual space according to an embodiment of the present invention.
[0032] Figure 2A simplified structural block diagram of a server of a sound conversion system in a virtual space according to an embodiment of the invention.
[0033] Figure 3 A simplified diagram of virtual data for illustrating a sound conversion system in a virtual space according to an embodiment of the present invention.
[0034] Figure 4 A simplified diagram of virtual data, wave data, and sound of a sound conversion system in a virtual space for illustrating an embodiment of the present invention.
[0035] Figure 5 The figure is a simplified flowchart for explaining a method for converting sound in a virtual space according to an embodiment of the present invention.
[0036] In order to further clearly express the technical concept of the present invention, the attached drawings simplify or omit parts that reduce the relevance to the technical concept of the present invention or that can be easily derived by ordinary technicians.
[0037] Throughout the specification, when it is stated that a part is "connected" to another part, this includes not only the case of "direct connection" but also the case of "electrical connection" with other elements in between. In addition, it should be understood that when it is stated that a part "includes" a structural element, unless otherwise stated, it means that other structural elements may also be included, not that other structural elements are removed, and it does not preclude the existence or additional possibility of one or more other features or numbers, steps, actions, structural elements, components or combinations thereof.
[0038] In this specification, a "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Furthermore, one unit may be realized by two or more hardwares, and two or more units may be realized by one hardware.
[0039] In this specification, a part of the actions or functions described as being performed by a terminal or device may be performed by a server connected to the corresponding terminal or device instead. Similarly, a part of the actions or functions described as being performed by a server may also be performed by a terminal or device connected to the corresponding server.
[0040] Below, refer to Figures 1 to 5 A sound conversion system 10 and method in a virtual space according to an embodiment of the present invention will be described.
[0041] As an example, the present invention may refer to a system 10 and method for converting and providing sounds generated in a virtual space (Virtual Reality) environment to a user.
[0042] As an example, Figure 1As shown, the sound conversion system 10 in the virtual space may include: a server S, which forms a virtual space and calculates / processes activities occurring in the virtual space; and user electronic devices P1, P2, which communicate with the server S and play their own roles in the virtual space.
[0043] As an example, there may be a plurality of users, such as a first user and a second user.
[0044] The user's electronic devices P1 and P2 refer to devices that can communicate with the server S and play their own roles in the virtual space. They can be mobile terminals, desktop computers, etc., and their types are not limited.
[0045] The sound conversion method in the virtual space can be implemented by the sound conversion system 10 in the virtual space.
[0046] Below, refer to Figures 1 to 5 The sound conversion method and system 10 in the virtual space are further described in detail.
[0047] As an example, Figure 2 As shown, the server S may include a controller 100, and the controller 100 has an atmosphere forming unit 110, a physical force generating unit 120, a virtual data generating unit 130, a position specific unit 140, a virtual data specific unit 150, a fluctuation data conversion unit 160, a sound conversion unit 170, and a characteristic changing unit 180, which will be described below, and may also include: an input unit 500, which can receive specified operation values / input values, data, etc. from an administrator; a communication unit 300, which communicates with other electronic devices P1, P2 including the user's electronic devices P1, P2; a memory unit 200, which is used to store specified data / information; and a display unit 400, which is used to display specified data / information.
[0048] On the other hand, although further detailed description will be given below, the fluctuation data conversion unit 160 and / or the sound conversion unit 170 can be included as a structure in the user's electronic device P1, P2, rather than as a structure of the server S.
[0049] As an example, the sound conversion method may include step S10 of forming a virtual atmosphere in the virtual space.
[0050] The step S10 of forming the virtual atmosphere may be implemented by the atmosphere forming unit 110 .
[0051] As an example, the administrator of the server S may input prescribed input values for defining the virtual atmosphere of the virtual space through the input unit 500, and the atmosphere forming unit 110 may form the virtual atmosphere corresponding to the prescribed input values input by the administrator.
[0052] As an example, the predetermined input values defining the virtual atmosphere may mean the temperature, pressure, humidity, etc. of the virtual space.
[0053] On the other hand, in the step S10 of forming the virtual atmosphere, the user can input the specified input values for defining the virtual atmosphere through his or her electronic devices P1 and P2, and transmit them to the communication unit 300. The atmosphere forming unit 110 can also form the virtual atmosphere corresponding to the specified input values input by the user.
[0054] On the other hand, the sound conversion method may further include a step S20 of generating a physical force in the virtual space.
[0055] Here, the physical force may mean a force that becomes a source of sound generated in the virtual space.
[0056] As an example, the step S20 of generating the physical force may be implemented by the physical force generating unit 120 .
[0057] As an example, the administrator of the server S may use the input unit 500 to pre-set the object that generates the physical force in the virtual space.
[0058] For example, an object that generates a physical force may be a bomb that explodes at a specific point in time.
[0059] At this time, the physical force generating unit 120 may cause the bomb to explode when a specific time point arrives, and may generate the physical force corresponding to the explosion force on the virtual atmosphere of the virtual space.
[0060] As an example, the physical force may mean temperature, pressure, humidity, etc. that change over time and have an impact on the virtual atmosphere.
[0061] On the other hand, in the step S20 of generating the physical force, the user can input a specified input value for defining the physical force through his or her electronic devices P1 and P2, and transmit it to the communication unit 300. The physical force generating unit 120 can also generate the physical force corresponding to the specified input value input by the user in the virtual atmosphere.
[0062] For example, the user's character may set a bomb in the virtual space that explodes at a specific time point.
[0063] On the other hand, the sound conversion method may further include a step S30 of generating virtual data on the virtual atmosphere based on the physical force.
[0064] Here, the virtual data may mean data of a state of the virtual atmosphere that changes due to the physical force generated on the virtual atmosphere.
[0065] That is, with respect to the virtual atmosphere, in the initial state set by step S10 of forming the virtual atmosphere, the physical force is generated on the virtual atmosphere by step S20 of generating the physical force, and with the help of the physical force, it is possible to change from the initial state to other states.
[0066] For example, with respect to the virtual atmosphere, the temperature, pressure and / or humidity of the virtual atmosphere may increase or decrease over time by means of the physical force, and may cause fluctuating changes.
[0067] Therefore, the virtual data may mean data of the state of the virtual atmosphere changed by the physical force.
[0068] As an example, the step S30 of generating the virtual data may be implemented by the virtual data generating unit 130 .
[0069] For example, Figure 3 As shown, the virtual data generation unit 130 may define the state of the virtual atmosphere that changes due to the physical force over time, based on the object that generates the physical force, at a predetermined position X1 in the virtual space.
[0070] At the position of X2 which is relatively close to X1, the state of the virtual atmosphere can be defined as the virtual data which is relatively more affected by the physical force; at the position of X3 which is relatively far from X1, the state of the virtual atmosphere can be defined as the virtual data which is relatively less affected by the physical force; and at the position of X4 which is far from X1, the state of the virtual atmosphere is not affected by the physical force, so that it can be the initial state where the virtual data is not generated.
[0071] The virtual data generation unit 130 may generate the virtual data on the virtual atmosphere based on the physical force when an object generating the physical force generates the physical force regardless of the position of the character of the user in the virtual space.
[0072] That is, the virtual data generating unit 130 may generate the virtual data that changes on the virtual atmosphere as time passes, regardless of the position of the user's character, based on the time point when the physical force is generated.
[0073] As an example, the virtual data may be generated by the virtual data generation unit 130 and stored in the memory unit 200 as time passes from the position of the virtual space and the time point when the physical force is generated.
[0074] On the other hand, the sound conversion method may further include a step S40 of specifying a prescribed position in the virtual space.
[0075] Here, the predetermined position means a specific position in the virtual space for generating sound in the virtual space, and means the position of the user character.
[0076] The step S40 of specifying the predetermined position may be implemented by the position specifying unit 140 .
[0077] As an example, a user can input a specified position in the virtual space through his or her electronic device P1 or P2, or can input an input value for placing his or her character at a specified position and transmit it to the communication unit 300. The position specifying unit 140 can place the user's character at a position in the virtual space corresponding to the specified input value entered by the user, or can specify its position.
[0078] On the other hand, the user can not only input the specified location through his own electronic device P1, P2, but also input a current or past specific time point or time.
[0079] On the other hand, the sound conversion method may further include a step S50 of specifying the virtual data corresponding to the specified position.
[0080] The step S50 of specifying the virtual data may be implemented by the virtual data specifying unit 150 .
[0081] As an example, the virtual data specifying unit 150 may select (specify) the virtual data corresponding to the predetermined position and / or the specific time point specified in the step S40 of specifying the predetermined position from among the plurality of virtual data.
[0082] As an example, the virtual data specifying unit 150 may select (specify) the virtual data corresponding to the predetermined position and / or specific time point from among the plurality of virtual data stored in the memory unit 200 .
[0083] Afterwards, the sound conversion method may further include a step S60 of converting the virtual data into fluctuation data, the virtual data being selected by the step S50 of specifying the virtual data.
[0084] As an example, the wave data, which is intermediate data for converting the virtual data into sound, may mean data having information on the wave (sound wave) corresponding to the virtual data.
[0085] As an example, the step of changing to the fluctuation data is a step implemented by the step S50 of specifying the virtual data when only the virtual data exists, and may not be implemented when the virtual data does not exist.
[0086] As an example, the step S60 of converting into the fluctuation data may be implemented by the fluctuation data conversion unit 160 .
[0087] As an example, the fluctuation data conversion unit 160 may be a structure of the controller 100 of the server S, but on the other hand, it may be a structure of the user's electronic device P1 or P2.
[0088] In the case where the fluctuation data conversion unit 160 is a structure of the user's electronic device P1, P2, the user's electronic device P1, P2 can receive the virtual data specified in the step S50 of specifying the virtual data, and can convert the received virtual data into the fluctuation data.
[0089] As an example, the fluctuation data conversion unit 160 may generate the fluctuation data including the frequency, pitch, wavelength, period, amplitude, sound pressure, phase, etc. constituting the sound wave by using the virtual data.
[0090] Afterwards, the sound conversion method may further include a step S70 of converting the fluctuation data into sound.
[0091] The sound refers to the sound that the user can hear through a speaker or a headset, etc., and the step S70 of converting into the sound can be implemented by the sound conversion unit 170.
[0092] As an example, the sound conversion unit 170 is a structure that converts the wave data as digital information into sound (mp3, FLAC or wav, etc.) as audible sound waves. It can be a structure of the controller 100 of the server S or a structure of the user's electronic devices P1 and P2.
[0093] As a result, the user can hear the sound generated in the virtual space at the specified location and time point specified by the user through his or her electronic device P1 or P2.
[0094] On the other hand, the sound conversion method may further include step S80 of transmitting the virtual data, the fluctuation data or the sound to other electronic devices.
[0095] This is further explained in detail as follows: the virtual data, the fluctuation data or the sound at a specified position and time point in the virtual space specified by a first user among multiple users can be transmitted to the electronic device P2 of the second user through the server S or the electronic device P1 of the first user.
[0096] As a result, the second user can hear the sound specified by the first user or the place where the character of the first user is located.
[0097] On the other hand, the voice conversion method may further include step S90 of changing the characteristics of the character based on the virtual data.
[0098] The step S90 of changing the characteristics of the character may be implemented by the characteristic changing unit 180 .
[0099] This is further explained in detail as follows: when the user's character (Player Character) or NPC (Non-Player Character) is located in the virtual space through step S40 of specifying the specified position, the virtual data based on the generation of the plurality of physical forces can be obtained, and the characteristic changing unit 180 can change the characteristics of the character according to the obtained virtual data.
[0100] For example, in the case where the physical force is generated by piano playing, the character that obtains the virtual data generated by means of the physical force can change into a docile personality and / or appearance, while in the case where the physical force is generated by the explosion of an explosive, the character that obtains the virtual data generated by means of the physical force can change into an aggressive personality and / or appearance.
[0101] That is, the characteristic changing unit 180 may change the characteristics (personality, appearance, etc.) of the character based on the virtual data corresponding to the character in the virtual space.
[0102] On the other hand, Figure 5 Although the step S40 of specifying the specified position is described as being implemented after the step of generating the virtual data, it is not limited to this and can be obviously implemented after the step S10 of forming the virtual atmosphere or the step S20 of generating the physical force.
[0103] On the other hand, the sound conversion system 10 in the virtual space may mean a device for implementing the sound conversion method in the virtual space through the above-mentioned structure.
[0104] As described above, the method and system 10 for converting sound in a virtual space can generate and store the virtual data regardless of the presence or absence of a character when the physical force is generated in the virtual space.
[0105] As a result, the user can obtain the virtual data corresponding to the specific position in the virtual space and the specific time point in the past, finally hear the corresponding sound, and can also transmit it to other users.
[0106] Although the structure and features of the present invention are described above based on the embodiments of the present invention, the present invention is not limited thereto, and various changes or modifications can be made within the concept and scope of the present invention. This is obvious to ordinary technicians in the technical field to which the present invention belongs. Therefore, such changes or modifications belong to the attached claims.
Claims
1. A method for converting sound in a virtual space, which is implemented by a sound conversion system in the virtual space, characterized in that: include: A step of forming a virtual atmosphere in the virtual space; The step of generating physical forces in the virtual space; and step of generating virtual data on said virtual atmosphere based on said physical forces, The virtual data is data on the state of the virtual atmosphere that changes due to the physical force.
2. The method for converting sound in a virtual space according to claim 1, characterized in that: Also includes: The step of specifying a predetermined position in the virtual space; The step of specifying the virtual data corresponding to the specified position; A step of converting the virtual data into fluctuation data; as well as The step of converting the wave data into sound.
3. The method for converting sound in a virtual space according to claim 2, characterized in that: The method also includes the step of transmitting the virtual data or the fluctuation data to other electronic devices.
4. The method for converting sound in a virtual space according to claim 2, characterized in that: The method further includes the step of changing the characteristics of the character based on the virtual data.
5. A sound conversion system in a virtual space, characterized in that: include: An atmosphere forming unit, forming a virtual atmosphere in a virtual space; a physical force generating unit for generating a physical force in the virtual space; and a virtual data generating unit that generates virtual data on the virtual atmosphere based on the physical force, The virtual data is data on the state of the virtual atmosphere that changes due to the physical force.
6. The sound conversion system in a virtual space according to claim 5, characterized in that: Also includes: A position specifying unit that specifies a predetermined position in the virtual space; a virtual data specifying unit that specifies the virtual data corresponding to the specified position; A fluctuation data conversion unit, converting the virtual data into fluctuation data; as well as The sound conversion unit converts the wave data into sound.
7. The sound conversion system in a virtual space according to claim 6, characterized in that: The device further includes a communication unit for transmitting the virtual data or the fluctuation data to other electronic devices.
8. The sound conversion system in a virtual space according to claim 6, characterized in that: The system further includes a characteristic changing unit configured to change the characteristics of the character based on the virtual data.
Citation Information
Patent Citations
Method for sound effect and apparatus for executing the method
KR102271395B1
