Control method of virtual reality head-mounted device, electronic device, and storage medium

By adjusting the speaker frequency response and setting up multiple speaker arrays, combined with preset data and reverberation sound field parameters, the problem of insufficient speaker presence in virtual reality headsets was solved, achieving a more realistic sound field and spatial experience.

CN114915881BActive Publication Date: 2026-04-14QINGDAO VIRTUAL REALITY RES INST CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-15
Publication Date
2026-04-14

AI Technical Summary

Technical Problem

The speakers in existing virtual reality headsets are located near the user's ears, resulting in a lower sense of immersion and difficulty in simulating a realistic sound field and sense of space.

Method used

By acquiring the relative position information between the speaker and the virtual sound source, the speaker frequency response is adjusted to match that of the virtual sound source. Multiple speakers are arranged in a ring array, and combined with preset datasets and reverberation field adjustment parameters, the position and environment of the virtual sound source are simulated.

Benefits of technology

It enhances the user's immersive and directional experience, expands the realistic sound field, and improves the spatial awareness and sound effect coordination of virtual reality headsets.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114915881B_ABST
    Figure CN114915881B_ABST
Patent Text Reader

Abstract

The application discloses a control method of a virtual reality head-mounted device, an electronic device and a storage medium, wherein the virtual reality head-mounted device is provided with a loudspeaker, and the control method comprises the following steps: acquiring relative position information between a virtual sound source and the loudspeaker; and adjusting the loudspeaker according to the relative position information, so that the frequency response of the loudspeaker relative to a reference point is the same as the frequency response of the virtual sound source relative to the reference point. According to the application, the relative position between the loudspeaker and the virtual sound source is used to adjust the loudspeaker, the virtual sound source is simulated by using the loudspeaker, the effect of expanding a real sound field and a sense of space is realized, and the on-the-spot experience of a user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of virtual reality technology, and more specifically, to a control method, electronic device, and storage medium for a virtual reality headset. Background Technology

[0002] For typical virtual reality headsets, such as VR headsets, there is usually a speaker on each side of the device. When a user puts on the VR headset, the speakers are located near the user's ears, and the sound emitted from the speakers near the user's ears is essentially stereo sound, resulting in a relatively low level of immersion for the user. Summary of the Invention

[0003] One object of the present invention is to provide a new technical solution for virtual reality headsets.

[0004] According to a first aspect of the present invention, a control method for a virtual reality headset is provided, the virtual reality headset being equipped with a speaker, the method comprising:

[0005] Obtain the relative position information between the virtual sound source and the speaker;

[0006] The speaker is adjusted according to the relative position information so that the frequency response of the speaker relative to the reference point is the same as the frequency response of the virtual sound source relative to the reference point; wherein the reference point is located at the head position of the wearer of the virtual reality headset.

[0007] Optionally, the virtual reality headset is equipped with multiple speakers arranged in a circular array. Each speaker corresponds to a virtual sound source and a reference point. Obtaining the relative position information between the virtual sound source and the speaker includes:

[0008] Obtain the virtual sound source corresponding to the speaker;

[0009] Obtain the relative position information between the speaker and the corresponding virtual sound source.

[0010] Optionally, obtaining the virtual sound source corresponding to the speaker includes:

[0011] Obtain the distance between the target sound source in the virtual scene and the mapped position of the speaker in the virtual scene;

[0012] The target sound source is used as a virtual sound source corresponding to the target loudspeaker, wherein the target loudspeaker is the loudspeaker that is closest to the target sound source.

[0013] Optionally, adjusting the speaker based on the relative position information includes:

[0014] The adjustment parameters corresponding to the relative position information are obtained from a preset dataset, wherein the preset dataset stores the correspondence between the relative position information and the speaker adjustment parameters;

[0015] Adjust the speaker according to the obtained adjustment parameters.

[0016] Optionally, adjusting the speaker based on the relative position information includes:

[0017] Obtain a preset dataset corresponding to the speaker to be adjusted, wherein the preset dataset stores the correspondence between relative position information and speaker adjustment parameters;

[0018] Obtain the adjustment parameters corresponding to the relative position information from the preset dataset corresponding to the speaker to be adjusted;

[0019] Adjust the speaker to be adjusted based on the obtained adjustment parameters.

[0020] Optionally, the preset dataset is determined in the following way:

[0021] Set the position of the reference point corresponding to the speaker;

[0022] The same audio signal is input to the speaker and the virtual sound source corresponding to the speaker;

[0023] The frequency response of the loudspeaker relative to the reference point is adjusted to determine the adjustment parameters of the loudspeaker, wherein, after adjustment, the frequency response of the loudspeaker relative to the reference point is the same as the frequency response of the virtual sound source relative to the reference point;

[0024] The relative position information between the virtual sound source and the speaker, along with the speaker's adjustment parameters, is stored in the preset dataset.

[0025] Optionally, setting the position of the reference point corresponding to the speaker includes:

[0026] Obtain the center point of the virtual reality headset;

[0027] Obtain the position of the speaker;

[0028] The reference point corresponding to the speaker is set at a position close to the speaker on the connecting line, which is the line connecting the center point of the virtual reality headset and the position of the speaker corresponding to the reference point.

[0029] Optionally, after adjusting the speaker according to the relative position information, the method further includes:

[0030] Obtain environmental information from a virtual scene;

[0031] Obtain the corresponding preset reverberation sound field adjustment parameters based on the environmental information;

[0032] The loudspeaker is adjusted according to the preset reverberation field adjustment parameters.

[0033] According to a second aspect of the present invention, an electronic device is provided, including a processor and a memory, the memory storing a program executable on the processor, the program, when executed by the processor, implementing the control method for a virtual reality head-mounted device as described in the first aspect of the present invention.

[0034] According to a third aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed, implements the control method for a virtual reality head-mounted device as described in the first aspect of the present invention.

[0035] According to one embodiment of this disclosure, the present invention adjusts the speaker based on the relative position between the speaker and the virtual sound source, using the speaker to simulate the virtual sound source, thereby expanding the realistic sound field and sense of space, and increasing the user's immersive experience.

[0036] Other features and advantages of the invention will become clear from the following detailed description of exemplary embodiments of the invention with reference to the accompanying drawings. Attached Figure Description

[0037] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the invention and, together with their description, serve to explain the principles of the invention.

[0038] Figure 1 This is a flowchart of a control method for a virtual reality headset in one embodiment of the present invention.

[0039] Figure 2 This is a schematic diagram of a virtual reality headset according to one embodiment of the present invention.

[0040] Figure 3 This is a functional block diagram of a virtual reality head-mounted device according to one embodiment of the present invention.

[0041] Figure 4 This is a functional block diagram of a virtual reality head-mounted device according to one embodiment of the present invention.

[0042] Figure 5 This is a functional block diagram of a virtual reality head-mounted device according to one embodiment of the present invention.

[0043] Figure 6 This is a functional block diagram of a virtual reality head-mounted device according to one embodiment of the present invention.

[0044] Figure 7 This is a schematic diagram of an electronic device according to one embodiment of the present invention. Detailed Implementation

[0045] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the invention.

[0046] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.

[0047] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0048] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0049] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0050] like Figure 1 As shown in the figure, an embodiment of the present invention introduces a control method for a virtual reality head-mounted device, wherein the virtual reality head-mounted device is equipped with a speaker, and the method includes steps S1-S2.

[0051] S1: Obtain the relative position information between the virtual sound source and the speaker.

[0052] S2: Adjust the speaker according to the relative position information so that the frequency response of the speaker relative to the reference point is the same as the frequency response of the virtual sound source relative to the reference point, wherein the reference point is located at the head position of the wearer of the virtual reality headset.

[0053] In this embodiment, when a user uses a virtual reality headset, the relative position between the speaker on the headset and the user is fixed. All sounds the user hears originate from this fixed location, affecting the user experience. To enhance the user's immersive experience, a speaker on the virtual reality headset is used to simulate a virtual sound source. The location of this virtual sound source is not fixed; it can be located far from the headset. When using the virtual reality headset, without a speaker simulating a virtual sound source, the user hears sounds emitted by the speaker, which is close to the user; this is near-field sound. With a speaker simulating a virtual sound source, the user hears sounds emanating from a distant virtual sound source; this is far-field sound.

[0054] This invention pre-tests the frequency response FR1 from the virtual sound source to a reference point, and also tests the frequency response FR2 from the speaker to the reference point. The reference point can be the position of the user's head when using a virtual reality headset. Because the distance from the virtual sound source to the reference point is different from the distance from the speaker to the reference point, the frequency response FR1 from the virtual sound source to the reference point is also different from the frequency response FR2 from the speaker to the reference point, resulting in different sound effects heard by the user at the reference point. A mapping function is defined between the speaker and the virtual sound source, which can be understood as FR1-FR2. The frequency response from the speaker to the reference point is adjusted using this mapping function. Subtracting the mapping function from the speaker's frequency response to the reference point results in the adjusted frequency response being the same as the frequency response from the virtual sound source to the reference point. This allows the speaker to replace the virtual sound source, thereby achieving the effect of enlarging the realistic sound field and spatial sense.

[0055] The frequency response of virtual sound sources to the reference point varies depending on their location. For example, the frequency response of the first virtual sound source to the reference point is the first frequency response, and the frequency response of the second virtual sound source to the reference point is the second frequency response. The first virtual sound source is farther from the speaker, while the second virtual sound source is closer to the speaker. By adjusting the frequency response of the speaker to the reference point to be the same as the first frequency response, the speaker can be used to simulate the first virtual sound source, which is farther away. Conversely, by adjusting the frequency response of the speaker to the reference point to be the same as the second frequency response, the speaker can be used to simulate the second virtual sound source, which is closer to the speaker.

[0056] In one example, a user plays a game using the virtual reality headset. In the game scene, a car is starting at a distance from the user, making a sound. The virtual reality headset's speakers are used to simulate this sound source. When the user uses the virtual device, the speakers are positioned near the user's ears. By adjusting the speaker's frequency response, the virtual sound source is simulated, making the user hear the car starting sound coming from a distance.

[0057] This invention adjusts the speaker based on its relative position to the virtual sound source, using the speaker to simulate the virtual sound source and achieve an effect of enlarging the realistic sound field and spatial sense. Furthermore, the frequency response of the speaker to the reference point can be adjusted according to the user's needs, using the speaker to simulate the virtual sound source at different distances to meet user requirements.

[0058] In one embodiment of the present invention, the virtual reality head-mounted device is provided with a plurality of speakers, which are arranged in a circular array on the virtual reality head-mounted device. Each speaker corresponds to a virtual sound source and a reference point. Step S1 includes: acquiring the virtual sound source corresponding to the speaker and acquiring the relative position information between the speaker and the corresponding virtual sound source.

[0059] In various scenarios, users may hear sounds from different directions. For example, if someone is speaking behind the user, the sound will come from behind. Conversely, if someone is speaking to the user's right, the sound will come from the right. Movies often feature dialogue scenes, and when watching movies with a virtual reality headset, it's difficult to distinguish the direction of sound if using a standard stereo headset, which negatively impacts the user experience.

[0060] In one example, such as Figure 2 As shown, the virtual reality headset 1 has five speakers 2 arranged in a circular array. When a user wears the virtual reality headset 1, the five speakers 2 surround the user's head, positioned directly in front, to the left front, to the left rear, to the right front, and to the right rear. Each speaker 2 corresponds to a virtual sound source 4; for example, the speaker directly in front corresponds to the virtual sound source directly in front, the speaker to the left front corresponds to the virtual sound source to the left front, the speaker to the left rear corresponds to the virtual sound source to the left rear, the speaker to the right front corresponds to the virtual sound source to the right front, and the speaker to the right rear corresponds to the virtual sound source to the right rear. The user can hear sounds coming from different directions.

[0061] This invention expands the two-channel signal into a multi-channel signal by setting multiple speakers in a virtual reality headset. Users can hear sounds coming from multiple directions. When users watch movies or play games using the virtual reality headset, the sound effects are matched with the virtual scene, improving the user's directional experience and enhancing the user's sense of presence.

[0062] In one embodiment of the present invention, obtaining the virtual sound source corresponding to the speaker includes: obtaining the distance between the target sound source in the virtual scene and the mapped position of the speaker in the virtual scene; and using the target sound source as the virtual sound source corresponding to the target speaker, wherein the target speaker is the speaker that is closest to the target sound source.

[0063] In a virtual environment, there is a certain distance between the target sound source and the user. For example, if the target sound source is 10 meters away from the user, then speakers are needed to simulate the target sound source 10 meters away from the user. In this embodiment, multiple speakers are provided on the virtual reality headset. After the user puts on the virtual reality headset, the multiple speakers surround the user's head. In the virtual environment, the mapping of the speakers in the virtual environment also surrounds the user's head.

[0064] In one example, the virtual reality headset has five speakers: a front speaker, a left front speaker, a left rear speaker, a right front speaker, and a right rear speaker. In the virtual scene, the front speaker is mapped to be directly in front of the user, the left front speaker to the left front, the left rear speaker to the left rear, the right front speaker to the right front, and the right rear speaker to the right rear.

[0065] When a user plays a game using a virtual reality headset, an explosion occurs directly in front of the user in the game scene. The location of the explosion is the location of the target sound source. Since the explosion occurs directly in front, the virtual sound source mapped to the front speaker is the closest to the target sound source in the virtual scene. Therefore, the target sound source is set as the virtual sound source corresponding to the front speaker.

[0066] If the explosion occurs to the user's left rear in the game scene, then the left rear speaker is mapped to the target sound source in the virtual scene, and the target sound source is set as the virtual sound source corresponding to the left rear speaker.

[0067] This invention uses target sound sources in a virtual scene as virtual sound sources, allowing sound effects to match the virtual scene, thereby improving the user's sense of direction and enhancing the user's sense of presence.

[0068] In one embodiment of the present invention, step S2 includes: obtaining adjustment parameters corresponding to the relative position information from a preset dataset, wherein the preset dataset stores the correspondence between the relative position information and the speaker adjustment parameters; and adjusting the speaker according to the obtained adjustment parameters.

[0069] This invention includes a preset dataset in a virtual reality headset, containing speaker adjustment parameters. The frequency response of the speaker to a reference point is pre-tested, and the frequency response of the virtual sound source to the reference point is tested multiple times at different positions, calculating the speaker adjustment parameters. When the relative position of the speaker and the virtual sound source changes, the speaker adjustment parameters should also change. The preset dataset stores the relative position of the speaker and the virtual sound source in correspondence with the speaker adjustment parameters; for example, when the speaker and the virtual sound source are in a first relative position, the speaker adjustment parameters are the first adjustment parameters; when the speaker and the virtual sound source are in a second relative position, the speaker adjustment parameters are the second adjustment parameters.

[0070] For example, when a user is using a virtual reality headset in a bedroom, the speaker and the virtual sound source are in a first relative position. When the speaker needs to be adjusted, a first adjustment parameter corresponding to the first relative position is obtained from a preset dataset. The speaker is then adjusted according to the obtained first adjustment parameter so that the frequency response of the speaker relative to the reference point is the same as the frequency response of the virtual sound source relative to the reference point.

[0071] This invention obtains the speaker adjustment parameters through pre-testing. When using a virtual reality headset, the corresponding adjustment parameters are obtained from a preset dataset based on the relative position of the speaker and the virtual sound source. This eliminates the need for complex calculations by the virtual reality headset, effectively increasing its operating speed and improving the user experience.

[0072] In one embodiment of the present invention, the virtual reality head-mounted device is provided with multiple speakers, which are arranged in a circular array on the virtual reality head-mounted device. Each speaker corresponds to a virtual sound source and a reference point. Step S2 includes: obtaining a preset dataset corresponding to the speaker to be adjusted, wherein the preset dataset stores the correspondence between relative position information and speaker adjustment parameters; and obtaining the adjustment parameters corresponding to the relative position information from the preset dataset corresponding to the speaker to be adjusted.

[0073] In this invention, multiple speakers are provided on a virtual reality headset. When a user uses the virtual reality headset, each speaker simulates its corresponding virtual sound source. During the pre-testing process, the frequency response of the speaker to a reference point and the frequency response of the virtual sound source corresponding to that speaker to the reference point are tested, and the adjustment parameters of the speaker are calculated.

[0074] In one example, a virtual reality headset has five speakers: a first speaker, a second speaker, a third speaker, a fourth speaker, and a fifth speaker. These five speakers correspond to a first virtual sound source, a second virtual sound source, a third virtual sound source, a fourth virtual sound source, and a fifth virtual sound source, respectively. For the first speaker, a first dataset is obtained through pre-testing. This first dataset stores the relative positional relationships between the first speaker and the first virtual sound source, and the speaker adjustment parameters stored in the first dataset are the adjustment parameters of the first speaker corresponding to the relative positional relationships. For the second, third, fourth, and fifth speakers, second, third, fourth, and fifth datasets are obtained after pre-testing, respectively.

[0075] For example, when a user needs to adjust the first speaker while using a virtual reality headset, the first dataset corresponding to the first speaker is first obtained. Then, the corresponding adjustment parameters of the first speaker are obtained from the first dataset based on the relative position information of the first speaker and the first virtual sound source. The first speaker is adjusted according to the obtained adjustment parameters so that the frequency response of the first speaker relative to the reference point is the same as the frequency response of the first virtual sound source relative to the reference point, and the first speaker is used to simulate the first virtual sound source.

[0076] This invention utilizes multiple speakers within a virtual reality headset. By pre-testing and obtaining a dataset corresponding to each speaker, and then retrieving speaker adjustment parameters from this dataset during headset use, users can hear sounds from various directions. This allows sound effects to complement the virtual scene, enhancing the user's directional experience and immersive experience. Furthermore, it eliminates the need for complex calculations within the virtual reality headset, effectively increasing its operating speed and improving the user experience.

[0077] In one embodiment of the present invention, the preset dataset is determined by: setting the position of a reference point corresponding to the speaker; inputting the same audio signal to the speaker and the virtual sound source corresponding to the speaker; adjusting the frequency response of the speaker relative to the reference point to determine the adjustment parameters of the speaker, wherein, after adjustment, the frequency response of the speaker relative to the reference point and the frequency response of the virtual sound source relative to the reference point are the same; and storing the relative position information between the virtual sound source and the speaker and the adjustment parameters of the speaker in the preset dataset.

[0078] Multiple speakers are installed in the virtual reality headset, and a preset dataset needs to be tested for each speaker separately. First, select a speaker and set the position of the reference point corresponding to that speaker. Input the same audio signal to both the speaker and the corresponding virtual sound source. In actual testing, a sound-emitting device, such as a loudspeaker or speaker enclosure, can be installed at the location of the virtual sound source. If the frequency response of the speaker relative to the reference point differs from that of the virtual sound source relative to the reference point, it indicates that the sound effect heard by the user from the speaker at the reference point is different from the sound effect heard from the virtual sound source. Adjust the speaker's configuration parameters until the frequency response of the speaker relative to the reference point is the same as that of the virtual sound source. If the frequency response of the speaker relative to the reference point is the same as that of the virtual sound source, it indicates that the sound effect heard by the user from the speaker at the reference point is the same as the sound effect heard from the virtual sound source. Then, save the speaker's current configuration parameters as the speaker's adjustment parameters, corresponding to the relative position information.

[0079] In one embodiment of the present invention, setting the position of the reference point corresponding to the speaker includes: obtaining the center point of the virtual reality headset; obtaining the position of the speaker; and setting the reference point corresponding to the speaker at a position close to the speaker on a connecting line, wherein the connecting line is the line between the center point of the virtual reality headset and the position of the speaker.

[0080] This invention corrects the frequency response of the speaker in the near field by setting a reference point close to the speaker, thereby expanding the realistic sound field and sense of space.

[0081] In one embodiment of the present invention, after adjusting the speaker according to the relative position information, the method further includes: acquiring environmental information in a virtual scene, acquiring corresponding preset reverberation field adjustment parameters according to the environmental information, and adjusting the speaker according to the preset reverberation field adjustment parameters.

[0082] During the actual propagation of sound, sound waves are reflected when they encounter obstacles, creating reverberation. To make the sound heard by users when using virtual reality headsets more realistic, a reverberant sound field can be added. The required reverberation sound field varies depending on the virtual scene. The reverberation sound field adjustment parameters of the speakers are pre-tested in different virtual scenes. When using the virtual reality headset, environmental information in the virtual scene is acquired. This environmental information may include the size, shape, and distribution of obstacles in the virtual scene. Based on this environmental information, the pre-tested reverberation sound field adjustment parameters are obtained, and the speakers are adjusted accordingly.

[0083] This invention pre-tests reverberation sound field adjustment parameters under various virtual scenarios and saves the corresponding environmental information of the virtual scenarios and reverberation sound field adjustment parameters. For example, in a spacious virtual scenario, the user is on flat outdoor ground with few obstacles, and the pre-tested reverberation sound field adjustment parameters are designated as the first reverberation sound field adjustment parameters. Conversely, in a denser virtual scenario, the user is in a bustling urban area with many tall buildings and obstacles, and the pre-tested reverberation sound field adjustment parameters are designated as the second reverberation sound field adjustment parameters. When using a virtual reality headset, if the user is in a spacious virtual scenario, the speakers can be adjusted according to the first reverberation sound field adjustment parameters; if the user is in a denser virtual scenario, the speakers can be adjusted according to the second reverberation sound field parameters.

[0084] This invention simulates a wider sound field by adding a reverberant sound field. Different reverberation parameters are used to adjust the speakers in different virtual scenes, making the sound heard by users through virtual reality headsets more realistic and improving the user experience.

[0085] like Figure 3 As shown in the figure, this embodiment of the invention introduces a virtual reality headset, which includes a relative position information acquisition module 101 and a speaker adjustment module 102. The relative position information acquisition module 101 is used to acquire the relative position information between the virtual sound source and the speaker. The speaker adjustment module 102 is used to adjust the speaker according to the relative position information, so that the frequency response of the speaker relative to a reference point is the same as the frequency response of the virtual sound source relative to the reference point.

[0086] The frequency response of virtual sound sources to the reference point varies depending on their location. For example, the frequency response of the first virtual sound source to the reference point is the first frequency response, and the frequency response of the second virtual sound source to the reference point is the second frequency response. The first virtual sound source is farther from the speaker, while the second virtual sound source is closer to the speaker. By adjusting the frequency response of the speaker to the reference point to be the same as the first frequency response, the speaker can be used to simulate the first virtual sound source, which is farther away. Conversely, by adjusting the frequency response of the speaker to the reference point to be the same as the second frequency response, the speaker can be used to simulate the second virtual sound source, which is closer to the speaker.

[0087] This invention adjusts the speaker based on its relative position to the virtual sound source, using the speaker to simulate the virtual sound source and achieve an effect of enlarging the realistic sound field and spatial sense. Furthermore, the frequency response of the speaker to the reference point can be adjusted according to the user's needs, using the speaker to simulate the virtual sound source at different distances to meet user requirements.

[0088] like Figure 4As shown, in one embodiment of the present invention, the virtual reality head-mounted device includes a virtual sound source acquisition module 103, which is used to acquire a virtual sound source corresponding to the speaker.

[0089] like Figure 5 As shown, in one embodiment of the present invention, the virtual reality head-mounted device includes a distance acquisition module 104, which is used to acquire the distance between a target sound source in the virtual scene and the mapped position of the speaker in the virtual scene.

[0090] In various scenarios, users may hear sounds from different directions. For example, if someone is speaking behind the user, the sound will come from behind. Conversely, if someone is speaking to the user's right, the sound will come from the right. Movies often feature dialogue scenes, and when watching movies with a virtual reality headset, it's difficult to distinguish the direction of sound if using a standard stereo headset, which negatively impacts the user experience.

[0091] This invention expands the two-channel signal into a multi-channel signal by setting multiple speakers in a virtual reality headset. Users can hear sounds coming from multiple directions. When users watch movies or play games using the virtual reality headset, the sound effects are matched with the virtual scene, improving the user's directional experience and enhancing the user's sense of presence.

[0092] like Figure 6 As shown, in one embodiment of the present invention, the virtual reality headset includes an environmental information acquisition module 105 and a reverberation parameter acquisition module 106. The environmental information acquisition module 105 is used to acquire environmental information in the virtual scene. The reverberation parameter acquisition module 106 is used to acquire corresponding preset reverberation sound field adjustment parameters based on the environmental information.

[0093] During the actual propagation of sound, sound waves are reflected when they encounter obstacles, creating reverberation. To make the sound heard by users when using virtual reality headsets more realistic, a reverberant sound field can be added. The required reverberation sound field varies depending on the virtual scene. The reverberation sound field adjustment parameters of the speakers are pre-tested in different virtual scenes. When using the virtual reality headset, environmental information in the virtual scene is acquired. This environmental information may include the size, shape, and distribution of obstacles in the virtual scene. Based on this environmental information, the pre-tested reverberation sound field adjustment parameters are obtained, and the speakers are adjusted accordingly.

[0094] This invention, by incorporating a reverberant sound field, can simulate a wider sound field, making the sounds heard by users through virtual reality headsets more realistic and improving the user experience.

[0095] like Figure 7 As shown in the figure, an embodiment of the present invention introduces an electronic device, including a processor 201 and a memory 202. The memory 202 stores a program that can run on the processor 201. When the program is executed by the processor 201, it implements the control method of the virtual reality head-mounted device as described in any embodiment of the present invention.

[0096] This invention also introduces a computer-readable storage medium storing a computer program that, when executed, implements the control method for a virtual reality head-mounted device as described in any embodiment of this invention.

[0097] While specific embodiments of the invention have been described in detail by way of examples, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of the invention. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.

Claims

1. A control method for a virtual reality headset, characterized in that, The virtual reality headset is equipped with a speaker, and the method includes: Obtain the relative position information between the virtual sound source and the speaker; The speaker is adjusted according to the relative position information so that the frequency response of the speaker relative to the reference point is the same as the frequency response of the virtual sound source relative to the reference point; wherein the reference point is located at the head position of the wearer of the virtual reality headset; The virtual reality headset is equipped with multiple speakers arranged in a circular array. Each speaker corresponds to a virtual sound source and a reference point. The reference point is located on the line connecting the center point of the virtual reality headset and the speaker, and is close to the speaker. Obtaining the relative position information between the virtual sound source and the speaker includes: Obtain the virtual sound source corresponding to the speaker; Obtain the relative position information between the speaker and the corresponding virtual sound source; The step of adjusting the speaker based on the relative position information includes: Obtain a preset dataset corresponding to the speaker to be adjusted, wherein the preset dataset stores the correspondence between relative position information and speaker adjustment parameters; Obtain the adjustment parameters corresponding to the relative position information from the preset dataset corresponding to the speaker to be adjusted; Adjust the speaker to be adjusted based on the obtained adjustment parameters.

2. The control method according to claim 1, characterized in that, The step of acquiring the virtual sound source corresponding to the speaker includes: Obtain the distance between the target sound source in the virtual scene and the mapped position of the speaker in the virtual scene; The target sound source is used as a virtual sound source corresponding to the target loudspeaker, wherein the target loudspeaker is the loudspeaker that is closest to the target sound source.

3. The control method according to claim 1, characterized in that, The preset dataset is determined in the following way: Set the position of the reference point corresponding to the speaker; The same audio signal is input to the speaker and the virtual sound source corresponding to the speaker; The frequency response of the loudspeaker relative to the reference point is adjusted to determine the adjustment parameters of the loudspeaker, wherein, after adjustment, the frequency response of the loudspeaker relative to the reference point is the same as the frequency response of the virtual sound source relative to the reference point; The relative position information between the virtual sound source and the speaker, along with the speaker's adjustment parameters, is stored in the preset dataset.

4. The control method according to claim 3, characterized in that, Setting the position of the reference point corresponding to the speaker includes: Obtain the center point of the virtual reality headset; Obtain the position of the speaker; The reference point corresponding to the speaker is set at a position close to the speaker on the connecting line, which is the line connecting the center point of the virtual reality headset and the position of the speaker.

5. The control method according to claim 1, characterized in that, After adjusting the speaker according to the relative position information, the method further includes: Obtain environmental information from a virtual scene; Obtain the corresponding preset reverberation sound field adjustment parameters based on the environmental information; The loudspeaker is adjusted according to the preset reverberation field adjustment parameters.

6. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program that can run on the processor, the program being executed by the processor to implement the control method for a virtual reality headset as described in any one of claims 1-5.

7. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed, implements the control method for a virtual reality headset as described in any one of claims 1-5.

Citation Information

Patent Citations

  • Sound effect optimization method and device, electronic equipment and storage medium

    CN111372167A

  • Mapping virtual sound sources to physical speakers in extended reality applications

    CN111459444A

  • Apparatus, method, sound system

    CN113632505A