Audio playback optimization methods, devices, electronic devices, and readable storage media

Abstract

This application discloses an audio playback optimization method, apparatus, electronic device, and readable storage medium, applied to extended reality devices. The audio playback optimization method includes: acquiring resonant frequency points in a target audio signal based on the extended reality device; converting the target audio signal into a playable audio signal by optimizing the resonant frequency points, wherein the playable audio signal consists of frequency points without resonant capabilities; and playing audio on the extended reality device based on the playable audio signal. This application solves the technical problem of high development costs for extended reality devices.

Description

Technical Field

[0001] This application relates to the field of audio processing technology, and in particular to an audio playback optimization method, apparatus, electronic device, and readable storage medium. Background Technology

[0002] With the continuous development of technology, XR (Extended Reality) devices are widely used in people's daily lives. At the same time, considering the user experience, the vibration problem induced by the acoustic devices built into extended reality devices has become an urgent problem for device manufacturers to solve.

[0003] Currently, the vibrations generated by extended reality devices during use can affect the operation of optical engines and other equipment. Therefore, vibration reduction structures are usually added inside the extended reality devices to reduce vibration. However, since the vibration reduction structures rely on expensive hardware, the development cost of current extended reality devices is high. Summary of the Invention

[0004] The main objective of this application is to provide an audio playback optimization method, apparatus, electronic device, and readable storage medium, aiming to solve the technical problem of high development costs of extended reality devices in the prior art.

[0005] To achieve the above objectives, this application provides an audio playback optimization method applied to an extended reality device, the audio playback optimization method comprising:

[0006] Based on the extended reality device, the frequency points to be optimized in the target audio signal that have resonant capabilities are obtained;

[0007] By optimizing the frequency points to be optimized, the target audio signal is converted into an audio signal to be played, wherein the audio signal to be played consists of frequency points that do not have resonance capability;

[0008] The audio signal to be played is played on the extended reality device.

[0009] Optionally, the extended reality device includes a vibration sensor and a speaker, the target audio signal includes a first target audio signal, and the step of obtaining the resonant frequency points to be optimized in the target audio signal based on the extended reality device includes:

[0010] The first target audio signal is output through the speaker, and the vibration amplitude value of the first target audio signal is obtained based on the vibration sensor;

[0011] If the vibration amplitude value is detected to be greater than the preset amplitude threshold, then the frequency point in the first target audio signal that generates the vibration amplitude value is taken as the frequency point to be optimized.

[0012] Optionally, the extended reality device includes a speaker, the target audio signal includes a second target audio signal, and the step of obtaining the resonant frequency points to be optimized in the target audio signal based on the extended reality device includes:

[0013] Before the speaker outputs the second target audio signal, the initial frequency point in the second target audio signal is obtained;

[0014] Check the resonant frequency table to see if there is a resonant frequency that is the same as the initial frequency.

[0015] If a resonant frequency point with the same initial frequency point is found, then the initial frequency point is taken as the frequency point to be optimized.

[0016] Optionally, the extended reality device includes a preset display interface, and the step of converting the target audio signal into a playable audio signal by optimizing the frequency point to be optimized includes:

[0017] Determine the frequency optimization parameters for the frequency point to be optimized;

[0018] Based on the optimization instructions input by the user on the preset display interface, the optimization frequency point is optimized by using the first parameter optimization value corresponding to the frequency point optimization parameter, thereby converting the target audio signal into the audio signal to be played.

[0019] Optionally, the step of converting the target audio signal into a playable audio signal by optimizing the frequency point to be optimized includes:

[0020] Determine the frequency optimization parameters for the frequency point to be optimized;

[0021] Based on the frequency point optimization parameters, the corresponding second parameter optimization value is queried in the preset parameter mapping table;

[0022] The frequency point parameter is optimized by using the second parameter optimization value, and the target audio signal is converted into the audio signal to be played.

[0023] Optionally, the frequency point to be optimized includes at least one parameter optimization frequency point, and the step of determining the frequency point optimization parameter of the frequency point to be optimized includes:

[0024] Use the frequency values ​​of each of the aforementioned optimized frequency points as the frequency optimization parameters of the frequency point to be optimized; and / or

[0025] The vibration amplitude value of the frequency point to be optimized is used as the frequency optimization parameter of the frequency point to be optimized.

[0026] Optionally, after the step of acquiring the resonant frequency points to be optimized in the target audio signal based on the extended reality device, the audio playback optimization method further includes:

[0027] Check if the frequency to be optimized exists in the resonant frequency table;

[0028] If it does not exist, the frequency point to be optimized is recorded in the resonant frequency point table.

[0029] To achieve the above objectives, this application also provides an audio playback optimization device for use in an extended reality device, the audio playback optimization device comprising:

[0030] The acquisition module is used to acquire the frequency points to be optimized that have resonant capabilities in the target audio signal based on the extended reality device;

[0031] An optimization module is used to convert the target audio signal into a playable audio signal by optimizing the frequency point to be optimized.

[0032] A playback module is used to play audio on the extended reality device according to the audio signal to be played.

[0033] Optionally, the extended reality device includes a vibration sensor and a speaker, the target audio signal includes a first target audio signal, and the acquisition module is further configured to:

[0034] The first target audio signal is output through the speaker, and the vibration amplitude value of the first target audio signal is obtained based on the vibration sensor;

[0035] If the vibration amplitude value is detected to be greater than the preset amplitude threshold, then the frequency point in the first target audio signal that generates the vibration amplitude value is taken as the frequency point to be optimized.

[0036] Optionally, the extended reality device includes a speaker, the target audio signal includes a second target audio signal, and the acquisition module is further configured to:

[0037] Before the speaker outputs the second target audio signal, the initial frequency point in the second target audio signal is obtained;

[0038] Check the resonant frequency table to see if there is a resonant frequency that is the same as the initial frequency.

[0039] If a resonant frequency point with the same initial frequency point is found, then the initial frequency point is taken as the frequency point to be optimized.

[0040] Optionally, the extended reality device includes a preset display interface, and the optimization module is further configured to:

[0041] Determine the frequency optimization parameters for the frequency point to be optimized;

[0042] Based on the optimization instructions input by the user on the preset display interface, the optimization frequency point is optimized by using the first parameter optimization value corresponding to the frequency point optimization parameter, thereby converting the target audio signal into the audio signal to be played.

[0043] Optionally, the optimization module is further configured to:

[0044] Determine the frequency optimization parameters for the frequency point to be optimized;

[0045] Based on the frequency point optimization parameters, the corresponding second parameter optimization value is queried in the preset parameter mapping table;

[0046] The frequency point parameter is optimized by using the second parameter optimization value, and the target audio signal is converted into the audio signal to be played.

[0047] Optionally, the frequency point to be optimized includes at least one parameter optimization frequency point, and the optimization module is further used for:

[0048] Use the frequency values ​​of each of the aforementioned optimized frequency points as the frequency optimization parameters of the frequency point to be optimized; and / or

[0049] The vibration amplitude value of the frequency point to be optimized is used as the frequency optimization parameter of the frequency point to be optimized.

[0050] Optionally, the audio playback optimization device is further configured to:

[0051] Check if the frequency to be optimized exists in the resonant frequency table;

[0052] If it does not exist, the frequency point to be optimized is recorded in the resonant frequency point table.

[0053] This application also provides an electronic device, the electronic device comprising: at least one processor and a memory communicatively connected to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the steps of the audio playback optimization method described above.

[0054] This application also provides a computer-readable storage medium storing a program that implements an audio playback optimization method. When the program is executed by a processor, it implements the steps of the audio playback optimization method as described above.

[0055] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the audio playback optimization method described above.

[0056] This application provides an audio playback optimization method, apparatus, electronic device, and readable storage medium, applied to an extended reality device. Specifically, it obtains resonant frequency points in a target audio signal from the extended reality device; optimizes the resonant frequency points to convert the target audio signal into a playable audio signal, wherein the playable audio signal consists of frequency points without resonant capabilities; and plays the audio signal in the extended reality device according to the playable audio signal.

[0057] When playing audio through an extended reality device, this application first obtains the frequency points with resonant capabilities in the target audio signal to be optimized. That is, it achieves the purpose of locating the frequency points that affect the user experience during the use of the extended reality device. Then, by optimizing the frequency points to be optimized, an audio signal to be played is obtained, which consists of frequency points without resonant capabilities. Finally, the audio signal to be played is played through the extended reality device. Since the frequency points in the audio signal to be played do not have resonant capabilities, no resonance will be generated that affects the user experience, thereby reducing the vibration generated when playing audio through the extended reality device.

[0058] Because extended reality devices can perform frequency optimization autonomously, they can optimize frequencies in the target audio that have resonance capabilities to frequencies that do not have resonance capabilities. This ensures that when audio is played on the extended reality device based on the target audio signal, there will be no resonance between the optical engine and the extended reality device. In other words, the goal of vibration reduction of the extended reality device is achieved without adding a vibration reduction structure.

[0059] Based on this, this application autonomously acquires the resonant frequencies of the target audio signal through an extended reality device, and then optimizes these frequencies to obtain a playback audio signal composed of frequencies lacking resonant capabilities. Finally, the audio is played on the extended reality device based on this playback audio signal. This achieves autonomous optimization of the audio signal's frequencies at the software level, thereby reducing vibration during use of the extended reality device. It avoids adding vibration-damping structures to the extended reality device to reduce vibration. In other words, it overcomes the technical drawback of vibration-damping structures relying on expensive hardware, thus reducing the development cost of the extended reality device. Attached Figure Description

[0060] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0061] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0062] Figure 1 A flowchart illustrating the audio playback optimization method provided in Embodiment 1 of this application;

[0063] Figure 2 A flowchart illustrating the optimization of the frequency point to be optimized in the audio playback optimization method provided in Embodiment 1 of this application;

[0064] Figure 3 This is a flowchart illustrating the audio playback optimization method provided in Embodiment 2 of this application;

[0065] Figure 4 This is a schematic diagram of the audio playback optimization device provided in Embodiment 3 of this application;

[0066] Figure 5 This is a schematic diagram of the structure of the electronic device provided in Embodiment 4 of this application.

[0067] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0068] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0069] Example 1

[0070] With the development of technology, XR (Extended Reality) devices are being used more and more widely in people's daily lives. People can use XR devices for leisure, work, and communication. However, considering the user experience, vibration caused by acoustic devices is becoming one of the key issues to be addressed. Currently, vibration caused by acoustic devices in some XR devices has affected the use of optical engines and other equipment. Therefore, vibration is usually reduced by adding vibration damping structures. However, too many vibration damping structures will increase the weight of XR devices and significantly increase the development cost. Therefore, there is an urgent need for a method that can replace the function of vibration damping structures in XR devices.

[0071] This application provides an audio playback optimization method applied to an extended reality device. In the first embodiment of the audio playback optimization method of this application, refer to... Figure 1 The audio playback optimization method includes:

[0072] Step S10: Based on the extended reality device, obtain the frequency points to be optimized in the target audio signal that have resonance capability;

[0073] Step S20: By optimizing the frequency points to be optimized, the target audio signal is converted into an audio signal to be played, wherein the audio signal to be played consists of frequency points that do not have resonance capability;

[0074] Step S30: Play audio on the extended reality device according to the audio signal to be played.

[0075] In this embodiment, it should be noted that, although Figure 1 The logical order is shown, but in some cases, the steps shown or described can be performed in a different order than that shown here. The audio playback optimization method can be executed in scenarios where audio is played through an extended reality device. Specifically, the scenario can be one where the extended reality device actively plays audio, such as timed program playback, or one where the extended reality device interacts with the user, such as when the user selects a program to watch. The extended reality device can be a device with audio playback capabilities and extended reality technology. The target audio signal is used to characterize an audio signal carrying a resonant frequency point. Specifically, it can be a user-input audio signal or an audio signal obtained based on an audio library. After receiving the target audio signal, the extended reality device can use its built-in... The audio processing system processes audio signals to optimize audio playback. For example, in one feasible approach, assuming a user selects a program to play on an extended reality device (ARD) via its human-computer interface, the audio processing system, upon receiving the target audio signal corresponding to the program, will detect whether there are any frequencies in the target audio signal that need optimization. These frequencies are those that need optimization and possess resonance capability; specifically, there can be one or more. Resonance capability refers to the ability to generate resonance between the optical engine and the housing of the ARD. Resonance between the optical engine and the housing will affect the user's experience using the optical engine. Therefore, optimization can be performed on the frequencies to be optimized to eliminate the resonance phenomenon.

[0076] Additionally, it should be noted that the detection of the frequency point to be optimized can be achieved through a frequency point detection device. After detecting the frequency point value of the frequency point in the target audio signal, the relationship between the frequency point value and the preset frequency point threshold can be used to determine whether the frequency point is the frequency point to be optimized. After determining the frequency point to be optimized, the audio signal to be played can be obtained by optimizing the frequency point. The audio signal to be played is used to represent the audio signal waiting to be played. The frequency points in the audio signal to be played do not have resonance capability. That is, when playing audio based on the audio signal to be played, no resonance phenomenon will occur between the optical engine of the extended reality device and the casing of the extended reality device. For example, in one feasible method, the specific way to optimize the frequency point to be optimized is to lower the tuning parameter of the frequency point to be optimized, that is, to reduce the volume of the audio playback, thereby eliminating the resonance phenomenon.

[0077] As an example, steps S10 to S30 include: acquiring a target audio signal input by the user based on the extended reality device; identifying frequency points in the target audio signal that are greater than a preset frequency threshold as frequencies with resonance capability to be optimized; converting the target audio signal into an audio signal to be played by lowering the tuning parameters of the frequencies to be optimized, wherein the audio signal to be played consists of frequencies without resonance capability; and playing audio on the extended reality device according to the audio signal to be played. Since the target audio signal carries frequencies with resonance capability, the audio processing system detects these frequencies as frequencies to be optimized, and by lowering the tuning parameters of these frequencies, the target audio signal is converted into an audio signal to be played composed of frequencies without resonance capability. Therefore, when the audio is played on the extended reality device according to the audio signal to be played, no resonance phenomenon occurs between the optical engine and the casing of the extended reality device, i.e., no resonance affecting the user experience occurs. This reduces vibration during audio playback on the extended reality device, thus achieving vibration reduction of the extended reality device without adding a vibration damping structure.

[0078] The extended reality device includes a vibration sensor and a speaker, the target audio signal includes a first target audio signal, and the step of obtaining the resonant frequency points to be optimized in the target audio signal based on the extended reality device includes:

[0079] Step A10: Output the first target audio signal through the speaker, and obtain the vibration amplitude value of the first target audio signal based on the vibration sensor;

[0080] Step A20: If the vibration amplitude value is detected to be greater than the preset amplitude threshold, then the frequency point in the first target audio signal that generates the vibration amplitude value is taken as the frequency point to be optimized.

[0081] In this embodiment, it should be noted that different audio signals cause different vibration frequencies, and simply lowering the volume to solve the resonance problem will greatly affect the user experience. Therefore, by adding hardware such as vibration sensors and speakers, the accuracy issues caused by the difference in vibration frequencies and the user experience can be considered when optimizing audio playback. Specifically, one or more vibration sensors can be placed near the optical engine. The vibration sensor can be a VPU (Vibration Amplitude Sensor). For example, the vibration sensor can be placed within 15mm of the optical engine. By collecting resonance points through the vibration sensor, EQ (Equalizer) can be applied to the resonance points to reduce the impact of vibration on the optical engine without affecting the user experience.

[0082] Additionally, it should be noted that, due to the difference in processing difficulty between electrical signals and acoustic signals, the received audio electrical signals can be converted into audio acoustic signals via a speaker, thereby enabling corresponding audio playback optimization processing. For example, in one feasible approach, the initial audio signal received by the extended reality device is an electrical signal, which is then converted into an acoustic signal via a speaker, namely the first target audio signal. The first target audio signal is used to characterize the audio signal output via the speaker of the extended reality device. After the first target audio signal is output, a vibration sensor is set at the optical engine or other locations with significant vibration. Based on the change in vibration state, the vibration amplitude value at the corresponding location is detected. If the vibration amplitude value is too large, the frequency point of that amplitude is fed back to the audio processing system so that the audio processing system can use it as the frequency point to be optimized.

[0083] As an example, steps A10 to A20 include: converting an initial audio signal into a first target audio signal through the loudspeaker and outputting the first target audio signal; detecting the vibration amplitude value generated by the first audio signal based on the vibration sensor; detecting whether the vibration amplitude value is greater than a preset amplitude threshold; if the vibration amplitude value is detected to be greater than the preset amplitude threshold, then taking the frequency point in the first target audio signal that generates the vibration amplitude value as the frequency point to be optimized. Since the sensor can convert electrical signals into sound signals, the signal processing difficulty is reduced. At the same time, by detecting the amplitude value through the vibration sensor, the frequency point that generates the resonance phenomenon can be accurately located, thereby avoiding the problem of low accuracy in locating the frequency point to be optimized with resonance function due to the difference in resonance frequency points of different audio signals. Therefore, by using the magnitude of the amplitude value, the purpose of accurately determining whether the frequency point in the signal has resonance function can be achieved. Thus, this lays the foundation for vibration reduction of extended reality devices without adding vibration reduction structures.

[0084] In one feasible approach, if the detected vibration amplitude value is not greater than a preset amplitude threshold, then the frequency point in the first target audio signal that generates the vibration amplitude value is not considered as the frequency point to be optimized.

[0085] Wherein, the extended reality device includes a speaker, the target audio signal includes a second target audio signal, and the step of obtaining the frequency points to be optimized with resonant capability in the target audio signal based on the extended reality device includes:

[0086] Step B10: Before the speaker outputs the second target audio signal, the initial frequency point in the second target audio signal is obtained;

[0087] Step B20: Check the resonant frequency table to see if there is a resonant frequency that is the same as the initial frequency.

[0088] Step B30: If a resonant frequency point with the same initial frequency point is found, then the initial frequency point is taken as the frequency point to be optimized.

[0089] In this embodiment, it should be noted that, generally speaking, for the same audio signal, the frequencies at which resonance occurs are roughly the same. Therefore, the audio signal can be pre-detected before the speaker outputs the audio signal to determine whether the frequency of the audio signal is a frequency to be optimized. The extended reality device is provided with a resonance frequency table, which is composed of resonance frequencies. The resonance frequencies are used to characterize the frequencies that cause resonance between the optical engine and the housing of the extended reality device. The second target audio signal is used to characterize the audio signal before it is output by the speaker of the extended reality device. For example, in one implementable method, after the audio processing system receives the signal, it directly obtains the initial frequency of the second target audio signal, and then compares it with the resonance frequency table to see if there is a resonance frequency that is the same as the initial frequency. If there is a resonance frequency that is the same as the initial frequency, it is not necessary to perform frequency detection for each frequency to determine whether it is a frequency to be optimized.

[0090] Additionally, it should be noted that for extended reality devices with pre-detection functionality, a vibration sensor can also be installed after the pre-detection function to detect the vibration generated by the output audio signal in real time, i.e., referring to... Figure 2 , Figure 2The flowchart for optimizing the frequency point to be optimized shows that after the audio processing system receives the audio signal, it first checks the resonance frequency table to see if there is a resonance frequency point that is the same as the initial signal of the audio signal. Then, the EQ adjustment module makes targeted adjustments to the frequency point to be optimized. Then, the vibration sensor is set to detect the vibration of the output audio signal in real time. When the vibration amplitude value is detected to be greater than the preset amplitude threshold, the frequency point that generates the vibration amplitude value is directly taken as the frequency point to be optimized and adjusted in real time by the EQ adjustment module, so as to finally output the audio.

[0091] As an example, steps B10 to B30 include: before the speaker outputs the second target audio signal, obtaining an initial frequency point in the second target audio signal; using the initial frequency point as an index, querying a resonance frequency point table to see if a common resonance frequency point exists; if a common resonance frequency point is found in the resonance frequency point table, then the initial frequency point is taken as the frequency point to be optimized. Since the audio signal can be pre-detected based on the resonance frequency point table after inputting into the audio processing system, thus avoiding the need to repeatedly detect the frequency point to be optimized for the same audio signal, this lays the foundation for vibration reduction of the extended reality device without adding a new vibration reduction structure.

[0092] The extended reality device includes a preset display interface, and the step of converting the target audio signal into a playable audio signal by optimizing the frequency point to be optimized includes:

[0093] Step C10: Determine the frequency optimization parameters for the frequency point to be optimized;

[0094] Step C20: Based on the optimization instructions input by the user on the preset display interface, optimize the frequency point parameters of the optimized frequency point using the first parameter optimization value corresponding to the frequency point optimization parameters, and convert the target audio signal into the audio signal to be played.

[0095] In this embodiment, it should be noted that the frequency optimization parameter is used to characterize the tuning parameters optimized within the frequency point. By adjusting the parameter values ​​of the tuning parameters, the target audio signal can be converted into an audio signal to be played. The extended reality device is equipped with a preset display interface. After obtaining the frequency point to be optimized in the target audio signal, human-computer interaction can be performed through the preset display interface. That is, the user can choose whether to perform active vibration reduction on the preset display interface to ensure that the adjusted output audio meets the user's actual needs. For example, in one feasible approach, assuming that the amplitude of the maximum vibration frequency point is detected to exceed A, a pop-up window will be displayed on the preset display interface asking "Whether to select active vibration reduction", so that vibration reduction or no vibration reduction is performed according to the user's subjective choice.

[0096] As an example, steps C10 to C20 include: determining the frequency optimization parameters of the frequency point to be optimized; obtaining the optimization instruction input by the user on the preset display interface; and converting the target audio signal into the audio signal to be played by adjusting the default frequency parameters of the frequency point to be optimized to the first parameter optimization value corresponding to the frequency optimization parameters according to the optimization instruction.

[0097] Wherein, the frequency point to be optimized includes at least one parameter optimization frequency point, and the step of determining the frequency point optimization parameter of the frequency point to be optimized includes:

[0098] Step D10: Use the frequency values ​​of each of the optimized frequency points as the frequency optimization parameters of the frequency point to be optimized; and / or

[0099] Step D20: Use the vibration amplitude value of the frequency point to be optimized as the frequency point optimization parameter of the frequency point to be optimized.

[0100] In this embodiment, it should be noted that during the optimization of frequency parameters, both the number of frequencies to be optimized and the amplitude of vibration generated by the frequencies to be optimized can be adjusted. The optimized frequency points are used to characterize the frequencies for parameter optimization. At the same time, the user can customize the degree of active vibration reduction adjustment. The difference between different degrees of vibration reduction adjustment is reflected in the different number of optimized frequency points or the different adjustment range of vibration amplitude values. For example, in one feasible method, assuming that the vibration reduction adjustment mode is set to three modes, A, B, and C, which correspond to high, medium, and low vibration reduction adjustment levels respectively, then the number of optimized frequency points corresponding to mode A is greater than the number of optimized frequency points corresponding to mode B, which is greater than the number of optimized frequency points corresponding to mode C. Similarly, the adjustment range of amplitude values ​​corresponding to mode A is greater than the adjustment range of amplitude values ​​corresponding to mode B, which is greater than the adjustment range of amplitude values ​​corresponding to mode C.

[0101] As an example, steps D10 to D20 include: determining at least one parameter-optimized frequency point according to the frequency point optimization mode corresponding to the frequency point to be optimized, and using the frequency point value of each parameter-optimized frequency point as the frequency point optimization parameter of the frequency point to be optimized; and / or

[0102] Based on the frequency optimization mode corresponding to the frequency point to be optimized, the vibration amplitude adjustment value of the frequency point to be optimized is determined, and the vibration amplitude adjustment value is used as the frequency optimization parameter of the frequency point to be optimized.

[0103] The audio playback optimization method further includes, after the step of acquiring the resonant frequency points to be optimized in the target audio signal based on the extended reality device:

[0104] Step E10: Check if the frequency point to be optimized exists in the resonance frequency point table;

[0105] Step E20: If the frequency point to be optimized does not exist, then record the frequency point to be optimized in the resonant frequency point table.

[0106] In this embodiment, it should be noted that in some specific cases, the audio signal may come from an unfamiliar audio signal that has not been output by the extended reality device. As a result, when the audio is played through the extended reality device, other vibration frequencies may be generated. In order to facilitate the subsequent audio playback optimization process, this frequency to be optimized can be recorded in the resonance frequency table. Then, when the resonance phenomenon generated by this frequency occurs later, the frequency to be optimized can be quickly determined.

[0107] As an example, steps E10 to E20 include: detecting whether the frequency point to be optimized exists in the resonant frequency point table; if the frequency point to be optimized does not exist in the resonant frequency point table, then recording the frequency point to be optimized in the resonant frequency point table.

[0108] This application provides an audio playback optimization method applied to an extended reality device. Specifically, the method involves obtaining resonant frequency points in a target audio signal from the extended reality device; optimizing these frequency points to convert the target audio signal into a playable audio signal, wherein the playable audio signal consists of frequency points that do not possess resonant capabilities; and playing the audio signal on the extended reality device based on the playable audio signal.

[0109] In this embodiment of the application, when playing audio through an extended reality device, the first step is to obtain the frequency points in the target audio signal that have resonant capabilities, i.e., to locate the frequency points that affect the user experience during the use of the extended reality device. Then, by optimizing the frequency points to be optimized, an audio signal to be played is obtained, which consists of frequency points that do not have resonant capabilities. Finally, the audio signal to be played is used for audio playback on the extended reality device. Since the frequency points in the audio signal to be played do not have resonant capabilities, no resonance will be generated that affects the user experience, thereby reducing the vibration generated when playing audio through the extended reality device.

[0110] Because extended reality devices can perform frequency optimization autonomously, they can optimize frequencies in the target audio that have resonance capabilities to frequencies that do not have resonance capabilities. This ensures that when audio is played on the extended reality device based on the target audio signal, there will be no resonance between the optical engine and the extended reality device. In other words, the goal of vibration reduction of the extended reality device is achieved without adding a vibration reduction structure.

[0111] Based on this, this application autonomously acquires the resonant frequencies of the target audio signal through an extended reality device, and then optimizes these frequencies to obtain a playback audio signal composed of frequencies lacking resonant capabilities. Finally, the audio is played on the extended reality device based on this playback audio signal. This achieves autonomous optimization of the audio signal's frequencies at the software level, thereby reducing vibration during use of the extended reality device. It avoids adding vibration-damping structures to the extended reality device to reduce vibration. In other words, it overcomes the technical drawback of vibration-damping structures relying on expensive hardware, thus reducing the development cost of the extended reality device.

[0112] Example 2

[0113] Furthermore, referring to Figure 3 In another embodiment of this application, content that is the same as or similar to that in Embodiment 1 described above can be referred to the above description and will not be repeated hereafter. Based on this, the step of converting the target audio signal into a playable audio signal by optimizing the frequency point to be optimized includes:

[0114] Step F10: Determine the frequency optimization parameters for the frequency point to be optimized;

[0115] Step F20: Based on the frequency point optimization parameters, query the corresponding second parameter optimization value in the preset parameter mapping table;

[0116] Step F30: Optimize the frequency point parameters of the optimized frequency point using the second parameter optimization value, and convert the target audio signal into the audio signal to be played.

[0117] In this embodiment, it should be noted that the specific steps for determining the frequency point optimization parameters can be referred to the above content, and will not be repeated here. The preset parameter mapping table is used to characterize the mapping relationship between the frequency point optimization parameters and the parameter optimization values. The parameter optimization values ​​are specific numerical values. For example, in one implementable method, assuming that the frequency point optimization parameter is a frequency point value, the default value of the frequency point value is a, and the second parameter optimization value is b, then the process of optimizing the frequency point parameters is to replace a with b.

[0118] As an example, steps F10 to F20 include: determining the frequency optimization parameters of the frequency point to be optimized; using the frequency optimization parameters as an index, querying the corresponding second parameter optimization value in a preset parameter mapping table; and converting the target audio signal into the audio signal to be played by replacing the default frequency parameter value of the frequency point to be optimized with the second parameter optimization value.

[0119] This application provides a frequency point parameter optimization method, namely, determining the frequency point optimization parameters of the frequency point to be optimized; querying the corresponding second parameter optimization value in a preset parameter mapping table according to the frequency point optimization parameters; and optimizing the frequency point parameters using the second parameter optimization value to convert the target audio signal into the audio signal to be played. In the process of frequency point parameter optimization, this application actively indexes the corresponding parameter optimization value through the mapping relationship between the frequency point optimization parameters and the parameter optimization value, and optimizes the parameters of the frequency point to be optimized through parameter optimization. This achieves automatic frequency point parameter optimization of the frequency point to be optimized, thereby achieving vibration reduction without adding a vibration reduction structure. Therefore, it lays the foundation for reducing the development cost of extended reality devices.

[0120] Example 3

[0121] This application also provides an audio playback optimization device, applied to an extended reality device, see reference. Figure 4 The audio playback optimization device includes:

[0122] The acquisition module 101 is used to acquire the frequency points to be optimized in the target audio signal that have resonant capabilities based on the extended reality device;

[0123] The optimization module 102 is used to convert the target audio signal into an audio signal to be played by optimizing the frequency point to be optimized;

[0124] The playback module 103 is used to play audio in the extended reality device according to the audio signal to be played.

[0125] Optionally, the extended reality device includes a vibration sensor and a speaker, the target audio signal includes a first target audio signal, and the acquisition module 101 is further configured to:

[0126] The first target audio signal is output through the speaker, and the vibration amplitude value of the first target audio signal is obtained based on the vibration sensor;

[0127] If the vibration amplitude value is detected to be greater than the preset amplitude threshold, then the frequency point in the first target audio signal that generates the vibration amplitude value is taken as the frequency point to be optimized.

[0128] Optionally, the extended reality device includes a speaker, the target audio signal includes a second target audio signal, and the acquisition module 101 is further configured to:

[0129] Before the speaker outputs the second target audio signal, the initial frequency point in the second target audio signal is obtained;

[0130] Check the resonant frequency table to see if there is a resonant frequency that is the same as the initial frequency.

[0131] If a resonant frequency point with the same initial frequency point is found, then the initial frequency point is taken as the frequency point to be optimized.

[0132] Optionally, the extended reality device includes a preset display interface, and the optimization module 102 is further configured to:

[0133] Determine the frequency optimization parameters for the frequency point to be optimized;

[0134] Based on the optimization instructions input by the user on the preset display interface, the optimization frequency point is optimized by using the first parameter optimization value corresponding to the frequency point optimization parameter, thereby converting the target audio signal into the audio signal to be played.

[0135] Optionally, the optimization module 102 is further configured to:

[0136] Determine the frequency optimization parameters for the frequency point to be optimized;

[0137] Based on the frequency point optimization parameters, the corresponding second parameter optimization value is queried in the preset parameter mapping table;

[0138] The frequency point parameter is optimized by using the second parameter optimization value, and the target audio signal is converted into the audio signal to be played.

[0139] Optionally, the frequency point to be optimized includes at least one parameter optimization frequency point, and the optimization module 102 is further used for:

[0140] Use the frequency values ​​of each of the aforementioned optimized frequency points as the frequency optimization parameters of the frequency point to be optimized; and / or

[0141] The vibration amplitude value of the frequency point to be optimized is used as the frequency optimization parameter of the frequency point to be optimized.

[0142] Optionally, the audio playback optimization device is further configured to:

[0143] Check if the frequency to be optimized exists in the resonant frequency table;

[0144] If it does not exist, the frequency point to be optimized is recorded in the resonant frequency point table.

[0145] The audio playback optimization device provided by this invention, employing the audio playback optimization method in the above embodiments, solves the technical problem of high development costs for extended reality devices. Compared with the prior art, the beneficial effects of the audio playback optimization device provided by this invention are the same as those of the audio playback optimization method provided in the above embodiments, and other technical features in this audio playback optimization device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0146] Example 4

[0147] This invention provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the audio playback optimization method described in Embodiment 1 above.

[0148] The following is for reference. Figure 5 The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0149] like Figure 5 As shown, the electronic device may include a processing unit 1001 (e.g., a central processing unit, a graphics processor, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the electronic device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus.

[0150] Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. The communication devices allow electronic devices to communicate wirelessly or wiredly with other devices to exchange data. Although electronic devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0151] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0152] The electronic device provided by this invention, employing the audio playback optimization method in the above embodiments, solves the technical problem of high development costs for extended reality devices. Compared with the prior art, the beneficial effects of the electronic device provided by this invention are the same as those of the audio playback optimization method provided in the above embodiments, and other technical features of this electronic device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0153] It should be understood that various parts of this disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0154] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0155] Example 5

[0156] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, which are used to execute the audio playback optimization method in the above embodiment.

[0157] The computer-readable storage medium provided in this embodiment of the invention may be, for example, a USB flash drive, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0158] The aforementioned computer-readable storage medium may be included in an electronic device or may exist independently without being assembled into an electronic device.

[0159] The aforementioned computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to: acquire, based on the extended reality device, optimize resonant frequency points in a target audio signal; convert the target audio signal into a playable audio signal by optimizing the optimized frequency points, wherein the playable audio signal consists of frequency points without resonant capabilities; and play audio on the extended reality device according to the playable audio signal.

[0160] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0161] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0162] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0163] The computer-readable storage medium provided by this invention stores computer-readable program instructions for executing the above-described audio playback optimization method, thus solving the technical problem of high development costs for extended reality devices. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this invention are the same as those of the audio playback optimization method provided in the above-described embodiments, and will not be repeated here.

[0164] Example 6

[0165] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the audio playback optimization method described above.

[0166] The computer program product provided in this application solves the technical problem of high development costs for extended reality devices. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiments of this invention are the same as the beneficial effects of the audio playback optimization method provided in the above embodiments, and will not be repeated here.

[0167] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.

Claims

1. An audio playback optimization method, characterized by, An extended reality device that exhibits resonance between the optical engine and its housing and requires no additional hardware vibration damping structure, comprising a vibration sensor and a speaker, wherein the vibration sensor is positioned within 15mm of the optical engine, and the audio playback optimization method includes: Based on the extended reality device, the target audio signal with resonant capability is obtained as a frequency point to be optimized, wherein the target audio signal includes a first target audio signal; The step of acquiring the resonant frequency points to be optimized in the target audio signal based on the extended reality device includes: The first target audio signal is output through the speaker, and the vibration amplitude value of the first target audio signal is obtained based on the vibration sensor; if the vibration amplitude value is detected to be greater than a preset amplitude threshold, the frequency point in the first target audio signal that generates the vibration amplitude value is taken as the frequency point to be optimized. Check if the frequency point to be optimized exists in the resonant frequency point table; if not, record the frequency point to be optimized in the resonant frequency point table. By optimizing the frequency points to be optimized, the target audio signal is converted into an audio signal to be played, wherein the audio signal to be played consists of frequency points that do not have resonance capability; The audio signal to be played is played on the extended reality device.

2. The audio playback optimization method as described in claim 1, characterized in that, The extended reality device includes a speaker, and the target audio signal includes a second target audio signal. The step of acquiring the resonant frequency points to be optimized in the target audio signal based on the extended reality device includes: Before the speaker outputs the second target audio signal, the initial frequency point in the second target audio signal is obtained; Check the resonant frequency table to see if there is a resonant frequency that is the same as the initial frequency. If a resonant frequency point with the same initial frequency point is found, then the initial frequency point is taken as the frequency point to be optimized.

3. The audio playback optimization method as described in claim 1, characterized in that, The extended reality device includes a preset display interface. The step of converting the target audio signal into a playable audio signal by optimizing the frequency point to be optimized includes: Determine the frequency optimization parameters for the frequency point to be optimized; Based on the optimization instructions input by the user on the preset display interface, the optimization frequency point is optimized by using the first parameter optimization value corresponding to the frequency point optimization parameter, thereby converting the target audio signal into the audio signal to be played.

4. The audio playback optimization method as described in claim 1, characterized in that, The step of converting the target audio signal into a playable audio signal by optimizing the frequency point to be optimized includes: Determine the frequency optimization parameters for the frequency point to be optimized; Based on the frequency point optimization parameters, query the corresponding second parameter optimization value in the preset parameter mapping table; The frequency point parameter is optimized by using the second parameter optimization value, and the target audio signal is converted into the audio signal to be played.

5. The audio playback optimization method as described in claim 3 or 4, characterized in that, The frequency point to be optimized includes at least one parameter optimization frequency point, and the step of determining the frequency point optimization parameter of the frequency point to be optimized includes: Use the frequency values ​​of each of the aforementioned optimized frequency points as the frequency optimization parameters of the frequency point to be optimized; and / or The vibration amplitude value of the frequency point to be optimized is used as the frequency optimization parameter of the frequency point to be optimized.

6. An audio playback optimization device, characterized in that, An extended reality device (ARD) is applied to devices where there is resonance between the optical engine and the housing, and no additional hardware vibration damping structure is required. The ARD device includes a vibration sensor and a speaker. The vibration sensor is positioned within 15mm of the optical engine. The audio playback optimization device includes: An acquisition module is used to acquire resonant frequency points in a target audio signal based on the extended reality device, wherein the target audio signal includes a first target audio signal. Specifically, the acquisition module is used to output the first target audio signal through the speaker and acquire the vibration amplitude value of the first target audio signal based on the vibration sensor. If the vibration amplitude value is detected to be greater than a preset amplitude threshold, the frequency point in the first target audio signal that generates the vibration amplitude value is taken as the frequency point to be optimized. The module also checks whether the frequency point to be optimized exists in the resonant frequency point table; if it does not exist, the frequency point to be optimized is recorded in the resonant frequency point table. An optimization module is used to convert the target audio signal into a playable audio signal by optimizing the frequency point to be optimized. A playback module is used to play audio on the extended reality device according to the audio signal to be played.

7. An electronic device, characterized in that, The electronic device includes: At least one processor; A memory that is communicatively connected to the at least one processor; The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the steps of the audio playback optimization method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a program for implementing an audio playback optimization method, which is executed by a processor to implement the steps of the audio playback optimization method as described in any one of claims 1 to 5.

Images