Audio playing method and device, head-mounted open hearing device and storage medium

Abstract

The invention discloses an audio playing method and device, a head-mounted open hearing device and a storage medium, and is applied to an audio playing system, and the audio playing method further comprises the steps: obtaining a feature parameter of an initial sound wave signal; converting the initial sound wave signal into at least one plane sound wave signal according to the characteristic parameters; and playing a to-be-played audio corresponding to a directional sound wave signal formed by jointly focusing the planar sound wave signals. The technical problem of high limitation of directional sound playing is solved.

Description

Technical Field

[0001] The present application relates to the field of audio technologies, and in particular, to an audio playing method, apparatus, head-mounted open hearing device, and computer-readable storage medium. Background Art

[0002] With the continuous development of technology, head-mounted open hearing devices such as virtual reality (VR) devices, augmented reality (AR) devices, audio glasses, and open headphones are widely used in people's lives. In order to improve the privacy of sound transmission of head-mounted open hearing devices, it is very necessary to achieve directional sound transmission.

[0003] Currently, generally, phased array technology or ultrasonic modulation technology is used for directional sound propagation. However, since the phased array technology requires the device to be array-designed, it can only be applied to large-scale scenarios such as stages or exhibitions. And the ultrasonic modulation technology needs to use ultrasonic transmitters, and different types of ultrasonic transmitters will cause changes in sound intensity, that is, the effect of directional sound propagation is limited by the type of ultrasonic transmitter. In summary, the limiting conditions for realizing directional sound propagation are likely to cause a poor listening experience for users wearing head-mounted open hearing devices. Therefore, the current limitations of directional sound propagation are high. Summary of the Invention

[0004] The main purpose of the present application is to provide an audio playing method, apparatus, head-mounted open hearing device, and computer-readable storage medium, aiming to solve the technical problem of high limitations in directional sound propagation in the prior art.

[0005] To achieve the above purpose, the present application provides an audio playing method, which is applied to an audio playing system. The audio playing method includes:

[0006] Obtaining characteristic parameters of an initial sound wave signal;

[0007] Converting the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters;

[0008] Playing the to-be-played audio corresponding to the directional sound wave signal formed by the common focusing of each planar sound wave signal.

[0009] Optionally, the signal characteristic parameter includes signal frequency, and the audio playing system includes a conversion element. The step of converting the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters includes:

[0010] Determining a corresponding sound wave cut-off frequency according to the size parameter of the conversion element;

[0011] Select at least one planar acoustic wave signal from the initial acoustic wave signal according to the magnitude relationship between the signal frequency and the acoustic wave cut-off frequency.

[0012] Optionally, the audio playback system includes a focusing element, and the step of playing the to-be-played audio corresponding to the directional acoustic wave signal formed by jointly focusing the planar acoustic wave signals includes:

[0013] Jointly focus each of the planar acoustic wave signals on a preset focusing position through the focusing element to obtain the directional acoustic wave signal;

[0014] Output the directional acoustic wave signal at the preset focusing position and play the to-be-played audio corresponding to the directional acoustic wave signal.

[0015] Optionally, the focusing element includes a first focusing element and a second focusing element. Before the step of jointly focusing each of the planar acoustic wave signals on a preset focusing position through the focusing element to obtain the directional acoustic wave signal, the audio playback method further includes:

[0016] Obtain a first transmission parameter of the focusing element and a second transmission parameter of the conversion element respectively;

[0017] Detect whether the first transmission parameter is greater than the second transmission parameter;

[0018] If so, use the first focusing element as the focusing element;

[0019] If not, use the second focusing element as the focusing element.

[0020] Optionally, the first focusing element includes a first single-sided focusing element and a first multi-sided focusing element. The step of using the first focusing element as the focusing element includes:

[0021] Predict the ear canal depth of the wearing user according to the identity information of the wearing user:

[0022] If it is detected that the ear canal depth is greater than a preset ear canal depth, use the first single-sided focusing element as the focusing element;

[0023] If it is detected that the ear canal depth is less than or equal to the preset ear canal depth, use the first multi-sided focusing element as the focusing element.

[0024] Optionally, the focusing element includes a matching layer and a focusing layer. The step of jointly focusing each of the planar acoustic wave signals on a preset focusing position through the focusing element to obtain the directional acoustic wave signal includes:

[0025] Transmit each of the plane acoustic wave signals through the matching layer to obtain at least one acoustic wave transmission signal;

[0026] Focus each of the acoustic wave transmission signals together on the preset focusing position through the focusing layer to obtain the directional acoustic wave signal.

[0027] Optionally, the matching layer includes a first matching layer and a second matching layer. The step of transmitting each of the plane acoustic wave signals through the matching layer to obtain at least one acoustic wave transmission signal includes:

[0028] Transmit each of the plane acoustic wave signals through the first matching layer with a first acoustic path to obtain at least one acoustic wave transmission signal; or,

[0029] Transmit each of the plane acoustic wave signals through the first matching layer with the second acoustic path to obtain at least one acoustic wave transmission signal, where the first acoustic path is greater than the second acoustic path.

[0030] To achieve the above object, the present application further provides an audio playback device, which is applied to an audio playback system. The audio playback device includes:

[0031] An acquisition module for acquiring the characteristic parameters of the initial acoustic wave signal;

[0032] A conversion module for converting the initial acoustic wave signal into at least one plane acoustic wave signal according to the characteristic parameters;

[0033] A playback module for playing the to-be-played audio corresponding to the directional acoustic wave signal formed by focusing each of the plane acoustic wave signals together.

[0034] Optionally, the signal characteristic parameters include the signal frequency. The audio playback system includes a conversion element. The conversion module is further configured to:

[0035] Determine the corresponding acoustic wave cut-off frequency according to the size parameters of the conversion element;

[0036] Select at least one plane acoustic wave signal from the initial acoustic wave signal according to the magnitude relationship between the signal frequency and the acoustic wave cut-off frequency.

[0037] Optionally, the audio playback system includes a focusing element. The playback module is further configured to:

[0038] Focus each of the plane acoustic wave signals together on a preset focusing position through the focusing element to obtain the directional acoustic wave signal;

[0039] Output the directional acoustic wave signal at the preset focusing position and play the to-be-played audio corresponding to the directional acoustic wave signal.

[0040] Optionally, the focusing element includes a first focusing element and a second focusing element, and the audio playback device is further configured to:

[0041] Obtain a first transmission parameter of the focusing element and a second transmission parameter of the conversion element respectively;

[0042] Detect whether the first transmission parameter is greater than the second transmission parameter;

[0043] If so, use the first focusing element as the focusing element;

[0044] If not, use the second focusing element as the focusing element.

[0045] Optionally, the first focusing element includes a first single-sided focusing element and a first multi-sided focusing element, and the audio playback device is further configured to:

[0046] Predict the ear canal depth of the wearing user according to the identity information of the wearing user:

[0047] If it is detected that the ear canal depth is greater than a preset ear canal depth, use the first single-sided focusing element as the focusing element;

[0048] If it is detected that the ear canal depth is less than or equal to the preset ear canal depth, use the first multi-sided focusing element as the focusing element.

[0049] Optionally, the focusing element includes a matching layer and a focusing layer, and the playback module is further configured to:

[0050] Transmit each of the plane sound wave signals through the matching layer to obtain at least one sound wave transmission signal;

[0051] Focus each of the sound wave transmission signals on the preset focusing position through the focusing layer to obtain the directional sound wave signal.

[0052] Optionally, the matching layer includes a first matching layer and a second matching layer, and the playback module is further configured to:

[0053] Transmit each of the plane sound wave signals through the first matching layer with a first sound path to obtain at least one sound wave transmission signal; or,

[0054] Transmit each of the plane sound wave signals through the first matching layer with the second sound path to obtain at least one sound wave transmission signal, where the first sound path is greater than the second sound path.

[0055] The present application also provides a head-mounted open hearing device, which includes at least one processor and a memory communicatively connected to the at least one processor. The memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor is enabled to execute the steps of the audio playback method as described above.

[0056] The present application also provides a computer-readable storage medium, on which a program for implementing the audio playback method is stored. When the program of the audio playback method is executed by a processor, the steps of the audio playback method as described above are implemented.

[0057] The present application also provides a computer program product, including a computer program, which when executed by a processor, implements the steps of the audio playback method as described above.

[0058] The present application provides an audio playback method, device, head-mounted open hearing device and computer-readable storage medium, which are applied to an audio playback system, that is, obtaining characteristic parameters of an initial sound wave signal; converting the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters; playing the to-be-played audio corresponding to the directional sound wave signal formed by the common focusing of each planar sound wave signal.

[0059] When the present application performs audio playback, first, the characteristic parameters of the initial sound wave signal are determined, and then, through the characteristic parameters, the initial sound wave signal is converted into at least one planar sound wave signal, that is, the signal transmitted in all directions by the sound source is converted into a planar sound wave signal transmitted in the same direction. Then, the to-be-played audio corresponding to the directional sound wave signal formed by the focusing of different planar sound wave signals is played. Since the directional sound wave signal is formed by the focusing of different planar sound wave signals, the purpose of directional sound propagation can be achieved. Furthermore, the to-be-played audio corresponding to the directional sound wave signal can be played at the target playback position. Therefore, the purpose of automatically performing directional sound playback after simple conversion and focusing of the initial sound wave signal is achieved.

[0060] Since the conversion and focusing of the sound wave signal are simpler to implement than the current sound directional propagation technology, the scope of application of the method of performing sound directional propagation through the conversion and focusing of the sound wave signal is wider, and thus the purpose of reducing the limiting conditions of sound directional propagation is achieved.

[0061] Based on this, when the present application plays audio, after the initial sound wave signal is subjected to waveform conversion and signal focusing through the audio playback system, the purpose of playing the to-be-played audio corresponding to the directional sound wave signal can be achieved, thereby reducing the limiting conditions for realizing the directional propagation of sound. Instead of restricting the type or application scenario of the ultrasonic transmitter to achieve the preset sound collection effect. Therefore, the technical defect that the limiting conditions for realizing the directional propagation of sound easily lead to a poor listening experience when the user wears a head-mounted open hearing device is overcome. Therefore, the limitation of directional sound playback is reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0063] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0064] Figure 1 It is a schematic flowchart of the audio playback method provided in the first embodiment of the present application;

[0065] Figure 2 It is a schematic diagram of the principle of sound wave signal transmission in different transmission media of the audio playback method provided in the first embodiment of the present application;

[0066] Figure 3 It is a schematic diagram of the size parameters of different types of waveguides of the audio playback method provided in the first embodiment of the present application;

[0067] Figure 4 It is a schematic diagram of the scenario of sound wave signal focusing by different lenses of the audio playback method provided in the first embodiment of the present application;

[0068] Figure 5 It is a first structural schematic diagram of the audio playback system of the audio playback method provided in the first embodiment of the present application;

[0069] Figure 6 It is a second structural schematic diagram of the audio playback system of the audio playback method provided in the first embodiment of the present application;

[0070] Figure 7 It is a structural schematic diagram of a waveguide-type acoustic lens with a matching layer combined with a lens of the audio playback method provided in the first embodiment of the present application;

[0071] Figure 8Schematic flowchart of the audio playback method provided in the second embodiment of this application;

[0072] Figure 9 Schematic structural diagram of the audio playback system provided in the third embodiment of this application;

[0073] Figure 10 Schematic structural diagram of the head-mounted open hearing device provided in the fourth embodiment of this application.

[0074] The implementation, functional features, and advantages of this application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0075] To make the above objects, features, and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0076] Embodiment 1

[0077] First of all, it should be understood that for head-mounted open hearing devices such as virtual reality helmets, virtual reality headsets, audio glasses, open earphones or virtual reality glasses, their sound-emitting structures are usually open. That is, the sound emitted by the sound source is directly radiated into the air through relatively simple and reliable structures such as speakers and sound ducts, and then transmitted to the user's ears through air transmission. Among them, the sound wave signal corresponding to the sound source propagates in all directions in the air. However, for user use, users have the need for listening privacy. For example, when a user wears a head-mounted open hearing device for use, the user wants the sound to be transmitted only in the direction the user desires. However, the open sound radiation design makes it impossible to guarantee the privacy of the sound. However, the directional propagation of sound is often achieved by phased array technology and ultrasonic modulation technology. Among them, phased array technology is to set different initial phases for different array elements. When the array emits a signal, since the initial phases of the signals of each array element are different, the final signal is the accumulation of the signals emitted by each array element. Therefore, the array signal will be concentrated at the specified position set by the phased array to achieve the directional propagation of sound. However, in phased array technology, its structure is an array design and requires a certain number of array elements and array linear dimensions, so it is difficult to achieve miniaturization and lightweight, so it is generally limited to certain scenarios, such as used in exhibition or stage scenes, etc.; while ultrasonic modulation technology utilizes the directivity of ultrasonic waves. Since the increase in the frequency of the sound wave signal will enhance the directivity of the sound during transmission, in ultrasonic modulation technology, a high-frequency ultrasonic signal is used as the carrier, and a relatively low-frequency audio signal is modulated into the ultrasonic wave. At the same time, because of the nonlinearity of air to ultrasonic waves, the ultrasonic modulation signal will undergo self-demodulation during propagation and be restored to an audio signal. Therefore, the directional propagation of sound waves can be achieved through an ultrasonic transmitter. However, since the radiation area and radiation sound power of the ultrasonic transmitter will affect the sound intensity, for example, it is difficult to reach the sound pressure level equivalent to that of an ordinary speaker if the radiation area or radiation sound power of the ultrasonic transmitter is small. That is, if it is necessary to reach the sound pressure level equivalent to that of an ordinary speaker, the type of ultrasonic speaker needs to be strictly restricted. Therefore, there are many limiting conditions for achieving the directional propagation of sound currently. Taking the scenario where a user wears a head-mounted open hearing device for use as an example, it is easy for the sound to be difficult to achieve directional propagation, resulting in other people besides the wearer hearing the relevant sound, and thus the voice privacy of the wearer cannot be guaranteed, ultimately affecting the listening experience of the wearer. That is, there is an urgent need for a method that can reduce the limitations of the directional propagation of sound currently.

[0078] An embodiment of the present application provides an audio playback method, which is applied to an audio playback system. In the first embodiment of the audio playback method of the present application, with reference to Figure 1 , the audio playback method includes:

[0079] Step S10, obtain the characteristic parameters of the initial acoustic wave signal;

[0080] Step S20, convert the initial acoustic wave signal into at least one planar acoustic wave signal according to the characteristic parameters;

[0081] Step S30, play the audio to be played corresponding to the directional acoustic wave signal formed by the common focusing of each of the planar acoustic wave signals.

[0082] In this embodiment, it should be noted that although Figure 1 the logical order is shown, in some cases, the steps shown or described can be executed in an order different from that here. The audio playback method is applied to an audio playback system for realizing the playback of directional sound. Different sound transmission elements are included in the audio playback system, and the conversion of acoustic wave signals and the focusing of acoustic wave signals can be respectively realized through different sound transmission elements. Among them, different sound transmission elements are transmitted through different sound transmission media. It can be understood that there are differences in the acoustic impedance of different sound transmission media. For example, in an implementable manner, refer to Figure 2 , Figure 2 which is a schematic diagram showing the principle of acoustic wave signal transmission in different transmission media. Assume that the sound velocity of the acoustic wave signal propagating in medium A is c1 and the sound velocity of the acoustic wave signal propagating in medium B is c2. When the acoustic wave signal is incident from medium A to medium B, reflection or transmission and other phenomena will occur to the acoustic wave at the junction. Among them, θ i is the incident angle, specifically, it can be the angle between the incident acoustic wave and the normal of the interface. Similarly, θ r is the reflection angle, and θ t is the refraction angle. Then the above angles satisfy Snell's law, specifically as follows:

[0083] θ i =θ r

[0084]

[0085] Among them, the incident angle θ i is equal to the reflection angle θ r . At the same time, the greater the sound velocity of the transmission medium of the transmitted acoustic wave, the greater the transmission angle.

[0086] Additionally, the initial acoustic wave signal is used to characterize the acoustic wave signal emitted by the initial sound source. Herein, for the specific type of the initial sound source, the embodiments of the present application do not make specific limitations. The initial sound source can be specifically generated by a single speaker or by a speaker array. The characteristic parameters are used to characterize the characteristics of the signal, which can specifically be frequency, frequency, phase, and time, etc. The plane acoustic wave signal is used to characterize a series of planes whose wavefronts of the acoustic wave signal are perpendicular to the transmission direction, which can specifically be one or more. Opposed to the plane acoustic wave are spherical acoustic waves and cylindrical acoustic waves, etc. When there are multiple plane acoustic wave signals, the transmission directions of the signals of multiple plane acoustic waves can be understood as the same. According to Snell's law, it can be understood that through the characteristics, it can be determined whether the acoustic wave signal of the initial sound source is transmitted in the form of a plane wave. For example, in an implementable manner, assume that the characteristic parameter is frequency and the shape of the first transmission element is rectangular. When the initial acoustic wave signal is transmitted through the transmission medium that converts the acoustic wave form, a cut-off frequency can be preset in advance. If the frequency of the initial acoustic wave signal is greater than the preset cut-off frequency, it can be determined that the wave transmitted in the first transmission element is a plane wave that is only transmitted along the specified direction. The specific formula can be as follows:

[0087]

[0088] where f c is the cut-off frequency, x is the size parameter of the first transmission element, and min[] represents taking the minimum value. That is, the cut-off frequency of the transmission medium is determined by the size parameter of the first transmission element. At the same time, similar to the refraction principle of light, when the plane acoustic wave signal is transmitted through the second transmission element in a specified shape, the plane acoustic wave signal will generally generate an acoustic wave focusing phenomenon similar to light. Among them, the first transmission element is arranged before the second transmission element. In summary, when the initial acoustic wave signal is transmitted through the first transmission element, if the signal frequency of the initial acoustic wave signal is less than the cut-off frequency, then there is only a plane acoustic wave signal in the first transmission element that is transmitted in the specified direction and has the same signal frequency. That is, the first transmission element realizes the conversion of the initial acoustic wave signal to the plane acoustic wave signal, thereby making the incident wave of the second transmission element a plane wave. Due to the different transmission media of the first transmission element and the second transmission element, after the plane wave propagates through the second transmission element, an acoustic wave focusing phenomenon will occur according to Snell's law. That is, a directional acoustic wave signal can be focused at a certain position through the second transmission element. Among them, the directional acoustic wave signal is used to characterize the acoustic wave signal at the acoustic wave focusing position, and the acoustic wave focusing position is used to characterize the position where different plane acoustic wave signals are focused after being transmitted through the second transmission element.

[0089] Additionally, it should be noted that the audio to be played refers to the audio signal waiting to be played. The audio to be played can be played at the target playback position, which is used to represent the position where the user listens to the audio to be played. It can be understood that the audio signal is an electrical signal, and the conversion from the electrical signal to the sound signal can be achieved through a speaker. After being transmitted through the sound transmission medium, the sound signal can be propagated to the target playback position. The target playback position can specifically be a designated position of the outer ear. When the directional sound wave signal enters the user from the designated position of the outer ear, after a series of mechanical vibrations and bone conduction, energy conversion can occur at the hair cells in the cochlea, thereby converting the directional sound wave signal into an electrical signal, which is finally perceived and listened to by the user. That is, by setting different incoming positions of the directional sound wave signals, the user can listen to sounds of different intensities. For example, in one implementable manner, it is assumed that after the initial sound wave signal is transmitted through the first transmission element and the second transmission element to obtain a directional sound wave signal, the directional sound wave signal can enter through user ear canal position a and user ear canal position b. Among them, user ear canal position a is deeper than user ear canal position b. Then, the sound pressure level of the audio to be played generated by the directional sound wave signal entering the user based on user ear canal position a is greater than that of the audio to be played generated by the directional sound wave signal entering the user based on user ear canal position b.

[0090] As an example, steps S10 to S30 include: collecting the initial sound source generated by the speaker array and obtaining the signal frequency of the initial sound wave signal emitted by the initial sound source; calculating the cut-off signal frequency of the first transmission element according to the size parameters of the first transmission element, and when it is detected that the signal frequency is greater than the cut-off signal frequency, converting the initial sound wave signal into at least one planar sound wave signal through the first transmission element; focusing each of the planar sound wave signals on a preset focusing position through the second transmission element to obtain a directional sound wave signal, converting the directional sound wave signal into an audio signal, and generating the audio to be played corresponding to the audio signal, and playing the played audio at the target playback position, where the first transmission element is arranged before the second transmission element, and the transmission media of the first transmission element and the second transmission element are different. For example, the transmission medium of the first transmission element can be air, and the transmission medium of the second transmission element can be a solid.

[0091] In the process of audio playback in the embodiments of the present application, by first determining the signal frequency of the initial sound wave signal of the initial sound source, and then based on the sound transmission theory, according to the magnitude relationship between the signal frequency and the cut-off signal frequency of the first transmission element, the initial sound wave signal is converted into a plurality of planar sound wave signals through the first transmission element. Then, based on the difference in the transmission media of the first transmission element and the second transmission element, after the planar sound wave signals are transmitted through the second transmission element, a directional sound wave signal formed by focusing a plurality of planar sound wave signals can be obtained at a preset focusing position. Finally, through the user, the conversion of the directional sound wave signal into an electrical signal is realized, and the playback of the audio to be played corresponding to the directional sound wave signal is realized at the target playback position. Since the directional sound wave signal is formed by focusing the sound wave signals transmitted in different transmission directions after being transmitted through the second transmission element, the directional sound wave signal can achieve the purpose of directional sound propagation, that is, by simply converting and focusing the sound wave signals, the purpose of directional propagation of the initial sound source can be achieved. At the same time, since the difficulty of realizing sound wave conversion and focusing is much less than the difficulty of realizing the existing sound directional technology, the limitation of directional sound playback is reduced.

[0092] In an implementable manner, taking the scenario where a user wears a head-mounted open hearing device to watch TV in the living room as an example, in the prior art, due to the design of the open sound-emitting structure of the head-mounted open hearing device, when the speaker array of the head-mounted open hearing device emits sound, other people in the living room can also hear this sound. Thus, obviously, the privacy of the sound information is reduced. Through the audio playback system provided in the embodiments of the present application, the first transmission element can convert the sounds from all directions emitted by the speaker array into planar sound wave signals. Then, based on the difference in the transmission media between the first transmission element and the second transmission element, the focusing of the sound wave signals is realized at a preset focusing position. If the preset focusing position is deployed at the user's ear canal, the technical defect that the directional sound wave signal is received by other people around can be avoided, thereby enhancing the privacy of sound propagation. At the same time, using the audio playback system to realize directional sound propagation has a lower implementation difficulty in the application scenario of the head-mounted open hearing device than the prior art, that is, the application scenario of directional sound playback is extended to the field of head-mounted open hearing devices. Therefore, the limitation of directional sound propagation is reduced.

[0093] Among them, the signal characteristic parameter includes the signal frequency, the audio playback system includes a conversion element, and the step of converting the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameter includes:

[0094] Step A10, determining the corresponding sound wave cut-off frequency according to the size parameter of the conversion element;

[0095] Step A20, select at least one planar acoustic wave signal from the initial acoustic wave signal according to the magnitude relationship between the signal frequency and the acoustic wave cut-off frequency.

[0096] In this embodiment, it should be noted that the first transmission element may specifically include air and a conversion element. The conversion element is used to convert the initial acoustic wave signal into a planar acoustic wave signal, and may specifically be a waveguide. Herein, the specific shape of the waveguide in the embodiments of the present application is not limited, and may specifically be a circular waveguide or a square waveguide. In this embodiment, when the signal frequency of the initial acoustic wave signal of the initial sound source is greater than the cut-off frequency (acoustic wave cut-off frequency) of the waveguide, there is only a unique planar wave signal that propagates along the tube axis direction and has the same signal frequency in the waveguide. For example, in an implementable manner, referring to Figure 3 , Figure 3 As a schematic diagram showing the size parameters of different types of waveguides, the calculation formula for the cut-off frequency is as follows: When the waveguide is a rectangular waveguide, the calculation formula for the cut-off frequency is as follows:

[0097]

[0098] where, l x is the width of the square waveguide, l y is the height of the square waveguide, f c1 is the cut-off frequency of the square waveguide, and c 0 is the speed of sound in air.

[0099] When the waveguide is a circular waveguide, the calculation formula for the cut-off frequency is as follows:

[0100]

[0101] where, a is the radius of the circular waveguide; when the signal frequency of the initial acoustic wave signal of the initial sound source is less than the cut-off frequency of the waveguide, the purpose of converting the waveform of the acoustic wave signal can be achieved through the waveguide.

[0102] As an example, steps A10 to A20 include: calculating the acoustic cut-off frequency of the rectangular waveguide according to the width and height of the rectangular waveguide; when the signal frequency is less than the acoustic cut-off frequency, transmitting the initial acoustic wave signal through the waveguide to obtain at least one plane acoustic wave signal. Since the waveguide can guide the initial acoustic wave signal from one end to the other end, and when the signal frequency of the initial acoustic wave signal is less than the acoustic cut-off frequency of the waveguide, according to the waveguide theory, it can be ensured that the acoustic wave signal output by the waveguide is a plane acoustic wave signal with the same transmission direction. At the same time, since the cut-off frequency can be used to determine the conversion condition for the waveguide to convert into a plane wave, the determination time of the conversion condition is reduced. Therefore, while laying a foundation for reducing the limitations of the directional propagation of sound, the conversion efficiency of the acoustic wave signal of the initial sound source into a plane acoustic wave signal is improved.

[0103] In an implementable manner, by reasonably setting the size of the waveguide, it can be ensured that the initial acoustic wave signals under different sound sources can be smoothly converted into plane acoustic wave signals through the waveguide.

[0104] Among them, the audio playback system includes a focusing element. The step of playing the to-be-played audio corresponding to the directional acoustic wave signal formed by the common focusing of the plane acoustic wave signals includes:

[0105] Step B10, focusing the plane acoustic wave signals on a preset focusing position through the focusing element to obtain the directional acoustic wave signal;

[0106] Step B20, outputting the directional acoustic wave signal at the preset focusing position and playing the to-be-played audio corresponding to the directional acoustic wave signal.

[0107] In this embodiment, it should be noted that the second transmission element can specifically be a focusing element made of a transmission medium. The focusing element can specifically be a lens. That is, the transmission medium can be a solid material for making the lens. According to Snell's law, after ensuring that the acoustic wave signal transmitted through the waveguide is a plane acoustic wave signal, the plane acoustic wave signal is transmitted through the lens, which can ensure that the plane acoustic wave signal converges at the preset focusing position. Among them, the preset focusing position can specifically be the focal position of the lens. By setting the position where the user receives the acoustic wave signal at the focal position of the lens, the privacy of the user receiving the sound can be improved.

[0108] As an example, steps B10 to B20 include: focusing each of the plane acoustic wave signals together at a preset focusing position through the lens to obtain the directional acoustic wave signal, where the preset focusing position is the entrance of the user's ear canal; outputting the directional acoustic wave signal at the entrance of the user's ear canal to generate and play the to-be-played audio corresponding to the directional acoustic wave signal. Since the directional acoustic wave signal is transmitted to the user through the entrance of the user's ear canal, the technical defect that the acoustic wave signal is transmitted into the ear canals of other users in the open sound channel design can be avoided. Therefore, the privacy of sound transmission is improved.

[0109] Wherein, the focusing element includes a first focusing element and a second focusing element. Before the step of focusing each of the plane acoustic wave signals together at a preset focusing position through the focusing element to obtain the directional acoustic wave signal, the audio playback method further includes:

[0110] Step C10, respectively obtaining a first transmission parameter of the focusing element and a second transmission parameter of the conversion element

[0111] Step C20, detecting whether the first transmission parameter is greater than the second transmission parameter;

[0112] Step C30, if so, using the first focusing element as the focusing element;

[0113] Step C40, if not, using the second focusing element as the focusing element.

[0114] In this embodiment, it should be noted that before setting the waveguide and the lens for directional sound propagation, different structures can be adopted based on different requirements to build different audio playback systems. That is, the lens can be selected according to the actual scenario requirements. Among them, the first focusing element can be a concave lens, the second focusing element can be a convex lens, and the first transmission parameter and the second transmission parameter can specifically be the sound speeds in different transmission media. For example, in an implementable manner, referring to Figure 4 , Figure 4 is a schematic diagram showing the scenarios of focusing acoustic wave signals by different lenses. Among them, M1, M2, and M3 are plane acoustic wave signals, N1, N2, and N3 are acoustic wave signals transmitted through the lens, F is the focusing position of the lens, that is, the acoustic wave signal at point F is the directional acoustic wave signal, c m is the sound speed in the lens, c 0 is the sound speed in the air. Based on Snell's law, when the sound speed in the lens is greater than the sound speed of the air in the waveguide, that is, c m > c 0 , then at this time the refraction angle is greater than the incident angle. Therefore, a concave lens needs to be used for focusing the plane acoustic wave signal. When the sound speed in the lens is less than or equal to the sound speed of the air in the waveguide, that is, c m≤c 0 When it is 0 , a convex lens needs to be used at this time. The specific shape of the lens surface is not specifically limited. That is, the concave lens and the convex lens can specifically be a hyperboloid, a spherical surface, or an ellipsoidal surface, etc.

[0115] As an example, steps C10 to C40 include: respectively obtaining the first sound speed in the lens and the second sound speed of the transmission medium in the waveguide; detecting whether the first sound speed is greater than the second sound speed; if it is detected that the first sound speed is greater than the second sound speed, then use a concave lens as the lens for constructing the audio playback system; if it is detected that the first sound speed is less than or equal to the second sound speed, then use a convex lens as the lens of the audio playback system.

[0116] In an implementable manner, referring to Figure 5 , Figure 5 is a first structural schematic diagram of an audio playback system. Among them, the sound source is facing the waveguide, and the plane sound wave signal output by the waveguide is transmitted through a double-sided concave lens. Furthermore, the double-sided concave lens can generate a directional sound wave signal at the lens focus.

[0117] In another implementable manner, referring to Figure 6 , Figure 6 is a second structural schematic diagram of an audio playback system. In the audio playback system, in addition to setting a coupling structure where the sound source radiation surface faces the waveguide, a phase plug can also be added at the sound source to make the sound field at the waveguide entrance consistent with the sound field where the sound source radiation surface faces the waveguide. That is, the conversion efficiency of the waveguide for converting the initial sound wave signal into a plane sound wave signal is improved.

[0118] Among them, the focusing element includes a matching layer and a focusing layer. The step of focusing each of the plane sound wave signals on a preset focusing position through the focusing element to obtain the directional sound wave signal includes:

[0119] Step D10, transmitting each of the plane sound wave signals through the matching layer to obtain at least one sound wave transmission signal;

[0120] Step D20, focusing each of the sound wave transmission signals on the preset focusing position through the focusing layer to obtain the directional sound wave signal.

[0121] In this embodiment, it should be noted that due to the inevitable reflection phenomenon at the interface between the waveguide and the lens, for the lens, it is difficult to avoid the reflection problem of the plane acoustic wave signal unless a material with a different sound velocity from the waveguide transmission medium but exactly the same acoustic impedance can be found for lens manufacturing. To improve the focusing effect of the plane acoustic wave signal, a matching layer can be set at the junction of the waveguide and the lens, so that the plane acoustic wave signal first passes through the matching layer for transmission, thereby reducing the reflected wave to a certain extent. Among them, the relevant parameters of the matching layer are jointly determined by the waveguide and the wavelength of the plane acoustic wave signal of the lens. For example, in an implementable manner, assume that the acoustic impedance of the waveguide is m 1 , the acoustic impedance of the lens is m 2 , and the wavelength of the plane acoustic wave signal is n 0 , then the acoustic impedance and thickness of the matching layer are as follows:

[0122]

[0123]

[0124] Among them, m is the acoustic impedance of the matching layer, and n is the thickness of the matching layer. Among them, the focusing layer can be specifically understood as other parts of the lens except the matching layer.

[0125] As an example, steps D10 to D20 include: transmitting each of the plane acoustic wave signals through the matching layer to obtain at least one acoustic wave transmission signal; refracting each of the acoustic wave transmission signals at different angles through the focusing layer and focusing each of the acoustic wave transmission signals at the preset focusing position to obtain the directional acoustic wave signal.

[0126] Among them, the matching layer includes a first matching layer and a second matching layer. The step of transmitting each of the plane acoustic wave signals through the matching layer to obtain at least one acoustic wave transmission signal includes:

[0127] Step E10, transmitting each of the plane acoustic wave signals through the first matching layer with a first acoustic path to obtain at least one acoustic wave transmission signal; or,

[0128] Step E20, transmitting each of the plane acoustic wave signals through the first matching layer with the second acoustic path to obtain at least one acoustic wave transmission signal, where the first acoustic path is greater than the second acoustic path.

[0129] In this embodiment, it should be noted that when setting the matching layer, due to structural differences, the reflection degree of the reflected wave can be different. The first matching layer is used to represent the matching layer that realizes the total transmission of the reflected wave, that is, the transmission is completed through the material of the matching layer. The second matching layer is used to represent the matching layer that realizes approximate total transmission, that is, the transmission is completed through the structure of the matching layer. For example, in an implementable manner, referring to Figure 7 , Figure 7 FIG. Figure 7 is a schematic structural diagram of a waveguide acoustic lens combining a matching layer and a lens. Among them, the first acoustic path is l 0 , the second acoustic path is l 1 , l 1 = l 11 + l 12 + l 13 , that is, the acoustic path of the waveguide acoustic lens is higher than that of the lens. The first generated acoustic path is greater than the second acoustic path. To achieve an equivalent transmission effect and thus realize the lens function, increasing the acoustic path can be equivalent to reducing the sound speed within the lens range. In this structure, when a plane acoustic wave signal passes through the waveguide lens, since the plane acoustic wave signal can be transmitted along the pipeline between the plates, the second acoustic path that originally takes time t can be converted into the first acoustic path, so that the plane acoustic wave signal can converge to the same preset focusing position after passing through different acoustic paths.

[0130] As an example, steps E10 to E20 include: transmitting each of the plane acoustic wave signals through the first matching layer with the first acoustic path to obtain at least one acoustic wave transmission signal; or,

[0131] transmitting each of the plane acoustic wave signals through the first matching layer with the second acoustic path to obtain at least one acoustic wave transmission signal, where the first acoustic path is greater than the second acoustic path.

[0132] The embodiments of the present application provide an audio playback method, device, head-mounted open hearing device, and computer-readable storage medium, which are applied to an audio playback system. That is, the characteristic parameters of the initial acoustic wave signal are obtained; according to the characteristic parameters, the initial acoustic wave signal is converted into at least one plane acoustic wave signal; and the to-be-played audio corresponding to the directional acoustic wave signal formed by the common focusing of each of the plane acoustic wave signals is played.

[0133] When the embodiment of the present application plays audio, it first determines the characteristic parameters of the initial sound wave signal, and then converts the initial sound wave signal into at least one planar sound wave signal through the characteristic parameters. That is, it realizes the conversion of the signal transmitted in all directions by the sound source into a planar sound wave signal transmitted in the same direction, and then plays the to-be-played audio corresponding to the directional sound wave signal formed by focusing different planar sound wave signals. Since the directional sound wave signal is formed by focusing different planar sound wave signals, the purpose of directional sound propagation can be achieved, and then the to-be-played audio corresponding to the directional sound wave signal can be played at the target playback position. Therefore, after simple conversion and focusing of the initial sound wave signal, the purpose of automatic directional sound playback is realized.

[0134] Since the conversion and focusing of the sound wave signal are simpler to implement than the current technology of directional sound propagation, the scope of application of the method of directional sound propagation through the conversion and focusing of the sound wave signal is wider, and the purpose of reducing the limiting conditions of directional sound propagation is achieved.

[0135] Based on this, when the embodiment of the present application plays audio, after waveform conversion and signal focusing of the initial sound wave signal by the audio playback system, the purpose of playing the to-be-played audio corresponding to the directional sound wave signal can be achieved, thereby reducing the limiting conditions for realizing directional sound propagation. Instead of restricting the type or application scenario of the ultrasonic transmitter to achieve the preset sound collection effect. Therefore, it overcomes the technical defect that the limiting conditions for realizing directional sound propagation easily lead to a poor listening experience when users wear head-mounted open hearing devices, so the limitation of directional sound playback is reduced.

[0136] Embodiment Two

[0137] Further, referring to Figure 8 , in another embodiment of the present application, the content that is the same as or similar to the above Embodiment One can be referred to the above introduction and will not be elaborated later. On this basis, the first focusing element includes a first single-sided focusing element and a first multi-sided focusing element, and the step of using the first focusing element as the focusing element includes:

[0138] Step F10, predicting the ear canal depth of the wearing user according to the identity information of the wearing user;

[0139] Step F20, if it is detected that the ear canal depth is greater than the preset ear canal depth, then use the first single-sided focusing element as the focusing element;

[0140] Step F30, if it is detected that the ear canal depth is less than or equal to the preset ear canal depth, then use the first multi-sided focusing element as the focusing element.

[0141] In this embodiment, it should be noted that since the ear canal depths of different users are different, in order to set personalized sound collection requirements for different wearing users, that is, different users have different requirements for the preset focusing position. Furthermore, by setting different types of lenses, the focusing position of the lens can be changed. The first single-sided focusing element can specifically be a single-sided concave lens or a single-sided convex lens, and the second multi-sided focusing element can specifically be a double-sided concave lens or a double-sided convex lens. For example, in an implementable manner, assuming that the ear canal depth of user H is deeper than that of user J, the structure of the audio playback system can be designed with a single-sided concave lens or a single-sided convex lens to match the usage requirements of user H. That is, the interface between the waveguide and the lens is a plane, and the other side of the lens is concave or convex. The structure of the audio playback system can also be designed with a double-sided concave lens or a double-sided convex lens to match the usage requirements of user J. That is, for users with a deeper ear canal, the directional sound wave signal obtained by lens focusing is made farther, so as to better meet the privacy requirements for sound information. For users with a shallower ear canal, to avoid excessive sound interfering with the user experience, the directional sound wave signal obtained by lens focusing can be made relatively closer, improving the user experience while meeting the privacy requirements.

[0142] In addition, it should be noted that the identity information is used to represent the identity of the user, which can specifically be the user's age, gender, or race, etc. The prediction can specifically be carried out by means of a trained neural network model to extract the feature of the user's identity information. Then, according to the size relationship between the ear canal depth and the preset ear canal depth, an appropriately configured lens of the corresponding type is used to build the audio playback system, so that the directional sound wave signal output by the audio playback system is more adapted to the personalized needs of the user.

[0143] As an example, steps F10 to F30 include: extracting the identity feature of the user through a preset ear canal depth prediction model, and predicting the ear canal depth of the wearing user according to the identity feature; if it is detected that the ear canal depth is greater than the preset ear canal depth, then use the single-sided concave lens or the single-sided convex lens as the lens of the audio playback system; if it is detected that the ear canal depth is less than or equal to the preset ear canal depth, then use the double-sided concave lens or the double-sided convex lens as the lens of the audio playback system.

[0144] An embodiment of the present application provides a method for selecting a focusing element, that is, predicting the ear canal depth of the wearing user according to the identity information of the wearing user: if it is detected that the ear canal depth is greater than a preset ear canal depth, the first single-sided focusing element is used as the focusing element; if it is detected that the ear canal depth is less than or equal to the preset ear canal depth, the first multi-sided focusing element is used as the focusing element. When the focusing element is selected in the embodiment of the present application, a corresponding type of focusing element is adaptively selected for the wearing user as the focusing element of the audio playback system through the identity information of the wearing user, so that the focusing position of the directional sound wave signal played through the audio playback system matches the actual needs of the user, thereby improving the user experience. Therefore, it lays a foundation for improving the application scenario and application comfort of sound directional propagation when wearing a head-mounted open hearing device.

[0145] Embodiment III

[0146] An embodiment of the present application further provides an audio playback device, which is applied to an audio playback system. Referring to Figure 9 , the audio playback device includes:

[0147] An acquisition module 101, configured to acquire characteristic parameters of an initial sound wave signal;

[0148] A conversion module 102, configured to convert the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters;

[0149] A playback module 103, configured to play the to-be-played audio corresponding to the directional sound wave signal formed by jointly focusing each of the planar sound wave signals.

[0150] Optionally, the signal characteristic parameters include signal frequency, the audio playback system includes a conversion element, and the conversion module 102 is further configured to:

[0151] Determine a corresponding sound wave cut-off frequency according to the size parameters of the conversion element;

[0152] Select at least one planar sound wave signal from the initial sound wave signal according to the magnitude relationship between the signal frequency and the sound wave cut-off frequency.

[0153] Optionally, the audio playback system includes a focusing element, and the playback module 103 is further configured to:

[0154] Jointly focus each of the planar sound wave signals on a preset focusing position through the focusing element to obtain the directional sound wave signal;

[0155] Output the directional sound wave signal at the preset focusing position and play the to-be-played audio corresponding to the directional sound wave signal.

[0156] Optionally, the focusing element includes a first focusing element and a second focusing element, and the audio playback device is further configured to:

[0157] Obtain a first transmission parameter of the focusing element and a second transmission parameter of the conversion element respectively;

[0158] Detect whether the first transmission parameter is greater than the second transmission parameter;

[0159] If so, use the first focusing element as the focusing element;

[0160] If not, use the second focusing element as the focusing element.

[0161] Optionally, the first focusing element includes a first single-sided focusing element and a first multi-sided focusing element, and the audio playback device is further configured to:

[0162] Predict the ear canal depth of the wearing user according to the identity information of the wearing user:

[0163] If it is detected that the ear canal depth is greater than a preset ear canal depth, use the first single-sided focusing element as the focusing element;

[0164] If it is detected that the ear canal depth is less than or equal to the preset ear canal depth, use the first multi-sided focusing element as the focusing element.

[0165] Optionally, the focusing element includes a matching layer and a focusing layer, and the playback module 103 is further configured to:

[0166] Transmit each of the plane sound wave signals through the matching layer to obtain at least one sound wave transmission signal;

[0167] Focus each of the sound wave transmission signals on the preset focusing position through the focusing layer to obtain the directional sound wave signal.

[0168] Optionally, the matching layer includes a first matching layer and a second matching layer, and the playback module 103 is further configured to:

[0169] Transmit each of the plane sound wave signals through the first matching layer with a first sound path to obtain at least one sound wave transmission signal; or,

[0170] Transmit each of the plane sound wave signals through the first matching layer with the second sound path to obtain at least one sound wave transmission signal, where the first sound path is greater than the second sound path.

[0171] The audio playback system provided by the present invention adopts the audio playback method in the above-mentioned embodiment, and solves the technical problem of high limitation of sound directional playback. Compared with the prior art, the beneficial effects of the audio playback system provided by the embodiments of the present invention are the same as those of the audio playback method provided by the above-mentioned embodiment, and other technical features in the audio playback system are the same as the features disclosed in the method of the above-mentioned embodiment, and will not be elaborated herein.

[0172] Embodiment 4

[0173] The embodiments of the present invention provide a head-mounted open hearing device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the audio playback method in Embodiment 1 above.

[0174] Next, refer to Figure 10 , which shows a schematic structural diagram of a head-mounted open hearing device suitable for implementing the embodiments of the present disclosure. The head-mounted open hearing device in the embodiments of the present disclosure may include, but is not limited to, a Mixed Reality (MR) device (such as an MR glasses or an MR helmet), an Augmented Reality (AR) device (such as an AR glasses or an AR helmet), an Extended Reality (XR) device, or a combination thereof, etc. Figure 10 The head-mounted open hearing device shown is only an example and should not impose any limitations on the functions and usage scope of the embodiments of the present disclosure.

[0175] As Figure 10 shown, the head-mounted open hearing device may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage device 1003 into the random access memory (RAM) 1004. In the RAM 1004, various programs and data required for the operation of the head-mounted open hearing device are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. The input / output (I / O) interface 1006 is also connected to the bus.

[0176] Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and a communication device 1009. The communication device can allow the open-ear hearing device to communicate with other devices wirelessly or wiredly to exchange data. Although the open-ear hearing device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the shown systems. More or fewer systems can be alternatively implemented or had.

[0177] Specifically, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication device 1009, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0178] The open-ear hearing device provided by the present invention adopts the audio playback method in the above embodiment, and solves the technical problem of high limitations in sound directional playback. Compared with the prior art, the beneficial effects of the open-ear hearing device provided by the embodiment of the present invention are the same as those of the audio playback method provided by the above embodiment, and other technical features in the open-ear hearing device are the same as the features disclosed in the method of the above embodiment, which will not be elaborated here.

[0179] It should be understood that each part of the present disclosure can be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0180] The above is only the specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of changes or substitutions, which should all be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

[0181] Embodiment Five

[0182] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the audio playback method in the above embodiment.

[0183] The computer-readable storage medium provided by the embodiments of the present invention may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0184] The above computer-readable storage medium may be included in a head-mounted open hearing device; or may exist separately and not be assembled into the head-mounted open hearing device.

[0185] The above computer-readable storage medium carries one or more programs, which when executed by the head-mounted open hearing device, cause the head-mounted open hearing device to: obtain characteristic parameters of an initial sound wave signal; convert the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters; and play the audio to be played corresponding to the directional sound wave signal formed by the common focusing of the planar sound wave signals.

[0186] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The above programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0187] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code, which contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0188] The modules described in the embodiments of the present disclosure can be implemented in software or in hardware. In some cases, the name of the module does not constitute a limitation on the unit itself.

[0189] The computer-readable storage medium provided by the present invention stores computer-readable program instructions for executing the above audio playback method, and solves the technical problem of high limitations in sound directional playback. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiments of the present invention are the same as those of the audio playback method provided by the above embodiments, and will not be elaborated here.

[0190] Embodiment Six

[0191] This application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the steps of the audio playback method as described above.

[0192] The computer program product provided by this application solves the technical problem of high limitations in sound directional playback. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of the present invention are the same as those of the audio playback method provided by the above embodiments, and will not be elaborated here.

[0193] The above are only the preferred embodiments of this application, and do not limit the patent scope of this application. Any equivalent structural or equivalent process transformation made by using the content of the specification and drawings of this application, or directly or indirectly applied in other related technical fields, shall be included in the patent scope of this application by the same token.

Claims

1. An audio playback method, characterized in that, applied to an audio playback system, the audio playback method includes: Obtaining characteristic parameters of an initial sound wave signal; Converting the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters; Playing the to-be-played audio corresponding to the directional sound wave signal formed by the common focusing of each of the planar sound wave signals.

2. The audio playback method according to claim 1, characterized in that, the signal characteristic parameters include signal frequency, the audio playback system includes a conversion element, the step of converting the initial sound wave signal into at least one planar sound wave signal according to the characteristic parameters includes: Determining a corresponding sound wave cut-off frequency according to the size parameters of the conversion element; Selecting at least one planar sound wave signal from the initial sound wave signal according to the magnitude relationship between the signal frequency and the sound wave cut-off frequency.

3. The audio playback method according to claim 2, characterized in that, the audio playback system includes a focusing element, the step of playing the to-be-played audio corresponding to the directional sound wave signal formed by the common focusing of each of the planar sound wave signals includes: Commonly focusing each of the planar sound wave signals on a preset focusing position through the focusing element to obtain the directional sound wave signal; Outputting the directional sound wave signal at the preset focusing position and playing the to-be-played audio corresponding to the directional sound wave signal.

4. The audio playback method according to claim 3, characterized in that, the focusing element includes a first focusing element and a second focusing element, before the step of commonly focusing each of the planar sound wave signals on a preset focusing position through the focusing element to obtain the directional sound wave signal, the audio playback method further includes: Respectively obtaining a first transmission parameter of the focusing element and a second transmission parameter of the conversion element; Detecting whether the first transmission parameter is greater than the second transmission parameter; If so, using the first focusing element as the focusing element; If not, using the second focusing element as the focusing element.

5. The audio playback method according to claim 4, characterized in that, the first focusing element includes a first single-sided focusing element and a first multi-sided focusing element, the step of using the first focusing element as the focusing element includes: Predicting the ear canal depth of the wearing user according to the identity information of the wearing user: If it is detected that the ear canal depth is greater than a preset ear canal depth, using the first single-sided focusing element as the focusing element; If it is detected that the ear canal depth is less than or equal to the preset ear canal depth, using the first multi-sided focusing element as the focusing element.

6. The audio playback method according to claim 3, characterized in that, the focusing element includes a matching layer and a focusing layer, the step of commonly focusing each of the planar sound wave signals on a preset focusing position through the focusing element to obtain the directional sound wave signal includes: Transmitting each of the planar sound wave signals through the matching layer to obtain at least one sound wave transmission signal; Commonly focusing each of the sound wave transmission signals on the preset focusing position through the focusing layer to obtain the directional sound wave signal.

7. The audio playback method according to claim 6, wherein, the matching layer includes a first matching layer and a second matching layer, and the step of transmitting each of the planar acoustic wave signals through the matching layer to obtain at least one acoustic wave transmission signal includes: transmitting each of the planar acoustic wave signals through the first matching layer with a first acoustic path to obtain at least one acoustic wave transmission signal; or, transmitting each of the planar acoustic wave signals through the first matching layer with the second acoustic path to obtain at least one acoustic wave transmission signal, wherein the first acoustic path is greater than the second acoustic path.

8. An audio playback device, wherein, applied to an audio playback system, the audio playback device includes: an acquisition module configured to acquire characteristic parameters of an initial acoustic wave signal; a conversion module configured to convert the initial acoustic wave signal into at least one planar acoustic wave signal according to the characteristic parameters; a playback module configured to play back an audio to be played corresponding to a directional acoustic wave signal formed by focusing each of the planar acoustic wave signals.

9. A head-mounted open hearing device, wherein, the head-mounted open hearing device includes: at least one processor; a memory communicatively connected to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the steps of the audio playback method according to any one of claims 1 to 7.

10. A computer-readable storage medium, wherein, a program for implementing an audio playback method is stored on the computer-readable storage medium, and the program for implementing the audio playback method is executed by a processor to implement the steps of the audio playback method according to any one of claims 1 to 7.

Images