Audio adjustment method, device and equipment, readable storage medium and program product

Abstract

The invention relates to an audio adjustment method and device, equipment, a readable storage medium and a program product. The method comprises the following steps: acquiring target virtual sound source information; and outputting a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, the target audio signal being obtained based on the target virtual sound source information. The target audio signal needing to be output by the ultrasonic transducer is determined through the target virtual sound source information, the target audio signal can better meet the requirement of the virtual sound source needing to be generated, then the target audio signal is output through the ultrasonic transducer to generate the virtual sound source, and then the quality of the generated virtual sound source is improved.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and in particular to an audio adjustment method, device, equipment, readable storage medium and program product. Background Art

[0002] Virtual sound source usually refers to the creation of a virtual sound source point in a specific space through audio signal processing technology and parametric array speaker system.

[0003] However, the existing parametric array speaker system uses two or more different carrier frequencies to modulate and transmit to generate a virtual sound source. However, this method makes the positioning of the virtual sound source inaccurate and the radiation direction of the virtual sound source cannot be controlled, resulting in low quality of the generated virtual sound source. Summary of the invention

[0004] The embodiment of the present application provides an audio adjustment method, which can improve the quality of the generated virtual sound source to solve the above technical problems.

[0005] In order to achieve the above object, according to a first aspect of the present application, an audio adjustment method is provided, the method comprising:

[0006] Obtain target virtual sound source information;

[0007] A target audio signal is outputted through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, wherein the target audio signal is obtained based on the target virtual sound source information.

[0008] Optionally, the method further comprises:

[0009] The audio signal to be transmitted by the ultrasonic transducer is adjusted according to the target virtual sound source information to obtain a target audio signal.

[0010] Optionally, the target virtual sound source information includes an expected position and an expected radiation direction of the virtual sound source.

[0011] Optionally, the method further comprises:

[0012] According to the desired position, an offset angle of the ultrasonic transducer is determined.

[0013] Optionally, the method comprises:

[0014] The audio signal to be transmitted corresponding to the ultrasonic transducer is processed according to the offset angle and the expected radiation direction to obtain a target audio signal.

[0015] Optionally, the ultrasonic transducer includes an ultrasonic transducer array, and the ultrasonic transducer array includes a plurality of ultrasonic transducer array units.

[0016] Optionally, the offset angle includes an offset angle of each ultrasonic transducer array unit in the ultrasonic transducer; and the method further includes:

[0017] The audio signal to be transmitted is processed according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction to obtain a target sub-audio signal of each ultrasonic transducer array unit.

[0018] Optionally, outputting the target audio signal through an ultrasonic transducer includes:

[0019] Determine the propagation time corresponding to each ultrasonic transducer array unit according to the distance between the desired position and each ultrasonic transducer array unit; the propagation time is the time required for the ultrasonic transducer array unit to transmit to the desired position after outputting the audio signal;

[0020] Determining the delay information of each of the ultrasonic transducer array units according to the propagation time length corresponding to each of the ultrasonic transducer array units;

[0021] Through each of the ultrasonic transducer array units, the target sub-audio signal corresponding to each of the ultrasonic transducer array units is outputted according to the delay information.

[0022] Optionally, determining the delay information of each ultrasonic transducer array unit according to the propagation duration corresponding to each ultrasonic transducer array unit includes:

[0023] The delay information of each of the ultrasonic transducer array units is determined according to the difference between the propagation time corresponding to each of the ultrasonic transducer array units and the maximum propagation time among the propagation time.

[0024] Optionally, the processing of the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction to obtain the target sub-audio signal of each ultrasonic transducer array unit includes:

[0025] Determining a first weighting coefficient of each ultrasonic transducer array unit according to an angle difference between an offset angle of each ultrasonic transducer array unit and the desired radiation direction;

[0026] The audio signal to be transmitted is processed according to the first weighting coefficient of each ultrasonic transducer array unit to obtain a first audio signal of each ultrasonic transducer array unit, so as to determine a target sub-audio signal according to the first audio signal.

[0027] Optionally, determining a target sub audio signal according to the first audio signal includes:

[0028] Determining a second weighting coefficient of each of the ultrasonic transducer array units according to the offset angle of each of the ultrasonic transducer array units and a preset conversion relationship;

[0029] The first audio signal is processed according to the second weighting coefficient of each of the ultrasonic transducer array units to obtain a second audio signal of each of the ultrasonic transducer array units, so as to determine a target sub-audio signal according to the second target audio signal.

[0030] Optionally, the method further comprises:

[0031] According to the offset angle of each ultrasonic transducer array unit, adjusting the posture of each ultrasonic transducer array unit;

[0032] Each of the ultrasonic transducer array units after posture adjustment outputs a corresponding target sub-audio signal.

[0033] Optionally, the ultrasonic transducer array includes the same number of first ultrasonic transducer array units and second ultrasonic transducer array units, and the method further includes:

[0034] Converting the audio signal to be transmitted into a first audio signal to be transmitted and a second audio signal to be transmitted;

[0035] Performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first target audio signal of each of the first ultrasonic transducer array units;

[0036] The second audio signal to be transmitted is modulated to obtain a second target audio signal of each second ultrasonic transducer array unit.

[0037] Optionally, performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first target audio signal of each of the first ultrasonic transducer array units includes:

[0038] Performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first reference audio signal;

[0039] The first reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each of the first ultrasonic transducer array units to obtain a first target audio signal of each of the first ultrasonic transducer array units.

[0040] Optionally, the modulating the second audio signal to be transmitted to obtain the second target audio signal of each second ultrasonic transducer array unit includes:

[0041] performing modulation processing on the second audio signal to be transmitted to obtain a second reference audio signal;

[0042] The second reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each second ultrasonic transducer array unit to obtain a second target audio signal of each second ultrasonic transducer array unit.

[0043] According to a second aspect of the present application, an audio adjustment device is provided, the audio adjustment device comprising:

[0044] An acquisition module, used to acquire target virtual sound source information;

[0045] An output module is used to output a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, wherein the target audio signal is obtained based on the target virtual sound source information.

[0046] According to the third aspect of the present application, an embodiment of the present application further provides an electronic device, the electronic device includes a processor and a memory, the memory stores a computer program; when the computer program is executed by the processor, the processor executes the steps of the above-mentioned audio adjustment method.

[0047] According to the fourth aspect of the present application, an embodiment of the present application also provides a computer-readable storage medium, which stores multiple computer programs. The computer programs are suitable for loading by a processor to execute the steps of any audio adjustment method provided in the embodiment of the present application.

[0048] According to the fifth aspect of the present application, an embodiment of the present application also provides a computer program product, including a computer program or a computer program, which implements the steps of any audio adjustment method provided in the embodiment of the present application when the computer program or the computer program is executed by a processor.

[0049] The audio adjustment method of the embodiment of the present application obtains target virtual sound source information; outputs a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, and the target audio signal is obtained based on the target virtual sound source information. Determining the target audio signal that the ultrasonic transducer needs to output through the target virtual sound source information can make the target audio signal more in line with the requirements of the virtual sound source to be generated, and then generating a virtual sound source through the ultrasonic transducer outputting the target audio signal, thereby improving the quality of the generated virtual sound source.

[0050] Other features and advantages of the present application will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative work.

[0052] In order to more completely understand the present application and its beneficial effects, the following description will be given in conjunction with the accompanying drawings.

[0053] Figure 1 It is a flowchart of a first embodiment of the audio adjustment method provided by the present application;

[0054] Figure 2 is a flowchart of a second embodiment of the audio adjustment method provided by the present application;

[0055] Figure 3 is a flowchart of a third embodiment of the audio adjustment method provided by the present application;

[0056] Figure 4 It is a schematic diagram of the workflow of the virtual sound source construction module provided by this application;

[0057] Figure 5 It is a schematic diagram of the working process of the radiation direction control module provided by this application;

[0058] Figure 6 is a flowchart of a fourth embodiment of the audio adjustment method provided by the present application;

[0059] Figure 7 is a schematic diagram of the positional relationship between the virtual sound source and the ultrasonic transducer array unit provided by the present application;

[0060] Figure 8 is a flowchart of a fifth embodiment of the audio adjustment method provided by the present application;

[0061] Fig. 9 It is a schematic diagram of the audio signal processing flow provided by this application;

[0062] Fig.10 is a schematic diagram of the distribution positions of different types of ultrasonic transducer array units provided in the present application;

[0063] Fig.11 It is a structural schematic diagram of the audio adjustment device provided by the present application;

[0064] Fig.12 It is a structural schematic diagram of the electronic device provided by this application. DETAILED DESCRIPTION

[0065] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0066] Embodiments of the present application provide an audio adjustment method, apparatus, device, readable storage medium, and program product.

[0067] The audio adjustment method provided in the embodiment of the present application can be applied to electronic devices. The electronic device can be an audio adjustment device. The electronic device includes a smart terminal, a smart PC, etc., which is not specifically limited in the present application. It should be noted that the electronic device can be integrated into the electronic device or exist independently of the electronic device, which is not limited here.

[0068] The following is a detailed description with reference to the accompanying drawings. It should be noted that, for ease of description, the following embodiments are based on electronic devices as the execution subject, and the description order of the following embodiments is not intended to limit the preferred order of the embodiments. Although the logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different from that shown in the accompanying drawings.

[0069] Please refer to Figure 1 , a first embodiment of the audio adjustment method is proposed, and the audio adjustment method of the first embodiment includes the following steps:

[0070] Step 101, obtaining target virtual sound source information;

[0071] In this step, the electronic device obtains the target virtual sound source information. It is understandable that when a virtual sound source needs to be constructed, the user inputs the target virtual sound source information corresponding to the virtual sound source to be constructed into the electronic device, and then the electronic device obtains the target virtual sound source information.

[0072] Step 102: output a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, wherein the target audio signal is obtained based on the target virtual sound source information.

[0073] In this step, after the electronic device obtains the target virtual sound source information, it obtains the target audio signal based on the target virtual sound source information, and then outputs the target audio signal through the ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information. It can be understood that the target virtual sound source information includes various parameter information corresponding to the virtual sound source to be constructed, and the electronic device adjusts the audio signal to be emitted corresponding to the ultrasonic transducer according to the parameter information to obtain the target audio signal, and then outputs the target audio signal through the ultrasonic transducer to generate the corresponding virtual sound source.

[0074] The electronic device of this embodiment obtains target virtual sound source information; outputs a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, and the target audio signal is obtained based on the target virtual sound source information. Determining the target audio signal that the ultrasonic transducer needs to output through the target virtual sound source information can make the target audio signal more consistent with the requirements of the virtual sound source to be generated, and then generating a virtual sound source through the ultrasonic transducer outputting the target audio signal, thereby improving the quality of the generated virtual sound source.

[0075] Specifically, refer to Figure 2 , a second embodiment of the present application is proposed. The difference between the second embodiment and the first embodiment is that the method further includes:

[0076] Step 201: adjusting the audio signal to be transmitted by the ultrasonic transducer according to the target virtual sound source information to obtain a target audio signal.

[0077] In this step, the electronic device obtains the target virtual sound source information, and adjusts the audio signal to be transmitted corresponding to the ultrasonic transducer according to the target virtual sound source information to obtain the target audio signal. It can be understood that when a virtual sound source needs to be constructed, the user inputs the target virtual sound source information into the electronic device, inputs the audio signal to be transmitted into the ultrasonic transducer, and then the electronic device adjusts the audio signal to be transmitted of the ultrasonic transducer according to the target virtual sound source information to obtain the target audio signal.

[0078] Furthermore, the target virtual sound source information includes an expected position and an expected radiation direction of the virtual sound source, and the electronic device determines the offset angle of the ultrasonic transducer according to the expected position.

[0079] Specifically, the electronic device determines the offset angle of the ultrasonic transducer according to the expected position in the target virtual sound source information; optionally, the electronic device determines the positional relationship between the ultrasonic transducer and the virtual sound source to be constructed according to the position of the ultrasonic transducer and the expected position in the target virtual sound source information, and determines the offset angle of the ultrasonic transducer according to the positional relationship. Optionally, the ultrasonic transducer includes a plurality of ultrasonic transducer array units, and the offset angle of the ultrasonic transducer includes the offset angle of each ultrasonic transducer array unit. The electronic device determines the positional relationship between each ultrasonic transducer array unit and the virtual sound source to be constructed according to the position of each ultrasonic transducer array unit and the expected position in the target virtual sound source information, and determines the offset angle of each ultrasonic transducer array unit according to the positional relationship.

[0080] Further, step 201 includes:

[0081] Step 1012: Process the audio signal to be transmitted corresponding to the ultrasonic transducer according to the offset angle and the expected radiation direction to obtain a target audio signal.

[0082] In this step, the electronic device processes the audio signal to be transmitted according to the offset angle of the ultrasonic transducer and the expected radiation direction in the target virtual sound source information to obtain the target audio signal. Optionally, the ultrasonic transducer includes a plurality of ultrasonic transducer array units, the offset angle of the ultrasonic transducer includes the offset angle of each ultrasonic transducer array unit, and the electronic device processes the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction in the target virtual sound source information to obtain the target audio signal of each ultrasonic transducer array unit.

[0083] Further, after determining the target audio signal, the electronic device outputs the target audio signal through the ultrasonic transducer to generate a virtual sound source. Optionally, the electronic device adjusts the posture of the ultrasonic transducer according to the offset angle so that the ultrasonic transducer reaches the offset angle, and then outputs the target audio signal through the ultrasonic transducer adjusted to the offset angle to generate a virtual sound source in the desired position. Optionally, the electronic device adjusts the posture of each ultrasonic transducer array unit according to the offset angle of each ultrasonic transducer array unit in the ultrasonic transducer so that each ultrasonic transducer array unit reaches the corresponding offset angle, and then outputs its corresponding target audio signal through each ultrasonic transducer array unit adjusted to the corresponding offset angle to generate a virtual sound source in the desired position.

[0084] The electronic device of this embodiment determines the offset angle of the ultrasonic transducer according to the expected position in the target virtual sound source information, and then processes the audio signal to be transmitted corresponding to the ultrasonic transducer according to the offset angle and the expected radiation direction to obtain the target audio signal, which can improve the target audio signal to better meet the requirements of the virtual sound source to be generated; then, based on the ultrasonic transducer outputting the target audio signal, a virtual sound source is generated in the expected position, thereby improving the quality of the generated virtual sound source.

[0085] Specifically, refer to Figure 3 , a third embodiment of the present application is proposed. The difference between the third embodiment and the first embodiment and the second embodiment is that the method further includes:

[0086] Step 301: Process the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction to obtain a target sub-audio signal of each ultrasonic transducer array unit.

[0087] In this step, the ultrasonic transducer includes an ultrasonic transducer array, the ultrasonic transducer array includes a plurality of ultrasonic transducer array units, and the offset angle of the ultrasonic transducer includes the offset angle of each ultrasonic transducer array unit. After determining the offset angle of each ultrasonic transducer array unit in the ultrasonic transducer, the electronic device processes the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction in the target virtual sound source information, and obtains the target audio signal of each ultrasonic transducer array unit. It should be noted that in the process of constructing a virtual sound source, the electronic device can determine the ultrasonic transducer array unit in the ultrasonic transducer that needs to be used according to actual conditions; wherein only part of the ultrasonic transducer array units in the ultrasonic transducer may be used, or all the ultrasonic transducer array units in the ultrasonic transducer may need to be used; when only part of the ultrasonic transducer array units in the ultrasonic transducer are used, it is only necessary to determine the target audio signal of the part of the ultrasonic transducer array units, and when all the ultrasonic transducer array units in the ultrasonic transducer are needed, it is only necessary to determine the target audio signal of each ultrasonic transducer array unit.

[0088] Specifically, the process of processing the audio signal to be transmitted includes delay and weight processing, as well as weighted processing; since the distance between each ultrasonic transducer array unit in the ultrasonic transducer and the virtual sound source is different, the amplitude and phase of the audio signal to be transmitted are adjusted through delay and weight processing, so that the target audio signal emitted by each ultrasonic transducer array unit arrives at the desired position of the virtual sound source to be constructed at the same time and with the same amplitude, thereby realizing the fixed-point and fixed-length construction of the virtual sound source; the weighted processing adjusts the radiation direction of the audio signal to be transmitted, so that a virtual sound source with any radiation direction can be constructed at the desired position.

[0089] For example, reference Figure 4 and Figure 5 The electronic device includes a virtual sound source construction module and a radiation direction control module, and the electronic device transmits the audio signal to be transmitted (S AM (t)) is input into the virtual sound source construction module, and the virtual sound source construction module delays and weights the transmitted audio signal according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction in the target virtual sound source information to obtain the reference audio signal (S′) of each ultrasonic transducer array unit. -N (t)……S′0(t)……S′ N (t), wherein the number of ultrasonic transducer array units is 2N, -N to N are numbers corresponding to each ultrasonic transducer array unit); after the electronic device obtains the reference audio signal of each ultrasonic transducer array unit, the reference audio signal of each ultrasonic transducer array unit is adjusted by audio and input into the radiation direction control module, and the radiation direction control module performs weighted processing on the reference audio signal of each ultrasonic transducer array unit based on the expected radiation direction in the target virtual sound source information, so as to obtain the target audio signal (S) of each ultrasonic transducer array unit. -N (t)……S0(t)……S N (t), wherein the number of ultrasonic transducer array units is 2N, -N to N are the numbers corresponding to each ultrasonic transducer array unit).

[0090] Furthermore, after determining the target audio signal corresponding to each ultrasonic transducer array unit, the electronic device outputs the corresponding target audio signal through each ultrasonic transducer array unit in the ultrasonic transducer, so as to construct a virtual sound source at a desired position.

[0091] The electronic device in this embodiment processes the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction in the target virtual sound source information, obtains the target audio signal of each ultrasonic transducer array unit, and outputs the corresponding target audio signal through each ultrasonic transducer array unit in the ultrasonic transducer, thereby realizing the construction of a virtual sound source at a fixed point and fixed length, and a virtual sound source of any radiation direction at a desired position, thereby improving the quality of the generated virtual sound source.

[0092] Specifically, refer to Figure 6 , a fourth embodiment of the present application is proposed. The difference between the fourth embodiment and the first to third embodiments is that the target audio signal is output through the ultrasonic transducer, including:

[0093] Step 401, determining the propagation time corresponding to each of the ultrasonic transducer array units according to the distance between the desired position and each of the ultrasonic transducer array units; the propagation time is the time required for the ultrasonic transducer array unit to transmit to the desired position after outputting the audio signal;

[0094] In this step, the electronic device determines the propagation time corresponding to each ultrasonic transducer array unit according to the distance between the desired position and each ultrasonic transducer array unit; wherein the propagation time is the time required for the ultrasonic transducer array unit to transmit to the desired position after outputting the audio signal. Specifically, the electronic device determines the distance between the desired position and each ultrasonic transducer array unit according to the desired position and the position information of each ultrasonic transducer array unit, and then determines the propagation time corresponding to each ultrasonic transducer array unit according to the sound propagation speed and distance.

[0095] For example, Figure 7 As shown, a coordinate system is established with the center point of the speaker array as the origin. In this coordinate system, the coordinates of the desired position are (x, r), the position coordinates of each ultrasonic transducer array unit are (-Nd, 0) to (Nd, 0), d is the spacing distance between two ultrasonic transducer array units, and the offset angle of each ultrasonic transducer array unit is φ-N to φN. For each ultrasonic transducer array unit, the electronic device is based on the formula: Determine the propagation time corresponding to each ultrasonic transducer array unit, where τ n is the propagation time corresponding to each ultrasonic transducer array unit, dn is the horizontal coordinate of the position coordinate of the ultrasonic transducer array unit, c is the speed of sound, and φn is the offset angle of each ultrasonic transducer array unit.

[0096] Step 402, determining the delay information of each of the ultrasonic transducer array units according to the propagation time length corresponding to each of the ultrasonic transducer array units;

[0097] In this step, the electronic device determines the delay information of each ultrasonic transducer array unit according to the propagation time length corresponding to each ultrasonic transducer array unit.

[0098] Specifically, step 402 includes:

[0099] Step 4021: Determine the delay information of each of the ultrasonic transducer array units according to the difference between the propagation time corresponding to each of the ultrasonic transducer array units and the maximum propagation time among the propagation time.

[0100] In this step, the electronic device determines the delay information of each ultrasonic transducer array unit according to the difference between the propagation time corresponding to each ultrasonic transducer array unit and the maximum propagation time in the propagation time; illustratively, Figure 7 As shown, the two ultrasonic transducer array units with position coordinates (-Nd, 0) and (Nd,, 0) in the speaker array are farthest from the desired position. Correspondingly, the maximum propagation time in the propagation time can only be the propagation time of one of the two ultrasonic transducer array units farthest from the desired position. The electronic device is based on the formula: Determine the delay information of each ultrasonic transducer array unit; that is, first calculate the propagation time τ of the ultrasonic transducer array unit with the position coordinate (-Nd, 0) -N and the propagation time τ of the ultrasonic transducer array unit with position coordinates (Nd, 0) N For comparison, if τ N >τ -N , then the maximum propagation time is determined to be τ N , according to the propagation time τ corresponding to each ultrasonic transducer array unit n With τ N The difference between the two determines the delay information of each ultrasonic transducer array unit. If τ N >τ -N , then the maximum propagation time is determined to be τ -N , according to the propagation time τ corresponding to each ultrasonic transducer array unit n With τ -N The delay information of each ultrasonic transducer array unit is determined by the difference.

[0101] Step 403: Control output of a target sub-audio signal corresponding to each of the ultrasonic transducer array units according to the delay information through each of the ultrasonic transducer array units.

[0102] In this step, the electronic device controls the output of the target sub-audio signal corresponding to the ultrasonic transducer array unit through each ultrasonic transducer array unit in the ultrasonic transducer according to the delay information. Specifically, after determining the delay information of each ultrasonic transducer array unit, the electronic device performs phase shift processing on the audio signal to be transmitted according to the delay information of each ultrasonic transducer array unit to obtain the target sub-audio signal corresponding to each ultrasonic transducer array unit. Exemplarily, the target sub-audio signal corresponding to each ultrasonic transducer array unit can be expressed as: s′ n (t) = s AM (t-Δτ n ), where Δτ n Delay information for each ultrasonic transducer array unit.

[0103] The electronic device of this embodiment determines the propagation time corresponding to each ultrasonic transducer array unit according to the distance between the expected position and each ultrasonic transducer array unit; determines the delay information of each ultrasonic transducer array unit according to the propagation time corresponding to each ultrasonic transducer array unit; and controls the output of the target sub-audio signal corresponding to each ultrasonic transducer array unit according to the delay information through each ultrasonic transducer array unit. The phase of the audio signal to be transmitted is adjusted by delay processing, so that the time for the target sub-audio signal emitted by each ultrasonic transducer array unit to reach the expected position of the virtual sound source to be constructed is the same, so that the virtual sound source is constructed at a fixed point and with a fixed length, and the quality of the generated virtual sound source is improved.

[0104] In one embodiment, the processing of the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction to obtain the target sub-audio signal of each ultrasonic transducer array unit includes:

[0105] Step a, determining a first weighting coefficient of each ultrasonic transducer array unit according to the angle difference between the offset angle of each ultrasonic transducer array unit and the desired radiation direction;

[0106] In this step, the electronic device determines the first weighting coefficient of each ultrasonic transducer array unit according to the angle difference between the offset angle of each ultrasonic transducer array unit and the desired radiation direction in the target virtual sound source information; specifically, the electronic device determines the first weighting coefficient of each ultrasonic transducer array unit according to the formula: dy n (β) = -0.0012 (β - φ n )2-0.0056(β-φ n )-0.0012, determine the first weighting coefficient of each ultrasonic transducer array unit, where dyn(β) is the first weighting coefficient, β is the expected radiation direction in the target virtual sound source information, φ n is the offset angle of each ultrasonic transducer array unit.

[0107] Step b: processing the audio signal to be transmitted according to the first weighting coefficient of each ultrasonic transducer array unit to obtain the first audio signal of each ultrasonic transducer array unit, so as to determine the target sub-audio signal according to the first audio signal.

[0108] In this step, the electronic device processes the audio signal to be transmitted according to the first weighting coefficient of each ultrasonic transducer array unit to obtain the first audio signal of each ultrasonic transducer array unit, so as to determine the target sub-audio signal according to the first audio signal. Specifically, the electronic device processes the audio signal to be transmitted according to the first weighting coefficient of each ultrasonic transducer array unit to obtain the first audio signal of each ultrasonic transducer array unit, so as to determine the target sub-audio signal according to the first audio signal. n (t) = 10 dyn (β) / 20s′ n (t), determine the target audio signal of each ultrasonic transducer array unit, where s n (t) is the target sub-audio signal, s′ n (t) is the audio signal to be transmitted.

[0109] Specifically, step b includes:

[0110] Step b1, determining a second weighting coefficient of each of the ultrasonic transducer array units according to the offset angle of each of the ultrasonic transducer array units and a preset conversion relationship;

[0111] In this step, the electronic device determines the second weighting coefficient of each ultrasonic transducer array unit according to the offset angle of each ultrasonic transducer array unit and the preset conversion relationship; specifically, the electronic device determines the second weighting coefficient of each ultrasonic transducer array unit according to the formula: Calculate the second weighting coefficient of each ultrasonic transducer array element, where φ n is the offset angle of each ultrasonic transducer array unit.

[0112] Step b2: Processing the first audio signal according to the second weighting coefficient of each ultrasonic transducer array unit to obtain a second audio signal of each ultrasonic transducer array unit, so as to determine a target sub-audio signal according to the second target audio signal.

[0113] In this step, the electronic device processes the first audio signal according to the second weighting coefficient of each ultrasonic transducer array unit to obtain the target sub-audio signal of each ultrasonic transducer array unit. Specifically, the electronic device first processes the audio signal to be transmitted according to the second weighting coefficient to obtain a reference audio signal: s′ n (t) = ε n s AM (t-Δτ n ), where s AM (t-Δτ n ) is the audio signal to be transmitted after delay processing ε n is the second weighting coefficient of each ultrasonic transducer array element, Δτ n is the delay information of each ultrasonic transducer array unit, s′ n (t) is the reference audio signal; after obtaining the reference audio signal, the electronic device uses the formula: n (t) = 10 dyn (β) / 20s′ n (t), the reference audio signal is divided and processed to obtain the target sub-audio signal of each ultrasonic transducer array unit, where s n (t) is the target sub-audio signal, and dyn(β) is the first weighting coefficient of each ultrasonic transducer array unit.

[0114] Furthermore, the method further comprises:

[0115] Step c, adjusting the posture of each of the ultrasonic transducer array units according to the offset angle of each of the ultrasonic transducer array units;

[0116] Step d: outputting corresponding target audio signals respectively through each of the ultrasonic transducer array units after posture adjustment in the ultrasonic transducer.

[0117] In step c to step d, the electronic device adjusts the posture of each ultrasonic transducer array unit according to the offset angle of each ultrasonic transducer array unit, so that each ultrasonic transducer array unit reaches the corresponding offset angle, and then outputs the corresponding target audio signal through each ultrasonic transducer array unit that reaches the corresponding offset angle in the ultrasonic transducer, so as to generate a virtual sound source in the desired position and determine the radiation direction of the virtual sound source.

[0118] The electronic device of this embodiment determines the second weighting coefficient of each ultrasonic transducer array unit according to the offset angle of each ultrasonic transducer array unit; processes the audio signal to be transmitted according to the first weighting coefficient and the second weighting coefficient of each ultrasonic transducer array unit to obtain the target audio signal of each ultrasonic transducer array unit. The second weighting coefficient is used to make the amplitude of the target audio signal emitted by each ultrasonic transducer array unit to reach the expected position of the virtual sound source to be constructed the same, so as to realize the construction of the virtual sound source with fixed point and fixed length; the radiation direction of the audio signal to be transmitted is adjusted by the first weighting coefficient, so that a virtual sound source with any radiation direction can be constructed at the expected position, thereby improving the quality of the generated virtual sound source.

[0119] refer to Figure 8 , a fifth embodiment of the present application is proposed. The difference between the fifth embodiment and the first to fourth embodiments is that the method further includes:

[0120] Step 501, converting the audio signal to be transmitted into a first audio signal to be transmitted and a second audio signal to be transmitted;

[0121] In this step, the electronic device converts the audio signal to be transmitted into a first audio signal to be transmitted and a second audio signal to be transmitted, wherein the first audio signal to be transmitted and the second audio signal to be transmitted are the same audio signal, and the electronic device only divides the originally single-channel audio signal to be transmitted into a dual-channel audio signal to be transmitted to obtain the first audio signal to be transmitted and the second audio signal to be transmitted.

[0122] Step 502: performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first target audio signal of each of the first ultrasonic transducer array units;

[0123] In this step, the electronic device performs phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first reference audio signal, and processes the first reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each first ultrasonic transducer array unit to obtain the first target audio signal of each first ultrasonic transducer array unit.

[0124] Step 503: Modulate the second audio signal to be transmitted to obtain a second target audio signal for each of the second ultrasonic transducer array units.

[0125] In this step, the electronic device modulates the second audio signal to be transmitted to obtain a second reference audio signal, and processes the second reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each second ultrasonic transducer array unit to obtain the second target audio signal of each first ultrasonic transducer array unit.

[0126] Specifically, step 502 includes:

[0127] Step 5021, performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first reference audio signal;

[0128] Step 5022: Process the first reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each of the first ultrasonic transducer array units to obtain a first target audio signal of each of the first ultrasonic transducer array units.

[0129] Specifically, step 503 includes:

[0130] Step 5031, modulating the second audio signal to be transmitted to obtain a second reference audio signal;

[0131] Step 5032: Process the second reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each of the second ultrasonic transducer array units to obtain a second target audio signal of each of the second ultrasonic transducer array units.

[0132] Specifically, Fig. 9 As shown, the electronic device first pre-processes the audio signal to be transmitted to obtain a pre-processed digital audio signal, and then converts the pre-processed digital audio signal into a first audio signal to be transmitted and a second audio signal to be transmitted. The first audio signal to be transmitted is modulated after passing through a first-level Hilbert transform. The first-level Hilbert transform can complete the signal Phase shift, then double-sideband modulation and pulse density modulation are performed to obtain the first reference audio signal. In order to maintain synchronization with the first audio signal to be transmitted, the second audio signal to be transmitted is delayed, and then double-sideband modulation and pulse density modulation are performed to obtain the second reference audio signal. Fig.10As shown, the speaker array in the speaker device includes the same number of first ultrasonic transducer array units and second ultrasonic transducer array units, the first ultrasonic transducer array unit is a first type of transducer device, and the second ultrasonic transducer array unit is a second type of transducer device. The electronic device processes the first reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each first ultrasonic transducer array unit to obtain the first target audio signal of each first ultrasonic transducer array unit. The second reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each second ultrasonic transducer array unit to obtain the second target audio signal of each second ultrasonic transducer array unit. It should be noted that the specific process of obtaining the first target audio signal and the second target audio signal is the same as the specific process of obtaining the target audio signal mentioned above, which will not be repeated here; the phase difference between the first target audio signal and the second target audio signal

[0133] Further, the outputting the target audio signal through the ultrasonic transducer to generate a virtual sound source includes:

[0134] Step e, adjusting the posture of each of the first ultrasonic transducer array units according to the offset angle of each of the first ultrasonic transducer array units;

[0135] Step f, adjusting the posture of each of the second ultrasonic transducer array units according to the offset angle of each of the second ultrasonic transducer array units;

[0136] In step e to step f, the electronic device performs posture adjustment on each first ultrasonic transducer array unit according to the offset angle of each first ultrasonic transducer array unit, so that each first ultrasonic transducer array unit reaches its corresponding offset angle; and performs posture adjustment on each second ultrasonic transducer array unit according to the offset angle of each second ultrasonic transducer array unit, so that each second ultrasonic transducer array unit reaches its corresponding offset angle.

[0137] Step g, transmitting a corresponding first target audio signal through each of the first ultrasonic transducer array units after the posture adjustment in the ultrasonic transducer, and transmitting a corresponding second target audio signal through the second ultrasonic transducer array unit after the posture adjustment in the ultrasonic transducer to generate a virtual sound source.

[0138] In this step, the electronic device transmits the corresponding first target audio signal through each first ultrasonic transducer array unit after the posture adjustment in the ultrasonic transducer, and transmits the corresponding second target audio signal through the second ultrasonic transducer array unit after the posture adjustment in the ultrasonic transducer, so as to generate a virtual sound source. In which, since the number of the first ultrasonic transducer array unit and the second ultrasonic transducer array unit is the same, the phase difference between the first target audio signal transmitted by each first ultrasonic transducer array unit and the second target audio signal transmitted by each second ultrasonic transducer array unit is When the phase difference between the two emitted beams is When sound waves are transmitted, after they are self-demodulated in the air, the second harmonic and the sum frequency cancel each other out, leaving only the difference frequency, the harmonic distortion is reduced, and the sound quality can be improved.

[0139] It should be noted that the ultrasonic transducer is a parametric array speaker, which uses ultrasonic waves as carriers and modulates audible sound signals on the sidebands of ultrasonic carriers. Due to the nonlinear propagation effect of air, ultrasonic waves will continuously self-demodulate audible sound signals during propagation. However, in the process of self-demodulation of ultrasonic waves, in addition to the desired fundamental frequency components, other harmonics are also generated. These harmonics will affect the quality of the sound and cause output signal distortion.

[0140] In the performance test of the parametric array speaker system, distortion refers to the distortion of the self-demodulated audible sound signal compared to the input audible sound signal. Total harmonic distortion (THD) is a parameter used to define the degree of harmonic distortion of the output signal relative to the input signal. Its expression is formula (1), as follows:

[0141]

[0142] In the formula, p i is the fundamental frequency amplitude, p j is the harmonic amplitude.

[0143] According to the Berktay theory, the relationship between the sound pressure of the self-demodulated output signal and the input signal envelope can be established as formula (2), as follows:

[0144]

[0145] Where β is the nonlinear coefficient in the air medium, p0 is the sound pressure amplitude of the original signal, S is the sound source area, ρ0 is the density balance value, α0 is the sound attenuation coefficient, z is the sound wave propagation distance, E(t) is the modulation envelope function, and t is the delay time.

[0146] Formula (2) lays the theoretical foundation for parametric array loudspeakers and is the basis for the research and development of parametric array signal processing methods.

[0147] Double sideband modulation is the method with the lowest computational cost and the simplest structure among all modulation methods, so the parametric array system adopts double sideband modulation.

[0148] If the sound source signal is a single-frequency signal, that is, s1(t) = sin(ω s t). The envelope function of the modulated sound source signal can be expressed as E1(t)=1+msin(ω s t), where m is the modulation coefficient. Substituting E1(t) into formula (2), we get formula (3):

[0149]

[0150] From formula (3), it can be seen that if DSB modulation is used, the second harmonic 2ω will appear. s ,

[0151]

[0152] When the phase of the sound source signal is delayed Right now Its envelope function is Substituting E2(t) into formula (2), we can get formula (4):

[0153]

[0154] When these two single-frequency signals are self-demodulated in the air at the same time, their sound pressure is expressed by formula (5):

[0155]

[0156] It can be seen from formula (4) that there is no second harmonic at this time, and THD=0.

[0157] When the sound source signal is a dual-frequency signal, that is, s1(t)=sin(ω s1 t)+sin(ω s2 t), its envelope function is E1(t)=1+m(sin(ω s1 t)+sin(ω s2 t)), substituting E1(t) into formula (2), we can get formula (6):

[0158]

[0159] From formula (5), it can be seen that if DSB modulation is used, harmonic 2ω will appear. s1 , 2ω s2 ,ω s1 -ω s2 ,ω s1 +ω s2 ,

[0160] When the phase of the sound source signal is delayed Right now Its envelope function is Substituting E2(t) into formula (2), we can obtain formula (7):

[0161]

[0162] When these two single-frequency signals are self-demodulated in the air at the same time, their sound pressure is expressed by formula (8):

[0163]

[0164] From formula (7), we can see that at this time, the second harmonic and sum frequency no longer exist, and only the difference frequency remains.

[0165] It can be seen that when the phase difference between the two emitted beams is When sound waves are generated, after they are self-demodulated in the air, the second harmonic and the sum frequency cancel each other out, leaving only the difference frequency, and the harmonic distortion is reduced.

[0166] The electronic device of this embodiment converts the audio signal to be transmitted into a first audio signal to be transmitted and a second audio signal to be transmitted; performs phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first reference audio signal, and performs modulation processing on the second audio signal to be transmitted to obtain a second reference audio signal; processes the first reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each first ultrasonic transducer array unit to obtain the first target audio signal of each first ultrasonic transducer array unit; processes the second reference audio signal according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each second ultrasonic transducer array unit to obtain the second target audio signal of each second ultrasonic transducer array unit. According to the offset angle of each first ultrasonic transducer array unit, the posture of each first ultrasonic transducer array unit is adjusted; according to the offset angle of each second ultrasonic transducer array unit, the posture of each second ultrasonic transducer array unit is adjusted; the corresponding first target audio signal is transmitted through each first ultrasonic transducer array unit after the posture adjustment in the ultrasonic transducer, and the corresponding second target audio signal is transmitted through the second ultrasonic transducer array unit after the posture adjustment in the ultrasonic transducer to generate a virtual sound source, so that the user can hear a higher quality virtual sound source.

[0167] Accordingly, reference Fig.11 The present application also provides an audio adjustment device, the audio adjustment device comprising:

[0168] An acquisition module 1001 is used to acquire target virtual sound source information;

[0169] The output module 1002 is used to output a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, and the target audio signal is obtained based on the target virtual sound source information.

[0170] Optionally, the audio adjustment device further includes an adjustment module, and the adjustment module is used to:

[0171] The audio signal to be transmitted by the ultrasonic transducer is adjusted according to the target virtual sound source information to obtain a target audio signal.

[0172] Optionally, the audio adjustment device further includes a determination module, and the determination module is used to:

[0173] According to the expected position, the offset angle of the ultrasonic transducer is determined, and the target virtual sound source information includes the expected position and expected radiation direction of the virtual sound source.

[0174] Optionally, the determination module is further configured to:

[0175] The audio signal to be transmitted corresponding to the ultrasonic transducer is processed according to the offset angle and the expected radiation direction to obtain a target audio signal.

[0176] Optionally, the determination module is further configured to:

[0177] According to the offset angle of each ultrasonic transducer array unit and the expected radiation direction, the audio signal to be transmitted is processed to obtain the target sub-audio signal of each ultrasonic transducer array unit; the ultrasonic transducer includes an ultrasonic transducer array, and the ultrasonic transducer array includes a plurality of ultrasonic transducer array units; the offset angle includes the offset angle of each ultrasonic transducer array unit in the ultrasonic transducer.

[0178] Optionally, the output module is further configured to:

[0179] Determine the propagation time corresponding to each ultrasonic transducer array unit according to the distance between the desired position and each ultrasonic transducer array unit; the propagation time is the time required for the ultrasonic transducer array unit to transmit to the desired position after outputting the audio signal;

[0180] Determining the delay information of each of the ultrasonic transducer array units according to the propagation time length corresponding to each of the ultrasonic transducer array units;

[0181] Through each of the ultrasonic transducer array units, the target sub-audio signal corresponding to each of the ultrasonic transducer array units is outputted according to the delay information.

[0182] Optionally, the output module is further configured to:

[0183] The delay information of each of the ultrasonic transducer array units is determined according to the difference between the propagation time corresponding to each of the ultrasonic transducer array units and the maximum propagation time among the propagation time.

[0184] Optionally, the determination module is further configured to:

[0185] Determining a first weighting coefficient of each ultrasonic transducer array unit according to an angle difference between an offset angle of each ultrasonic transducer array unit and the desired radiation direction;

[0186] The audio signal to be transmitted is processed according to the first weighting coefficient of each ultrasonic transducer array unit to obtain a first audio signal of each ultrasonic transducer array unit, so as to determine a target sub-audio signal according to the first audio signal.

[0187] Optionally, the determination module is further configured to:

[0188] Determining a second weighting coefficient of each of the ultrasonic transducer array units according to the offset angle of each of the ultrasonic transducer array units and a preset conversion relationship;

[0189] The first audio signal is processed according to the second weighting coefficient of each of the ultrasonic transducer array units to obtain a second audio signal of each of the ultrasonic transducer array units, so as to determine a target sub-audio signal according to the second target audio signal.

[0190] Optionally, the output module is further configured to:

[0191] According to the offset angle of each ultrasonic transducer array unit, adjusting the posture of each ultrasonic transducer array unit;

[0192] Each of the ultrasonic transducer array units after posture adjustment outputs a corresponding target sub-audio signal.

[0193] Optionally, the determination module is further configured to:

[0194] Converting the audio signal to be transmitted into a first audio signal to be transmitted and a second audio signal to be transmitted;

[0195] Performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first target audio signal of each of the first ultrasonic transducer array units;

[0196] The second audio signal to be transmitted is modulated to obtain a second target audio signal of each second ultrasonic transducer array unit.

[0197] Optionally, the determination module is further configured to:

[0198] Performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first reference audio signal;

[0199] The first reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each of the first ultrasonic transducer array units to obtain a first target audio signal of each of the first ultrasonic transducer array units.

[0200] Optionally, the determination module is further configured to:

[0201] performing modulation processing on the second audio signal to be transmitted to obtain a second reference audio signal;

[0202] The second reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each second ultrasonic transducer array unit to obtain a second target audio signal of each second ultrasonic transducer array unit.

[0203] In this embodiment, target virtual sound source information is obtained; a target audio signal is output through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, and the target audio signal is obtained based on the target virtual sound source information. The target audio signal that the ultrasonic transducer needs to output is determined by the target virtual sound source information, so that the target audio signal can better meet the requirements of the virtual sound source to be generated, and then the target audio signal is output by the ultrasonic transducer to generate a virtual sound source, thereby improving the quality of the generated virtual sound source.

[0204] Accordingly, the present application also provides an electronic device, such as Fig.12 As shown, Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 1100 includes a processor 1101 having one or more processing cores, a memory 1102 having one or more computer-readable storage media, and a computer program stored in the memory 1102 and executable on the processor. The processor 1101 is electrically connected to the memory 1102. It will be understood by those skilled in the art that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0205] The processor 1101 is the control center of the electronic device 1100, and uses various interfaces and lines to connect various parts of the entire electronic device 1100. By running or loading software programs and / or units stored in the memory 1102, and calling data stored in the memory 1102, the processor 1101 executes various functions of the electronic device 1100 and processes data, thereby monitoring the electronic device 1100 as a whole. The processor 1101 can be a processor CPU, a graphics processor GPU, a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0206] In an embodiment of the present application, the processor 1101 in the electronic device 1100 will load the computer program corresponding to the process of one or more applications into the memory 1102 according to the following steps, and the processor 1101 will run the application stored in the memory 1102 to execute the audio adjustment method.

[0207] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0208] Optional, such as Fig.12 As shown, the electronic device 1100 further includes: a touch screen 1103, a radio frequency circuit 1104, an audio signal circuit 1105, an input unit 1106, and a power supply 1107. The processor 1101 is electrically connected to the touch screen 1103, the radio frequency circuit 1104, the audio signal circuit 1105, the input unit 1106, and the power supply 1107, respectively. Those skilled in the art can understand that Fig.12 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0209] The touch display screen 1103 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 1103 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-EmittingDiode) and the like. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 1101, and can receive the command sent by the processor 1101 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1101 to determine the type of touch event, and then the processor 1101 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 1103 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 1103 can also be used as a part of the input unit 1106 to realize the input function.

[0210] The radio frequency circuit 1104 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to send and receive signals between the network device or other electronic devices.

[0211] The audio signal circuit 1105 can be used to provide an audio signal interface between the user and the electronic device through a speaker and a microphone. The audio signal circuit 1105 can transmit the received audio signal data to the speaker after the electrical signal is converted, and the speaker converts it into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio signal circuit 1105 and converted into audio signal data, and then the audio signal data is output to the processor 1101 for processing, and then sent to another electronic device through the radio frequency circuit 1104, or the audio signal data is output to the memory 1102 for further processing. The audio signal circuit 1105 may also include an earplug jack to provide communication between an external headset and an electronic device.

[0212] The input unit 1106 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0213] The power supply 1107 is used to supply power to various components of the electronic device 1100. Optionally, the power supply 1107 can be logically connected to the processor 1101 through a power management device, so as to manage charging, discharging, and power consumption through the power management device. The power supply 1107 can also include one or more DC or AC power supplies, recharging devices, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0214] although Fig.12 Not shown, the electronic device 1100 may also include a camera device, a sensor, a wireless fidelity module, a Bluetooth module, etc., which are not described in detail here.

[0215] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0216] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0217] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0218] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0219] The embodiments, implementation methods and related technical features of the present application can be combined and replaced with each other without conflict.

[0220] The above are only preferred embodiments of the present application and do not constitute any form of limitation to the present application. Although the descriptions of various embodiments in the embodiments of the present application have different focuses, for parts not described in detail in a certain embodiment, reference can be made to the relevant embodiments of other embodiments. However, any modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. An audio adjustment method, characterized in that: The method comprises: Obtain target virtual sound source information; A target audio signal is outputted through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, wherein the target audio signal is obtained based on the target virtual sound source information.

2. The method according to claim 1, characterized in that: The method further comprises: The audio signal to be transmitted by the ultrasonic transducer is adjusted according to the target virtual sound source information to obtain a target audio signal.

3. The method according to claim 1, characterized in that The target virtual sound source information includes an expected position and an expected radiation direction of the virtual sound source.

4. The method according to claim 3, characterized in that The method further comprises: According to the desired position, an offset angle of the ultrasonic transducer is determined.

5. The method according to claim 4, characterized in that The method comprises: The audio signal to be transmitted corresponding to the ultrasonic transducer is processed according to the offset angle and the expected radiation direction to obtain a target audio signal.

6. The method according to claim 4, characterized in that The ultrasonic transducer includes an ultrasonic transducer array, and the ultrasonic transducer array includes a plurality of ultrasonic transducer array units.

7. The method according to claim 6, characterized in that The offset angle includes an offset angle of each ultrasonic transducer array unit in the ultrasonic transducer; the method further includes: The audio signal to be transmitted is processed according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction to obtain a target sub-audio signal of each ultrasonic transducer array unit.

8. The method according to claim 7, characterized in that The step of outputting a target audio signal through an ultrasonic transducer comprises: Determine the propagation time corresponding to each ultrasonic transducer array unit according to the distance between the desired position and each ultrasonic transducer array unit; the propagation time is the time required for the ultrasonic transducer array unit to transmit to the desired position after outputting the audio signal; Determining the delay information of each of the ultrasonic transducer array units according to the propagation time length corresponding to each of the ultrasonic transducer array units; Through each of the ultrasonic transducer array units, the target sub-audio signal corresponding to each of the ultrasonic transducer array units is outputted according to the delay information.

9. The method according to claim 8, characterized in that Determining the delay information of each ultrasonic transducer array unit according to the propagation time length corresponding to each ultrasonic transducer array unit includes: The delay information of each of the ultrasonic transducer array units is determined according to the difference between the propagation time corresponding to each of the ultrasonic transducer array units and the maximum propagation time among the propagation time.

10. The method according to claim 7, characterized in that The step of processing the audio signal to be transmitted according to the offset angle of each ultrasonic transducer array unit and the expected radiation direction to obtain the target sub-audio signal of each ultrasonic transducer array unit includes: Determining a first weighting coefficient of each ultrasonic transducer array unit according to an angle difference between an offset angle of each ultrasonic transducer array unit and the desired radiation direction; The audio signal to be transmitted is processed according to the first weighting coefficient of each ultrasonic transducer array unit to obtain a first audio signal of each ultrasonic transducer array unit, so as to determine a target sub-audio signal according to the first audio signal.

11. The method according to claim 10, characterized in that The determining a target sub-audio signal according to the first audio signal comprises: Determining a second weighting coefficient of each of the ultrasonic transducer array units according to the offset angle of each of the ultrasonic transducer array units and a preset conversion relationship; The first audio signal is processed according to the second weighting coefficient of each of the ultrasonic transducer array units to obtain a second audio signal of each of the ultrasonic transducer array units, so as to determine a target sub-audio signal according to the second target audio signal.

12. The method according to claim 7, characterized in that The method further comprises: According to the offset angle of each ultrasonic transducer array unit, adjusting the posture of each ultrasonic transducer array unit; Each of the ultrasonic transducer array units after posture adjustment outputs a corresponding target sub-audio signal.

13. The audio adjustment method according to claims 6-12, characterized in that: The ultrasonic transducer array includes a first ultrasonic transducer array unit and a second ultrasonic transducer array unit of the same number, and the method further includes: Converting the audio signal to be transmitted into a first audio signal to be transmitted and a second audio signal to be transmitted; Performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first target audio signal of each of the first ultrasonic transducer array units; The second audio signal to be transmitted is modulated to obtain a second target audio signal of each second ultrasonic transducer array unit.

14. The audio adjustment method according to claim 13, characterized in that: The performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain the first target audio signal of each of the first ultrasonic transducer array units includes: Performing phase shift processing and modulation processing on the first audio signal to be transmitted to obtain a first reference audio signal; The first reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each of the first ultrasonic transducer array units to obtain a first target audio signal of each of the first ultrasonic transducer array units.

15. The audio adjustment method according to claim 13, characterized in that: The step of performing modulation processing on the second audio signal to be transmitted to obtain a second target audio signal of each second ultrasonic transducer array unit includes: performing modulation processing on the second audio signal to be transmitted to obtain a second reference audio signal; The second reference audio signal is processed according to the expected radiation direction in the target virtual sound source information and the offset angle corresponding to each second ultrasonic transducer array unit to obtain a second target audio signal of each second ultrasonic transducer array unit.

16. An audio adjustment device, characterized in that: The audio adjustment device comprises: An acquisition module, used to acquire target virtual sound source information; An output module is used to output a target audio signal through an ultrasonic transducer to generate a virtual sound source corresponding to the target virtual sound source information, wherein the target audio signal is obtained based on the target virtual sound source information.

17. An electronic device, characterized in that: The invention comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor is caused to execute the steps of the method according to any one of claims 1 to 15.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of computer programs, and the computer programs are suitable for being loaded by a processor to execute the steps of the method according to any one of claims 1 to 15.

19. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program product performs the steps of the method according to any one of claims 1 to 15.

Images