Sound source positioning method, device, apparatus and storage medium

Abstract

The embodiment of the present application discloses a sound source positioning device, the device comprises: a first body for receiving and processing vibration generated by a sound source; a second body, the second body comprises at least four vibration planes, the second body is connected with the first body through any one of the vibration planes; wherein each vibration plane is used for receiving vibration generated by a sound source, and transmitting the vibration to the first body, and the sound source is positioned based on the force of vibration generated by the vibration plane of the second body and / or the force of vibration transmitting the first body. The embodiment of the present application also simultaneously provides a sound source positioning method, device and storage medium.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of electronic devices, and relates to, but is not limited to, a sound source positioning method, device, apparatus, and storage medium. BACKGROUND

[0002] In related technologies, in order to improve the clarity of recording, noise reduction processing is performed on the recording. In the noise reduction process, spatial information is weakened, and the sense of direction of the recording is reduced. If the noise reduction process is omitted, it is difficult to guarantee the clarity of the recording. Therefore, the direction in which a speaker is located in the recording needs to be determined based on the spatial information of the recording while guaranteeing the clarity. SUMMARY

[0003] The present application provides a sound source positioning method, device, apparatus, and storage medium.

[0004] The technical solution of the present application embodiment is as follows:

[0005] The present application provides a sound source positioning device, which comprises: a first body for receiving and processing vibrations generated by a sound source; and a second body comprising at least four vibration planes, wherein the second body is connected to the first body through any one of the vibration planes; each vibration plane is configured to receive vibrations generated by the sound source and transmit the vibrations to the first body; and the sound source is positioned based on the force of the vibrations generated by the vibration planes of the second body and / or the force of the vibrations transmitted to the first body.

[0006] The present application provides a sound source positioning method applied to a sound source positioning device, which comprises: acquiring a first force of a sound source on at least one vibration plane of a second body of the sound source positioning device; the second body comprises at least four vibration planes; each vibration plane is configured to receive vibrations generated by the sound source and transmit the vibrations to a first body; the second body is connected to the first body through any one of the vibration planes; in a case where the first force is not zero, a second force of the second body on the first body based on the transmission of the vibrations is determined; the direction of the second force is the same as the direction of the first force; and the sound source is positioned based on the first force and / or the second force.

[0007] The embodiment of the present application provides a sound source positioning device, the device comprises: an acquisition module, which is used for acquiring a first acting force of a sound source on at least one vibration plane of a second body of the sound source positioning device; the second body comprises at least four vibration planes; each vibration plane is used for receiving vibration generated by the sound source and transmitting the vibration to a first body; the second body is connected with the first body through any vibration plane; a determination module is used for determining a second acting force of the second body on the first body based on vibration transmission in a case where the first acting force is not zero; the direction of the second acting force is the same as that of the first acting force; and a positioning module is used for positioning the sound source based on the first acting force and / or the second acting force.

[0008] The embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the steps in the above method.

[0009] The technical scheme provided by the embodiment of the present application has at least the following beneficial effects:

[0010] In the embodiment of the present application, the sound positioning device comprises a second body, the second body comprises at least four planes, and the direction of the sound wave source is determined based on the angle at which at least two surfaces of the second body are stressed to incline; in this way, the sound positioning device can receive force in different directions generated by the sound wave in addition to the direction of the first part of the first body, and the direction of the sound wave is determined based on the resultant force of the force in different directions in the spatial information. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical scheme in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.

[0012] Figure 1 A schematic structural diagram of a sound source positioning device provided by the embodiment of the present application is shown in the figure;

[0013] Figure 2 A schematic structural diagram of a sound source positioning device provided by the embodiment of the present application is shown in the figure;

[0014] Figure 3 A flowchart of a sound source positioning method provided by the embodiment of the present application is shown in the figure;

[0015] Figure 4A A flowchart of a sound source positioning method provided by the embodiment of the present application is shown in the figure;

[0016] Figure 4B An application scenario schematic diagram of a sound source positioning method provided by an embodiment of the present application is shown in FIG. 1.

[0017] Figure 4C An application scenario schematic diagram of a sound source positioning method provided by an embodiment of the present application is shown in FIG. 1.

[0018] Figure 5 A component structure schematic diagram of a sound source positioning device provided by an embodiment of the present application is shown in FIG. 2.

[0019] Figure 6A A component structure schematic diagram of a sound source positioning device provided by an embodiment of the present application is shown in FIG. 2.

[0020] Figure 6B An application scenario schematic diagram of a sound source positioning method provided by an embodiment of the present application is shown in FIG. 1.

[0021] Figure 6C An application scenario schematic diagram of a sound source positioning method provided by an embodiment of the present application is shown in FIG. 1.

[0022] Figure 6D An application scenario schematic diagram of a sound source positioning method provided by an embodiment of the present application is shown in FIG. 1.

[0023] Figure 7 A component structure schematic diagram of a sound source positioning device provided by an embodiment of the present application is shown in FIG. 2. DETAILED DESCRIPTION

[0024] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some of the embodiments of the present application but not all the embodiments of the present application. The following embodiments are used to explain the present application but not to limit the scope of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0025] In the following description, “some embodiments” are described, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” can be the same subset or different subset of all possible embodiments, and can be combined with each other without conflict.

[0026] It should be noted that the terms “first\second\third” involved in the embodiments of the present application are only to distinguish similar objects and do not represent a specific order of the objects. Understandably, “first\second\third” can be interchanged with a specific order or sequence as allowed, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0027] Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which embodiments of the present application belong. It should also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0028] Figure 1 A schematic diagram of a component structure of a sound source positioning device provided by embodiments of the present application is shown in Figure 1 The device 100 includes:

[0029] A first body 101 for receiving and processing vibrations generated by a sound source;

[0030] A second body 102, the second body including at least four vibration planes, the second body being connected to the first body through any one of the vibration planes;

[0031] Each of the vibration planes is configured to receive vibrations generated by a sound source and transmit the vibrations to the first body, and the sound source is positioned based on an acting force of the vibrations generated by the vibration planes of the second body and / or based on an acting force of the vibrations transmitted to the first body.

[0032] Here, the first body 101 can be configured to receive an acting force of sound waves generated by a sound source on the first body and convert kinetic energy generated by the acting force into electrical energy. In a case where the first part 1011 receives the acting force of the first body, a capacitor composed of the first part 1011 and the second part 1012 parallel to each other vibrates due to the first part 1011, the distance between the first part 1011 and the second part 1012 changes, causing a change in capacitance, and since the charge of the back electrode plate is fixed, a change in V0 as an output voltage is generated, thereby converting kinetic energy generated by the sound source into electrical energy.

[0033] In an implementable manner, the first body includes at least a diaphragm and a back electrode plate.

[0034] Here, as shown in Figure 2 The first body 200 can include a first part 201, which can be a diaphragm, and a second part 202, which can be a back electrode plate. Here, the diaphragm can be a vibratable material, and the diaphragm can record the direction of the sound source according to the amplitude of the sound wave vibration after receiving the vibration of the sound source.

[0035] Exemplarily, the first body can be a Micro-Electro-Mechanical System (MEMS) as shown in Figure 5 The MEMS includes a diaphragm 501 and a back plate 504.

[0036] In an implementable manner, the second body is a polyhedron, and each plane in the polyhedron is made of a vibratable material.

[0037] Here, the second body 102 can be a polyhedral structure such as a triangular pyramid, a square pyramid, a cube, or the like. Here, the first body 101 and the first part 1011 of the second body 102 are used to sense the vibration of the sound source. The propagation of sound is the vibration of the sound source, so that the air pressure around it fluctuates up and down. When the air vibration driven by the sound wave comes, at least two faces of the second body 102 are forced to tilt. The direction of the sound wave source is determined by the angle of the tilt of the second body 102.

[0038] In the above embodiment, the sound positioning device includes a second body, and the second body includes at least four planes. The direction of the sound wave source is determined based on the angle of the tilt of at least two faces of the second body. In this way, the sound positioning device can receive forces in different directions generated by the sound wave in addition to the direction of the first part of the first body. The direction of the sound wave source is determined according to the resultant force of the forces in different directions in the spatial information.

[0039] Figure 3 A flowchart of a sound source positioning method provided by an embodiment of the present application is applied to a sound source positioning device. As shown in Figure 3 The method includes the following steps.

[0040] In step S301, a first force of a sound source on at least one vibration plane of a second body in the sound source positioning device is obtained. The second body includes at least four vibration planes. Each vibration plane is used to receive the vibration generated by the sound source and transmit the vibration to a first body. The second body and the first body are connected through any one of the vibration planes.

[0041] In an implementable manner, in step S301, the first force of the sound source on at least one vibration plane of the second body in the sound source positioning device is obtained, including: obtaining at least two vibration planes of the second body affected by the sound source; obtaining the force of the sound source on each vibration plane; determining the resultant force of the force of the sound source on each vibration plane of the second body based on the forces of the at least two vibration planes, to obtain the first force.

[0042] Here, the position of the sound source relative to the second body is different, the vibration plane of the second body receiving the action of the sound source is different. Exemplarily, as shown in Figure 4B , the force generated by the sound source 41 is in the 1, 3, 5 plane, and the force generated by the sound source 42 is in the 2, 4, 6 plane. Here, the force of the sound source on each vibration plane is the component of the sound wave generated by the sound source in different directions.

[0043] Here, the position of the sound source 61 is different, the force on each vibration plane is different, and the direction of the resultant force is also different. As shown in Figure 6D , the resultant force F65 is obtained by using F2 and F4, and as shown in Figure 6C , the direction of the resultant force F63 is obtained by using F2 and F5.

[0044] In the above embodiment, at least two vibration planes in the second body receiving the action of the sound source are obtained; the force of the sound source on each vibration plane is obtained, so that the component of the sound wave generated by the sound source in different directions can be received, the richness of the sound space information is improved, and the direction of the sound source in different dimensions is realized.

[0045] In an implementable manner, the resultant force of the sound source on each vibration plane in the second body is determined based on the force of the at least two vibration planes, comprising:

[0046] In the case where the vibration plane in the second body receiving the action of the sound source includes two vibration planes, the resultant force of the forces of the two vibration planes is determined, and the resultant force of the force of the sound source on each vibration plane in the second body is obtained;

[0047] In the case where the vibration plane in the second body receiving the action of the sound source includes a plurality of vibration planes, a first resultant force of the forces of any two vibration planes is determined, and the iteration is performed: a second resultant force between the first resultant force and the force of any vibration plane not participating in the determination of the first resultant force is determined, the second resultant force is determined as the first resultant force, until the force participating in the determination of the first resultant force includes the force of each vibration plane in the plurality of vibration planes; the first resultant force is determined as the resultant force of the force of each vibration plane in the second body.

[0048] Exemplarily, as shown in Figure 6C , the vibration plane receiving the action of the sound source includes two vibration planes, 2 and 4, the force received by the 2 plane is F2, the force received by the 4 plane is F4, and the resultant force F65 can be obtained by using F2 and F4, F65 is the resultant force of the force of each vibration plane in the second body.

[0049] Exemplarily, as shown in Figure 6BAs shown, the 1st, 3rd and 5th faces of the cube 62 receive forces F1, F3 and F5 from the sound source 61. After determining the resultant force F2 of F1 and F3, the force F5 which does not participate in the determination of F2 is combined with F2 to obtain F63 as shown, which is the resultant force of the forces acting on each vibration plane of the second body. Figure 6C

[0050] In step S302, when the first force is not zero, a second force of the second body on the first body is determined based on vibration transmission; the direction of the second force is the same as the direction of the first force.

[0051] In an implementable manner, the difference between the magnitude of the second force and the magnitude of the first force is less than a loss threshold.

[0052] Here, in the process of force transmission, force loss occurs, and when the difference between the magnitude of the first force and the magnitude of the first force is greater than the loss threshold, the force transmission is abnormal, and the direction of the sound source cannot be determined using the second force after transmission.

[0053] In an implementable manner, in step S302, when the first force is not zero, a second force of the second body on the first body is determined based on vibration transmission, including: determining the deformation of the first part after the first part is acted on by the second body; and determining the second force of the second body on the first body based on the deformation.

[0054] Here, the second body and the first part of the first body are materials that can vibrate, and when the second body is acted on by a force, the second body deforms, and the deformed second body tilts, and the second force of the second body on the first body is determined by the angle of the tilt of the second body under force.

[0055] In step S303, the sound source is located based on the first force and / or the second force.

[0056] In an implementable manner, in step S303, the sound source is located based on the first force and / or the second force, including: determining the reaction force of the first force to obtain the direction of the sound source; and / or determining the reaction force of the second force to obtain the direction of the sound source.

[0057] Exemplarily, as shown in FIG. 1, the sound source 61 is located by determining the reaction force of the first force F2 to obtain the direction of the sound source 61. Figure 6B ​As shown, the 1st, 3rd and 5th faces of the cube 62 receive forces F1, F3 and F5 from the sound source 61. The direction of the resultant force F of the three forces is the direction of the sound source. When the position of the sound source 61 is different, the faces of the cube 62 receiving the forces generated by the sound source waves are different, and the magnitude of the resultant force is also different. The resultant force of F1 and F3 is F2, as shown. Figure 6C As shown, the resultant force F63 is obtained by F2 and F5, and the direction F64 of the resultant force F63 is the direction of the sound source. The direction of the force does not change in the transmission process, the direction of the second force of the second body on the first body is the same as the direction of the first force, and therefore, the process of obtaining the direction of the sound source based on the reaction force of the second force is the same as the above process.

[0058] Exemplarily, when the position of the sound source 61 is different, the forces received by each face are different, and the direction of the resultant force is also different. As shown, Figure 6D As shown, the resultant force F65 is obtained by F2 and F4, which is different from the direction of the resultant force F63.

[0059] In a case that can be implemented, the direction of the force does not change in the transmission process, the direction of the second force of the second body on the first body is the same as the direction of the first force, and therefore, the process of obtaining the direction of the sound source based on the reaction force of the second force is the same as the process in the above two examples.

[0060] In the above embodiment, the first force of the sound source on at least one vibration plane of the second body in the sound source positioning device is obtained; the second body includes at least four vibration planes; each vibration plane is used to receive the vibration generated by the sound source and transmit the vibration to the first body; the second body and the first body are connected through any one of the vibration planes, so that the second body with multiple planes can obtain multiple dimensional forces of the sound source in different directions, and the direction of the sound wave in space can be determined.

[0061] Figure 4A A flowchart of a sound source positioning method provided by the embodiment is shown in the figure, which is applied to a sound source positioning device, as shown, Figure 4A The method includes the following steps:

[0062] In step S401, at least one sound source is obtained.

[0063] In step S402, the angular velocity of the force of each sound source on the second body in the process of rotating the second body is determined based on the frequency of each sound source.

[0064] Here, the sound source generates sound waves, the sound waves change the pressure in the air in the process of propagation, generate sound pressure, and the sound pressure drives the second body to generate the angular velocity of rotating the second body.

[0065] Here, the frequency fr of the sound source and the angular velocity ω have a relationship of formula (4-1),

[0066] ω = 2πf r Formula (4-1);

[0067] Here, the angular velocity can be determined by formula (4-1).

[0068] Step S403, based on the angular acceleration of each of the angular velocities, determine the torque of the force of each of the sound sources on each of the vibration planes of the second body;

[0069] Here, the torque M and the angular acceleration a have a relationship of formula (4-2),

[0070] M = Ja Formula (4-2);

[0071] Wherein, J is the moment of inertia of the second body, and the moments of inertia of different polyhedrons are different.

[0072] Step S404, obtain at least one first force of at least one sound source on at least one vibration plane of the second body of the sound source positioning device; the second body comprises at least four vibration planes; each of the vibration planes is used to receive the vibration generated by the sound source and transmit the vibration to the first body; the second body and the first body are connected through any one of the vibration planes; each of the first forces is the resultant force of the forces with the same torque in each of the vibration planes;

[0073] Step S405, in the case that the first force is not zero, determine the second force of the second body on the first body based on the vibration transmission; the direction of the second force is the same as the direction of the first force;

[0074] Step S406, based on at least one of the first forces and / or at least one of the second forces, position at least one of the sound sources.

[0075] Exemplarily, as Figure 4BAs shown in the case where two second bodies 43 receive the forces generated by two sound sources 41 and 42, based on the frequency of the sound source 41, the moment of force of the sound source 41 on each vibration plane of the second body 43 is determined, and there is a set of forces with the same moment of force on the 1, 3, 5 planes of the second body 43; there is a set of forces with the same moment of force on the 2, 4, 6 planes. It is determined that the force generated by the sound source 41 is on the 1, 3, 5 planes, and the force generated by the sound source 42 is on the 2, 4, 6 planes. Therefore, the resultant force F41 of the forces on the 1, 3, 5 planes is determined, and the resultant force F41 is determined as the first force of the sound source 41 on the vibration plane of the second body in the sound source positioning device. The resultant force F42 of the forces on the 2, 4, 6 planes is determined, and the resultant force F42 is determined as the first force of the sound source 42 on the vibration plane of the second body in the sound source positioning device. After the first force is determined, the direction of each sound source can be determined according to the reaction force of the first force; or, based on the vibration transmission, the second force of the second body on the first body is determined, and the direction of each sound source is determined.

[0076] As shown in the case where two second bodies 43 receive the forces generated by two sound sources 41 and 42, based on the frequency of the sound source 41, the moment of force of the sound source 41 on each vibration plane of the second body 43 is determined, and there is a set of forces with the same moment of force on the 1, 3, 5 planes of the second body 43; there is a set of forces with the same moment of force on the 2, 4, 6 planes. It is determined that the force generated by the sound source 41 is on the 1, 3, 5 planes, and the force generated by the sound source 42 is on the 2, 4, 6 planes. Therefore, the resultant force F41 of the forces on the 1, 3, 5 planes is determined, and the resultant force F41 is determined as the first force of the sound source 41 on the vibration plane of the second body in the sound source positioning device. The resultant force F42 of the forces on the 2, 4, 6 planes is determined, and the resultant force F42 is determined as the first force of the sound source 42 on the vibration plane of the second body in the sound source positioning device. After the first force is determined, the direction of each sound source can be determined according to the reaction force of the first force; or, based on the vibration transmission, the second force of the second body on the first body is determined, and the direction of each sound source is determined. Figure 4C As shown in the case where two second bodies 43 receive the forces generated by two sound sources 41 and 42, based on the frequency of the sound source 41, the moment of force of the sound source 41 on each vibration plane of the second body 43 is determined, and there is a set of forces with the same moment of force on the 1, 3, 5 planes of the second body 43; there is a set of forces with the same moment of force on the 2, 4, 6 planes. It is determined that the force generated by the sound source 41 is on the 1, 3, 5 planes, and the force generated by the sound source 42 is on the 2, 4, 6 planes. Therefore, the resultant force F41 of the forces on the 1, 3, 5 planes is determined, and the resultant force F41 is determined as the first force of the sound source 41 on the vibration plane of the second body in the sound source positioning device. The resultant force F42 of the forces on the 2, 4, 6 planes is determined, and the resultant force F42 is determined as the first force of the sound source 42 on the vibration plane of the second body in the sound source positioning device. After the first force is determined, the direction of each sound source can be determined according to the reaction force of the first force; or, based on the vibration transmission, the second force of the second body on the first body is determined, and the direction of each sound source is determined.

[0077] As shown in the case where two second bodies 43 receive the forces generated by two sound sources 41 and 42, based on the frequency of the sound source 41, the moment of force of the sound source 41 on each vibration plane of the second body 43 is determined, and there is a set of forces with the same moment of force on the 1, 3, 5 planes of the second body 43; there is a set of forces with the same moment of force on the 2, 4, 6 planes. It is determined that the force generated by the sound source 41 is on the 1, 3, 5 planes, and the force generated by the sound source 42 is on the 2, 4, 6 planes. Therefore, the resultant force F41 of the forces on the 1, 3, 5 planes is determined, and the resultant force F41 is determined as the first force of the sound source 41 on the vibration plane of the second body in the sound source positioning device. The resultant force F42 of the forces on the 2, 4, 6 planes is determined, and the resultant force F42 is determined as the first force of the sound source 42 on the vibration plane of the second body in the sound source positioning device. After the first force is determined, the direction of each sound source can be determined according to the reaction force of the first force; or, based on the vibration transmission, the second force of the second body on the first body is determined, and the direction of each sound source is determined. Figure 4C As shown in the case where two second bodies 43 receive the forces generated by two sound sources 41 and 42, based on the frequency of the sound source 41, the moment of force of the sound source 41 on each vibration plane of the second body 43 is determined, and there is a set of forces with the same moment of force on the 1, 3, 5 planes of the second body 43; there is a set of forces with the same moment of force on the 2, 4, 6 planes. It is determined that the force generated by the sound source 41 is on the 1, 3, 5 planes, and the force generated by the sound source 42 is on the 2, 4, 6 planes. Therefore, the resultant force F41 of the forces on the 1, 3, 5 planes is determined, and the resultant force F41 is determined as the first force of the sound source 41 on the vibration plane of the second body in the sound source positioning device. The resultant force F42 of the forces on the 2, 4, 6 planes is determined, and the resultant force F42 is determined as the first force of the sound source 42 on the vibration plane of the second body in the sound source positioning device. After the first force is determined, the direction of each sound source can be determined according to the reaction force of the first force; or, based on the vibration transmission, the second force of the second body on the first body is determined, and the direction of each sound source is determined.

[0078] In the above embodiments, based on the frequency of each sound source, the angular velocity of the force exerted by each sound source on the second body during the rotation of the second body is determined; based on the angular acceleration of each angular velocity, the torque of the force exerted by each sound source on each vibrating plane in the second body is determined. In this way, the force exerted by different sound sources can be distinguished according to the characteristics of the force exerted by sound sources of different frequencies on the second body, and the direction of different sound sources can be located in the case of multiple sound sources.

[0079] In multi-person conferences and video calls, spatial information from the recording is typically used to determine the speaker's direction. Microphones record stereo sound. Determining the speaker's direction using stereo spatial information involves: microphones at different positions in the microphone array receiving sound, determining the sound pressure level and the position of the receiving microphone, and then calculating the speaker's direction in stereo based on the microphone positions, the distances between microphones at different positions, and the sound pressure level.

[0080] In related technologies, noise reduction processing is performed to improve recording clarity. This process weakens spatial information and reduces the sense of direction in the recording. However, omitting noise reduction makes it difficult to guarantee recording clarity. Therefore, it is necessary to determine the speaker's direction in the recording using spatial information while maintaining clarity. Conventional linear microphone arrays can distinguish left from right, but cannot distinguish front from back.

[0081] Related technologies such as sound source localization equipment Figure 5 As shown, the device includes: a diaphragm 501, a connecting assembly 502, a supporting assembly 503, and a back electrode plate 504. The diaphragm 501 can record the direction of the sound source according to the amplitude of the sound wave vibration.

[0082] To address the aforementioned problems, this application proposes a sound source localization device. Figure 6A This is a schematic diagram of the composition structure of a sound source localization device provided in an embodiment of this application, as shown below. Figure 6A As shown, the device includes:

[0083] A first body 610 includes a first part 612 and a second part 613 separated and supported by a support component 611, wherein the first part 612 is parallel to the second part 613; the first part 612 is connected to the support component 611 by a connecting component 614.

[0084] The second body 620 includes at least four planes, any one of which is connected to the first part.

[0085] Here, the first body 610 can be a micro-electro-mechanical system (MEMS), the first part 612 can be a diaphragm, the second part 613 can be a back electrode plate, and the connecting component 614 can be a spring. Here, the first part 612 and the second part 613 are parallel and separated by a distance, forming a capacitor.

[0086] Here, when the first part 612 is a diaphragm, as... Figure 6B As shown, 63 is the diagonal length of the diaphragm.

[0087] Here, the second body 620 can be a polyhedral structure, such as a triangular pyramid, a cube, or a cubic structure.

[0088] Here, the first part 612 of the first body 610 and the second body 620 is used to sense the vibration of the sound source. The propagation of sound is the vibration of the sound source, which causes the surrounding air pressure to fluctuate up and down. When the air vibration driven by the sound wave is transmitted, at least two surfaces of the second body 620 are tilted by force. The direction of the sound wave source is determined by the angle of tilt of the second body 620.

[0089] For example, such as Figure 6B As shown, faces 1, 3, and 5 of cube 62 receive forces F1, F3, and F5 from sound source 61. The opposite direction of the resultant force F obtained from the three forces indicates the direction of the sound source. Depending on the position of sound source 61, different faces of cube 62 receive the forces generated by the sound source waves, and the magnitude of the resultant force also varies. The resultant force obtained from F1 and F3 is F2, as shown... Figure 6C As shown, the resultant force F63 is obtained using F2 and F5, and the opposite direction of F63, F64, is the direction from which the sound source originates.

[0090] For example, when the location of the sound source 61 is different, the force received by each surface is different, and the direction of the resultant force is also different. Figure 6D As shown, the resultant force F65 is obtained using F2 and F4, and its direction is different from that of the resultant force F63.

[0091] To aid in understanding this application, a microphone (Mic) including the sound source localization device of this application is described. The microphone records sound through frequency response and sensitivity:

[0092] 1) Frequency Response (FR)

[0093] Frequency response, also known as frequency range, refers to the range of frequencies that the microphone can sense sound waves and convert sound wave energy into an electrical signal. When the microphone receives different frequency sounds, the output electrical signal will be amplified or attenuated with the change of frequency. The formula for calculating frequency is as shown in equation (6-1),

[0094]

[0095] where b is the diagonal length of the diaphragm, m2 is the mass of the cube, L is the height of the cube, k is the elastic coefficient of the diaphragm, g is the acceleration of gravity, IG x is the moment of inertia of the cube about the x-axis, IG y is the moment of inertia of the cube about the y-axis, and m is the mass of the diaphragm.

[0096] 2) Sensitivity

[0097] Sensitivity represents the strength of the output electrical signal generated after the microphone converts sound wave energy into voltage, and is the ratio of the output voltage to the input sound pressure under unit sound pressure excitation. The formula for calculating sensitivity is as shown in equation (6-2),

[0098]

[0099] where V0 is the output voltage, and P is the sound pressure received by the cube.

[0100] Here, the formula for calculating the output voltage is as shown in equation (6-3),

[0101]

[0102] where ε0 is the vacuum permittivity, ε r is the relative permittivity, σ is the stress, t is the diaphragm thickness, d is the piezoelectric constant, D is the total electric displacement of the back plate, q is the circuit, C p is the capacitance.

[0103] Here, the formula for calculating the total electric displacement of the back plate is as shown in equation (6-4);

[0104] D = εE + dσ equation (6-4);

[0105] where E is the electric field force, and ε is the diaphragm permittivity.

[0106] In the implementation process, for example, Figure 6AAs shown, in the case that the first part 612 of the sound source positioning device is a diaphragm and the second part 613 is a back plate, the diaphragm and the back plate are parallel to each other to form a capacitor, the vibration amplitude of the diaphragm changes, the distance between the diaphragm and the back plate changes, and the capacitance changes. Since the charging charge of the back plate is fixed, the change of V0 as the output voltage is generated, and the kinetic energy generated by the sound source is converted into electrical energy.

[0107] In the above embodiment, the sound positioning device includes a second body, the second body includes at least four planes, and the direction of the sound source is determined based on the angle at which at least two faces of the second body are forced to tilt. In this way, the sound positioning device can receive forces in different directions generated by the sound wave in addition to the direction of the first part of the first body, thereby increasing the richness of the sound spatial information. After noise reduction processing of the sound, a large amount of spatial information can be retained, and the direction of the sound source can be determined based on the resultant force generated by the forces in different directions in the spatial information.

[0108] Based on the foregoing embodiment, the embodiment of the present application further provides a sound source positioning device, which includes various modules and can be implemented by a processor in the sound source positioning device. Of course, the device can also be implemented by a specific logic circuit. In the implementation process, the processor can be a central processing unit (CPU), a micro processing unit (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA).

[0109] Figure 7 A schematic diagram of the composition structure of a sound source positioning device provided by the embodiment of the present application is shown in Figure 7 As shown, the device 700 includes an acquisition module 710, a determination module 720, and a positioning module 730, wherein:

[0110] The acquisition module 710 is configured to acquire a first force of a sound source on at least one vibration plane of a second body of the sound source positioning device. The second body includes at least four vibration planes. Each vibration plane is configured to receive vibration generated by the sound source and transmit the vibration to a first body. The second body is connected to the first body through any one of the vibration planes.

[0111] The determination module 720 is configured to determine a second force of the second body on the first body based on vibration transmission in the case that the first force is not zero. The direction of the second force is the same as the direction of the first force.

[0112] The positioning module 730 is configured to position the sound source based on the first force and / or the second force.

[0113] In some possible embodiments, the acquisition module 710 is further configured to acquire at least two vibration planes in the second body acted on by the sound source, acquire the force of the sound source on each of the vibration planes, and determine the resultant force of the sound source on each of the vibration planes in the second body based on the forces of the at least two vibration planes, to obtain the first force.

[0114] In some possible embodiments, the acquisition module 710 is further configured to, in a case where the vibration planes in the second body acted on by the sound source include two vibration planes, determine the resultant force of the two vibration planes, to obtain the resultant force of the sound source on each of the vibration planes in the second body; in a case where the vibration planes in the second body acted on by the sound source include a plurality of vibration planes, determine a first resultant force between any two vibration planes, and iteratively perform: determining a second resultant force between the first resultant force and the force of any vibration plane not involved in determining the first resultant force, determining the second resultant force as the first resultant force, until the forces involved in determining the first resultant force include the forces of each of the plurality of vibration planes; and determining the first resultant force as the resultant force of the forces of each of the vibration planes in the second body.

[0115] In some possible embodiments, the determining module 720 is further configured to determine a deformation of the first part after the first part is acted on by the second body, and determine the second force of the second body on the first body based on the deformation.

[0116] In some possible embodiments, the positioning module 730 is further configured to determine a reaction force of the first force, to obtain a direction of the sound source, and / or determine a reaction force of the second force, to obtain the direction of the sound source.

[0117] In some possible embodiments, the acquisition module 710 is further configured to acquire at least one sound source, wherein each of the sound sources generates a first force, and each of the first forces is a resultant force of forces with the same moment of each of the vibration planes; and the determining module 720 is further configured to determine an angular velocity of the force of each of the sound sources on the second body in a process of rotating the second body based on a frequency of each of the sound sources, and determine a moment of the force of each of the sound sources on each of the vibration planes in the second body based on an angular acceleration of each of the angular velocities.

[0118] It should be noted that the above device embodiment is described similarly to the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0119] It should be noted that in the embodiments of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for causing a sound source positioning device to execute all or part of the method described in the embodiments of the present application. The storage medium mentioned above includes: a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk, and various media that can store program codes. Therefore, the embodiments of the present application are not limited to any specific hardware and software combination.

[0120] Correspondingly, the embodiments of the present application provide a computer readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the sound source positioning method described in any of the above embodiments are implemented.

[0121] Correspondingly, in the embodiments of the present application, a chip is also provided. The chip includes a programmable logic circuit and / or program instructions. When the chip is running, it is used to implement the steps of the sound source positioning method described in any of the above embodiments.

[0122] Correspondingly, in the embodiments of the present application, a computer program product is also provided. When the computer program product is executed by the processor of the sound source positioning device, it is used to implement the steps of the sound source positioning method described in any of the above embodiments.

[0123] The processor can be at least one of an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, or a microprocessor. It can be understood that the electronic device implementing the functions of the processor can also be other devices, and the embodiments of the present application are not limited in this regard.

[0124] The computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, a compact disc read-only memory (CD-ROM), or the like. It can also be various sound source positioning devices including one or any combination of the above memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, and the like.

[0125] It should be noted that the above description of the storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present application, please refer to the description of the method embodiments for understanding.

[0126] It should be understood that every feature, structure, or characteristic described herein is within a preferred embodiment of the present application. It should be noted that the foregoing embodiments are merely exemplary and are not to be construed as limiting the present application. It should also be noted that features from one embodiment can be combined with features from another embodiment. It should also be noted that the words "comprise," "comprising," "comprises," "include," "including," and "includes" when used in this specification and in the following claims are not to be interpreted so as to exclude other additives, components, elements or steps. It should be understood that the terms "a" or "an," as used herein, mean "one or more" when applied to any feature in the specification and claims.

[0127] It should be noted that, as used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component" can include a plurality of components. Similarly, the terms "another" and "at least one" are defined as including the plural unless the context clearly dictates otherwise.

[0128] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, such as: a plurality of units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed components can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0129] The units described above as separate components can or can not be physically separate, and the components shown as units can or can not be physical units; they can be located in one place or distributed on multiple network units; some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0130] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can be a unit alone, or two or more units can be integrated into one unit; the integrated unit can be realized in the form of hardware or in the form of hardware plus software functional unit.

[0131] Alternatively, the above-mentioned integrated units of the present application, if realized in the form of software function modules and sold or used as independent products, can also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to make the equipment test line execute all or part of the methods described in the embodiments of the present application. The foregoing storage medium includes mobile storage devices, ROM, magnetic discs or optical discs and various media that can store program codes.

[0132] The methods disclosed in the several method embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method embodiments.

[0133] The features disclosed in the several method or device embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method embodiments or device embodiments.

[0134] The above is only an implementation of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A sound source positioning device, comprising: a first body for receiving and processing vibrations generated by a sound source, the first body comprising at least a diaphragm and a back plate; a second body, the second body comprising at least four vibration planes, the second body being connected to the first body through any one of the vibration planes; wherein each of the vibration planes is configured to receive vibrations generated by the sound source and transmit the vibrations to the first body, the sound source positioning device receiving different directional forces generated by the sound source based on the angles of force receiving inclination of the forces generated by at least two of the vibration planes of the second body, and positioning the sound source according to the resultant force of the different directional forces in the spatial information. 2.The device of claim 1, wherein the second body is a polyhedron, and each plane of the polyhedron is made of a vibration material. 3.A sound source positioning method applied to a sound source positioning device, the method comprising: obtaining forces generated by a sound source on at least two vibration planes of a second body of the sound source positioning device, determining a resultant force of the forces generated by the sound source on each of the vibration planes of the second body to obtain a first force, each of the vibration planes being configured to receive vibrations generated by the sound source and transmit the vibrations to a first body, the second body being connected to the first body through any one of the vibration planes; in a case where the first force is not zero, determining a second force generated by the second body on the first body based on the transmission of the vibrations; a direction of the second force being the same as a direction of the first force; and positioning the sound source based on the first force and / or the second force. 4.The method of claim 3, wherein the obtaining forces generated by a sound source on at least two vibration planes of a second body of the sound source positioning device, determining a resultant force of the forces generated by the sound source on each of the vibration planes of the second body to obtain a first force, comprises: obtaining at least two vibration planes of the second body that are affected by the sound source; obtaining the forces generated by the sound source on each of the vibration planes; determining the resultant force of the forces generated by the sound source on each of the vibration planes of the second body based on the forces of the at least two vibration planes to obtain the first force. 5.The method of claim 4, wherein the determining the resultant force of the forces generated by the sound source on each of the vibration planes of the second body based on the forces of the at least two vibration planes comprises: in a case where the vibration planes of the second body that are affected by the sound source include two vibration planes, determining the resultant force of the forces of the two vibration planes to obtain the resultant force of the forces generated by the sound source on each of the vibration planes of the second body. In the case where the vibration plane in the second body acted on by the sound source comprises a plurality of vibration planes, a first resultant force of the acting forces of any two vibration planes is determined, and the following is iteratively performed: a second resultant force between the first resultant force and the acting force of any vibration plane not involved in determining the first resultant force is determined, the second resultant force is determined as the first resultant force, until the acting forces involved in determining the first resultant force comprise the acting forces of each of the plurality of vibration planes; the first resultant force is determined as the resultant force of the acting forces of each vibration plane in the second body.

6. The method of claim 3, wherein determining a second acting force of the second body on the first body based on vibration transmission comprises: determining a deformation of the first body caused by the action of the second body; determining the second acting force of the second body on the first body based on the deformation.

7. The method of any one of claims 4 to 6, wherein positioning the sound source based on the first acting force, and / or the second acting force, comprises: determining a reaction force of the first acting force to obtain a direction of the sound source; and / or determining a reaction force of the second acting force to obtain a direction of the sound source.

8. The method of claim 3, further comprising: obtaining at least one sound source; wherein each of the sound sources generates a first acting force; and each of the first acting forces is a resultant force of the acting forces of the same moment in each of the vibration planes; determining an angular velocity of the acting force of each of the sound sources on the second body in the process of rotating the second body based on a frequency of each of the sound sources; determining a moment of the acting force of each of the sound sources on each of the vibration planes in the second body based on an angular acceleration of each of the angular velocities.

9. An apparatus for positioning a sound source, the apparatus comprising: an obtaining module configured to obtain an acting force of the sound source on at least two vibration planes in a second body of the apparatus for positioning the sound source, and determine a resultant force of the acting force of the sound source on each of the vibration planes in the second body to obtain a first acting force; each of the vibration planes is configured to receive a vibration generated by the sound source and transmit the vibration to a first body; the second body is connected to the first body through any one of the vibration planes; a determining module configured to, in the case where the first acting force is not zero, determine a second acting force of the second body on the first body based on vibration transmission; a direction of the second acting force is the same as a direction of the first acting force; a positioning module configured to position the sound source based on the first acting force, and / or the second acting force. The computer program is executed by a processor to implement the steps in the method of any one of claims 3 to 8.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by a processor to implement the steps in the method of any one of claims 3 to 8.

Images