Audio processing method, apparatus and electronic device

By adjusting the sound filtering system of the headphones to process audio signals, the problem of visual and sound system failure in fire and smoke environments was solved, and the effectiveness of headphones in guiding evacuation was realized.

CN115379339BActive Publication Date: 2026-03-31GEER TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-29
Publication Date
2026-03-31

AI Technical Summary

Technical Problem

In emergencies such as fires, evacuation systems based on vision and sound cannot effectively guide people to safety in smoky environments. The visual system lacks clarity, and the sound system is susceptible to echo interference, leading to unclear directions.

Method used

By acquiring the movement direction of the headphone wearer and the incident direction of the sound source to be simulated, the transfer function of the sound filtering system is adjusted, the left and right channels are filtered, and an audio signal with an indicative direction is output to the headphones to guide the wearer's movement.

Benefits of technology

In smoky environments, headphones can play directional audio to help wearers evacuate safely and provide effective directional guidance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115379339B_ABST
    Figure CN115379339B_ABST
Patent Text Reader

Abstract

The present disclosure relates to the field of audio processing, and in particular to an audio processing method, device and electronic equipment. The audio processing method comprises: obtaining motion direction information of a headphone wearer and incident direction information of a to-be-simulated sound source relative to the headphone wearer, obtaining a parameter value of a spatial parameter of the to-be-simulated sound source according to the motion direction information and the incident direction information, adjusting a transfer function of an acoustic filtering system according to the parameter value of the spatial parameter, performing first filtering processing corresponding to a left channel and second filtering processing corresponding to a right channel on an audio signal corresponding to the to-be-simulated sound source according to the adjusted transfer function to obtain a left channel audio signal and a right channel audio signal, and outputting the left channel audio signal and the right channel audio signal to a left headphone and a right headphone of the headphone of the headphone wearer respectively to play the audio signal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of audio processing, and specifically to audio processing methods, apparatus and electronic devices. Background Technology

[0002] Currently, in some emergencies, such as fires, the evacuation of people mainly relies on visual emergency lighting evacuation signs. However, during fires, there may be a lot of smoke, and the clarity of evacuation signs in fire emergency lighting and evacuation sign systems is not ideal in smoky environments. In addition, people in fires experience a high degree of fear and disorientation, making it impossible for such visual emergency evacuation systems to fully guarantee the safe evacuation of people.

[0003] Given this situation, since sound attenuates very little in smoky environments, researchers incorporated speakers into evacuation signs. However, because sound can cause echoes in different spatial environments, trapped individuals may not be able to easily discern the direction from which the sound is coming, so this method cannot guarantee the safe evacuation of personnel. Summary of the Invention

[0004] This disclosure provides an audio processing method, apparatus, and electronic device that can solve the problem of personnel evacuation in emergency situations.

[0005] In a first aspect, embodiments of this application provide an audio processing method, comprising: acquiring motion direction information of an earphone wearer and incident direction information of a sound source to be simulated relative to the earphone wearer; obtaining parameter values ​​of spatial parameters of the sound source to be simulated based on the motion direction information and the incident direction information; adjusting the transfer function of an acoustic filtering system based on the parameter values ​​of the spatial parameters; performing a first filtering process corresponding to the left channel and a second filtering process corresponding to the right channel on the audio signal corresponding to the sound source to be simulated based on the adjusted transfer function to obtain a left channel audio signal and a right channel audio signal; and outputting the left channel audio signal and the right channel audio signal to the left and right earphones of the earphone wearer, respectively, to play the audio signal.

[0006] Optionally, obtaining the incident direction information of the sound source to be simulated relative to the headphone wearer includes: obtaining the sound source position information of the sound source to be simulated, the first position information of the left earphone and the second position information of the right earphone; obtaining the position information of the set calibration point of the headphone wearer based on the first position information and the second position information; and obtaining the incident direction information based on the sound source position information and the position information of the calibration point.

[0007] Optionally, obtaining the sound source location information of the sound source to be simulated includes: obtaining the target location information of the headphone wearer as the sound source location information of the sound source to be simulated.

[0008] Optionally, obtaining the target location information of the headphone wearer includes: obtaining fire location information reflecting the location of the fire in the place where the headphone wearer is located, and obtaining safety exit information of the place; determining the target safety exit corresponding to the headphone wearer based on the fire location information, the safety exit information and the headphone wearer's location information, and using the location information of the target safety exit as the target location information.

[0009] Optionally, the incident direction information of the sound source to be simulated relative to the headphone wearer is the incident direction information of a set calibration point of the headphone wearer, and the spatial parameters include the horizontal angle and azimuth angle of the sound source to be simulated in a set coordinate system with the set calibration point as the origin; wherein, the coordinate axis direction of the set coordinate system is determined based on the motion direction information.

[0010] Optionally, the transfer function is a head-related transfer function.

[0011] Optionally, both the first filtering process and the second filtering process are convolutional processes.

[0012] Optionally, the audio signal is an audio signal that prompts the headphone wearer to move toward the simulated sound source.

[0013] Secondly, embodiments of this application provide an audio processing device, comprising: an information acquisition module for acquiring motion direction information of an earphone wearer and incident direction information of a sound source to be simulated relative to a calibration point of the earphone wearer; a parameter calculation module for obtaining parameter values ​​of spatial parameters of the sound source to be simulated based on the motion direction information and the incident direction information; a function adjustment module for adjusting the transfer function of an acoustic filtering system based on the parameter values ​​of the spatial parameters; an audio processing module for performing a first filtering process corresponding to the left channel and a second filtering process corresponding to the right channel on the audio signal corresponding to the sound source to be simulated based on the adjusted transfer function, to obtain a left channel audio signal and a right channel audio signal; and an output module for outputting the left channel audio signal and the right channel audio signal to the left and right earphones of the earphone wearer, respectively, to play the audio signals.

[0014] Thirdly, embodiments of this application provide an electronic device having a processor and a memory, wherein the memory stores computer instructions, and when executed by the processor, the computer instructions implement the steps of the method described in any of the first aspects above.

[0015] One beneficial effect of this disclosure is that the spatial parameters of the simulated sound source can be obtained based on the movement direction information of the headphone wearer and the incident direction information of the simulated sound source relative to the headphone wearer. Then, the transfer function of the sound filtering system is adjusted according to the parameter values, and the audio signals of the corresponding simulated sound sources are filtered according to the adjusted transfer function to obtain the left and right channel audio signals, which are then output from the headphones. In this way, in the event of an emergency, audio with directional indication can be played through the headphones, allowing the wearer to perceive the direction from which the audio is emitted, providing directional guidance and directing their movement.

[0016] Other features and advantages of the embodiments of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments of the present disclosure and, together with their description, serve to explain the principles of the embodiments of the present disclosure.

[0018] Figure 1 A flowchart of an audio processing method according to an embodiment of the present disclosure is shown.

[0019] Figure 2 A schematic diagram illustrating an example of an audio processing method according to an embodiment of the present disclosure is shown.

[0020] Figure 3 A block diagram of an audio processing apparatus according to an embodiment of the present disclosure is shown. Detailed Implementation

[0021] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the invention.

[0022] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.

[0023] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0024] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0025] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0026] This application discloses an audio processing method, such as... Figure 1 As shown, the method includes steps S11-S15.

[0027] Step S11: Obtain the motion direction information of the headphone wearer and the incident direction information of the sound source to be simulated relative to the headphone wearer.

[0028] In one example of this embodiment, the earphone may be equipped with a positioning module. When the earphone is worn, the positioning module can be used to obtain the location of the earphone, i.e. the location of the earphone wearer, and report the location of the earphone wearer to the server or main control device.

[0029] In one example of this embodiment, the earphone can continuously report its own location information. The server or main control device can determine the direction of movement of the earphone wearer based on the location changes of the earphone in a recent period of time. After obtaining the direction of movement of the earphone wearer, the direction in which the earphone wearer is facing can be further determined.

[0030] In one example of this embodiment, obtaining the incident direction information of the sound source to be simulated relative to the headphone wearer includes: obtaining the sound source position information of the sound source to be simulated, the first position information of the left earphone and the second position information of the right earphone; obtaining the position information of the set calibration point of the headphone wearer based on the first position information and the second position information; and obtaining the incident direction information based on the sound source position information and the position information of the calibration point.

[0031] In one example of this embodiment, obtaining the sound source location information of the sound source to be simulated includes: obtaining the target location information of the headphone wearer as the sound source location information of the sound source to be simulated.

[0032] In one example of this embodiment, the target location of the headphone wearer can be the location that the headphone wearer needs to reach, such as the location of a safety exit.

[0033] In one example of this embodiment, obtaining the target location information of the headphone wearer includes: obtaining fire location information reflecting the location of the fire in the place where the headphone wearer is located, and obtaining the safety exit information of the place. Based on the fire location information, the safety exit information and the headphone wearer's location information, the target safety exit corresponding to the headphone wearer is determined, and the location information of the target safety exit is used as the target location information.

[0034] In one example of this embodiment, when a fire occurs, the location information of the fire is first obtained. Specifically, an infrared imager can be used to sense the temperature of the location and upload the temperature information to a server for analysis or processing to determine the location of the fire. Simultaneously, the location information of the safety exits in the location can also be obtained. This safety exit information can be pre-stored in a server or main control device.

[0035] After obtaining the fire location information, safety exit information, and the headphone wearer's location information, the target safety exit for the headphone wearer can be determined based on these three locations. Specifically, prioritizing the closest safety exit that does not pass through the fire location, the headphone wearer's target safety exit can be selected, and its location information can be used as the target location information. Once the headphone wearer's target location information is determined, it can be used as the sound source location information to be simulated.

[0036] In this example, in the case of a fire, the location information of the fire, the location information of the safety exit, and the location information of the headphone wearer can be used to determine the safety exit suitable for the headphone wearer, and the location information of that safety exit can be used as the target location information.

[0037] In one example of this embodiment, after obtaining the position information of the left and right earphones of the earphone wearer, the position information of the earphone wearer's set calibration point can be determined based on the position information of the left and right earphones at the same time. In this example, the set calibration point can be the position of the center point of the earphone wearer's head. Specifically, the midpoint of the left and right earphones can be determined based on the position information of the left and right earphones, such as... Figure 2 Point O shown is used as the calibration point. Specifically, the calibration point for the headphone wearer can be flexibly set by those skilled in the art according to actual needs.

[0038] Step S12: Obtain the parameter values ​​of the spatial parameters of the sound source to be simulated based on the motion direction information and the incident direction information.

[0039] After obtaining the motion direction information of the headphone wearer and the incident direction information of the sound source to be simulated, the spatial parameter values ​​of the sound source to be simulated can be obtained based on the motion direction information and the incident direction information.

[0040] In one example of this embodiment, the incident direction information of the sound source to be simulated for the headphone wearer is the incident direction information for the set calibration point of the headphone wearer. The spatial parameters include the horizontal angle and azimuth angle of the sound source to be simulated in the set coordinate system with the set calibration point as the origin; wherein, the coordinate axis direction of the set coordinate system is determined based on the motion direction information.

[0041] In one example of this embodiment, the incident direction information of the sound source to be simulated relative to the headphone wearer is the direction of the position of the sound source to be simulated relative to the headphone wearer. Specifically, it can be the direction information of the sound source position information relative to the set calibration point.

[0042] In one example of this embodiment, the coordinate system is established with the headphone wearer's designated calibration point as the origin. The directions of the coordinate axes of the coordinate system can be determined based on the headphone wearer's direction of movement, specifically, as follows: Figure 2 As shown, a coordinate system can be established with the direction of movement of the headphone wearer, i.e., the direction directly in front of the headphone wearer, as the Y-axis, the direction directly above the headphone wearer's set point as the Z-axis, and the direction directly to the right of the headphone wearer's set point as the X-axis.

[0043] In one example of this embodiment, such as Figure 2 As shown, under the set coordinate system, the spatial parameter values ​​of the sound source to be simulated in the set coordinate system can be determined based on the incident direction information. For example, the horizontal angle and azimuth angle. In this example, the horizontal angle is the angle between the direction of the sound source S to the set point O and the horizontal plane, that is, the angle between SO and the XOY plane. 90° represents directly above, and -90° represents directly below. The azimuth angle is the angle between the projection S'O of SO on the XOY plane and the Y-axis. 0° represents directly in front, 90° represents directly to the right, 180° represents directly behind, and 270° represents directly to the left.

[0044] Step S13: Adjust the transfer function of the acoustic filtering system according to the parameter values ​​of the spatial parameters;

[0045] Step S14: Based on the adjusted transfer function, the audio signals of the corresponding simulated sound source are subjected to the first filtering process for the left channel and the second filtering process for the right channel, respectively, to obtain the left channel audio signal and the right channel audio signal.

[0046] In one example of this embodiment, the transfer function is a head-related transfer function.

[0047] In reality, a point sound source enters a person's ears only after being reflected or refracted by the body parts of the torso, head, and auricle. This physical process can be viewed as a linear time-invariant sound filtering system. Therefore, the characteristics of this physical process can be represented by a transfer function, such as the HRTF (Head Related Transfer Function).

[0048] After determining the spatial parameters of the sound source to be simulated, these parameters can be used to determine a specific HRTF as the transfer function. Specifically, an HRTF matching the sound source to be simulated can be determined from an HRTF near-field database. This HRTF can filter a single-channel audio signal to obtain a left-channel audio signal and a right-channel audio signal. Furthermore, when a person's left and right ears receive the corresponding left and right channel audio signals, they will perceive the audio signal as originating from the location of the sound source to be simulated.

[0049] In one example of this embodiment, both the first filtering process and the second filtering process are convolutional processes.

[0050] In one example of this embodiment, the audio signal is an audio signal that prompts the headphone wearer to move toward the simulated sound source.

[0051] In one example of this embodiment, the audio signal of the sound source to be simulated can be a mono sound source signal used to guide the headphone wearer to move, such as a voice prompt signal of "This is the emergency exit".

[0052] Step S15: Output the left channel audio signal and the right channel audio signal to the left and right earpieces of the headphone wearer, respectively, to play the audio signals.

[0053] After determining the left and right channel audio signals corresponding to the position to be simulated, the left channel audio signal can be output to the wearer's left earphone, and the right channel audio signal can be output to the wearer's right earphone, and the audio signals can be played. This allows the earphone wearer to hear directional audio through the earphones in case of an emergency, enabling them to perceive the direction from which the audio is emitted, providing directional guidance and directing their movement.

[0054] See Figure 3 As shown, this embodiment provides an audio processing device 100, including:

[0055] The information acquisition module 101 is used to acquire the motion direction information of the headphone wearer and the incident direction information of the sound source to be simulated relative to the calibration point of the headphone wearer.

[0056] The parameter calculation module 102 is used to obtain the parameter values ​​of the spatial parameters of the sound source to be simulated based on the motion direction information and the incident direction information.

[0057] The function adjustment module 103 is used to adjust the transfer function of the acoustic filtering system according to the parameter values ​​of the spatial parameters.

[0058] The audio processing module 104 is used to perform a first filtering process on the left channel and a second filtering process on the right channel of the audio signal corresponding to the simulated sound source according to the adjusted transfer function, so as to obtain the left channel audio signal and the right channel audio signal.

[0059] Additionally, the output module 105 is used to output the left channel audio signal and the right channel audio signal to the left and right earpieces of the headphone wearer, respectively, to play the audio signal.

[0060] Optionally, the information acquisition module includes: a first acquisition submodule, used to acquire the sound source location information of the sound source to be simulated, the first position information of the left earphone, and the second position information of the right earphone; a first obtaining submodule, used to obtain the position information of the set calibration point of the earphone wearer based on the first and second position information; and a second obtaining submodule, used to obtain the incident direction information based on the sound source location information and the calibration point position information.

[0061] Optionally, the first acquisition submodule is specifically used to: acquire the target position information of the headphone wearer, as the sound source position information of the sound source to be simulated.

[0062] Optionally, the first acquisition submodule is specifically used to: acquire fire location information reflecting the location of the fire in the place where the headphone wearer is located, and acquire the safety exit information of the place; determine the target safety exit for the headphone wearer based on the fire location information, safety exit information and headphone wearer's location information, and use the location information of the target safety exit as the target location information.

[0063] Optionally, the incident direction information of the sound source to be simulated for the headphone wearer is the incident direction information for the set calibration point of the headphone wearer, and the spatial parameters include the horizontal angle and azimuth angle of the sound source to be simulated in the set coordinate system with the set calibration point as the origin; wherein, the coordinate axis direction of the set coordinate system is determined based on the motion direction information.

[0064] Optionally, the transfer function is a head-related transfer function.

[0065] Optionally, both the first and second filtering processes are convolutional processes.

[0066] Optionally, the audio signal is an audio signal that prompts the headphone wearer to move toward the simulated sound source.

[0067] This embodiment provides a computer-readable storage medium storing executable commands. When executed by a processor, the executable commands implement the various processes of the above-described audio processing method embodiment and achieve the same technical effect. To avoid repetition, further details are omitted here.

[0068] This embodiment provides an electronic device having a processor and a memory. The memory stores computer instructions. When the computer instructions are executed by the processor, they implement the various processes of the above-described audio processing method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0069] It should be noted that all actions involving the acquisition of signals, information, or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where the application is located, and with authorization from the owner of the relevant device / account.

[0070] The various embodiments in this disclosure are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and apparatus embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0071] The foregoing has described specific embodiments of this disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired results. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0072] Embodiments of this disclosure may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the embodiments of this disclosure.

[0073] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0074] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0075] Computer program instructions used to perform the operations of embodiments of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on a user's computer, partially on a user's computer, as a standalone software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of embodiments of this disclosure.

[0076] Various aspects of embodiments of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0077] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0078] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0079] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are equivalent.

[0080] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. An audio processing method, characterized by, The method comprises: obtaining motion direction information of a headphone wearer and incidence direction information of a to-be-simulated sound source relative to the headphone wearer; wherein a positioning module is arranged in the headphone; obtaining a parameter value of a spatial parameter of the to-be-simulated sound source according to the motion direction information, a facing direction of the headphone wearer and the incidence direction information; adjusting a transfer function of an acoustic filtering system according to the parameter value of the spatial parameter; performing first filtering processing corresponding to a left sound channel and second filtering processing corresponding to a right sound channel on an audio signal corresponding to the to-be-simulated sound source respectively according to the adjusted transfer function, to obtain a left sound channel audio signal and a right sound channel audio signal; outputting the left sound channel audio signal and the right sound channel audio signal to a left headphone and a right headphone of the headphone of the headphone wearer respectively to play the audio signal, the audio signal being an audio signal for prompting the headphone wearer to move towards the to-be-simulated sound source; obtaining incidence direction information of a to-be-simulated sound source relative to a headphone wearer comprises: obtaining target position information of the headphone wearer, first position information of a left headphone and second position information of a right headphone; obtaining position information of a set calibration point of the headphone wearer according to the first position information and the second position information; obtaining the incidence direction information according to the target position information and the position information of the calibration point; wherein obtaining the target position information of the headphone wearer comprises: obtaining fire position information reflecting a fire occurrence position of a place where the headphone wearer is located, and obtaining pre-stored safety exit information of the place, wherein the fire position information is determined by temperature information of the place obtained by an infrared imager arranged in the place, and the safety exit information of the place; determining a target safety exit corresponding to the headphone wearer according to the fire position information, the safety exit information and position information of the headphone wearer, wherein the target safety exit is a safety exit closest to the position of the headphone wearer and not passing through the fire position; taking the position information of the target safety exit as the target position information.

2. The method of claim 1, wherein, The incidence direction information of the to-be-simulated sound source relative to the headphone wearer is incidence direction information relative to a set calibration point of the headphone wearer, and the spatial parameter comprises a horizontal angle and an azimuth angle of the to-be-simulated sound source in a set coordinate system with the set calibration point as the origin; wherein the coordinate axis direction of the set coordinate system is determined based on the motion direction information.

3. The method of claim 1, wherein, The transfer function is a head-related transfer function.

4. The method of claim 1, wherein, The first filtering processing and the second filtering processing are both convolution processing.

5. An audio processing apparatus, characterized by comprising: The method comprises: an information acquisition module, configured to obtain motion direction information of a headphone wearer and incidence direction information of a to-be-simulated sound source relative to a calibration point of the headphone wearer; wherein a positioning module is arranged in the headphone; a parameter calculation module, configured to obtain a parameter value of a spatial parameter of the to-be-simulated sound source according to the motion direction information, a facing direction of the headphone wearer and the incidence direction information; The function adjustment module is configured to adjust a transfer function of the acoustic filtering system according to the parameter value of the spatial parameter. The audio processing module is configured to perform first filtering processing corresponding to a left channel and second filtering processing corresponding to a right channel on the audio signal corresponding to the to-be-simulated sound source according to the adjusted transfer function, to obtain a left-channel audio signal and a right-channel audio signal. The output module is configured to output the left-channel audio signal and the right-channel audio signal to a left earphone and a right earphone of the earphone worn by the earphone wearer respectively, to play the audio signal, the audio signal being an audio signal about prompting the earphone wearer to move towards the to-be-simulated sound source. The information acquisition module is specifically configured to: acquire target position information of the earphone wearer, first position information of the left earphone, and second position information of the right earphone; obtain position information of a set calibration point of the earphone wearer according to the first position information and the second position information; obtain the incident direction information according to the target position information and the position information of the calibration point. The information acquisition module is specifically configured to: acquire fire position information reflecting a fire occurrence position of a place where the earphone wearer is located, and acquire pre-stored safety exit information of the place, wherein the fire position information is determined by temperature information of the place acquired by an infrared imager arranged in the place, and the safety exit information of the place; determine a target safety exit corresponding to the earphone wearer according to the fire position information, the safety exit information, and position information of the earphone wearer, wherein the target safety exit is a safety exit closest to the position of the earphone wearer and not passing through the fire position; take the position information of the target safety exit as the target position information.

6. An electronic device, comprising: The electronic device includes a memory and a processor, the memory is configured to store a computer program, and the processor is configured to execute the audio processing method according to any one of claims 1 to 4 under control of the computer program.

Citation Information

Patent Citations

  • Stereo processing method and system of earphone assembly and earphone assembly

    CN111142665A