True sense sound equipment audio output device for talkback communication

Abstract

The present invention relates to a real sound audio output device for talkback communication, comprising: a noise reduction unit for reducing peripheral noise when a plurality of audio signals are input; a multiple sound source determination unit that determines whether or not the plurality of processed audio signals transmitted through the noise reduction unit are stereo sound sources and outputs a plurality of stereo signals; a multiple audio rendering unit including an audio channel separation rendering unit that performs first audio-video localization reflecting sound source position information on the plurality of stereo signals or an audio panorama rendering unit that performs second audio-video localization reflecting sound source position information and tracking information; and a sound source output unit for post-processing the plurality of stereo signals output by the multiple audio rendering unit and outputting the post-processed stereo signals. Therefore, space sense can be applied to each sound channel through dual audio and video positioning, and real sense sound can be heard in a stereophonic sound listening environment.

Description

Technical Field

[0001] The present invention relates to a device for reducing surrounding noise through a noise reduction unit when multiple audio signals are input, and determining in a multiple sound source determination unit whether multiple processed audio signals transmitted are stereo sound sources and outputting them as multiple stereo signals, and then performing a first audio and video positioning reflecting sound source position information or a second audio and video positioning reflecting sound source position information and tracking information on the output multiple stereo signals in a multiple audio rendering unit, and then performing post-processing in a sound source output unit and outputting them, so that a spatial sense can be applied to each channel through dual audio and video localization, and real sound can be heard in a stereo listening environment. Background Art

[0002] As is known to all, Inter Communication System (ICS, hereinafter referred to as "intercommunication"), as an interactive communication system, is a multiplex communication system that mixes various signal channels input according to communication objects such as microphones into stereo channels or monaural channels and outputs them. It is used to provide communication services for transmitting commands or contact information between a radio station studio and a control room or between a control room, and is also used to provide communication services for transmitting commands or contact information between an aircraft and a control department or between an aircraft. It is also suitable for various multi-channel communication fields such as internal communications in fighter jets and tanks.

[0003] However, existing intercom communications simply mix and output the input multi-channel sound sources, so there are problems with reduced voice clarity and situation judgment recognition rate. In addition, for intercom communications of fighter jets and tanks, although danger signals related to surrounding dangerous factors can be expressed as sound and transmitted to listeners, in order to make judgments on dangerous situations, it is difficult to grasp the direction and movement of dangerous factors before using additional equipment such as radar. Therefore, it is necessary to express the location and movement information of the dangerous factors through sound.

[0004] In order to solve the above-mentioned problems, it is necessary to develop an audio output device that can truly output various input sounds. Prior art literature Patent Literature

[0007] 1. Korean registered patent No. 10-0542129 (registered on January 3, 2006) Summary of the invention

[0008] The object of the present invention is to provide a device which reduces surrounding noise through a noise reduction unit when multiple audio signals are input, determines in a multiple sound source determination unit whether the multiple processed audio signals transmitted are stereo sound sources and outputs them as multiple stereo signals, and then performs a first audio and video positioning reflecting sound source position information or a second audio and video positioning reflecting sound source position information and tracking information on the output multiple stereo signals in a multiple audio rendering unit, and then performs post-processing in a sound source output unit and outputs them, so that a spatial sense can be applied to each channel through audio and video localization, and a real sound audio output device for intercom communication can be used to listen to real sound in a stereo listening environment.

[0009] The purposes of the embodiments of the present invention are not limited to the purposes mentioned in the above content, and a person having general knowledge in the technical field to which the present invention belongs will be able to further clearly understand other purposes not mentioned through the following description.

[0010] In an embodiment of the present invention, a real-sound audio output device for intercom communication can be provided, comprising: a noise reduction unit, which reduces surrounding noise when multiple audio signals are input; a multiple sound source judgment unit, which judges whether multiple processed audio signals transmitted through the noise reduction unit are stereo sound sources and outputs them as multiple stereo signals; a multiple audio rendering unit, including an audio channel separation rendering unit that performs a first audio and video positioning reflecting sound source position information on the multiple stereo signals or an audio panoramic rendering unit that performs a second audio and video positioning reflecting sound source position information and tracking information; and a sound source output unit, which post-processes and outputs the multiple stereo signals output by the multiple audio rendering units.

[0011] In addition, in an embodiment of the present invention, a real-sound audio output device for intercom communication can be provided, wherein the audio channel separation rendering unit includes: a first preprocessing unit, which performs preprocessing to prevent sound source distortion of the multiple stereo signals; a 1-1 reverberation processing unit, which selectively performs reverberation processing on the preprocessed multiple stereo signals for the sense of spatiality of the sound source; a first ear boost unit, which adjusts the multiple stereo signals that have been reverberated to a preset listening volume value; a first sound source position information providing unit, which provides first sound source position information using a head-related transfer function (HRTF); a first sound and image localization unit, which performs the first sound and image localization reflecting the first sound source position information on the multiple stereo signals adjusted to the preset listening volume value; and a 1-2 reverberation processing unit, which selectively performs reverberation processing on the multiple stereo signals that have been subjected to the first sound and image localization for the sense of spatiality of the sound source.

[0012] In addition, in an embodiment of the present invention, a real-sound audio output device for intercom communication can be provided, wherein the first audio and video localization unit includes: an elevation pinna filter unit, which processes the multiple stereo signals according to the pinna effect of the height position of the audio and video; an azimuth pinna filter unit, which represents the position of the multiple stereo signals according to the direction angle on the horizontal plane; and a head shadow filter unit, which processes the multiple stereo signals output from the elevation pinna filter unit and the azimuth pinna filter unit according to the effect of the shape of the human head.

[0013] In addition, in an embodiment of the present invention, a real-sound audio output device for intercom communication can be provided, wherein the audio panoramic rendering unit includes: a second preprocessing unit, which performs preprocessing to prevent sound source distortion of the multiple stereo signals; a 2-1 reverberation processing unit, which selectively performs reverberation processing on the preprocessed multiple stereo signals for the sense of spatiality of the sound source; a second ear boost unit, which adjusts the multiple stereo signals that have been reverberated to a preset listening volume value; a second sound source position information providing unit, which provides second sound source position information using the head-related transfer function (HRTF); a tracking information processing unit, which provides head movement information; a second sound and image localization unit, which performs the second sound and image localization reflecting the second sound source position information and the head movement information on the multiple stereo signals adjusted to the preset listening volume value; and a 2-2 reverberation processing unit, which selectively performs reverberation processing on the multiple stereo signals that perform the second sound and image localization for the sense of spatiality of the sound source.

[0014] In addition, in an embodiment of the present invention, a real-sound audio output device for intercom communication can be provided, wherein the second audio and video localization unit includes: an elevation pinna filter unit, which processes the multiple stereo signals according to the pinna effect of the height position of the audio and video; an azimuth pinna filter unit, which represents the position of the multiple stereo signals according to the direction angle on the horizontal plane; and a head shadow filter unit, which processes the multiple stereo signals output from the elevation pinna filter unit and the azimuth pinna filter unit according to the effect of the shape of the human head.

[0015] In addition, in an embodiment of the present invention, a real-sound audio output device for intercom communication can be provided, wherein the sound source output unit includes: a volume normalization unit for adjusting the volume difference of the multiple stereo signals output by the multiple audio rendering unit; a down-mixing unit for down-mixing the multiple stereo signals output by the volume normalization unit according to the number of channels, and an equalizer processing unit for performing equalizer adjustment on the multiple stereo signals output by the down-mixing unit and outputting them.

[0016] The present invention can reduce surrounding noise through the noise reduction unit when multiple audio signals are input, and determine whether the multiple processed audio signals transmitted are stereo sound sources in the multiple sound source determination unit and output them as multiple stereo signals, and then perform a first audio and video positioning that reflects the sound source position information or a second audio and video positioning that reflects the sound source position information and tracking information on the output multiple stereo signals in the multiple audio rendering unit, and then perform post-processing in the sound source output unit and output them, so that the spatial sense can be applied to each channel through dual audio and video positioning, thereby allowing real sound to be heard in a stereo listening environment.

[0017] In addition, the present invention can solve the problem of decreased clarity of the output audio signals due to sound mixing even for multiple audio signals that sound simultaneously, thereby improving communication performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 1 is a diagram showing the structure of a real sound audio output device for intercom communication according to an embodiment of the present invention.

[0019] Figure 2 as well as Figure 3 It is a detailed structural diagram of an audio channel separation rendering unit provided in a real sound audio output device for intercom communication according to an embodiment of the present invention.

[0020] Figure 4 as well as Figure 5 The present invention is a detailed structural diagram of an audio panoramic rendering unit provided in a realistic sound audio output device for intercom communication according to an embodiment of the present invention.

[0021] Figure 6 This is a detailed structural diagram of a sound source output unit provided in a real-sound audio output device for intercom communication according to an embodiment of the present invention.

[0022] Figure 7 This is a schematic diagram illustrating an example of a system to which the real sound audio output device for intercom communication according to an embodiment of the present invention is applied. DETAILED DESCRIPTION

[0023] The advantages and features of the embodiments of the present invention and the methods for achieving them will be further clarified by the subsequent embodiments which will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments disclosed in the following content, but can be implemented in a variety of different forms. These embodiments are only for the purpose of more fully disclosing the present invention and more fully introducing the scope of the present invention to those with general knowledge of the technical field to which the present invention belongs. The present invention should only be defined according to the scope of the claims. Throughout the specification, the same reference numerals represent the same components.

[0024] In the process of describing the embodiments of the present invention, when it is determined that the detailed description of a known function or structure may make the gist of the present invention unclear, the detailed description related to it will be omitted. In addition, the terms used subsequently are defined in consideration of the functions in the embodiments of the present invention, which may change according to the intention or convention of the user and the user. Therefore, it should be defined based on the overall content of this specification.

[0025] Next, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0027] Figure 1 is a diagram showing the structure of a real-sound audio output device for intercom communication according to an embodiment of the present invention. Figure 2 as well as Figure 3 is a detailed structural diagram of an audio channel separation rendering unit provided in a real-sound audio output device for intercom communication according to an embodiment of the present invention, Figure 4 as well as Figure 5 is a detailed structural diagram of an audio panoramic rendering unit provided in a realistic sound audio output device for intercom communication according to an embodiment of the present invention, and Figure 6 This is a detailed structural diagram of a sound source output unit provided in a real-sound audio output device for intercom communication according to an embodiment of the present invention.

[0029] See also Figures 1 to 6 According to an embodiment of the present invention, the real sound audio output device for intercom communication may include a noise reduction unit 100, a multiple sound source determination unit 200, a multiple audio rendering unit 300, and a sound source output unit 400.

[0031] The noise reduction unit 100 can reduce the surrounding noise when there are multiple audio signals input. For example, various external noises contained in multiple audio signals of multi-channel and multi-object performance venues, radio stations, airplanes, tanks and vehicles, as well as noise generated in communication lines, can be reduced by active noise control (ANC), active noise reduction (ANR) and electronic noise cancelling (ENC) to reduce the noise in the input audio signals of each multi-channel and multi-object, and then output multiple processed audio signals to the multiple sound source judgment unit 200.

[0032] In addition, the noise reduction unit 100 can detect the speech interval through real-time speech modeling, and can minimize sound distortion by reducing noise even under low signal-to-noise ratio (SNR) conditions. It not only supports the 8KHz frequency band for narrowband speech, but also supports 16, 22.5, 24, 32 and 48KHz formats, so that it can effectively reduce noise not only for wideband speech but also for microphone noise of portable terminals.

[0034] The multiple sound source determination unit 200 determines whether the multiple processed audio signals transmitted through the noise reduction unit 100 are stereo sound sources and outputs them as multiple stereo signals. The multiple processed audio signals output by the noise reduction unit 100 can be output in a mono format or a stereo format. In order to locate the phase of the sound source, the corresponding sound source needs to be processed into a stereo signal. Therefore, the information of each processed audio signal can be confirmed, so that the stereo signal can be directly output to the multiple audio rendering unit 300, and the mono signal can be output to the multiple audio rendering unit 300 after up mixing (up mixing) to convert it into a stereo signal.

[0036] The multiple audio rendering unit 300 can perform a first audio and video localization reflecting the sound source position information on the multiple stereo signals, or perform a second audio and video localization reflecting the sound source position information and tracking information, such as Figure 1 As shown, an audio channel separation rendering unit 300A or an audio panoramic rendering unit 300B may be included. The input multiple stereo signals may be input to the audio channel separation rendering unit 300A or the audio panoramic rendering unit 300B.

[0037] Among them, there is almost no sound pressure difference when the sound coming from the front of the face is transmitted to the two ears. However, the sound coming from the side has a head shadow effect with a difference of about 1 / 1000 second between the left and right sides. Therefore, the direction of the sound source can be recognized by this. In the case that the direction of the sound source cannot be distinguished by the head shadow effect, the timbre can be distinguished according to the shape of the auricle, which is called the pinna effect.

[0038] The audio channel separation rendering unit 300A performs the first audio and video localization for audio channel separation by reflecting the sound source position information on the plurality of stereo signals. Figure 2 As shown, it may include a first pre-processing unit 310a, a 1-1 reverberation processing unit 320a, a first ear boost unit 330a, a first sound source position information providing unit 340a, a first audio and video localization unit 350a and a 1-2 reverberation processing unit 360a.

[0039] The first preprocessing unit 310a performs preprocessing to prevent the multiple stereo signals from sound source distortion, and can perform preprocessing to enhance the phenomenon of partial distortion of speech during audio and video localization performed by the interactive communication system.

[0040] The 1-1 reverberation processing unit 320a selectively performs reverberation processing on the pre-processed stereo signals for the purpose of enhancing the spatial sense of the sound source. For a sound source requiring a spatial sense, the sound source can be given a spatial sense by selectively performing the reverberation processing on the sound source.

[0041] Next, the reverberation processing described above will be described in detail. In reality, the reason why the sound heard has a sense of space is because of the combination of the sound heard directly and the reflected sound heard after being reflected by the wall, etc., and the reverberation technology can be realized by the reflection, absorption and diffusion of the sound on the walls of the space surrounding the listener. After the 1-1 reverberation processing unit 320a generates the initial reflected sound, the 1-2 reverberation processing unit 360a described later can generate the late reflected sound, so that it can be applied in the form of a reflection group combination.

[0042] In the case where the reverberation processing of the 1-1th reverberation processing part 320 a as described above is not required, the plurality of stereo signals output from the first pre-processing part 310 a may be input to the first ear enhancement part 330 a .

[0043] The first ear enhancement unit 330a adjusts the multiple stereo signals that have undergone reverberation processing to a preset listening volume value, and may adjust the signals to the preset listening volume value and output the signals so that the user can hear a sound source with a lower or higher volume.

[0044] The first sound source position information providing unit 340a provides the first sound source position information by using the head related transfer function (HRTF). The head related transfer function (HRTF) is a transfer function of the sound system from a sound located at a specific position in a three-dimensional space to a person's ears. The HRTF is affected by the refraction and sound insulation of the head and shoulders, the reflection and diffraction of the outer ear (auricle), etc. according to the three-dimensional position of the sound source. It can be understood how a person grasps the position of the sound source in the three-dimensional space, which is affected by the size of the head, the position and shape of the outer ear, etc.

[0045] The first sound and image localization unit 350a performs the first sound and image localization reflecting the first sound source position information on multiple stereo signals adjusted to a pre-set listening volume value, and can perform the first sound and image localization by reflecting the first sound source position information provided by using the head-related transfer function (HRTF) to determine the position of the sound and image.

[0046] The 1-2 reverberation processing unit 360a selectively performs reverberation processing on a plurality of stereo signals for performing the first sound image localization for the purpose of enhancing the spatial sense of the sound source. For a sound source that requires an additional spatial sense, the sound source can be given a spatial sense by selectively performing additional reverberation processing on the sound source.

[0047] In the case where the reverberation processing of the 1-2 reverberation processing unit 360 a as described above is not required, the plurality of stereo signals on which the first sound image localization is performed by the first sound image localization unit 350 a may be output to the sound source output unit 400 .

[0048] The first audio and video localization unit 350a as described above is as follows Figure 3 As shown, it may include a first elevation pinna filter portion 351a, a first azimuth pinna filter portion 353a, and a first head shadow filter portion 355a.

[0049] Among them, the first elevation pinna filter unit 351a performs pinna effect processing on multiple stereo signals according to the height position of the sound and image, and can perform height processing of the sound and image and output it by applying an elevation pinna filter based on the pinna effect.

[0050] The first height pinna filter section 351a as described above may include a 1-1th height pinna filter 351a / 1 for inputting a left input signal L and a 1-2th height pinna filter 351a / 2 for inputting a right input signal R, thereby respectively performing high and low processing of the audio and video on the left input signal and the right input signal in the stereo signal.

[0051] The first azimuth pinna filter unit 353a performs pinna effect processing according to the angular position of the sound and image on the plurality of stereo signals, and can process the angular position of the sound and image by applying an azimuth pinna filter based on the pinna effect and output the processed sound and image.

[0052] The first azimuth pinna filter section 353a as described above may include a 1-1th azimuth pinna filter 353a / 1 for inputting a left input signal L and a 1-2th azimuth pinna filter 353a / 2 for inputting a right input signal R, thereby respectively performing audio and video directional angle effects processing on the left input signal and the right input signal in the stereo signal.

[0053] The left input signal L in the stereo signal is processed by the 1-1 height pinna filter 351a / 1 and the 1-1 direction pinna filter 353a / 1 for the height and angular effects of the sound and image and is input to the first head shadow filter section 355a, while the right input signal R in the stereo signal is processed by the 1-2 height pinna filter 351a / 2 and the 1-2 direction pinna filter 353a / 2 for the height and angular effects of the sound and image and is input to the first head shadow filter section 355a. A delay circuit (Delay) may be provided to allow the left input signal L and the right input signal R to be input to the first head shadow filter section 355a at the same time point.

[0054] The first head shadow filter unit 355a processes the multiple stereo signals output from the first height pinna filter unit 351a and the first directional pinna filter unit 353a according to the effect of the human head shape. The head shadow filter is developed by applying the head shadow effect, which is based on the distance difference based on the ear measured according to the direction of the sound and the influence of the human head shape and modeling the acquired impulse response (HRIR, head related impulse response) curve. It can process the sound and image difference caused by the human head and process it into a state in which the sound sources in the left and right directions can be recognized and output.

[0055] By applying the filter provided in the first sound and image localization unit 350 a as described above, it is possible to output and listen to realistic sounds with a sense of distance and direction even when wearing headphones or earphones.

[0056] In addition, in order to minimize the amount of calculation and memory usage and be used in portable terminals, the first audio and video localization unit 350a as described above reduces the order of each filter to first or second order and implements it with an infinite impulse response (IIR) filter, thereby performing audio and video localization processing on more than 8 multiple channels and multiple objects in real time according to position and distance values.

[0058] In addition, the audio panoramic rendering unit 300B performs a second audio and video positioning on the plurality of stereo signals by reflecting the sound source position information and the tracking information to perform audio panoramic processing, such as Figure 4 As shown, it may include a second pre-processing unit 310b, a 2-1 reverberation processing unit 320b, a second ear enhancement unit 330b, a second sound source position information providing unit 340b, a tracking information processing unit 350b, a second audio and video positioning unit 360b and a 2-2 reverberation processing unit 370b, etc.

[0059] The second preprocessing unit 310b performs preprocessing to prevent the multiple stereo signals from sound source distortion, and can perform preprocessing to enhance the phenomenon of partial distortion of speech during audio and video localization performed by the interactive communication system.

[0060] The 2-1 reverberation processing unit 320b selectively performs reverberation processing on the pre-processed stereo signals for the purpose of enhancing the spatial sense of the sound source. For a sound source requiring a spatial sense, the sound source can be given a spatial sense by selectively performing the reverberation processing on the sound source.

[0061] In the case where the reverberation processing of the 2-1st reverberation processing part 320b as described above is not required, the plurality of stereo signals output from the second pre-processing part 310b may be input to the second ear enhancement part 330b.

[0062] The second ear enhancement unit 330b adjusts the multiple stereo signals after reverberation processing to a preset listening volume value, and can adjust and output the preset listening volume value in order to allow the user to hear a sound source with a lower or higher volume.

[0063] The second sound source position information providing unit 340 b provides second sound source position information using a head related transfer function (HRTF), and since it is similar to the first sound source position information providing unit 340 a described above, a detailed description will be omitted.

[0064] The tracking information processing unit 350b provides head movement information, and the head movement information (for example, left and right movement and up and down movement, etc.) can be obtained through head movement tracking technology. The head movement tracking technology can use a head tracker that periodically measures the listener's head position and orientation to extract the head position and head orientation in order to calculate the relative positions of each when expressing the spatial sense of the sound source.

[0065] The head tracker described above can track and detect the listener's head movement using sensors such as gyroscopes, accelerometers, and magnetometers.

[0066] The second audio and video localization unit 360b performs second audio and video localization reflecting second sound source position information and head movement information on multiple stereo signals adjusted to a pre-set listening volume value. The second audio and video localization can be performed by linking the first sound source position information provided by the head-related transfer function (HRTF) and the head movement information (for example, left and right movement and up and down movement, etc.) tracked and obtained by the head tracker to determine the position of the audio and video.

[0067] The 2-2 reverberation processing unit 370b selectively performs reverberation processing on a plurality of stereo signals for performing the second sound image localization for the purpose of enhancing the spatial sense of the sound source. For a sound source that requires an additional spatial sense, the sound source can be given a spatial sense by selectively performing additional reverberation processing on the sound source.

[0068] In the case where the reverberation processing of the 2-2 reverberation processing unit 370 b as described above is not required, the plurality of stereo signals on which the second sound image localization is performed by the second sound image localization unit 360 b may be output to the sound source output unit 400 .

[0069] The second audio and video localization unit 360b as described above is as follows: Figure 5 As shown, it may include a second height pinna filter unit 361b, a second azimuth pinna filter unit 363b, and a second head shadow filter unit 365b.

[0070] Among them, the second height pinna filter unit 361b performs pinna effect processing according to the height position of the sound and image on multiple stereo signals, and can perform height processing of the sound and image and output it by applying a height pinna filter based on the pinna effect.

[0071] The second height pinna filter section 361b as described above may include a 2-1st height pinna filter 361b / 1 for inputting a left input signal L and a 2-2nd height pinna filter 361b / 2 for inputting a right input signal R, thereby respectively performing high and low processing of the audio and video on the left input signal and the right input signal in the stereo signal.

[0072] The second azimuth pinna filter unit 363b performs pinna effect processing according to the directional angular positions of the sound and image on the plurality of stereo signals, and can process the directional angular position of the sound and image by applying a directional pinna filter based on the pinna effect and output the processed sound and image.

[0073] The second azimuth pinna filter section 363b as described above may include a 2-1st azimuth pinna filter 363b / 1 for inputting a left input signal L and a 2-2nd azimuth pinna filter 363b / 2 for inputting a right input signal R, thereby respectively performing audio and video directional angle effects processing on the left input signal and the right input signal in the stereo signal.

[0074] The left input signal L in the stereo signal is processed by the 2-1st height pinna filter 361b / 1 and the 2-1st directional pinna filter 363b / 1 for the height and directional effect of the sound image and is input to the second head shadow filter section 365b, while the right input signal R in the stereo signal is processed by the 2-2nd height pinna filter 361b / 2 and the 2-2nd directional pinna filter 363b / 2 for the height and directional effect of the sound image and is input to the second head shadow filter section 365b. A delay circuit (Delay) may be provided to allow the left input signal L and the right input signal R to be input to the second head shadow filter section 365b at the same time point.

[0075] The second head shadow filter unit 365b processes the multiple stereo signals output from the second height pinna filter unit 361b and the second directional pinna filter unit 363b according to the effect of the human head shape. The head shadow filter is developed by applying the head shadow effect, measuring the distance difference based on the ear according to the direction of the sound and the influence of the human head shape and modeling the acquired impulse response (HRIR) curve. It can process the audio and video differences caused by the human head and process them into a state that can recognize the sound sources in the left and right directions and output them.

[0076] By applying the filter provided in the second sound and image localization unit 360 b as described above, it is possible to output and listen to realistic sounds with a sense of distance and direction even when wearing headphones or earphones.

[0077] In addition, in order to minimize the amount of calculation and memory usage and be used in portable terminals, the second audio and video localization unit 360b as described above reduces the order of each filter to first or second order and implements it with an wireless impulse response (IIR) filter, thereby performing audio and video localization processing on more than 8 multiple channels and multiple objects in real time according to position and distance values.

[0079] The sound source output unit 400 performs post-processing on the multiple stereo signals output by the multiple audio rendering unit 300 and outputs them. Figure 6 As shown, it may include a volume normalization unit 410 , a down-mixing unit 420 , an equalizer processing unit 430 and the like.

[0080] The volume normalization unit 410 adjusts the volume difference of the multiple stereo signals output by the multiple audio rendering unit 300 , and can adjust the volume of each sound source of the multiple stereo signals output by the multiple volume rendering unit 300 .

[0081] The downmixing unit 420 downmixes the plurality of stereo signals outputted by the volume normalization unit 410 according to the number of channels, and may downmix the plurality of stereo signals whose volumes of the respective sound sources are adjusted according to the number of channels of a final output device.

[0082] The equalizer processing unit 430 performs equalizer adjustment on the plurality of stereo signals outputted by the downmixing unit 420 and outputs the signals. The equalizer of the plurality of downmixed stereo signals may be adjusted according to the characteristics of the listener or the final output device and finally outputted.

[0084] also, Figure 7 The present invention is a schematic diagram illustrating a system of a real-sound audio output device for intercom communication applicable to an embodiment of the present invention. The present invention illustrates a system of a real-sound audio output device for intercom communication applicable to an embodiment of the present invention. When a radio signal, a microphone signal, and a message are input into an output sound source level equalization module, and the output sound source level is equalized and input into the real-sound audio output device for intercom communication according to an embodiment of the present invention, after performing phase positioning of the sound source based on sound source position information of external information and head movement information of a listener of an intercom communication system (ICS), an equalizer and audio balance (EQ and Audio Balance) processing are performed after performing audio mixing (Mix), and then the real-sound is output through a digital-to-analog converter (DAC).

[0086] Thus, in an embodiment of the present invention, the surrounding noise can be reduced by the noise reduction unit when multiple audio signals are input, and the multiple sound source judgment unit determines whether the multiple processed audio signals transmitted are stereo sound sources and outputs them as multiple stereo signals. Then, after the multiple stereo signals output are subjected to the first audio and video positioning that reflects the sound source position information or the second audio and video positioning that reflects the sound source position information and tracking information in the multiple audio rendering unit, they are post-processed and output in the sound source output unit, so that the spatial sense can be applied to each channel through dual audio and video positioning, thereby allowing real sound to be heard in a stereo listening environment.

[0088] In the above content, various embodiments of the present invention are described, but the present invention is not limited thereto. Personnel with general knowledge in the technical field to which the present invention belongs should understand that the present invention can be subjected to various substitutions, deformations and changes without departing from the scope of its technical ideas.

[0090]

Explanation of symbols

[0091] 100: Noise reduction department

[0092] 200: Multiple sound source determination unit

[0093] 300: Multiple audio rendering units

[0094] 300A: Audio channel separation rendering unit

[0095] 300B: Audio Panorama Rendering Department

[0096] 400: Sound source output unit

Claims

1. A real-sense audio output device for intercom communication, comprising: A noise reduction unit, which reduces surrounding noise when multiple audio signals are input; a multiple sound source determination unit, which determines whether the multiple processed audio signals transmitted through the noise reduction unit are stereo sound sources and outputs them as multiple stereo signals; A multiple audio rendering unit, including an audio channel separation rendering unit that performs a first audio and video localization reflecting the sound source position information or an audio panoramic rendering unit that performs a second audio and video localization reflecting the sound source position information and tracking information on the multiple stereo signals; as well as, The sound source output unit post-processes and outputs the plurality of stereo signals output by the multi-audio rendering unit.

2. The real-sense sound system for intercom communication according to claim 1 Audio output device, The audio channel separation and rendering unit comprises: A first preprocessing unit, configured to perform preprocessing to prevent sound source distortion of the plurality of stereo signals; A 1-1 reverberation processing unit selectively performs reverberation processing on the plurality of pre-processed stereo signals for the purpose of enhancing the spatial sense of the sound source; A first ear booster unit, adjusting the plurality of stereo signals after reverberation processing to a preset listening volume value; A first sound source position information providing unit, which provides first sound source position information using a head related transfer function (HRTF); A first sound and image localization unit performs the first sound and image localization reflecting the first sound source position information on the plurality of stereo signals adjusted to the preset listening volume values; and The 1-2 reverberation processing unit selectively performs reverberation processing on the plurality of stereo signals for performing the first sound image localization in order to achieve a sense of spatiality of a sound source.

3. The real-sound audio output device for intercom communication according to claim 2, The first audio and video positioning unit includes: an elevation pinna filter section for performing pinna effect processing on the plurality of stereo signals according to the height position of the sound and image; an azimuth pinna filter section for expressing positions of the plurality of stereo signals according to directional angles on a horizontal plane; and The head shadow filter unit performs effect processing according to the shape of the human head on the plurality of stereo signals output from the height pinna filter unit and the azimuth pinna filter unit.

4. The intercom communication device according to claim 1 Audio output device, The audio panorama rendering unit comprises: A second preprocessing unit performs preprocessing to prevent the plurality of stereo signals from suffering from sound source distortion; A 2-1 reverberation processing unit selectively performs reverberation processing on the plurality of pre-processed stereo signals for the purpose of enhancing the spatial sense of the sound source; a second ear boost unit, adjusting the plurality of stereo signals after reverberation processing to a preset listening volume value; a second sound source position information providing unit, which provides second sound source position information using the head related transfer function (HRTF); Tracking information processing unit, providing head movement information; A second sound and image localization unit performs the second sound and image localization reflecting the second sound source position information and the head movement information on the plurality of stereo signals adjusted to the preset listening volume values; and The 2-2 reverberation processing unit selectively performs reverberation processing on the plurality of stereo signals for performing the second sound image localization for the purpose of spatial perception of a sound source.

5. The real-sound audio output device for intercom communication according to claim 4, The second audio and video positioning unit includes: an elevation pinna filter section for performing pinna effect processing on the plurality of stereo signals according to the height position of the sound and image; an azimuth pinna filter section for expressing positions of the plurality of stereo signals according to directional angles on a horizontal plane; and The head shadow filter unit performs effect processing according to the shape of the human head on the plurality of stereo signals output from the height pinna filter unit and the azimuth pinna filter unit.

6. The real-sound audio output device for intercom communication according to claim 3 or claim 5, The sound source output unit comprises: a volume normalization unit, configured to adjust volume differences of the plurality of stereo signals output by the multiple audio rendering unit; a down-mixing unit that down-mixes the plurality of stereo signals output by the volume normalization unit according to the number of channels, and The equalizer processing unit performs equalizer adjustment on the plurality of stereo signals output by the downmixing unit and outputs the signals.

Images