Stereo output system for selectively controlling sound source

Abstract

Disclosed is a technical idea comprising: a sound source extraction unit that filters a video source from a predetermined terminal that applies a sound source of stereo type together with the video source, and selectively extracts only the sound source; a sound source processing unit which upmixes the sound source extracted by the sound source extraction unit through predetermined sound source processing, and processes the upmixed signal into a two-channel stereo signal through selective control; and a sound source transmitting unit for transmitting the two-channel stereo signal processed by the sound source processing unit to a left speaker and a right speaker of a predetermined terminal, respectively.

Description

Technical Field

[0001] The present invention relates to a stereo output system, and more particularly, to a system that separates a sound source from a video source and a sound source and performs multi-channel upmixing on the separated sound source, thereby filtering out mutual interference between left and right signals, and outputting stereo sound to a user's virtual position through selective control of the left and right signals. Background Art

[0002] According to a forecast by global market research company ReportLinker on May 11, 2023, the global audio equipment market size is expected to reach US$7.74 billion (approximately 10.2438 trillion won) this year. Considering that the market size was estimated at US$7.25 billion (approximately 9.6 trillion won) last year, it is estimated to have increased by approximately 6.76%.

[0003] According to relevant information, the speaker market, which includes home audio equipment such as subwoofers, wall-mounted speakers, and TV sound bars, will continue to grow.

[0004] In particular, the "home audio" market is estimated to show significant growth. According to analysis, as more people enjoy TV content on TV at home during the new coronavirus pandemic, more people are paying attention to audio equipment, etc., and the report link states that "users are becoming more aware of and demanding sound quality," which means "willing to spend more money on speakers."

[0005] The Digital Entertainment Group (DEG) of the United States also released a report that overall spending on "home entertainment" such as TVs and audio equipment has increased. Just as TV sales have increased significantly during the pandemic, the audio equipment market has also grown. The report link stated that "as the popularity of home entertainment audio equipment increases, manufacturers such as Samsung, LG, Sony, and Bosch have released products and platforms." (Refer to the Edaily report on May 16)

[0006] With the advancement of related products, that is, with the increase and improvement of hardware performance, the development and improvement of software based on the improvement and development of existing hardware or hardware, as well as the development and improvement of software technology for various stereos are also progressing rapidly.

[0007] Various technical ideas for processing and controlling sound signals have been applied for and disclosed as patents, and such representative examples are as follows.

[0008] There is an "audio head-related transfer function (HRTF) interpolation method and an audio output device using the same (Korean Patent No. 10-1899828, Patent Document 1)".

[0009] The invention according to Patent Document 1 relates to a head-related transfer function (HRTF) interpolation method applied to audio output and an audio output device using the same. The HRTF interpolation method of the invention of patent document 1 includes the following steps: a step of receiving HRTF data corresponding to a point where an elevation angle and an azimuth angle intersect, and receiving ILD data of a point where the HRTF data exists; a step of generating an HRTF interpolation signal corresponding to the elevation angle (Φ) of a sound localization point using HRTF data corresponding to two points constituting an elevation segment closest to a sound localization point (θ, Φ); a step of calculating an ILD variation from the azimuth angle (θ) of the sound localization point based on the ILD data of two points constituting an azimuth angle segment closest to the sound localization point (θ, Φ); and a step of generating a final HRTF interpolation signal corresponding to a sound localization point (θ, Φ) by applying the ILD variation to the HRTF interpolation signal corresponding to the elevation angle (Φ) of the sound localization point. According to the HRTF interpolation method of the inventive embodiment of Patent Document 1, the amount of calculation can be significantly reduced, and thus there is an advantage in that the interpolated HRTF value can be applied even in real-time audio output.

[0010] There is a "personalized HRTF generation method (Korean Grant No. 10-2274581, Patent Document 2)".

[0011] As for Patent Document 2, a personalized HRTF generation method is disclosed. As for Patent Document 2, the personalized HRTF generation method according to the embodiment of the invention includes the following steps: a step of training an artificial intelligence model by marking HRTF with training ear images and training body information; and a step of obtaining a personalized HRTF by inputting a user's ear image and the user's body information into the trained artificial intelligence model.

[0012] There is "Partial HRTF compensation or prediction for in-ear microphone array (Korean Publication No. 10-2022-0043171, Patent Document 3)".

[0013] In the case of Patent Document 3, in some embodiments, an ear-worn sound reproduction system is provided. The system includes a housing that can be installed in the auricle of the ear and covers the ear canal. In some embodiments of Patent Document 3, the housing that can be installed in the ear includes multiple microphones facing outward. In the case of Patent Document 3, the microphone facing outward can be located in the auricle of the ear, rather than outside the ear canal, so that the three-dimensional sound effect of a part of the auricle of the microphone is experienced instead of the whole. In the case of Patent Document 3, in some embodiments, in order to retain the three-dimensional positioning clues that exist in the eardrum in the absence of the housing so that the housing must be transparent to the user, multiple filters applied to the signals received by the multiple microphones facing outward are used to reproduce the sound through the driver element facing the inside of the housing. In the case of Patent Document 3, in some embodiments, a technology for deriving multiple filters is provided.

[0014] There is a "method and apparatus for generating and processing parameters representing HRTFs (Korean Patent No. 10-1333031, Patent Document 4)".

[0015] As for patent document 4, as a method for generating parameters representing head-related transform functions (HRTFs), the method includes the following steps: step a, using the sampling rate (fs) of the calculated first time discrete signal, sampling the first time domain HRTF impulse response signal with a sample length (n); step b, converting the first time discrete signal into a frequency domain to calculate a first frequency time domain signal; step c, separating the first frequency time domain signal into sub-bands; and step d, generating the first parameters of the sub-band based on statistical measurements of the sub-band values.

[0016] There is a "three-dimensional audio signal processing device and method using a personalized head-related transfer function, and a high-realism multimedia playback system using the same (Korean Patent No. 10-0954385, Patent Document 5)".

[0017] As for Patent Document 5, a three-dimensional audio signal processing device and method using a personalized head-related transformation function, and a high-realism multimedia playback system using the same, a three-dimensional audio signal is generated by using a head-related transformation function modeled to suit the user's personal body characteristics, providing each user with a maximum sense of presence and a three-dimensional audio signal with a sense of presence.

[0018] To this end, the invention of patent document 5 is a three-dimensional audio signal processing device using a head-related transformation function, which includes: an audio decoding unit that decodes audio data to restore the original audio signal; and a three-dimensional audio generation unit that generates a three-dimensional audio signal of the restored audio signal by using a head-related transformation function modeled to fit the user's personal body characteristics.

[0019] Patent Document 1: Korean Grant No. 10-1899828

[0020] Patent Document 2: Korean Grant No. 10-2274581

[0021] Patent Document 3: Korean Publication No. 10-2022-0043171

[0022] Patent Document 4: Korean Grant No. 10-1333031

[0023] Patent Document 5: Korean Grant No. 10-0954385 Summary of the invention

[0024] Technical issues to be solved

[0025] The stereo output system for selectively controlling sound sources according to the present invention is proposed to solve the above-mentioned problems, and the following problems are proposed to be solved.

[0026] First, it is possible to have a three-dimensional stereo effect of a two-channel stereo input signal.

[0027] Second, it can double the effect of the user's left and right sound perception.

[0028] Third, a separate technical idea is proposed to adjust the user's ghost image distance by adjusting the intermediate frequency.

[0029] The problems solved by the present invention are not limited to those mentioned above, and those skilled in the art can clearly understand other problems that are not mentioned from the following description.

[0030] Methods used to solve problems

[0031] In order to solve the above-mentioned problems, a stereo output system for selectively controlling a sound source according to the present invention has the following means for solving the problems.

[0032] As for the stereo output system for selectively controlling the sound source according to the present invention, it is characterized in that it includes: a sound source extraction unit, which filters out the video source from a predetermined terminal to which the sound source is applied together with the video source, and selectively extracts only the sound source; a sound source processing unit, which upmixes the sound source extracted by the sound source extraction unit through predetermined sound source processing, and processes the upmixed signal into a two-channel stereo signal through selective control; and a sound source sending unit, which sends the two-channel stereo signal processed by the sound source processing unit to the left speaker and the right speaker of the predetermined terminal respectively.

[0033] The stereo output system for selectively controlling a sound source according to the present invention is characterized in that the sound source may be a stereo type two-channel sound source.

[0034] The stereo output system for selectively controlling a sound source according to the present invention is characterized in that the sound source processing unit may include an upmixing section for making the sound source pass through a predetermined upmixing filter so as to be upmixed into a multi-channel multi-sound source.

[0035] As for the stereo output system for selectively controlling sound sources according to the present invention, it is characterized in that the multi-channel can set the multi-sound source to more than 5.1 channels, and the multi-sound source is virtually configured with a preset position of a user in front of a predetermined terminal as a reference, and the 5.1 channels are respectively allocated to the center front channel (front center channel), the right front channel (front right channel), the left front channel (front left channel), the right rear channel (rear right channel), the left rear channel (rear left channel) and the woofer channel (woofer channel).

[0036] As for the stereo output system for selectively controlling sound sources according to the present invention, it is characterized in that the sound source processing unit may also include a cross noise elimination unit, which uses the multiple sound sources as a reference based on a preset position of a user virtually configured in front of a predetermined terminal, i) removes the left front channel component remaining in the right front channel, and removes the right front channel component remaining in the left front channel, ii) removes the left rear channel component remaining in the right rear channel, and removes the right rear channel component remaining in the left rear channel.

[0037] As for the stereo output system for selectively controlling sound sources according to the present invention, it is characterized in that the sound source processing unit may also include a sound pressure setting unit, which takes the multiple sound sources as a reference based on a user-preset position virtually configured in front of a predetermined terminal, and selectively adjusts the sound pressure of the left front channel and the left rear channel relative to the right front channel and the right rear channel in order to locate the virtual position of the ghost image of the object on the predetermined terminal through audio and video.

[0038] As for the stereo output system for selectively controlling sound sources according to the present invention, it is characterized in that the sound source processing unit may also include a time difference setting unit, which takes the multiple sound sources as a reference based on a user-preset position virtually configured in front of a predetermined terminal, and selectively adjusts the predetermined sound time difference between the left front channel and the left rear channel relative to the right front channel and the right rear channel in order to locate the virtual position of the ghost image of the object on the predetermined terminal for audio and video.

[0039] As for the stereo output system for selectively controlling sound sources according to the present invention, it is characterized in that the sound source processing unit may also include a sense of distance setting unit, which takes the multiple sound sources as a reference and selectively adjusts the change in the sound volume of the left front channel and the left rear channel relative to time relative to the right front channel and the right rear channel based on a user-preset position virtually configured in front of a predetermined terminal.

[0040] As for the stereo output system for selectively controlling sound sources according to the present invention, it is characterized in that the sound source processing unit may also include a reverberation setting unit, which uses the multiple sound sources as a reference and repeatedly modulates the reverberation signals of the left front channel and the left rear channel according to a reverberation time difference setting value relative to the right front channel and the right rear channel based on a user-preset position virtually configured in front of a predetermined terminal.

[0041] As for the stereo output system for selectively controlling the sound source according to the present invention, it is characterized in that the sound source sending unit can assign the right front channel and the right rear channel to the right speaker part of the predetermined terminal and send them, assign the left front channel and the left rear channel to the left speaker part and send them, and selectively assign the front channel and the bass channel to the left speaker part and the right speaker part and send them.

[0042] Effects of the Invention

[0043] The stereo output system for selectively controlling a sound source according to the present invention structured as described above provides the following effects.

[0044] First, by eliminating the mutual signal interference between the left and right of the input sound source, mixing the two channels into multi-channels and processing the sound source, even stereo types can produce the same stereo effect as multi-channels.

[0045] Second, after eliminating the mutual interference signals that may occur in the left and right speakers from the source, the sound sources of the left and right speakers are reprocessed to double the effect of the left and right sound perception.

[0046] Third, the sound sources of the left and right speakers are reprocessed to adjust the user's ghost image distance by adjusting the intermediate frequency of the ghost image.

[0047] The effects of the present invention are not limited to those mentioned above, and those skilled in the art can clearly understand other effects not mentioned from the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 FIG. 1 is a conceptual diagram of a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0049] Figure 2 This is a block diagram showing a main structure of a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0050] Figure 3 This is a block diagram showing a sound source processing unit and its lower-level structure in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0051] Figure 4 FIG. 1 is a conceptual diagram of an upmixing unit of a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0052] Figure 5 This is a conceptual diagram for explaining the processing of a ghost image and its concept in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0053] Figure 6 It is a conceptual diagram of a cross noise canceller in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0054] Figure 7 It is a conceptual diagram of a sound pressure setting unit for left and right speakers in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0055] Figure 8 It is a conceptual diagram of a time difference setting unit for left and right speakers in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0056] Fig. 9It is a conceptual diagram of a distance sense setting unit in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0057] Fig.10 This is a conceptual diagram of a reverberation setting unit in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention.

[0058] Fig.11 The present invention is a conceptual diagram showing that, in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention, a sound wave arrival time difference information file between two ears is represented as a bit array and then grouped into a single group configuration.

[0059] Fig.12 The present invention is a conceptual diagram showing that in a stereo output system for selectively controlling sound sources according to an embodiment of the present invention, group processing is performed as a configuration reordered by a preset reordering function. DETAILED DESCRIPTION

[0060] The stereo output system for selectively controlling sound sources according to the present invention can be modified in various ways and can have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to a specific implementation form, but should be understood to include all changes, equivalents and substitutes within the technical concept and technical scope of the present invention.

[0061] Figure 1 FIG. 1 is a conceptual diagram of a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 2 This is a block diagram showing a main structure of a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 3 This is a block diagram showing a sound source processing unit and its lower-level structure in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 4 FIG. 1 is a conceptual diagram of an upmixing unit of a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 5 This is a conceptual diagram for explaining the processing of a ghost image and its concept in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 6 It is a conceptual diagram of a cross noise canceller in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 7 It is a conceptual diagram of a sound pressure setting unit for left and right speakers in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Figure 8 It is a conceptual diagram of a time difference setting unit for left and right speakers in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Fig. 9It is a conceptual diagram of a distance sense setting unit in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Fig.10 This is a conceptual diagram of a reverberation setting unit in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention. Fig.11 The present invention is a conceptual diagram showing that, in a stereo output system for selectively controlling a sound source according to an embodiment of the present invention, a sound wave arrival time difference information file between two ears is represented as a bit array and then grouped into a single group configuration. Fig.12 The present invention is a conceptual diagram showing that in a stereo output system for selectively controlling sound sources according to an embodiment of the present invention, group processing is performed as a configuration reordered by a preset reordering function.

[0062] As for the stereo output system for selectively controlling the sound source according to the present invention, Figure 1 As shown, it corresponds to the technical idea of ​​generating three-dimensional stereo sound by using the speaker of the display unit by processing the sound source to a certain extent among the video source and sound source applied to the display unit.

[0063] exist Figure 1 In the case of the system according to the present invention, it may be a program embedded in an external terminal used by plugging into the HDMI terminal of the display unit, or it may be in the form of a program that can be installed in the display unit itself and updated when the display unit is manufactured in accordance with the requirements of the display unit manufacturer. In the case of electronic means, the program can be activated by simply installing it in the HDMI of the display unit, so that the stereo processing can be turned on or off.

[0064] First of all, with regard to the stereo output system for selectively controlling the sound source according to the present invention, its purpose is to produce three-dimensional stereo sound by applying the sound source to the two channels of the stereo type. At the same time, the physical speakers (collectively referred to as 11 and 12) of the display unit are provided with two speakers (for example, the left speaker 11 and the right speaker 12) to produce a three-dimensional stereo effect.

[0065] For this reason, Figure 1 and Figure 2 As shown, the stereo output system for selectively controlling a sound source according to the present invention may include a sound source extracting unit 100 , a sound source processing unit 200 and a sound source sending unit 300 .

[0066] First, the sound source extraction unit 100 filters out the video source from a predetermined terminal (eg, a display unit) to which the sound source is applied together with the video source, and selectively extracts only the sound source.

[0067] In the case where only a sound source is separately extracted from a video source / audio source, it corresponds to a typical technical structure, so a separate explanation will be omitted.

[0068] like Figure 1 and Figure 2 As shown, the sound source processing unit 200 has the following structure: by performing predetermined sound source processing on the sound source independently extracted by the sound source extraction unit 100, upmixing the sound source is performed, and the upmixed signal is processed into a two-channel stereo signal through selective control.

[0069] Here, the detailed technical features of the predetermined sound source processing correspond to Figures 3 to 9 The functions shown will be explained together with the description of the detailed structure.

[0070] After the sound source processing unit 200 upmixes the two-channel stereo type sound source, it separates and extracts the channels into multiple channels such as 5.1 channels, and then selectively controls each channel and downmixes it to two channels again, thereby producing a stereo effect through the two physical speakers 11 and 12 of the display unit.

[0071] like Figure 1 As described above, the sound source sending unit 300 is a technical structure that sends the sound source that is re-downmixed after being upmixed and subjected to predetermined sound source processing by the sound source processing unit 200 to the two physical speakers 11 and 12 .

[0072] like Figure 4 As shown, the sound source processing unit 200 may include an upmixing unit 210 .

[0073] The upmix unit 210 passes a sound source through a predetermined upmix filter to upmix the sound source into a multi-channel multi-sound source.

[0074] The upmixing unit 210 has the following structure: the multiple sound sources here are set to more than 5.1 channels, and the multiple sound sources are virtually configured based on the preset position of the user in front of the predetermined terminal, and the 5.1 channels are respectively allocated to the center front channel (front center channel), the right front channel (front right channel), the left front channel (front left channel), the right rear channel (rear right channel), the left rear channel (rear left channel) and the bass channel (woofer channel).

[0075] like Figure 1 As shown, the preset position can be set as a virtual position, temporarily set to a user being located in front of the display unit.

[0076] Assuming that the user at a preset position is the center, the center of the display configured in the front actually includes a front center speaker, a front right speaker, a front left speaker, a rear right speaker, a rear left speaker, and a woofer channel speaker, and the 5.1 multi-channels allocated to each of them are upmixed by performing channel separation on the front center channel, the front right channel, the front left channel, the rear right channel, the rear left channel, and the woofer channel.

[0077] Thereafter, the multi-channel signals obtained by upmixing the two-channel stereo sound source by the upmixing unit 210 may be subjected to various subsequent processing processes after going through the control process according to the cross noise canceling unit 201 .

[0078] As described above, the sound source processing unit 201 may further include a cross noise canceling unit 201 .

[0079] The cross noise elimination unit 201 has the following structure: Figure 6 As shown, mutual interference / noise of sound sources input from the left ear and the right ear in a virtual preset position of the user, such as a space of several meters in front of the center of the display unit, is filtered out.

[0080] First, for each of the front center channel (front center channel), front right channel (front right channel), front left channel (front left channel), rear right channel (rear right channel), rear left channel (rear left channel) and woofer channel, which are each divided into 5.1 multi-channels, a left channel filter and a right channel filter are respectively provided, so that these signals separated into 5.1 channels pass through the left channel filter and the right channel filter, thereby removing the components of the left channel of interference or noise that may remain in the right front channel and the right rear channel, and conversely, removing the components of the right channel of interference or noise that may remain in the left front channel and the left rear channel.

[0081] like Figure 5 and Figure 7 As shown, the sound source processing unit 200 may further include a sound pressure setting unit 220 .

[0082] The sound pressure setting unit 220 is configured to identify the user's preset position by the pressure difference between the left ear and the right ear. Figure 5 According to the standard of the sense of position / spatial sense of the ghost images #1-#4 in the video, the sound pressure of the left ear and the right ear are set differently for each channel according to the position setting of the ghost images of the assumed object on the screen.

[0083] like Figure 7 As shown, with respect to the sound pressure setting unit 220, multiple sound sources are virtually configured with a preset position of a user in front of a predetermined terminal (e.g., a display unit) as a reference, and in order to locate the virtual position of a ghost image of an object on the display unit for audio and video, the sound pressures of the left front channel and the left rear channel are selectively adjusted relative to the right front channel and the right rear channel.

[0084] At once Figure 5 In the case of the ghost image #1, due to Figure 7 There is a difference in sound pressure between the left ear and the right ear in the sound recording, so the user can be provided with a sense of space of the left and right positions of the ghost image #1. For the channels leading to the left speaker (for example, FL and RL), the sound pressure (that is, the amplitude of the sound source) is larger at the same time, and according to the degree to which the ghost image #1 tends to lean to the left, the sound pressure (that is, the amplitude of the sound source) of FR and RR leading to the right channel is relatively smaller than that of the channel leading to the left speaker at the same time, so that the user can be provided with the degree to which the image of the object on the screen tends to lean to the left by adjusting the difference in sound pressure of the left and right sound sources.

[0085] On the contrary, if Figure 5 In the ghost image #4 in FIG. 4 , in order to provide the user with a sense of space that is inclined to the right, the sound pressure (i.e., the amplitude of the sound source) is smaller for the channels (e.g., FL and RL) leading to the left speaker at the same time, and according to the degree of the rightward inclination of the ghost image #4, the sound pressure (i.e., the amplitude of the sound source) of FR and RR leading to the right channel is relatively larger than that of the channel leading to the left speaker at the same time. However, setting the left and right sense of space by such a sound pressure difference is advantageous in the high-frequency region where the wavelength of the sound wave is smaller than the size of the user's virtual head circumference.

[0086] like Figure 5 and Figure 8 As shown, the sound source processing unit 200 may further include a time difference setting unit 230 .

[0087] The time difference setting unit 230 can also set the left and right spatial sense of the ghost images (#1-#4) and deliver the spatial sense according to the time difference of the sound source delivered to the left ear and the right ear.

[0088] The time difference setting unit 230 has the following structure: Figure 8 As shown, multiple sound sources are virtually configured with the preset position of the user in front of the predetermined terminal as a reference. In order to locate the virtual position of the ghost image of the object on the predetermined terminal by audio and video, the predetermined sound time difference of the left front channel and the left rear channel is selectively adjusted relative to the right front channel and the right rear channel. In the case of providing a sense of space to the left ear and the right ear by setting the time difference, there is an advantage that it can also be performed in the low-frequency region where the wavelength of the sound wave is greater than the diameter of the user's virtual head, but there is also the problem of mixing and interference with other sounds according to the time difference (that is, the degree of time delay of the sound signal). Therefore, it can be adjusted to set and transmit the sense of position and sense of space of the ghost images #1-#4 through the selective application of the sound pressure setting unit 220 and the time difference setting unit 230.

[0089] According to the given head diameter information of the user, the propagation speed of the sound wave and the difference between the propagation speed of the sound wave and the delay time corresponding to the head diameter length of the user are calculated, and used as a given value for setting the time difference of the time difference setting unit 230. The head diameter of the user can be set differently according to age, gender or race, and a statistical standard value can be applied, but here, it is set as a variable (function) of the head diameter, and according to the constant value of the variable of the input head diameter (that is, the head diameter information of the actual user), different time differences and the like can be calculated.

[0090] As for the head diameter, the time difference information calculated based on the head diameter may have a time difference even if the head diameter is the same. In the case of sound transmitted across two ears (i.e., right ear and left ear), according to the stereoscopic sense of the user's face (front face) formed with the two ears as the center, the sound wave transmission between the two ears may have a time difference, which is calculated based on the statistical information of the three-dimensional shape of the user's face. The facial information of the user's face can be realized by the user face recognition unit (not shown), which can be achieved by linking the system according to the present invention with an application such as a smartphone with a three-dimensional recognition function of user face recognition and importing this function.

[0091] In the case of an information file about the time difference of sound waves between the two ears according to the user's facial recognition unit and the user's facial three-dimensional recognition, it can be divided into a plurality of sub-files, and the files divided into sub-files are given the same media code and then stored in a plurality of physically divided databases (DB) respectively to prevent arbitrary hacker attacks by a third party. In the event of an arbitrary hacker attack by a third party, if there is no information about the media code with the sub-file as the medium, it cannot be re-merged, so it is difficult to carry out arbitrary hacker attacks.

[0092] like Fig.11 As shown, the facial recognition unit lists the information file about the time difference of the sound waves between the two ears as a bit array of 1 and 0, and then redefines the bit array of 1 and 0 as follows by setting a preset configuration. Fig.11 (b) shows the new bundle units (i.e., sets and arrays of sets of configurations).

[0093] like Fig.11 As shown, the preset configuration defines 1 and 0 bits as 5, but this can be changed at will.

[0094] like Fig.12 As shown, for the facial recognition unit, Fig.11 The configuration is sequentially input to sort #0001, sort #0002, ..., sort #000N. When sort #0001, sort #0002, ..., sort #000N are input to a predetermined reordering function, the order of rearrangement #0001, rearrangement #0002, ..., rearrangement #000N is rearranged according to the predetermined rearrangement function of the predetermined reordering function, which has a rule of changing the information file about the time difference of the sound waves between the two ears as the information of the initial bit array according to the purpose. Thus, even if external access or a hacker attack by a third party occurs, the information file about the time difference of the sound waves between the two ears can be prevented from being known from the outside.

[0095] like Figure 5 and Fig. 9 As shown, the sound source processing unit 200 may further include a distance setting unit 240 .

[0096] As for the distance sense setting part 240, it provides the effect of being far away from or close to the preset position of the user, and provides the left or right placement sense at the same time.

[0097] The sense of distance setting unit 240 is structured as follows: based on a preset position of a user virtually configured in front of a predetermined terminal such as a display unit, multiple sound sources are selectively adjusted relative to time changes in the sound volume of the left front channel and the left rear channel relative to the right front channel and the right rear channel.

[0098] exist Figure 5 In the example, the ghost image #3 configured far from the user to the ghost image #4 relatively close to the user can be set to a state close to the user from left to right. Fig. 9 In the embodiment, as time goes by, the left channel going to the left speaker and the right channel going to the right speaker both control the sound source toward the upper right, that is, in the direction in which the amplitude of the sound pressure size increases, and at the same time, the channel size (that is, the slope) to the left speaker and the channel size to the right speaker are set differently, that is, the slope of the signal of the channel to the right speaker is set to be larger, thereby providing a ghost image that moves from left to right and a sense of space close to the user.

[0099] like Figure 5 and Fig.10 As shown, the processing unit 200 may further include a reverberation setting section 250 .

[0100] The reverberation setting unit 250 is structured as follows: the multiple sound sources are virtually configured with a preset position of a user in front of a predetermined terminal (e.g., a display unit) as a reference, and the reverberation signals of the left front channel and the left rear channel are repeatedly modulated according to the reverberation time difference setting value relative to the right front channel and the right rear channel.

[0101] Another important factor in the sense of distance is the reverberation effect. In terms of reverberation, it corresponds to the sound effect that remains and is heard even after the sound sounds in the room and stops. As the distance from the ghost image of the sound source to the user increases, the amplitude (i.e., the amplitude size) decreases, and the degree of decrease is equivalent to the degree inversely proportional to the square of the distance. Conversely, the amplitude of the reverberation increases even if the distance increases, because the reverberation does not come from the sound source, but from things adjacent to the user's position, the ratio of the amplitude of the direct sound to the reverberation plays a greater role in nearby objects than in distant objects. Therefore, the reverberation of distant objects is relatively greater than the reverberation effect of nearby objects.

[0102] like Figure 2 As shown, the sound source sending unit 300 allocates the right front channel and the right rear channel to the right speaker part of a predetermined terminal (e.g., a display unit) and sends them, allocates the left front channel and the left rear channel to the left speaker part and sends them, and selectively allocates the front channel and the bass channel to the left speaker part and the right speaker part and sends them.

[0103] The scope of the claims of the present invention is determined by the matters recorded in the claims. The brackets used in the claims are used to clarify the constituent elements, rather than to record selective limitations. The records in the brackets should also be interpreted as essential constituent elements.

Claims

1. A stereo output system for selectively controlling a sound source, characterized in that: include: The sound source extraction unit filters out the video source from a predetermined terminal to which the sound source is applied together with the video source, and selectively extracts only the sound source, a sound source processing unit, which performs upmixing of the sound source extracted by the sound source extraction unit through predetermined sound source processing, and processes the upmixed signal into a two-channel stereo signal through selective control, and The sound source sending unit sends the two-channel stereo signal processed by the sound source processing unit to the left speaker and the right speaker of the predetermined terminal respectively.

2. The stereo output system for selectively controlling sound sources according to claim 1, characterized in that: The sound source is a stereo type two-channel sound source.

3. The stereo output system for selectively controlling sound sources according to claim 2, characterized in that: The sound source processing unit comprises: The upmixing unit allows the sound source to pass through a predetermined upmixing filter, thereby upmixing the sound source into a multi-channel multi-sound source.

4. The stereo output system for selectively controlling sound sources according to claim 3, characterized in that: The multi-channel sets the multi-sound source to more than 5.1 channels, The multiple sound sources are virtually configured with a preset position of a user in front of a predetermined terminal as a reference, and the 5.1 channels are respectively allocated to a center front channel, a right front channel, a left front channel, a right rear channel, a left rear channel and a bass channel.

5. The stereo output system for selectively controlling sound sources according to claim 4, characterized in that: The sound source processing unit further includes a cross noise elimination unit, The cross noise elimination unit removes the left front channel component remaining in the right front channel, removes the right front channel component remaining in the left front channel, removes the left rear channel component remaining in the right rear channel, and removes the right rear channel component remaining in the left rear channel based on the preset position of the user virtually configured in front of a predetermined terminal.

6. The stereo output system for selectively controlling sound sources according to claim 5, characterized in that: The sound source processing unit further includes a sound pressure setting unit, The sound pressure setting unit takes the multiple sound sources as a reference and selectively adjusts the sound pressures of the left front channel and the left rear channel relative to the right front channel and the right rear channel in order to locate the virtual position of a ghost image of an object on the predetermined terminal through audio and video.

7. The stereo output system for selectively controlling sound sources according to claim 5, characterized in that: The sound source processing unit also includes a time difference setting unit, The time difference setting unit takes the multiple sound sources as a reference based on a preset position of a user who is virtually configured in front of a predetermined terminal, and selectively adjusts the predetermined sound time difference between the left front channel and the left rear channel relative to the right front channel and the right rear channel in order to audiovisually locate the virtual position of a ghost image of an object on the predetermined terminal.

8. The stereo output system for selectively controlling sound sources according to claim 5, characterized in that: The sound source processing unit also includes a distance sense setting unit, The sense of distance setting unit uses the preset position of the user virtually configured in front of a predetermined terminal as a reference, and selectively adjusts the change in the sound volume of the left front channel and the left rear channel relative to time relative to the right front channel and the right rear channel.

9. The stereo output system for selectively controlling sound sources according to claim 8, characterized in that: The sound source processing unit also includes a reverberation setting unit. The reverberation setting unit uses the multiple sound sources as a reference, and repeatedly modulates the reverberation signals of the left front channel and the left rear channel according to the reverberation time difference setting value relative to the right front channel and the right rear channel.

10. The stereo output system for selectively controlling a sound source according to any one of claims 6 to 9, characterized in that: The sound source sending unit allocates the right front channel and the right rear channel to the right speaker part of the predetermined terminal and sends them, allocates the left front channel and the left rear channel to the left speaker part and sends them, and selectively allocates the front channel and the bass channel to the left speaker part and the right speaker part and sends them.

Images