System for outputting stereophonic sound through selective control of sound source
The three-dimensional sound output system addresses the limitations of conventional systems by separating sound sources, upmixing, and selectively controlling signals to reduce interference and enhance the stereo effect, achieving improved immersive audio with precise control over the ghost image's distance.
Patent Information
- Application Number
- PCT/KR2023/021077
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-01
- Filing Date
- 2023-12-20
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional three-dimensional sound output systems face challenges in producing effective stereo sound with reduced mutual interference between left and right signals, and in adjusting the midrange to control the distance of the ghost image, limiting the immersive audio experience.
A three-dimensional sound output system with a sound source extraction unit that separates sound sources from video sources, a sound source processing unit that upmixes and selectively controls the sound signals to create a multi-channel stereoscopic sound effect, and a sound source transmission unit that allocates these signals to left and right speakers, including components like upmix, cross noise canceling, sound pressure, time difference, distance, and reverberation settings.
The system effectively reduces mutual interference between left and right signals, enhances the stereo effect by doubling the pitch impact, and allows for precise control of the ghost image's distance, providing an immersive three-dimensional audio experience.
Smart Images

Figure KR2023021077_05122024_PF_FP_ABST
Abstract
Description
Surround sound output system with selective control of sound sources
[0001] The present invention relates to a stereoscopic sound output system, and more particularly, to a technical field of a system that filters out mutual interference according to left and right signals through separation of sound sources from video sources and sound sources and multi-channel upmixing of the separated sound sources, and outputs stereoscopic sound through selective control of left and right signals to a user's virtual location.
[0002]
[0003] According to global market research firm ReportLinker, the global audio equipment market is projected to reach $7.74 billion (approximately KRW 10.2438 trillion) this year. Considering last year's market size, which was estimated at $7.25 billion (approximately KRW 9.6 trillion), this represents approximately 6.76% growth.
[0004] According to related data, the speaker market, including home audio devices such as subwoofers and wall-mounted speakers, as well as TV soundbars, is expected to continue its growth.
[0005] The "home audio" market, in particular, is evaluated to have shown remarkable growth. As the number of people enjoying content at home via TV increased during the COVID-19 pandemic, the number of people paying attention to audio equipment also increased. ReportLinker explained, "Users are increasingly aware of and demanding sound quality," and "are willing to spend more on speakers."
[0006] The US-based Digital Entertainment Group (DEG) also released a report showing an increase in overall spending on "home entertainment," including TVs and audio equipment. This suggests that, just as TV sales have surged during the pandemic, the audio equipment market has also grown. ReportLinker stated, "With the growing popularity of home entertainment audio equipment, manufacturers like Samsung, LG, Sony, and Bose are releasing products and platforms." (See the May 16th article in Edaily.)
[0007] As related products become more sophisticated, that is, hardware performance increases and improves, software development and improvement are also rapidly progressing in line with existing hardware or hardware improvements and developments, and software technology development and improvement for various stereophonic sounds are also rapidly progressing.
[0008] Various technical ideas for processing and controlling acoustic signals have been patented and disclosed, and representative examples of these are as follows:
[0009] There exists an "audio head-related transfer function (HRTF) interpolation method and an audio output device using the same (registration number 10-1899828, patent document 1)".
[0010] In the case of the invention according to patent document 1, it relates to a head-related transfer function (HRTF) interpolation method used for audio output and an audio output device using the same. The HRTF interpolation method of the invention of Patent Document 1 includes the steps of receiving HRTF data corresponding to a point where an elevation angle and an azimuth angle intersect, receiving ILD data for a point where the HRTF data exists, generating an HRTF interpolation signal corresponding to the elevation angle (Φ) of the sound localization point using HRTF data corresponding to two points constituting the elevation angle segment closest to the sound localization point (θ, Φ), calculating an ILD change amount from the ILD data of two points constituting the azimuth angle segment closest to the sound localization point (θ, Φ) to the azimuth angle (θ) of the sound localization point, and applying the ILD change amount to the HRTF interpolation signal corresponding to the elevation angle (Φ) of the sound localization point, thereby generating a final HRTF interpolation signal corresponding to the sound localization point (θ, Φ). According to an embodiment of the invention of Patent Document 1, the HRTF interpolation method enables a significant reduction in the amount of calculation, and thus has the advantage of being able to utilize interpolated HRTF values even when outputting real-time audio.
[0011] There exists a “personalized HRTF generation method (registration number 10-2274581, patent document 2).”
[0012] Patent Document 2 discloses a method for generating a personalized HRTF. According to an embodiment of the invention, the method for generating a personalized HRTF includes a step of training an artificial intelligence model by labeling an HRTF on training ear images and training body information, and a step of inputting the user's ear images and body information into the trained artificial intelligence model to obtain a personalized HRTF.
[0013] "Partial HRTF compensation or prediction for ear-type microphone arrays (Publication No. 10-2022-0043171, Patent Document 3)" exists.
[0014] In some embodiments of Patent Document 3, an ear-mounted sound reproduction system is provided. The system comprises an ear-mountable housing that rests within the auricle of an ear and obscures the ear canal. In some embodiments of Patent Document 3, the ear-mountable housing comprises a plurality of outward-facing microphones. In some embodiments of Patent Document 3, the outward-facing microphones may be positioned within the auricle of the ear rather than outside the ear canal, so that the microphones will experience some, but not all, of the three-dimensional sound effects of the auricle. In some embodiments of Patent Document 3, to preserve three-dimensional localization cues that would otherwise be present at the eardrum, while the housing is essentially transparent to the user, sound is reproduced by an actuator element facing inwardly within the housing using a plurality of filters applied to signals received by the plurality of outward-facing microphones. In some embodiments of Patent Document 3, techniques for inducing the plurality of filters are provided.
[0015] There exists a "method and device for generating and processing parameters representing HRTFs (Registration No. 10-1333031, Patent Document 4)".
[0016] In the case of Patent Document 4, a method for generating parameters representing HRTFs (Head-Related Transfer Functions) includes the steps of (a) sampling a first time-domain HRTF impulse response signal with a sample length (n) using a sampling rate (fs) that produces a first time-discrete signal, (b) converting the first time-discrete signal into a frequency domain that produces a first frequency-domain signal, (c) separating the first frequency-domain signals into sub-bands, and (d) generating first parameters of the sub-bands based on statistical measurements of the values of the sub-bands.
[0017] "A 3D audio signal processing device and method using a personalized head-related transfer function, and a high-realism multimedia playback system using the same (Registration No. 10-0954385, Patent Document 5)" exists.
[0018] Patent Document 5 relates to a 3D audio signal processing device and method using a personalized head-related transfer function, and a high-presence multimedia playback system using the same, which generates a 3D audio signal using a head-related transfer function modeled to fit the physical characteristics of each user, thereby providing a 3D audio signal with the greatest sense of presence and reality to each user.
[0019] To this end, the invention of Patent Document 5 includes a 3D audio signal processing device using a head-related transfer function, an audio decoding means for decoding audio data to restore an original audio signal; and a 3D audio generating means for generating a 3D audio signal for the restored audio signal using a head-related transfer function modeled to fit the user's body characteristics.
[0020] (Patent Document 1) Registration No. 10-1899828
[0021] (Patent Document 2) Registration No. 10-2274581
[0022] (Patent Document 3) Publication No. 10-2022-0043171
[0023] (Patent Document 4) Registration No. 10-1333031
[0024] (Patent Document 5) Registration No. 10-0954385
[0025]
[0026] The stereophonic sound output system through selective control of a sound source according to the present invention has been devised to solve the above-mentioned conventional problems, and presents the following problems to be solved.
[0027] First, it enables the three-dimensional surround sound effect of a two-channel stereo input signal.
[0028] Second, it allows the effect on the user's left and right pitch to be doubled.
[0029] Third, we would like to propose a separate technical idea that can adjust the mid to control the distance of the user's ghost image.
[0030] The problems to be solved by the present invention are not limited to those mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.
[0031]
[0032] The stereophonic sound output system through selective control of a sound source according to the present invention has the following problem-solving means to solve the above-mentioned problem.
[0033] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, it may be characterized by including a sound source extraction unit that filters out a video source from a predetermined terminal to which a sound source is applied together with a video source and selectively extracts only the sound source; a sound source processing unit that performs upmixing of the sound source extracted by the sound source extraction unit through predetermined sound source processing and processes the upmixed signal into a 2-channel stereoscopic sound signal through selective control; and a sound source transmission unit that separately transmits the 2-channel stereoscopic sound signal processed by the sound source processing unit to the left speaker and the right speaker of the predetermined terminal, respectively.
[0034] In the case of a stereophonic sound output system through selective control of a sound source according to the present invention, the sound source may be characterized as being a two-channel sound source of a stereo type.
[0035] In the case of a stereophonic sound output system through selective control of a sound source according to the present invention, the sound source processing unit may be characterized by including an upmix unit that upmixes the sound source into a multi-channel multi-sound source by passing it through a predetermined upmix filter.
[0036] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the multi-channel may be characterized in that the multi-sound source is set to 5.1 channels or more, and the 5.1 channels are allocated to a front center channel, a front right channel, a front left channel, a rear right channel, a rear left channel, and a woofer channel, respectively, based on a preset position of a user virtually positioned in front of a predetermined terminal.
[0037] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the sound source processing unit may further include a cross noise canceling unit that, based on a preset position of a user virtually positioned in front of a predetermined terminal, i) removes a front left channel component remaining in a front right channel and removes a front right channel component remaining in a front left channel, and ii) removes a rear left channel component remaining in a rear right channel and removes a rear right channel component remaining in a rear left channel.
[0038] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the sound source processing unit may further include a sound pressure setting unit that selectively adjusts the sound pressure of the front left channel and the rear left channel relative to the front right channel and the rear right channel in order to localize a virtual position of a ghost image of an object on the predetermined terminal based on a preset position of a user virtually positioned in front of the predetermined terminal, using the multi-sound source as a reference.
[0039] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the sound source processing unit may further include a time difference setting unit that selectively adjusts a predetermined sound time difference of the front left channel and the rear left channel compared to the front right channel and the rear right channel in order to localize a virtual position of a ghost image of an object on the predetermined terminal based on a preset position of a user virtually positioned in front of the predetermined terminal, using the multi-sound source as a reference.
[0040] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the sound source processing unit may further include a distance setting unit that selectively adjusts the variability of the sound size of the front left channel and the rear left channel versus time in comparison with the front right channel and the rear right channel based on a preset position of a user virtually positioned in front of a predetermined terminal with respect to the multi-sound source.
[0041] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the sound source processing unit may further include a reverberation setting unit that repeatedly adds reverberation signals of the front left channel and the rear left channel to the front right channel and the rear right channel according to a reverberation time difference setting value based on a preset position of a user virtually positioned in front of a predetermined terminal of the multi-sound source.
[0042] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the sound source transmission unit may be characterized in that the front right channel and the rear right channel are allocated to the right speaker unit of the predetermined terminal, the front left channel and the rear left channel are allocated to the left speaker unit, and the front channel and the woofer channel are selectively allocated and transmitted to the left speaker unit and the right speaker unit.
[0043]
[0044] The stereophonic sound output system through selective control of the sound source according to the present invention having the above configuration provides the following effects.
[0045] First, by eliminating left and right mutual signal interference for the input sound source, it is possible to upmix 2 channels into multi-channels and process the sound source to produce a three-dimensional sound effect similar to multi-channels even in stereo type.
[0046] Second, by eliminating any mutual interference signals that may occur from the left and right speakers, the sound source for the left and right speakers is reprocessed to double the effect on the left and right sound quality.
[0047] Third, the sound source for the left and right speakers is reprocessed so that the user can adjust the distance of the ghost image through mid-adjustment of the ghost image.
[0048] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.
[0049]
[0050] FIG. 1 is a conceptual diagram of a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0051] FIG. 2 is a block diagram illustrating the main configuration of a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0052] FIG. 3 is a block diagram illustrating a sound source processing unit and its sub-components among a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0053] FIG. 4 is a conceptual diagram of an upmix section of a stereophonic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0054] FIG. 5 is a conceptual diagram for explaining the processing of ghost images and the concept thereof in a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0055] FIG. 6 is a conceptual diagram of a cross noise canceling unit in a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0056] FIG. 7 is a conceptual diagram of a sound pressure setting unit for left and right speakers in a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0057] FIG. 8 is a conceptual diagram of a time difference setting unit for left and right speakers in a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0058] FIG. 9 is a conceptual diagram of a distance setting unit in a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0059] Fig. 10 is a conceptual diagram of a reverberation setting unit in a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention.
[0060] FIG. 11 is a conceptual diagram illustrating a system for outputting stereophonic sound through selective control of a sound source according to one embodiment of the present invention, in which information on the time difference in arrival of sound waves between two ears is expressed as a bit array and then bundled and processed as a set of individual bundles.
[0061] FIG. 12 is a conceptual diagram illustrating a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention, in which a set of bundled sound sources is reordered by a preset reordering function.
[0062]
[0063] The stereophonic sound output system using selective control of a sound source according to the present invention can be modified in various ways and has various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, but should be understood to include all modifications, equivalents, and alternatives falling within the technical spirit and scope of the present invention.
[0064] FIG. 1 is a conceptual diagram of a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating the main configuration of a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 3 is a block diagram illustrating a sound source processing unit and its sub-components in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 4 is a conceptual diagram of an upmix unit in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 5 is a conceptual diagram for explaining ghost image processing and the concept thereof in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 6 is a conceptual diagram of a cross-noise canceling unit in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 7 is a conceptual diagram of a sound pressure setting unit for left and right speakers in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 8 is a conceptual diagram of a time difference setting unit for left and right speakers in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 9 is a conceptual diagram of a distance setting unit in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 10 is a conceptual diagram of a reverberation setting unit in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention. FIG. 11 is a conceptual diagram illustrating a process in which a sound wave arrival time difference information file between two ears is expressed as a bit array and then bundled and processed as a set of individual bundles in a stereoscopic sound output system through selective control of a sound source according to an embodiment of the present invention.FIG. 12 is a conceptual diagram illustrating a stereoscopic sound output system through selective control of a sound source according to one embodiment of the present invention, in which a set of bundled sound sources is reordered by a preset reordering function.
[0065] In the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, as illustrated in FIG. 1, it corresponds to a technical idea of processing a sound source from a video source and a sound source applied to a display unit to generate 3D stereoscopic sound through a speaker of the display unit.
[0066] In Fig. 1, in the case of the system according to the present invention, it may be a program embedded in an external terminal that is plugged into the HDMI terminal of the display unit and used, or ii) it may be a program that can be installed and updated in the display unit itself in the form of a program during the manufacturing of the display unit at the request of the manufacturer of the display unit. In the case of the electronic method, the program is activated simply by attaching it to the HDMI of the display unit, thereby enabling the ON or OFF processing of the 3D sound processing.
[0067] First, in the case of a stereoscopic sound output system through selective control of a sound source according to the present invention, the purpose is to produce a 3D stereoscopic sound effect by applying a sound source of a stereo type of two channels, and at the same time, to produce a 3D stereoscopic sound effect in a state where the physical speakers (collectively referred to as 11 and 12) of the display unit are equipped with two speakers, for example, a left speaker (11) and a right speaker (12).
[0068] To this end, as illustrated in FIGS. 1 and 2, a stereophonic sound output system through selective control of a sound source according to the present invention may include a sound source extraction unit (100), a sound source processing unit (200), and a sound source transmission unit (300).
[0069] First, in the case of the sound source extraction unit (100), it corresponds to a configuration that filters out the video source from a predetermined terminal, such as a display unit, to which a sound source is applied together with a video source, and selectively extracts only the sound source.
[0070] In the case of separate extraction of only the sound source from the video / audio source, this corresponds to a typical technical configuration and therefore a separate explanation will be omitted.
[0071] In the case of the sound source processing unit (200), as shown in FIGS. 1 and 2, the sound source extraction unit (100) separately extracts the sound source through a predetermined sound source processing, the sound source extracted by the sound source extraction unit is upmixed through a predetermined sound source processing, and the upmixed signal is processed into a 2-channel stereoscopic sound signal through selective control.
[0072] Here, the detailed technical features for the sound source processing correspond to the functions illustrated in Figs. 3 to 9, etc., and these will be described together with the description of the detailed configuration.
[0073] The sound source processing unit (200) corresponds to a technical configuration that upmixes a 2-channel stereo type sound source, then separates and extracts the channels into multiple channels such as 5.1 channels, then selectively controls each channel, and then downmixes it back into 2 channels to produce a three-dimensional sound effect through the two physical speakers (11, 12) of the display unit.
[0074] In the case of the sound source transmission unit (300), as shown in FIG. 1 and described above, it corresponds to a technical configuration that transmits sound to two physical speakers (11, 12) using sound sources that have been upmixed and processed to a predetermined level by the sound source processing unit (200) and then re-downmixed.
[0075] As shown in FIG. 4, the sound source processing unit (200) may include an upmix unit (210).
[0076] In the case of the up mix section (210), the sound source is passed through a predetermined up mix filter and upmixed into a multi-channel multi sound source.
[0077] In the case of the upmix unit (210), the multi-sound source here is set to 5.1 channels or more, and the multi-sound source is configured to allocate 5.1 channels to a front center channel, a front right channel, a front left channel, a rear right channel, a rear left channel, and a woofer channel, respectively, based on a preset position of a user virtually placed in front of a given terminal.
[0078] The preset position may be set to a virtual position where the user is tentatively expected to be positioned in front of the display unit, as illustrated in FIG. 1.
[0079] Assuming that there are actually a front center speaker, a front right speaker, a front left speaker, a rear right speaker, a rear left speaker, and a woofer channel speaker in the center of the display placed in front, centered on a user in a preset position, the 5.1 multi-channel to be assigned to each of these is upmixed by channel separation of the front center channel, front right channel, front left channel, rear right channel, rear left channel, and woofer channel.
[0080] In the future, these multi-channel signals upmixed from a two-channel stereo type sound source by the upmix unit (210) will be able to undergo various subsequent processing steps after going through a control procedure according to the cross noise canceling unit (201).
[0081] As described above, the sound source processing unit (201) may further include a cross noise canceling unit (201).
[0082] In the case of the cross noise canceling unit (201), as shown in FIG. 6, it corresponds to a configuration that filters out mutual interference / noise between sound sources input from the left ear and the right ear at a virtual preset position of the user, for example, a space several meters away from the center in front of the display unit.
[0083] First, for each of the front center channel, front right channel, front left channel, rear right channel, rear left channel, and woofer channel separated into 5.1 multichannels, a filter for the left channel and a filter for the right channel are respectively provided, and these signals separated into 5.1 channels are passed through the left channel filter and the right channel filter, respectively, to remove left channel components that may remain as interference or noise in the front right channel and rear right channel, and conversely, right channel components that may remain as interference or noise in the front left channel and rear left channel are removed.
[0084] As shown in FIGS. 5 and 7, the sound source processing unit (200) may further include a sound pressure setting unit (220).
[0085] In the case of the sound pressure setting unit (220), the standard for recognizing the sense of position / spatial space of the ghost images (#1-#4) in FIG. 5 based on the user's preset position can be recognized through the difference in pressure between the left and right ears. The sound pressure setting unit (220) is a configuration that sets the sound pressure of the left and right ears differently for each channel according to the position setting of the ghost image of the assumed object on the screen.
[0086] As illustrated in FIG. 7, in the case of the sound pressure setting unit (220), the sound pressure of the front left channel and the rear left channel is selectively adjusted in comparison to the front right channel and the rear right channel in order to localize the virtual position of the ghost image of the object on the display unit based on the preset position of the user virtually positioned in front of a predetermined terminal, for example, the display unit, using the multi-sound source.
[0087] In the case of the ghost image (#1) in Fig. 5, by making a difference in the sound pressure of the left and right ears in Fig. 7, the user can be given a sense of space in terms of the left and right positions of the ghost image (#1). For example, for the channels going to the left speaker, the sound pressure, that is, the amplitude of the sound source, is made large for the same time, and depending on the degree of the leftward bias of the ghost image (#1), the sound pressure, that is, the amplitude of the sound source, of the FR and RR going to the right channel is made relatively small for the same time compared to the channel going to the left speaker, so that the user can be given the degree of the leftward bias of the image of the object on the screen by adjusting the difference in the sound pressure of the left and right sound sources.
[0088] Conversely, in order to provide the user with a sense of space by being tilted to the right, as in the ghost image (#4) in Fig. 5, the sound pressure, i.e., the amplitude of the sound source, is set to be small for the channels going to the left speaker, for example, FL and RL, and the sound pressure, i.e., the amplitude of the sound source, of the FR and RR channels going to the right speaker is set to be relatively large for the same time compared to the channel going to the left speaker, depending on the degree of right-leaning of the ghost image (#4). However, the setting of the left-right sense of space through this difference in sound pressure is advantageous in the high-frequency region where the wavelength of the sound wave is smaller than the size of the user's virtual head circumference.
[0089] As shown in FIGS. 5 and 8, the sound source processing unit (200) may further include a time difference setting unit (230).
[0090] In the case of the time difference setting unit (230), it is also possible to set the left and right spatial sense of the ghost image (#1-#4) and transmit the spatial sense according to the time difference of the sound source transmitted to the left and right ears.
[0091] In the case of the time difference setting unit (230), as illustrated in FIG. 8, it is a configuration that selectively adjusts a predetermined sound time difference of the front left channel and the rear left channel compared to the front right channel and the rear right channel in order to localize the virtual position of the ghost image of the object on the predetermined terminal based on the preset position of the user virtually placed in front of the predetermined terminal. In the case of providing a sense of space to the left and right ears through setting the time difference, there is an advantage that it can be possible even in the low-frequency range where the wavelength of the sound wave is larger than the virtual head diameter of the user. However, there is also a point that mixing and interference with other sounds may occur depending on the time difference, that is, the degree of time delay of the sound signal. Therefore, the positional sense and sense of space of the ghost image (#1-#4) can be set and transmitted through selective application of the sound pressure setting unit (220) and the time difference setting unit (230).
[0092] According to the given information of the user's head diameter, the speed of sound wave transmission and, accordingly, the difference between the speed of sound wave transmission and the delay time corresponding to the length of the user's head diameter are calculated, and this is used as a given value for setting the time difference of the time difference setting unit (230). The user's head diameter can be set differently depending on age, gender, or artificial differences, and a statistical standard value can also be applied, but here, it is set as a variable (function) for the head diameter, and a constant value for the head diameter variable, that is, depending on the input of the actual user's head diameter information, the calculation of the time difference, etc. can be produced differently.
[0093] In the case of head diameter, the time difference information calculated according to the head diameter may have a time difference even if the head diameter is the same. This is because, in the case of sound transmitted through the two ears, that is, the right ear and the left ear, a time difference in sound wave transmission between the two ears may occur depending on the three-dimensionality of the user's face (front face) centered on the two ears, and this part is calculated based on statistical information about the three-dimensional shape of the user's face. The user's face information is made possible through a user face recognition unit (not shown), and this function can be introduced by linking the system according to the present invention with an app such as a smartphone equipped with a 3D recognition function for user face recognition.
[0094] In the case of information files regarding the time difference of sound waves between the two ears based on the user's facial recognition unit and 3D recognition of the user's face, they can be split into multiple sub-files, and the files split into sub-files are given the same parameter code and then stored separately in multiple physically split DBs to prevent arbitrary hacking by a third party. In the case of arbitrary hacking, a third party cannot re-merge the sub-files without information about the parameter code that mediates them, making arbitrary hacking difficult.
[0095] As shown in Fig. 11, in the case of the facial recognition unit, the information file for the time difference of sound waves between the two ears is listed as a bit array of 1 and 0, and then, as a predetermined set is set, the bit array of 1 and 0 is redefined as a new bundle unit, i.e., a set of sets and a set array, as shown in Fig. 11(b).
[0096] As shown in Figure 11, the predetermined set defines five bits of 1 and 0, which may vary depending on what is being determined.
[0097] As illustrated in FIG. 12, in the case of the facial recognition unit, the sets of FIG. 11 are sequentially inputted into order #0001, order #0002, 쪋, order #000N. When order #0001, order #0002, 쪋, order #000N are inputted into a predetermined reordering function, they are sequentially reordered into reorder #0001, reorder #0002, 쪋, reorder #000N according to the predetermined reordering function rule of the predetermined reordering function, which has a rule for transforming the information file about the time difference of sound waves between the two ears, which is the information of the first bit array, according to the purpose. This prevents the information file about the time difference of sound waves between the two ears from being known from the outside even in the event of external access or hacking by a third party.
[0098] As shown in FIGS. 5 and 9, the sound source processing unit (200) may further include a distance setting unit (240).
[0099] In the case of the distance setting unit (240), it provides a function that can provide an effect of moving away from or closer to the user's preset position, and at the same time, provide a sense of placement to the left or right.
[0100] In the case of the distance setting unit (240), it is a configuration that selectively adjusts the variability of the sound size of the front left channel and the rear left channel versus the time, based on the preset position of the user virtually positioned in front of a predetermined terminal, such as a display unit, with the multi-sound source.
[0101] In Fig. 5, a ghost image (#4) relatively close to the user can be set to approach the user from the left to the right in a ghost image (#3) placed far from the user. In this case, in Fig. 9, the sound source control is performed in the direction in which both the left channel going to the left speaker and the right channel going to the right speaker move upward over time, that is, the amplitude, which is the size of the sound pressure, increases, while at the same time, the size of the channel going to the left speaker, that is, the slope, and the size of the channel going to the right speaker are set to be different, that is, the slope of the signal of the channel going to the right speaker is set to be larger, thereby providing a sense of space in which the ghost image moves left to right and approaches the user.
[0102] As shown in FIGS. 5 and 9, the sound source processing unit (200) may further include a reverberation setting unit (250).
[0103] In the case of the forward setting unit (250), the multi-sound source is configured to repeatedly add the reverberation signals of the front left channel and the rear left channel to the front right channel and the rear right channel according to the reverberation time difference setting value based on the preset position of the user virtually placed in front of a predetermined terminal, for example, a display unit.
[0104] Another important factor in perception of distance is the reverberation effect. Reverberation refers to the effect of a sound that remains in a room even after it has stopped. As the distance from the ghost image of the sound source to the user increases, the amplitude, or amplitude, decreases inversely proportional to the square of the distance. Conversely, the amplitude of the reverberation decreases with increasing distance. Because the reverberation originates not from the sound source itself, but from objects in the vicinity of the user, the ratio of the reverberation amplitude to the direct sound is greater for objects that are close by than for objects that are far away. Consequently, the reverberation of distant objects has a relatively greater effect than that of nearby objects.
[0105] As illustrated in FIG. 2, the sound source transmission unit (300) transmits the front right channel and the rear right channel by assigning them to the right speaker section of a given terminal, for example, a display unit, the front left channel and the rear left channel by assigning them to the left speaker section, and the front channel and the woofer channel by selectively assigning them to the left speaker section and the right speaker section.
[0106] The scope of the present invention is determined by the matters described in the patent claims, and the parentheses used in the patent claims are not written for optional limitation, but are used to indicate clear components, and the description within the parentheses should also be interpreted as essential components.
Claims
1. A sound source extraction unit that filters out a video source from a predetermined terminal to which a sound source is applied together with a video source and selectively extracts only the sound source; A sound source processing unit that performs upmixing of the sound source extracted by the sound source extraction unit through a predetermined sound source processing, and processes the upmixed signal into a 2-channel stereoscopic sound signal through selective control; and A stereoscopic sound output system through selective control of a sound source, characterized in that it includes a sound source transmission unit that separately transmits the two-channel stereoscopic sound signal processed by the sound source processing unit to the left and right speakers of the predetermined terminal, respectively.
2. In the first paragraph, the sound source is A stereo sound output system with selective control of the sound source, characterized by a two-channel sound source of the stereo type.
3. In the second paragraph, the sound source processing unit, A stereoscopic sound output system through selective control of a sound source, characterized by including an upmix unit that upmixes the sound source into a multi-channel multi-sound source by passing the sound source through a predetermined upmix filter.
4. In the third paragraph, the multi-channel, By setting the above multi-sound source to 5.1 channels or more, Based on the preset position of the user, the above multi-sound source is virtually placed in front of a given terminal. A surround sound output system through selective control of sound sources, characterized in that the above 5.1 channels are each allocated to a front center channel, a front right channel, a front left channel, a rear right channel, a rear left channel, and a woofer channel.
5. In the fourth paragraph, the sound source processing unit, Based on the preset position of the user, the above multi-sound source is virtually placed in front of a given terminal. i) Remove the remaining front left channel component from the front right channel, and remove the remaining front right channel component from the front left channel. ii) A stereophonic sound output system through selective control of a sound source, characterized in that it further includes a cross noise canceling unit that removes the remaining rear left channel component from the rear right channel and removes the remaining rear right channel component from the rear left channel.
6. In paragraph 5, the sound source processing unit, Based on the preset position of the user, the above multi-sound source is virtually placed in front of a given terminal. In order to localize the virtual location of the ghost image of the object on the above terminal, A stereophonic sound output system through selective control of a sound source, characterized in that it further includes a sound pressure setting unit that selectively adjusts the sound pressure of the front left channel and the rear left channel compared to the front right channel and the rear right channel.
7. In paragraph 5, the sound source processing unit, Based on the preset position of the user, the above multi-sound source is virtually placed in front of a given terminal. In order to localize the virtual location of the ghost image of the object on the above terminal, A stereophonic sound output system through selective control of a sound source, characterized in that it further includes a time difference setting unit that selectively adjusts a predetermined sound time difference of the front left channel and the rear left channel compared to the front right channel and the rear right channel.
8. In paragraph 5, the sound source processing unit, Based on the preset position of the user, the above multi-sound source is virtually placed in front of a given terminal. A stereoscopic sound output system through selective control of a sound source, characterized in that it further includes a distance setting unit that selectively adjusts the variability of the sound size of the front left channel and the rear left channel over time compared to the front right channel and the rear right channel.
9. In paragraph 8, the sound source processing unit, Based on the preset position of the user, the above multi-sound source is virtually placed in front of a given terminal. A stereoscopic sound output system through selective control of a sound source, characterized in that it further includes a reverberation setting unit that repeatedly adds the reverberation signals of the front left channel and the rear left channel to the front right channel and the rear right channel according to a reverberation time difference setting value.
10. In any one of the clauses 6 to 9, the sound source transmission unit, The above front light channel and the above rear light channel are assigned to the right speaker section of the above given terminal, The above front left channel and the above rear left channel are assigned to the left speaker section, A stereoscopic sound output system through selective control of a sound source, characterized in that the front channel and the woofer channel are selectively allocated and transmitted to the left speaker section and the right speaker section.
Citation Information
Patent Citations
Acoustic rendering device and acoustic rendering method
JP5944403B2
System for providing audio data and providing methodthereof
KR1020050118495A
Apparatus for generating multi-channel sound signal
KR1020110053600A
System for mastering sound files
KR102504081B1
A fastening detection device for detecting whether a safety belt is fastened and an electronic device therefor
KR102607884B1
