Sound image calibration method, terminal device, storage medium and program product

Abstract

The invention relates to a sound image calibration method, terminal equipment, a storage medium and a program product, and particularly relates to the technical field of terminals. Comprising a sound collection assembly and a plurality of sound playing assemblies, and the method comprises the following steps: collecting sound source volumes output by the plurality of sound playing assemblies through the sound collection assembly; obtaining distance values between the plurality of sound playing components and the sound acquisition component and the central position of the terminal equipment; according to the sound source volume and the distance value, calculating a corresponding calibration parameter when the sound image is located at the central position of the terminal equipment; and carrying out acoustic image calibration according to the calibration parameters. According to the embodiment of the invention, the sound image can be perceived to be located at the central position of the terminal equipment by human ear listening after calibration, and the accuracy of sound image positioning is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an audio-visual calibration method, a terminal device, a storage medium and a program product. Background Art

[0002] Sound and image is the human ear's perception of the source of the sound source through listening. If the left and right channels of a stereo device play the same signal size and delay, the human ear will think that the sound source is located in the center of the screen. In reality, due to the use of different electroacoustic devices for the left and right channels and the difference in sensitivity of the electroacoustic devices themselves, the sound and image positions are quite different, and the equipment itself needs to be calibrated separately. For example, the upper speaker of a stereo mobile phone often uses a 1012 unit, and the lower speaker uses a ≥1115 unit. The upper speaker itself bears less power than the lower speaker, which causes the sound and image position to generally bias towards the lower speaker, and the sound and image positioning is not accurate enough; in addition, the upper and lower speakers have different signal sources, and there is a certain time difference, which also affects the sound and image position to a certain extent. In addition, the sensitivity of the electroacoustic device itself also varies. The sensitivity deviation of conventional speakers is ±3Db, and the sensitivity difference between the left and right channel speakers may reach 6Db under extreme conditions. The above factors cause inaccurate sound and image positioning. Summary of the invention

[0003] In order to solve the above technical problems or at least partially solve the above technical problems, the present application provides a sound and image calibration method, a terminal device, a storage medium and a program product, which can improve the accuracy of sound and image positioning.

[0004] In order to achieve the above purpose, the technical solutions provided by the embodiments of the present application are as follows:

[0005] In a first aspect, the present application provides a sound and image calibration method, including: applied to a terminal device, the terminal device includes a sound collection component and multiple sound playback components, the method includes: collecting the sound source volume output by the multiple sound playback components through the sound collection component; obtaining the distance values ​​between the multiple sound playback components and the sound collection component and the center position of the terminal device; according to the sound source volume and the distance value, calculating the calibration parameters corresponding to when the sound and image are located at the center position of the terminal device; and performing sound and image calibration according to the calibration parameters.

[0006] As an optional implementation of an embodiment of the present application, the calibration parameters include playback gain; based on the sound source volume and the distance value, the calibration parameters corresponding to the sound image being located at the center of the terminal device are calculated, including: based on the sound source volume and the distance value, calculating the sound pressure levels of multiple sound playback components at the center of the terminal device; determining whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, calculating the sound pressure difference between the sound pressure levels, and using the sound pressure difference as the playback gain.

[0007] As an optional implementation of an embodiment of the present application, the calibration parameters include playback delay; based on the sound source volume and distance value, the calibration parameters corresponding to the sound image being located at the center of the terminal device are calculated, including: based on the sound source volume and distance value, calculating the sound pressure levels of multiple sound playback components at the center of the terminal device; determining whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, calculating the sound pressure difference between the sound pressure levels; and calculating the playback delay based on the sound pressure difference.

[0008] As an optional implementation of the embodiment of the present application, the sound pressure level of multiple sound playback components at the center of the terminal device is calculated according to the sound source volume and the distance value, including: calculating the sound pressure level of each sound playback component at the center of the terminal device according to the following formula:

[0009]

[0010] Wherein, v is the sound source volume corresponding to the sound playback component, L is the distance between the sound playback component and the sound collection component, and d is the distance between the sound playback component and the center position of the terminal device.

[0011] In a second aspect, the present application provides a terminal device, the terminal device comprising a sound collection component and a plurality of sound playback components;

[0012] Among them, the sound collection component is used to collect the sound source volume output by multiple sound playback components;

[0013] An acquisition module is used to obtain the distance values ​​between multiple sound playback components and the sound collection components and the center position of the terminal device;

[0014] A calculation module, used to calculate the calibration parameters corresponding to when the sound image is located at the center of the terminal device according to the sound source volume and distance value;

[0015] The calibration module is used for performing sound and image calibration according to calibration parameters.

[0016] As an optional implementation of an embodiment of the present application, the calibration parameters include playback gain; a calculation module is specifically used to: calculate the sound pressure levels of multiple sound playback components at the center position of the terminal device based on the sound source volume and distance value; determine whether the sound pressure levels of multiple sound playback components at the center position of the terminal device match; if not, calculate the sound pressure difference between the sound pressure levels, and use the sound pressure difference as the playback gain.

[0017] As an optional implementation of an embodiment of the present application, the calibration parameters include playback delay; the calculation module is specifically used to: calculate the calibration parameters corresponding to when the sound image is located at the center of the terminal device according to the sound source volume and the distance value, including: calculating the sound pressure levels of multiple sound playback components at the center of the terminal device according to the sound source volume and the distance value; determining whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, calculating the sound pressure difference between the sound pressure levels; and calculating the playback delay according to the sound pressure difference.

[0018] As an optional implementation of the embodiment of the present application, the calculation module is specifically used to calculate the sound pressure level of each sound playback component at the center of the terminal device according to the following formula:

[0019]

[0020] Wherein, v is the sound source volume corresponding to the sound playback component, L is the distance between the sound playback component and the sound collection component, and d is the distance between the sound playback component and the center position of the terminal device.

[0021] In a third aspect, the present application provides a terminal device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the audio and video calibration method as described in the first aspect or any one of its optional embodiments is implemented.

[0022] In a fourth aspect, the present application provides a computer-readable storage medium, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the sound and image calibration method as described in the first aspect or any optional embodiment thereof is implemented.

[0023] In a fifth aspect, the present application provides a computer program product, including: the computer program product includes a computer program, and when the computer program runs on a computer, the computer implements the sound and image calibration method as described in the first aspect or any optional embodiment thereof.

[0024] Compared with the prior art, the technical solution provided by the embodiments of the present application has the following advantages:

[0025] The disclosed embodiment provides a sound image calibration method, a terminal device, a storage medium and a program product, wherein the method is applied to a terminal device, firstly, the sound source volume output by multiple sound playback components is collected by a sound collection component in the terminal device, and then the distance values ​​between the multiple sound playback components and the sound collection component and the center position of the terminal device are obtained, and the calibration parameters corresponding to the sound image when the sound image is located at the center position of the terminal device are calculated according to these distance values ​​and the collected sound source volume, so as to perform sound image calibration according to the calibration parameters. In this way, after calibration, the human ear can perceive that the sound image is located at the center position of the terminal device, thereby ensuring the accuracy of sound image positioning. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0027] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0028] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0029] Figure 2 A flow chart of a sound and image calibration method provided in an embodiment of the present application;

[0030] Figure 3A A schematic diagram of a terminal device provided in an embodiment of the present application Figure 1 ;

[0031] Figure 3B A schematic diagram of the distance values ​​between multiple sound playback components, sound collection components, and the center position of a terminal device provided in an embodiment of the present application;

[0032] Figure 4 A schematic diagram of a terminal device provided in an embodiment of the present application Figure 2 ;

[0033] Figure 5 This is a third structural diagram of a terminal device described in an embodiment of the present application. DETAILED DESCRIPTION

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the technical terms required to be used in the embodiments or the prior art description are briefly introduced below:

[0035] Sound image refers to the spatial position of each musical instrument displayed through a stereo recording and playback system, giving the audience a sense of presence and surrounding.

[0036] Sound image positioning refers to the ability to accurately locate the sound image of a musical instrument or human voice, and even to clearly determine the characteristics of the sound field. This technology enhances the sense of direction of the sound, allowing the listener to clearly perceive the direction and position of the sound source, thereby providing a more immersive listening experience. The speaker unit is the core component of the speaker's sound. It can be divided into dynamic, inductive, electrostatic, planar, ribbon, horn and other types according to the different sound-generating methods. 1012 units usually refer to speakers with a diameter of 10.2mm. Speakers of this size are often used in small devices such as mobile phones or other portable terminal devices. It may have a smaller size and lower power output, suitable for devices that require smaller space and lower volume requirements. 1115 units refer to speakers with a diameter of 11mm. Speakers of this size are usually used in devices that require higher volume or higher sound quality requirements, such as smart watches, tablets or other wearable devices. It may have a larger size and higher power output to provide better sound quality and volume performance.

[0037] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0038] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only part of the embodiments of the present application, rather than all of the embodiments.

[0039] like Figure 1 As shown, Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application, wherein the terminal device includes multiple sound playback components, so that the terminal device can use the multiple sound playback components to achieve sound playback. However, the sound and image corresponding to the played audio deviates from the center position of the terminal device, and the audio playback effect is poor. For example, when the terminal device plays any sound source, the sound and image of the sound source should be located at the center position of the terminal device, but the user indicates that the sound and image deviates from the center position and is relatively to the right based on the audio signal received.

[0040] In order to solve some or all of the technical problems existing in the related art, the embodiment of the present application provides a sound image calibration method, a terminal device, a storage medium and a program product, wherein the method is applied to the terminal device, firstly, the sound source volume output by multiple sound playback components is collected by the sound collection component in the terminal device, and then the distance values ​​between the multiple sound playback components and the sound collection component and the center position of the terminal device are obtained, and the calibration parameters corresponding to the sound image when the sound image is located at the center position of the terminal device are calculated according to these distance values ​​and the collected sound source volume, so as to perform sound image calibration according to the calibration parameters. In this way, after calibration, the human ear can perceive that the sound image is located at the center position of the terminal device, thereby ensuring the accuracy of sound image positioning.

[0041] A sound and image calibration method provided in the embodiment of the present application can be implemented by a sound and image calibration device or a terminal device, and the terminal device includes but is not limited to a personal computer, a laptop computer, a tablet computer, a smart phone, etc. The operating system of the terminal device may include Android, a mobile operating system (iOS) developed by Apple, an operating system (Windows) developed by Microsoft Corporation of the United States, etc., and the embodiment of the present application does not limit this. The terminal device can be operated alone to implement the present application, or it can be connected to a network and implement the present application through interactive operations with other computer devices in the network. Among them, the network in which the terminal device is located includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN) network, etc.

[0042] It should be noted that the protection scope of the sound and image calibration method described in the embodiment of the present application is not limited to the execution order of the steps listed in this embodiment. All solutions implemented by adding, reducing or replacing steps in the prior art based on the principles of the present application are included in the protection scope of the present application.

[0043] like Figure 2 As shown, Figure 2 1 is a flow chart of a sound and image calibration method according to an embodiment of the present application. The method can be performed by a sound and image calibration device, wherein the device can be implemented by software and / or hardware and can generally be integrated in a terminal device. Figure 3A As shown, Figure 3A A structural schematic diagram of a terminal device provided in an embodiment of the present application, the terminal device includes a sound collection component and a sound playback component. Exemplarily, the sound collection component includes a left channel speaker 301 and a right channel speaker 302, and the sound playback component includes a main microphone 303 and a secondary microphone 304.

[0044] like Figure 2 As shown, the method mainly includes the following steps S201 to S204:

[0045] S201. Collect the volume of sound sources output by multiple sound playing components through a sound collecting component.

[0046] Among them, when multiple sound playing components play sound sources, the sound and image deviate from the center position of the terminal device, as exemplified by Figure 1 The plurality of sound playing components may be at least two to present a stereo sound effect, such as Figure 3A The left channel speaker 301 and the right channel speaker 302 are shown. There can be at least one sound collecting component.

[0047] In some embodiments, a calibration mode is set for the sound calibration method, and is optionally displayed as a control on the terminal device. The user can operate the control to turn on the calibration mode so that the terminal device starts executing the sound calibration method provided in the embodiments of the present application.

[0048] In some embodiments, when executing step S201, the terminal device first controls any sound playback component to output a preset sound source, and then controls the sound collection component to collect the volume of the sound source, and then controls other sound playback components to output the same preset sound source and the sound collection component to collect. Exemplarily, the terminal device first controls the first sound playback component to output the preset sound source, and then controls the sound collection component to collect the sound source volume, which can be recorded as the first volume; then the terminal device controls the second sound playback component to output the preset sound source, and then controls the sound collection component to collect the sound source volume, which can be recorded as the second volume.

[0049] refer to Figure 3A As shown, the left channel speaker 301 is controlled to output the preset sound source first, and the main microphone 303 collects the first volume v1 = 64dB; then the right channel speaker 302 is controlled to output the preset sound source first, and the main microphone 303 collects the second volume v2 = 80dB. The auxiliary microphone 304 can also perform the volume collection task.

[0050] S202: Obtain distance values ​​between multiple sound playing components and the sound collecting components and the center position of the terminal device.

[0051] In some embodiments, a first distance value between the first sound playing component and the sound collecting component, a second distance value between the first sound playing component and the center position of the terminal device, a third distance value between the second sound playing component and the sound collecting component, and a fourth distance value between the second sound playing component and the center position of the terminal device are obtained.

[0052] like Figure 3BAs shown, the first distance value L1 between the left channel speaker 301 and the main microphone 303 is 10 cm, the second distance value d1 between the left channel speaker 301 and the center position of the terminal device is 4 cm, the third distance value L2 between the right channel speaker 302 and the main microphone 303 is 2 cm, and the fourth distance value d2 between the right channel speaker 302 and the center position of the terminal device is 4 cm.

[0053] S203: Calculate the calibration parameters corresponding to when the sound image is located at the center of the terminal device according to the sound source volume and the distance value.

[0054] In some embodiments, the calibration parameters corresponding to when the sound image is located at the center of the terminal device are calculated based on the first volume, the first distance value and the second distance value, and the second volume, the third distance value and the fourth distance value.

[0055] Optionally, the calibration parameters include playback gain or playback delay.

[0056] In some embodiments, when the calibration parameter is playback gain, the process of executing step S203 includes the following steps S2031 to S2033:

[0057] S2031. Calculate the sound pressure levels of multiple sound playback components at the center of the terminal device according to the sound source volume and distance value.

[0058] Optionally, the sound pressure level of each sound playback component at the center of the terminal device is calculated according to the following formula (1):

[0059]

[0060] In formula (1), v is the sound source volume corresponding to the sound playing component, L is the distance between the sound playing component and the sound collecting component, and d is the distance between the sound playing component and the center position of the terminal device.

[0061] According to the above formula (1), the sound pressure level of each sound playing component at the center of the terminal device is calculated based on the sound source volume corresponding to each sound playing component, the distance value to the sound collecting component and the distance value to the center of the terminal device.

[0062] Exemplarily, based on the first volume v1, the first distance value L1 and the second distance value d1, the first sound pressure level SPL1=64+20log(10 / 4) of the first sound playing component at the center position of the terminal device is calculated; based on the second volume v2, the third distance value L2 and the fourth distance value d2, the second sound pressure level SPL2=80+20log(2 / 4) of the second sound playing component at the center position of the terminal device is calculated.

[0063] S2032: Determine whether the sound pressure levels of the multiple sound playing components at the center position of the terminal device match.

[0064] If yes, it means that the sound pressure levels of multiple sound playing components at the center of the terminal device are the same or the difference is within a preset range, and the sound image position is at the center of the terminal device, then the sound calibration process ends.

[0065] If not, it means that the sound pressure levels of the multiple sound playing components at the center position of the terminal device are different or the difference exceeds the preset range, and the sound image position deviates from the midpoint position of the terminal device, then step S2033 is further executed.

[0066] S2033. Calculate the sound pressure difference between the sound pressure levels.

[0067] After calculating the sound pressure levels of each sound playing component at the center of the terminal device, the sound pressure difference between them is calculated. Exemplarily, the sound pressure difference ΔSPL≈-2dB between the first sound pressure level SPL1 and the second sound pressure level SPL2 is calculated.

[0068] Afterwards, step S204 may be executed to perform sound image calibration according to the sound pressure difference.

[0069] The above embodiment takes into account the sensitivity differences of the sound playback components. By calculating the sound pressure level of the sound playback component at the center of the terminal device, the playback gain can be adjusted later to overcome the problem of inaccurate sound and image positioning caused by the sensitivity differences, thereby optimizing the auditory experience, enhancing the immersiveness of the sound, and allowing users to feel a more realistic and three-dimensional sound effect.

[0070] In some embodiments, the calibration parameter is the playback delay, and the process of executing step S203 includes the following steps S203a to S203d:

[0071] S203a. Calculate the sound pressure levels of the multiple sound playing components at the center of the terminal device according to the sound source volume and the distance value.

[0072] Optionally, the sound pressure level of each sound playback component at the center of the terminal device is calculated according to the following formula (1):

[0073]

[0074] In formula (1), v is the volume of the sound source, L is the distance between the sound playback component and the sound collection component, and d is the distance between the sound playback component and the center position of the terminal device.

[0075] According to the above formula (1), the sound pressure level of each sound playing component at the center of the terminal device is calculated based on the sound source volume corresponding to each sound playing component, the distance value to the sound collecting component and the distance value to the center of the terminal device.

[0076] Exemplarily, based on the first volume v1, the first distance value L1 and the second distance value d1, the first sound pressure level SPL1=64+20log(10 / 4) of the first sound playing component at the center position of the terminal device is calculated; based on the first volume v2, the third distance value L2 and the fourth distance value d2, the second sound pressure level SPL2=80+20log(2 / 4) of the second sound playing component at the center position of the terminal device is calculated.

[0077] The above embodiment takes into account that different sound playback components are used for the left and right channels, and the difference in sensitivity of the sound playback components themselves will lead to large differences in the sound and image positions, and the device itself needs to be calibrated separately. Therefore, according to the sound source volume and distance value, the sound pressure level of multiple sound playback components at the center position of the terminal device is calculated, and the sound pressure level is used as the basis to measure whether the sound and image positioning is accurate.

[0078] S203b, determining whether the sound pressure levels of the multiple sound playing components at the center position of the terminal device match.

[0079] If yes, it means that the sound pressure levels of multiple sound playing components at the center of the terminal device are the same or the difference is within a preset range, and the sound image position is at the center of the terminal device, then the sound calibration process ends.

[0080] If not, it means that the sound pressure levels of the multiple sound playing components at the center position of the terminal device are different or the difference exceeds the preset range, and the sound image position deviates from the end position of the terminal device, then step S203c is further executed.

[0081] S203c. Calculate the sound pressure difference between the sound pressure levels.

[0082] After calculating the sound pressure levels of each sound playing component at the center of the terminal device, the sound pressure difference between them is calculated. Exemplarily, the sound pressure difference ΔSPL≈-2dB between the first sound pressure level SPL1 and the second sound pressure level SPL2 is calculated.

[0083] S203d. Calculate the playback delay according to the sound pressure difference.

[0084] It should be noted that by optimizing the sound image position through delay, according to the Haas effect and the De Boe effect, when the sound pressure level of the left and right channels differs by 15dB, or the delay differs by 5ms, people will feel that all the sounds come from the sound with a larger sound pressure level or the sound that is emitted first. Through a rough conversion relationship, 1dB is approximately equal to 1 / 3ms delay.

[0085] Exemplarily, the sound pressure difference ΔSPL≈-2dB, and the playback delay calculated according to the sound pressure difference is -2 / 3ms, which means that if the sound and image are to be located at the center of the terminal device, the second sound playback component needs to be delayed by 2 / 3ms.

[0086] Afterwards, step S204 may be executed to perform sound and image calibration according to the playback delay.

[0087] The above embodiment calculates the sound pressure difference and then converts it to obtain the playback delay. In addition to providing the sound pressure difference as an audio-visual calibration parameter, it also provides the playback delay as a calibration parameter.

[0088] S204: Perform audio and video calibration according to the calibration parameters.

[0089] In some embodiments, the calibration parameter is a sound pressure difference, and performing sound and image calibration based on the sound pressure difference includes: when the sound pressure difference is a negative value, increasing the sound pressure level of the first sound playback component at the center position of the terminal device according to the absolute value of the sound pressure difference, so as to perform sound and image calibration on the first sound playback component so that the sound and image are located at the center position of the terminal device; or, when the sound pressure difference is a negative value, reducing the sound pressure level of the second sound playback component at the center position of the terminal device according to the absolute value of the sound pressure difference, so as to perform sound and image calibration on the second sound playback component so that the sound and image are located at the center position of the terminal device.

[0090] Exemplarily, the sound pressure difference ΔSPL≈-2dB increases the sound pressure level of the first sound playing component at the center of the terminal device by 2dB, or decreases the sound pressure level of the second sound playing component at the center of the terminal device by 2dB.

[0091] In some embodiments, the calibration parameter is the playback delay, and the sound and image calibration according to the playback delay includes: when the playback delay is a negative value, the second sound playback component is delayed according to the absolute value of the playback delay to perform sound and image calibration on the second sound playback component so that the sound and image are located at the center of the terminal device; when the playback delay is a positive value, the first sound playback component is delayed according to the absolute value of the playback delay to perform sound and image calibration on the first sound playback component so that the sound and image are located at the center of the terminal device. Thus, by adjusting the delay of the sound playback component, the problem of inaccurate sound and image positioning caused by sensitivity differences can be overcome, the auditory experience can be optimized, the immersiveness of the sound can be enhanced, and the user can feel a more realistic and three-dimensional sound effect.

[0092] The above implementation provides a variety of sound and image calibration methods. By adjusting individual sound playback components, the sound and image can be close to the center position of the terminal device when they deviate, thereby improving the playback effect of the entire audio system, enhancing the user's immersive listening experience, and meeting listening scenarios with higher sound and image positioning.

[0093] In summary, the embodiment of the present application provides a sound image calibration method, which is applied to a terminal device. First, the sound source volume output by multiple sound playback components is collected by the sound collection component in the terminal device, and then the distance values ​​between the multiple sound playback components and the sound collection component and the center position of the terminal device are obtained. According to these distance values ​​and the collected sound source volume, the calibration parameters corresponding to the sound image at the center position of the terminal device are calculated, so as to perform sound image calibration according to the calibration parameters. In this way, after calibration, the human ear can perceive that the sound image is located at the center position of the terminal device, ensuring the accuracy of sound image positioning.

[0094] At the same time, some embodiments of the present application take into account the sensitivity differences of the sound playback components. By calculating the sound pressure level of the sound playback component at the center of the terminal device, the playback gain is adjusted to overcome the problem of inaccurate sound and image positioning caused by the sensitivity difference, optimize the auditory experience, and enhance the immersiveness of the sound, so that users can feel a more realistic and three-dimensional sound effect.

[0095] In addition, the difference in sound pressure levels of different sound playback components at the center of the terminal device is converted into playback delay, so that the delay of the sound playback component can be adjusted to overcome the problem of inaccurate sound and image positioning caused by sensitivity differences, optimize the auditory experience, enhance the immersiveness of the sound, and allow users to feel a more realistic and three-dimensional sound effect.

[0096] like Figure 4 As shown, Figure 4 A terminal device provided in an embodiment of the present application includes a sound collection component and multiple sound playback components 400;

[0097] The sound collection component 401 is used to collect the sound source volume output by multiple sound playing components;

[0098] The acquisition module 402 is used to obtain the distance values ​​between the multiple sound playing components and the sound collecting components and the center position of the terminal device;

[0099] A calculation module 403, used to calculate the calibration parameters corresponding to when the sound image is located at the center of the terminal device according to the sound source volume and the distance value;

[0100] The calibration module 404 is used to perform sound and image calibration according to the calibration parameters.

[0101] As an optional implementation of an embodiment of the present application, the calibration parameters include playback gain; the calculation module 403 is specifically used to: calculate the sound pressure levels of multiple sound playback components at the center position of the terminal device according to the sound source volume and distance value; determine whether the sound pressure levels of multiple sound playback components at the center position of the terminal device match; if not, calculate the sound pressure difference between the sound pressure levels, and use the sound pressure difference as the playback gain.

[0102] As an optional implementation of an embodiment of the present application, the calibration parameters include playback delay; the calculation module 403 is specifically used to: calculate the calibration parameters corresponding to when the sound image is located at the center of the terminal device according to the sound source volume and the distance value, including: calculating the sound pressure levels of multiple sound playback components at the center of the terminal device according to the sound source volume and the distance value; determining whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, calculating the sound pressure difference between the sound pressure levels; and calculating the playback delay according to the sound pressure difference.

[0103] As an optional implementation of the embodiment of the present application, the calculation module 403 is specifically used to calculate the sound pressure level of each sound playing component at the center position of the terminal device according to the following formula:

[0104]

[0105] Wherein, v is the sound source volume corresponding to the sound playback component, L is the distance between the sound playback component and the sound collection component, and d is the distance between the sound playback component and the center position of the terminal device.

[0106] In summary, the embodiment of the present application provides a terminal device, which first collects the sound source volume output by multiple sound playback components through a sound collection component, and then obtains the distance values ​​between the multiple sound playback components and the sound collection component and the center position of the terminal device through an acquisition module, and the calculation module calculates the calibration parameters corresponding to the sound image when it is located at the center position of the terminal device based on these distance values ​​and the collected sound source volume, so as to perform sound image calibration according to the calibration parameters through the calibration module. In this way, after calibration, the human ear can perceive that the sound image is located at the center position of the terminal device, ensuring the accuracy of sound image positioning.

[0107] For the specific definition of the terminal device, please refer to the definition of the sound and image calibration method above, which will not be repeated here. Each module in the above terminal device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0108] In one embodiment, the present application provides a terminal device, which may be a terminal, and its internal structure diagram may be as follows: Figure 5As shown. The terminal device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the terminal device is used to provide computing and control capabilities. The memory of the terminal device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the terminal device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a jam detection method is implemented. The display screen of the terminal device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the terminal device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the terminal device housing, or an external keyboard, touchpad or mouse, etc.

[0109] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the terminal device to which the scheme of the present application is applied. The specific terminal device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0110] In one embodiment, the terminal device provided by the present application can be implemented in the form of a computer program, and the computer program can be Figure 5 The memory of the terminal device can store various program modules constituting the terminal device, for example, Figure 4 The acquisition module 402, the calculation module 403 and the calibration module 404 are shown. The computer program composed of various program modules enables the processor to execute the steps of the sound image calibration method of each embodiment of the present application described in this specification.

[0111] For example, Figure 5 The terminal device shown can be Figure 4 The sound collection component 401 in the terminal device shown collects the sound source volume output by multiple sound playing components; the terminal device can obtain the distance values ​​between multiple sound playing components and the sound collection component and the center position of the terminal device through the acquisition module 402; the terminal device can calculate the corresponding calibration parameters when the sound image is located at the center position of the terminal device according to the sound source volume and the distance value through the calculation module 403. The terminal device can perform sound image calibration according to the calibration parameters through the calibration module 404.

[0112] In one embodiment, the present application provides a terminal device, including a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program: collecting the sound source volume output by multiple sound playing components through a sound collection component; obtaining the distance values ​​between the multiple sound playing components and the sound collection component and the center position of the terminal device; calculating the calibration parameters corresponding to the sound image when the sound image is located at the center position of the terminal device according to the sound source volume and the distance value; and performing sound image calibration according to the calibration parameters.

[0113] In one embodiment, the processor further implements the following steps when executing the computer program: the calibration parameters include playback gain; based on the sound source volume and the distance value, the calibration parameters corresponding to when the sound image is located at the center of the terminal device are calculated, including: based on the sound source volume and the distance value, the sound pressure levels of multiple sound playback components at the center of the terminal device are calculated; it is determined whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, the sound pressure difference between the sound pressure levels is calculated, and the sound pressure difference is used as the playback gain.

[0114] In one embodiment, the processor further implements the following steps when executing the computer program: the calibration parameters include the playback delay; based on the sound source volume and the distance value, the calibration parameters corresponding to when the sound image is located at the center of the terminal device are calculated, including: based on the sound source volume and the distance value, the sound pressure levels of multiple sound playback components at the center of the terminal device are calculated; it is determined whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, the sound pressure difference between the sound pressure levels is calculated; and the playback delay is calculated based on the sound pressure difference.

[0115] In one embodiment, when the processor executes the computer program, the following steps are further implemented: according to the sound source volume and the distance value, the sound pressure level of multiple sound playback components at the center of the terminal device is calculated, including: the sound pressure level of each sound playback component at the center of the terminal device is calculated according to the following formula:

[0116]

[0117] Wherein, v is the sound source volume corresponding to the sound playback component, L is the distance between the sound playback component and the sound collection component, and d is the distance between the sound playback component and the center position of the terminal device.

[0118] When the processor in the terminal device provided by the present application executes the computer program, it first collects the sound source volume output by multiple sound playing components through the sound collection component in the terminal device, and then obtains the distance values ​​between the multiple sound playing components and the sound collection component and the center position of the terminal device. According to these distance values ​​and the collected sound source volume, the calibration parameters corresponding to the sound image at the center position of the terminal device are calculated, so as to perform sound image calibration according to the calibration parameters. In this way, after calibration, the human ear can perceive that the sound image is located at the center position of the terminal device, ensuring the accuracy of sound image positioning.

[0119] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed, the following steps are implemented: collecting the sound source volume output by multiple sound playing components through a sound collection component; obtaining the distance values ​​between the multiple sound playing components and the sound collection component and the center position of the terminal device; calculating the calibration parameters corresponding to the sound image at the center position of the terminal device according to the sound source volume and the distance value; and performing sound image calibration according to the calibration parameters.

[0120] In one embodiment, the computer program further implements the following steps when executing the computer program: the calibration parameters include playback gain; based on the sound source volume and the distance value, the calibration parameters corresponding to when the sound image is located at the center of the terminal device are calculated, including: based on the sound source volume and the distance value, the sound pressure levels of multiple sound playback components at the center of the terminal device are calculated; it is determined whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, the sound pressure difference between the sound pressure levels is calculated, and the sound pressure difference is used as the playback gain.

[0121] In one embodiment, the computer program further implements the following steps when executing the computer program: the calibration parameters include the playback delay; based on the sound source volume and the distance value, the calibration parameters corresponding to when the sound image is located at the center of the terminal device are calculated, including: based on the sound source volume and the distance value, the sound pressure levels of multiple sound playback components at the center of the terminal device are calculated; it is determined whether the sound pressure levels of multiple sound playback components at the center of the terminal device match; if not, the sound pressure difference between the sound pressure levels is calculated; and the playback delay is calculated based on the sound pressure difference.

[0122] In one embodiment, when the computer program is executed, the computer program further implements the following steps: calculating the sound pressure level of multiple sound playback components at the center of the terminal device according to the sound source volume and the distance value, including: calculating the sound pressure level of each sound playback component at the center of the terminal device according to the following formula:

[0123]

[0124] Wherein, v is the sound source volume corresponding to the sound playback component, L is the distance between the sound playback component and the sound collection component, and d is the distance between the sound playback component and the center position of the terminal device.

[0125] When the computer program in the computer-readable storage medium provided by the present application executes the computer program, the sound source volume output by the multiple sound playing components is first collected by the sound collecting component in the terminal device, and then the distance values ​​between the multiple sound playing components and the sound collecting component and the center position are obtained. According to these distance values ​​and the collected sound source volume, the calibration parameters corresponding to the sound image at the center position are calculated, so as to perform sound image calibration according to the calibration parameters. In this way, after calibration, the human ear can perceive that the sound image is located at the center position of the terminal device, ensuring the accuracy of sound image positioning.

[0126] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media that include computer-usable program code.

[0127] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0128] In the present application, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0129] In this application, memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0130] In this application, computer-readable media includes permanent and non-permanent, removable and non-removable storage media. Storage media can be implemented by any method or technology to store information, and the information can be computer-readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. According to the definition in this article, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0131] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0132] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for calibrating an audio and video signal, characterized in that: Applied to a terminal device, the terminal device includes a sound collection component and multiple sound playback components, and the method includes: The sound source volumes output by the multiple sound playing components are collected by the sound collecting component; and the distance values ​​between the multiple sound playing components and the sound collecting component and the center position of the terminal device are obtained; Calculating, according to the sound source volume and the distance value, a calibration parameter corresponding to when the sound image is located at the center of the terminal device; Perform sound and image calibration according to the calibration parameters.

2. The method according to claim 1, characterized in that: The calibration parameters include playback gain; Calculating, according to the sound source volume and the distance value, a calibration parameter corresponding to when the sound image is located at the center of the terminal device, including: Calculating the sound pressure levels of the multiple sound playing components at the center of the terminal device according to the sound source volume and the distance value; Determining whether the sound pressure levels of the multiple sound playing components at the center position of the terminal device match; If not, the sound pressure difference between the sound pressure levels is calculated, and the sound pressure difference is used as the playback gain.

3. The method according to claim 1, characterized in that The calibration parameters include playback delay; Calculating, according to the sound source volume and the distance value, a calibration parameter corresponding to when the sound image is located at the center of the terminal device, including: Calculating the sound pressure levels of the multiple sound playing components at the center of the terminal device according to the sound source volume and the distance value; Determining whether the sound pressure levels of the multiple sound playing components at the center position of the terminal device match; If not, calculating the sound pressure difference between the sound pressure levels; The playback delay is calculated according to the sound pressure difference.

4. The method according to claim 2 or 3, characterized in that: The step of calculating the sound pressure levels of the plurality of sound playing components at the center of the terminal device according to the sound source volume and the distance value includes: The sound pressure level of each sound playback component at the center of the terminal device is calculated according to the following formula: In the formula, v is the sound source volume corresponding to the sound playing component, L is the distance value between the sound playing component and the sound collecting component, and d is the distance value between the sound playing component and the center position of the terminal device.

5. A terminal device, characterized in that: The terminal device includes a sound collection component and a plurality of sound playing components; The sound collection component is used to collect the sound source volume output by the multiple sound playing components; An acquisition module, used to acquire distance values ​​between the multiple sound playing components and the sound collecting component and the center position of the terminal device; A calculation module, used to calculate the calibration parameters corresponding to when the sound image is located at the center of the terminal device according to the sound source volume and the distance value; The calibration module is used to perform sound and image calibration according to the calibration parameters.

6. The terminal device according to claim 5, characterized in that: The calibration parameter includes playback gain; the calculation module is specifically used for: Calculating the sound pressure levels of the multiple sound playing components at the center of the terminal device according to the sound source volume and the distance value; Determining whether the sound pressure levels of the multiple sound playing components at the center position of the terminal device match; If not, the sound pressure difference between the sound pressure levels is calculated, and the sound pressure difference is used as the playback gain.

7. The terminal device according to claim 5, characterized in that: The calibration parameters include a playback delay; a calculation module, specifically used for: Calculating, according to the sound source volume and the distance value, a calibration parameter corresponding to when the sound image is located at the center of the terminal device, including: Calculating the sound pressure levels of the multiple sound playing components at the center of the terminal device according to the sound source volume and the distance value; Determining whether the sound pressure levels of the multiple sound playing components at the center position of the terminal device match; If not, calculating the sound pressure difference between the sound pressure levels; The playback delay is calculated according to the sound pressure difference.

8. The terminal device according to claim 6 or 7, characterized in that: The calculation module is specifically used to calculate the sound pressure level of each sound playing component at the center position of the terminal device according to the following formula: In the formula, v is the sound source volume corresponding to the sound playing component, L is the distance value between the sound playing component and the sound collecting component, and d is the distance value between the sound playing component and the center position of the terminal device.

9. A computer-readable storage medium, characterized in that: include: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the sound and image calibration method according to any one of claims 1 to 4 is implemented.

10. A computer program product, characterized in that include: The computer program product comprises a computer program, and when the computer program is run on a computer, the computer is enabled to implement the sound image calibration method according to any one of claims 1 to 4.

Images