Loudness adjustment method and apparatus, storage medium and electronic device

Abstract

The present application relates to the field of sound playback. Disclosed are a loudness adjustment method and apparatus, a storage medium and an electronic device. The method comprises: on the basis of a first distance and a first azimuth angle between a first device and a second device, and a second distance and a second azimuth angle between the first device and a target user, calculating a third distance between the second device and the target user; and, on the basis of the third distance and the second distance, calculating a playback gain adjustment value which is used for device playback gain regulation and control. The present application improves device loudness equalization effects.

Description

Loudness adjustment method, device, storage medium and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on January 8, 2024, with application number 202410029828.3 and application name “Loudness Adjustment Method, Device, Storage Medium and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of sound playback, and in particular to a loudness adjustment method, device, storage medium, and electronic device. Background Art

[0003] Dual-device usage scenarios are becoming more and more common. Dual-device usage scenarios include co-play scenarios where a first device (such as a TV) and a second device (such as a sound bar) collaboratively play the same audio (usually the audio provided by the first device).

[0004] In a co-broadcast scenario, while the coordinated sound output of the first and second devices can provide a better listening experience, the listener (user) may move within the sound field, resulting in an imbalance in the loudness of the sounds played by the first and second devices, which can lead to poor listening experience. To address this issue, the current conventional approach is to have the listener sit in the optimal listening position and manually adjust the loudness of the two devices to a similar level to achieve loudness balance. Technical issues

[0005] Under the current solution, users may only experience a certain degree of loudness balance near the optimal listening position. Since listeners move dynamically in the sound field, the loudness is still not balanced enough in many positions, affecting the user experience. Technical Solutions

[0006] The embodiment of the present application provides a solution that can effectively improve the device loudness balancing effect in a dual-device co-broadcasting scenario and enhance the user experience.

[0007] The embodiments of this application provide the following technical solutions:

[0008] According to one embodiment of the present application, a loudness adjustment method includes: detecting a first distance and a first azimuth between a first device and a second device, the first device and the second device being in a co-broadcast scenario; detecting a second distance and a second azimuth between the first device and a target user; calculating based on the first distance, the first azimuth, the second distance, and the second azimuth to obtain a third distance between the second device and the target user; and calculating based on the third distance and the second distance to obtain a playback gain adjustment value, the playback gain adjustment value being used to control device playback gain in the co-broadcast scenario.

[0009] In some embodiments of the present application, the method further includes: calculating the difference between the second distance and the third distance to obtain a distance difference; calculating based on the distance difference to obtain a playback delay, and the playback delay is used to control the device playback time in the co-broadcast scenario.

[0010] In some embodiments of the present application, the playback gain adjustment value is the gain adjustment value of the subject to be adjusted; after the playback gain adjustment value is obtained by calculating based on the third distance and the second distance, the method further includes: summing the subject playback gain of the reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; in the co-broadcast scenario, controlling the reference subject to perform audio playback based on the subject playback gain, and controlling the subject to be adjusted to perform audio playback based on the target playback gain, the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0011] In some embodiments of the present application, the playback delay is the delay of the subject to be adjusted; after the playback delay is obtained by calculating based on the distance difference, the method also includes: in the co-broadcast scenario, controlling the reference subject to play the co-broadcast audio, and controlling the subject to be adjusted to play the co-broadcast audio, wherein the audio playback time of the subject to be adjusted is delayed by the playback delay compared to the reference subject, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0012] In some embodiments of the present application, the calculating based on the third distance and the second distance to obtain the playback gain adjustment value includes: calculating the ratio of the third distance to the second distance to obtain a distance ratio; and calculating based on the distance ratio to obtain the playback gain adjustment value.

[0013] In some embodiments of the present application, calculating according to the distance ratio to obtain the playback gain adjustment value includes: calculating according to the formula Δg=20log A to obtain the playback gain adjustment value, wherein A refers to the distance ratio and Δg refers to the playback gain adjustment value.

[0014] In some embodiments of the present application, the calculating based on the distance difference to obtain the playback delay includes: calculating the ratio of the distance difference to the speed of sound to obtain a delay value; and obtaining the playback delay based on the delay value.

[0015] In some embodiments of the present application, obtaining the playback delay based on the delay value includes one of the following methods: using the delay value as the playback delay; multiplying the delay value by a preset adjustment coefficient to obtain the playback delay, wherein the preset adjustment coefficient is the adjustment coefficient corresponding to the device type of the first device and the second device.

[0016] In some embodiments of the present application, the calculation based on the first distance, the first azimuth, the second distance and the second azimuth to obtain the third distance between the second device and the target user includes: according to the formula The third distance is obtained by calculation, wherein D refers to the third distance, h refers to the first distance, d refers to the second distance, α refers to the second azimuth angle, and β refers to the first azimuth angle.

[0017] According to one embodiment of the present application, a loudness adjustment device includes: a first detection module for detecting a first distance and a first azimuth between a first device and a second device, where the first device and the second device are in a co-broadcast scenario; a second detection module for detecting a second distance and a second azimuth between the first device and a target user; a first calculation module for calculating, based on the first distance, the first azimuth, the second distance, and the second azimuth, to obtain a third distance between the second device and the target user; and a second calculation module for calculating, based on the third distance and the second distance, to obtain a playback gain adjustment value, where the playback gain adjustment value is used to control the device playback gain in the co-broadcast scenario.

[0018] In some embodiments of the present application, the device also includes a third calculation module, which is used to: perform difference calculation based on the second distance and the third distance to obtain a distance difference; perform calculation based on the distance difference to obtain a playback delay, and the playback delay is used to control the device playback time in the co-broadcast scenario.

[0019] In some embodiments of the present application, the playback gain adjustment value is the gain adjustment value of the subject to be adjusted; after the playback gain adjustment value is obtained by calculating based on the third distance and the second distance, the device also includes a first control module, which is used to: sum the subject playback gain of the reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; in the co-broadcast scenario, control the reference subject to perform audio playback based on the subject playback gain, and control the subject to be adjusted to perform audio playback based on the target playback gain, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0020] In some embodiments of the present application, the playback delay is the delay of the subject to be adjusted; after the playback delay is obtained by calculating based on the distance difference, the device also includes a second control module, which is used to: in the co-broadcast scenario, control the reference subject to play the co-broadcast audio, and control the subject to be adjusted to play the co-broadcast audio, wherein the audio playback time of the subject to be adjusted is delayed by the playback delay compared with the reference subject, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0021] In some embodiments of the present application, the second calculation module is configured to: calculate a ratio between the third distance and the second distance to obtain a distance ratio; and perform calculation based on the distance ratio to obtain the playback gain adjustment value.

[0022] In some embodiments of the present application, the second calculation module is configured to calculate a playback gain adjustment value according to a formula Δg=20log A, where A refers to the distance ratio and Δg refers to the playback gain adjustment value.

[0023] In some embodiments of the present application, the third calculation module is used to: calculate the ratio of the distance difference to the speed of sound to obtain a delay value; and obtain the playback delay based on the delay value.

[0024] In some embodiments of the present application, the third calculation module is used to implement one of the following methods: using the delay value as the playback delay; multiplying the delay value by a preset adjustment coefficient to obtain the playback delay, wherein the preset adjustment coefficient is the adjustment coefficient corresponding to the device type of the first device and the second device.

[0025] In some embodiments of the present application, the first calculation module is used to: The third distance is obtained by calculation, wherein D refers to the third distance, h refers to the first distance, d refers to the second distance, α refers to the second azimuth angle, and β refers to the first azimuth angle.

[0026] According to another embodiment of the present application, a storage medium stores a computer program thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method described in the embodiment of the present application.

[0027] According to another embodiment of the present application, an electronic device may include: a memory storing a computer program; and a processor reading the computer program stored in the memory to execute the method described in the embodiment of the present application.

[0028] According to another embodiment of the present application, a computer program product or computer program includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations described in the embodiments of the present application. Beneficial effects

[0029] In an embodiment of the present application, a first distance and a first azimuth are detected between a first device and a second device, and the first device and the second device are in a co-broadcast scenario; a second distance and a second azimuth are detected between the first device and a target user; a third distance between the second device and the target user is calculated based on the first distance, the first azimuth, the second distance, and the second azimuth; a playback gain adjustment value is calculated based on the third distance and the second distance, and the playback gain adjustment value is used to control the device playback gain in the co-broadcast scenario.

[0030] In this way, in the co-broadcast scenario of the first device and the second device, the third distance between the second device and the target user is obtained by detecting the first distance, the first azimuth, the second distance and the second azimuth, and a playback gain adjustment value is calculated based on the third distance and the second distance. The device playback gain is regulated in the co-broadcast scenario according to the playback gain adjustment value, so that when the listener moves in the co-broadcast sound field of the first device and the second device, he can always hear the loudness-balanced sound played by the first device and the second device well, which can effectively improve the device loudness balancing effect in the dual-device co-broadcast scenario and enhance the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0032] FIG1 shows a flow chart of a loudness adjustment method according to an embodiment of the present application.

[0033] FIG2 shows a schematic diagram of a loudness adjustment system architecture according to an embodiment of the present application.

[0034] FIG3 shows a schematic diagram of a loudness adjustment system architecture according to an embodiment of the present application.

[0035] FIG4 shows a block diagram of a loudness adjustment device according to an embodiment of the present application.

[0036] FIG5 shows a block diagram of an electronic device according to an embodiment of the present application.

[0037] Implementation Methods of the Application

[0038] The present disclosure will be further described in detail below in conjunction with the accompanying drawings and examples. It should be understood that the examples provided herein are merely for explaining the present disclosure and are not intended to limit the present disclosure. In addition, the examples provided below are partial examples for implementing the present disclosure, rather than providing all examples for implementing the present disclosure. In the absence of conflict, the technical solutions described in the examples of the present disclosure may be implemented in any combination.

[0039] It should be noted that, in the embodiments of the present disclosure, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a method or apparatus comprising a series of elements includes not only the elements explicitly stated, but also other elements not explicitly listed, or also includes elements inherent to the implementation of the method or apparatus. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other related elements (such as steps in the method or units in the apparatus, for example, a unit may be part of a circuit, part of a processor, part of a program or software, etc.) in the method or apparatus comprising the element.

[0040] For example, the loudness adjustment method provided in the embodiments of the present disclosure includes a series of steps, but the loudness adjustment method provided in the embodiments of the present disclosure is not limited to the steps described. Similarly, the loudness adjustment device provided in the embodiments of the present disclosure includes a series of units, but the device provided in the embodiments of the present disclosure is not limited to including the units explicitly described and may also include units required for obtaining relevant information or performing processing based on the information.

[0041] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present disclosure pertains. The terms used herein are for the purpose of describing specific embodiments only and are not intended to limit the present disclosure.

[0042] Figure 1 schematically illustrates a flow chart of a loudness adjustment method according to an embodiment of the present application. The loudness adjustment method can be executed by any device or server with processing capabilities, such as a television, computer, mobile phone, smartwatch, or home appliance, or a server such as a cloud server or a physical server.

[0043] In a specific embodiment of the present application, the loudness adjustment method is performed by a device, which may be one of the first device and the second device, or another device other than the first device and the second device (e.g., a mobile phone held by a user).

[0044] As shown in FIG. 1 , the loudness adjustment method may include steps S110 to S140 .

[0045] Step S110, detecting a first distance and a first azimuth between a first device and a second device, where the first device and the second device are in a co-broadcast scenario; step S120, detecting a second distance and a second azimuth between the first device and a target user; step S130, calculating based on the first distance, the first azimuth, the second distance, and the second azimuth to obtain a third distance between the second device and the target user; step S140, calculating based on the third distance and the second distance to obtain a playback gain adjustment value, where the playback gain adjustment value is used to control the device playback gain in the co-broadcast scenario.

[0046] In a dual-device co-broadcast scenario where the first device and the second device perform co-broadcasting (in the co-broadcasting scenario, the first device and the second device collaboratively play the same audio), relevant detection can be performed on the first device and the second device, and the first distance, the second distance, the first azimuth angle, and the second azimuth angle can be obtained through the detection.

[0047] The first azimuth angle may specifically be the angle between the line connecting the first device and the second device and the line connecting the microphone array elements in the first device. The second azimuth angle may specifically be the angle between the line connecting the target user and the first device and the line connecting the microphone array elements in the first device.

[0048] Referring to Figure 2 , the first azimuth angle between first device 210 and second device 220 can be represented by β in Figure 2 , the second azimuth angle between first device 210 and target user 230 can be represented by α in Figure 2 , and the line connecting the microphone array elements in first device 210 can be represented by line 240 in Figure 2 . The first distance can be represented by h in Figure 2 , and the second distance can be represented by d in Figure 2 .

[0049] Furthermore, a third distance between the second device and the target user may be obtained by calculation based on the first distance, the first azimuth, the second distance, and the second azimuth. The third distance may be shown as D between the second device 220 and the target user 230 in FIG. 2 .

[0050] A playback gain adjustment value is calculated based on the third distance and the second distance. The playback gain adjustment value is used to control the device playback gain in a co-broadcast scenario. Based on the playback gain adjustment value, the playback gain of a certain device can be increased in the co-broadcast scenario so that the user can hear the balanced loudness of the two devices.

[0051] In this way, based on steps S110 to S140, in the co-broadcast scenario of the first device and the second device, the third distance between the second device and the target user is obtained by detecting the first distance, the first azimuth, the second distance and the second azimuth, and a playback gain adjustment value is calculated based on the third distance and the second distance. The device playback gain is regulated in the co-broadcast scenario based on the playback gain adjustment value, so that when the listener moves in the co-broadcast sound field of the first device and the second device, the listener can always hear the loudness-balanced sound played by the first device and the second device well, which can effectively improve the device loudness balancing effect in the dual-device co-broadcast scenario and enhance the user experience.

[0052] The following describes further optional specific embodiments of each step performed when loudness adjustment is performed in the embodiment of FIG. 1 .

[0053] In one embodiment, the detecting of the first distance and the first azimuth angle between the first device and the second device, where the first device and the second device are in a co-broadcast scenario, can specifically include: obtaining the sound signals played by the second device and received by multiple microphones in the first device; and calculating based on the sound signals received by the multiple microphones to obtain the first distance and the first azimuth angle.

[0054] Specifically, the speaker in the second device (which may be a better one among the speakers in the selected second device) is controlled to play the sound signal. At the same time, the sound signal is received by the microphone array in the first device to obtain the sound signals received by multiple microphones in the microphone array.

[0055] Taking a linear microphone array as an example, as shown in Figure 3, the distance between microphone 310 and microphone 320 is d0. The sound signal received by microphone 310 at time t is y1(t), and the sound signal received by microphone 320 at time t is y2(t). The cross-correlation function of y1(t) and y2(t) can be calculated as follows:

[0056] Then the time difference τ when the two microphones receive the sound signal is When taking the maximum value, the value of p is:

[0057] The angle between the line connecting the first device and the second device and the line connecting the microphone array elements in the first device is:

[0058] where c is the speed of sound.

[0059] Furthermore, a hyperbola can be drawn with the difference in distance to microphone 310 and microphone 320 being τc. Repeating the above steps, several sets of hyperbolas can be drawn based on the sound signals received by other sets of microphones. The intersection of these sets of hyperbolas is the location of the second device. Based on the locations of the first and second devices, the first distance h between the first and second devices can be calculated.

[0060] In one embodiment, the second distance and second azimuth angle between the first device and the target user are detected, specifically by: controlling the acquisition of the acoustic signal received by the microphone array in the first device when the speaker in the first device plays the ultrasonic signal; and calculating the second distance and second azimuth angle between the first device and the target user based on the acoustic signal.

[0061] Specifically, a speaker in the first device (which may be a better one selected from multiple speakers in the first device) is controlled to play an ultrasonic signal, and at the same time, a microphone array (multiple microphones) in the first device receives an acoustic signal.

[0062] The received acoustic signal is band-pass filtered (for example, 20kHz to 24kHz band-pass filtered) to obtain a filtered signal; the filtered signal is pre-processed to remove direct sound and reflected sound from stationary objects to obtain a signal to be analyzed.

[0063] The ultrasonic signal being played is multiplied by the signal to be analyzed and then filtered to produce a sinusoidal signal containing distance information. After time-domain beamforming is performed on the sinusoidal signal to improve the signal-to-noise ratio, a distance-angle-of-arrival profile is estimated using the 2D-MUSIC algorithm. The distance-angle-of-arrival profile is then searched to find the location with the highest energy within the profile. This location is the estimated second distance d and second azimuth angle α of the target user relative to the first device at each moment.

[0064] In one embodiment, the calculation based on the first distance, the first azimuth, the second distance, and the second azimuth to obtain the third distance between the second device and the target user may specifically include: according to the formula The third distance is obtained by calculation, wherein D refers to the third distance, h refers to the first distance, d refers to the second distance, α refers to the second azimuth angle, and β refers to the first azimuth angle.

[0065] The applicant found that according to the formula The third distance between the second device and the target user can be accurately calculated, and based on the third distance, an effective playback gain adjustment value can be further accurately calculated, thereby effectively improving the loudness equalization adjustment effect.

[0066] It is understandable that in other embodiments, the third distance between the second device and the target user can be calculated based on other preset formulas according to the first distance, the first azimuth angle, the second distance and the second azimuth angle.

[0067] In one embodiment, the calculating based on the third distance and the second distance to obtain the playback gain adjustment value may include: calculating a ratio of the third distance to the second distance to obtain a distance ratio; and calculating based on the distance ratio to obtain the playback gain adjustment value.

[0068] Furthermore, the calculating according to the distance ratio to obtain the playback gain adjustment value may specifically include: calculating according to a formula Δg=20log A to obtain the playback gain adjustment value, wherein A refers to the distance ratio, and Δg refers to the playback gain adjustment value.

[0069] If A = D / d, where D is the third distance and d is the second distance, then the playback gain adjustment value Δg is the gain adjustment value of the second device, meaning that the second device is the subject to be adjusted. If A = d / D, then the playback gain adjustment value Δg is the gain adjustment value of the first device, meaning that the first device is the subject to be adjusted.

[0070] The applicant has found that the loudness equalization adjustment effect can be very effectively improved by calculating the playback gain adjustment value according to the formula Δg=20log A and performing playback gain control based on the playback gain adjustment value.

[0071] In one embodiment, the playback gain adjustment value is the gain adjustment value of the subject to be adjusted; after the playback gain adjustment value is obtained by calculating based on the third distance and the second distance, the method further includes: summing the subject playback gain of the reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; in the co-broadcast scenario, controlling the reference subject to perform audio playback based on the subject playback gain, and controlling the subject to be adjusted to perform audio playback based on the target playback gain, the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0072] One of the first device and the second device is selected as the reference subject, and the other is selected as the subject to be adjusted. A playback gain adjustment value corresponding to the subject to be adjusted is obtained by calculating based on the third distance and the second distance.

[0073] According to the formula g2=g1+Δg, the subject playback gain g1 of the reference subject (ie, the playback gain of the reference subject) and the playback gain adjustment value Δg can be summed to obtain the target playback gain g2 of the subject to be adjusted.

[0074] In the co-broadcast scenario, the reference subject can be controlled to play audio based on the subject playback gain, and the subject to be adjusted can be controlled to play audio based on the target playback gain, so that the user can hear a co-broadcast effect with extremely balanced loudness.

[0075] In one embodiment, the method further includes: calculating the difference between the second distance and the third distance to obtain a distance difference; calculating based on the distance difference to obtain a playback delay, and the playback delay is used to control the device playback time in the co-broadcast scenario.

[0076] By calculating the difference between the second distance and the third distance, a distance difference value can be calculated, and the playback delay can be calculated based on the distance difference value. In one example, a distance difference value Δd can be obtained by subtracting the third distance from the second distance.

[0077] A playback delay is calculated based on the distance difference, and the playback delay is used to control the device playback time in the co-broadcast scenario. By controlling the device playback time in the co-broadcast scenario based on the playback delay, the listener (i.e., the target user) can always hear the sound played synchronously by the first device and the second device at the same time when moving in the sound field of the combination of the first device and the second device, further assisting in improving the loudness equalization effect and further improving the loudness control effect.

[0078] Furthermore, the calculating according to the distance difference to obtain the playback delay may specifically include: calculating the ratio of the distance difference to the speed of sound to obtain a delay value; and obtaining the playback delay according to the delay value.

[0079] The formula used to calculate the ratio of the distance difference Δd to the speed of sound C yields the delay value. This delay value can then be used to determine the playback delay. By adjusting the device playback time based on this delay, the listener (i.e., the target user) can consistently hear the synchronized sound from both the first and second devices as they move through the combined sound field of the first and second devices.

[0080] Furthermore, obtaining the playback delay based on the delay value includes one of the following methods: first, using the delay value as the playback delay; second, multiplying the delay value by a preset adjustment coefficient to obtain the playback delay, wherein the preset adjustment coefficient is the adjustment coefficient corresponding to the device type of the first device and the second device.

[0081] In the first method, the delay value is used as the playback delay, which can effectively ensure the device playback time control effect; in the second method, the delay value is multiplied by the preset adjustment coefficient according to the device type (specifically, the device model) of the first device and the second device to obtain the playback delay, which can further improve the device playback time control effect.

[0082] Furthermore, the playback delay is the delay of the subject to be adjusted; after the playback delay is obtained by calculating based on the distance difference, the method may also include: in the co-broadcast scenario, controlling the reference subject audio to play the co-broadcast audio, and controlling the subject to be adjusted to play the co-broadcast audio, wherein the audio playback time of the subject to be adjusted is delayed by the playback delay compared to the reference subject, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0083] The playback delay is the delay of the subject to be adjusted. Taking the subject to be adjusted as the second device as an example, the second distance d minus the third distance D can be used to obtain a distance difference Δd to calculate the playback delay, which is the playback delay corresponding to the second device; conversely, taking the subject to be adjusted as the first device as an example, the third distance D minus the second distance d can be used to obtain a distance difference Δd to calculate the playback delay, which is the playback delay corresponding to the first device.

[0084] In the co-broadcast scenario, the reference subject can be controlled to play the co-broadcast audio, and the subject to be adjusted can be controlled to play the co-broadcast audio according to the formula s2(t)=s1(t+Δt), so that the audio playback time of the subject to be adjusted is delayed by a playback delay Δt compared with the reference subject. The reference subject and the subject to be adjusted are respectively one of the first device and the second device, s1(t) is the co-broadcast audio played by the reference subject, and s2(t) is the co-broadcast audio played by the subject to be adjusted.

[0085] To facilitate better implementation of the loudness adjustment method provided in the embodiments of the present application, the embodiments of the present application also provide a loudness adjustment device based on the aforementioned loudness adjustment method. The meanings of the terms herein are the same as those in the aforementioned loudness adjustment method. For specific implementation details, please refer to the description in the method embodiments. Figure 4 shows a block diagram of a loudness adjustment device according to one embodiment of the present application.

[0086] As shown in FIG4 , the loudness adjustment device 400 may include: a first detection module 410 for detecting a first distance and a first azimuth between a first device and a second device, where the first device and the second device are in a co-broadcast scenario; a second detection module 420 for detecting a second distance and a second azimuth between the first device and a target user; a first calculation module 430 for calculating, based on the first distance, the first azimuth, the second distance, and the second azimuth, a third distance between the second device and the target user; and a second calculation module 440 for calculating, based on the third distance and the second distance, a playback gain adjustment value, where the playback gain adjustment value is used to control the playback gain of the device in the co-broadcast scenario.

[0087] In some embodiments of the present application, the device also includes a third calculation module, which is used to: perform difference calculation based on the second distance and the third distance to obtain a distance difference; perform calculation based on the distance difference to obtain a playback delay, and the playback delay is used to control the device playback time in the co-broadcast scenario.

[0088] In some embodiments of the present application, the playback gain adjustment value is the gain adjustment value of the subject to be adjusted; after the playback gain adjustment value is obtained by calculating based on the third distance and the second distance, the device also includes a first control module, which is used to: sum the subject playback gain of the reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; in the co-broadcast scenario, control the reference subject to perform audio playback based on the subject playback gain, and control the subject to be adjusted to perform audio playback based on the target playback gain, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0089] In some embodiments of the present application, the playback delay is the delay of the subject to be adjusted; after the playback delay is obtained by calculating based on the distance difference, the device also includes a second control module, which is used to: in the co-broadcast scenario, control the reference subject to play the co-broadcast audio, and control the subject to be adjusted to play the co-broadcast audio, wherein the audio playback time of the subject to be adjusted is delayed by the playback delay compared with the reference subject, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0090] In some embodiments of the present application, the second calculation module is configured to: calculate a ratio between the third distance and the second distance to obtain a distance ratio; and perform calculation based on the distance ratio to obtain the playback gain adjustment value.

[0091] In some embodiments of the present application, the second calculation module is configured to calculate a playback gain adjustment value according to a formula Δg=20log A, where A refers to the distance ratio and Δg refers to the playback gain adjustment value.

[0092] In some embodiments of the present application, the third calculation module is used to: calculate the ratio of the distance difference to the speed of sound to obtain a delay value; and obtain the playback delay based on the delay value.

[0093] In some embodiments of the present application, the third calculation module is used to implement one of the following methods: using the delay value as the playback delay; multiplying the delay value by a preset adjustment coefficient to obtain the playback delay, wherein the preset adjustment coefficient is the adjustment coefficient corresponding to the device type of the first device and the second device.

[0094] In some embodiments of the present application, the first calculation module is used to: The third distance is obtained by calculation, wherein D refers to the third distance, h refers to the first distance, d refers to the second distance, α refers to the second azimuth angle, and β refers to the first azimuth angle.

[0095] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the application, the features and functions of two or more modules or units described above can be concretized in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0096] In addition, an embodiment of the present application further provides an electronic device, as shown in FIG5 . FIG5 shows a block diagram of an electronic device according to an embodiment of the present application. Specifically:

[0097] The electronic device may include components such as a processor 501 with one or more processing cores, a memory 502 with one or more computer-readable storage media, a power supply 503, and an input unit 504. Those skilled in the art will appreciate that the electronic device structure shown in FIG5 does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0098] Processor 501 is the control center of the electronic device. It utilizes various interfaces and circuits to connect the various components of the entire computer device. By running or executing software programs and / or modules stored in memory 502 and accessing data stored in memory 502, it performs various computer device functions and processes data, thereby providing overall monitoring of the electronic device. Optionally, processor 501 may include one or more processing cores; preferably, processor 501 may integrate an application processor and a modem processor, wherein the application processor primarily processes the operating system, user interfaces, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 501.

[0099] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and data processing by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.

[0100] The electronic device also includes a power supply 503 for supplying power to various components. Preferably, the power supply 503 can be logically connected to the processor 501 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 503 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0101] The electronic device may further include an input unit 504, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0102] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 501 in the electronic device will load the executable files corresponding to one or more computer program processes into the memory 502 according to the following instructions, and the processor 501 will run the computer program stored in the memory 502, thereby realizing the various functions of the aforementioned embodiments of the present application. For example, the processor 501 may perform the following steps:

[0103] Detect a first distance and a first azimuth between a first device and a second device, where the first device and the second device are in a co-broadcast scenario; detect a second distance and a second azimuth between the first device and a target user; calculate based on the first distance, the first azimuth, the second distance, and the second azimuth to obtain a third distance between the second device and the target user; calculate based on the third distance and the second distance to obtain a playback gain adjustment value, where the playback gain adjustment value is used to control the device playback gain in the co-broadcast scenario.

[0104] In some embodiments of the present application, it also includes: performing a difference calculation based on the second distance and the third distance to obtain a distance difference; performing a calculation based on the distance difference to obtain a playback delay, and the playback delay is used to control the device playback time in the co-broadcast scenario.

[0105] In some embodiments of the present application, the playback gain adjustment value is the gain adjustment value of the subject to be adjusted; after the calculation based on the third distance and the second distance to obtain the playback gain adjustment value, it also includes: summing the subject playback gain of the reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; in the co-broadcast scenario, controlling the reference subject to perform audio playback based on the subject playback gain, and controlling the subject to be adjusted to perform audio playback based on the target playback gain, the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0106] In some embodiments of the present application, the playback delay is the delay of the subject to be adjusted; after the playback delay is obtained by calculating based on the distance difference, it also includes: in the co-broadcast scenario, controlling the reference subject to play the co-broadcast audio, and controlling the subject to be adjusted to play the co-broadcast audio, wherein the audio playback time of the subject to be adjusted is delayed by the playback delay compared to the reference subject, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

[0107] In some embodiments of the present application, the calculating based on the third distance and the second distance to obtain the playback gain adjustment value includes: calculating the ratio of the third distance to the second distance to obtain a distance ratio; and calculating based on the distance ratio to obtain the playback gain adjustment value.

[0108] In some embodiments of the present application, calculating according to the distance ratio to obtain the playback gain adjustment value includes: calculating according to the formula Δg=20log A to obtain the playback gain adjustment value, wherein A refers to the distance ratio and Δg refers to the playback gain adjustment value.

[0109] In some embodiments of the present application, the calculating based on the distance difference to obtain the playback delay includes: calculating the ratio of the distance difference to the speed of sound to obtain a delay value; and obtaining the playback delay based on the delay value.

[0110] In some embodiments of the present application, obtaining the playback delay based on the delay value includes one of the following methods: using the delay value as the playback delay; multiplying the delay value by a preset adjustment coefficient to obtain the playback delay, wherein the preset adjustment coefficient is the adjustment coefficient corresponding to the device type of the first device and the second device.

[0111] In some embodiments of the present application, the calculation based on the first distance, the first azimuth, the second distance and the second azimuth to obtain the third distance between the second device and the target user includes: according to the formula The third distance is obtained by calculation, wherein D refers to the third distance, h refers to the first distance, d refers to the second distance, α refers to the second azimuth angle, and β refers to the first azimuth angle.

[0112] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0113] To this end, an embodiment of the present application further provides a storage medium storing a computer program, which can be loaded by a processor to execute the steps of any method provided in the embodiment of the present application.

[0114] The storage medium may be a computer-readable storage medium, and the storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0115] Since the computer program stored in the storage medium can execute the steps of any method provided in the embodiments of the present application, the beneficial effects that can be achieved by the method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0116] Those skilled in the art will readily conceive of other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of this application and include common knowledge or customary techniques in the art that are not disclosed herein.

[0117] It should be understood that the present application is not limited to the embodiments that have been described above and shown in the accompanying drawings, but various modifications and changes may be made without departing from the scope thereof.

Claims

1. A loudness adjustment method, wherein, Including: Detecting a first distance and a first azimuth angle between a first device and a second device, where the first device and the second device are in a co-broadcast scenario; Detecting a second distance and a second azimuth angle between the first device and a target user; Calculating based on the first distance, the first azimuth angle, the second distance, and the second azimuth angle to obtain a third distance between the second device and the target user; Calculating based on the third distance and the second distance to obtain a playback gain adjustment value, where the playback gain adjustment value is used to adjust the device playback gain in the co-broadcast scenario.

2. The method according to claim 1, wherein, The method further includes: Performing a difference calculation based on the second distance and the third distance to obtain a distance difference; Calculating based on the distance difference to obtain a playback delay, where the playback delay is used to adjust the device playback time in the co-broadcast scenario.

3. The method according to claim 1, wherein, The playback gain adjustment value is the gain adjustment value of the subject to be adjusted; After calculating the playback gain adjustment value based on the third distance and the second distance, the method further includes: Performing a summation calculation on the subject playback gain of a reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; In the co-broadcast scenario, controlling the reference subject to play audio based on the subject playback gain, and controlling the subject to be adjusted to play audio based on the target playback gain, where the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

4. The method according to claim 2, wherein, The playback delay is the delay of the subject to be adjusted; After calculating the playback delay based on the distance difference, the method further includes: In the co-broadcast scenario, controlling the reference subject to play co-broadcast audio, and Controlling the subject to be adjusted to play the co-broadcast audio, where the audio playback time of the subject to be adjusted is delayed by the playback delay compared to the reference subject, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

5. The method according to claim 1, wherein Calculating the playback gain adjustment value based on the third distance and the second distance includes: Performing a ratio calculation on the third distance and the second distance to obtain a distance ratio; Calculating based on the distance ratio to obtain the playback gain adjustment value.

6. The method according to claim 5, wherein Calculating the playback gain adjustment value based on the distance ratio includes: Calculating the playback gain adjustment value according to the formula Δg = 20log A, where A refers to the distance ratio and Δg refers to the playback gain adjustment value.

7. The method according to claim 2, wherein Calculating the playback delay based on the distance difference includes: Calculating the ratio of the distance difference to the speed of sound to obtain a delay value; Obtaining the playback delay based on the delay value.

8. The method according to claim 7, wherein Obtaining the playback delay based on the delay value includes one of the following methods: Using the delay value as the playback delay; Multiplying the delay value by a preset adjustment coefficient to obtain the playback delay, where the preset adjustment coefficient is the adjustment coefficient corresponding to the device types of the first device and the second device.

9. The method according to claim 1, wherein Calculating according to the first distance, the first azimuth angle, the second distance, and the second azimuth angle to obtain a third distance between the second device and the target user, including: According to the formula Calculating to obtain the third distance, where D represents the third distance, h represents the first distance, d represents the second distance, α represents the second azimuth angle, and β represents the first azimuth angle.

10. The method according to claim 1, wherein Detecting a first distance and a first azimuth angle between a first device and a second device, including: Obtaining sound signals played by the second device received by a plurality of microphones in the first device; Calculating according to the sound signals received by the plurality of microphones to obtain the first distance and the first azimuth angle.

11. The method according to claim 10, wherein, Calculating according to the sound signals received by the plurality of microphones to obtain the first distance and the first azimuth angle, including: Calculating a cross-correlation function corresponding to each pair of the plurality of microphones according to the sound signals received by each pair of the plurality of microphones; Obtaining a time difference between the sound signals received by each pair of the plurality of microphones according to the cross-correlation function corresponding to each pair of the plurality of microphones; According to the formula Calculating to obtain a first azimuth angle, where τ is the time difference between the sound signals received by each pair of the plurality of microphones, c is the speed of sound, d0 is the distance between each pair of the plurality of microphones, and β is the first azimuth angle; Drawing hyperbolas with the difference in distances to each pair of the plurality of microphones being τc to obtain several sets of hyperbolas; Obtaining the position of the second device according to the intersection points of the several sets of hyperbolas, and calculating a first distance between the first device and the second device according to the position of the first device and the position of the second device.

12. The method according to claim 1, wherein, Detecting a second distance and a second azimuth angle between the first device and a target user, including: Obtaining an acoustic signal received by a microphone array in the first device when the first device plays an ultrasonic signal; Calculating according to the acoustic signal to obtain a second distance and a second azimuth angle between the first device and the target user.

13. The method according to claim 12, wherein, Calculating according to the acoustic signal to obtain a second distance and a second azimuth angle between the first device and the target user, including: Performing band-pass filtering on the acoustic signal to obtain a filtered signal; Performing preprocessing on the filtered signal to remove direct sound and reflected sound from stationary objects to obtain a signal to be analyzed; Multiplying the ultrasonic signal and the signal to be analyzed and then performing shaping filtering to obtain a sine wave signal containing distance information; Performing time-domain beamforming on the sine wave signal to improve the signal-to-noise ratio, and then using a 2D-MUSIC algorithm to estimate a distance-angle-of-arrival profile; Obtaining a second distance and a second azimuth angle of the target user relative to the first device according to the position with the maximum energy in the distance-angle-of-arrival profile.

14. A loudness adjustment device, wherein, Including: A first detection module for detecting a first distance and a first azimuth angle between a first device and a second device, where the first device and the second device are in a co-broadcast scenario; A second detection module for detecting a second distance and a second azimuth angle between the first device and a target user; A first calculation module, configured to calculate according to the first distance, the first azimuth angle, the second distance, and the second azimuth angle to obtain a third distance between the second device and the target user; A second calculation module, configured to calculate according to the third distance and the second distance to obtain a playback gain adjustment value, and the playback gain adjustment value is used to regulate the device playback gain in the co-play scenario.

15. The apparatus according to claim 14, wherein, The device further includes a third calculation module, configured to: perform a difference calculation according to the second distance and the third distance to obtain a distance difference; calculate according to the distance difference to obtain a playback delay, and the playback delay is used to regulate the device playback time in the co-play scenario.

16. The apparatus according to claim 14, wherein, The playback gain adjustment value is the gain adjustment value of the subject to be adjusted; after calculating the playback gain adjustment value according to the third distance and the second distance, the device further includes a first regulation module, configured to: perform a summation calculation on the subject playback gain of the reference subject and the playback gain adjustment value to obtain the target playback gain of the subject to be adjusted; In the co-play scenario, control the reference subject to perform audio playback based on the subject playback gain, and control the subject to be adjusted to perform audio playback based on the target playback gain, where the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

17. The apparatus according to claim 16, wherein The playback delay is the delay of the subject to be adjusted; after calculating the playback delay according to the distance difference, the device further includes a second regulation module, configured to: in the co-play scenario, control the reference subject to play the co-play audio, and control the subject to be adjusted to play the co-play audio, where the audio playback time of the subject to be adjusted lags behind the reference subject by the playback delay, and the reference subject and the subject to be adjusted are respectively one of the first device and the second device.

18. The apparatus according to claim 14, wherein The second calculation module is configured to: perform a ratio calculation on the third distance and the second distance to obtain a distance ratio; calculate according to the distance ratio to obtain the playback gain adjustment value.

19. A storage medium, wherein, A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 13.

20. An electronic device, wherein, Including: A memory storing a computer program; A processor that reads the computer program stored in the memory to execute the method according to any one of claims 1 to 13.

Images