SOUND BOX POSITIONING METHOD, AUDIO RENDERING METHOD AND DEVICE - Patent application

The sound box positioning method and audio rendering method improve indoor audio systems by rotating sound boxes to maximize audio volume, addressing acoustics issues and enhancing sound quality in indoor environments.

JP7590553B2Active Publication Date: 2024-11-26HUAWEI TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023515026
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-09-04
Filing Date
2021-09-02
Publication Date
2024-11-26
Estimated Expiration
2041-09-02

AI Technical Summary

Technical Problem

Existing methods for simulating a movie theater-like audio space in indoor environments, such as 5.1 or 5.1.2 home theater systems or stereo playback systems, fail to achieve good acoustics due to limitations in cross-talk cancellation and sound wave directionality.

Method used

A sound box positioning method and audio rendering method that involves rotating sound boxes from a first position to a second position while playing positioning audio, adjusting their position based on maximum audio volume detection to enhance crosstalk cancellation and sound image effect.

Benefits of technology

Accurately positions sound boxes to enhance sound image effects and restore the original acoustic experience by eliminating room interference and improving sound quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590553000043
    Figure 0007590553000043
  • Figure 0007590553000044
    Figure 0007590553000044
  • Figure 0007590553000045
    Figure 0007590553000045
Patent Text Reader

Abstract

This application provides a sound box positioning method, an audio rendering method, and an audio rendering device. The sound box positioning method includes the steps of: an electronic device transmitting a first playback command to a sound box, the first playback command being used to instruct the sound box to rotate in a predetermined direction from a first position to a second position and play positioning audio during the rotation, the volume of the positioning audio being stable and unchanged during the playback; an electronic device receiving the positioning audio; and an electronic device determining instruction information based on the positioning audio, the instruction information being used to determine a target position of the sound box, the target position being a position of the sound box corresponding to when the volume of the received audio is maximum during the process of receiving the positioning audio by the electronic device, the target position being a position of the sound box during the process of rotating from the first position to the second position; and an electronic device transmitting the instruction information to the sound box. This application achieves more accurate crosstalk cancellation, eliminates the effects of different rooms, enhances the sound image effect, and truly restores the original sound effect.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present application relates to the field of audio processing technology, and in particular to a sound box positioning method, an audio rendering method and an apparatus. [Background technology]

[0002] In indoor usage scenarios, people can deploy a 5.1 or 5.1.2 home theater system or use a stereo playback system such as a soundbar to get a cinema-like sense of sound image space.

[0003] In order to simulate the sensation of a real sound image space, the first step is to design the user's sweet spot. The sweet spot refers to the optimal listening position. There are generally two sweet spot design methods. One is a method that performs cross-talk cancellation by virtualizing a surround sound box based on the head-related transfer function and the room response. The other is a method that achieves a surround feeling by controlling a speaker array to form directional sound waves, and then performing beam forming by transmitting the sound waves to the human ear from a certain angle using a reflector such as a wall.

[0004] However, neither of the two methods can achieve good acoustic effect in indoor usage scenarios. Summary of the Invention [Means for solving the problem]

[0005] The present application provides a sound box position adjustment method, an audio rendering method and an apparatus, which implements more accurate crosstalk cancellation, eliminates the effects of different rooms, enhances the sound image effect, and truly restores the original sound effect.

[0006] According to a first aspect, the present application provides a sound box position adjustment method, including: a step of an electronic device sending a first playback command to a sound box, where the first playback command is used to instruct the sound box to rotate in a preset direction from a first position to a second position and play a positioning audio in the process of rotation, and when the positioning audio is being played, a volume of the positioning audio is stable and does not change; a step of an electronic device receiving the positioning audio; a step of an electronic device determining instruction information based on the positioning audio, where the instruction information is used to determine a target position of the sound box, the target position being a position of the sound box corresponding to when the volume of the received audio is maximum in the process of receiving the positioning audio by the electronic device, and the target position being a position in the process of the sound box rotating from the first position to the second position; and a step of an electronic device sending the instruction information to the sound box.

[0007] Correspondingly, the sound box receives a first playback command from the electronic device, the sound box rotates in a predetermined direction from a first position to a second position based on the first playback command and plays positioning audio during the rotation process, and the volume of the positioning audio when being played is stable and does not change, the sound box receives instruction information from the electronic device, the instruction information is used to determine a target position, the target position is a position of the sound box when the volume of the received audio is maximum during the process of receiving the positioning audio by the electronic device, the target position is a position during the process of the sound box rotating from the first position to the second position, and the sound box rotates from the second position to the target position based on the instruction information.

[0008] Optionally, the angular difference between the first position and the second position is related to the inter-aural distance of the user, or the angular difference between the first position and the second position is related to a preset fine adjustment range.

[0009] Optionally, the instruction information further instructs the sound box to rotate from the second position to the target position.

[0010] Optionally, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0011] Optionally, the rotation includes rotating at a constant speed around a vertical sound box rotation axis. The vertical sound box rotation axis may be a vertical axis that fixes the sound box, and the sound box may rotate horizontally clockwise or counterclockwise around the axis, or rotate horizontally clockwise or counterclockwise under the drive of the axis. Optionally, the vertical sound box rotation axis may be an axis that passes through the center of the sound box, or an axis whose extension passes through the center of the sound box. For example, the center of the sound box refers to the geometric center of the sound box.

[0012] Optionally, the shape of the sound box includes a bar shape, a square shape, or a ring shape.

[0013] The sound box position adjustment method in the present application may also be applicable to position adjustment of equipment having a speaker, that is, the sound box in the present application may be understood as a loudspeaker equipment having a speaker.

[0014] Before the sound box position adjustment method starts, the user must first turn on the application installed in the electronic device. (A The sweet spot positioning command can be sent by using an interactive interface provided by the Sound Box Positioning System (PP). Based on the command, the electronic device starts to execute the steps of the sound box positioning method, and firstly, sends a first playback command to the sound bar. The first playback command is used to instruct the sound bar to rotate at a constant speed from a first position to a second position and play a positioning audio during the rotation.

[0015] The positioning audio is a full-band audio that meets a specified condition. For example, the positioning audio may be a full-band audio with a sound pressure level of 65 dB or more and a signal-to-noise ratio of 20 dB or more, including white noise, pink noise, or a sweep signal. Optionally, the energy of each frame of the positioning audio is the same. The volume of the positioning audio when played is stable and unchanging may be understood as meaning that the energy of each audio frame does not change when the positioning audio is played, and the playback parameters of the sound box also need to remain unchanged, so that the playback energy remains unchanged when the sound box plays the audio. Optionally, the positioning audio may be audio pre-stored in the sound box, may be audio defined by a user, or may be audio sent to the sound box by an electronic device. The method for obtaining the positioning audio by the sound box is not particularly limited in this application.

[0016] Optionally, for ease of understanding, as shown in FIG. 12l, the position of the sound bar may be represented by a first included angle a between the sound bar and a vertical plane, where the vertical plane may refer to, for example, a wall near the sound bar or on which the sound bar is installed. When the sound bar is parallel to the vertical plane, the angle of the first included angle is 0°. When the sound bar rotates counterclockwise from an angle 0°, and the sound bar rotates to be perpendicular to the vertical plane, the angle of the first included angle is 90°, and the angle of the first included angle changes from 0° to 90° during the course of the rotation. When the sound bar rotates clockwise from an angle 0°, and the sound bar rotates to be perpendicular to the vertical plane, the angle of the first included angle is -90°, and the angle of the first included angle changes from 0° to -90° during the course of the rotation. It can be seen that when the opening of the first included angle faces to the left, the angle value of the first included angle is positive, and when the opening of the first included angle faces to the right, the angle value of the first included angle is negative.

[0017] Optionally, for ease of understanding, as shown in FIG. 12m, the position of the sound bar may alternatively be represented by a second included angle b between the vertical line of the center of the sound bar and the vertical line of the vertical plane. When the sound bar is parallel to the vertical plane, the vertical line of the center of the sound bar is parallel to or coincides with the vertical line of the vertical plane. In this case, the angle of the second included angle is 0°. When the sound bar rotates counterclockwise from an angle of 0°, and the sound bar rotates so that it is perpendicular to the vertical plane, the vertical line of the center of the sound bar and the vertical line of the vertical plane become perpendicular to each other. In this case, the angle of the second included angle is 90°, and the angle of the second included angle changes from 0° to 90° during the course of the rotation. When the sound bar rotates clockwise from an angle of 0°, and the sound bar rotates so that it is perpendicular to the vertical plane, the vertical line of the center of the sound bar and the vertical line of the vertical plane become perpendicular to each other. In this case, the angle of the second included angle is -90°, and the angle of the second included angle changes from 0° to -90° during the course of rotation. It can be seen that when the vertical line of the center of the sound bar is located to the right of the vertical line of the vertical plane, the angle value of the second included angle is positive, and when the vertical line of the center of the sound bar is located to the left of the vertical line of the vertical plane, the angle value of the second included angle is negative.

[0018] Thus, the first position and the second position may both be represented by angle values ​​of the first angle or the second angle, and the sound bar rotating at a constant speed from the first position to the second position may be described as the sound bar rotating at a constant speed from the first angle to the second angle, where the first angle and the second angle are each two angle values ​​of a first included angle, or the first angle and the second angle are each two angle values ​​of a second included angle.

[0019] In one possible embodiment, before sending the first playback command to the soundbar, the electronics can first obtain an initial position of the center of the soundbar and a user's position, calculate a theoretical sweet spot of the soundbar relative to the user based on the initial position and the user's position, obtain a fine-tuning angle, and then obtain a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0020] When the soundbar is located in the theoretical sweet spot, the connecting line between the user's position and the center of the soundbar is perpendicular to the loudspeaker surface of the soundbar, which faces the user. The loudspeaker surface of the soundbar is the surface on which the loudspeakers of the soundbar are located. Typically, the loudspeakers are located on a surface of the soundbox. In this case, the loudspeaker surface is that surface. Alternatively, the loudspeakers of the soundbox are located on multiple surfaces of the soundbox. In this case, the loudspeaker surface is the surface of the soundbox that faces the user.

[0021] The first position is a position where the sound bar is rotated from the theoretical sweet spot by a fine-tuning angle in a preset direction, and the second position is a position where the sound bar is rotated from the theoretical sweet spot by a fine-tuning angle in the opposite direction to the preset direction.

[0022] In the present application, an interactive interface provided by the APP (for example, a room configuration interface that may be described in FIG. 11 below) may be used. The user inputs a first virtual position into the interface, and the first virtual position is used to simulate the position of the center of the sound bar in the room, and an initial position of the center of the sound bar may be calculated based on the first virtual position. The initial position may be expressed in the form of coordinates. Alternatively, the user may input a second virtual position into the interactive interface. The second virtual position is used to simulate the position of the user in the room. The position of the user may be calculated based on the second virtual position, and the position of the user may be expressed in the form of coordinates.

[0023] The theoretical sweet spot of the soundbar can be obtained according to the following formulas (1) to (3):

number

number

[0024] However, since the user's position is inputted into the interactive interface by the user, there may be an error between the position and the user's actual position, so the position of the sound bar needs to be fine-tuned based on the theoretical sweet spot to determine the accurate target position.

[0025] One side of the included angle corresponding to the fine-tuning angle θ is the connecting line between the user's position and the center of the sound bar. The fine-tuning angle θ is calculated according to equation (4):

number

[0026] Optionally, the fine-tuning angle θ may be directly input by a user in an interactive interface (eg, a precision sweet-spot positioning interface).

[0027] Optionally, the first angle corresponding to the first position may be A-θ and the second angle corresponding to the second position may be A+θ, or the first angle corresponding to the first position may be A+θ and the second angle corresponding to the second position may be A-θ.

[0028] In one possible embodiment, if the initial position of the center of the sound bar and the user's position meet the objective that the connecting line between the center of the sound bar and the user's position is perpendicular to the sound bar, there is no need to perform sweet spot positioning. Therefore, before sweet spot positioning, it may be determined whether sweet spot positioning is required based on the principle, the initial position of the center of the sound bar, and the user's position. If sweet spot positioning is required, the process of sweet spot positioning begins.

[0029] After receiving the first playback command, the soundbar obtains the first position and the second position from the first playback command, and plays positioning audio, e.g., a pre-recorded rain sound, while rotating in a preset rotation direction, e.g., from A-θ to A+θ or from A+θ to A-θ.

[0030] The soundbar rotates while playing positioning audio. Therefore, there may be a volume difference between the positioning audio received by the microphone of the electronic device. That is, when the position where the soundbar rotates is far away from the electronic device, the volume of the positioning audio received by the electronic device decreases, while when the position where the soundbar rotates is close to the electronic device, the volume of the positioning audio received by the electronic device increases. The purpose of the fine tuning is to find the position of the soundbar that corresponds to when the volume of the positioning audio received by the electronic device is maximum. Since the volume is detected by the user's electronic device, it may be considered that the sweet spot of the soundbar is exactly at the user's position when the soundbar is at that position.

[0031] In one possible embodiment, the electronic device can detect the positioning audio received at a specified frequency from the start time of receiving the positioning audio to obtain the volume. When the end time of receiving the positioning audio arrives, the electronic device determines the difference between the time corresponding to the maximum volume among the multiple obtained volumes and the start time of receiving the positioning audio as the target time. The electronic device can synchronize the reception of the positioning audio with the detection of the volume.

[0032] In one possible implementation, the electronic device can detect the positioning audio to obtain the maximum volume, and then determine the difference between the time point corresponding to the maximum volume and the start time point of receiving the positioning audio as the target time. Alternatively, the electronic device can detect the positioning audio for the entire section after receiving all the positioning audio.

[0033] Optionally, when the soundbar plays the positioning audio, if the volume of the positioning audio changes, the electronic device may compare the energy of the received positioning audio with the energy of the pre-stored positioning audio, i.e., compare the energy of the i-th frame of the received positioning audio with the energy of the i-th frame of the pre-stored positioning audio, where i=0, 1, . . . m-1, where m represents the total number of frames of the positioning audio, and then determine the time point corresponding to the frame with the largest energy difference as the target time.

[0034] The angle value corresponding to the target position of the soundbar can be calculated based on the following formula:

[0035] If the first angle is A-θ and the second angle is A+θ, the angle value B corresponding to the target position is calculated according to equation (5): B = (A - θ) + vt (5)

[0036] When the positioning audio playback is finished, the soundbar rotates to a second position (corresponding second angle is A+θ). Therefore, the soundbar needs to rotate in the reverse direction from the second position to the target position (corresponding angle is B), i.e., from angle A+θ to angle B. Based on the above formula, the angle that the soundbar needs to rotate can be calculated as β=2θ-vt.

[0037] If the first angle is A+θ and the second angle is A−θ, then the angle value B corresponding to the target position is calculated according to equation (6): B = (A - θ) - vt (6) Here, v represents the rotation speed of the sound bar, which may be preset, and t represents the target time.

[0038] When the positioning audio playback is finished, the soundbar rotates to a second position (corresponding second angle is A-θ). Therefore, the soundbar needs to rotate in the reverse direction from the second position to the target position (corresponding angle is B), i.e., from angle A-θ to angle B. According to equation (6), the angle that the soundbar needs to rotate can be calculated as β=2θ-vt.

[0039] It can be seen that based on the target time obtained using the above method, the electronic device can determine the indication information in several ways as follows, and then the sound bar can obtain the angle β=2θ-vt that the sound bar needs to rotate based on the indication information.

[0040] (1) The electronic device determines a target time as instruction information.

[0041] The fine-tuning angle θ in the above formula may be obtained from information previously exchanged with the electronic device, and the details will not be described again in this specification. The rotation speed may be preset. The target time may be obtained from the instruction information. The rotation direction may also be preset. Therefore, the sound bar can calculate the angle β that the sound bar needs to rotate based on these information.

[0042] (2) The electronic device determines a target time and a direction opposite to a preset direction as instruction information.

[0043] The fine-tuning angle θ in the above formula may be obtained from information previously exchanged with the electronic device, and the details will not be described again in this specification. The rotation speed may be preset. The target time and the rotation direction (the opposite direction to the preset direction) may be obtained from the instruction information. Therefore, the sound bar can calculate the angle β that the sound bar needs to rotate based on these information.

[0044] (3) The electronic device determines a target time, a direction opposite to a preset direction, and a fine adjustment angle as instruction information.

[0045] The fine-tuning angle θ and the target time in the above formula, as well as the rotation direction (opposite to the preset direction) may all be obtained from the instruction information. The rotation speed may be preset. Therefore, the sound bar can calculate the angle β that the sound bar needs to rotate based on these information.

[0046] (4) The electronic device determines, as instruction information, a direction opposite to a preset direction and a target rotation angle.

[0047] The rotation direction (opposite to the preset direction) may be obtained from the instruction information. In this case, the sound bar does not need to calculate the angle β that the sound bar needs to rotate according to the above formula, and the angle may be obtained from the instruction information.

[0048] Note that the duration T of the positioning audio, the target time t, the fine-tuning angle θ, and the rotation speed v are mutually constrained, that is, the angle value B corresponding to the target position is obtained by using the fine-tuning result, and the angle value B corresponding to the target position needs to be within the angle range [A-θ, A+θ]. Therefore, -θ≦vt≦θ and t≦T.

[0049] Thus, the instruction information determined by the electronic device may include an angle value B corresponding to the target position, or may include a target time t, both of which may enable the sound bar to determine the target position of the sound bar.

[0050] The instruction information further has a function of instructing the sound bar to rotate from the second position to the target position. Thus, after receiving the instruction information, the sound bar first determines the target position, and then rotates from the current position to the target position.

[0051] For example, in the process of fine-tuning, the sound bar rotates from a position corresponding to A-θ to a position corresponding to A+θ. After receiving the instruction information, the sound bar rotates in the reverse direction by an angle (2θ-vt) from a position corresponding to A+θ to a position corresponding to B.

[0052] In another example, during the fine-tuning process, the sound bar rotates from a position corresponding to A+θ to a position corresponding to A−θ. After receiving the instruction information, the sound bar rotates in the reverse direction by an angle (2θ−vt) from a position corresponding to A−θ to a position corresponding to B.

[0053] In this application, the soundbar and the electronic device cooperate with each other. The soundbar rotates from the first position to the second position at a certain speed while playing positioning audio. The electronic device finds the position of the soundbar corresponding to the case where the volume is maximum based on the received positioning audio, and controls the soundbar to rotate to that position. In this way, more accurate crosstalk cancellation can be implemented with respect to the user's position, the influence of different rooms can be eliminated, the audio-visual effect can be enhanced, and the original acoustic effect can be truly restored.

[0054] In a possible embodiment, the electronic device sends a second resume command to the soundbar, and the second resume command is used to instruct the soundbar to play test audio. The electronic device receives the collected audio, and the collected audio is the audio received by the microphone of the headset worn by the user during the process of playing the test audio. The electronic device calculates the binaural room impulse response BRIR based on the collected audio and the test audio, and the electronic device obtains the filter coefficient of the soundbar based on the BRIR.

[0055] The BRIR may be calculated according to Equation (7):

Number

[0056] Then, the filter coefficient is calculated according to Equation (8): C(f) = (H(f) H H(f)+βI k (f) -1 H(f) H D(f) (8) where H(f)∈C K×K where H(f) represents the matrix constructed by using the BRIR calculated according to equation (7) as elements, and the matrix covers the room transfer functions of all users corresponding to all speaker units, respectively, and * H represents the conjugate matrix, and I k (f)∈C K×K and I k (f) represents the identity matrix, and D(f)∈R 2P×R where D(f) represents the ideal transfer function, R represents the number of sound channels, and R=2 if the audio is stereo.

number

[0057] Finally, the soundbar processes the audio played by the soundbar based on the updated filter coefficients according to equation (9): X(f)=C(f)S(f) (9) where X(f) represents the processed audio, S(f) represents the audio played by the soundbar, and C(f) represents the filter coefficients.

[0058] The filter coefficients are obtained after precise sweet spot positioning, so that more accurate crosstalk cancellation can be implemented for the user's position, the effect of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0059] In one possible embodiment, before the electronic device obtains filter coefficients of the sound box based on the BRIR, the method further includes a step of the electronic device receiving a virtual space command, the virtual space command including a listening space, and a step of the electronic device obtaining a transfer function of the listening space, wherein the electronic device obtaining filter coefficients of the sound bar based on the BRIR includes the electronic device calculating filter coefficients of the sound bar based on the BRIR and the transfer function of the listening space.

[0060] For example, the listening space is the "Golden Hall". The electronics calculates the filter coefficients according to equation (10):

number

number

number

number

number

[0061] The soundbar processes the audio played by the soundbar based on the updated filter coefficients according to equation (11):

number

number

number

[0062] The aforementioned filter coefficients are obtained after dedicated private customization. Therefore, more accurate crosstalk cancellation can be implemented for the user's position, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored. In addition, the sound field can be rendered at the user's position, thereby providing the user with an immersive experience.

[0063] According to a second aspect, the present application provides a sound box position adjustment method, including: an electronic device sends a first playback command to the i-th sound box, where the first playback command is used to instruct the i-th sound box to rotate from a first position to a second position in a preset direction at a constant speed and play a positioning audio in the process of rotating, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change, and the i-th sound box is one of N sound boxes, where 1≦i≦N, and N is a positive integer greater than 1; an electronic device receives a mixed signal, where the mixed signal is an audio signal obtained by mixing the positioning audio played by the N sound boxes; an electronic device determines i-th instruction information based on the mixed signal, where the i-th instruction information is used to determine a target position of the i-th sound box, and the target position of the i-th sound box is a corresponding position of the i-th sound box corresponding to when the volume of the received audio is maximum in the process of receiving the mixed signal by the electronic device; and an electronic device sends the i-th instruction information to the i-th sound box.

[0064] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0065] In one possible embodiment, before the electronic device sends the first playback command to the i-th sound box, the method further includes the steps of: the electronic device obtaining an initial position of the center of the i-th sound box and a user's position; the electronic device calculating a theoretical sweet spot of the i-th sound box relative to the user's position based on the initial position and the user's position, where when the i-th sound box is located at the theoretical sweet spot, a connecting line between the user's position and the center of the i-th sound box is perpendicular to the loudspeaker surface of the i-th sound box and the loudspeaker surface faces the user; obtaining, by the electronic device, a fine-tuning angle; and the electronic device obtaining a first position and a second position of the i-th sound box based on the theoretical sweet spot and the fine-tuning angle.

[0066] In one possible embodiment, the first position of the i-th sound box is a position where the i-th sound box is rotated from the theoretical sweet spot by a fine-tuning angle in a preset direction, and the second position of the i-th sound box is a position where the i-th sound box is rotated from the theoretical sweet spot by a fine-tuning angle in the opposite direction to the preset direction.

[0067] The difference between this embodiment and the first aspect is that the number of sound bars in the room changes from one to multiple, and the multiple sound bars are arranged in a row, with the loudspeaker surfaces all facing the user. In this case, the multiple sound bars in the room simultaneously play positioning audio, and the microphone of the user terminal receives a mixed signal of the positioning audio respectively played by the multiple sound bars. Because the positions of the sound bars relative to the user are different, the position of the sound bar corresponding to the maximum volume of the received positioning audio is also different. It is necessary to obtain the target position and instruction information of each sound bar.

[0068] In this application, the multiple sound bars and the electronic device cooperate with each other. The multiple sound bars rotate from a first position to a second position at a certain speed while playing positioning audio. The electronic device finds the position of the sound bar corresponding to the maximum volume based on the mixed signal of the received positioning audio, and controls the sound bar to rotate to each corresponding position. In this way, more accurate crosstalk cancellation can be implemented for the user's position, the effect of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0069] In one possible embodiment, the method includes the steps of: sending a first playback command to the sound box by the electronic device, the first playback command being used to instruct the sound box to rotate in a preset direction from a first position to a second position and play a positioning audio in the process of rotating, and when the positioning audio is being played, a volume of the positioning audio is stable and does not change; receiving a plurality of collected audios by the electronic device, the plurality of collected audios being audios respectively received by microphones of the terminals of the plurality of users in the process of playing the positioning audio; and determining, by the electronic device, instruction information based on the plurality of collected audios, the instruction information being used to determine a target position of the sound box, and the target position is a volume of the sound box that is used to instruct the sound box to rotate in a preset direction from a first position to a second position and play a positioning audio in the process of playing the positioning audio. Terminal a step of receiving positioning audio by the electronic device, the step being where the sum of the volumes of the received audio is maximum, and the target position is the position of the sound box corresponding to the point in time when the sound box is rotating from the first position to the second position; and a step of transmitting instruction information to the sound box by the electronic device.

[0070] In one possible embodiment, before the electronic device sends a first playback command to the sound box, the method further includes the steps of: the electronic device obtaining an initial position of the center of the sound box and positions of the multiple users; the electronic device determining a center position of the multiple users based on the positions of the multiple users; the electronic device calculating a theoretical sweet spot of the sound box for the center position of the multiple users based on the initial position and the center positions of the multiple users, where when the sound box is positioned at the theoretical sweet spot, a connecting line between the center positions of the multiple users and the center of the sound box is perpendicular to the loudspeaker surface of the sound box and the loudspeaker surface faces the multiple users; the electronic device obtaining a fine-tuning angle; and the electronic device obtaining a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0071] The difference between this embodiment and the first aspect is that the number of users in the room is changed from one to multiple. In this case, the microphones of multiple user terminals in the room respectively receive the positioning audio. Since the positions of the user terminals are different, the position of the sound bar corresponding to the maximum volume of the received positioning audio is also different. In this case, the target position of the sound bar is found by referring to the sum of the sound bar volumes received by the user terminals at the time of sampling. The theoretical sweet spot is obtained based on the center position of the multiple users, not the position of the user.

[0072] In this application, the sound bar and the electronic device cooperate with each other. The sound bar rotates from a first position to a second position at a certain speed while playing positioning audio. The electronic device finds the position of the sound bar corresponding to the maximum sum of the volume based on the received multiple sampled audios, and controls the sound bar to rotate to that position. In this way, for multiple user positions, more accurate crosstalk cancellation can be implemented, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0073] In one possible embodiment, the method includes the steps of: dividing the space into a plurality of subspaces based on the number of N sound boxes, where each subspace corresponds to one of the sound boxes, and N is a positive integer greater than 1, by the electronic device; sending a first playback command to each of the N sound boxes, where the first playback command is used to instruct the corresponding sound box to rotate in a predetermined direction from a first position to a second position and play positioning audio during the rotation, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change; determining, by the electronic device, N pieces of instruction information, where the N pieces of instruction information correspond to the N sound boxes, and the instruction information is used to determine a target position of the corresponding sound box; and sending, by the electronic device, the N pieces of instruction information to the corresponding sound boxes, respectively.

[0074] In one possible embodiment, the step of determining, by the electronic device, the N pieces of instruction information includes the steps of: receiving, by the electronic device, a first positioning audio played by the i-th sound box, where the i-th sound box is one of the N sound boxes, where 1≦i≦N, and where only one first user is within the subspace corresponding to the first sound box; and determining, by the electronic device, first instruction information based on the first positioning audio, where the first instruction information is used to determine a first target position of the i-th sound box, and the first target position is the position of the i-th sound box corresponding to when the volume of the received audio is maximum in the process of receiving the first positioning audio by the electronic device.

[0075] In one possible embodiment, before the electronic device sends the first playback command to each of the N sound boxes, the method further includes the steps of: the electronic device obtaining a first initial position of the center of the i-th sound box and a position of the first user; the electronic device calculating a first theoretical sweet spot of the i-th sound box relative to the user's position based on the first initial position and the position of the first user, where when the i-th sound box is located at the first theoretical sweet spot, a connecting line between the position of the first user and the center of the i-th sound box is perpendicular to the loudspeaker surface of the i-th sound box, and the loudspeaker surface faces the first user; the electronic device obtaining a first fine-tuning angle; and the electronic device obtaining a first position and a second position of the first sound box based on the first theoretical sweet spot and the first fine-tuning angle.

[0076] In one possible embodiment, the step of the electronic device determining the N pieces of instruction information includes the steps of: receiving, by the electronic device, a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of the electronic devices of the plurality of second users in a process of playing the second positioning audio by the jth sound box, the jth sound box being one of the N sound boxes, 1≦j≦N, and the plurality of second users being located in a subspace corresponding to the jth sound box; and determining, by the electronic device, second instruction information based on the plurality of collected audios, the second instruction information being used to determine a second target position of the jth sound box, the second target position being the position of the jth sound box corresponding to when the sum of the volumes of the received audios is maximum in the process of receiving the second positioning audio by the electronic devices of the plurality of second users, and the second target position being a position in the process of rotating from the first position to the second position.

[0077] In one possible embodiment, before the electronic device sends the first playback command to each of the N sound boxes, the method further includes the steps of: the electronic device obtaining a second initial position of the center of the jth sound box and the positions of the second users; the electronic device determining the center positions of the second users based on the positions of the second users; the electronic device calculating a second theoretical sweet spot of the jth sound box for the center positions of the second users based on the second initial position and the center positions of the second users, where when the jth sound box is located at the second theoretical sweet spot, the connecting line between the center positions of the second users and the center of the jth sound box is perpendicular to the loudspeaker surface of the jth sound box, and the loudspeaker surface faces the second users; the electronic device obtaining a second fine-tuning angle; and the electronic device obtaining a first position and a second position of the jth sound box based on the second theoretical sweet spot and the second fine-tuning angle.

[0078] In one possible embodiment, the step of the electronic device determining the N pieces of instruction information includes the steps of: receiving, by the electronic device, a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of a plurality of third user electronic devices in a process of playing third positioning audio by the kth sound box, the kth sound box being one of the N sound boxes, 1≦k≦N, there is no user in the subspace corresponding to the kth sound box, and the plurality of third users are all users in the space; and determining, by the electronic device, third instruction information based on the plurality of collected audios, the third instruction information being used to determine a third target position of the kth sound box, the third target position being the position of the kth sound box corresponding to when the sum of the volume of the received audio is maximum in the process of receiving third positioning audio by the plurality of third user electronic devices, and the third target position being a position in the process of rotating from the first position to the second position.

[0079] In one possible embodiment, before the electronic device transmits the first playback command to each of the N sound boxes, the method includes the steps of: the electronic device acquiring a third initial position of the kth sound box and positions of a plurality of third users; the electronic device determining a center position of the plurality of third users based on the positions of the plurality of third users; and the electronic device determining a center position of the plurality of third users based on the third initial position and the center positions of the plurality of third users. ThirdThe method further includes the steps of: calculating a third theoretical sweet spot of the kth sound box relative to a central position of the users, where when the kth sound box is located at the third theoretical sweet spot, a connecting line between the central positions of the multiple third users and the center of the kth sound box is perpendicular to a loudspeaker surface of the kth sound box, and the loudspeaker surface faces the multiple third users; the electronics obtaining a third fine-tuning angle; and the electronics obtaining a first position and a second position of the kth sound box based on the third theoretical sweet spot and the third fine-tuning angle.

[0080] The electronic device first divides the space in the room based on the number of sound bars, and each sound bar corresponds to a subspace. For example, as shown in FIG. 15, there are three sound bars, and the center of the middle sound bar is used as the apex. The horizontal space in front of the sound bars may be divided into three subspaces in a manner that evenly divides an angle of 180° horizontally. The left subspace corresponds to sound bar 1 and has one user, the middle subspace corresponds to sound bar 2 and has two users, and the right subspace corresponds to sound bar 3 and has no user. That is, in the scenario shown in FIG. 15, the three sound bars correspond to three subspaces respectively, and based on the number of users in the subspace, the relationship between the three sound bars and the number of users is one-to-one, one-to-many, and one-to-zero, respectively.

[0081] The electronics determine a target position for each sound bar based on the division of the space and the number of users in the subspace.

[0082] For example, for a subspace with only one user, the target position of the corresponding sound bar may be determined with reference to the method of the first aspect, and then the indication information of the sound bar is determined. For a subspace with multiple users, the target position of the corresponding sound bar may be determined with reference to the method of the second aspect, and then the indication information of the sound bar is determined, but the theoretical sweet spot is obtained based on the center position of all users in the subspace instead of the user's position. For a subspace with no user, the target position of the corresponding sound bar may be determined with reference to the method of the second aspect, and then the indication information of the sound bar is determined, but the theoretical sweet spot is obtained based on the center position of all users in the room instead of the user's position.

[0083] In this application, the multiple sound bars and the electronic device cooperate with each other. The multiple sound bars rotate from a first position to a second position at a certain speed while playing positioning audio. For each sound bar, the electronic device finds the corresponding sound bar position when the volume or sum of the volume of the sampled audio received by the user's terminal in the corresponding subspace is maximum, and controls the sound bar to rotate to that position. In this way, for multiple user positions, more accurate crosstalk cancellation can be implemented, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0084] According to a third aspect, the present application provides a control device including: a transmitting module configured to transmit a first playback command to a sound box, where the first playback command is used to instruct the sound box to rotate in a preset direction from a first position to a second position and to play a positioning audio in the process of rotation, where when the positioning audio is being played, a volume of the positioning audio is stable and does not change; a receiving module configured to receive the positioning audio; and a processing module configured to determine instruction information based on the positioning audio, where the instruction information is used to determine a target position of the sound box, where the target position is a position of the sound box corresponding to when the volume of the received audio is maximum in the process of receiving the positioning audio by the electronic device, where the target position is a position in the process of the sound box rotating from the first position to the second position, where the transmitting module is further configured to transmit the instruction information to the sound box.

[0085] In one possible embodiment, the angular difference between the first position and the second position is related to the inter-aural distance of the user, or the angular difference between the first position and the second position is related to a preset fine adjustment range.

[0086] In one possible embodiment, the instructional information further instructs the sound box to rotate from the second position to the target position.

[0087] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0088] In one possible embodiment, the rotation involves rotating at a constant speed around a vertical soundbox axis of rotation.

[0089] In one possible embodiment, the shape of the sound box includes a bar shape, a square shape, or a ring shape.

[0090] In one possible embodiment, the processing module is further configured to obtain an initial position of the center of the sound box and a position of the user, calculate a theoretical sweet spot of the sound box for the user based on the initial position and the user's position, when the sound box is positioned at the theoretical sweet spot, a connecting line between the user's position and the center of the sound box is perpendicular to a loudspeaker surface of the sound box and the loudspeaker surface faces the user, obtain a fine-tuning angle, and obtain a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0091] In one possible embodiment, the first position is a position where the sound box is rotated horizontally clockwise by a fine-tuning angle from the theoretical sweet spot, and the second position is a position where the sound box is rotated horizontally counterclockwise by a fine-tuning angle from the theoretical sweet spot.

[0092] In one possible embodiment, the processing module is particularly configured to display a room configuration interface, the room configuration interface being used to simulate a space in which a user and a sound box are located, receive a first virtual position input by the user on the room configuration interface, the first virtual position being used to simulate an initial position, calculate the initial position based on the first virtual position, receive a second virtual position input by the user on the room configuration interface, the second virtual position being used to simulate a position of the user, and calculate a position of the user based on the second virtual position.

[0093] In one possible embodiment, the processing module is specifically configured to calculate the fine-tuning angle based on the initial position, the position of the user, and the interaural distance of the user.

[0094] In one possible embodiment, the processing module is particularly configured to display a precision sweet spot positioning interface, the precision sweet spot positioning interface including a pop-up window for setting a fine-tuning angle, receive a pre-set experience value input by a user on the pop-up window, and set the value of the fine-tuning angle to the pre-set experience value.

[0095] In one possible embodiment, the processing module is particularly configured to detect positioning audio received at a specified frequency from a start time of reception of the positioning audio to obtain the volume, and when an end time of reception of the positioning audio arrives, determine a difference between a time corresponding to the maximum volume among the multiple obtained volume levels and the start time of reception as a target time, determine the target time as instruction information, determine the target time and a reverse direction of the predetermined direction as instruction information, determine the target time, the reverse direction of the predetermined direction, and a fine-tuning angle as instruction information, or determine the reverse direction of the predetermined direction and a target rotation angle as instruction information, and the target rotation angle instructs the sound box to rotate from the second position to the target position.

[0096] In one possible embodiment, the processing module is particularly configured to detect the positioning audio to obtain a maximum volume, determine a difference between a time point corresponding to the maximum volume and a start time point of receiving the positioning audio as a target time, determine the target time as instruction information, determine the target time and a reverse direction of the preset direction as instruction information, determine the target time, the reverse direction of the preset direction and a fine adjustment angle as instruction information, or determine the reverse direction of the preset direction and a target rotation angle as instruction information, and the target rotation angle instructs the sound box to rotate from the second position to the target position.

[0097] In one possible embodiment, the transmitting module is further configured to transmit a second playback command to the sound box, the second playback command being used to instruct the sound box to play the test audio, the receiving module is further configured to receive collected audio, the collected audio being audio received by a microphone of a headset worn by the user in the process of playing the test audio, and the processing module is further configured to calculate a binaural room impulse response BRIR based on the collected audio and the test audio, and obtain filter coefficients for the sound box based on the BRIR.

[0098] In one possible embodiment, the processing module is further configured to receive a virtual space command including a listening space, obtain a transfer function of the listening space, and calculate filter coefficients of the sound box based on the BRIR and the transfer function of the listening space.

[0099] According to a fourth aspect, the present application provides an audio playback device including a receiving module configured to receive a first playback command from an electronic device, and a processing module configured to rotate in a preset direction from a first position to a second position based on the first playback command and play positioning audio in the process of rotation, where when the positioning audio is played, a volume of the positioning audio is stable and does not change, wherein the receiving module is further configured to receive instruction information from the electronic device, the instruction information is used to determine a target position, the target position being a position of the sound box corresponding to when the volume of the received audio is maximum in the process of receiving the positioning audio by the electronic device, the target position being a position in the process of the sound box rotating from the first position to the second position, and the processing module is further configured to rotate from the second position to the target position based on the instruction information.

[0100] In one possible embodiment, the angular difference between the first position and the second position is related to the inter-aural distance of the user, or the angular difference between the first position and the second position is related to a preset fine adjustment range.

[0101] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0102] In one possible embodiment, rotating in a predetermined direction comprises rotating at a constant speed in the predetermined direction.

[0103] In one possible embodiment, the shape of the sound box includes a bar shape, a square shape, or a ring shape.

[0104] In one possible embodiment, the receiving module is further configured to receive a theoretical sweet spot and a fine-tuning angle from the electronic device, and when the sound box is positioned at the theoretical sweet spot, a connecting line between the user's position and the center of the sound box is perpendicular to a loudspeaker surface of the sound box and the loudspeaker surface faces the user, and the processing module is further configured to determine a first position based on the theoretical sweet spot and the fine-tuning angle and rotate to the first position.

[0105] In one possible embodiment, the first position is a position where the sound box is rotated horizontally clockwise by a fine-tuning angle from the theoretical sweet spot, and the second position is a position where the sound box is rotated horizontally counterclockwise by a fine-tuning angle from the theoretical sweet spot.

[0106] According to a fifth aspect, the present application provides a control device, comprising: a transmitting module configured to transmit a first playback command to an i-th sound box, the first playback command being used to instruct the i-th sound box to rotate from a first position to a second position in a preset direction at a constant speed and play a positioning audio in the process of rotating, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change, and the i-th sound box is one of N sound boxes, where 1≦i≦N, and N is a positive integer greater than 1; a receiving module configured to receive a mixed signal, the mixed signal being an audio signal obtained by mixing the positioning audio played by the N sound boxes; and a processing module configured to determine an i-th instruction information based on the mixed signal, the i-th instruction information being used to determine a target position of the i-th sound box, and the target position of the i-th sound box being a corresponding position of the i-th sound box corresponding to when the volume of the received audio is maximum in the process of receiving the mixed signal by the electronic device, the processing module being further configured to transmit the i-th instruction information to the i-th sound box.

[0107] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0108] In one possible embodiment, the processing module is further configured to obtain an initial position of the center of the i-th sound box and a position of the user, calculate a theoretical sweet spot of the i-th sound box relative to the user's position based on the initial position and the user's position, determine that when the i-th sound box is located at the theoretical sweet spot, a connecting line between the user's position and the center of the i-th sound box is perpendicular to the loudspeaker surface of the i-th sound box and the loudspeaker surface faces the user, obtain a fine-tuning angle, and obtain a first position and a second position of the i-th sound box based on the theoretical sweet spot and the fine-tuning angle.

[0109] In one possible embodiment, the first position of the i-th sound box is a position where the i-th sound box is rotated from the theoretical sweet spot by a fine-tuning angle in a preset direction, and the second position of the i-th sound box is a position where the i-th sound box is rotated from the theoretical sweet spot by a fine-tuning angle in the opposite direction to the preset direction.

[0110] In one possible embodiment, the transmitting module is further configured to transmit a first playback command to the sound box, the first playback command being used to instruct the sound box to rotate in a preset direction from a first position to a second position and to play a positioning audio in the process of rotating, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change; the receiving module is further configured to receive a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of the terminals of the plurality of users in the process of playing the positioning audio; the processing module is further configured to determine instruction information based on the plurality of collected audios, the instruction information being used to determine a target position of the sound box, and the target position being a volume of the positioning audio of the plurality of users. TerminalIn the process of receiving positioning audio by the positioning module, the position of the sound box corresponds to when the sum of the volumes of the received audio is maximum, and the target position is a position in the process of rotating from the first position to the second position, and the transmitting module is further configured to transmit instruction information to the sound box.

[0111] In one possible embodiment, the processing module is further configured to obtain an initial position of a center of the sound box and positions of the multiple users, determine a center position of the multiple users based on the positions of the multiple users, calculate a theoretical sweet spot of the sound box for the center position of the multiple users based on the initial position and the center positions of the multiple users, determine that when the sound box is positioned at the theoretical sweet spot, a connecting line between the center positions of the multiple users and the center of the sound box is perpendicular to a loudspeaker surface of the sound box and the loudspeaker surface faces the users, obtain a fine-tuning angle, and obtain a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0112] In one possible embodiment, the processing module is further configured to divide the space into a plurality of subspaces based on the number of N sound boxes, each subspace corresponding to one of the sound boxes, where N is a positive integer greater than 1; the transmitting module is further configured to send a first playback command to each of the N sound boxes, where the first playback command is used to instruct the corresponding sound box to rotate in a predetermined direction from a first position to a second position and play positioning audio during the rotation, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change; the processing module is further configured to determine N pieces of instruction information, where the N pieces of instruction information correspond to the N sound boxes, and the instruction information is used to determine a target position of the corresponding sound box; and the transmitting module is further configured to transmit the N pieces of instruction information to the corresponding sound boxes, respectively.

[0113] According to a sixth aspect, the present application provides an electronic device including one or more processors and a memory. The memory is configured to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors are enabled to perform a method according to any one of the first to second aspects.

[0114] According to a seventh aspect, the present application provides an electronic device including one or more processors and a memory. The memory is configured to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors perform the functions of the first aspect. Any possible embodiment of This makes it possible to carry out the method according to the present invention.

[0115] According to an eighth aspect, the present application provides a computer readable storage medium comprising a computer program, which when executed on a computer enables the computer to carry out a method according to any one of the first to second aspects.

[0116] According to a ninth aspect, the present application further provides a computer program product, the computer program product comprising computer program code, which when executed on a computer or processor, causes the computer or processor to perform a method according to any one of the first to second aspects. [Brief description of the drawings]

[0117] [Figure 1] FIG. 2 is an exemplary structural diagram of an audio playback device according to the present application; [Diagram 2] FIG. 2 is an exemplary structural diagram of a control device according to the present application; [Diagram 3] FIG. 1 is a schematic diagram of an example of an electronic device according to the present application. [Figure 4]4 is a flow chart of an example of a process 400 of a sound box position adjustment method according to the present application. [Diagram 5] 5 is a flow chart of an example of a process 500 of a sound box position adjustment method according to the present application. [Figure 6] 6 is a flow chart of an example of a process 600 of a sound box position adjustment method according to the present application. [Figure 7] 7 is a flow chart of an example of a process 700 of a sound box position adjustment method according to the present application. [Figure 8] 8 is a flowchart of an example of a process 800 of a rendering method according to the present application. [Figure 9] FIG. 2 is a schematic diagram of an example of a login interface according to the present application. [Figure 10] 2 is a schematic diagram of an example of a function selection interface according to the present application; [Figure 11] FIG. 2 is a schematic diagram of an example of a room configuration interface according to the present application. [Figure 12a] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12b] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12c] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12d] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12e] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12f] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12g] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12h] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12i] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12j] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12k] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12l] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 12m] 1 is a schematic diagram of an example of a precision sweet-spot positioning interface according to the present application. [Figure 13] FIG. 2 is a schematic diagram of an example of an initial horizontal angle according to the present application. [Figure 14] FIG. 13 is a schematic diagram of another example of an initial horizontal angle according to the present application. [Figure 15] FIG. 13 is a schematic diagram of yet another example of an initial horizontal angle according to the present application. [Figure 16] FIG. 13 is a schematic diagram of yet another example of an initial horizontal angle according to the present application. [Figure 17a] 1 is a schematic diagram of an example of a dedicated private customization interface according to the present application. [Figure 17b] 1 is a schematic diagram of an example of a dedicated private customization interface according to the present application. [Figure 17c] 1 is a schematic diagram of an example of a dedicated private customization interface according to the present application. [Figure 17d] 1 is a schematic diagram of an example of a dedicated private customization interface according to the present application. [Figure 18a] 1 is a schematic diagram of an example of a virtual space mode interface according to the present application. [Figure 18b] 1 is a schematic diagram of an example of a virtual space mode interface according to the present application. [Figure 18c] 1 is a schematic diagram of an example of a virtual space mode interface according to the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0118] In order to make the objectives, technical solutions and advantages of the present application clearer, the following will clearly and completely describe the technical solutions of the present application with reference to the accompanying drawings in the present application. It is clear that the described embodiments are only a part of the present application, not all the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0119] In the specification, embodiments, claims, and accompanying drawings of this application, terms such as "first", "second", etc. are intended to be merely descriptive and should not be understood as indicating or implying relative importance or ordering. In addition, the terms "include", "have", and any variations thereof are intended to cover non-exclusive inclusions, including, for example, a series of steps or units. A method, system, product, or device is not necessarily limited to the literally recited steps or units, and may include other steps or units that are not literally recited or that are inherent to such a process, method, product, or device.

[0120] In this application, it is to be understood that "at least one (item)" refers to one or more, and "multiple" refers to two or more. The term "and / or" is used to describe an association relationship between associated objects, and represents that three relationships may exist. For example, "A and / or B" can represent the following three cases: only A is present, only B is present, and both A and B are present, where A and B may be singular or plural. The character " / " generally indicates an "or" relationship between associated objects. "At least one of" or similar expressions refers to any combination of the following, including any combination of one or more of the following. For example, at least one of a, b, or c can refer to a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural.

[0121] FIG. 1 is an exemplary structural diagram of an audio playback device according to the present application. As shown in FIG. 1, the audio playback device includes a base, a turntable, and a soundbar. The soundbar is placed on the turntable by using a magnetic attraction structure or an in-line structure, and the turntable is embedded in the base. The turntable drives the soundbar to rotate, and the soundbar can rotate left and right horizontally and can also rotate up and down vertically. In addition, the turntable can supply signals and power.

[0122] The audio playback device is a separate and independent entity from the video playback device (e.g., a television or computer) and the video playback device does not move when the soundbar is rotated.

[0123] It should be noted that the audio playback device shown in FIG. 1 is only used as an example to explain one possible embodiment of an audio playback device used in this application, and does not constitute any limitation on the audio playback device.

[0124] For example, the soundbar may be placed at the bottom of the television and attached to a rotatable base. If the soundbar needs to be rotated, the base can be controlled to rotate and then the soundbar is driven to rotate, but the television does not need to rotate. In another example, the soundbar may be placed at the bottom of the television and attached to a rotatable base together with the television. If the soundbar needs to be rotated, the base can be controlled to rotate and then the soundbar and television are driven to rotate together.

[0125] Based on the aforementioned audio playback device with a rotatable sound bar, the present application provides a sound box position adjustment method and an audio rendering method, which accurately determines the user's position through positioning, and then controls the rotation direction of the sound bar, so that the optimal listening position (sweet spot) of the audio played by the sound bar is exactly at the user's position.

[0126] The above-described sound box positioning method and audio rendering method may be applied to a control device, which may be located on an electronic device that can communicate (e.g., Bluetooth connection) with the sound bar, and the electronic device may be, for example, a mobile phone, a tablet computer, or a smart TV.

[0127] 2 is an exemplary structural diagram of a control device according to the present application. As shown in FIG. 2, the control device includes a function module and a database module.

[0128] The functional modules include a receiving module, a processing module, and a transmitting module. The receiving module is configured to receive audio data and instructions obtained by the electronic device. The processing module is configured to perform calculations and processing based on the instructions and the audio data to obtain a target position, and then calculate audio filter coefficients to perform audio rendering. The transmitting module is configured to send instructions to the sound bar to control the sound bar to rotate to the target position.

[0129] The database module is configured to store information about past sweet spots, the information including the coordinates of the sweet spots, and the target horizontal angle and audio filter coefficients corresponding to the sweet spots. When the user's position coincides with the calculated sweet spot, the information about the sweet spot may be obtained directly from the database module. In this way, the amount of calculation can be reduced, and the efficiency of sweet spot positioning and audio rendering can be improved.

[0130] It should be noted that the controller framework depicted in FIG. 2 is merely an example and does not constitute any limitation on the entity performing the methods of the present application.

[0131] 3 is a schematic diagram of an example of an electronic device according to the present application, in which the electronic device is a mobile phone.

[0132] As shown in FIG. 3, the mobile phone 300 includes a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB), (U SB) interface 330, charging management module 340, power management module 341, battery 342, antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, handset 370B, microphone 370C, headset jack 370D, sensor module 380, button 390, motor 391, indicator 392, camera 393, display 394, subscriber identity module (S The sensor module 380 may include a pressure sensor 380A, a gyro sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, an optical proximity sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, and the like.

[0133] It may be understood that the structure shown in this embodiment is not a specific limitation of the mobile phone 300. In some other embodiments of the present application, the mobile phone 300 may include more or less components than those shown in the figures, some components may be combined, some components may be divided, or there may be a different arrangement of components. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.

[0134] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor. (A P), modem processor, graphics processing unit (G PU), Image Signal Processor (I SP), controller, video codec, digital signal processor (D SP), baseband processor, and / or neural network processing unit (N The different processing units may be separate components or may be integrated into one or more processors.

[0135] The controller can generate an operation control signal according to the instruction operation code and the time series signal to complete the control of reading the instruction and executing the instruction.

[0136] A memory may further be disposed in the processor 310 and configured to store instructions and data. In some embodiments, the memory in the processor 310 is a cache. The memory may store instructions or data that have just been used or are used periodically by the processor 310. When the processor 310 needs to use the instructions or data again, the processor can directly call the instructions or data from the memory. This avoids repeated accesses and reduces the latency of the processor 310. Thus, the system efficiency is improved.

[0137] In the present application, the processor 310 can cooperate with the mobile communication module 350 or the wireless communication module 360 ​​to implement the functions of the aforementioned control device. Optionally, the processor 310 can further cooperate with the audio module 370 and the microphone 370C to receive audio played by the sound bar, and then implement the functions of the aforementioned control device.

[0138] In some embodiments, the processor 310 may include one or more interfaces. (I 2C) Interface, Inter-Integrated Circuit Sound (I 2S) Interface, Pulse Code Modulation (P CM) interface, universal asynchronous receiver / transmitter (U ART) Interface, Mobile Industry Processor Interface (M IPI), General Purpose Input / Output (G PIO) interface, Subscriber Identity Module (S IM) interface, Universal Serial Bus (U SB) interface, etc.

[0139] The I2C interface is a bidirectional synchronous serial bus with one serial data line. (S DA) and one serial clock line (S CL). In some embodiments, the processor 310 may include multiple groups of I2C buses. The processor 310 may be coupled to the touch sensor 380K, the charger, the flashlight, the camera 393, etc., through different I2C bus interfaces. For example, the processor 310 may be coupled to the touch sensor 380K through an I2C interface, such that the processor 310 communicates with the touch sensor 380K through the I2C bus interface to implement the touch function of the mobile phone 300.

[0140] The I2S interface may be configured to perform audio communication. In some embodiments, the processor 310 may include multiple groups of I2S buses. The processor 310 may be coupled to the audio module 370 via the I2S bus to perform communication between the processor 310 and the audio module 370. In some embodiments, the audio module 370 may send audio signals to the wireless communication module 360 ​​via the I2S interface to perform a function of answering a phone call via a Bluetooth headset.

[0141] The PCM interface may also be configured to perform audio communications and to sample, quantize, and encode analog signals. In some embodiments, the audio module 370 may be coupled to the wireless communication module 360 ​​via a PCM bus interface. In some embodiments, the audio module 370 may also send audio signals to the wireless communication module 360 ​​via the PCM interface to perform the function of answering a phone call via a Bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communications.

[0142] The UART interface is a universal serial data bus and is configured for asynchronous communication. The bus may be a bidirectional communication bus. The bus converts data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically configured to connect the processor 310 to the wireless communication module 360. For example, the processor 310 communicates with Bluetooth in the wireless communication module 360 ​​via the UART interface to perform Bluetooth functions. In some embodiments, the audio module 370 may send audio signals to the wireless communication module 360 ​​via the UART interface to perform a function of playing music via a Bluetooth headset.

[0143] The MIPI interface may be configured to connect the processor 310 to peripheral components such as a display 394 or a camera 393. The MIPI interface may be a camera serial interface. (C SI), Display Serial Interface (D In some embodiments, the processor 310 communicates with a camera 393 via a CSI interface to perform a photographing function of the mobile phone 300. The processor 310 communicates with a display 394 via a DSI interface to perform a display function of the mobile phone 300.

[0144] The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or a data signal. In some embodiments, the GPIO interface may be configured to connect the processor 310 to the camera 393, the display 394, the wireless communication module 360, the audio module 370, the sensor module 380, etc. The GPIO interface may alternatively be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0145] The USB interface 330 is an interface that complies with the USB standard, and may be, specifically, a Mini USB interface, a Micro USB interface, a USB Type-C interface, etc. The USB interface 330 may be configured to connect to a charger to charge the mobile phone 300, to transmit data between the mobile phone 300 and a peripheral device, or to connect to a headset to play audio through the headset. The interface may alternatively be configured to connect to another mobile phone, for example, an AR device.

[0146] It may be understood that the interface connection relationships between modules shown in this embodiment are merely illustrative examples and do not constitute any limitations on the structure of the mobile phone 300. In some other embodiments of the present application, the mobile phone 300 may alternatively use an interface connection scheme different from the aforementioned embodiment, or may use a combination of multiple interface connection schemes.

[0147] The charging management module 340 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 340 may receive a charging input from a wired charger via the USB interface 330. In some embodiments of wireless charging, the charging management module 340 may receive a wireless charging input by using a wireless charging coil of the mobile phone 300. The charging management module 340 may be configured to receive a charging input from a battery. 342 The mobile phone is powered by using a power management module 341 while charging the mobile phone.

[0148] The power management module 341 is a battery 342 The power management module 341 is configured to connect the battery, the charging management module 340, and the processor 310. 342and / or receives input from charging management module 340 to provide power to processor 310, internal memory 321, display 394, camera 393, wireless communication module 360, etc. Power management module 341 may be further configured to monitor parameters such as battery capacity, battery cycle count, and battery health (leakage or impedance). In some other embodiments, power management module 341 may be alternatively located in processor 310. In some other embodiments, power management module 341 and charging management module 340 may be alternatively located in the same component.

[0149] The wireless communication functions of the mobile phone 300 may be implemented using antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, a modem processor, a baseband processor, and the like.

[0150] Antenna 1 and Antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna of the mobile phone 300 may be configured to cover one or more communication frequency bands. Different antennas may be further multiplexed to improve antenna utilization. For example, Antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas may be used in combination with a tuning switch.

[0151] The mobile communication module 350 can provide a solution for wireless communication including 2G, 3G, 4G, 5G, etc., applied to the mobile phone 300. The mobile communication module 350 includes at least one filter, switch, power amplifier, low noise amplifier, (LThe mobile communication module 350 may include a 10-bit 12-bit 12-bit 16 ...

[0152] The modem processor may include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained through demodulation to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then transmitted to the application processor. The application processor outputs a voice signal via an audio device (not limited to a speaker 370A, a handset 370B, etc.) or displays an image or video on the display 394. In some embodiments, the modem processor may be an independent component. In some other embodiments, the modem processor may be independent from the processor 310 and be located in the same device as the mobile communication module 350 or another functional module.

[0153] The wireless communication module 360 ​​is applied to the mobile phone 300 and establishes a wireless local area network (LAN). (W LAN) (e.g. Wireless Fidelity (W i-Fi network), Bluetooth (B T), Global Navigation Satellite System (G NSS), Frequency Modulation(F M), near field communication (N FC) technology, and infrared (I A wireless communication solution including a cellular radio (R) technology can be provided. The wireless communication module 360 ​​may be one or more components that integrate at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 310. The wireless communication module 360 ​​may further receive a signal to be transmitted from the processor 310, perform frequency modulation and amplification on the signal, and convert the signal into an electromagnetic wave for emission via the antenna 2.

[0154] In some embodiments, antenna 1 of the mobile phone 300 is coupled to a mobile communication module 350 and antenna 2 is coupled to a wireless communication module 360, so that the mobile phone 300 can communicate with a network and other devices by using wireless communication technology. The wireless communication technology is known as the Global System for Mobile Communications. (G SM), General Packet Radio Service (G PRS), code division multiple access (C DMA), Wideband Code Division Multiple Access (W CDMA), time division code division multiple access (T D-SCDMA), Long Term Evolution (L TE), BT, GNSS, WLAN, NFC, FM, IR technologies etc. GNSS is the Global Positioning System (G PS), Global Navigation Satellite System (G LONASS), Beidou Navigation Satellite System (B DS), Quasi-Zenith Satellite System (Q ZSS), and / or Satellite Augmentation System (S BAS).

[0155] The mobile phone 300 performs display functions by using a GPU, a display 394, an application processor, etc. The GPU is a microprocessor for image processing and is connected to the display 394 and the application processor. The GPU is configured to perform mathematical and geometric calculations and render images. The processor 310 may include one or more GPUs that execute program instructions to generate or modify display information.

[0156] The display 394 is configured to display images, videos, etc. The display 394 includes a display panel. The display panel may be a liquid crystal display (LCD). (L CD), organic light-emitting diode (O LED), Active Matrix Organic Light Emitting Diode (A MOLED, flexible light-emitting diode (F LED), Miniled, MicroLed, Micro-oLed, Quantum Dot Light Emitting Diode (Q In some embodiments, the mobile phone 300 may include one or N displays 394, where N is a positive integer greater than one.

[0157] The mobile phone 300 can implement the photography function using an ISP, a camera 393, a video codec, a GPU, a display 394, an application processor, and the like.

[0158] The ISP is configured to process data fed back by the camera 393. For example, during shooting, the shutter is pressed and light is transmitted to the camera's photosensitive elements through the lens. The light signal is converted into an electrical signal, which the camera's photosensitive elements transmit to the ISP for processing and converting the electrical signal into a visible image. The ISP can further perform algorithmic optimization on noise, brightness, and skin tone of the image. The ISP can further optimize parameters such as exposure and color temperature for the shooting scenario. In some embodiments, the ISP may be located in the camera 393.

[0159] The camera 393 is configured to capture still images or video. An optical image of a subject is generated through a lens and projected onto a photosensitive element. The photosensitive element may be a charge-coupled device. (C CD) or complementary metal oxide semiconductor (C The photosensitive element may be a MOS (metal oxide semiconductor) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then sent to the ISP, which converts the electrical signal into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into an image signal in a standard format, such as RGB or YUV. In some embodiments, the mobile phone 300 may include one or N cameras 393, where N is a positive integer greater than one.

[0160] The digital signal processor is configured to process digital signals and may process other digital signals in addition to the digital image signal, for example, when the mobile phone 300 selects a frequency, the digital signal processor is configured to perform a Fourier transform on the frequency energy, etc.

[0161] A video codec is configured to compress or decompress digital video. The mobile phone 300 may support one or more types of video codec. In this manner, the mobile phone 300 may support multiple encoding formats, such as the Moving Picture Experts Group (MPG) video codec. (M It can play or record video in MPEG-1, MPEG-2, MPEG-3, and MPEG-4.

[0162] NPU is a neural network (NNPU is a computing processor that can process input information quickly and perform self-learning continuously by referring to the structure of biological neural networks, for example, by referring to the mode of communication between human brain neurons. Applications such as intelligent recognition of the mobile phone 300, such as image recognition, face recognition, audio recognition, and text understanding, can be implemented by using the NPU.

[0163] The external memory interface 320 is configured to connect to an external storage card, such as a Micro SD card, to expand the storage capability of the mobile phone 300. The external storage card communicates with the processor 310 via the external memory interface 320 to perform data storage functions. For example, files such as music or videos are stored on the external storage card.

[0164] The internal memory 321 may be configured to store computer executable program code. The executable program code includes instructions. The internal memory 321 may include a program storage area and a data storage area. The program storage area may store an operating system, applications required by at least one function (e.g., an audio playback function or an image playback function), and the like. The data storage area may store data created during use of the mobile phone 300 (e.g., audio data and an address book), and the like. In addition, the internal memory 321 may include a high-speed random access memory and a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or a universal flash storage device. (U The processor 310 executes instructions stored in the internal memory 321 and / or in memory located on the processor to perform various functional applications and data processing of the mobile phone 300.

[0165] The mobile phone 300 can implement audio functions such as music playback or recording via an audio module 370, a speaker 370A, a handset 370B, a microphone 370C, a headset jack 370D, an application processor, and the like.

[0166] The audio module 370 is configured to convert digital audio information to analog audio signals for output, and is also configured to convert analog audio input to digital audio signals. The audio module 370 may be further configured to encode and decode audio signals. In some embodiments, the audio module 370 may be located in the processor 310, or some functional modules within the audio module 370 are located in the processor 310.

[0167] The speaker 370A, also called a "loudspeaker", is configured to convert audio electrical signals into voice signals. The speaker 370A of the mobile phone 300 can be used to listen to music or answer hands-free calls.

[0168] The handset 370B, also referred to as an "earpiece," is configured to convert audio electrical signals into voice signals. When a call is answered or voice information is received by using the mobile phone 300, the handset 370B can be held close to a person's ear to hear the sound.

[0169] The microphone 370C, also referred to as a "mike" or "mic", is configured to convert audio signals into electrical signals. When making a call or sending a voice message, a user can put their mouth close to the microphone 370C to speak and input the audio signal to the microphone 370C. At least one microphone 370C may be disposed on the mobile phone 300. In some other embodiments, two microphones 370C may be disposed on the mobile phone 300 to collect audio signals and further perform noise reduction functions. In some other embodiments, three, four, or more microphones 370C may alternatively be disposed on the mobile phone 300 to collect audio signals, reduce noise, further identify sound sources, perform directional recording functions, and the like.

[0170] The headset jack 370D is configured to connect to a wired headset. The headset jack 370D is configured to connect to a USB interface 330, a 3.5mm open mobile terminal platform (O MTP) standard interface, or American Cellular Telecommunications Industry Association (C It may be a TIA (Translation International Association) standard interface.

[0171] The pressure sensor 380A is configured to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 380A may be disposed on the display 394. There are many types of pressure sensors 380A, for example, resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor can include at least two parallel plates made of a conductive material.

[0172] The gyro sensor 380B may be configured to determine the orientation of the mobile phone 300.

[0173] Air pressure sensor 380C is configured to measure air pressure.

[0174] The magnetic sensor 380D includes a Hall sensor.

[0175] The acceleration sensor 380E can detect the acceleration values ​​of the mobile phone 300 in various directions (usually three axes).

[0176] The distance sensor 380F is configured to measure distance.

[0177] The optical proximity sensor 380G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode may be an infrared emitting diode.

[0178] The ambient light sensor 380L is configured to sense the brightness of the ambient light.

[0179] Fingerprint sensor 380H is configured to capture a fingerprint.

[0180] The temperature sensor 380J is configured to detect a temperature.

[0181] The touch sensor 380K may also be referred to as a "touch component." The touch sensor 380K may be disposed on the display 394. The touch sensor 380K and the display 394 constitute a touch screen and are also referred to as a "touch screen." The touch sensor 380K is configured to detect touch operations on or near the touch sensor 380K. The touch sensor may forward the detected touch operations to an application processor to determine a type of touch event. A visual output associated with the touch operation may be provided via the display 394. In some other embodiments, the touch sensor 380K may alternatively be disposed on the surface of the mobile phone 300 at a location different from that of the display 394.

[0182] The bone conduction sensor 380M can acquire a vibration signal.

[0183] The buttons 390 include a power button, a volume button, etc. The buttons 390 may be mechanical buttons or touch buttons. The mobile phone 300 can receive key inputs and generate key signal inputs related to user settings and function control of the mobile phone 300.

[0184] The motor 391 can generate vibration prompts. The motor 391 may be configured to generate incoming vibration prompts and touch vibration feedback.

[0185] The indicator 392 may be an indicator light and may be configured to indicate charging status and power changes, or may be configured to indicate messages, missed calls, notifications, and the like.

[0186] The SIM card interface 395 is configured to connect to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 395 to be connected to or separated from the mobile phone 300. The mobile phone 300 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 395 can support a Nano SIM card, a Micro SIM card, a SIM card, etc. The mobile phone 300 interacts with a network by using a SIM card to perform functions such as calling and data communication. In some embodiments, the mobile phone 300 uses an eSIM, i.e., an embedded SIM card. The eSIM card may be embedded in the mobile phone 300 and cannot be separated from the mobile phone 300.

[0187] It can be understood that the structure shown in this embodiment does not constitute a specific limitation on the electronic device. In some other embodiments of the present application, the electronic device may include more or fewer components than those shown in the figures, some components may be combined, some components may be divided, or there may be a different arrangement of components. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.

[0188] 4 is a flow chart of an example of a process 400 of a sound box position adjustment method according to the present application. The process 400 may be performed by the electronic device and the sound bar shown in FIG. 3 together. The process 400 is described as a series of steps or operations. It should be understood that the steps or operations of the process 400 are not limited to the order of execution shown in FIG. 4 and may be performed in various orders and / or simultaneously. The process 400 may include the following:

[0189] S401. An electronic device sends a first playback command to a sound bar.

[0190] Before the sound box position adjustment method starts, the user must first turn on the application installed in the electronic device. (A The sweet spot positioning instruction can be sent by using an interactive interface provided by the Sound Bar Navigation System (SANS) (Single Stream Player). Based on the instruction, the electronic device starts performing the steps of the sound box position adjustment method. First, the electronic device sends a first play instruction to the sound bar. The first play instruction is used to instruct the sound bar to rotate in a preset direction from a first position to a second position and play positioning audio in the course of the rotation. Optionally, the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction. Optionally, the rotating in the preset direction includes rotating at a constant speed in the preset direction.

[0191] Optionally, the shape of the sound box includes a bar shape, a square shape, a ring shape, etc. The shape of the sound box is not particularly limited in this application. The following uses a sound bar as an example for explanation. It should be understood that the sound box position adjustment method provided in this application may further be applied to the position adjustment of a sound box such as a square-shaped sound box or a ring-shaped sound box.

[0192] The positioning audio is full-band audio that meets specified conditions. For example, the positioning audio may be full-band audio with a sound pressure level of 65 dB or greater and a signal-to-noise ratio of 20 dB or greater, including white noise, pink noise, or a sweep signal. When the positioning audio is being played, the volume of the positioning audio is stable and does not change.

[0193] Optionally, the position of the sound bar may be represented by the angle of a first included angle between the sound bar and the wall. When the sound bar is parallel to the wall, the angle of the first included angle is 0°. The sound bar rotates counterclockwise from an angle of 0°, and when the sound bar rotates so that it is perpendicular to the wall, the angle of the first included angle is 90°, and the angle of the first included angle changes from 0° to 90° during the course of the rotation. When the sound bar rotates clockwise from an angle of 0°, and when the sound bar rotates so that it is perpendicular to the wall, the angle of the first included angle is -90°, and the angle of the first included angle changes from 0° to -90° during the course of the rotation. It can be seen that when the opening of the first included angle faces left, the angle value of the first included angle is positive, and when the opening of the first included angle faces right, the angle value of the first included angle is negative.

[0194] Optionally, the position of the soundbar may alternatively be represented by the angle of a second included angle between the vertical of the center of the soundbar and the vertical of the wall. When the soundbar is parallel to the wall, the vertical of the center of the soundbar is parallel to or coincides with the vertical of the wall. In this case, the angle of the second included angle is 0°. When the soundbar rotates counterclockwise from an angle of 0°, and the soundbar rotates so that it is perpendicular to the wall, the vertical of the center of the soundbar and the vertical of the wall become perpendicular to each other. In this case, the angle of the second included angle is 90°, and the angle of the second included angle changes from 0° to 90° during the course of the rotation. When the soundbar rotates clockwise from an angle of 0°, and the soundbar rotates so that it is perpendicular to the wall, the vertical of the center of the soundbar and the vertical of the wall become perpendicular to each other. In this case, the angle of the second included angle is -90°, and the angle of the second included angle changes from 0° to -90° during the course of the rotation. It can be seen that when the vertical line of the center of the soundbar is located to the right of the vertical line of the wall, the angle value of the second included angle is positive, and when the vertical line of the center of the soundbar is located to the left of the vertical line of the wall, the angle value of the second included angle is negative.

[0195] Thus, the first position and the second position may both be represented by angle values ​​of the first angle or the second angle, and the sound bar rotating at a constant speed from the first position to the second position may be described as the sound bar rotating at a constant speed from the first angle to the second angle, where the first angle and the second angle are each two angle values ​​of a first included angle, or the first angle and the second angle are each two angle values ​​of a second included angle.

[0196] In one possible embodiment, before sending the first playback command to the soundbar, the electronics can first obtain an initial position of the center of the soundbar and a user's position, calculate a theoretical sweet spot of the soundbar relative to the user's position based on the initial position and the user's position, obtain a fine-tuning angle, and then obtain a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0197] When the soundbar is located in the theoretical sweet spot, the connecting line between the user's position and the center of the soundbar is perpendicular to the loudspeaker surface of the soundbar, which faces the user. The loudspeaker surface of the soundbar is the surface on which the loudspeakers of the soundbar are located. Typically, the loudspeakers are located on a surface of the soundbox. In this case, the loudspeaker surface is that surface. Alternatively, the loudspeakers of the soundbox are located on multiple surfaces of the soundbox. In this case, the loudspeaker surface is the surface of the soundbox that faces the user.

[0198] The first position is a position where the sound bar is rotated from the theoretical sweet spot by a fine-tuning angle in a preset direction, and the second position is a position where the sound bar is rotated from the theoretical sweet spot by a fine-tuning angle in the opposite direction to the preset direction.

[0199] In the present application, an interactive interface provided by the APP (for example, a room configuration interface that may be described in FIG. 11 below) may be used. The user inputs a first virtual position into the interface, and the first virtual position is used to simulate the position of the center of the sound bar in the room, and an initial position of the center of the sound bar may be calculated based on the first virtual position. The initial position may be expressed in the form of coordinates. Alternatively, the user may input a second virtual position into the interactive interface. The second virtual position is used to simulate the position of the user in the room. The position of the user may be calculated based on the second virtual position, and the position of the user may be expressed in the form of coordinates.

[0200] For example, the theoretical sweet spot of a soundbar may be obtained according to equations (1)-(3):

number

number

[0201] However, since the user's position is inputted into the interactive interface by the user, there may be an error between the position and the user's actual position, so the position of the sound bar needs to be fine-tuned based on the theoretical sweet spot to determine the accurate target position.

[0202] As shown in Figure 13, one side of the included angle corresponding to the fine-tuning angle θ is the connecting line between the user's position and the center of the sound bar. The fine-tuning angle θ is calculated according to Equation (4):

number

[0203] Optionally, the fine-tuning angle θ may be directly input by the user into an interactive interface (eg, a precision sweet-spot positioning interface, see FIG. 12k below).

[0204] Optionally, the first angle corresponding to the first position may be A-θ and the second angle corresponding to the second position may be A+θ, or the first angle corresponding to the first position may be A+θ and the second angle corresponding to the second position may be A-θ.

[0205] In one possible embodiment, if the initial position of the center of the sound bar and the user's position meet the objective that the connecting line between the center of the sound bar and the user's position is perpendicular to the loudspeaker surface of the sound bar, there is no need to perform sweet spot positioning. Therefore, before sweet spot positioning, it may be determined whether sweet spot positioning is required based on the principle, the initial position of the center of the sound bar, and the user's position. If sweet spot positioning is required, the process of sweet spot positioning begins.

[0206] S402. The sound bar rotates from a first position to a second position in a preset direction based on a first playback command, and plays positioning audio during the process of the rotation.

[0207] After receiving the first playback command, the soundbar obtains the first position and the second position from the first playback command, and plays positioning audio, e.g., a pre-recorded rain sound, while rotating in a preset rotation direction, e.g., from A-θ to A+θ or from A+θ to A-θ.

[0208] S403. The electronic device receives positioning audio.

[0209] A microphone on the electronic device receives the positioning audio.

[0210] S404. The electronic device determines instructional information based on the positioning audio.

[0211] The soundbar rotates while playing positioning audio. Therefore, there may be a volume difference between the positioning audio received by the microphone of the electronic device. That is, when the position where the soundbar rotates is far away from the electronic device, the volume of the positioning audio received by the electronic device decreases, while when the position where the soundbar rotates is close to the electronic device, the volume of the positioning audio received by the electronic device increases. The purpose of the fine tuning is to find the position of the soundbar that corresponds to when the volume of the positioning audio received by the electronic device is maximum. Since the volume is detected by the user's electronic device, it may be considered that the sweet spot of the soundbar is exactly at the user's position when the soundbar is at that position.

[0212] In one possible embodiment, the electronic device may detect the positioning audio received within a specified time interval from the start of reception of the positioning audio to obtain the volume. When the end of reception of the positioning audio arrives, the electronic device determines the difference between the end of the specified time corresponding to the maximum volume among the multiple obtained volumes and the start of reception as the target time. The electronic device may synchronize the reception of the positioning audio with the detection of the volume.

[0213] In one possible implementation, the electronic device can detect the positioning audio to obtain the maximum volume, and then determine the difference between the time point corresponding to the maximum volume and the start time point of receiving the positioning audio as the target time. Alternatively, the electronic device can detect the positioning audio for the entire section after receiving all the positioning audio.

[0214] The angle value corresponding to the target position of the sound bar may be calculated according to equation (5) or (6).

[0215] If the first angle is A-θ and the second angle is A+θ, the angle value B corresponding to the target position is calculated according to equation (5): B = (A - θ) + vt (5)

[0216] When the positioning audio finishes playing, the soundbar rotates to a second position (corresponding to a second angle A+θ). Therefore, the soundbar needs to rotate in the reverse direction from the second position to the target position (corresponding to an angle B), i.e., from an angle A+θ to an angle B. According to equation (5), the angle that the soundbar needs to rotate may be calculated as β=2θ-vt.

[0217] If the first angle is A+θ and the second angle is A−θ, then the angle value B corresponding to the target position is calculated according to equation (6): B = (A - θ) - vt (6) Here, v represents the rotation speed of the sound bar, which may be preset, and t represents the target time.

[0218] When the positioning audio playback is finished, the soundbar rotates to a second position (corresponding second angle is A-θ). Therefore, the soundbar needs to rotate in the reverse direction from the second position to the target position (corresponding angle is B), i.e., from angle A-θ to angle B. According to equation (6), the angle that the soundbar needs to rotate can be calculated as β=2θ-vt.

[0219] It can be seen that based on the target time obtained using the above method, the electronic device can determine the indication information in several ways as follows, and then the sound bar can obtain the angle β=2θ-vt that the sound bar needs to rotate based on the indication information.

[0220] (1) The electronic device determines a target time as instruction information.

[0221] In the sound bar, the fine-tuning angle θ in the above formula may be obtained from information previously exchanged with the electronic device, and the details will not be described again in this specification. The rotation speed may be preset. The target time may be obtained from the instruction information. The rotation direction may also be preset. Therefore, the sound bar can calculate the angle β that the sound bar needs to rotate based on these information.

[0222] (2) The electronic device determines a target time and a direction opposite to a preset direction as instruction information.

[0223] In the sound bar, the fine-tuning angle θ in the above formula may be obtained from information previously exchanged with the electronic device, and the details will not be described again in this specification. The rotation speed may be preset. The target time and the rotation direction (the opposite direction to the preset direction) may be obtained from the instruction information. Therefore, the sound bar can calculate the angle β that the sound bar needs to rotate based on these information.

[0224] (3) The electronic device determines a target time, a direction opposite to a preset direction, and a fine adjustment angle as instruction information.

[0225] In the sound bar, the fine-tuning angle θ and the target time in the above formula, as well as the rotation direction (opposite to the preset direction) may all be obtained from the instruction information. The rotation speed may be preset. Therefore, the sound bar can calculate the angle β that the sound bar needs to rotate based on these information.

[0226] (4) The electronic device determines, as instruction information, a direction opposite to a preset direction and a target rotation angle.

[0227] In the sound bar, the rotation direction (opposite to the preset direction) may be obtained from the instruction information. In this case, the sound bar does not need to calculate the angle β that the sound bar needs to rotate according to the above formula, and the angle may be obtained from the instruction information.

[0228] Note that the duration T of the positioning audio, the target time t, the fine-tuning angle θ, and the rotation speed v are mutually constrained, that is, the angle value B corresponding to the target position is obtained by using the fine-tuning result, and the angle value B corresponding to the target position needs to be within the angle range [A-θ, A+θ]. Therefore, -θ≦vt≦θ and t≦T.

[0229] Thus, the instruction information determined by the electronic device may include an angle value B corresponding to the target position, or may include a target time t, both of which may enable the sound bar to determine the target position of the sound bar.

[0230] S405. The electronic device transmits instruction information to the sound bar.

[0231] S406. The soundbar rotates to the target position based on the instruction information.

[0232] The instruction information further has a function of instructing the sound bar to rotate from the second position to the target position. Thus, after receiving the instruction information, the sound bar first determines the target position, and then rotates from the current position to the target position.

[0233] For example, in the process of fine-tuning, the sound bar rotates from a position corresponding to A-θ to a position corresponding to A+θ. After receiving the instruction information, the sound bar rotates in the reverse direction by an angle (2θ-vt) from a position corresponding to A+θ to a position corresponding to B.

[0234] In another example, during the fine-tuning process, the sound bar rotates from a position corresponding to A+θ to a position corresponding to A−θ. After receiving the instruction information, the sound bar rotates in the reverse direction by an angle (2θ−vt) from a position corresponding to A−θ to a position corresponding to B.

[0235] In this application, the sound bar and the electronic device cooperate with each other. The sound bar rotates from a first position to a second position at a certain speed while playing positioning audio. The electronic device finds the position of the sound bar corresponding to the maximum volume based on the received positioning audio, and controls the sound bar to rotate to that position. In this way, more accurate crosstalk cancellation can be implemented for the user's position, the effect of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0236] 5 is a flow chart of an example of a process 500 of a sound box position adjustment method according to the present application. The process 500 may be performed by the electronic device and the sound bar shown in FIG. 3 together. The process 500 is described as a series of steps or operations. It should be understood that the steps or operations of the process 500 are not limited to the order of execution shown in FIG. 5 and may be performed in various orders and / or simultaneously. The process 500 may include:

[0237] S501. An electronic device sends a first playback command to a sound bar.

[0238] For S501, please refer to S401 in the embodiment shown in Figure 4. The details will not be described again in this specification.

[0239] S502. The sound bar rotates from a first position to a second position in a preset direction based on a first playback command, and plays positioning audio during the rotation.

[0240] S501 and S502 are the same as S401 and S402 in the embodiment shown in FIG. 402 Please refer to the above. The details will not be described again in this specification. The difference is that in the calculation of the user's position, the user's position is changed to the center position of multiple users.

[0241] S503. The user terminal receives positioning audio.

[0242] The difference between this embodiment and the embodiment shown in FIG. 4 is that the number of users in the room is changed from one to multiple. In this case, the microphones of multiple user terminals in the room respectively receive the positioning audio. Because the positions of the user terminals are different, the position of the soundbar corresponding to the maximum volume of the received positioning audio is also different. In this case, the target position of the soundbar is found by referring to the sum of the soundbar volumes received by the user terminals at the time of sampling.

[0243] S504. The electronic device receives a plurality of collected audio data.

[0244] The user terminal stores the received positioning audio, and after receiving the positioning audio, transmits the positioning audio in the form of audio data to the electronic device, which performs calculations.

[0245] S505. The electronic device determines instructional information based on the plurality of collected audios.

[0246] For S505, refer to S404 in the embodiment shown in Fig. 4. The difference is that the target time is determined based on the time corresponding to the sum of the maximum volumes, not the time corresponding to the maximum volume.

[0247] S506. The electronic device transmits instruction information to the sound bar.

[0248] S507. The sound bar rotates to the target position based on the instruction information.

[0249] For S506 and S507, please refer to S405 and S406 in the embodiment shown in Figure 4. The details will not be described again in this specification.

[0250] In this application, the sound bar and the electronic device cooperate with each other. The sound bar rotates from a first position to a second position at a certain speed while playing positioning audio. The electronic device finds the position of the sound bar corresponding to the maximum sum of the volume based on the received multiple sampled audios, and controls the sound bar to rotate to that position. In this way, for multiple user positions, more accurate crosstalk cancellation can be implemented, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0251] 6 is a flow chart of an example of a process 600 of a sound box position adjustment method according to the present application. The process 600 may be performed by the electronic device and the sound bar shown in FIG. 3 together. The process 600 is described as a series of steps or operations. It should be understood that the process 600 is not limited to the order of execution shown in FIG. 6 and may be performed in various orders and / or simultaneously. The process 600 may include:

[0252] S601. An electronic device divides a space into a plurality of subspaces based on a number of sound bars.

[0253] The electronic device first divides the space in the room based on the number of sound bars, and each sound bar corresponds to a subspace. For example, as shown in FIG. 15, there are three sound bars, and the center of the middle sound bar is used as the apex. The horizontal space in front of the sound bars may be divided into three subspaces in a manner that evenly divides an angle of 180° horizontally. The left subspace corresponds to sound bar 1 and has one user, the middle subspace corresponds to sound bar 2 and has two users, and the right subspace corresponds to sound bar 3 and has no user. That is, in the scenario shown in FIG. 15, the three sound bars correspond to three subspaces respectively, and based on the number of users in the subspace, the relationship between the three sound bars and the number of users is one-to-one, one-to-many, and one-to-zero, respectively.

[0254] S602. The electronic device sends a first playback command to each of a plurality of sound bars.

[0255] S603. The electronic device determines a plurality of pieces of instruction information, the plurality of pieces of instruction information corresponding to the plurality of sound bars.

[0256] The electronics determine a target position for each sound bar based on the division of the space and the number of users in the subspace.

[0257] For example, in the left subspace of FIG. 15, the target position of the sound bar 1 is S 15, the target position of the sound bar 2 may be determined with reference to A502 to S404 of the embodiment shown in FIG. 5, and then the instruction information of the sound bar may be determined. In the center subspace of FIG. 15, the target position of the sound bar 2 may be determined with reference to A502 to S505 of the embodiment shown in FIG. 5, and then the instruction information of the sound bar may be determined. The difference is that the multiple users are limited to only two users in the center subspace. In the right subspace of FIG. 15, the target position of the sound bar 2 may be determined with reference to A502 to S505 of the embodiment shown in FIG. 5, and then the instruction information of the sound bar may be determined. SThe sound bar indication information may be determined by referring to S502 to S505, and then the sound bar indication information may be determined. The difference is that the multiple users include all users in the left subspace, the center subspace, and the right subspace.

[0258] S604. The electronic device transmits a plurality of pieces of instruction information to the corresponding sound bars.

[0259] S605. The soundbar rotates to the target position based on the instruction information.

[0260] For S604 and S605, please refer to S405 and S406 in the embodiment shown in Figure 4. The details will not be described again in this specification.

[0261] In this application, the multiple sound bars and the electronic device cooperate with each other. The multiple sound bars rotate from a first position to a second position at a certain speed while playing positioning audio. For each sound bar, the electronic device finds the corresponding sound bar position when the volume or sum of the volume of the sampled audio received by the user's terminal in the corresponding subspace is maximum, and controls the sound bar to rotate to that position. In this way, for multiple user positions, more accurate crosstalk cancellation can be implemented, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0262] 7 is a flow chart of an example of a process 700 of a sound box position adjustment method according to the present application. The process 700 may be performed by the electronic device and the sound bar shown in FIG. 3 together. The process 700 is described as a series of steps or operations. It should be understood that the steps or operations of the process 700 are not limited to the order of execution shown in FIG. 7 and may be performed in various orders and / or simultaneously. The process 700 may include:

[0263] S701. An electronic device sends a first playback command to each of a plurality of sound bars.

[0264] Optionally, the multiple soundbars are arranged in a row, with loudspeaker surfaces of the multiple soundbars facing the user.

[0265] S702. An electronic device receives a mixed signal.

[0266] In this embodiment, there are multiple sound bars and only one user, so the electronic device receives a mixed signal obtained by mixing the positioning audio played by the multiple sound bars.

[0267] S703. The electronic device determines a plurality of indications based on the mixed signal.

[0268] For S703, please refer to S404 in the embodiment shown in FIG. 4, the difference being that the electronic device determines the indication information of each of the multiple sound bars, and the position in each calculation includes the initial position of the center of a single sound bar and the user's position.

[0269] S704. The electronic device transmits a plurality of pieces of instruction information to the corresponding sound bars, respectively.

[0270] S705. The soundbar rotates to a target position based on the instruction information.

[0271] For S704 and S705, please refer to S405 and S406 in the embodiment shown in Figure 4. The details will not be described again in this specification.

[0272] In this application, the multiple sound bars and the electronic device cooperate with each other. The multiple sound bars rotate from a first position to a second position at a certain speed while playing positioning audio. The electronic device finds the position of the sound bar corresponding to the maximum volume based on the mixed signal of the received positioning audio, and controls the sound bar to rotate to each corresponding position. In this way, more accurate crosstalk cancellation can be implemented for the user's position, the effect of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0273] 8 is a flow chart of an example of a process 800 of a rendering method according to the present application. The process 800 may be performed by the electronic device and the sound bar shown in FIG. 3 together. The process 800 is described as a series of steps or operations. It should be understood that the steps or operations of the process 800 are not limited to the order of execution shown in FIG. 8 and may be performed in various orders and / or simultaneously. The process 800 may include:

[0274] S801. The electronic device sends a second playback command to the sound bar.

[0275] The test audio is full-band audio that meets specified criteria, for example, the test audio may be full-band audio with a sound pressure level of 65 dB or greater and a signal-to-noise ratio of 20 dB or greater, including white noise, pink noise, or a sweep signal.

[0276] S802. The sound bar plays the test audio based on a second playback instruction.

[0277] S803. A microphone on a headset worn by a user receives the test audio.

[0278] In this embodiment, the test audio reproduced by the sound bar is received by the microphone of the headset worn by the user. After receiving the test audio, the headset stores the test audio and transmits the test audio to the electronic device in the form of audio data.

[0279] S804. The electronic device receives the collected audio data.

[0280] S805. The electronic device calculates the BRIR based on the collected audio and the test audio.

[0281] The electronic device can calculate the BRIR according to Equation (7):

Equation

[0282] S806. The electronic device obtains the filter coefficients of the sound bar based on the BRIR.

[0283] The electronic device calculates the filter coefficients according to Equation (8): C(f)=(H(f) H H(f)+βI k (f)) -1 H(f) H D(f) (8) Here, H(f) ∈ C K×Kwhere H(f) represents the matrix constructed by using the BRIR calculated according to equation (7) as elements, the matrix covers the room transfer functions of all users corresponding to all speaker units respectively, and * H represents the conjugate matrix, and I k (f)∈C K×K and I k (f) represents the identity matrix, and D(f)∈R 2P×R where D(f) represents the ideal transfer function, R represents the number of sound channels, and R=2 if the audio is stereo.

number

[0284] S807. The electronic device sends the filter coefficients to the soundbar.

[0285] S808. The soundbar processes the audio based on the filter coefficients.

[0286] The soundbar processes the audio played by the soundbar based on the updated filter coefficients according to equation (9): X(f)=C(f)S(f) (9) where X(f) represents the processed audio, S(f) represents the audio played by the soundbar, and C(f) represents the filter coefficients.

[0287] The filter coefficients are obtained after precise sweet spot positioning, so that more accurate crosstalk cancellation can be implemented for the user's position, the effect of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0288] In one possible implementation, the electronic device can receive a virtual space command including a listening space selected by a user in a virtual space mode interface, obtain a transfer function of the listening space, and then obtain filter coefficients of the sound bar based on the BRIR.

[0289] For example, the listening space is the "Golden Hall". The electronics calculates the filter coefficients according to equation (10):

number

number

number

number

number

[0290] The soundbar processes the audio played by the soundbar based on the updated filter coefficients according to equation (11):

number

number

number

[0291] The aforementioned filter coefficients are obtained after dedicated private customization. Therefore, more accurate crosstalk cancellation can be implemented for the user's position, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored. In addition, the sound field can be rendered at the user's position, thereby providing the user with an immersive experience.

[0292] The following describes the sound box positioning method and audio rendering method provided in this application by using specific embodiments.

[0293] In a real room, there are one or more users, and the room may be, for example, a living room, a bedroom, a conference room, a movie theater, or a theater. Each user holds an electronic device, which may be, for example, a mobile phone or a tablet computer. In addition, there is an administrator. The administrator may be one of the users, in which case the administrator also holds the aforementioned electronic device. The administrator may be another person, in which case the administrator holds a control device. The control device may be the aforementioned electronic device, may be a computer, or may be a video playback device, which includes a sound bar.

[0294] 1.Login application (APP) (such as Huawei Vision) is installed on each of the devices held by everyone (including one or more users and administrators). The APP has two modes: "general user" and "administrator". Everyone can select the mode to be entered by using the control on the login interface. Figure 9 is a schematic diagram of an example of a login interface according to the present application. As shown in Figure 9, in addition to the user name input area and the password input area, the login interface further includes a "general user" control and an "administrator" control. If there is only one user in the actual room, the user is the administrator and the "administrator" control is clicked. If there are multiple users in the actual room and one of the multiple users is the administrator, the "administrator" control is clicked and the other users click the "general user" control, or if the multiple users are all general users, the "general user" control is clicked and further the administrator (the administrator may be in a different room) clicks the "administrator" control.

[0295] 2.Select functions After everyone logs in to the APP using their registered username / password respectively, the APP will enter a function selection interface. The APP provides four functions including room configuration, precise sweet spot positioning, dedicated private customization, and virtual space mode. FIG. 10 is a schematic diagram of an example of a function selection interface according to the present application. As shown in FIG. 10, the function selection interface displays four controls: "room configuration", "precise sweet spot positioning", "dedicated private customization", and "virtual space mode".

[0296] 3. Room configuration The "Room Configuration" control on the function selection interface is clicked. The APP displays the room configuration interface. Figure 11 is a schematic diagram of an example of a room configuration interface according to the present application. As shown in Figure 11, the room configuration interface includes a simulated room area and an input area.

[0297] Optionally, the room configuration interface shown in FIG. 11 may be displayed on the APP only in the “Administrator” mode. The APP only in the administrator mode allows the administrator to arrange the simulated room area and input the length and width of the room. In this case, after the administrator completes the setting, the APP in the “Administrator” mode can send the input information obtained by using the room configuration interface to the APP in the “General User” mode, so that the APP in the “General User” mode can also display the simulated room area and the arrangement within the simulated room area. The APP in the “Administrator” mode and the APP in the “General User” mode are both located on the same local area network.

[0298] Optionally, the room configuration interface shown in FIG. 11 may be displayed in the APP in the "administrator" mode, and may also be displayed in the APP in the "general user" mode. In this way, any person using the APP can arrange the simulated room area and input the length and width of the room. In this case, after completing the setting, the APP can send the input information obtained by using the room configuration interface to the APP in the "administrator" mode, so that the APP in the "administrator" mode can integrate the input information and determine the position of the same home appliance (e.g., sound bar) to eliminate the input error of different people.

[0299] The input area of ​​the room configuration interface is used to input the length (e.g., 6 m) and width (e.g., 4 m) of a real room. The simulated room area is used by the administrator or user to simulate the arrangement of a real room within the area. For example, in a living room, a TV with a sound bar is placed next to the TV wall, and a sofa is placed directly opposite the TV. Based on this arrangement, the administrator or user can use an icon to identify the TV (also identifying the sound bar) near the top of the simulated room area. This icon can be a 2D or 3D model, a schematic diagram, or a point (the point corresponds to the center of the sound bar) of the TV. An icon is used to identify a sofa located directly opposite the TV near the bottom of the simulated room area. This icon can also be a 2D or 3D model, a bar-shaped schematic diagram, or a point (the point corresponds to the center of the sofa). For example, when a user clicks on a TV, the APP displays a schematic diagram of the TV in the simulated room area, and the user drags the schematic diagram of the TV to a position in the simulated room area that corresponds to the actual location of the TV; when a user clicks on a sofa, the APP displays a schematic diagram of the sofa in the simulated room area, and the user drags the schematic diagram of the sofa to a position in the simulated room area that corresponds to the actual location of the sofa.

[0300] It should be noted that the manner of identifying real furniture in the simulated room area is not particularly limited in the present application. In addition, except that in the simulated room area, the number and position of the sound bar icons must match the number and position of the sound bar in the real room, whether the icons of each other furniture are displayed in the simulated room area depends on the user's operation. For example, the user may place an icon identifying a sofa in the simulated room area, or may not place an icon identifying a sofa.

[0301] 4.Precise sweet spot positioning The "Precise sweet spot positioning" control on the function selection interface is clicked. The APP displays the precise sweet spot positioning interface. Figures 12a-12m are schematic diagrams of several examples of the precise sweet spot positioning interface according to the present application. The precise sweet spot positioning interface includes a simulated room area, and the icon displayed in the area is set by the user in the room configuration interface.

[0302] Scenario 1: One soundbar and one user in a room.

[0303] The user is an administrator, and the administrator holds a control device. The control device is, for example, a mobile phone, and the APP installed on the mobile phone enters the "administrator" mode.

[0304] As shown in FIG. 12a, the user clicks on a corresponding location in the simulated room area based on the user's location in the room, and the APP displays an identifier (e.g., a smiling face) at the corresponding location to indicate that the user is there.

[0305] The coordinate system of the real room is the first coordinate system, and the coordinate system of the simulated room is the second coordinate system. The ratio of the two coordinate systems is 100:1. Each origin (0, 0) is the left end point of the wall (TV wall) near the sound bar. The direction from the origin to the right is the positive x-axis direction, and the direction from the origin to the bottom is the positive y-axis direction.

[0306] For example, the actual length and width of the room are 6m and 4m, respectively, and the simulated length and width of the room are 0.06m and 0.04m, respectively. If the center of the sound bar is in the middle of the top side, i.e., in the second coordinate system, the coordinates of the center of the sound bar are (0.03, 0), the coordinates of the center of the sound bar in the first coordinate system may be calculated as (3, 0). If the center of the sofa is in the middle of the bottom side, i.e., in the second coordinate system, the coordinates of the center of the sofa are (0.03, 0.04), the coordinates of the center of the sofa in the first coordinate system may be calculated as (3, 4).

[0307] Therefore, based on the center of the sound bar and the user's position within the simulated room area, and based on the proportional relationship between the side lengths of the simulated room area and the actual length and width of the room, the APP calculates the coordinates of the user's position in the first coordinate system (x c , y c ) and the coordinates of the center of the soundbar (x s0 , y s0 ) can be obtained.

[0308] The APP receives the coordinates of the user's position (x c , y c ) and the coordinates of the center of the soundbar (x s0 , y s0 ), calculate the initial horizontal angle A according to (a), where the vertex of the included angle corresponding to the initial horizontal angle A is the center of the sound bar, one side of the included angle is perpendicular to the sound bar, and the other side of the included angle is the connecting line between the user's position and the center of the sound bar. It should be noted that when the connecting line between the user's position and the center of the sound bar is located to the right of the side perpendicular to the sound bar, the value of the initial horizontal angle A is positive, and when the connecting line between the user's position and the center of the sound bar is located to the left of the side perpendicular to the sound bar, the value of the initial horizontal angle A is negative.

[0309] For example, as shown in FIG. 13, the initial horizontal angle A may be calculated based on the following method.

[0310] The linear distance d between the user's position and the center of the soundbar is calculated according to formula (1):

number

[0311] The vertical distance h between the user's position and the center of the soundbar is then calculated according to equation (2): h=|y c -y s0 | (2)

[0312] An initial horizontal angle A is then calculated based on the linear distance d and the vertical distance h according to equation (3):

number

[0313] One side of the included angle corresponding to the fine-tuning angle θ is the connecting line between the user's position and the center of the sound bar. For example, as shown in FIG. 13, the fine-tuning angle θ may be calculated based on the linear distance d and the vertical distance h according to Equation (4):

number

[0314] The user clicks the “OK” control on the precision sweet spot positioning interface, and the APP sends the calculated initial horizontal angle A and fine-tuning angle θ to the sound bar in the form of an instruction.

[0315] After receiving the command, the soundbar can rotate to an angle A-θ or A+θ.

[0316] As shown in Fig. 12b, the user holds the mobile phone and remains still in the aforementioned position in the room (corresponding to the smiling face in Fig. 12a), and clicks the "fine-tune" control on the precision sweet spot positioning interface. The APP sends a play command to instruct the sound bar to start fine-tuning. Optionally, the APP can display the sound bar rotating by A-θ or A+θ in the simulated room area.

[0317] After receiving the play command, the sound bar starts playing the pre-acquired and locally stored positioning audio (e.g., rain sound), and rotates from a first angle to a second angle at a constant speed v in the process of playing the positioning audio. The first angle and the second angle are A-θ and A+θ, or A+θ and A-θ, respectively. Specifically, the first angle is A-θ and the second angle is A+θ, or the first angle is A+θ and the second angle is A-θ.

[0318] The microphone on the user's mobile phone receives the recorded audio.

[0319] In one possible embodiment, the APP can detect the recorded audio received within a specified time from the start of the recorded audio at a specified time interval to obtain the volume. When the end of the recorded audio arrives, the APP determines the difference between the end of the specified time corresponding to the maximum volume of the multiple obtained volumes and the start of reception as the target time. For example, the APP records the start of the recorded audio as 0 ms, records the initial maximum volume as 0, records a time after a specified time interval (e.g., 1 ms) as 1 ms, detects the recorded audio received within 1 ms to obtain the volume corresponding to the time 1 ms (e.g., performs sampling detection on the recorded audio received within 1 ms to obtain multiple volume values, and then averages the multiple volume values), records the maximum volume as the volume at the time 1 ms, records a time after the interval of 1 ms as 2 ms, detects the recorded audio received within 1 ms to obtain the volume corresponding to the time 2 ms, compares the volume at the time 2 ms with the current maximum volume, and selects the larger volume as the maximum volume. By analogy, when the end time of the recorded audio arrives (e.g., time 10 ms), the APP obtains the time corresponding to the maximum volume (e.g., time 3 ms), calculates the difference between time 3 ms and the start time of reception 0 ms, and determines the difference as the target time.

[0320] In one possible embodiment, the APP detects the recorded audio to obtain the maximum volume, and determines the difference between the time point corresponding to the maximum volume and the start time of the recorded audio as the target time. For example, the APP receives a total of 10 ms of recorded audio, performs sampling detection on the recorded audio to obtain the volume at multiple times, for example, the volume at 1 ms, the volume at 2 ms, ..., the volume at 10 ms, and compares these volumes to obtain the maximum volume, and then determines the difference between the time point corresponding to the maximum volume (for example, 3 ms) and the start time of receiving 0 ms as the target time.

[0321] The APP can calculate the target horizontal angle B based on the target time, the initial horizontal angle A, and the fine-tuning angle θ. The formula used for the calculation is related to the rotation direction of the soundbar.

[0322] If the first angle is A-θ and the second angle is A+θ, the target horizontal angle B is calculated according to equation (5): B = (A - θ) + vt (5)

[0323] If the first angle is A+θ and the second angle is A−θ, the target horizontal angle B is calculated according to equation (6): B = (A - θ) - vt (6) Here, v represents the rotation speed and t represents the target time.

[0324] Note that the duration T of the recorded audio, the target time t, the fine-tuning angle θ, and the rotation speed v are constrained to each other, i.e., the objective of the fine-tuning is to obtain a target horizontal angle B, which must fall within the angle range [A-θ, A+θ]. Thus, -θ≦vt≦θ and t≦T.

[0325] As shown in Fig. 12c, after obtaining the target horizontal angle B, the APP sends the target horizontal angle B to the sound bar. Optionally, the APP can display the sound bar rotating by the target horizontal angle B in the simulated room area, and display a pop-up window on the precision sweet spot positioning interface, where the text "fine-tuning completed" is displayed in the pop-up window.

[0326] After receiving the target horizontal angle B, the soundbar rotates to reach the target horizontal angle B. In this case, the sweet spot of the soundbar is just the position of the user. To achieve this purpose, the soundbar can determine the rotation direction and rotation angle based on the angle before rotation. For example, when the soundbar rotates from A-θ to A+θ during fine tuning, the soundbar rotates in the reverse direction from A+θ, and the rotation angle is (A+θ)-B=2θ-vt; when the soundbar rotates from A+θ to A-θ during fine tuning, the soundbar rotates in the reverse direction from A-θ, and the rotation angle is B-(A-θ)=2θ-vt.

[0327] The precise sweet spot positioning function is then completed. After that, as long as the user does not move, the stereo sound (such as the sound of a TV or movie) played by the sound bar will form the optimal listening effect at the user's position.

[0328] Scenario 2: There is a soundbar and multiple users in the room.

[0329] One of the multiple users is an administrator, and the administrator holds a control device. The control device is, for example, a mobile phone. An APP installed on the administrator's mobile phone enters the "administrator" mode. Other users other than the administrator hold electronic devices, which are also, for example, mobile phones. An APP installed on another user's mobile phone enters the "general user" mode.

[0330] As shown in Fig. 12a, a user (any one of multiple users) clicks a corresponding position in the simulated room area based on the user's position in the room, and the user's APP displays an identifier (e.g., a smiley face) at the corresponding position to indicate that the user is there. The user clicks an "OK" control on the precision sweet spot positioning interface, and the APP sends the coordinates of the user's identifier position in the second coordinate system to the administrator's APP.

[0331] All of the above-mentioned multiple users may perform the above-mentioned operations. Thus, the APPs of the multiple users all display identifiers (e.g., smiley faces) in the simulated room area to indicate the positions of the corresponding users, and the APPs of all other users different from the administrator send the coordinates of the positions of their respective identifiers in the second coordinate system to the APP of the administrator.

[0332] As shown in Fig. 12d, in addition to displaying the administrator's identifier, the administrator's APP further displays the identifiers of all other users (e.g., user 1 to user 3). That is, after receiving the coordinates transmitted by the APPs of all other users, the administrator's APP displays the identifiers (e.g., smiling faces) at the positions corresponding to the aforementioned coordinates in the simulated room area.

[0333] The administrator's APP can obtain the initial horizontal angle A and the fine-tuning angle θ according to equations (1) to (4) in scenario 1. The difference is that the coordinates (x c , y c ) represents the center position of multiple users. In this case,

number

[0334] As shown in FIG. 14, in scenario 2, it can be seen that the apex of the included angle corresponding to the initial horizontal angle A is the center of the sound bar, one side of the included angle is perpendicular to the sound bar, and the other side of the included angle is the connecting line between the central positions of the multiple users and the center of the sound bar.

[0335] The administrator clicks the "OK" control on the precision sweet spot positioning interface, and the administrator's APP sends the calculated initial horizontal angle A and fine-tuning angle θ to the sound bar in the form of a command.

[0336] After receiving the command, the soundbar can rotate to an angle A-θ or A+θ.

[0337] Multiple users hold their mobile phones and rest at selected positions in the room (positions corresponding to the smiling faces in FIG. 12a). As shown in FIG. 12b, the administrator clicks the "fine-tune" control on the precision sweet spot positioning interface, and the administrator's APP sends a play command to instruct the soundbar to start fine-tuning. Optionally, the multiple users' APPs can each display a soundbar rotating by A-θ or A+θ in the simulated room area.

[0338] After receiving the play command, the sound bar starts playing the pre-acquired and locally stored positioning audio (e.g., rain sound), and rotates from a first angle to a second angle at a constant speed v in the process of playing the positioning audio. The first angle and the second angle are A-θ and A+θ, or A+θ and A-θ, respectively. Specifically, the first angle is A-θ and the second angle is A+θ, or the first angle is A+θ and the second angle is A-θ.

[0339] The microphones of the mobile phones of the multiple users all receive the recorded audio. Optionally, the APPs of all other users, different from the administrator, send the collected audios respectively acquired to the APP of the administrator. The APP of the administrator detects the recorded audios from the APPs of all other users and the recorded audios received by the microphone of the mobile phone of the administrator, acquires the volume of each recorded audio at each sampling time, calculates the sum of the volumes at each sampling time, and then determines the sampling time corresponding to the sum of the maximum volume to obtain the target time. The APP of the administrator can detect and acquire the volume of the recorded audio with reference to the description of scenario 1. Optionally, the APPs of the multiple users separately detect the recorded audios received to acquire the volume at each sampling time. Then, the APPs of all other users, different from the administrator, send the volume at the sampling time respectively acquired by the APP to the APP of the administrator. The APP of the administrator calculates the sum of the volumes at each sampling time, and then determines the sampling time corresponding to the sum of the maximum volume to obtain the target time. The APPs of the multiple users can also detect and acquire the volume of the recorded audio with reference to the description of scenario 1.

[0340] The manager's APP can calculate the target horizontal angle B according to equations (5) to (6) in scenario 1.

[0341] As shown in Fig. 12c, after obtaining the target horizontal angle B, the administrator's APP sends the target horizontal angle B to the sound bar. Optionally, the administrator's APP can display the sound bar rotating by the target horizontal angle B in the simulated room area, and display a pop-up window on the precision sweet spot positioning interface, where the text "fine-tuning completed" is displayed in the pop-up window.

[0342] Optionally, the administrator's APP can also send the target horizontal angle B to all other users' APPs. In this way, the multiple users' APPs can respectively display the sound bar rotating by the target horizontal angle B in the simulated room area, and display a pop-up window on the precision sweet spot positioning interface, where the text "fine-tuning completed" is displayed in the pop-up window.

[0343] After receiving the target horizontal angle B, the soundbar rotates to reach the target horizontal angle B. In this case, the sweet spot of the soundbar is the center position of multiple users.

[0344] Thus, the precision sweet spot positioning function is completed. After that, as long as the users do not move, the stereo (such as TV or movie sound) played by the sound bar will create the optimal listening effect at the center position of the users.

[0345] Scenario 3: There are multiple soundbars and multiple users in the room.

[0346] The aforementioned multiple users hold electronic devices. The electronic devices are, for example, mobile phones. The APPs installed on the multiple users' mobile phones enter a "general user" mode. In addition, there is an administrator, who holds a control device. The control device is, for example, a tablet computer. The APPs installed on the administrator's tablet computer enter an "administrator" mode.

[0347] As shown in Fig. 12e, a user (any one of multiple users) clicks a corresponding position in the simulated room area based on the user's position in the room, and the user's APP displays an identifier (e.g., a smiley face) at the corresponding position to indicate that the user is there. The user clicks an "OK" control on the precision sweet spot positioning interface, and the APP sends the coordinates of the user's identifier position in the second coordinate system to the administrator's APP.

[0348] All of the above-mentioned multiple users may perform the above-mentioned operations. Thus, the APPs of the multiple users all display identifiers (e.g., smiley faces) in the simulated room area to indicate the positions of the corresponding users, and the APPs of the multiple users send the coordinates of the positions of the respective identifiers in the second coordinate system to the APP of the administrator.

[0349] As shown in Fig. 12f, the administrator's APP displays the identifiers of multiple users (e.g., user 1 to user 3) in the simulated room area. That is, after receiving the coordinates transmitted by the multiple users' APPs, the administrator's APP displays the identifiers (e.g., smiling faces) at positions corresponding to the aforementioned coordinates in the simulated room area.

[0350] The manager's APP first divides the space in the room based on the number of sound bars, and each sound bar corresponds to a subspace. For example, as shown in FIG. 15, there are three sound bars, and the center of the middle sound bar is used as the apex. The horizontal space in front of the sound bars may be divided into three subspaces in a manner that evenly divides an angle of 180° horizontally. The left subspace corresponds to sound bar 1 and has one user, the middle subspace corresponds to sound bar 2 and has two users, and the right subspace corresponds to sound bar 3 and has no user. That is, in the scenario shown in FIG. 15, the three sound bars correspond to three subspaces respectively, and based on the number of users in the subspace, the relationship between the three sound bars and the number of users is one-to-one relationship, one-to-many relationship, and one-to-zero relationship, respectively. The manager's APP determines the sweet spots of the three sound bars in sequence.

[0351] The administrator's APP can obtain the initial horizontal angle A1 and the fine-tuning angle θ1 of the sound bar 1 according to equations (1) to (4) in scenario 1. The difference is that the coordinates (x s0 , y s0) represents the center of soundbar 1. The administrator's APP can obtain the initial horizontal angle A2 and fine-tuning angle θ2 of soundbar 2 by using the method described in scenario 2. The difference is that the coordinates (x s0 , y s0 ) represents the center of Soundbar 2, and the coordinate (x c , y c ) represents the center position of the two users in the central subspace corresponding to the sound bar 2. In this case,

number

number

[0352] The administrator clicks the “OK” control on the precision sweet spot positioning interface, and the administrator’s APP sends the calculated initial horizontal angle A1 and fine-tuning angle θ1 of soundbar 1 to soundbar 1 in the form of a command, sends the calculated initial horizontal angle A2 and fine-tuning angle θ2 of soundbar 2 to soundbar 2 in the form of a command, and sends the calculated initial horizontal angle A3 and fine-tuning angle θ3 of soundbar 3 to soundbar 3 in the form of a command.

[0353] After receiving the command, the soundbar 1 can rotate to an angle A1-θ1 or A1+θ1.

[0354] After receiving the command, the soundbar 2 can rotate to an angle A2-θ2 or A2+θ2.

[0355] After receiving the command, the soundbar 3 can rotate to an angle A3-θ3 or A3+θ3.

[0356] Multiple users hold their mobile phones and stand still at selected positions in the room (positions corresponding to the smiles in FIG. 12e). As shown in FIG. 12g, the administrator clicks the "fine-tune" control on the precision sweet spot positioning interface, and the administrator's APP sends a play command to instruct soundbars 1-3 to start fine-tuning. Optionally, the multiple users' APPs can respectively display soundbar 1 rotating by A1-θ1 or A1+θ1, soundbar 2 rotating by A2-θ2 or A2+θ2, and soundbar 3 rotating by A3-θ3 or A3+θ3 in the simulated room area.

[0357] After receiving the play command, the sound bar 1 starts playing the pre-acquired, locally stored positioning audio (e.g., rain sound), and rotates at a constant speed v from a first angle to a second angle in the process of playing the positioning audio. The first angle and the second angle are A1-θ1 and A1+θ1, or A1+θ1 and A1-θ1, respectively. Specifically, the first angle is A1-θ1 and the second angle is A1+θ1, or the first angle is A1+θ1 and the second angle is A1-θ1.

[0358] The microphone of the user's mobile phone in the left subspace receives the recorded audio and sends the recorded audio to the administrator's APP. The administrator's APP can obtain the target horizontal angle B1 of the sound bar 1 by referring to the description of scenario 2.

[0359] After receiving the play command, the sound bar 2 starts playing the pre-acquired, locally stored positioning audio (e.g., rain sound), and rotates from a first angle to a second angle at a constant speed v in the process of playing the positioning audio. The first angle and the second angle are A2-θ2 and A2+θ2, or A2+θ2 and A2-θ2, respectively. Specifically, the first angle is A2-θ2 and the second angle is A2+θ2, or the first angle is A2+θ2 and the second angle is A2-θ2.

[0360] The microphone of the user's mobile phone in the central subspace receives the recorded audio and sends the recorded audio to the administrator's APP. The administrator's APP can obtain the target horizontal angle B2 of the sound bar 2 by referring to the description of scenario 2.

[0361] After receiving the play command, the sound bar 3 starts playing the pre-acquired, locally stored positioning audio (e.g., rain sound), and rotates at a constant speed v from a first angle to a second angle in the process of playing the positioning audio. The first angle and the second angle are A3-θ3 and A3+θ3, or A3+θ3 and A3-θ3, respectively. Specifically, the first angle is A3-θ3 and the second angle is A3+θ3, or the first angle is A3+θ3 and the second angle is A3-θ3.

[0362] The microphones of all users' mobile phones in the room receive the recorded audio and send the recorded audio to the administrator's APP, which can refer to the description of scenario 2 to obtain the target horizontal angle B3 of the soundbar 3.

[0363] As shown in FIG. 12g, after obtaining the target horizontal angles B1-B3, the administrator APP sends the target horizontal angle B1 to soundbar 1, sends the target horizontal angle B2 to soundbar 2, and sends the target horizontal angle B3 to soundbar 3. Optionally, the administrator APP can display the soundbar 1 rotating by the target horizontal angle B1, the soundbar 2 rotating by the target horizontal angle B2, and the soundbar 3 rotating by the target horizontal angle B3 in the simulated room area, and display a pop-up window on the precision sweet spot positioning interface, and the text "fine-tuning completed" is displayed in the pop-up window.

[0364] After receiving the target horizontal angle B1, the sound bar 1 rotates to reach the target horizontal angle B1. In this case, the sweet spot of the sound bar 1 is the user's position in the left subspace.

[0365] After receiving the target horizontal angle B2, the sound bar 2 rotates to reach the target horizontal angle B2. In this case, the sweet spot of the sound bar 2 is the center position of the two users in the central subspace.

[0366] After receiving the target horizontal angle B3, the sound bar 3 rotates to reach the target horizontal angle B3. In this case, the sweet spot of the sound bar 3 is the center position of all users in the room.

[0367] Thus, the precision sweet spot positioning function is completed. After that, unless the users move, the stereo sound (e.g., TV or movie sound) played by the sound bars will respectively form the optimal listening effect at the position associated with the user in each corresponding subspace.

[0368] Scenario 4: Multiple soundbars and one user in the room.

[0369] The user is an administrator, and the administrator holds a control device. The control device is, for example, a mobile phone, and the APP installed on the mobile phone enters the "administrator" mode.

[0370] As shown in FIG. 12e, the user clicks on a corresponding location in the simulated room area based on the user's location in the room, and the APP displays an identifier (e.g., a smiling face) at the corresponding location indicating that the user is there.

[0371] As shown in FIG. 16, the user's APP can separately obtain the initial horizontal angle A1 and fine-tuning angle θ1 of soundbar 1, the initial horizontal angle A2 and fine-tuning angle θ2 of soundbar 2, and the initial horizontal angle A3 and fine-tuning angle θ3 of soundbar 3 according to equations (1) to (4) in scenario 1. The difference is that for soundbar 1, the coordinates (x s0 , y s0 ) represents the center of sound bar 1, and for sound bar 2, the coordinates (x s0 , y s0 ) represents the center of sound bar 2, and for sound bar 3, the coordinates (x s0 , ys0 ) represents the center of the Soundbar 3.

[0372] The user clicks the “OK” control on the precision sweet spot positioning interface, and the user's APP sends the calculated initial horizontal angle A1 and fine-tuning angle θ1 of soundbar 1 to soundbar 1 in the form of a command, sends the calculated initial horizontal angle A2 and fine-tuning angle θ2 of soundbar 2 to soundbar 2 in the form of a command, and sends the calculated initial horizontal angle A3 and fine-tuning angle θ3 of soundbar 3 to soundbar 3 in the form of a command.

[0373] After receiving the command, the soundbar 1 can rotate to an angle A1-θ1 or A1+θ1.

[0374] After receiving the command, the soundbar 2 can rotate to an angle A2-θ2 or A2+θ2.

[0375] After receiving the command, the soundbar 3 can rotate to an angle A3-θ3 or A3+θ3.

[0376] A user holds the mobile phone and rests at a selected position in the room (the position corresponding to the smiling face in FIG. 12e). As shown in FIG. 12i, the user clicks the "fine-tune" control on the precision sweet spot positioning interface, and the user's APP sends a play command to instruct soundbars 1-3 to start fine-tuning. Optionally, the user's APP can display soundbar 1 rotating by A1-θ1 or A1+θ1, soundbar 2 rotating by A2-θ2 or A2+θ2, and soundbar 3 rotating by A3-θ3 or A3+θ3 in the simulated room area.

[0377] After receiving the play command, the sound bar 1 starts playing the pre-acquired, locally stored positioning audio (e.g., rain sound), and rotates at a constant speed v from a first angle to a second angle in the process of playing the positioning audio. The first angle and the second angle are A1-θ1 and A1+θ1, or A1+θ1 and A1-θ1, respectively. Specifically, the first angle is A1-θ1 and the second angle is A1+θ1, or the first angle is A1+θ1 and the second angle is A1-θ1.

[0378] After receiving the play command, the sound bar 2 starts playing the pre-acquired, locally stored positioning audio (e.g., rain sound), and rotates from a first angle to a second angle at a constant speed v in the process of playing the positioning audio. The first angle and the second angle are A2-θ2 and A2+θ2, or A2+θ2 and A2-θ2, respectively. Specifically, the first angle is A2-θ2 and the second angle is A2+θ2, or the first angle is A2+θ2 and the second angle is A2-θ2.

[0379] After receiving the play command, the sound bar 3 starts playing the pre-acquired, locally stored positioning audio (e.g., rain sound), and rotates at a constant speed v from a first angle to a second angle in the process of playing the positioning audio. The first angle and the second angle are A3-θ3 and A3+θ3, or A3+θ3 and A3-θ3, respectively. Specifically, the first angle is A3-θ3 and the second angle is A3+θ3, or the first angle is A3+θ3 and the second angle is A3-θ3.

[0380] The three aforementioned soundbars will play positioning audio simultaneously and begin rotating at the same time.

[0381] The microphone of the user's mobile phone receives the recorded audio. The user's APP can obtain and detect the volume of the recorded audio by referring to the description of Scenario 1, determine the time point corresponding to the maximum volume, and determine the difference between that time point and the start time of the recorded audio as the target time, and then calculate the target horizontal angles B1-B3 of the three sound bars separately by using formula (5) or (6) in Scenario 1.

[0382] As shown in FIG. 12j, after obtaining the target horizontal angles B1-B3, the user's APP sends the target horizontal angle B1 to soundbar 1, sends the target horizontal angle B2 to soundbar 2, and sends the target horizontal angle B3 to soundbar 3. Optionally, the user's APP can display the soundbar 1 rotating by the target horizontal angle B1, the soundbar 2 rotating by the target horizontal angle B2, and the soundbar 3 rotating by the target horizontal angle B3 in the simulated room area, and display a pop-up window on the precision sweet spot positioning interface, and the text "fine-tuning completed" is displayed in the pop-up window.

[0383] After receiving the target horizontal angle B1, the sound bar 1 rotates to reach the target horizontal angle B1, after receiving the target horizontal angle B2, the sound bar 2 rotates to reach the target horizontal angle B2, and after receiving the target horizontal angle B3, the sound bar 3 rotates to reach the target horizontal angle B3. In this case, the sweet spots of the sound bar 1, the sound bar 2, and the sound bar 3 are the user's positions.

[0384] Thus, the precision sweet spot positioning function is completed. After that, as long as the user does not move, the stereo sound (such as the sound of a TV or movie) played by the multiple sound bars will form the optimal listening effect at the user's position.

[0385] Optionally, there is a "Settings" control on the top right of the precision sweet spot positioning interface. As shown in Fig. 12k, the user clicks the "Settings" control. After receiving the command generated by the operation, the APP displays a drop-down menu on the precision sweet spot positioning interface. The drop-down menu has two items, namely "Maximum Rotation Angle Measurement" and "User-defined Fine Tuning Angle".

[0386] The user clicks on the "Maximum Rotation Angle Measurement" item. After receiving the command generated by the operation, the APP sends a maximum rotation angle measurement command to the sound bar. The sound bar starts to rotate horizontally based on the maximum rotation angle measurement command, stops rotating when it contacts the wall, and records the angle M corresponding to the stop of rotation as the maximum rotation angle. The sound bar sends the maximum rotation angle M to the APP. The APP limits the initial horizontal angle A based on the maximum rotation angle M. Specifically, if the calculated initial horizontal angle A is greater than the maximum rotation angle M, the initial horizontal angle A is modified to the maximum rotation angle M, or if the calculated initial horizontal angle A is equal to or less than the maximum rotation angle M, the initial horizontal angle A remains unchanged. In addition, the APP limits the fine-tuning angle θ based on the maximum rotation angle M. Specifically, if the calculated fine-tuning angle θ is greater than MA, the fine-tuning angle θ is modified to MA, or if the calculated fine-tuning angle θ is equal to or less than MA, the fine-tuning angle θ remains unchanged.

[0387] It should be noted that the APP can further actively execute the process of obtaining the maximum rotation angle M once every time the user executes a room configuration.

[0388] The user clicks on the item of "user-defined fine-tuning angle" and inputs the value of the fine-tuning angle θ specified by the user in the item. After receiving the command generated by the operation, the APP determines the value input by the user as the fine-tuning angle θ. Specifically, the fine-tuning angle θ in this application may be calculated according to formula (4), or may be obtained by the user inputting it in the item of "user-defined fine-tuning angle".

[0389] 5. Exclusive private customization The "dedicated private customization" control on the function selection interface is clicked. The APP displays the dedicated private customization interface. Figures 17a-17d are schematic diagrams of some examples of the dedicated private customization interface according to the present application. The dedicated private customization interface includes a simulated room area, and the furniture models displayed in the area are configured by the user in the room configuration interface.

[0390] In one possible embodiment, a dedicated private customization function is enabled. The APP can first perform a process of precision sweet spot positioning to obtain a target horizontal angle B, and then rotate the angle of the soundbar in the simulated room area to the target horizontal angle B. The APP will send the target horizontal angle B to the soundbar, which will also rotate to the target horizontal angle B.

[0391] In one possible embodiment, before enabling the dedicated private / customization function, the APP must first complete the precision sweet spot positioning function. For example, if the user clicks the “Dedicated Private Customization” control on the function selection interface, the APP will first determine whether the user clicked the “Precise Sweet Spot Positioning” control on the function selection interface before clicking the “Dedicated Private Customization” control on the function selection interface. If the user has not clicked the “Precise Sweet Spot Positioning” control, the APP will display a pop-up window on the dedicated private customization interface, and the pop-up window will display the text “Please select Precise Sweet Spot Positioning first” to remind the user to click the “Dedicated Private Customization” control first, and then a pop-up window will appear on the precision sweet spot positioning interface to remind the user to click the “Dedicated Private Customization” control when the text “Fine-tuning completed” is displayed in the pop-up window, as shown in FIG. 17a. Similarly, after the user performs the aforementioned operation, on the dedicated private customization interface, the APP will rotate the angle of the sound bar in the simulated room area to the target horizontal angle B. When the precision sweet spot positioning function is disabled, the soundbar is rotated to an angle that reaches the target horizontal angle B.

[0392] As shown in Fig. 17b, the APP further displays a pop-up window on the dedicated private customization interface, which displays the text "Please wear the headset" to remind the user to wear the headset. After wearing the headset, the user clicks the "OK" control on the dedicated private customization interface, and the APP sends a second playback command to the sound bar.

[0393] As shown in FIG. 17c, after the APP sends the second renewal order, the APP displays a pop-up window on the dedicated private customization interface, and the pop-up window displays the text "Customizing...".

[0394] After receiving the second renewal order, the sound bar starts playing the test audio that has been previously acquired and stored locally.

[0395] The headset receives the test audio and then transmits the recorded audio corresponding to the test audio to the mobile phone.

[0396] The mobile phone calculates the binaural room impulse response (BRIR) based on the test audio from the sound bar and the recorded audio from the headset.

[0397] Note that the dedicated private customization function may also be applicable to multiple scenarios, namely, one sound bar and one user, one sound bar and multiple users, multiple sound bars and multiple users, and multiple sound bars and one user, similar to the precise suite spot positioning function.

[0398] For example, the BRIR may be calculated according to Equation (7):

Number

[0399] The filter coefficients are then calculated according to equation (8): C(f) = (H(f) H H(f)+βI k (f) -1 H(f) H D(f) (8) where H(f)∈C K×K where H(f) represents a matrix constructed by using the BRIR calculated according to equation (7) as an element, and the matrix covers the room transfer functions of all users corresponding to all speaker units, respectively, and * H represents the conjugate matrix, and I k (f)∈C K×K and I k (f) represents the identity matrix, and D(f)∈R 2P×R where D(f) represents the ideal transfer function, R represents the number of sound channels, and R=2 if the audio is stereo.

number

[0400] The APP processes the audio played by the soundbar based on the updated filter coefficients according to equation (9): X(f)=C(f)S(f) (9) where X(f) represents the processed audio, S(f) represents the audio played by the soundbar, and C(f) represents the filter coefficients.

[0401] The filter coefficients are obtained after precise sweet spot positioning, so that more accurate crosstalk cancellation can be implemented for the user's position, the effect of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored.

[0402] As shown in Figure 17d, the APP will display a pop-up window on the dedicated private customization interface, and the pop-up window will display the text "Customization Complete". The dedicated private customization function is then completed. After that, unless the user moves, the stereo sound (e.g., TV or movie sound) played by the sound bar will form the optimal listening effect at the user's position, and the original sound effect will be highly restored.

[0403] 6. Virtual Space Mode The "Virtual Space Mode" control on the function selection interface is clicked. The APP displays the virtual space mode interface. Figures 18a-18c are schematic diagrams of some examples of the virtual space mode interface according to the present application. The virtual space mode interface includes a simulated room area, and the furniture models displayed in the area are set by the user in the room configuration interface.

[0404] In one possible embodiment, the virtual space mode function is enabled. The APP can first execute a process in precision sweet spot positioning to obtain a target horizontal angle B, rotate the angle of the sound bar in the simulated room area to the target horizontal angle B, and then execute a process in dedicated private customization to obtain the BRIR. The APP sends the target horizontal angle B to the sound bar, so that the sound bar also rotates to an angle that reaches the target horizontal angle B.

[0405] In one possible embodiment, before enabling the virtual space mode function, the APP must first complete the precision sweet spot positioning function and the dedicated private customization function. For example, if the user clicks the "Virtual Space Mode" control on the function selection interface, the APP first determines whether the user clicked the "Virtual Space Mode" control on the function selection interface before clicking the "Precise Sweet Spot Positioning" control and the "Dedicated Private Customization" control on the function selection interface. If the user has not clicked the "Precise Sweet Spot Positioning" control and / or the "Dedicated Private Customization" control, the APP will display a pop-up window on the virtual space mode interface, and the pop-up window will display the text "Please select Precision Sweet Spot Positioning and Dedicated Private Customization in order", as shown in FIG. 18a, to remind the user to first click the "Precise Sweet Spot Positioning" control, then click the "Dedicated Private Customization" control when the pop-up window appears on the precision sweet spot positioning interface and the text "Fine-tuning Completed" appears in the pop-up window, and then click the "Virtual Space Mode" control when the pop-up window appears on the dedicated private customization interface and the text "Customization Completed" appears in the pop-up window. Similarly, after the user performs the aforementioned operations on the virtual space interface, the APP will rotate the angle of the soundbar in the simulated room area to the target horizontal angle B. When the precision sweet spot positioning function is disabled, the soundbar has been rotated to an angle that reaches the target horizontal angle B.

[0406] As shown in Figure 18b, the user clicks the "Space" control on the virtual space mode interface, and the APP displays a pull-up menu on the virtual space mode interface. The pull-up menu includes four items: "None", "Golden Hall", "Concert", and "Tiananmen Square".

[0407] The user clicks on the "Golden Hall" item and clicks on the "OK" control on the virtual space mode interface.

[0408] The APP obtains the room transfer function corresponding to the "golden hall", and calculates the filter coefficient based on the BRIR and the room transfer function corresponding to the "golden hall" according to equation (10):

number

number

number

number

number

[0409] The APP processes the audio played by the soundbar according to the updated filter coefficients according to equation (11):

number

number

number

[0410] The aforementioned filter coefficients are obtained after dedicated private customization. Therefore, more accurate crosstalk cancellation can be implemented for the user's position, the effects of different rooms can be eliminated, the sound image effect can be enhanced, and the original sound effect can be truly restored. In addition, the sound field can be rendered at the user's position, thereby providing the user with an immersive experience.

[0411] As shown in FIG. 18c, the APP displays a pop-up window on the virtual space mode interface, and the pop-up window displays the text "Customization Complete". The virtual space mode function is then completed. After that, unless the user moves, the stereo sound (e.g., TV or movie sound) played by the sound bar will form an optimal listening effect at the user's position, and the original sound effect will be highly restored, thereby providing the user with an immersive experience.

[0412] Referring to the control device shown in FIG. 2, when the room includes one sound bar and one user, the transmitting module is configured to transmit a first playback command to the sound box, the first playback command is used to instruct the sound box to rotate in a preset direction from a first position to a second position and play positioning audio in the process of rotating, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change, the receiving module is configured to receive the positioning audio, the processing module is configured to determine instruction information based on the positioning audio, the instruction information is used to determine a target position of the sound box, the target position is a position of the sound box corresponding to when the volume of the received audio is maximum in the process of receiving the positioning audio by the electronic device, and the target position is a position in the process of the sound box rotating from the first position to the second position, and the transmitting module is further configured to transmit the instruction information to the sound box.

[0413] In one possible embodiment, the angular difference between the first position and the second position is related to the inter-aural distance of the user, or the angular difference between the first position and the second position is related to a preset fine adjustment range.

[0414] In one possible embodiment, the instructional information further instructs the sound box to rotate from the second position to the target position.

[0415] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0416] In one possible embodiment, rotating in a predetermined direction comprises rotating at a constant speed in the predetermined direction.

[0417] In one possible embodiment, the shape of the sound box includes a bar shape, a square shape, or a ring shape.

[0418] In one possible embodiment, the processing module is further configured to obtain an initial position of the center of the sound box and a position of the user, calculate a theoretical sweet spot of the sound box for the user based on the initial position and the user's position, when the sound box is positioned at the theoretical sweet spot, a connecting line between the user's position and the center of the sound box is perpendicular to the loudspeaker surface of the sound box, obtain a fine-tuning angle, and obtain a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0419] In one possible embodiment, the first position is a position where the sound box is rotated horizontally clockwise by a fine-tuning angle from the theoretical sweet spot, and the second position is a position where the sound box is rotated horizontally counterclockwise by a fine-tuning angle from the theoretical sweet spot.

[0420] In one possible embodiment, the processing module is particularly configured to display a room configuration interface, the room configuration interface being used to simulate a space in which a user and a sound box are located, receive a first virtual position input by the user on the room configuration interface, the first virtual position being used to simulate an initial position, calculate the initial position based on the first virtual position, receive a second virtual position input by the user on the room configuration interface, the second virtual position being used to simulate a position of the user, and calculate a position of the user based on the second virtual position.

[0421] In one possible embodiment, the processing module is specifically configured to calculate the fine-tuning angle based on the initial position, the position of the user, and the interaural distance of the user.

[0422] In one possible embodiment, the processing module is particularly configured to display a precision sweet spot positioning interface, the precision sweet spot positioning interface including a pop-up window for setting a fine-tuning angle, receive a pre-set experience value input by a user on the pop-up window, and set the value of the fine-tuning angle to the pre-set experience value.

[0423] In one possible embodiment, the processing module is particularly configured to detect positioning audio received at a specified frequency from a start time of reception of the positioning audio to obtain the volume, and when an end time of reception of the positioning audio arrives, determine a difference between a time corresponding to the maximum volume among the multiple obtained volume levels and the start time of reception as a target time, determine the target time as instruction information, determine the target time and a reverse direction of the predetermined direction as instruction information, determine the target time, the reverse direction of the predetermined direction, and a fine-tuning angle as instruction information, or determine the reverse direction of the predetermined direction and a target rotation angle as instruction information, and the target rotation angle instructs the sound box to rotate from the second position to the target position.

[0424] In one possible embodiment, the processing module is particularly configured to detect the positioning audio to obtain a maximum volume, determine a difference between a time point corresponding to the maximum volume and a start time point of receiving the positioning audio as a target time, determine the target time as instruction information, determine the target time and a reverse direction of the preset direction as instruction information, determine the target time, the reverse direction of the preset direction and a fine adjustment angle as instruction information, or determine the reverse direction of the preset direction and a target rotation angle as instruction information, and the target rotation angle instructs the sound box to rotate from the second position to the target position.

[0425] In one possible embodiment, the transmitting module is further configured to transmit a second playback command to the sound box, the second playback command being used to instruct the sound box to play the test audio, the receiving module is further configured to receive collected audio, the collected audio being audio received by a microphone of a headset worn by the user in the process of playing the test audio, and the processing module is further configured to calculate a binaural room impulse response BRIR based on the collected audio and the test audio, and obtain filter coefficients for the sound box based on the BRIR.

[0426] In one possible embodiment, the processing module is further configured to receive a virtual space command including a listening space, obtain a transfer function of the listening space, and calculate filter coefficients of the sound box based on the BRIR and the transfer function of the listening space.

[0427] According to a fourth aspect, the present application provides an audio playback device including a receiving module configured to receive a first playback command from an electronic device; and a processing module configured to rotate in a predetermined direction from a first position to a second position based on the first playback command and play positioning audio in the process of the rotation, where the volume of the positioning audio is stable and does not change when the positioning audio is being played, wherein the receiving module is further configured to receive instruction information from the electronic device, the instruction information is used to determine a target position, the target position being a position of the sound box corresponding to when the volume of the received audio is maximum in the process of receiving the positioning audio by the electronic device, the target position being a position in the process of the sound box rotating from the first position to the second position, and the processing module is further configured to rotate to the target position based on the instruction information.

[0428] In one possible embodiment, the angular difference between the first position and the second position is related to the inter-aural distance of the user, or the angular difference between the first position and the second position is related to a preset fine adjustment range.

[0429] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0430] In one possible embodiment, rotating in a predetermined direction comprises rotating at a constant speed in the predetermined direction.

[0431] In one possible embodiment, the shape of the sound box includes a bar shape, a square shape, or a ring shape.

[0432] In one possible embodiment, the receiving module is further configured to receive a theoretical sweet spot and a fine-tuning angle from the electronic device, and when the sound box is positioned at the theoretical sweet spot, a connecting line between the user's position and the center of the sound box is perpendicular to the loudspeaker surface of the sound box, and the processing module is further configured to determine a first position and a second position based on the theoretical sweet spot and the fine-tuning angle, and rotate to the first position.

[0433] In one possible embodiment, the first position is a position where the sound box is rotated horizontally clockwise by a fine-tuning angle from the theoretical sweet spot, and the second position is a position where the sound box is rotated horizontally counterclockwise by a fine-tuning angle from the theoretical sweet spot.

[0434] When the room includes multiple sound bars and one user, the method further comprises: a transmitting module configured to transmit a first playback command to an i-th sound box, the first playback command being used to instruct the i-th sound box to rotate from a first position to a second position in a preset direction at a constant speed and play a positioning audio in the process of rotating, and when the positioning audio is being played, a volume of the positioning audio is stable and does not change, the i-th sound box being one of the N sound boxes, 1≦i≦N, where N is a positive integer greater than 1; a receiving module configured to receive a mixed signal, the mixed signal being an audio signal obtained by mixing the positioning audio played by the N sound boxes; and a processing module configured to determine an i-th instruction information based on the mixed signal, the i-th instruction information being used to determine a target position of the i-th sound box, the target position of the i-th sound box being a corresponding position of the i-th sound box corresponding to when a volume of the received audio is maximum in the process of receiving the mixed signal by the electronic device; and the transmitting module is further configured to transmit the i-th instruction information to the i-th sound box.

[0435] In one possible embodiment, the pre-set direction comprises a horizontal clockwise direction or a horizontal counterclockwise direction.

[0436] In one possible embodiment, the processing module is further configured to obtain an initial position of the center of the i-th sound box and a user's position, calculate a theoretical sweet spot of the i-th sound box relative to the user's position based on the initial position and the user's position, determine that when the i-th sound box is located at the theoretical sweet spot, a connecting line between the user's position and the center of the i-th sound box is perpendicular to the loudspeaker surface of the i-th sound box, obtain a fine-tuning angle, and obtain a first position and a second position of the i-th sound box based on the theoretical sweet spot and the fine-tuning angle.

[0437] In one possible embodiment, the first position is a position where the i-th sound box is rotated from the theoretical sweet spot by a fine-tuning angle in a preset direction, and the second position is a position where the i-th sound box is rotated from the theoretical sweet spot by a fine-tuning angle in the opposite direction to the preset direction.

[0438] When the room includes one sound bar and multiple users, the transmitting module is further configured to transmit a first playback command to the sound box, the first playback command is used to instruct the sound box to rotate in a preset direction from a first position to a second position and play a positioning audio in the process of rotating, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change; the receiving module is further configured to receive a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of the terminals of the plurality of users in the process of playing the positioning audio; the processing module is further configured to determine instruction information based on the plurality of collected audios, the instruction information is used to determine a target position of the sound box, and the target position is a volume of the positioning audio of the plurality of users. TerminalIn the process of receiving positioning audio by the positioning module, the position of the sound box corresponds to when the sum of the volumes of the received audio is maximum, and the target position is a position in the process of rotating from the first position to the second position, and the transmitting module is further configured to transmit instruction information to the sound box.

[0439] In one possible embodiment, the processing module is further configured to obtain an initial position of a center of the sound box and positions of the multiple users, determine center positions of the multiple users based on the positions of the multiple users, calculate a theoretical sweet spot of the sound box for the center positions of the multiple users based on the initial position and the center positions of the multiple users, determine that when the sound box is positioned at the theoretical sweet spot, a connecting line between the center positions of the multiple users and the center of the sound box is perpendicular to the loudspeaker surface of the sound box, obtain a fine-tuning angle, and obtain a first position and a second position based on the theoretical sweet spot and the fine-tuning angle.

[0440] When the room includes multiple sound bars and multiple users, in one possible embodiment, the processing module is further configured to divide the space into multiple subspaces based on the number of N sound boxes, each subspace corresponding to one of the sound boxes, where N is a positive integer greater than 1; the transmitting module is further configured to send a first playback command to each of the N sound boxes, where the first playback command is used to instruct the corresponding sound box to rotate in a predetermined direction from a first position to a second position and play positioning audio during the rotation, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change; the processing module is further configured to determine N pieces of instruction information, where the N pieces of instruction information correspond to the N sound boxes, and the instruction information is used to determine a target position of the corresponding sound box; and the transmitting module is further configured to transmit the N pieces of instruction information to the corresponding sound boxes, respectively.

[0441] In one possible embodiment, the processing module is particularly configured to receive a first positioning audio played by the i-th sound box, the i-th sound bar being one of the N sound bars, where 1≦i≦N, and only one first user being within the subspace corresponding to the first sound bar, determine first indication information based on the first positioning audio, and the first indication information is used to determine a first target position of the i-th sound box, and the first target position is a position of the i-th sound box corresponding to when the volume of the received audio is maximum during the process of receiving the first positioning audio by the electronic device.

[0442] In one possible embodiment, the processing module is further configured to obtain a first initial position of a center of the i-th sound box and a position of a first user, calculate a first theoretical sweet spot of the i-th sound box relative to the user's position based on the first initial position and the first user's position, obtain a first fine-tuning angle, and obtain a first position and a second position of the first sound bar based on the first theoretical sweet spot and the first fine-tuning angle.

[0443] In one possible embodiment, the receiving module is further configured to receive a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of a plurality of second user's electronic devices in the process of playing second positioning audio by the jth sound bar, the jth sound bar being one of the N sound bars, where 1≦j≦N, and the plurality of second users being positioned within a subspace corresponding to the jth sound bar, and the processing module is further configured to determine second instruction information based on the plurality of collected audios, the second instruction information being used to determine a second target position of the jth sound bar, the second target position being a position of the jth sound bar where a sum of the volumes of the received audios is maximum in the process of receiving the second positioning audio by the plurality of second user's electronic devices, and the second target position being a position in the process of rotating from the first position to the second position.

[0444] In one possible embodiment, the processing module is further configured to obtain a second initial position of a center of the jth sound box and positions of the multiple second users, determine center positions of the multiple second users based on the positions of the multiple second users, calculate a second theoretical sweet spot of the jth sound box for the center positions of the multiple users based on the second initial position and the center positions of the multiple second users, obtain a second fine-tuning angle, and obtain a first position and a second position of the jth sound bar based on the second theoretical sweet spot and the second fine-tuning angle.

[0445] In one possible embodiment, the receiving module is further configured to receive a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of a plurality of third user electronic devices in the process of playing third positioning audio by the kth sound bar, the kth sound bar being one of the N sound bars, 1≦k≦N, there is no user in the subspace corresponding to the kth sound bar, and all of the plurality of third users are users in the space, the processing module is further configured to determine third instruction information based on the plurality of collected audios, the third instruction information being used to determine a third target position of the kth sound bar, the third target position being the position of the kth sound bar where the sum of the volumes of the received audios is maximum in the process of receiving the third positioning audio by the plurality of third user electronic devices, and the third target position being a position in the process of rotating from the first position to the second position.

[0446] In one possible embodiment, the processing module obtains a third initial position of the kth sound bar and positions of a plurality of third users, determines a center position of the plurality of third users based on the positions of the plurality of third users, and calculates a center position of the plurality of third users based on the third initial position and the center positions of the plurality of third users. Third Calculate the third theoretical sweet spot of the kth soundbar relative to the user's center position. , No. and further configured to obtain a third fine-tuning angle and a first position and a second position of the kth sound bar based on the third theoretical sweet spot and the third fine-tuning angle.

[0447] The apparatus in this embodiment may be configured to implement the technical solutions of the method embodiments shown in Figures 4 to 8. The implementation principles and technical effects of the apparatus are similar to those of the method embodiments of this embodiment, and the details will not be described again in this specification.

[0448] In the course of implementation, the steps in the above-described method embodiments can be implemented using hardware integrated logic circuits in a processor, or using instructions in the form of software. The processor may be a general-purpose processor, a digital signal processor, (D SP), Application Specific Integrated Circuit (A SIC), Field Programmable Gate Array (F The processor may be a programmable logic device (PGA) or another programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application may be directly provided to be performed and completed by a hardware coding processor, or performed and completed by a combination of the hardware and software modules of the coding processor. The software modules may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the aforementioned method in cooperation with the hardware of the processor.

[0449] The memory in the above-described embodiments may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory is read-only memory. (R OM), programmable read-only memory (P ROM), erasable programmable read-only memory (E PROM, Electrically Erasable Programmable Read-Only Memory (E Volatile memory may be a random access memory (RAM) used as an external cache. (RBy way of example and not limitation, many forms of RAM, such as static random access memory (RAM), (S RAM), Dynamic Random Access Memory (D RAM), Synchronous Dynamic Random Access Memory (S DRAM), Double Data Rate Synchronous Dynamic Random Access Memory (D DR SDRAM), Enhanced Synchronous Dynamic Random Access Memory (E SDRAM), Synchronous Link Dynamic Random Access Memory (S LDRAM), and Direct Rambus Dynamic Random Access Memory (D R RAM) may be used. It should be noted that the memory of the systems and methods described herein includes, but is not limited to, these and any other suitable types of memory.

[0450] Those skilled in the art can recognize that, in combination with the examples described in the embodiments disclosed herein, the units and algorithm steps can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether a function is implemented by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use various methods for each specific application to implement the described functions, but the implementation should not be considered beyond the scope of this application.

[0451] For the sake of convenience and concise description, the detailed operation processes of the above-mentioned systems, devices and units may be clearly understood by those skilled in the art to refer to the corresponding processes in the above-mentioned method embodiments, and the details will not be described again in this specification.

[0452] In some embodiments provided in the present application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the described device embodiment is only an example. For example, the division into units is merely a logical division of functions, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into other systems, or some functions may be ignored or not performed. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be implemented through some interfaces. Indirect couplings or communication connections between devices or units may be implemented in electrical, mechanical, or other forms.

[0453] The units described as separate parts may or may not be physically separate, and the parts shown as units may or may not be physical units, and may be located in one location or distributed over multiple network units. Some or all of the units may be selected based on actual requirements to achieve the objectives of the solutions of the embodiments.

[0454] In addition, the functional units in the embodiments of the present application may be integrated into one processing unit, each of the units may exist physically alone, or two or more units may be integrated into one unit.

[0455] When the functions are implemented in the form of a software functional unit and sold or used as an independent product, the functions may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application essentially, or the part that contributes to the prior art, or part of the technical solutions may be implemented in the form of a software product. The computer software product is stored in a storage medium and includes some instructions for instructing a computer device (such as a personal computer, a server, a network device, etc.) to execute all or part of the steps of the method in the embodiments of the present application. The aforementioned storage medium may be a USB flash drive, a removable hard disk, a read-only memory, (R OM), Random Access Memory (R The present invention includes any medium capable of storing program code, such as a hard disk, a magnetic disk, or an optical disk.

[0456] The above description is merely a specific embodiment of the present application, and is not intended to limit the scope of protection of the present application. Any variations or replacements that are easily conceived by those skilled in the art within the technical scope disclosed in this application shall fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be subject to the scope of protection of the claims. [Explanation of symbols]

[0457] 1 Soundbar 2 Soundbar 3. Soundbar 300 Mobile Phones 310 Processor 320 External Memory Interface 321 Internal Memory 330 USB interface 332 Battery 340 Charging Management Module 341 Power Management Module 350 Mobile Communication Module 360 Wireless Communication Module 370 Audio Module 370A Speaker 370B Receiver 370C Microphone 370D Headset Jack 380 Sensor Module 380A PRESSURE SENSOR 380B Gyro Sensor 380C Barometric Pressure Sensor 380D Magnetic Sensor 380E Accelerometer 380F Distance Sensor 380G Optical Proximity Sensor 380H Fingerprint Sensor 380J Temperature Sensor 380K touch sensor 380L Ambient Light Sensor 380M Bone Conduction Sensor 390 Button 391 Motor 392 Indicator 393 Camera 394 Display 395 SIM card interface 400 processes 500 processes 600 processes 700 processes 800 processes

Claims

1. sending, by an electronic device, a first playback command to a sound box, the first playback command being used to instruct the sound box to rotate in a preset direction from a first position to a second position around a vertical rotation axis of the sound box and to play positioning audio during the rotation, and a volume of the positioning audio is stable and does not change when the positioning audio is being played; receiving, by the electronic device, the positioning audio; determining, by the electronic device, instruction information based on the positioning audio, the instruction information being used to determine a target position of the sound box, the target position being a position of the sound box corresponding to a case where a volume of the received audio is maximum during a process of receiving the positioning audio by the electronic device, the target position being a position of the sound box during a process of rotating from the first position to the second position; transmitting the instruction information to the sound box by the electronic device; Including how to adjust the sound box position.

2. 2. The method of claim 1, wherein an angular difference between the first position and the second position is related to a distance between the ears of a user, or an angular difference between the first position and the second position is related to a preset fine adjustment range.

3. The method of claim 1 or 2, wherein the instruction information further instructs the sound box to rotate from the second position to the target position.

4. 4. The method of claim 1, wherein the rotating comprises rotating at a constant speed about the vertical axis of rotation.

5. Prior to the step of transmitting, by the electronic device, a first playback command to the sound box, the method further comprises: obtaining, by the electronic device, an initial position of the center of the sound box and a position of a user; Calculating, by the electronic device, a theoretical sweet spot of the sound box for the user based on the initial position and the position of the user, where when the sound box is located at the theoretical sweet spot, a connecting line between the position of the user and the center of the sound box is perpendicular to a loudspeaker surface of the sound box, and the loudspeaker surface faces the user; obtaining a fine adjustment angle by the electronic device; obtaining, by the electronics, the first position and the second position based on the theoretical sweet spot and the fine-tuning angle; 5. The method of claim 1, further comprising:

6. The step of obtaining an initial position of the center of the sound box and a position of the user by the electronic device, displaying, by the electronic device, a room configuration interface, the room configuration interface being used to simulate a space in which the user and the sound box are located; receiving, by the electronic device, a first virtual position input by the user on the room configuration interface, the first virtual position being used to simulate the initial position; calculating, by the electronic device, the initial position based on the first virtual position; receiving, by the electronic device, a second virtual position input by the user on the room configuration interface, the second virtual position being used to simulate the position of the user; calculating, by the electronic device, the location of the user based on the second virtual location; 6. The method of claim 5, comprising:

7. The step of obtaining a fine adjustment angle by the electronic device includes: calculating, by the electronic device, the fine-tuning angle based on the initial position, the position of the user, and the inter-aural distance of the user; 7. The method of claim 5 or 6, comprising:

8. The step of obtaining a fine adjustment angle by the electronic device includes: displaying a precision sweet spot positioning interface by the electronic device, the precision sweet spot positioning interface including a pop-up window for setting the fine adjustment angle; receiving, by the electronic device, a preset experience value input by the user on the pop-up window; setting the value of the fine-tuning angle to the preset empirical value by the electronic device; 7. The method of claim 5 or 6, comprising:

9. determining, by the electronic device, indication information based on the positioning audio, detecting, by the electronic device, the positioning audio to obtain a maximum volume; determining, by the electronic device, a difference between a time corresponding to the maximum volume and a start time of receiving the positioning audio as a target time; determining, by the electronic device, the target time as the instruction information; determining, by the electronic device, the target time and a direction opposite to the preset direction as the instruction information; determining, by the electronic device, the target time, the direction opposite to the preset direction, and the fine-tuning angle as the instruction information; or determining, by the electronic device, a reverse direction of the preset direction and a target rotation angle as the instruction information, the target rotation angle instructing the sound box to rotate from the second position to the target position; 9. The method according to any one of claims 5 to 8, comprising:

10. After the step of transmitting, by the electronic device, the instruction information to the sound box, the method further comprises: sending, by the electronic device, a second playback command to the sound box, the second playback command being used to instruct the sound box to play a test audio; receiving, by the electronic device, collected audio, the collected audio being audio received by a microphone of a headset worn by a user during the course of playing the test audio; calculating, by the electronics, a binaural room impulse response BRIR based on the collected audio and the test audio; obtaining, by the electronic device, a filter coefficient for the sound box based on the BRIR; 10. The method of claim 1, further comprising:

11. Before the step of obtaining, by the electronic device, a filter coefficient for the sound box based on the BRIR, the method further comprises: receiving, by the electronic device, virtual space instructions, the virtual space instructions including a listening space; obtaining a transfer function of the listening space by the electronic device; Further comprising: The step of obtaining, by the electronic device, a filter coefficient for the sound box based on the BRIR, calculating, by the electronic device, the filter coefficients of the sound box based on the BRIR and the transfer function of the listening space; Including, The method of claim 10.

12. receiving, by the sound box, a first playback command from the electronic device; a step of rotating the sound box in a preset direction from a first position to a second position around a vertical rotation axis of the sound box according to the first playback command, and playing a positioning audio during the rotation, wherein the volume of the positioning audio is stable and does not change when the positioning audio is being played; receiving, by the sound box, instruction information from the electronic device, the instruction information being used to determine a target position, the target position being a position of the sound box corresponding to a maximum volume of the received audio during the process of receiving the positioning audio by the electronic device, the target position being a position of the sound box during the process of rotating from the first position to the second position; rotating the sound box from the second position to the target position based on the instruction information; Including how to adjust the sound box position.

13. Prior to the step of receiving, by the sound box, a first playback command from an electronic device, the method further comprises: receiving, by the sound box, a theoretical sweet spot and a fine-tuning angle from the electronic device, where when the sound box is located at the theoretical sweet spot, a connecting line between a user's position and the center of the sound box is perpendicular to a loudspeaker surface of the sound box, and the loudspeaker surface faces the user; determining, by the sound box, the first position based on the theoretical sweet spot and the fine-tuning angle; rotating the sound box to the first position; 13. The method of claim 12, further comprising:

14. sending, by an electronic device, a first playback command to a sound box, the first playback command being used to instruct the sound box to rotate in a preset direction from a first position to a second position around a vertical rotation axis of the sound box and to play positioning audio during the rotation, and a volume of the positioning audio is stable and does not change when the positioning audio is being played; receiving, by the electronic device, a plurality of collected audios, the plurality of collected audios being audios respectively received by microphones of a plurality of user terminals during the process of playing the positioning audio; determining, by the electronic device, instruction information based on the collected audios, the instruction information being used to determine a target position of the sound box, the target position being a position of the sound box corresponding to a maximum sum of the volumes of the received audios during a process of receiving the positioning audios by the terminals of the multiple users, the target position being a position during a process of rotating from the first position to the second position; transmitting the instruction information to the sound box by the electronic device; Including how to adjust the sound box position.

15. Prior to the step of transmitting, by the electronic device, a first playback command to the sound box, the method further comprises: obtaining an initial position of the center of the sound box and positions of the users by the electronic device; determining, by the electronic device, a center position of the plurality of users based on the positions of the plurality of users; Calculating, by the electronic device, a theoretical sweet spot of the sound box relative to the center position of the multiple users based on the initial position and the center positions of the multiple users, where when the sound box is located at the theoretical sweet spot, a connecting line between the center positions of the multiple users and the center of the sound box is perpendicular to a loudspeaker surface of the sound box, and the loudspeaker surface faces the users; obtaining a fine adjustment angle by the electronic device; obtaining, by the electronics, the first position and the second position based on the theoretical sweet spot and the fine-tuning angle; 15. The method of claim 14, further comprising:

16. Dividing the space into a plurality of subspaces by an electronic device based on the number of N sound boxes, each subspace corresponding to one of the sound boxes, where N is a positive integer greater than 1; sending a first playback command to each of the N sound boxes by the electronic device, the first playback command being used to instruct the corresponding sound box to rotate around a vertical rotation axis of the sound box from a first position to a second position in a preset direction and play a positioning audio during the rotation, and when the positioning audio is being played, the volume of the positioning audio is stable and does not change; determining, by the electronic device, N pieces of instruction information, the N pieces of instruction information corresponding to the N sound boxes, and the instruction information is used to determine a target position of the corresponding sound box; sending the N pieces of instruction information to the corresponding sound boxes by the electronic device respectively; Including how to adjust the sound box position.

17. said step of determining, by said electronic device, N pieces of indication information, receiving, by the electronic device, a first positioning audio played by an i-th sound box, the i-th sound box being one of the N sound boxes, 1≦i≦N, and only one first user being in a subspace corresponding to the first sound box; determining, by the electronic device, first indication information based on the first positioning audio, the first indication information being used to determine a first target position of the i-th sound box, the first target position being a position of the i-th sound box corresponding to a case where a volume of the received audio is maximum during a process of receiving the first positioning audio by the electronic device; 17. The method of claim 16, comprising:

18. Before the step of transmitting a first playback command to each of the N sound boxes by the electronic device, the method further comprises: obtaining, by the electronic device, a first initial position of a center of the i-th sound box and a position of the first user; Calculating, by the electronic device, a first theoretical sweet spot of the i-th sound box relative to the position of the user based on the first initial position and the position of the first user, wherein when the i-th sound box is located at the first theoretical sweet spot, a connecting line between the position of the first user and the center of the i-th sound box is perpendicular to a loudspeaker surface of the i-th sound box, and the loudspeaker surface faces the first user; obtaining a first fine-tuning angle by the electronic device; obtaining, by the electronic device, the first position and the second position of the first sound box based on the first theoretical sweet spot and the first fine-tuning angle; 20. The method of claim 17, further comprising:

19. one or more processors; a memory configured to store one or more programs; Equipped with The one or more programs, when executed by the one or more processors, enable the one or more processors to perform the method according to any one of claims 1 to 11. electronic equipment.

20. one or more processors; a memory configured to store one or more programs; Equipped with 19. An electronic device, wherein the one or more programs, when executed by the one or more processors, enable the one or more processors to perform the method of any one of claims 14 to 18.

21. one or more processors; a memory configured to store one or more programs; Equipped with The one or more programs, when executed by the one or more processors, enable the one or more processors to perform the method according to any one of claims 12 to 13. Sound box.

22. A computer readable storage medium containing a computer program, which when executed on a computer enables the computer to carry out the method of any one of claims 1 to 11.

Citation Information

Patent Citations

  • System, audio signal output device and method for automatically adjusting sounding direction

    CN106817657A

  • Partition, control method, program, and recording medium

    JP2009033416A

  • Display device, display system, air conditioner, illumination device, and display device control program

    JP2016122876A