Adjustment method and device

Abstract

The invention discloses an adjusting method and device, and the method comprises the steps: responding to the deformation of electronic equipment, and obtaining the relative position information of each audio unit contained in an audio array of the electronic equipment under the current deformation feature; and based on the relative position information, adjusting a target parameter of the audio array, so that the use effect of the audio array after the target parameter is adjusted conforms to a first preset standard.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of electronic technology, and relate to but are not limited to an adjustment method and device. Background Art

[0002] When an electronic device is deformed, such as being pushed, pulled, rolled, or folded, the relative spacing of the audio devices in the audio array changes, changing the parameters of the audio array and affecting the original effect of the audio array. How to reduce the impact on the use effect of the audio array when the electronic device is deformed has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] In view of this, an embodiment of the present application provides an adjustment method and device.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides an adjustment method, including:

[0006] In response to the electronic device generating a deformation, obtaining relative position information of each audio unit included in the audio array of the electronic device under the current deformation feature;

[0007] Based on the relative position information, the target parameters of the audio array are adjusted so that the use effect of the audio array after the target parameters are adjusted meets the first preset standard.

[0008] In a second aspect, an embodiment of the present application provides an adjustment device, the device comprising:

[0009] A first acquisition module, configured to acquire relative position information of each audio unit included in an audio array of the electronic device under a current deformation feature in response to deformation of the electronic device;

[0010] The adjustment module is used to adjust the target parameters of the audio array based on the relative position information, so that the use effect of the audio array after the target parameters are adjusted meets the first preset standard.

[0011] In a third aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program that can be executed on the processor, and the processor implements the above method when executing the program.

[0012] In a fourth aspect, an embodiment of the present application provides a storage medium storing executable instructions for implementing the above method when executed by a processor.

[0013] In a fifth aspect, a computer program product includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the steps in the above method are implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1A A schematic diagram of an implementation flow of an adjustment method provided in an embodiment of the present application;

[0015] Figure 1B A schematic diagram of a foldable mobile phone provided in an embodiment of the present application;

[0016] Figure 1C A schematic diagram of a foldable mobile phone provided in an embodiment of the present application;

[0017] Figure 1D A schematic diagram of a scroll phone provided in an embodiment of the present application;

[0018] Figure 1E A schematic diagram of a scroll phone provided in an embodiment of the present application;

[0019] Figure 1F A schematic diagram of a headset provided in an embodiment of the present application;

[0020] Figure 1G This is a schematic diagram of the deformation of headphones;

[0021] Figure 2A A schematic diagram of a standard posture of an electronic device provided in an embodiment of the present application;

[0022] Figure 2B A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application;

[0023] Figure 2C A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application;

[0024] Figure 2D A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application;

[0025] Figure 2E A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application.

[0026] Figure 3 A schematic diagram of a process for adjusting target parameters provided in an embodiment of the present application;

[0027] Figure 4 A schematic diagram of an implementation flow of a method for adjusting an interconnected audio array provided in an embodiment of the present application;

[0028] Figure 5 A schematic diagram of the structure of an adjustment device provided in an embodiment of the present application;

[0029] Figure 6A hardware entity schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the embodiments of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0031] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0032] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0034] Most of the devices in the related art are devices with fixed audio arrays, such as upright mobile phones (bar phones) and tablet computers that cannot be deformed. Their main features are that the screen and buttons are located on the same side, and the audio array is set in a fixed physical position, so that users can directly see the content displayed on the screen. The design of this electronic device has a fixed shape and will not be extended or folded. Therefore, the relative positions between the audio units are fixed. No matter how the user changes the way the electronic device is used, the relative positions between the audio units will not change, so using fixed parameters can meet the user's expected effects on the audio array.

[0035] With the development of technology, more and more electronic devices are designed to be deformable, such as foldable mobile phones, scroll phones, etc. Since the relative position of the audio unit can change with the deformation of the electronic device, the relative position of the audio unit is not fixed during the deformation of the electronic device. If the audio array of the deformable electronic device can achieve the optimal sound pickup or sound projection effect under the corresponding fixed parameters, then the audio array under certain postures of the deformation cannot achieve the optimal sound pickup or sound projection effect due to the change in the relative position between the audio units, that is, it cannot achieve the expected effect of the user. For example, when the foldable mobile phone is in the unfolded state, the microphone unit set on the mobile phone can achieve the optimal sound pickup effect, and when the user folds the foldable mobile phone at a certain angle for use, the distance between some microphone units will become smaller due to the folding of the mobile phone, affecting the sound pickup effect. For another example, when the scroll mobile phone is in the unfolded state, the speaker unit can achieve the optimal sound projection effect, and when the user rolls the scroll mobile phone, some speaker units will be blocked because the mobile phone is in the storage state, affecting the playback effect of the speaker unit. How to reduce the impact on the use of audio arrays when electronic equipment is deformed has become a technical problem that needs to be solved urgently.

[0036] The present application embodiment provides an adjustment method, such as Figure 1A As shown, the method includes:

[0037] Step S110: in response to deformation of the electronic device, obtaining relative position information of each audio unit included in the audio array of the electronic device under the current deformation feature;

[0038] Here, in order to meet the usage needs of users, more and more deformable electronic devices are appearing on the market, such as folding devices, including folding mobile phones, folding tablets, etc.; roll-up devices, including roll-up mobile phones, roll-up tablets, etc.; there are also other deformation designs such as pushing and pulling, assembly, etc., and headphones can also produce deformation due to use.

[0039] An audio array refers to an array of multiple microphones (such as microphones) arranged in a certain geometric shape in space to receive sound field information of target noise or audio signals.

[0040] The degree of deformation of the electronic device can be obtained based on the sensors set on the electronic device. For example, an angle sensor set on a foldable electronic device can obtain the folding angle. For example, a position sensor set in a scroll device can obtain the degree of expansion and contraction of the scroll. For example, a displacement sensor set in a headphone can detect the displacement or angle of the earmuff, and the folding shape of the headphone can be obtained using a pressure sensor or an external microphone arm sensor.

[0041] During implementation, when the electronic device is deformed, the relative distances of the audio units in the audio array also change. During implementation, the relative position information of the audio units after the deformation is obtained. For example, when a foldable phone is switched from a folded state to an unfolded state, the distance information between the microphones disposed on the foldable phone can be obtained.

[0042] In some embodiments, the relative distance between the audio units may also be acquired by radio signal ranging, laser ranging, visual ranging, ultrasonic reflection ranging, or ultrasonic communication ranging.

[0043] In some embodiments, the audio units in the audio array may be connected by wire or wirelessly. For example, the audio units may communicate with each other in one-way or two-way manners, such as by ultrasonic communication.

[0044] Step S120: adjusting target parameters of the audio array based on the relative position information, so that the use effect of the audio array after adjusting the target parameters meets a first preset standard.

[0045] If the phase position information is the first relative position information, the target parameter is the first playback parameter; if the relative position information is the second phase position information, the target parameter is the second playback parameter.

[0046] Here, the target parameters include at least one of the following: beam angle parameter, suppression parameter, sensitivity parameter and gain parameter, wherein the beam angle parameter, also known as beam angle, refers to the angle from the extension line of the central axis of the microphone to the point where the energy intensity is reduced by half (-3dB). The suppression parameter reflects the ability of the microphone to suppress the sound source signal. The sensitivity parameter describes the sensitivity of the microphone to small changes. The gain parameter refers to the degree to which the amplifier amplifies the sound source signal.

[0047] Meeting the first preset standard means that a valid audio array can be maintained. For example, when the audio array is a microphone array, the microphone array can continue to be effective after adjustment, that is, it can ensure that the sound collected by the microphone array after adjusting the parameters meets the preset sound standard.

[0048] The first preset standard includes at least one of the following: the beam angle meets a preset angle threshold, the sound pickup intensity at a preset angle meets a preset intensity threshold, and the clarity of the received voice signal meets a preset clarity threshold.

[0049] For example, when the foldable phone is in a folded state (corresponding to the first relative position information), the first target parameters are used to obtain the receiving effect parameters of the microphone array, such as the wave velocity angle of the received sound source signal, the sound pickup intensity and clarity of the received sound source signal, etc. When the shape of the foldable phone changes, such as unfolding (corresponding to the second relative position information), the beam angle parameters, suppression parameters, sensitivity parameters and gain parameters (second target parameters) can be adjusted to achieve a receiving effect that is not much different from the receiving effect in the folded state, without affecting the sound pickup effect of the user using the foldable phone in different states.

[0050] In the embodiment of the present application, first, in response to the deformation of the electronic device, the relative position information of each audio unit contained in the audio array of the electronic device under the current deformation feature is obtained; then, based on the relative position information, the target parameter of the audio array is adjusted so that the use effect of the audio array after the target parameter is adjusted meets the first preset standard. In this way, when the electronic device is deformed, the effective audio array can continue to be maintained, reducing the impact on the original use effect of the audio array.

[0051] In some embodiments, the above step S110 "obtaining relative position information of each audio unit included in the audio array of the electronic device under the current deformation feature in response to the electronic device generating a deformation" can be implemented by the following steps:

[0052] Step 111: determining a coordinate origin based on structural features of the electronic device;

[0053] Here, the structural features of the electronic device may refer to structural features that are configured to produce deformation features, for example, a folding axis of a folding mobile phone, a scroll axis of a scroll device, and the like.

[0054] During implementation, the coordinate origin of an electronic device may be determined based on the structural features of the electronic device that can generate deformation.

[0055] Figure 1B A schematic diagram of a foldable mobile phone provided in an embodiment of the present application, such as Figure 1B As shown, the schematic diagram includes: a coordinate origin 11, an X-axis, a Y-axis and an opening angle a. In the implementation process, the upper left corner of the foldable mobile phone can be identified as the coordinate origin 11 (0, 0, 0) of the foldable mobile phone.

[0056] Figure 1C A schematic diagram of a foldable mobile phone provided in an embodiment of the present application, such as Figure 1C As shown, the schematic diagram includes: a coordinate origin 11, an X-axis, a Y-axis and an opening angle a. In the implementation process, the upper left corner of the foldable mobile phone can be identified as the coordinate origin 11 (0, 0, 0) of the foldable mobile phone.

[0057] Figure 1D A schematic diagram of a scroll phone provided in an embodiment of the present application, such as Figure 1D As shown, the schematic diagram includes: a coordinate origin 11, an X-axis, a Y-axis and a vertical unfolding distance d. In the implementation process, the upper left corner of the foldable mobile phone can be identified as the coordinate origin 11 (0, 0, 0) of the scroll mobile phone.

[0058] Figure 1E A schematic diagram of a scroll phone provided in an embodiment of the present application, such as Figure 1E As shown, the schematic diagram includes: a coordinate origin 11, an X-axis, a Y-axis and a horizontal expansion distance d. In the implementation process, the upper left corner of the scroll phone can be identified as the coordinate origin 11 (0, 0, 0) of the scroll phone.

[0059] Figure 1F A schematic diagram of a headset provided in an embodiment of the present application is shown in FIG. Figure 1F As shown, the diagram includes: a coordinate origin 11.

[0060] Step 112: determining the coordinate value of each audio unit relative to the coordinate origin based on the current deformation feature;

[0061] During implementation, the coordinate value of each audio unit set on the electronic device relative to the coordinate origin can be determined based on the current deformation characteristics of the electronic device, that is, the current physical state of the electronic device, such as the folded state of a foldable mobile phone.

[0062] For example, Figure 1B The coordinate value of the left half microphone of the foldable phone is (0, y1, 0), the coordinate value of the left half top microphone is (x2, 0, 0), the coordinate value of the left half bottom microphone is (x3, y, 0), and the coordinate value of the left half back microphone is (x4, y4, 0); the coordinate value of the right half side microphone is (xx*cosa, y5, x*sina), the coordinate value of the right half top microphone is (x-x6*cosa, 0, x6*sina), the coordinate value of the right half bottom microphone is (x-x7*cosa, y, x7*sina), and the coordinate value of the right half back microphone is (x-x8*cosa, y8, x8*sina).

[0063] Figure 1CThe coordinate value of the microphone on the left side of the upper half of the foldable phone is (0, y1, 0), the coordinate value of the microphone on the right side of the upper half is (x, y2, 0), the coordinate value of the top microphone on the upper half is (x3, 0, 0), and the coordinate value of the microphone on the back of the upper half is (x4, y4, 0); the coordinate value of the microphone on the left side of the lower half is (0, y-y5*cosa, y5*sina), the coordinate value of the microphone on the right side of the lower half is (x, y-y6*cosa, y6*sina), the coordinate value of the microphone on the bottom half is (x7, yy*cosa, y*sina), and the coordinate value of the microphone on the back of the lower half is (x8, y-y8*cosa, y8*sina).

[0064] Figure 1D The coordinate value of the fixed left microphone in the scroll phone is (0, y1, 0), the coordinate value of the sliding left microphone is (0, y2+d, 0), the coordinate value of the fixed right microphone is (x, y3, 0), the coordinate value of the sliding right microphone is (x, y4+d, 0), the coordinate value of the top microphone is (x3, 0, 0), the coordinate value of the bottom microphone is (x4, y+d, 0), the coordinate value of the fixed back microphone is (x5, y5, 0), and the coordinate value of the sliding back microphone is (x6, y6+d, 0).

[0065] Figure 1E The coordinate value of the microphone on the left side of the scroll phone is (0, y1, 0), the coordinate value of the microphone on the right side is (x+d, y2, 0), the coordinate value of the fixed top microphone is (x3, 0, 0), the coordinate value of the sliding top microphone is (x4+d, 0, 0), the coordinate value of the fixed bottom microphone is (x5, y, 0), the coordinate value of the sliding bottom microphone is (x6+d, y, 0), the coordinate value of the fixed back microphone is (x5, y5, 0), and the coordinate value of the sliding back microphone is (x6+d, y6, 0).

[0066] Figure 1F The point where the lower right corner of the headset is connected to the external microphone arm is the coordinate origin (0, 0, 0). Figure 1G is a schematic diagram of the deformation of headphones, such as Figure 1G As shown, it includes an external microphone 12 before deformation and an external microphone 13 after deformation. In the implementation process, the displacement and angle of the microphone 13 pushed out to the microphone 13 can be obtained according to the displacement sensor, the curvature a of the headset after deformation can be calculated according to the pressure sensor, and the positions of several microphones (x i ,y i , 0), the position of the microphone on the right earphone (x j ,y j , 0), according to the shape of the external microphone arm sensor, obtain several microphone positions (x k ,yk , z k ).

[0067] Step 113: Determine the relative distance between the audio units based on the coordinate value of each of the audio units.

[0068] During implementation, for two points with known coordinate values ​​in three-dimensional space, the Euclidean distance formula can be used to calculate the distance between the two points.

[0069] For example, the relative positions of several microphones with respect to the origin can be obtained, the algorithm microphone array parameters can be updated, and the relative distance d between microphones i and j can be calculated using the following formula (1): ij :

[0070] d ij =sqrt((x i -x j )*(x i -x j )+(y i -y j )*(y i -y j )+(z i -z j )*(z i -z j )) (1);

[0071] Among them, (x i ,y i , z i ) is the coordinate of microphone i, (x j ,y j , z j ) are the coordinates of microphone j.

[0072] In the embodiment of the present application, the coordinate origin is first determined based on the structural characteristics of the electronic device; then the coordinate value of each audio unit relative to the coordinate origin is determined based on the current deformation characteristics; and finally the relative distance between the audio units is determined based on the coordinate value of each audio unit. In this way, the relative distance between the audio units can be determined in the same coordinate system.

[0073] In some embodiments, the above adjustment method further includes the following steps:

[0074] Step S130: determining the posture information of the electronic device based on the sensor data of the electronic device, wherein the sensor data at least includes rotation data collected by a gyroscope, angular velocity and / or acceleration data collected by an accelerometer;

[0075] Here, the sensor of the electronic device includes at least a gyroscope and an accelerometer. The gyroscope is used to obtain rotation data and angular velocity. The accelerometer is used to obtain acceleration data.

[0076] The posture information of an electronic device refers to parameters such as the direction, tilt angle, and rotation state of the electronic device in space.

[0077] During implementation, the posture information of the electronic device may be determined based on at least one of the following data: rotation data, angular velocity data, and acceleration data.

[0078] Step S140: determining the current deformation feature based on the posture information of the electronic device.

[0079] In the implementation process, the current deformation feature can be determined in combination with the posture information of the electronic device. For example, the current deformation feature can be determined in combination with the folding angle of the foldable mobile phone.

[0080] Figure 2A A schematic diagram of a standard posture of an electronic device provided in an embodiment of the present application; Figure 2B A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application; Figure 2C A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application; Figure 2D A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application; Figure 2E A schematic diagram of a non-standard posture of an electronic device provided in an embodiment of the present application.

[0081] For example, we can combine the above Figure 2A , 2B , 2C, 2D or 2E shows the posture information of the electronic device to determine the current deformation characteristics.

[0082] In the embodiment of the present application, the posture information of the electronic device is first determined based on the sensor data of the electronic device, and then the current deformation feature is determined based on the posture information of the electronic device. In this way, the current deformation feature can be accurately determined in combination with the posture information.

[0083] In some embodiments, the above step S120 "adjusting the target parameter of the audio array based on the relative position information" may be implemented by any of the following steps:

[0084] Step 121: Determine that the relative distance between any of the target audio units and other audio units is less than a relative distance threshold, and set the target audio unit as an invalid audio unit so that the target audio unit does not participate in the adjustment of the target parameter; or

[0085] Here, the relative distance threshold can be set according to actual needs.

[0086] During the implementation process, it is determined that the relative distance between the target audio unit and other audio units is small, that is, it can be determined that the pickup or broadcasting function of the target audio unit is affected. When the target audio unit is blocked by other audio units or physical hardware, it can be determined that the target audio unit cannot perform normal pickup or broadcasting functions, and the target audio unit is set to an invalid audio unit, and the invalid audio unit does not participate in the adjustment of the target parameters.

[0087] For example, if a certain deformation form causes the positions of microphones to substantially overlap, the two microphones whose positions substantially overlap cannot be used as two array elements in the microphone array to pick up sound.

[0088] In some embodiments, the target audio unit may be turned off when the relative distance between the target audio unit and other audio units is less than a relative distance threshold.

[0089] For example, if Figure 2E As shown, when the electronic device is folded, some sound pickup devices overlap, and the relative distance between the blocked sound pickup device and other devices is less than the relative distance threshold, resulting in the sound pickup device being unable to perform the sound pickup function. It can be determined that the sound pickup device is an invalid device.

[0090] Step 122: Determine that any of the target audio units is blocked and cannot work normally, and set the target audio unit to an invalid audio unit so that the target audio unit does not participate in the adjustment of the target parameters.

[0091] Here, the target audio unit may be blocked due to the change of the form of the electronic device, or due to the surrounding environment in which the electronic device is placed. When the target audio unit is blocked, it cannot work normally, and the target audio unit in the audio array can be set as an invalid audio unit, and the invalid audio unit does not participate in the adjustment of the target parameter.

[0092] For example, a hole blocking detection algorithm may be used to detect that a microphone is blocking a hole, and then the blocked microphone may be determined to be an invalid array element.

[0093] In some embodiments, the target audio unit may be turned off when the target audio unit is blocked.

[0094] For example, if Figure 2B As shown, when the electronic device is placed on the base bracket, the sound pickup device located below the electronic device is completely blocked by the base bracket and cannot perform the sound pickup function. It can be determined that the sound pickup device is an invalid device.

[0095] In an embodiment of the present application, it is determined that the relative distance between any target audio unit and other audio units is less than a relative distance threshold, and the target audio unit is set as an invalid audio unit. In this way, the target audio unit does not participate in the adjustment of the target parameters, thereby improving the efficiency of the target parameter adjustment.

[0096] It is determined that any of the target audio units is blocked and cannot work normally, and the target audio unit is set as an invalid audio unit. In this way, the target audio unit does not participate in the adjustment of the target parameters, thereby improving the efficiency of the target parameter adjustment.

[0097] In some embodiments, the above adjustment method further includes the following steps:

[0098] Step S150, determining the number of valid audio units based on the number of invalid audio units in the audio array;

[0099] During implementation, the number of valid audio units may be obtained by subtracting the data of invalid audio units from the total number of audio units in the audio array.

[0100] For example, the audio array may include 10 microphones. When it is determined that the number of invalid microphones is 4, it can be determined that the number of valid microphones is 6.

[0101] Step S160: Based on the number of valid audio units and / or the relative distance, determining that the target parameter cannot be adjusted so that the adjusted usage effect meets the first preset standard;

[0102] In some embodiments, it can be determined that the adjusted use effect cannot meet the first preset standard by adjusting the target parameters based on the number of valid audio units. During implementation, the data threshold of the valid audio unit can be set according to actual needs to determine whether the number of valid audio units is less than the number threshold. For example, the audio array includes 10 microphones, and the number threshold can be set to 4. When it is determined that the number of valid microphones is 2, it can be determined that no matter how it is adjusted, the adjusted use effect cannot meet the first preset standard.

[0103] In some embodiments, based on the relative distance between the valid audio units, it can be determined that the target parameter cannot be adjusted so that the adjusted usage effect meets the first preset standard. In the implementation process, the relative distance threshold between the valid audio units can be set according to actual needs to determine whether the relative distance between the valid audio units is less than the relative distance threshold. For example, the relative distance threshold can be set to 5 mm, such as Figure 2E As shown, when the relative distance between the audio units after the electronic device is folded is less than 5 mm, it can be determined that no matter how it is adjusted, the adjusted usage effect cannot meet the first preset standard.

[0104] In some embodiments, it can be determined that the adjusted use effect cannot meet the first preset standard by adjusting the target parameter based on the number of valid audio units and the relative distance between the valid audio units. For example, when it is determined that the number of valid audio units is less than 4 and the relative distances between the valid audio units are less than 5 mm, it can be determined that no matter how the adjustment is made, the adjusted use effect cannot meet the first preset standard.

[0105] Step S170: output a first prompt message to prompt the user to restore a valid audio array configuration.

[0106] During the implementation process, when the posture of the effective audio unit or electronic device is not sufficient to meet the basic requirements of the algorithm, the algorithm fails, and a failure response strategy is used and a first prompt message is output to prompt the user to restore the array element to validity.

[0107] In some embodiments, first prompt information for prompting a user to restore a valid audio array configuration may be input on a display interface of the electronic device.

[0108] In some embodiments, a playback unit may also be used to voice play the first prompt information for prompting the user to restore a valid audio array form.

[0109] In the embodiment of the present application, the number of valid audio units is first determined based on the number of invalid audio units in the audio array; then, based on the number and / or relative distance of the valid audio units, it is determined that the target parameters cannot be adjusted so that the adjusted use effect meets the first preset standard; finally, a first prompt message is output to prompt the user to restore the valid audio array form. In this way, when the target parameters cannot be adjusted so that the adjusted use effect meets the first preset standard, the first prompt message for prompting the user to restore the valid audio array form can be output, so that the user can understand that the use effect of the audio array cannot meet the first preset standard based on the first prompt message, so as to restore the use effect of the audio array by adjusting the form of the electronic device.

[0110] In some embodiments, the audio array includes at least a microphone array and / or a speaker array; Figure 3 As shown, the above step S320 "adjusting the target parameter of the audio array based on the relative position information so that the use effect of the audio array after adjusting the target parameter meets the first preset standard" can be achieved by the following steps:

[0111] Step S310: determine to use the speaker array to send a signal and use the microphone array to receive a signal;

[0112] The electronic device has a scenario where a speaker array sends out an audio signal and a microphone array receives the information signal, that is, a scenario where the electronic device sends and receives audio signals by itself. In this scenario, the speaker units in the speaker array set up by the electronic device itself can be used to send audio signals, and the microphone array set up by the electronic device itself can be used to receive audio signals.

[0113] For example, an audio file for testing a speaker array and a microphone array may be pre-set. During implementation, the speaker array may be used to play the audio file, and the microphone array may be used to receive the audio file.

[0114] Step S320: determining effective microphone units in the microphone array and effective speaker units in the speaker array based on the relative distance;

[0115] During implementation, when the electronic device is in different postures, the best speaker and microphone combination can be automatically selected based on the relative distance between the audio units.

[0116] In some embodiments, the relative distance between audio units can be calculated using an ultrasonic self-feedback algorithm, wherein the self-feedback algorithm for audio information transmits audio information and receives audio information bounced back by obstacles, and calculates the distance between audio units based on the time difference between transmission and reception.

[0117] Step S330: Adjust target parameters of the effective microphone unit and the effective speaker unit so that the use effects of the adjusted microphone array and speaker array meet the first preset standard.

[0118] During implementation, after the effective microphone units and the effective speaker units are determined, the target parameters of the microphone array and the speaker array that can work effectively are adjusted so that the use effects of the adjusted microphone array and the speaker array meet the first preset standard.

[0119] In the embodiment of the present application, it is first determined to use the speaker array to send signals and to use the microphone array to receive signals; then, based on the relative distance, the effective microphone unit in the microphone array and the effective speaker unit in the speaker array are determined; finally, the target parameters of the effective microphone unit and the effective speaker unit are adjusted so that the use effect of the adjusted microphone array and speaker array meets the first preset standard. In this way, in the scenario where the electronic device sends and receives audio signals by itself, by adjusting the target parameters of the effective microphone unit and the effective speaker unit, the use effect of the adjusted microphone array and speaker array meets the first preset standard.

[0120] In some embodiments, Figure 4As shown, a method for adjusting an interconnected audio array is provided, which can be implemented by the following steps:

[0121] Step S410: determining other electronic devices that communicate with the electronic device, wherein the audio arrays of the other electronic devices can form an interconnected audio array with the audio array of the electronic device;

[0122] Here, the communication between the electronic device and other electronic devices is established through a wired connection or a wireless connection, such as ultrasonic communication, so that one-way communication or two-way communication is performed between the electronic device and other electronic devices to enter an interconnected state.

[0123] Other electronic devices may be other mobile phones, stereos, microphones, etc. that are capable of playing or receiving audio information. In the implementation process, the audio arrays of other electronic devices may be used to form an interconnected audio array with the audio array of the electronic device.

[0124] For example, a mobile phone can communicate with multiple Bluetooth microphones or Bluetooth players via Bluetooth to form an interconnected microphone array and / or an interconnected speaker array.

[0125] Step S420, obtaining location information and orientation information of each electronic device constituting the interconnected audio array;

[0126] In some embodiments, the location information of each electronic device may be located by a global positioning system (GPS) or other satellite positioning systems.

[0127] In some embodiments, the location information of each electronic device can also be located based on a network; the location information of each electronic device can also be located based on Bluetooth or other short-range wireless communication technologies.

[0128] In some embodiments, the location information of each electronic device may be located by visual positioning, sensor-based positioning, or sound-based positioning.

[0129] The orientation information of the electronic device can be obtained based on sensors provided in the electronic device, such as an acceleration sensor, a gyroscope, and a geomagnetic sensor, etc. These sensors can sense the motion state and surrounding environment of the electronic device, thereby calculating the orientation of the electronic device.

[0130] In some embodiments, a three-dimensional coordinate system can be established based on the information shared by the interconnected electronic devices and the results of the distance measurement to locate and determine the location information of each electronic device.

[0131] Step S430: determining target parameters of the interconnected audio array based on the position information and orientation information of each electronic device, so that the use effect of the adjusted interconnected audio array meets the second preset standard.

[0132] During the implementation process, after obtaining data such as the position and orientation of all audio units in the device interconnection, each microphone unit begins to receive audio information in the environment, and after pre-processing by the electronic device, sends the audio information to other electronic devices that have established an interconnected relationship through communication, and aggregates the audio information obtained by each interconnected electronic device to determine the target parameters of the interconnected audio array based on the aggregated audio information, so that the use effect of the adjusted interconnected audio array meets the second preset standard.

[0133] Here, the second preset standard may be a preset standard determined based on the interconnected audio array. For example, the beam angle of each microphone determined in the interconnected microphone array may satisfy a preset angle threshold, the sound pickup intensity at a preset angle may satisfy a preset intensity threshold, and the clarity of the received voice signal may satisfy a preset clarity threshold.

[0134] In the embodiment of the present application, firstly, other electronic devices that communicate with the electronic device are determined, wherein the audio arrays of the other electronic devices can form an interconnected audio array with the audio array of the electronic device; then, the position information and orientation information of each electronic device that forms the interconnected audio array are obtained; finally, the target parameters of the interconnected audio array are determined based on the position information and orientation information of each electronic device, so that the use effect of the adjusted interconnected audio array meets the second preset standard. In this way, when forming an interconnected audio array, the target parameters can be determined based on the position information and orientation information of each electronic device, so that the use effect of the adjusted interconnected audio array meets the second preset standard.

[0135] In some embodiments, the method for adjusting the interconnected audio array further includes the following steps:

[0136] Step S440: When it is determined that the target parameter of the interconnected audio array cannot reach the second preset standard after adjusting the target parameter of the interconnected audio array, a second prompt message is output to prompt the user of the placement position and orientation information of each audio array in the interconnected audio array.

[0137] Here, if the second preset standard cannot be achieved by adjusting the target parameter, at least one second prompt information can be output to prompt the user how to adjust the placement and orientation of each electronic device in the interconnected audio array. For example, during the entire adjustment process, the second prompt information can be used to guide the user to move the device to a more suitable position and angle to achieve a better algorithm effect.

[0138] In an embodiment of the present application, when it is determined that adjusting the target parameters of the interconnected audio array cannot meet the second preset standard, a second prompt message is output, so that the second prompt message is used to prompt the user to adjust the placement position and orientation information of each audio array in the interconnected audio array, so that the interconnected audio array can achieve a better use effect.

[0139] The present application provides a method for adjusting speaker parameters due to deformation of an electronic device, which can be implemented by the following steps:

[0140] Step A: Adjust the speaker gain;

[0141] In the implementation process, the posture information of the electronic device can be obtained according to the gyroscope and accelerometer set in the electronic device, and the gains Gi of different speakers can be adjusted accordingly based on the posture information. For example, the playback energy of the blocked speaker can be reduced, while the playback gain of other unblocked speakers can be increased.

[0142] Step B: Use the spatial filter to adjust the playing effect of the speaker.

[0143] During implementation, a standard point P can be set diagonally in front of the electronic device, and the effect of playing standard audio at point P using a speaker in a standard posture can be recorded. In a non-standard posture, the effect of playing standard audio at point P can be recorded, and a spatial filter can be designed to adjust the playing effect of the speaker, so that the hearing sense at the standard point P and its vicinity remains consistent in different postures.

[0144] Here, the standard posture can be as follows Figure 2A The posture of the electronic device shown; non-standard posture can be as follows Figure 2B , 2C , and different postures of the electronic device shown in 2E.

[0145] During implementation, step S410 and / or step S420 may be executed to adjust the speaker of the electronic device in different postures.

[0146] In the embodiment of the present application, by adjusting the speaker gain and / or using a spatial filter to adjust the speaker's playing effect, it is possible to keep the speaker's playing effect unaffected when the electronic device changes its posture.

[0147] Based on the foregoing embodiments, an embodiment of the present application provides an adjustment device, which includes the modules included, each module includes each sub-module, each sub-module includes a unit, which can be implemented by a processor in an electronic device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0148] Figure 5 A schematic diagram of the structure of the adjustment device provided in the embodiment of the present application is shown in FIG. Figure 5 As shown, the device 500 includes:

[0149] A first acquisition module 510, configured to acquire relative position information of each audio unit included in an audio array of the electronic device under a current deformation feature in response to deformation of the electronic device;

[0150] The adjustment module 520 is configured to adjust the target parameters of the audio array based on the relative position information, so that the use effect of the audio array after the target parameters are adjusted meets a first preset standard.

[0151] In some embodiments, the first acquisition module 510 includes a first determination submodule, a second determination submodule and a third determination submodule, wherein the first determination submodule is used to determine the coordinate origin based on the structural characteristics of the electronic device; the second determination submodule is used to determine the coordinate value of each of the audio units relative to the coordinate origin based on the current deformation characteristics; the third determination submodule is used to determine the relative distance between the audio units based on the coordinate value of each of the audio units.

[0152] In some embodiments, the adjustment device also includes a first determination module and a second determination module, wherein the first determination module is used to determine the posture information of the electronic device based on sensor data of the electronic device, wherein the sensor data at least includes rotation data collected by a gyroscope, angular velocity and / or acceleration data collected by an accelerometer; and the second determination module is used to determine the current deformation feature based on the posture information of the electronic device.

[0153] In some embodiments, the adjustment module 520 includes a first setting submodule or a second setting submodule, wherein the first setting submodule is used to determine that the relative distance between any of the target audio units and other audio units is less than a relative distance threshold, and set the target audio unit to an invalid audio unit so that the target audio unit does not participate in the adjustment of the target parameters; the second setting submodule is used to determine that any of the target audio units is blocked and cannot work normally, and set the target audio unit to an invalid audio unit so that the target audio unit does not participate in the adjustment of the target parameters.

[0154] In some embodiments, the adjustment module 520 also includes a first determination submodule, a second determination submodule and an output submodule, wherein the first determination submodule is used to determine the number of valid audio units based on the number of invalid audio units in the audio array; the second determination submodule is used to determine, based on the number of valid audio units and / or the relative distance, that it is impossible to adjust the target parameters so that the adjusted usage effect meets the first preset standard; and the output submodule is used to output a first prompt message to prompt the user to restore the valid audio array form.

[0155] In some embodiments, the audio array includes at least a microphone array and / or a speaker array; the target parameter includes at least one of the following: a beam angle parameter, a suppression parameter, a sensitivity parameter and a gain parameter; the first preset standard includes at least one of the following: the beam angle satisfies a preset angle threshold, the pickup intensity at a preset angle satisfies a preset intensity threshold and the clarity of the received voice signal satisfies a preset clarity threshold.

[0156] In some embodiments, the adjustment module 520 includes a third determination submodule, a fourth determination submodule and an adjustment submodule, wherein the third determination submodule is used to determine the use of the speaker array to send a signal and the use of the microphone array to receive a signal; the fourth determination submodule is used to determine the effective microphone unit in the microphone array and the effective speaker unit in the speaker array based on the relative distance; the adjustment submodule is used to adjust the target parameters of the effective microphone unit and the effective speaker unit so that the use effect of the adjusted microphone array and speaker array meets the first preset standard.

[0157] In some embodiments, the adjustment device includes a third determination module, a second acquisition module and a fourth determination module, wherein the third determination module is used to determine other electronic devices that communicate with the electronic device, wherein the audio arrays of the other electronic devices can form an interconnected audio array with the audio array of the electronic device; the second acquisition module is used to obtain the position information and orientation information of each electronic device that constitutes the interconnected audio array; the fourth determination module is used to determine the target parameters of the interconnected audio array based on the position information and orientation information of each electronic device, so that the use effect of the adjusted interconnected audio array meets the second preset standard.

[0158] In some embodiments, the adjustment device also includes an output module for outputting a second prompt message to prompt a user of the placement position and orientation information of each audio array in the interconnected audio array when it is determined that the target parameters of the interconnected audio array cannot meet the second preset standard.

[0159] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0160] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable an electronic device (which can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.

[0161] Correspondingly, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the adjustment method provided in the above embodiment are implemented.

[0162] Correspondingly, an embodiment of the present application provides an electronic device, including an audio array, a processor and a memory, the audio array including audio units, the processor being used to obtain relative position information of each audio unit contained in the audio array of the electronic device under the current deformation feature in response to deformation of the electronic device; based on the relative position information, adjusting the target parameters of the audio array so that the use effect of the audio array after adjusting the target parameters meets the first preset standard, and the memory storing a computer program that can be run on the processor.

[0163] Figure 6 A hardware entity diagram of an electronic device provided in an embodiment of the present application, such as Figure 6 As shown, the hardware entity of the device 600 includes: a memory 601 and a processor 602, wherein the memory 601 stores a computer program that can be run on the processor 602, and the processor 602 implements the steps in the adjustment method provided in the above embodiment when executing the program.

[0164] The memory 601 is configured to store instructions and applications executable by the processor 602, and can also cache data to be processed or processed by the processor 602 and various modules in the electronic device 600 (for example, image data, audio data, voice communication data, and video communication data), which can be implemented through flash memory (FLASH) or random access memory (Random Access Memory, RAM).

[0165] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0166] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0167] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0168] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0169] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0170] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0171] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0172] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable an electronic device (which can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0173] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0174] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0175] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0176] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An adjustment method, the method comprising: In response to deformation of the electronic device, obtaining relative position information of each audio unit included in the audio array of the electronic device under the current deformation feature; Based on the relative position information, a target parameter of the audio array is adjusted so that a use effect of the audio array after the target parameter is adjusted meets a first preset standard.

2. The method according to claim 1, wherein in response to the electronic device generating a deformation, obtaining relative position information of each audio unit of the audio array of the electronic device under the current deformation feature comprises: Determining a coordinate origin based on structural features of the electronic device; Based on the current deformation feature, determining a coordinate value of each of the audio units relative to the coordinate origin; A relative distance between the audio units is determined based on the coordinate value of each of the audio units.

3. The method of claim 1, further comprising: Determining the posture information of the electronic device based on sensor data of the electronic device, wherein the sensor data at least includes rotation data collected by a gyroscope, angular velocity and / or acceleration data collected by an accelerometer; The current deformation feature is determined based on the posture information of the electronic device.

4. The method according to claim 1, wherein adjusting the target parameters of the audio array based on the relative position information comprises: Determining that the relative distance between any of the target audio units and other audio units is less than a relative distance threshold, setting the target audio unit as an invalid audio unit so that the target audio unit does not participate in the adjustment of the target parameter; or, It is determined that any of the target audio units is blocked and cannot work normally, and the target audio unit is set as an invalid audio unit so that the target audio unit does not participate in the adjustment of the target parameter.

5. The method of claim 4, further comprising: determining a number of valid audio units based on the number of invalid audio units in the audio array; Based on the number of the valid audio units and / or the relative distance, determining that the target parameter cannot be adjusted so that the adjusted usage effect meets the first preset standard; Output a first prompt message to prompt the user to restore a valid audio array state.

6. According to the method described in any one of claims 1 to 5, the audio array comprises at least a microphone array and / or a speaker array; the target parameter comprises at least one of the following: a beam angle parameter, a suppression parameter, a sensitivity parameter and a gain parameter; the first preset standard comprises at least one of the following: the beam angle satisfies a preset angle threshold, the pickup intensity at a preset angle satisfies a preset intensity threshold and the clarity of the received speech signal satisfies a preset clarity threshold.

7. The method according to claim 6, wherein adjusting the target parameter of the audio array based on the relative position information so that the use effect of the audio array after adjusting the target parameter meets the first preset standard comprises: Determine to use the speaker array to send a signal and use the microphone array to receive a signal; Based on the relative distance, determining an effective microphone unit in the microphone array and an effective speaker unit in the speaker array; The target parameters of the effective microphone unit and the effective speaker unit are adjusted so that the use effects of the adjusted microphone array and speaker array meet the first preset standard.

8. The method according to any one of claims 1 to 5, further comprising: Determining other electronic devices that communicate with the electronic device, wherein the audio arrays of the other electronic devices can form an interconnected audio array with the audio array of the electronic device; Acquiring location information and orientation information of each electronic device constituting the interconnected audio array; The target parameters of the interconnected audio array are determined based on the position information and the orientation information of each electronic device, so that the use effect of the adjusted interconnected audio array meets the second preset standard.

9. The method of claim 8, further comprising: When it is determined that adjusting the target parameters of the interconnected audio array cannot meet the second preset standard, a second prompt message is output to prompt the user of the placement position and orientation information of each audio array in the interconnected audio array.

10. An adjustment device, comprising: An acquisition module, configured to acquire relative position information of each audio unit included in an audio array of the electronic device under a current deformation feature in response to deformation of the electronic device; The adjustment module is used to adjust the target parameters of the audio array based on the relative position information, so that the use effect of the audio array after the target parameters are adjusted meets the first preset standard.

Images