Control method and electronic device

Abstract

The present disclosure provides a control method and an electronic device, the control method is applied to an electronic device, the method comprises: determining scene information; determining configuration information of a sound pickup device of the electronic device based on the scene information; configuring the sound pickup device based on the configuration information to pick up environmental audio; wherein the sound pickup device comprises a first type of sound pickup device with fixed sound pickup direction relative to the electronic device and a second type of sound pickup device with adjustable sound pickup direction relative to the electronic device.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of computers, and in particular, to a control method and an electronic device. BACKGROUND

[0002] Electronic devices are widely used in many fields such as work and life. In order to adapt to different fields, electronic devices have many functions. For example, network conference, online office, cloud gathering, online chat, online course, etc. However, the pickup device configured by the electronic device is in a fixed manner, and the pickup audio mode is single. SUMMARY

[0003] According to a first aspect of the present disclosure, a control method applied to an electronic device is provided, and the method comprises:

[0004] determining scene information;

[0005] determining configuration information of a pickup device of the electronic device based on the scene information;

[0006] configuring the pickup device based on the configuration information to pick up environmental audio;

[0007] wherein the pickup device comprises a first type of pickup device with fixed pickup direction relative to the electronic device and a second type of pickup device with adjustable pickup direction relative to the electronic device.

[0008] In an implementation manner, the configuration information comprises at least one of:

[0009] the number of enabled first type pickup devices and second type pickup devices;

[0010] the pickup direction information of the second type pickup device.

[0011] In an implementation manner, the scene information is determined by determining the scene information according to at least one of:

[0012] the state information of the electronic device;

[0013] the state and / or number of living beings around the electronic device.

[0014] In an implementation manner, the configuration information is further associated with a voice processing strategy of the electronic device, and the voice processing strategy is used to process the environmental audio.

[0015] In an implementation manner, the configuration information is associated with the voice processing strategy of the electronic device, comprising:

[0016] The configuration information comprises that the enabled pickup devices are at least two, and the pickup directions of the at least two pickup devices are the same, and the voice processing strategy of the electronic device is a noise reduction voice processing strategy based on the at least two pickup devices.

[0017] In an implementation manner, the configuration information is associated with the voice processing strategy of the electronic device, and comprises:

[0018] The configuration information comprises that the enabled pickup devices are at least one first type pickup device and at least one second type pickup device, the pickup direction of the first type pickup device is consistent with the screen extension direction of the electronic device, and the pickup direction of the at least one second type pickup device is away from the screen of the electronic device, and the voice processing strategy of the electronic device is a narrow beam voice processing strategy or an audio zoom voice processing strategy; the narrow beam voice processing strategy comprises: performing directional noise reduction according to the difference between the directivity and the pickup energy of the first type pickup device and the second type pickup device, and eliminating the sound outside the predetermined angle area size on one side of the screen of the electronic device; and the audio zoom voice processing strategy comprises: enhancing the sound in the area corresponding to the camera and weakening the sound outside the area corresponding to the camera.

[0019] In an implementation manner, the configuration information is associated with the voice processing strategy of the electronic device, and comprises:

[0020] The configuration information comprises that the enabled pickup devices are at least one first type pickup device and at least one second type pickup device, the pickup direction of the first type pickup device is consistent with the screen extension direction of the electronic device, and the pickup direction of the at least one second type pickup device is towards one side of the screen of the electronic device, and the voice processing strategy of the electronic device is to enhance the sound on one side of the screen.

[0021] In an implementation manner, the pickup devices are configured based on the configuration information, comprising:

[0022] According to the pickup direction information of the second type pickup device, the second type pickup device is controlled to move so that the pickup direction of the second type pickup device matches the pickup direction information; or

[0023] According to the pickup direction information of the second type pickup device, the opening and closing of the pickup holes in different directions of the second type pickup device are controlled so that the pickup direction of the second type pickup device matches the pickup direction information.

[0024] In an implementation manner, the method further comprises:

[0025] configure the pickup device with the first configuration information in response to the electronic device enabling the pickup device;

[0026] configure the pickup device with the second configuration information if the second configuration information of the pickup device determined based on the scene information is different from the first configuration information.

[0027] According to a second aspect of the present disclosure, a control device is provided, the device comprising:

[0028] a determining module configured to determine scene information and determine configuration information of a pickup device of an electronic device based on the scene information;

[0029] a configuring module configured to configure the pickup device based on the configuration information to pick up environmental audio;

[0030] wherein the pickup device comprises a first type of pickup device fixed in a pickup direction relative to the electronic device and a second type of pickup device adjustable in the pickup direction relative to the electronic device.

[0031] According to a third aspect of the present disclosure, an electronic device is provided, comprising:

[0032] a first type of pickup device fixed in a pickup direction relative to the electronic device;

[0033] a second type of pickup device adjustable in the pickup direction relative to the electronic device;

[0034] at least one processor; and

[0035] a memory communicatively connected to the at least one processor; wherein

[0036] the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of the present disclosure.

[0037] According to a fourth aspect of the present disclosure, a non-transitory computer readable storage medium storing computer instructions is provided, the computer instructions being used to cause the computer to perform the method of the present disclosure.

[0038] The control method of the present disclosure is used for an electronic device, the pickup device of the electronic device includes a first type pickup device fixed in a pickup direction of the electronic device and a second type pickup device adjustable in the pickup direction of the electronic device, in the method of the present disclosure, configuration information of the pickup device of the electronic device can be determined based on scene information; the pickup device is configured based on the configuration information to pick up environmental audio. By using the configuration information corresponding to the scene information to configure the pickup device, the environmental audio can be picked up in a targeted manner for different scene information, the voice quality for various scenes can be optimized, and the user experience is improved.

[0039] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0040] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will be more apparent from the following detailed description read in conjunction with the accompanying drawings, in which:

[0041] In the drawings, identical or corresponding reference numerals indicate identical or corresponding parts.

[0042] Figure 1 An implementation flowchart of the control method of the embodiment of the present disclosure is shown Figure 1 ;

[0043] Figure 2 An implementation flowchart of the control method of the embodiment of the present disclosure is shown Figure 2 ;

[0044] Figure 3 An implementation flowchart of the control method of the embodiment of the present disclosure is shown Figure 3 ;

[0045] Figures 4a to 4c The schematic diagrams of the electronic device one and the pickup device thereof configured by applying the control method of the embodiment of the present disclosure are shown respectively;

[0046] Figures 5a to 5c The schematic diagrams of the electronic device two and the pickup device thereof configured by applying the control method of the embodiment of the present disclosure are shown respectively;

[0047] Figures 6a to 6c The schematic diagrams of the electronic device three and the pickup device thereof configured by applying the control method of the embodiment of the present disclosure are shown respectively;

[0048] Figures 7a to 7d The schematic diagrams of the electronic device four and the pickup device thereof configured by applying the control method of the embodiment of the present disclosure are shown respectively;

[0049] Figure 8 A constituent structure schematic diagram of a control device in an embodiment of the present disclosure is shown.

[0050] Figure 9 A constituent structure schematic diagram of an electronic device in an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0051] For the purposes of making the objectives, features, and advantages of the present disclosure more apparent and easy to understand, the technical strategies in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present disclosure.

[0052] Referring to Figure 1 The present embodiment provides a control method, which is applied to an electronic device. The control method of the present embodiment comprises:

[0053] S1, determining scene information;

[0054] S2, determining configuration information of a pickup device of the electronic device based on the scene information;

[0055] S3, configuring the pickup device based on the configuration information, to pick up ambient audio;

[0056] The pickup device comprises a first type pickup device 10 with fixed pickup direction relative to the electronic device and a second type pickup device 20 with adjustable pickup direction relative to the electronic device.

[0057] The control method of the present disclosure is applied to an electronic device. The pickup device of the electronic device comprises a first type pickup device 10 with fixed pickup direction relative to the electronic device and a second type pickup device 20 with adjustable pickup direction relative to the electronic device. In the method of the present embodiment, the configuration information of the pickup device of the electronic device can be determined based on the scene information. The pickup device is configured based on the configuration information, to pick up ambient audio. By configuring the pickup device with the configuration information corresponding to the scene information, the ambient audio can be picked up in a targeted manner for different scene information. The present embodiment can provide better voice quality for various scenes and improve user experience.

[0058] In the present embodiment, the pickup device can comprise a microphone. The specific manner in which the second type pickup device 20 adjusts the pickup direction is not limited.

[0059] In the example embodiment, the second type of pickup device 20 comprises a microphone and a shell, the microphone is arranged in the shell, and the shell has a pickup hole in one direction. By rotating the second type of pickup device 20, the direction of the pickup hole can be changed, so as to adjust the pickup direction of the second type of pickup device 20 relative to the electronic device.

[0060] For the convenience of description, in the embodiment of the present disclosure, the electronic device is vertically arranged, the side of the screen of the electronic device is the front, and the side away from the screen is the back. Referring to Figures 4a to 6c , by rotating the second type of pickup device 20, the pickup direction relative to the electronic device can be adjusted to be in different directions such as forward, backward, upward, etc. The second type of pickup device 20 can include an enabled state and a disabled state. When the second type of pickup device 20 is moved to adjust the pickup direction, the second type of pickup device 20 in the disabled state can be stored in the electronic device, and the second type of pickup device 20 in the enabled state can be extended from the electronic device. In a specific implementation, a receiving cavity can be formed on the shell of the electronic device. In the disabled state, the second type of pickup device 20 is driven by a driving mechanism such as a motor to be stored in the receiving cavity. In the enabled state, the second type of pickup device 20 is driven by the driving mechanism to extend from the receiving cavity and rotate to adjust the pickup direction.

[0061] In other example embodiments, referring to Figures 7a to 7d , the second type of pickup device 20 corresponds to pickup holes in multiple different directions, and the pickup direction is adjusted by opening and closing the pickup holes. The second type of pickup device 20 can be arranged inside the electronic device, and the shell of the electronic device is provided with pickup holes corresponding to the second type of pickup device 20. For example, the second type of pickup device 20 is arranged near the upper side of the electronic device, and the shell of the electronic device is provided with pickup holes corresponding to the second type of pickup device 20 in the directions of front, back, and up. The pickup direction can be adjusted by opening and closing the pickup holes through the cover plate 30. When the pickup direction is backward, the backward pickup hole can be opened, and the pickup holes in other directions can be closed. In a specific implementation, the shell can have first pickup holes in different directions, and the cover plate 30 can have second pickup holes in different directions. When the cover plate 30 moves along a straight line, only the first pickup hole in one direction is opposite to the corresponding second pickup hole at different positions. For example, referring to Figure 7b , at the first position, the forward second pickup hole is opposite to the forward first pickup hole, and the second pickup holes in other directions are misaligned with the corresponding first pickup holes; referring to Figure 7c , at the second position, the upward second pickup hole is opposite to the upward first pickup hole, and the second pickup holes in other directions are misaligned with the corresponding first pickup holes; referring to Figure 7dIn the third position, the second sound pickup hole facing backward is opposite to the first sound pickup hole facing backward, and the second sound pickup hole in other directions is staggered with the corresponding first sound pickup hole.

[0062] In an implementation, the configuration information includes at least one of the following: the number of enabled first type sound pickup devices 10 and the number of enabled second type sound pickup devices 20; the sound pickup direction information of the second type sound pickup devices 20. In the embodiments of the present disclosure, the number of first type sound pickup devices 10 and the number of second type sound pickup devices 20 are at least one, respectively. In the exemplary embodiments, the total number of first type sound pickup devices 10 and second type sound pickup devices 20 can be at least three. The configuration of the sound pickup devices according to the configuration information determined by the scene information can be flexibly implemented in different ways to pick up the environmental audio in different combinations of different numbers and / or different sound pickup directions. When only the first type sound pickup devices 10 are enabled, the configuration information can only include the number information of the first type sound pickup devices 10. When the enabled sound pickup devices include the first type sound pickup devices 10 and the second type sound pickup devices 20, the configuration information includes the number information of the first type sound pickup devices 10 and the second type sound pickup devices 20, and the direction information of the second type sound pickup devices 20.

[0063] In the embodiments of the present disclosure, the configuration information is not limited to the part described in the above embodiments, and can also include the enabled position information of the first type sound pickup devices 10 and the second type sound pickup devices 20. When the number of enabled first type sound pickup devices 10 or second type sound pickup devices 20 is less than the total number of each, the combination of first type sound pickup devices 10 and second type sound pickup devices 20 in different positions can adapt to different sound pickup modes. For example, Figures 6a to 6c , the total number of first type sound pickup devices 10 is three, which are respectively arranged on the upper side and the right side of the electronic device, of course, can also be arranged on the left side, the upper side and the right side, respectively, or all arranged on the upper side, and other setting schemes. When the number of enabled is two, see Figures 6a to 6c , if the enabled position information indicates that two first type sound pickup devices 10 on the upper side are enabled, then two first type sound pickup devices 10 on the upper side are enabled according to the enabled position information; if the enabled position information indicates that the first type sound pickup devices 10 on the right side and the left side of the upper side are enabled, then the first type sound pickup devices 10 on the right side and the left side of the upper side are enabled according to the enabled position information. Similarly, when the configuration information includes the enabled position information of the second type sound pickup devices 20, then the second type sound pickup devices 20 in the corresponding position are enabled according to the enabled position information. For example, see Figures 5a to 7a , the total number of second type sound pickup devices 20 is two. Figures 6a to 6c , the two second type sound pickup devices 20 can be respectively arranged on the upper side and the left side of the electronic device, or as Figures 5a to 5c , the two second type sound pickup devices 20 can be respectively arranged on the right side and the left side of the electronic device. Or other suitable setting schemes. When the number of enabled is one, seeFigures 5a to 5c If the second type of pickup device 20 on the right side is enabled according to the enabled position information, the second type of pickup device 20 on the right side is enabled according to the enabled position information. For other position combinations of the first type of pickup device 10 and the second type of pickup device 20, refer to the above examples, which will not be repeated here.

[0064] Referring to Figures 4a to 4c For example, two first type of pickup devices 10 and one second type of pickup device 20, through different combinations of the number and pickup direction of the pickup devices, more pickup modes can be realized with fewer pickup devices. During a call, two pickup devices can be enabled to realize voice noise reduction and improve the voice quality of the call. The two enabled pickup devices can be two first type of pickup devices 10, in which case the configuration information can only include the number of first type of pickup devices 10. The two enabled pickup devices can also be one first type of pickup device 10 and one second type of pickup device 20. In this case, the configuration information includes the number information of the first type of pickup device 10 and the second type of pickup device 20, and the pickup direction information of the second type of pickup device 20. The pickup direction of the second type of pickup device 20 can be consistent with the pickup direction of the first type of pickup device 10. Alternatively, in the above example, both the two first type of pickup devices 10 and the second type of pickup device 20 are enabled, and through the combination of different pickup directions of the second type of pickup device 20 and the first type of pickup device 10, multiple pickup modes can be realized.

[0065] In the embodiments of the present disclosure, when the first type of pickup device 10 is at least two, the pickup directions of the at least two first type of pickup devices 10 can be consistent or inconsistent. The pickup directions consistent include all facing forward, all facing backward, and all consistent with the screen extension direction. The pickup directions consistent with the screen extension direction include upward, downward, leftward, and rightward. The at least two first type of pickup devices 10 can be disposed on the same side of the electronic device, or can be disposed on different sides. For example, referring to Figures 4a to 4c The at least two first type of pickup devices 10 are disposed on the upper side of the electronic device, and the pickup directions are all upward. Alternatively, referring to Figures 6a to 6c The at least two first type of pickup devices 10 are disposed on at least two different sides of the electronic device, and the pickup directions are respectively consistent with the screen extension direction, for example, the pickup direction of the first type of pickup device 10 disposed on the left side is leftward, and the pickup direction of the first type of pickup device 10 disposed on the right side is rightward. The pickup direction of the second type of pickup device 20 includes a first direction consistent with the pickup direction of the fixed microphone, a second direction perpendicular to the pickup direction of the fixed microphone, and the first direction is opposite to the second direction. The first direction can be toward one side of the screen, and the second direction is away from one side of the screen.

[0066] In an implementation, the S1 determines the scene information, including determining the scene information according to at least one of the following: the state information of the electronic device; the state and / or quantity of the living beings around the electronic device. See Figure 2 , specifically including: S11, obtaining the state information of the electronic device; S12, obtaining the state and / or quantity of the living beings around the electronic device; S13, determining the scene information according to at least one of the information obtained in the above steps S11 and S12.

[0067] The state information of the electronic device includes the environmental information of the electronic device, the motion information of the electronic device, and the application information of the electronic device running. According to the environmental information, the scene information can be determined. In an exemplary embodiment, according to the environmental information, the noise value of the environment where the electronic device is located is determined, and the scene information is determined according to the noise value. For example, when the noise value reaches a preset noise threshold, it can be determined that the environment where the electronic device is located is relatively noisy, and the scene information is determined as a voice noise reduction scene, and accordingly the configuration information of the pickup device is determined as a voice noise reduction pickup mode. Specifically, at least two pickup devices can be enabled, and the pickup directions of the at least two pickup devices are consistent. The at least two pickup devices can be both the first type pickup device 10, or can be both the first type pickup device 10 and the second type pickup device 20. For example, two first type pickup devices 10 are enabled, and the pickup directions of the two first type pickup devices 10 are consistent; or three first type pickup devices 10 are enabled, and the pickup directions of the three first type pickup devices 10 are consistent; or at least one second type pickup device 20 is enabled on the basis of the above first type pickup device 10, and the pickup direction of the second type pickup device 20 is consistent with the pickup direction of the first type pickup device 10.

[0068] According to the motion information of the electronic device, the scene information can be determined. In an exemplary embodiment, according to the motion information, it is determined that the electronic device is in a motion state or a stationary state, as well as the distance, spatial pose and other information of the motion. When the electronic device is in a motion state, it can be determined that the scene information is a voice noise reduction scene, and accordingly the configuration information of the pickup device is determined as a voice noise reduction pickup mode. When the electronic device is in a stationary state, it can be determined that the scene information is a sound source positioning scene or a voice wake-up scene, and accordingly the configuration information is determined as enabling at least three pickup devices, and the pickup directions of the at least three pickup devices are consistent. Specifically, the at least three pickup devices can be all first type pickup devices 10, or can be both the first type pickup device 10 and the second type pickup device 20.

[0069] According to the application information, the scene information can be determined. For example, according to the application information, it can be determined that the application currently running on the electronic device is a conference application. When the application is a conference application, it can be determined that the scene information is a conference scene. Accordingly, it can be determined that the configuration information is to enable two first-type pickup devices 10 and one second-type pickup device 20, and the pickup direction of the second-type pickup device 20 is backward. Or when the application is an instant messaging application, it can be determined that the scene information is a call scene. Accordingly, it can be determined that the configuration information is to enable two first-type pickup devices 10. Or when the application is a camera application, it can be determined that the scene information is a camera scene. Accordingly, it can be determined that the configuration information is to enable two first-type pickup devices 10 and one second-type pickup device 20, and the pickup direction of the second-type pickup device 20 is backward.

[0070] According to the state and / or number of the surrounding active organisms of the electronic device, the scene information can be determined. The number of the surrounding active organisms is the number of the people surrounding the electronic device, for example, whether it is one person or multiple people, etc. The state of the surrounding active organisms may, for example, be the state of the people surrounding the electronic device, etc., for example, multiple people are distributed in front of the electronic device to have a meeting or class, or multiple people are distributed around the electronic device to listen to music, or to have a lecture in front of the electronic device, multiple people video, single person video, face-to-face communication, etc. The state and / or number of the surrounding active organisms of the electronic device can be determined by one or more of ultrasonic information and image information taken by the camera, etc. In an example embodiment, according to the state and / or number of the surrounding active organisms of the electronic device, it is determined that the scene information is a personal conference scene. Accordingly, it can be determined that the configuration information of the pickup device is to enable at least two first-type pickup devices 10 and one second-type pickup device 20, and the pickup direction of the first-type pickup device 10 is upward, and the pickup direction of the second-type pickup device is backward.

[0071] In the embodiments of the present disclosure, the scene information can also be determined by combining multiple information in the state information and / or the state and / or number of the surrounding active organisms. For example, the current application information of the electronic device determines that the application is a conference application, and the environmental noise exceeds the preset noise threshold. It is determined that the scene information is a personal conference scene. Accordingly, it can be determined that the configuration information of the pickup device is to enable at least two first-type pickup devices 10 and one second-type pickup device 20, and the pickup direction of the first-type pickup device 10 is upward, and the pickup direction of the second-type pickup device is backward.

[0072] In an implementable manner, the configuration information is also associated with a voice processing strategy of the electronic device, and the voice processing strategy is used to process the ambient audio. According to the association of the configuration information with the voice processing strategy, the electronic device can enable the corresponding voice processing strategy to process the ambient audio picked up by the pickup device, match the configuration information with the voice processing strategy, adapt to different scene information, optimize the voice quality in different scenes, and improve the user experience. The association of the configuration information with the voice processing strategy can be that the configuration information and the voice processing strategy correspond to the scene information respectively, and the configuration information and the voice processing strategy can be determined through the scene information. Alternatively, the voice processing strategy can correspond to the configuration information, the configuration information can be determined according to the scene information, and the corresponding voice processing strategy can be determined according to the correspondence between the voice processing strategy and the configuration information. For example, according to the personal meeting scene information, it is determined that the configuration information is to enable at least two first-type pickup devices 10 and one second-type pickup device 20, the pickup direction of the first-type pickup device 10 is upward, the pickup direction of the second-type pickup device 20 is backward, and the corresponding voice processing strategy is a narrow-beam voice processing strategy.

[0073] In the embodiments of the present disclosure, the configuration information is associated with the language processing strategy, based on the determined scene information, the configuration information and the corresponding voice processing strategy can be determined to better provide the user with a voice use experience in different scenes.

[0074] Referring to Figure 3 In specific implementations, the following steps can be included:

[0075] S301, the electronic device is started;

[0076] S302, it is determined whether the pickup device is enabled by the electronic device;

[0077] S303, if the pickup device is enabled, scene one can be entered based on the determined scene, or a default mode can be set as scene one;

[0078] S304, in scene one, the pickup device is configured based on the first configuration information and the corresponding first voice processing strategy;

[0079] S305, it is determined whether the scene information changes;

[0080] S306, if it is determined that scene two is the new scene according to the new scene information, S307 is performed;

[0081] S307, the pickup device is configured based on the second configuration information and the corresponding second voice processing strategy;

[0082] S308, if it is determined that scene three is the new scene according to the new scene information, S309 is performed;

[0083] S309, configuring the sound pickup device and the corresponding third voice processing strategy based on the third configuration information;

[0084] S310, if it is determined that the scene is scene four according to the new scene information, performing S311;

[0085] S311, configuring the sound pickup device and the corresponding fourth voice processing strategy based on the fourth configuration information.

[0086] Of course, more scenes, configuration information and voice processing strategies can be corresponded in the method of the embodiments of the present disclosure. The voice processing strategies in the embodiments of the present disclosure include but are not limited to: a noise reduction voice processing strategy, a narrow beam voice processing strategy, an audio zoom voice processing strategy, a high-definition recording voice processing strategy, a sound source positioning voice processing strategy and a voice enhancement processing strategy.

[0087] For example, scene one can be a call scene, and the first voice processing strategy can be a noise reduction voice processing strategy; scene two can be a voice wake-up scene, and the second voice processing strategy can be a sound positioning processing strategy; scene three can be a camera shooting scene, and the third voice processing strategy can be an audio zoom voice processing strategy; and scene four can be a recording scene, and the fourth voice processing strategy can be a high-definition recording voice processing strategy.

[0088] In an implementable manner, the configuration information is associated with the voice processing strategy of the electronic device, including: the configuration information includes at least two enabled sound pickup devices, and the sound pickup directions of the at least two sound pickup devices are the same, and the voice processing strategy of the electronic device is a noise reduction voice processing strategy based on the at least two sound pickup devices. In a specific implementation, the enabled sound pickup devices can be two first type sound pickup devices 10, both of which are arranged on the upper side of the electronic device and have upward sound pickup directions, and the second type sound pickup device 20 does not participate in sound pickup. The corresponding voice processing strategy can be a noise reduction voice processing strategy based on two sound pickup devices. Alternatively, the enabled sound pickup devices can be three first type sound pickup devices 10, all of which are arranged on the upper side of the electronic device and have upward sound pickup directions, and the second type sound pickup device 20 does not participate in sound pickup. The corresponding voice processing strategy can be a noise reduction voice processing strategy based on a linear array of three sound pickup devices, or a sound source positioning voice processing strategy based on three sound pickup devices. Alternatively, referring to Figure 4b, the enabled pickup devices can be two first-type pickup devices 10 and one second-type pickup device 20, both of the first-type pickup devices 10 are arranged on the upper side of the electronic device, and the pickup directions of the first-type pickup devices 10 and the second-type pickup device 20 are both upward. The corresponding voice processing strategy can be a noise reduction voice processing strategy based on three pickup devices in a linear array, or a sound source positioning voice processing strategy based on three pickup devices. By picking up environmental audio through three or more pickup devices with consistent pickup directions, and processing the environmental audio through the noise reduction voice processing strategy or the sound source positioning voice processing strategy, more accurate noise reduction or far-field voice wake-up can be achieved.

[0089] In an implementation, the configuration information is associated with a voice processing strategy of the electronic device, including: the configuration information includes that the enabled pickup devices are at least one first-type pickup device 10 and at least one second-type pickup device 20, the pickup direction of the first-type pickup device 10 is consistent with the screen extension direction of the electronic device, and the pickup direction of the at least one second-type pickup device 20 is away from the screen of the electronic device, and the voice processing strategy of the electronic device is a narrow-beam voice processing strategy or an audio zoom voice processing strategy. In the embodiment of the present disclosure, the total number of enabled pickup devices can be at least three, and the pickup direction of the at least one second-type pickup device 20 is backward, and the pickup direction of the other pickup devices is consistent with the screen extension direction. In a specific implementation, see Figure 4c , the enabled pickup devices can be two first-type pickup devices 10 and one second-type pickup device 20, both of the first-type pickup devices 10 are arranged on the upper side of the electronic device, and the pickup directions of the first-type pickup devices 10 and the second-type pickup device 20 are both upward. The corresponding voice processing strategy can be a noise reduction voice processing strategy based on three pickup devices in a linear array, or a sound source positioning voice processing strategy based on three pickup devices. By picking up environmental audio through three or more pickup devices with consistent pickup directions, and processing the environmental audio through the noise reduction voice processing strategy or the sound source positioning voice processing strategy, more accurate noise reduction or far-field voice wake-up can be achieved.

[0090] The narrow beam voice processing strategy includes: according to the difference of the pickup directivity and the difference of the pickup energy of the first type pickup device 10 and the second type pickup device 20, directional noise reduction is performed to eliminate the sound outside the predetermined angle area size on one side of the screen of the electronic device. Taking two first type pickup devices 10 and one second type pickup device 20 as an example, the corresponding scene can be a personal meeting scene, and the meeting application on the electronic device is in a personal meeting mode. The two first type pickup devices 10 with the upward pickup direction are used for main pickup and noise reduction, and the second type pickup device 20 with the backward pickup direction is used for picking up noise. By using the directivity of the two types of pickup devices in the pickup direction and the energy difference of the sound, the sound in front and behind the electronic device can be well distinguished, directional noise reduction is realized, only the sound within the predetermined angle area size on one side of the screen of the electronic device is retained, and the rest of the sound is eliminated.

[0091] The audio zoom voice processing strategy includes: enhancing the sound in the area corresponding to the camera and weakening the sound outside the area corresponding to the camera. Taking two first type pickup devices 10 and one second type pickup device 20 as an example, the corresponding scene can be a camera scene, and the second type pickup device 20 with the backward pickup direction is used for zooming with the camera to enhance the sound picked up in the area corresponding to the camera.

[0092] In an implementation manner, the configuration information is associated with the voice processing strategy of the electronic device, including: the configuration information includes at least one first type pickup device 10 and at least one second type pickup device 20 as the enabled pickup devices, the pickup direction of the first type pickup device 10 is consistent with the screen extension direction of the electronic device, the pickup direction of the at least one second type pickup device 20 is toward one side of the screen of the electronic device, and the voice processing strategy of the electronic device is to enhance the sound on one side of the screen. In the embodiment of the present disclosure, the total number of the enabled pickup devices can be at least three, and the pickup direction of the at least one second type pickup device 20 is forward, and the pickup direction of the other pickup devices is consistent with the screen extension direction. In a specific implementation, see Figure 4a , the enabled pickup devices can be two first type pickup devices 10 and one second type pickup device 20, the two first type pickup devices 10 are arranged on the upper side of the electronic device, and the pickup direction of the first type pickup device 10 is upward, and the pickup direction of the second type pickup device 20 is forward. The corresponding voice processing strategy can be a high-definition recording processing strategy or a voice enhancement processing strategy. The second type pickup device performs front pickup, adopts the high-definition recording processing strategy, can enhance the front pickup effect, realizes far distance pickup, and improves the performance. It can also cooperate with the voice recognition processing strategy to realize far field voice interaction processing, so that the sound is clearer. Or see Figures 6a to 6c , the first type pickup device 10 is three or more.

[0093] In an implementation, the pickup device is configured based on the configuration information, including: according to the pickup direction information of the second type pickup device 20, controlling the movement of the second type pickup device 20 to match the pickup direction of the second type pickup device 20 with the pickup direction information. In the embodiment of the present disclosure, the second type pickup device 20 can be driven to rotate by the driving mechanism according to the configuration information, so as to realize the adjustment of the pickup direction of the second type pickup device 20. Specifically, the second type pickup device 20 can have a pickup hole in one direction, and the adjustment of the pickup direction of the second type pickup device 20 can be realized by adjusting the direction of the pickup hole. The electronic device can have a containing cavity for accommodating the second type pickup device 20, and when the second type pickup device 20 is not enabled, the second type pickup device 20 is accommodated in the containing cavity. When the second type pickup device 20 is enabled, the second type pickup device 20 is driven to extend out of the containing cavity by the driving mechanism, and the second type pickup device 20 is driven to rotate to adjust the pickup direction.

[0094] The control method of the embodiment of the present disclosure can realize various pickup modes with a small number of pickup devices, for example, a total of three pickup devices, and a small number of second type pickup devices 20, for example, only one second type pickup device 20, adapt to different scenes, provide better quality voice service for different scenes, have low cost, and improve user experience. Further, cooperating with the voice processing strategy in different scenes, the voice use experience of the user can be better provided.

[0095] In an implementation, according to the pickup direction information of the second type pickup device 20, the opening and closing of the pickup holes in different directions of the second type pickup device 20 are controlled to match the pickup direction of the second type pickup device 20 with the use direction information. In the embodiment of the present disclosure, the second type pickup device 20 can be arranged inside the electronic device, and different direction pickup holes corresponding to the second type pickup device 20 can be arranged on the shell of the electronic device. Taking the second type pickup device 20 arranged close to the upper side of the electronic device as an example, the pickup holes corresponding to the second type pickup device 20 are arranged on the shell of the electronic device in the front, rear, and upper directions, respectively. The cover plate 30 can be used to open and close the pickup holes to realize the adjustment of the pickup direction. When the pickup direction is rearward, the rearward pickup hole can be opened, and the pickup holes in other directions can be closed.

[0096] In an implementation, referring to Figure 3The method of the embodiment of the present disclosure further comprises: configuring the sound pickup device with first configuration information in response to the electronic device enabling the sound pickup device; and configuring the sound pickup device with second configuration information if the second configuration information of the sound pickup device determined based on the scene information is different from the first configuration information. In a scenario of using voice, the electronic device enables the sound pickup device, and when the sound pickup device is enabled, the scene information is determined again, and the configuration information of the sound pickup device is further determined according to the scene information, and the sound pickup device is configured according to the configuration information to pick up the environmental audio. When the sound pickup device is configured with the first configuration information, the first voice processing strategy associated with the first configuration information is enabled at the same time, and when the sound pickup device is configured with the second configuration information, the second voice processing strategy associated with the second configuration information is enabled at the same time. When it is monitored that the electronic device enables the sound pickup device, the sound pickup device is configured with the first configuration information, and the first configuration information can be any one of the configuration modes that can be implemented by the sound pickup device of the electronic device. For example, two first-type sound pickup devices 10 are enabled as the first configuration information, and the corresponding first voice processing strategy is a noise reduction voice processing strategy. The first configuration information can be a default configuration information, and the first voice processing strategy is a default voice processing strategy. When the electronic device enables the sound pickup device, the sound pickup device is configured with the first configuration information, and the picked-up environmental audio is processed with the first voice processing strategy, so as to avoid the sound pickup dead time and affect the user experience. If the second configuration information of the sound pickup device determined based on the scene information is the same as the first configuration information, the first configuration information is continued to be used without change. The second configuration information different from the first configuration information can be, for example, that the sound pickup direction of the enabled second-type sound pickup device is forward, the sound pickup direction is backward, or the sound pickup direction is upward, and the total number of the enabled sound pickup devices is three or four. At this time, the second voice processing strategy corresponding to the second configuration information can be a narrow-beam voice processing strategy, an audio zoom voice processing strategy, a high-definition recording voice processing strategy, or a voice enhancement processing strategy. For example, the second configuration information is that two first-type sound pickup devices 10 and one second-type sound pickup device 20 are enabled, and the sound pickup direction of the second-type sound pickup device 20 is forward, so that the sound pickup device is configured with the second configuration information, and the high-definition recording voice processing strategy is enabled at the same time, so that the configuration information and the voice processing strategy correspond to the scene information, and high-quality voice service is provided.

[0097] Referring to Figure 8 The embodiment of the present disclosure provides a control device, which comprises a determination module and a configuration module. The determination module is used to determine scene information and determine configuration information of a sound pickup device of an electronic device based on the scene information. The configuration module is used to configure the sound pickup device based on the configuration information to pick up environmental audio. The sound pickup device comprises a first-type sound pickup device 10 with a fixed sound pickup direction relative to the electronic device and a second-type sound pickup device 20 with an adjustable sound pickup direction relative to the electronic device.

[0098] The control device of the embodiments of the present disclosure can implement the method of the above embodiments, and the description of the control device embodiments above is similar to the description of the above method embodiments, has similar beneficial effects as the above method embodiments, and thus is not described again. For technical details of the control device embodiments of the present disclosure that have not been disclosed, please refer to the description of the above method embodiments for understanding, and thus is not described again for saving space.

[0099] According to embodiments of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

[0100] Figure 9 A schematic block diagram of an example electronic device 900 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present disclosure described and / or claimed in this document.

[0101] As shown in Figure 9 The electronic device 900 includes a computing unit 901 that can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded from a storage unit 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 can also be stored in the RAM 903. The computing unit 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0102] Various components in the electronic device 900 are connected to the I / O interface 905, including an input unit 906, such as a keyboard, a mouse, etc.; an output unit 907, such as various types of displays, a speaker, etc.; the storage unit 908, such as a magnetic disk, an optical disk, etc.; a communication unit 909, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 909 allows the electronic device 900 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks; and a sound pickup device 910, such as the first type of sound pickup device 10 fixed in a sound pickup direction relative to the electronic device 900 and the second type of sound pickup device 20 adjustable in a sound pickup direction relative to the electronic device 900, for picking up environmental audio.

[0103] The computing unit 901 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 901 performs various methods and processes described above, such as the control method. For example, in some embodiments, the hollowing method can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 908. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 900 via the ROM 902 and / or the communication unit 909. When the computer program is loaded onto the RAM 903 and executed by the computing unit 901, one or more steps of the control method described above can be performed. Alternatively, in other embodiments, the computing unit 901 can be configured to perform the control method by any other suitable means, such as by means of firmware.

[0104] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0105] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces a means for implementing the functions / operations specified in the flowchart and / or block diagram block or blocks. The program code can be retrieved from the storage system and / or the storage system can be programmed to provide the program code to the processor or controller for execution. The program code can execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

[0106] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0107] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0108] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0109] The computer system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0110] It should be understood that the various forms of flow shown above can be used to reorder, add, or remove steps. For example, the steps described in the present disclosure can be performed in parallel, in series, or in a different order, without limitation herein, so long as the desired results of the technical strategies of the present disclosure are achieved.

[0111] Furthermore, the terms "first", "second", "third", "fourth" are used only for descriptive purposes and should not be construed as indicating or implying relative importance or a quantity of the specified technical features. Thus, a feature defined with "first", "second", "third", "fourth" can explicitly or implicitly include at least one of the feature. In the description of the present disclosure, the meaning of "a plurality of" is two or more, unless otherwise specifically defined.

[0112] The above description is merely that of specific embodiments of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present disclosure, and all such changes and substitutions should be encompassed within the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be determined by the scope of protection of the claims.

Claims

1. A control method applied to an electronic device, the method comprising: Determine scene information; The configuration information of the electronic device's pickup unit is determined based on the scene information; Configure the sound pickup device based on the configuration information to pick up ambient audio; The pickup device includes a first type of pickup device with a fixed pickup direction relative to the electronic device and a second type of pickup device with an adjustable pickup direction relative to the electronic device; The configuration information is also associated with the voice processing strategy of the electronic device, which is used to process the ambient audio. The configuration information is associated with the voice processing strategy of the electronic device, including: The configuration information includes that the enabled microphones are at least one first-type microphone and at least one second-type microphone, and the pickup direction of the first-type microphone is consistent with the screen extension direction of the electronic device, the pickup direction of at least one second-type microphone is towards one side of the screen of the electronic device, and the voice processing strategy of the electronic device is to enhance the sound on the screen side.

2. The method according to claim 1, wherein, The configuration information includes at least one of the following: Information on the number of activated first-type and second-type pickup devices; The pickup direction information of the second type of pickup device.

3. The method according to claim 1, wherein, Determining scene information includes determining the scene information based on at least one of the following: The status information of the electronic device; The state and / or number of living organisms in the vicinity of the electronic device.

4. The method according to claim 1, wherein, The configuration information is associated with the voice processing strategy of the electronic device, including: The configuration information includes that when at least two microphones are enabled and the microphones of at least two microphones have the same pickup direction, the voice processing strategy of the electronic device is a noise reduction voice processing strategy based on at least two microphones.

5. The method according to claim 1, wherein the configuration information is associated with the voice processing strategy of the electronic device, comprising: The configuration information includes that the enabled microphones are at least one first-type microphone and at least one second-type microphone, and the microphone direction of the first-type microphone is consistent with the screen extension direction of the electronic device, and the microphone direction of at least one second-type microphone is away from the screen of the electronic device. The voice processing strategy of the electronic device is a narrow beam voice processing strategy or an audio zoom voice processing strategy. The narrow beam voice processing strategy includes: performing directional noise reduction based on the differences in the pickup directionality and pickup energy between the first type of pickup device and the second type of pickup device to eliminate sound outside a predetermined angle area on one side of the electronic device screen; the audio zoom voice processing strategy includes: enhancing the sound within the area corresponding to the camera and reducing the sound outside the area corresponding to the camera.

6. The method according to claim 1, wherein, Configure the pickup device based on the configuration information, including: Based on the pickup direction information of the second type of pickup device, control the movement of the second type of pickup device to match the pickup direction information; or Based on the pickup direction information of the second type of pickup device, the opening and closing of the pickup holes in different directions of the second type of pickup device are controlled so that the pickup direction of the second type of pickup device matches the pickup direction information.

7. The method according to claim 1, further comprising: The electronic device activates the pickup device in response to the electronic device, and the pickup device is configured with the first configuration information; If the second configuration information of the pickup device determined based on the scene information is different from the first configuration information, the pickup device shall be configured using the second configuration information.

8. An electronic device, characterized in that, include: The first type of sound pickup device has a fixed sound pickup direction relative to the electronic device; The second type of sound pickup device has an adjustable sound pickup direction relative to the electronic device; At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

Images