A smart speaker and its use method, computer-readable storage medium, and video conferencing system

Abstract

The present invention is applicable to the field of smart home technology, and provides a smart speaker and a method for using the smart speaker, wherein the method for using the smart speaker includes: a microphone array collects voice information, and determines the direction of the sound source according to the voice information, and a control module controls the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module according to the sound source direction, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module. The present invention can support the use of multiple application scenarios, improve the utilization rate of the smart speaker, and has strong ease of use and practicality.

Description

Technical Field

[0001] The present invention relates to the field of smart home technologies, and in particular to a smart speaker, a method for using the smart speaker, and a computer-readable storage medium. Background Art

[0002] With the rise of Internet technology, the way people communicate with each other has been greatly enriched, making it more convenient for people in different regions to communicate. Among them, video conferencing system, as an important remote communication technology, has been well received by people for its convenience and efficiency.

[0003] However, when supporting video calls, smart speaker devices on the market can generally only display the current video screen in one direction, which cannot meet the needs of users in group video conferencing scenarios and has a low usage rate. Summary of the invention

[0004] In view of this, the embodiments of the present invention provide a smart speaker and a method for using the smart speaker, which can display image information of a video conference in multiple directions at the same time, thereby improving the utilization rate of the smart speaker while facilitating user use.

[0005] A first aspect of an embodiment of the present invention provides a smart speaker, including:

[0006] A control module, a microphone array, a wireless communication module, a camera, and at least two screens;

[0007] The microphone array, the wireless communication module, the camera and the screen are all connected to the control module;

[0008] The microphone array is used to collect voice information and determine the direction of the sound source according to the voice information;

[0009] The control module is used to control the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module according to the sound source direction, and to control the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

[0010] A second aspect of an embodiment of the present invention provides a method for using a smart speaker, the smart speaker comprising:

[0011] A control module, a microphone array, a wireless communication module, a camera and at least two screens, wherein the microphone array, the wireless communication module, the camera and the screen are all connected to the control module, and the method comprises:

[0012] The microphone array collects voice information and determines the direction of the sound source according to the voice information;

[0013] The control module controls the screen corresponding to the direction of the sound source to display the image information collected by the camera and / or the image information received by the wireless communication module according to the direction of the sound source, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

[0014] A third aspect of an embodiment of the present invention provides a computer-readable storage medium, including: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method mentioned in the second aspect is implemented.

[0015] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: in this embodiment, the smart speaker includes: a control module, a microphone array, a wireless communication module, a camera and at least two screens, the microphone array, the wireless communication module, the camera and the screen are all connected to the control module, and the method includes: the microphone array collects voice information and determines the direction of the sound source according to the voice information, the control module controls the screen corresponding to the direction of the sound source to display the image information collected by the camera and / or the image information received by the wireless communication module according to the direction of the sound source, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module. Through the embodiments of the present invention, participants in all directions can clearly see the screen of the video conference while hearing the sound, which greatly improves the utilization rate of the smart speaker and has strong ease of use and practicality. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0017] Figure 1 A schematic diagram of the structure of the smart speaker provided in the first embodiment of the present invention;

[0018] Figure 2 A schematic diagram of the specific structure of the smart speaker provided in the second embodiment of the present invention;

[0019] Figure 3 A schematic diagram of a flow chart of a method used by a smart speaker provided in Embodiment 3 of the present invention;

[0020] Figure 4 A schematic diagram of a specific implementation process of the method used by the smart speaker provided in the fourth embodiment of the present invention;

[0021] Figure 5 A schematic diagram of a specific implementation process of the method used by the smart speaker provided in Embodiment 5 of the present invention;

[0022] Figure 6 This is a schematic diagram of the structure of a video conferencing system provided in Embodiment 6 of the present invention. DETAILED DESCRIPTION

[0023] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present invention. However, it should be clear to those skilled in the art that the present invention may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present invention.

[0024] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0025] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0026] It should be further understood that the term "and / or" used in the present description and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0027] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0028] It should be understood that the order of execution of the steps in this embodiment does not necessarily mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0029] It should be noted that the present invention may include any number of smart speakers to enable two or more users to conduct a video conference, wherein the smart speakers include wireless speakers.

[0030] In order to illustrate the technical solution of the present invention, a specific embodiment is provided below for illustration.

[0031] Embodiment 1

[0032] Figure 1 : is a schematic diagram of the structure of the smart speaker provided in the first embodiment of the present invention, and the smart speaker may include:

[0033] Control module 11, microphone array 12, wireless communication module 13, camera 14 and screen 15.

[0034] In the embodiment of the present invention, the microphone array 12 , the wireless communication module 13 , the camera 14 and the screen 15 are all connected to the control module 11 .

[0035] The microphone array 12 is used to collect voice information and determine the direction of the sound source based on the voice information, wherein the direction of the sound source can be determined based on a positioning algorithm based on the arrival time difference. It should be understood that the microphone array 12 is a system composed of a certain number of microphones for sampling and processing the spatial characteristics of the sound field. Optionally, the number of the microphones is 7, arranged in a ring.

[0036] The wireless communication module 13 is used to interact with the server, so as to send the locally collected voice information and / or image information to the server, and receive the voice information and / or image information collected by the other end during the entire video conference. Optionally, the wireless communication module 13 may include: a WiFi communication submodule and a Bluetooth communication submodule. Furthermore, voice information other than the voice information collected by the microphone array 12 and / or image information other than the image information collected by the camera 14 are received through the server. It should be noted that, considering that the smart speaker in this application is mainly used in video conferencing scenarios, when using the microphone array on the smart speaker to collect voice information, it needs to be played through the smart speaker so that local users can hear it.

[0037] The camera 14 is used to collect image information of the user. It should be noted that the type and number of the camera 14 can be flexibly selected according to actual conditions, including but not limited to an ordinary camera, a 360-degree panoramic camera or a camera array.

[0038] The screen 15 is used to display the image information collected by the camera 14 and / or the image information received by the wireless communication module 13. Optionally, the number of the screens is at least 2.

[0039] The control module 11 is used to control the screen closest to the sound source direction to display the image information collected by the camera 14 and / or the image information received by the wireless communication module 13 according to the sound source direction; in addition, the control module 11 is also used to control the smart speaker to play the voice information collected by the microphone array 12 and / or the voice information received by the wireless communication module 13. Optionally, the control module 11 includes a main control chip, which is an APQ8009 chip.

[0040] In an embodiment of the present invention, voice information is collected by the microphone array, and the direction of the sound source is determined according to the voice information. The control module controls the screen corresponding to the direction of the sound source to display the image information collected by the camera and / or the image information received by the wireless communication module according to the direction of the sound source, and at the same time controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module. This can meet the scenario requirements of multi-person video conferencing, improve the practicality of the smart speaker, make it more comprehensive in functions, and make it more convenient for people to use.

[0041] Embodiment 2

[0042] Figure 2 : is a schematic diagram of a specific structure of a smart speaker provided in Embodiment 2 of the present invention. The smart speaker may include:

[0043] Control module 21 , microphone array 22 , wireless communication module 23 , camera 24 , screen 25 , wake-up module 26 , audio processing module 27 and button module 28 .

[0044] Among them, the microphone array 22, the wireless communication module 23, the camera 24, the screen 25, the wake-up module 26, the audio processing module 27 and the button module 28 are all connected to the control module 21. It should be noted that the control module 21, the microphone array 22, the wireless communication module 23, the camera 24 and the screen 25 are the same as the control module 11, the microphone array 12, the wireless communication module 13, the camera 14 and the screen 15 in the first embodiment, and are not repeated here.

[0045] After detecting the preset wake-up keyword, the wake-up module 26 wakes up the smart speaker to put the smart speaker into working state.

[0046] The audio processing module 27 includes: a digital signal processor, a power amplifier and a speaker, the digital signal processor, the power amplifier and the speaker are all connected to the control module 21, the output end of the digital signal processor is connected to the input end of the power amplifier, and the output end of the power amplifier is connected to the input end of the speaker. It should be understood that since the voice information collected by the microphone array 22 and / or the voice information received by the wireless communication module 23 contains a lot of noise, if it is played directly, it will affect the final playback effect and reduce the user experience. Optionally, the voice information collected by the microphone array 22 and / or the voice information received by the wireless communication module 23 is processed by a digital signal processing system including the audio processing module 27.

[0047] The button module 28 is used to receive button commands from the user and control the volume adjustment of the smart speaker through the control module.

[0048] As can be seen from the above, compared with the first embodiment, the embodiment of the present invention adds a wake-up module, which can wake up the smart speaker and put it into working state after detecting the preset wake-up keyword; and, adds an audio processing module, which can make the voice played by the smart speaker more pleasant; in addition, a button module is added, which can be combined with the control module to adjust the volume of the smart speaker, thereby meeting the different needs of users in different application scenarios, improving the user experience, and having strong ease of use and practicality.

[0049] Embodiment 3

[0050] A flowchart of a method for using a smart speaker provided in Embodiment 3 of the present invention may include the following steps:

[0051] S301: The microphone array collects voice information and determines the direction of the sound source according to the voice information.

[0052] Among them, the smart speaker includes: a control module, a microphone array, a wireless communication module, a camera and at least two screens, and the microphone array, the wireless communication module, the camera and the screen are all connected to the control module.

[0053] Optionally, voice information is collected through the microphone array, and the voice information is processed into voice data, and the sound source direction corresponding to the voice information is determined according to the voice data.

[0054] S302: The control module controls the screen corresponding to the direction of the sound source to display the image information collected by the camera and / or the image information received by the wireless communication module, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module according to the direction of the sound source.

[0055] It should be understood that the image displayed on the screen may be only the image information collected by the camera, that is, the image information of the user; it may be only the image information received by the wireless communication module, that is, the image information of the other party; it may also include the image information collected by the camera and the image information received by the wireless communication module, that is, the image information of the user and the image information of the other party are displayed at the same time, and the specific information displayed can be flexibly set according to actual needs and the size of the screen. Optionally, the screen displays the image information collected by the camera and the image information received by the wireless communication module at different proportions at the same time.

[0056] It should also be understood that the voice played by the smart speaker can be only the voice information collected by the microphone array, that is, the voice information of the user; it can also be only the voice information received by the wireless communication module, that is, the voice information of the other party; it can also include the voice information collected by the microphone array and the voice information received by the wireless communication module, that is, the voice information of the user and the other party is displayed at the same time, and the specific information displayed can be flexibly set according to actual needs and the processing effect of the audio processing module. Optionally, the smart speaker plays the voice information received by the wireless communication module.

[0057] As can be seen from the above, the embodiment of the present invention collects voice information through the microphone array, and determines the direction of the sound source according to the voice information. The control module controls the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module according to the sound source direction, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module. This allows users in all directions to not only hear the voice of the person you are talking to, but also to communicate voice and see their expressions and movements, so that people in different places can communicate as if they were in the same conference room, which can improve the usage rate of smart speakers while improving the user experience, and has strong ease of use and practicality.

[0058] Embodiment 4

[0059] The schematic diagram of the specific implementation process of the method used by the smart speaker provided in the fourth embodiment of the present invention is a further refinement and explanation of steps S301 and S302 in the above third embodiment. The method may include the following steps:

[0060] S401: The microphone array collects voice information.

[0061] Among them, the above step S401 is basically the same as step S301 in the above embodiment 3, and will not be repeated here.

[0062] S402: Detect whether the voice information contains a preset wake-up keyword, and if the preset wake-up keyword is detected, wake up the smart speaker.

[0063] The wake-up keyword is a predefined word for switching the smart speaker from a standby state to a working state. Optionally, the preset wake-up keyword can be flexibly set according to the user's preferences.

[0064] S403: After waking up the smart speaker, determine the direction of the sound source according to the voice information.

[0065] Among them, the above step S403 is basically the same as step S301 in the above embodiment 3, and will not be repeated here.

[0066] S404: When the determined sound source direction is one, the control module controls the screen closest to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

[0067] It should be understood that, considering that the application scenarios in the present invention include: one-to-one single-person video conferencing mode, one-to-many group video conferencing mode and many-to-many group video conferencing mode, there may be one or more directions of the sound source. In the embodiments of the present invention, only the case where there is only one sound source direction is explained and illustrated as an example. For the description of multiple sound source directions, please refer to Example 5 for details.

[0068] It should also be understood that when the sound source direction is one, by controlling the screen closest to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module, the user can be guaranteed to watch a clear video image to the greatest extent. The distance from the sound source to the screen can be converted based on the distance from the sound source to the microphone array.

[0069] As can be seen from the above, compared with Example 3, the embodiment of the present invention adds a voice wake-up step and a step of judging the direction of the sound source. Through the voice wake-up step, the smart speaker can be switched from the standby state to the working state in time, which speeds up the data processing speed; in addition, for the situation where there is only one sound source direction, the screen closest to the sound source direction is controlled to display the image information collected by the camera and / or the image information received by the wireless communication module, so as to obtain a better viewing effect, thereby improving the utilization rate of the smart speaker and having greater ease of use and practicality.

[0070] Embodiment 5

[0071] The schematic diagram of the specific implementation process of the method for using the smart speaker provided in the fifth embodiment of the present invention is a further refinement and explanation of steps S301 and S302 in the third embodiment above. The method may include the following steps:

[0072] S501: The microphone array collects voice information.

[0073] S502: Detect whether the voice information contains a preset wake-up keyword. If the preset wake-up keyword is detected, wake up the smart speaker.

[0074] S503: After waking up the smart speaker, the microphone array determines the direction of the sound source according to the voice information.

[0075] Among them, the above steps S501-S503 are basically the same as steps S401-S403 in the above embodiment 4, and can refer to the relevant description in the above embodiment, which will not be repeated here.

[0076] S504: When there are multiple sound source directions determined, the control module determines the angle between each of the sound source directions and a preset reference direction, and when there is a viewing angle range corresponding to the screen that includes the angle, controls the screen to display the image information collected by the camera and / or the image information received by the wireless communication module, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

[0077] Optionally, the preset reference direction is a reference direction set when the microphone array is installed.

[0078] The viewing angle range refers to the maximum angle range in which a user can clearly observe all contents on the screen from different directions. It should be understood that the viewing angle range is related to the number of screens.

[0079] Exemplarily, in a specific application scenario, if the smart speaker is installed with three screens, the viewing angle range corresponding to the first screen is (0, 120°], the viewing angle range corresponding to the second screen is (120°, 240°], and the viewing angle range corresponding to the third screen is (240°, 360°]. When the control module determines that the angle between the sound source direction and the preset reference direction is less than or equal to 120°, the first screen is controlled to be in a working state to display the image information collected by the camera and / or the image information received by the wireless communication module; when the control module determines that the angle between the sound source direction and the preset reference direction falls within the interval of (120°, 240°], the second screen is controlled to be in a working state to display the image information collected by the camera and / or the image information received by the wireless communication module; when the control module determines that the angle between the sound source direction and the preset reference direction falls within the interval of (240°, 360°], the third screen is controlled to be in a working state to display the image information collected by the camera and / or the image information received by the wireless communication module.

[0080] It should also be understood that in the above-mentioned application scenarios, in order to enable the same communication and display between the local and remote ends, while displaying the image information collected by the camera and / or the image information received by the wireless communication module, the control module can also control the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

[0081] It can be seen from the above that compared with Example 3, the embodiment of the present invention provides a specific implementation method when there are multiple sound source directions, which can better control the working state of the screen, thereby improving the utilization rate of the smart speaker, and has strong ease of use and practicality.

[0082] Embodiment 6

[0083] Figure 6 : is a schematic diagram of the structure of a video conferencing system provided by Embodiment 6 of the present invention. The video conferencing system may include:

[0084] More than two smart speakers and servers respectively connected to the at least two smart speakers, wherein the smart speakers have been described in detail in Embodiment 1 and will not be repeated here.

[0085] The following describes the video conferencing system in the embodiment of the present invention by taking a specific application scenario as an example. Figure 6The video conferencing system shown includes: a first smart speaker 61, a second smart speaker 62 and a server 63, wherein the first smart speaker 61 is used by a local user, and the second smart speaker 62 is used by a remote user at the opposite end. It should be noted that the number of local users and the number of remote users are not limited in this application, and can be one or more respectively, and the specific number can be determined according to the situation. When the local user and the peer user turn on their respective smart speakers, the first smart speaker 61 collects local image information and voice information through its own camera and microphone array, and sends the collected image information and voice information to the server through the wireless communication module. After receiving the request message from the second smart speaker 62, the server forwards the image information and voice information sent by the first smart speaker 61 to the second smart speaker 62, and receives the image information and voice information sent by the second smart speaker 62. After receiving the request message from the first smart speaker 61, the server forwards the image information and voice information sent by the second smart speaker 62 to the first smart speaker 61. After the first smart speaker 61 determines the direction of the sound source according to the locally collected voice information, it controls the screen corresponding to the sound source direction to display the image information collected locally and / or by the peer, and controls the smart speaker 61 to play the voice information collected locally and / or by the peer, so that the local user can hear the other party's voice and see the picture including the other party's image at the same time.

[0086] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0087] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0088] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0089] In the embodiments provided by the present invention, it should be understood that the disclosed terminal device and method can be implemented in other ways. For example, the terminal device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0090] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0091] If the integrated module is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0092] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A smart speaker for video conferencing, characterized in that: include: A control module, a microphone array, a wireless communication module, a camera, and at least two screens; The microphone array, the wireless communication module, the camera and the screen are all connected to the control module; The microphone array is used to collect voice information and determine the direction of the sound source according to the voice information; The control module is used to control the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module according to the sound source direction, and control the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module; wherein, when the microphone array is used to collect voice information, the voice information collected by the microphone array is played; The smart speaker also includes: Wake-up module; The wake-up module is connected to the control module; After detecting a preset wake-up keyword, the wake-up module wakes up the smart speaker to put the smart speaker into working state.

2. The smart speaker according to claim 1, characterized in that: When the determined sound source direction is one, the control module is specifically used to control the screen closest to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module, and to control the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

3. The smart speaker according to claim 2, characterized in that: The smart speaker also includes: An audio processing module, the audio processing module comprising a digital signal processor, a power amplifier and a speaker; The digital signal processor, the power amplifier and the speaker are all connected to the control module.

4. The smart speaker according to claim 1, characterized in that: When there are multiple sound source directions determined, the control module is specifically used to determine the angle between each of the sound source directions and a preset reference direction, and when there is a viewing angle range corresponding to the screen that includes the angle, control the screen to display the image information collected by the camera and / or the image information received by the wireless communication module, and control the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

5. The smart speaker according to claim 1, characterized in that: The smart speaker also includes: Button module; The button module is connected to the control module; The control module is used to control the adjustment of the volume of the smart speaker when the button module receives a button instruction.

6. A method for using a smart speaker for video conferencing, characterized in that: The smart speaker comprises: a control module, a microphone array, a wireless communication module, a camera and at least two screens, wherein the microphone array, the wireless communication module, the camera and the screen are all connected to the control module, and the method comprises: The microphone array collects voice information and determines the direction of the sound source according to the voice information; The control module controls the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module according to the sound source direction, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module; wherein, when the microphone array is used to collect voice information, the voice information collected by the microphone array is played; The method further comprises: The microphone array collects voice information; Detect whether the voice information contains a preset wake-up keyword. If the preset wake-up keyword is detected, wake up the smart speaker to put the smart speaker into working state.

7. The method according to claim 6, characterized in that Controlling the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module, and controlling the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module includes: When the determined sound source direction is one, the control module controls the screen closest to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

8. The method according to claim 6, characterized in that Controlling the screen corresponding to the sound source direction to display the image information collected by the camera and / or the image information received by the wireless communication module, and controlling the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module also includes: When there are multiple sound source directions determined, the control module determines the angle between each of the sound source directions and a preset reference direction, and when there is a viewing angle range corresponding to the screen that includes the angle, controls the screen to display the image information collected by the camera and / or the image information received by the wireless communication module, and controls the smart speaker to play the voice information collected by the microphone array and / or the voice information received by the wireless communication module.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 6 to 8 are implemented.

10. A video conferencing system, comprising: At least two smart speakers as described in any one of claims 1 to 5.

11. The video conferencing system according to claim 10, wherein: The video conferencing system also includes: a server connected to the at least two smart speakers respectively.

Images