Smart glasses, method and device for automatically controlling volume and smart glasses system

Abstract

The application discloses a kind of intelligent glasses, automatically control volume method and device and intelligent glasses system, wherein intelligent glasses include: glasses body and be set on the wireless communication module of the glasses body, microphone and speaker, the processing module is built-in in the wireless communication module, the processing module is connected with the microphone and the speaker, the microphone is used to the audio signal picked up is transmitted to the processing module, the processing module is used to judge whether the audio signal is noise signal, if noise signal, the noise value of the noise signal is calculated, and according to the corresponding relationship of preset noise value and the output volume of the speaker, the output volume of the speaker is adjusted as the output volume corresponding to the noise value of the noise signal.The above-mentioned intelligent glasses, automatically control volume method and device and intelligent glasses system can realize the automatic adjustment of output volume according to noise volume, improve the intelligence of intelligent glasses and the convenience of user operation.

Description

TECHNICAL FIELD

[0001] The embodiment of the present application relates to the technical field of intelligent wearing equipment, in particular to an intelligent glasses, a method and device for automatically controlling volume and an intelligent glasses system. BACKGROUND

[0002] The intelligent glasses system generally provides basic functions such as listening to music, answering and making a call through the glasses body. In addition to the above basic functions, the intelligent glasses system also provides voice prompts by detecting human head activities through the sensors of the glasses body and the intelligent terminal. The medium for the intelligent glasses to communicate with the user includes a microphone and a loudspeaker. The microphone mainly receives the voice information of the user, and the loudspeaker mainly outputs music or voice information to the ear of the user.

[0003] The user uses the intelligent glasses in different environments, and the environmental noise of different environments is also different. In the prior art, the user needs to manually control the output volume of the intelligent glasses, that is, the output volume is increased when the environmental noise is large, and the output volume is decreased when the environmental noise is small. Manual adjustment of the output volume is not intelligent enough, which brings inconvenience to the user operation. SUMMARY

[0004] The embodiment of the present application provides an intelligent glasses, a method and device for automatically controlling volume and an intelligent glasses system, which can solve the problem that the intelligent glasses cannot automatically adjust the output volume of the loudspeaker according to the noise volume, and bring inconvenience to the user operation.

[0005] The embodiment of the present application provides an intelligent glasses, a method and device for automatically controlling volume and an intelligent glasses system, which can solve the problem that the intelligent glasses cannot automatically adjust the output volume of the loudspeaker according to the noise volume, and bring inconvenience to the user operation.

[0006] The glasses body and a wireless communication module, a microphone and a loudspeaker arranged on the glasses body;

[0007] The processing module is connected with the microphone and the loudspeaker;

[0008] The microphone is used to transmit the picked-up audio signal to the processing module, the processing module is used to judge whether the audio signal is a noise signal, if it is a noise signal, the noise value of the noise signal is calculated, and the output volume of the loudspeaker is adjusted to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the loudspeaker.

[0009] The embodiment of the present application also provides a method for automatically controlling volume, which is applied to the above intelligent glasses and includes the following steps.

[0010] An audio signal picked up by a microphone arranged on a glasses body of the intelligent glasses is acquired;

[0011] determining whether the audio signal is a noise signal;

[0012] if the audio signal is a noise signal, calculating a noise value of the noise signal;

[0013] adjusting an output volume of a speaker arranged on a glasses body of the smart glasses to an output volume corresponding to the noise value of the current noise signal according to a preset correspondence between noise values and output volumes of the speaker.

[0014] The embodiment of the present application also provides a device for automatically controlling a volume, comprising:

[0015] an acquisition module configured to acquire an audio signal picked up by a microphone arranged on a glasses body of the smart glasses;

[0016] a determination module configured to determine whether the audio signal is a noise signal;

[0017] a calculation module configured to calculate a noise value of the noise signal if the audio signal is a noise signal;

[0018] a control module configured to adjust an output volume of a speaker arranged on a glasses body of the smart glasses to an output volume corresponding to the noise value of the current noise signal according to a preset correspondence between noise values and output volumes of the speaker.

[0019] The embodiment of the present application also provides a smart glasses system, comprising:

[0020] a smart glasses, a smart terminal and a cloud system;

[0021] The smart glasses is connected to the smart terminal in a wireless connection mode, and the smart terminal is connected to the cloud system in a wireless connection mode.

[0022] The smart glasses is configured to acquire an audio signal through a microphone arranged on a glasses body of the smart glasses, determine whether the audio signal is a noise signal, calculate a noise value of the noise signal if the audio signal is a noise signal, and adjust an output volume of a speaker arranged on the glasses body of the smart glasses to an output volume corresponding to the noise value of the current noise signal according to a preset correspondence between noise values and output volumes of the speaker.

[0023] The smart glasses is further configured to send the adjusted output volume to the smart terminal.

[0024] The smart terminal is further configured to synchronously update an output volume of a speaker of the smart terminal to the adjusted output volume.

[0025] From the above embodiments of the present application, the intelligent glasses include a glasses body and a wireless communication module, a microphone and a loudspeaker arranged on the glasses body, the wireless communication module has a processing module built-in, the processing module is connected with the microphone and the loudspeaker, the processing module acquires an audio signal picked up by the microphone, and judges whether the audio signal is a noise signal, if the audio signal is the noise signal, the processing module calculates a noise value of the noise signal, and adjusts an output volume of the loudspeaker to an output volume corresponding to the noise value of the noise signal according to a preset corresponding relationship between the noise value and the output volume of the loudspeaker, so as to automatically regulate the output volume of the loudspeaker according to the noise volume, improve the intelligence of the intelligent glasses, and make the audio volume heard by the user under different noise volumes consistent in hearing, and improve the hearing experience. BRIEF DESCRIPTION OF DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0027] Figure 1 The hardware structure schematic diagram of the intelligent glasses provided by the embodiments of the present application is shown in the figure.

[0028] Figure 2 The schematic diagram of the user controlling the output volume of the loudspeaker on the intelligent glasses by gesture operation in the embodiments of the present application is shown in the figure.

[0029] Figure 3 The internal structure schematic diagram of the intelligent glasses provided by the embodiments of the present application is shown in the figure.

[0030] Figure 4 The structure schematic diagram of the intelligent glasses system provided by the embodiments of the present application is shown in the figure.

[0031] Figure 5 The implementation flowchart of the method for automatically controlling the volume provided by an embodiment of the present application is shown in the figure.

[0032] Figure 6 The implementation flowchart of the method for automatically controlling the volume provided by another embodiment of the present application is shown in the figure.

[0033] Figure 7 The flowchart of the speech detection algorithm in the method for automatically controlling the volume provided by an embodiment of the present application is shown in the figure.

[0034] Figure 8 The structure schematic diagram of the device for automatically controlling the volume provided by an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0035] The technical solutions and advantages of the embodiments of the present application will be described clearly and completely below with reference to the drawings of the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0036] The embodiments of the present application provide a kind of intelligent glasses, the intelligent glasses can be in music playing mode or telephone voice call mode, realize according to noise automatic adjustment output volume, so that user hears music or voice when hearing, hearing volume size is not changed due to environmental noise, hearing is more comfortable.

[0037] Specifically, a wireless communication module, a microphone and a loudspeaker are installed on the glasses body of the intelligent glasses. The wireless communication module is internally provided with a processing module, and the processing module is connected to the microphone and the loudspeaker. The microphone is used to obtain an audio signal and continuously transmit the audio signal to the processing module. The processing module identifies whether the audio signal is a noise signal. If yes, the processing module calculates a noise value and adjusts the output volume of the loudspeaker to an output volume corresponding to the noise value in the current noise signal according to a preset corresponding relationship between noise values and the output volume of the loudspeaker. In the corresponding relationship, the larger the noise value, the larger the output volume, and the smaller the noise value, the smaller the output volume. Therefore, if the current noise value is large, the output volume of the loudspeaker is increased, and if the current noise value is small, the output volume of the loudspeaker is decreased. Thus, the intelligent glasses can automatically adjust the output volume according to the ambient environmental noise.

[0038] Referring to Figure 1 , Figure 1 A hardware structure schematic diagram of the intelligent glasses provided by an embodiment of the present application is shown. For ease of illustration, only parts related to the embodiments of the present application are shown. As shown in Figure 1 , the intelligent glasses include a glasses body 10, a wireless communication module 20, a microphone 30 and a loudspeaker 40.

[0039] The glasses body includes a temple 11 and a front frame 12. The wireless communication module 20 is arranged on the inner side of the temple 11 of the glasses body 10, and is connected with the microphone 30 and the speaker 40. The wireless communication module 20 is internally provided with a processing module, which mainly includes a micro controller unit (MCU) and a digital signal processing (DSP) connected with the MCU. Specifically, the MCU is connected with the microphone 30 and the speaker 40, and is used to control the output volume of the speaker 40 according to the noise signal picked up by the microphone 30. The DSP is used to process the data sent by the MCU and return the processed data to the MCU.

[0040] The wireless communication module 20 is also provided with a communication submodule, which is used to communicate and interact with other devices and modules in the smart glasses through WIFI, Bluetooth and other wireless communication modes, or communicate and interact with smart terminals and cloud systems outside the smart glasses.

[0041] The microphone 30 is used to pick up an audio signal, which can be a voice uttered by the user or noise from the surrounding environment. The microphone 30 transmits the picked-up audio signal to the processing module, which is used to determine whether the audio signal is a noise signal. If it is a noise signal, the noise value of the noise signal is calculated, and the output volume of the speaker 40 is adjusted to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the speaker 40.

[0042] The corresponding relationship between the noise value and the output volume of the speaker 40 is pre-stored in the processing module and can be customized by the user. The higher the noise value is, the higher the output volume is, and the two are positively correlated. In this way, the user can hear the audio volume consistently in the auditory sense under different noise volumes.

[0043] In the embodiment of the application, the smart glasses include a glasses body and a wireless communication module, a microphone and a speaker arranged on the glasses body. The processing module is internally provided in the wireless communication module, and the processing module is connected with the microphone and the speaker. The processing module acquires an audio signal picked up by the microphone, determines whether the audio signal is a noise signal, calculates a noise value of the noise signal if it is a noise signal, and adjusts the output volume of the speaker to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the speaker. In this way, the output volume of the speaker is automatically controlled according to the noise volume, the intelligence of the smart glasses is improved, the user can hear the audio volume consistently in the auditory sense under different noise volumes, and the auditory experience is improved.

[0044] Further, in another embodiment, the number of microphones 30 is at least two, arranged on the inner side of one or both of the temple 11 of the glasses body 10, and the arrangement position is close to the front frame 12 relative to the tail of the temple 11, that is, the microphone 30 is arranged close to the root of the temple 11, that is, the position where the temple 11 is connected with the front frame 12, which is close to the user's mouth, and can better obtain the user's voice. Preferably, the number of microphones 30 is 2, which are arranged on the temple 11 in an up-down manner as shown in Figure 1 , or in a left-right manner or an oblique manner. The number of microphones 30 is not limited, and each microphone 30 can be arranged on the two temples 11 in groups or individually, which are all within the protection scope of the present application.

[0045] The speaker 40 is arranged on the inner side of the two temples 11 of the glasses body 10, and the arrangement position is away from the front frame 12 relative to the tail of the temple 11, that is, the speaker 40 is arranged closer to the tail of the temple 11 than the microphone 30, which is closer to the user's ear, and can make the user hear clearer output audio. Preferably, the number of speakers 40 is at least 2, for example, two speakers 40 are arranged on the two temples 11 as shown in Figure 1 . For example, the number of speakers 40 is two, and each speaker 40 is arranged on one of the two temples 11. The number of speakers 40 can also be one, which is arranged on the tail of one of the two temples 11, and the number can also be more, which is arranged on each temple 11 in a preset shape, for example, in an up-down manner, a left-right manner, an oblique manner or a circular manner. The number and arrangement manner of the speaker 40 are not limited, which are all within the protection scope of the present application.

[0046] Further, in another embodiment, the glasses body 10 is further provided with a touch control module 50, which specifically includes a touch sensor. The user can operate the touch control module 50 through a touch gesture, left or right sliding, to realize increasing or decreasing the output volume. Referring to Figure 2 , Figure 2 , which is a schematic diagram of the user's touch gesture to realize increasing or decreasing the output volume. Figure 2 In the touch control module 50, the user slides left to increase the output volume, and slides right to decrease the output volume. Figure 2 In the touch control module 50, the left volume identifier represents a larger volume than the right volume identifier. The touch control module 50 can also be a button, for example, a long button. The user can press one side of the long button to increase the volume, and press the other side of the long button to decrease the volume. For another example, two short buttons, one of which is an increase volume button, and the other of which is a decrease volume button. The user can press them to adjust the volume.

[0047] Further, in another embodiment, an automatic volume control switch is also provided on the glasses body 10, and opening or closing the switch can switch the automatic volume control function and the manual volume control function. When the switch is opened, the automatic volume control function is opened, and the smart glasses can automatically control the output volume of the speaker through the automatic volume control method in the embodiment of the application. When the switch is closed, the automatic volume control function is closed, and the manual volume control function is opened, and then the user can manually control the output volume of the speaker through the touch gesture operation of the touch control module. The smartness and the convenience of the smart glasses are further improved.

[0048] Further, the smart glasses are connected with a mobile terminal such as a mobile phone through a wireless network, the automatic volume control switch is provided on a user interface (UI) of the mobile terminal, the smart glasses acquire an automatic volume control switch instruction sent by the mobile terminal, and the enabling of the touch control module is opened or closed according to the automatic volume control switch instruction. The user sends the automatic volume control switch instruction by controlling the automatic volume control switch provided on the UI of the mobile terminal.

[0049] In the embodiment of the application, the smart glasses further include a touch control module and an automatic volume control switch provided on the glasses body, so that the user can control the output volume of the speaker of the smart glasses through a gesture, and control the automatic and manual two modes to realize the regulation of the output volume of the speaker through the automatic volume control switch, and the smartness and the convenience of the smart glasses are further improved.

[0050] Further, the glasses body 10 is also provided with a battery 60, a proximity sensor 70 and a nine-axis sensor 80, wherein the nine-axis sensor 80 can include a three-dimensional acceleration sensor, a three-dimensional gyroscope and a three-dimensional magnetic force sensor, etc. The battery 60 can be a rechargeable battery or a button cell, and supplies power to various components on the smart glasses; the proximity sensor 70 is used to detect whether the smart glasses are worn on the face of the user and whether the smart glasses are correctly worn; and the nine-axis sensor 80 is used to detect the motion state of the user.

[0051] Referring to Figure 3 , Figure 3 The figure is a schematic diagram of the internal connection structure of the smart glasses in the embodiment of the application. Taking the smart glasses provided with two microphones and two speakers as an example. The smart glasses mainly include a wireless communication module 20, and a first microphone 31, a second microphone 32, a first speaker 41, a second speaker 42, a touch sensor 51, a proximity sensor 70, a nine-axis sensor 80 and a battery 60 connected with the wireless communication module 20;

[0052] The wireless communication module 20 comprises an MCU and a DSP which are interconnected; the nine-axis sensor 80 comprises a three-dimensional acceleration sensor, a three-dimensional gyroscope and a three-dimensional magnetic force sensor.

[0053] Referring to Figure 4 The embodiment of the application further provides an intelligent glasses system, which comprises the intelligent glasses 100, the intelligent terminal 200 and the cloud system 300.

[0054] The intelligent glasses 100 is connected with the intelligent terminal 200 through WIFI or Bluetooth, and the intelligent terminal 200 is connected with the cloud system 300 through WIFI or Bluetooth. The intelligent terminal 200 is provided with an operation interface for human-computer interaction, through which the user can send various instructions to realize the control and interaction of the intelligent glasses 100, such as the selection and playing of songs when listening to music, the regulation of the output volume through the intelligent glasses and the like. The cloud system 300 is used for processing the storage of large-capacity data, the analysis and transmission of big data and the like, and can obtain data including GPS (Global Positioning System) and the like from the intelligent terminal 200 to realize the above functions.

[0055] The intelligent terminal 200 comprises a mobile intelligent terminal such as a smart phone and a smart watch, and also comprises a non-mobile intelligent terminal such as a PC. The cloud system 300 is specifically a cloud artificial intelligence system, and can comprise multiple servers.

[0056] Specifically, the intelligent glasses 100 are used for picking up an audio signal through a microphone arranged on a glasses body of the intelligent glasses 100, judging whether the audio signal is a noise signal, calculating a noise value of the noise signal if the audio signal is the noise signal, and adjusting an output volume of a loudspeaker arranged on the glasses body of the intelligent glasses 100 to an output volume corresponding to the noise value of the current noise signal according to a preset corresponding relationship between noise values and output volumes of loudspeakers.

[0057] The intelligent glasses 100 are further used for sending the adjusted output volume to the intelligent terminal 200.

[0058] The intelligent terminal 200 is further used for synchronously updating the output volume of a loudspeaker of the intelligent terminal 200 itself to the adjusted output volume.

[0059] In the embodiments of the present application, the smart glasses are connected to the smart terminal through a wireless connection mode, the smart terminal is connected to the cloud system through a wireless connection mode, and the three can process data through data transmission to improve the efficiency of data processing. The smart glasses pick up an audio signal through a microphone, determine whether the audio signal is a noise signal, calculate a noise value of the noise signal if it is a noise signal, and adjust the output volume of the loudspeaker to the output volume corresponding to the noise value of the noise signal according to a preset corresponding relationship between the noise value and the output volume of the loudspeaker, so as to automatically regulate the output volume of the loudspeaker according to the noise volume, improve the intelligence of the smart glasses, and send the adjusted output volume to the smart terminal. The smart terminal synchronously updates the output volume of the loudspeaker of the smart terminal itself to the adjusted output volume, realizes the synchronization of the output volume of the loudspeaker of the smart glasses on the loudspeaker of the smart terminal, realizes the unity of the data of the smart glasses system, and further improves the intelligence of the smart glasses system.

[0060] The embodiments of the present application also provide a method for automatically controlling the volume based on the smart glasses in the above-mentioned embodiments, which will be described in detail below.

[0061] Referring to Figure 5 , Figure 5 The implementation flowchart of the method for automatically controlling the volume provided by an embodiment of the present application is applied to the smart glasses in the above-mentioned embodiments, the execution subject can be a processing module of the smart glasses, and the method is specifically executed by an MCU and / or a DSP in the processing module. The method comprises the following steps.

[0062] S501, an audio signal picked up by a microphone arranged on a glasses body of the smart glasses is acquired.

[0063] S502, it is determined whether the audio signal is a noise signal.

[0064] If the audio signal is a voice signal, the output volume of the loudspeaker is not adjusted.

[0065] S503, if the audio signal is a noise signal, a noise value of the noise signal is calculated.

[0066] The noise value of the noise signal is calculated according to a preset noise volume algorithm.

[0067] S504, the output volume of the loudspeaker of the smart glasses is automatically adjusted according to the noise value of the noise signal.

[0068] According to a preset corresponding relationship between the noise value and the output volume of the loudspeaker, the output volume of the loudspeaker arranged on the glasses body of the smart glasses is adjusted to the output volume corresponding to the current noise value of the noise signal.

[0069] Specifically, in the corresponding relationship between the noise value and the output volume of the speaker, the higher the noise value, the higher the corresponding output volume, the lower the noise value, the lower the corresponding output volume, that is, the noise value and the output volume are positively correlated.

[0070] Specifically, if the noise value of the current frame is lower than that of the previous frame, the output volume of the speaker is adjusted lower according to the corresponding relationship; if the noise value of the current frame is higher than that of the previous frame, the output volume of the speaker is adjusted higher according to the corresponding relationship; if the noise value of the current frame is equal to that of the previous frame, the output volume of the speaker is not adjusted.

[0071] For details not fully described in the embodiments, refer to the descriptions of the foregoing embodiments.

[0072] In the embodiments of the application, the audio signal is picked up by the microphone arranged on the glasses body of the smart glasses, and it is judged whether the audio signal is a noise signal. If it is a noise signal, the noise value of the noise signal is calculated, and the output volume of the speaker is adjusted to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the speaker, so as to automatically adjust and control the output volume of the speaker according to the noise volume, improve the convenience of user operation, and at the same time make the audio volume heard by the user under different noise volumes consistent in hearing, and improve the hearing experience.

[0073] Referring to Figure 6 , Figure 6 The implementation flowchart of the automatic volume control method provided by another embodiment of the application is applied to the smart glasses in the foregoing embodiments, and the execution subject is the processing module in the smart glasses. The method comprises the following steps:

[0074] S601, a corresponding relationship between a noise value and an output volume of a speaker of smart glasses is set;

[0075] The corresponding relationship between the noise value and the output volume of the speaker customized by the user through the mobile terminal is obtained, the numerical value of the noise value is positively correlated with the size of the output volume of the speaker, and the corresponding relationship is stored in the MCU of the processing module of the smart glasses or in the storage medium of the smart glasses for calling by the MCU.

[0076] S602, an audio signal picked up by a microphone arranged on a glasses body of the smart glasses is obtained;

[0077] S603, it is judged whether the audio signal is a noise signal;

[0078] Specifically, the audio signal is divided into a single frame, and it is judged whether the current frame is a noise signal according to a preset voice detection algorithm.

[0079] When the microphones are two, the specific steps of determining whether the current frame is a noise signal by the voice detection algorithm are as shown in the following table: Figure 7

[0080] S701, calculate the difference of the sound energy of the current frame of each microphone;

[0081] The sound energy of the current frame of the first microphone 31 and the second microphone 32 is calculated, and the difference of the sound energy is calculated. The specific calculation formula of the sound energy is as follows:

[0082] The audio signals picked up by the first microphone and the second microphone are x1(n), x2(n) respectively, and the long-term energy En1 and En2 thereof are calculated:

[0083] En1(n) = En1(n-1)*(1-α) + α*|x1(n)|, |x| is absolute value, α = 0.0025;

[0084] En2(n) = En2(n-1)*(1-α) + α*|x2(n)|, |x| is absolute value, α = 0.0025;

[0085] The sound energy E1 and E2 of the kth frame of the first microphone and the second microphone:

[0086]

[0087]

[0088] Where N is the number of speech signal samples in a frame, specifically 128; ln() is the natural logarithm.

[0089] S702, determine whether the difference of the sound energy is greater than a preset voice energy threshold;

[0090] The voice energy threshold is a value for determining whether the sound is voice, which can be customized according to the need of the intelligent glasses to adjust the output volume.

[0091] If it is greater, step S703 is executed; if it is not greater, step S704 is executed;

[0092] S703, confirm that the current frame is a voice signal;

[0093] S704, confirm that the current frame of each microphone is not a voice frame;

[0094] S705, count the number of frames in which the two microphones are not voice frames continuously;

[0095] S706, determine whether the number of frames in which the two microphones are not voice frames continuously is greater than a preset frame number threshold;

[0096] ​If the number of frames in which the two microphones are not continuous speech frames is greater than the preset frame number threshold, step S707 is performed; if the number of frames in which the two microphones are not continuous speech frames is less than the preset frame number threshold, step S703 is performed.

[0097] S707, confirming that the current frame is not a speech signal.

[0098] Confirming that the current frame is not a speech signal, but a noise signal.

[0099] If it is a speech signal, the output volume of the speaker is not adjusted.

[0100] S604, if it is a noise signal, calculating the noise value of the noise signal;

[0101] According to the preset noise volume algorithm, the noise value of the noise signal is calculated.

[0102] S605, according to the noise value of the noise signal, automatically adjusting the output volume of the speaker of the smart glasses;

[0103] According to the preset correspondence between the noise value and the output volume of the speaker, the output volume of the speaker arranged on the glasses body of the smart glasses is adjusted to the output volume corresponding to the current noise value of the noise signal;

[0104] Specifically, in the correspondence between the noise value and the output volume of the speaker, the higher the noise value, the higher the corresponding output volume, and the lower the noise value, the lower the corresponding output volume, that is, the noise value and the output volume are positively correlated.

[0105] If the noise volume of the current frame is lower than that of the previous frame, the output volume of the speaker is adjusted according to the correspondence; if the noise volume of the current frame is higher than that of the previous frame, the output volume of the speaker is adjusted according to the correspondence; if the noise volume of the current frame is equal to that of the previous frame, the output volume of the speaker is not adjusted.

[0106] S606, synchronizing the adjusted output volume to the smart terminal.

[0107] The adjusted output volume is sent to the smart terminal through a wireless network, so that the smart terminal synchronously updates the output volume of the speaker of the smart terminal to the adjusted output volume.

[0108] The details not described in the embodiments are described in the foregoing embodiments.

[0109] In the embodiment of the present application, the user can customize the corresponding relationship between the noise value of the noise signal picked up by the microphone of the smart glasses and the output volume of the loudspeaker, thereby improving the flexibility and controllability of regulating the output volume. Furthermore, the audio signal is picked up by the microphone arranged on the glasses body of the smart glasses, and it is determined whether the audio signal is a noise signal. If it is a noise signal, the noise value of the noise signal is calculated, and the output volume of the loudspeaker is adjusted to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the loudspeaker, so as to automatically regulate the output volume of the loudspeaker according to the noise volume, improve the convenience of user operation, and synchronize the adjusted output volume on the smart terminal connected with the smart glasses, thereby realizing the output volume consistency of the loudspeaker on the smart terminal, further improving the intelligence of the smart system composed of the smart glasses and the smart terminal, and further improving the convenience of user operation.

[0110] Referring to Figure 8 , Figure 8 The structure diagram of the device for automatically controlling the volume provided by the embodiment of the present application can be the processing module of the smart glasses, including the MCU and the DSP, or can be the MCU. For the convenience of description, only the parts related to the embodiment of the present application are shown. The device for automatically controlling the volume includes:

[0111] The acquisition module 801 is configured to acquire the audio signal picked up by the microphone arranged on the glasses body of the smart glasses.

[0112] The judgment module 802 is configured to determine whether the audio signal is a noise signal.

[0113] The calculation module 803 is configured to calculate the noise value of the noise signal if the audio signal is a noise signal.

[0114] The control module 804 is configured to adjust the output volume of the loudspeaker arranged on the glasses body of the smart glasses to the output volume corresponding to the noise value of the current noise signal according to the preset corresponding relationship between the noise value and the output volume of the loudspeaker.

[0115] Furthermore, the judgment module 802 is further configured to divide the audio signal into a single frame, and determine whether the current frame is a noise signal according to the preset voice detection algorithm.

[0116] Furthermore, when the number of microphones is two, the judgment module is further configured to calculate the difference value of the sound energy of the current frame of each of the two microphones, and determine whether the difference value of the sound energy is greater than a preset voice energy threshold value. If not, it is determined that the current frame of each of the two microphones is not a voice frame, and the number of frames in which the two microphones are not continuous voice frames is counted. If the number of frames in which the two microphones are not continuous voice frames is greater than a preset frame number threshold value, it is determined that the audio signal is not a voice signal.

[0117] Further, the control module 804 is further configured to: if the noise value of the current frame of the noise signal is lower than the noise value of the previous frame, correspondingly adjust the output volume of the speaker according to the corresponding relationship; if the noise value of the current frame of the noise signal is higher than the noise value of the previous frame, correspondingly adjust the output volume of the speaker according to the corresponding relationship; and if the noise value of the current frame of the noise signal is equal to the noise value of the previous frame, do not adjust the output volume of the speaker.

[0118] Further, the device for automatically adjusting the volume further comprises a sending module configured to send the adjusted output volume to the smart terminal through a wireless network, so that the smart terminal synchronously updates the output volume of the speaker of the smart terminal to the adjusted output volume.

[0119] Further, the acquisition module 801 is further configured to acquire and store a corresponding relationship between a noise value and an output volume of a speaker, which is customized by a user through a mobile terminal, and the noise value is positively related to the output volume of the speaker.

[0120] For details not described above, refer to the descriptions of the above-mentioned embodiments.

[0121] In the embodiments of the present application, a user can customize a corresponding relationship between a noise value of a noise signal picked up by a microphone of the smart glasses and an output volume of a speaker, thereby improving the flexibility and controllability of the output volume adjustment. Further, the microphone arranged on the glasses body of the smart glasses picks up an audio signal, and judges whether the audio signal is a noise signal. If the audio signal is a noise signal, the noise value of the noise signal is calculated, and the output volume of the speaker is adjusted to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the speaker, thereby automatically adjusting the output volume of the speaker according to the noise value, improving the convenience of user operation, synchronously adjusting the adjusted output volume on a smart terminal connected with the smart glasses, realizing the output volume consistency of the speaker on the smart terminal, further improving the intelligence of the smart system composed of the smart glasses and the smart terminal, and further improving the convenience of user operation.

[0122] Further, the embodiments of the present application further provide a computer readable storage medium, which can be arranged in the smart glasses in the above-mentioned embodiments, and can be a memory in the smart glasses. The computer readable storage medium stores a computer program, and the program is executed by a processor to realize the above-mentioned Figure 5 and Figure 6The method for automatically controlling the volume described in the illustrated embodiment. Further, the computer storage medium can also be a U disk, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk or an optical disk, and various media that can store program codes.

[0123] It should be noted that, for the foregoing method embodiments, in order to facilitate description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the action sequence described, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0124] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0125] The above is the description of the intelligent glasses, the method and device for automatically controlling the volume, and the intelligent glasses system provided by the present application. For those skilled in the art, according to the idea of the embodiments of the present application, there will be changes in the specific implementation and application range. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A smart glass, characterized by, The smart glasses comprise: an eyeglass body and a wireless communication module, two microphones and at least two loudspeakers arranged on the eyeglass body; the two microphones are arranged on the inner side of the temple of the eyeglass body, and the arrangement position is close to the front frame relative to the tail of the temple; the at least two loudspeakers are arranged on the inner side of the temple of the eyeglass body, and the arrangement position is away from the front frame relative to the tail of the temple; the wireless communication module is internally provided with a processing module, and the processing module is connected with the microphones and the loudspeakers; the microphones are used to transmit the audio signals picked up by the two microphones to the processing module, and the processing module is used to divide the audio signals into single frames, calculate the difference of the sound energy of the current frame of each of the two microphones, and determine whether the difference of the sound energy is greater than a preset voice sound energy threshold value; if not, it is confirmed that the current frame of each of the two microphones is not a voice frame, and the number of frames in which the two microphones are not voice frames continuously is counted; if the number of frames in which the two microphones are not voice frames continuously is greater than a preset frame number threshold value, it is confirmed that the audio signal is not a voice signal but a noise signal; if it is a noise signal, the noise value of the noise signal is calculated, and the output volume of the loudspeaker is adjusted to the output volume corresponding to the noise value of the noise signal according to the preset corresponding relationship between the noise value and the output volume of the loudspeaker.

2. The smart glasses of claim 1, wherein, The eyeglass body is further provided with a touch control module, and the touch control module is connected with the processing module; the touch control module is used to adjust the output volume of the loudspeaker in response to the touch operation of the user.

3. The smart glasses of claim 2, wherein, The eyeglass body is further provided with an automatic volume control switch, and the automatic volume control switch is connected with the processing module; the automatic volume control switch is used to control the enablement of the touch control module by turning on or off.

4. The smart glasses of claim 3, wherein, The smart glasses acquire an automatic volume control switch instruction sent by a mobile terminal connected with the smart glasses through a wireless network, and control the enablement of the touch control module by turning on or off according to the automatic volume control switch instruction. The automatic volume control switch instruction is sent out by the user by manipulating an automatic volume control switch arranged on the human-computer interaction interface of the mobile terminal.

5. The smart glasses according to any one of claims 1-4, characterized in that, The processing module comprises a microcontroller and a digital signal processing module, and the microcontroller is connected with the digital signal processing module.

6. A method for automatically controlling the volume, applied to the smart glasses according to any one of claims 1-5, characterized in that, The method comprises: acquiring an audio signal picked up by a microphone arranged on the eyeglass body of the smart glasses; dividing the audio signal into single frames, calculating the difference of the sound energy of the current frame of each of the two microphones, and determining whether the difference of the sound energy is greater than a preset voice sound energy threshold value; if not, it is confirmed that the current frame of each of the two microphones is not a voice frame, and the number of frames in which the two microphones are not voice frames continuously is counted; if the number of frames in which the two microphones are not voice frames continuously is greater than a preset frame number threshold value, it is confirmed that the audio signal is not a voice signal but a noise signal; if it is a noise signal, the noise value of the noise signal is calculated; Adjust the output volume of the speaker arranged on the glasses body of the smart glasses according to the preset correspondence between the noise value and the output volume of the speaker.

7. The method of claim 6, wherein, The adjusting the output volume of the speaker arranged on the glasses body of the smart glasses according to the preset correspondence between the noise value and the output volume of the speaker includes: If the noise value of the current frame of the noise signal is lower than the noise value of the previous frame, the output volume of the speaker is correspondingly adjusted lower according to the correspondence; If the noise value of the current frame of the noise signal is higher than the noise value of the previous frame, the output volume of the speaker is correspondingly adjusted higher according to the correspondence; If the noise value of the current frame of the noise signal is equal to the noise value of the previous frame, the output volume of the speaker is not adjusted.

8. The method of claim 6, wherein, The adjusting the output volume of the speaker arranged on the glasses body of the smart glasses according to the preset correspondence between the noise value and the output volume of the speaker further includes: The adjusted output volume is sent to the smart terminal through a wireless network, so that the smart terminal synchronously updates the output volume of the speaker of the smart terminal to the adjusted output volume.

9. The method according to any one of claims 6-8, characterized in that, The adjusting the output volume of the speaker arranged on the glasses body of the smart glasses according to the preset correspondence between the noise value and the output volume of the speaker further includes: The preset correspondence between the noise value and the output volume of the speaker is obtained and stored through the mobile terminal, and the noise value is positively correlated with the output volume of the speaker.

10. An apparatus for automatically controlling volume, characterized by The smart glasses include a glasses body, two microphones and at least two speakers are arranged on the glasses body, the two microphones are arranged on the inner side of the temple of the glasses body, and the arrangement position is close to the front frame relative to the tail of the temple; the at least two speakers are arranged on the inner side of the temple of the glasses body, and the arrangement position is away from the front frame relative to the tail of the temple; including: The obtaining module is used to obtain the audio signal picked up by the two microphones; The judging module is used to divide the audio signal into a single frame, calculate the difference value of the sound energy of the current frame of the two microphones respectively, and judge whether the difference value of the sound energy is greater than a preset voice sound energy threshold value; if not, it is confirmed that the current frame of the two microphones is not a voice frame, and the frame number of continuous non-voice frames of the two microphones is counted; if the frame number of continuous non-voice frames of the two microphones is greater than a preset frame number threshold value, it is confirmed that the audio signal is not a voice signal but a noise signal; The calculating module is used to calculate the noise value of the noise signal if it is a noise signal; The control module is used to adjust the output volume of the speaker arranged on the glasses body of the smart glasses according to the preset correspondence between the noise value and the output volume of the speaker.

11. A smart eyewear system, characterized by It includes: The smart glasses, the smart terminal and the cloud system; The application is applied to smart glasses, the smart glasses include a glasses body, two microphones and at least two loudspeakers are arranged on the glasses body, the two microphones are arranged on the inner side of the glasses body, and the setting position is close to the front frame relative to the tail of the glasses body; the at least two loudspeakers are arranged on the inner side of the glasses body, and the setting position is away from the front frame relative to the tail of the glasses body; The smart glasses are connected with the smart terminal through a wireless connection mode, and the smart terminal is connected with the cloud system through a wireless connection mode; The smart glasses are used for acquiring an audio signal through the two microphones, dividing the audio signal into a single frame, calculating the difference of sound energy of the current frame of the two microphones, and judging whether the difference of sound energy is greater than a preset voice energy threshold value; If not, it is confirmed that the current frame of the two microphones is not a voice frame, and the frame number of the two microphones that are not continuous voice frames is counted; if the frame number of the two microphones that are not continuous voice frames is greater than a preset frame number threshold value, it is confirmed that the audio signal is not a voice signal but a noise signal, if it is a noise signal, the noise value of the noise signal is calculated, and according to the corresponding relationship between the preset noise value and the output volume of the loudspeaker, the output volume of the loudspeaker arranged on the glasses body of the smart glasses is adjusted to the output volume corresponding to the noise value of the current noise signal; The smart glasses are also used for sending the adjusted output volume to the smart terminal; The smart terminal is also used for synchronously updating the output volume of the loudspeaker of the smart terminal to the adjusted output volume.

Images