Acoustic equipment control method and device, electronic equipment and storage medium

Abstract

The invention relates to an acoustic equipment control method and device, electronic equipment and a storage medium, and the method comprises the steps: determining the current state information of a user through a sensor integrated on a mobile terminal and / or acoustic equipment, the state information comprises at least one of the following information: motion state information, position information, environment information and dialogue state information; based on the state information, determining a target acoustic mode adaptive to the current state of the user; and controlling the acoustic equipment to be switched to the target acoustic mode.

Description

Technical Field

[0001] The present disclosure relates to the technical field of acoustic devices, and particularly to a method and device for controlling an acoustic device, an electronic device, and a storage medium. Background Art

[0002] In recent years, wearable acoustic devices such as earphones and headsets have achieved significant technological development, with increasingly rich functions and superior performance. For example, current acoustic devices often have an automatic noise reduction function, which can isolate external noise when the user wears them, improving the user experience. In related technologies, acoustic devices have a certain ability of adaptive adjustment. For example, the automatic noise reduction function is automatically activated in some environments. However, the current adaptive adjustment ability of acoustic devices is relatively low and often has the opposite effect, resulting in a decline in the user experience of the usage function. Summary of the Invention

[0003] To overcome the problems in related technologies, embodiments of the present disclosure provide a method and device for controlling an acoustic device, an electronic device, and a storage medium to solve the defects in related technologies.

[0004] According to a first aspect of the embodiments of the present disclosure, there is provided a method for controlling an acoustic device, the method including:

[0005] Using sensors integrated on a mobile terminal and / or an acoustic device, determining current status information of a user, where the status information includes at least one of the following information: motion status information, location information, environmental information, and conversation status information;

[0006] Based on the status information, determining a target acoustic mode adapted to the current status of the user;

[0007] Controlling the acoustic device to switch to the target acoustic mode.

[0008] In an embodiment of the present disclosure, the using sensors integrated on a mobile terminal and / or an acoustic device to determine current status information of a user includes:

[0009] Obtaining first voice information collected by a microphone of the acoustic device and second voice information collected by a voice pickup unit (VPU), and determining the conversation status information of the user according to the first voice information and the second voice information.

[0010] In an embodiment of the present disclosure, the determining the conversation status information of the user according to the first voice information and the second voice information includes:

[0011] In response to the relevance between the first voice information and the second voice information being higher than a preset threshold, determining that the conversation status information of the user is in conversation;

[0012] In response to the relevance between the first voice message and the second voice message not being higher than a preset threshold, determine that the user's conversation status information is not in a conversation.

[0013] In an embodiment of the present disclosure, the first voice message collected by the microphone of the acoustic device includes:

[0014] The voice message collected by the in-ear microphone and the voice message collected by the out-ear microphone.

[0015] In an embodiment of the present disclosure, determining the target acoustic mode adapted to the user's current state based on the status information includes:

[0016] In response to the user's conversation status information being in a conversation, determine that the target acoustic mode is the transparent mode.

[0017] In an embodiment of the present disclosure, determining the target acoustic mode adapted to the user's current state based on the status information includes:

[0018] In response to the motion state of the acoustic device belonging to a preset motion type, determine that the target acoustic mode is the noise reduction mode, and determine that the level of the noise reduction mode is a level matching the preset motion type.

[0019] In an embodiment of the present disclosure, the method further includes:

[0020] In response to the user adjusting the acoustic mode of the acoustic device, use the mobile terminal and / or the acoustic device to determine the user's habit based on the adjusted acoustic mode and the status information when the user adjusts the acoustic mode, and save the user's habit in the acoustic device, where the user's habit includes the mapping relationship between the acoustic mode and the status information;

[0021] Determining the target acoustic mode adapted to the user's current state based on the status information includes:

[0022] According to the user's habit and the status information, determine the target acoustic mode adapted to the user's current state.

[0023] In an embodiment of the present disclosure, determining the target acoustic mode adapted to the user's current state based on the status information includes:

[0024] According to the multi-modal parameter adjustment strategy, determine the target acoustic mode based on multiple pieces of information in the status information.

[0025] According to the second aspect of the embodiments of the present disclosure, there is provided an acoustic device control device, and the device includes:

[0026] A status module, configured to determine the current status information of the user by using sensors integrated on the mobile terminal and / or the acoustic device, where the status information includes at least one of the following information: motion status information, location information, environmental information, and conversation status information;

[0027] A mode module, configured to determine a target acoustic mode adapted to the current status of the user based on the status information;

[0028] A control module, configured to control the acoustic device to switch to the target acoustic mode.

[0029] In an embodiment of the present disclosure, the status module is configured to:

[0030] Obtain first voice information collected by a microphone of the acoustic device and second voice information collected by a voice pickup unit (VPU), and determine the conversation status information of the user according to the first voice information and the second voice information.

[0031] In an embodiment of the present disclosure, when the status module is configured to determine the conversation status information of the user according to the first voice information and the second voice information, it is configured to:

[0032] In response to the relevance between the first voice information and the second voice information being higher than a preset threshold, determine that the conversation status information of the user is in conversation;

[0033] In response to the relevance between the first voice information and the second voice information not being higher than a preset threshold, determine that the conversation status information of the user is not in conversation.

[0034] In an embodiment of the present disclosure, the first voice information collected by the microphone of the acoustic device includes:

[0035] Voice information collected by an in-ear microphone and voice information collected by an out-ear microphone.

[0036] In an embodiment of the present disclosure, the mode module is configured to:

[0037] In response to the conversation status information of the user being in conversation, determine that the target acoustic mode is a transparent mode.

[0038] In an embodiment of the present disclosure, the mode module is configured to:

[0039] In response to the motion status of the acoustic device belonging to a preset motion type, determine that the target acoustic mode is a noise reduction mode, and determine that the level of the noise reduction mode is a level matching the preset motion type.

[0040] In one embodiment of the present disclosure, the device further includes a habit module, configured to:

[0041] In response to a user adjusting the acoustic mode of the acoustic device, determine a user habit based on the acoustic mode adjusted by the user and the status information when the user adjusts the acoustic mode by using the mobile terminal and / or the acoustic device, and save the user habit in the acoustic device, where the user habit includes a mapping relationship between the acoustic mode and the status information;

[0042] The mode module is configured to:

[0043] Determine a target acoustic mode adapted to the current state of the user according to the user habit and the status information.

[0044] In one embodiment of the present disclosure, the mode module is configured to:

[0045] Determine the target acoustic mode according to various information in the status information according to a multi-modal parameter adjustment strategy.

[0046] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, the electronic device includes a memory and a processor, the memory is used to store computer instructions that can run on the processor, and the processor is used to implement the acoustic device control method described in the first aspect when executing the computer instructions.

[0047] According to a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and the method described in the first aspect is implemented when the program is executed by a processor.

[0048] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0049] The acoustic device control method provided by the embodiments of the present disclosure can use sensors integrated on the mobile terminal and / or the acoustic device to determine the current status information of the user, and then determine a target acoustic mode adapted to the current state of the user based on the status information, and control the acoustic device to switch to the target acoustic mode. Since the current status information of the user includes various information such as motion status information, location information, environmental information, and conversation status information, the status information can comprehensively represent the status of the user in all aspects. Therefore, the method can adaptively adjust the acoustic mode of the acoustic device based on the status information of the user, so that the acoustic mode of the acoustic device can adapt to the state of the user, thereby improving the adaptability of the acoustic mode and the intelligence level of the adaptive adjustment, eliminating the need for the user to adjust the parameters, and improving the user experience. Description of the Drawings

[0050] The accompanying drawings here are incorporated into the specification and form a part of this specification, showing embodiments consistent with the present invention, and are used together with the specification to explain the principles of the present invention.

[0051] Figure 1 is a flowchart of a method for controlling an acoustic device shown in an exemplary embodiment of the present disclosure;

[0052] Figure 2 is a flowchart of a method for controlling an acoustic device shown in an exemplary embodiment of the present disclosure;

[0053] Figure 3 is a flowchart of a method for controlling an acoustic device shown in an exemplary embodiment of the present disclosure;

[0054] Figure 4 is a logic diagram of a method for controlling an acoustic device shown in an exemplary embodiment of the present disclosure;

[0055] Figure 5 is a schematic structural diagram of a device for controlling an acoustic device shown in an exemplary embodiment of the present disclosure;

[0056] Figure 6 is a block diagram of the structure of an electronic device shown in an exemplary embodiment of the present disclosure. Detailed Embodiments

[0057] Here, the exemplary embodiments will be described in detail, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0058] The terms used in the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure. The singular forms "a", "the", and "said" used in the present disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0059] It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to a determination".

[0060] In recent years, wearable acoustic devices such as earphones and headsets have seen significant technological development, with increasingly rich functions and superior performance. For example, current acoustic devices mostly have an automatic noise reduction function, which can isolate external noise when the user wears them, improving the user experience. In related technologies, acoustic devices have a certain adaptive adjustment ability. For example, in some environments, the automatic noise reduction function is automatically activated. However, the current adaptive adjustment ability of acoustic devices is low and often counterproductive, resulting in a decline in the user's functional experience. For example, when a user is running outdoors, the earphone recognizes the surrounding noise and adaptively activates the automatic noise reduction function. After the automatic noise reduction function isolates the surrounding noise, the user will instead hear some abnormal running and jumping sounds, even causing serious discomfort to the user, thus counteracting the user experience and severely degrading it.

[0061] Based on this, in a first aspect, at least one embodiment of the present disclosure provides an acoustic device control method, which can be applied to acoustic devices, especially wearable acoustic devices such as earphones and headsets. This method can improve the adaptive adjustment ability of acoustic devices, making the adaptive adjustment result more in line with the user's usage needs, thus eliminating the user's manual adjustment operation and improving the user experience, especially avoiding the situation where the adaptive adjustment is counterproductive.

[0062] In terms of hardware, the acoustic device executing this method can be configured with a motion sensor, a microphone, a voice pickup unit VPU (Voice Pickup Unit), etc. For example, the motion sensor can be an acceleration sensor G-sensor, etc. The voice pickup unit VPU can collect the user's own voice through bone conduction.

[0063] Please refer to the appendix Figure 1 , which exemplarily shows the flow of this acoustic device control method, including steps S101 to S103.

[0064] In step S101, the sensor integrated on the mobile terminal and / or the acoustic device is used to determine the user's current status information, where the status information includes at least one of the following information: motion state information, location information, environmental information, and conversation state information.

[0065] First, taking the motion state information and the dialogue state information in the status information as examples, the process of determining the user's current status information using the sensors on the acoustic device will be introduced.

[0066] Please refer to the appendix Figure 2 , which exemplarily shows the process of determining the motion state information, including steps S201 to S202.

[0067] In step S201, the motion parameters collected by the motion sensor of the acoustic device are obtained. Among them, the motion sensor can collect motion parameters at a certain frequency. For example, the acceleration sensor G-sensor collects the acceleration values on its three coordinate axes at a certain frequency. The motion sensor can actively report the collected motion parameters to the processor of the acoustic device or the microprocessing unit (MCU) that executes this method; or, the processor of the acoustic device or the microprocessing unit that executes this method can obtain the motion parameters collected by the motion sensor in real time.

[0068] In step S202, the motion state of the acoustic device is determined according to the motion parameters. Exemplarily, this step can determine the motion state of the acoustic device according to the change situation of the motion parameters of the motion sensor. For example, if the change amplitude of the acceleration value collected by the acceleration sensor is less than the first amplitude threshold, the motion state of the acoustic device can be determined to be the stationary state; if the change amplitude of the acceleration value collected by the acceleration sensor is greater than the second amplitude threshold and less than the third amplitude threshold, and the acceleration value collected by the acceleration sensor changes at a fixed frequency, the motion state of the acoustic device can be determined to be walking; if the change amplitude of the acceleration value collected by the acceleration sensor is greater than the third amplitude threshold, and the acceleration value collected by the acceleration sensor changes at a fixed frequency, the motion state of the acoustic device can be determined to be running (the acceleration value change frequency corresponding to running is higher than the acceleration value change frequency corresponding to walking).

[0069] Please refer to the appendix Figure 3 , which exemplarily shows the process of determining the dialogue state information, including step S301.

[0070] In step S301, the first voice information collected by the microphone of the acoustic device and the second voice information collected by the voice pickup unit VPU are obtained, and the user's dialogue state information is determined according to the first voice information and the second voice information.

[0071] Wherein, when the acoustic device is a wearable acoustic device such as a headset or an earphone, the acoustic device may have an in-ear microphone and an out-ear microphone. The in-ear microphone is located inside the user's ear when the acoustic device is worn, and the out-ear microphone is located outside the user's ear when the acoustic device is worn. In this case, the first voice information collected by the microphone of the acoustic device includes: the voice information collected by the in-ear microphone (hereinafter referred to as in-ear voice information) and the voice information collected by the out-ear microphone (hereinafter referred to as out-ear voice information).

[0072] When the user is speaking, both the microphone (in-ear microphone and out-ear microphone) and the voice pickup unit VPU can collect the voice emitted by the user. The results of the same voice collected by different devices have a certain correlation. Therefore, exemplarily, it can be determined that the user's conversation status information is in conversation in response to the correlation degree between the first voice information and the second voice information being higher than a preset threshold; and it can be determined that the user's conversation status information is not in conversation in response to the correlation degree between the first voice information and the second voice information not being higher than the preset threshold.

[0073] Furthermore, if the first voice information includes in-ear voice information and out-ear voice information, it can be determined that the user's conversation status information is in conversation in response to the correlation degrees between the in-ear voice information and the out-ear voice information, between the in-ear voice information and the second voice information, and between the out-ear voice information and the second voice information all being higher than the preset threshold; otherwise, it is determined that the user's conversation status information is not in conversation.

[0074] Wherein, the correlation degree between two voice signals can be calculated according to the following formula:

[0075]

[0076] In the above formula, r xy [l] represents the correlation degree between two voice information x[n] and y(n - l). The higher the correlation degree, the higher the correlation degree between the two voice signals, and the higher the similarity between the two voice signals.

[0077] Next, taking the motion state information, position information, and environmental information in the state information as examples, the process of determining the user's current state information using the sensors on the mobile terminal will be introduced.

[0078] It should be understood that the acoustic device can be pre-bound to a mobile terminal such as a smartphone. For example, a user can achieve the binding of the mobile terminal and the acoustic device through an acoustic device control program installed on the mobile terminal. At the same time, the acoustic device and communication with the acoustic device can also be controlled through this program. Mobile terminals such as smartphones are equipped with a variety of high-precision sensors, have powerful computing power, and can access the cloud through the network for extremely complex data processing and serve as the hub of multiple intelligent devices through wireless transmission. Utilizing this feature, through an application program as a bridge and in the way of wireless information transmission, the state information obtained by the mobile terminal using some user behavior data collected can be transmitted to the acoustic device, which can help the acoustic device make a more refined judgment of the user's behavior state and can also be used as a supplement to verify the accuracy of the result of the acoustic device's judgment of the state information.

[0079] For example, a mobile terminal device can determine the location where the user is located, that is, the location information, through programs such as maps. The user's location can be represented by multiple levels of location categories. For example, the first-level location category can be divided into outdoor and indoor, etc. The second-level location category can include streets, parks, the wild, highways, etc. under outdoor, and home, company, school, shopping mall, coffee shop, etc. under indoor.

[0080] For example, a mobile terminal device can determine the user's motion state information through its motion sensors, such as stationary, running, walking, etc. The acoustic device can also compare the motion state information determined by the mobile terminal with the motion state information determined by the acoustic device itself. If they match, the motion state information is adopted; if they do not match, the motion state information is not adopted.

[0081] For example, the mobile terminal can obtain the weather of the location where the user is through the network.

[0082] For example, the mobile terminal can determine the user's transportation mode through some sensors, such as taking a means of transportation or not taking a means of transportation, and the type of the means of transportation taken.

[0083] In step S102, based on the state information, a target acoustic mode adapted to the current state of the user is determined.

[0084] Optionally, when determining the target acoustic mode, the level of the acoustic mode can also be determined.

[0085] Exemplarily, in response to the motion state of the acoustic device belonging to a preset motion type, the target acoustic mode is determined to be the noise reduction mode, and the level of the noise reduction mode is determined to be a level matching the preset motion type. For example, if the preset motion type is running, the acoustic device can automatically reduce the level of active noise cancellation to a lower level when the user is running, so as to avoid discomfort caused by the user hearing abnormal running and jumping sounds. For another example, if the preset motion type is stationary, walking or other motion types, the level of the active noise cancellation function can be maintained at a higher level. Since the user is focused on the music in the earphones when stationary or walking, a higher noise reduction level can be used to isolate the noise for the user.

[0086] Exemplarily, in response to the user's conversation status information indicating that the user is in a conversation, the target acoustic mode is determined to be the transparency mode. The transparency mode not only turns off the active noise cancellation function, but also can restore and even enhance the content of the other party's speech, so that the user can clearly hear the content of the other party's speech, meet the user's needs, and improve the user experience. When the user is in a conversation, they are often communicating with others, and the user needs to clearly hear the content of the other party's speech. By turning off the active noise cancellation function, it can be avoided that the content of the other party's speech is eliminated or reduced as noise by the acoustic device, thus meeting the user's needs.

[0087] Compared with the scenario in the related art where the acoustic device still performs active noise cancellation when the user is communicating with others, this embodiment can improve the user experience and save the user from the operation of manually turning off the noise cancellation function.

[0088] When the status information includes multiple types of information, the target acoustic mode can be determined according to a multi-modal parameter adjustment strategy based on the multiple types of information in the status information. Among them, the multi-modal parameter adjustment strategy can be the result of training a deep learning model, which can fuse the features of multiple types of information in the status information to predict the target acoustic mode. For example, if the status information is that the user is walking on a street on a cloudy day, the multi-modal parameter adjustment strategy can turn off the active noise cancellation function automatically activated by the acoustic device based on the safety of the user's walking.

[0089] In addition, the status information can further include environmental sound detection results, ear canal detection results, etc. Multiple types of information are added to the determining factors of the multi-modal parameter adjustment strategy, thereby further improving the effect of parameter adjustment and the degree of fitting to the user's needs.

[0090] Please refer to the append Figure 4 ix, which shows a logical schematic diagram of the acoustic device control method obtained by combining the above-mentioned multiple embodiments. From the append Figure 4It can be seen that the acoustic device can detect the wearer's activity status based on a microphone, a voice pickup unit (VPU), a gravity sensor (G-sensor), and the scene recognition result sent by the mobile phone App, that is, detect the wearer's motion state, scene, speech state, etc. Then, the wearer's activity status detection result, the environmental sound detection result, the ear canal detection result, etc. are jointly input into the multi-modal AI module to determine the current optimal experience strategy, that is, the parameter value most suitable for the acoustic device at present, and then adaptively switch parameter values such as the ANC (automatic noise cancellation) effect of the earphone.

[0091] In step S103, control the acoustic device to switch to the target acoustic mode.

[0092] The acoustic device control method provided by the embodiments of the present disclosure can use sensors integrated on the mobile terminal and / or the acoustic device to determine the current status information of the user, and then based on the status information, determine the target acoustic mode adapted to the current status of the user, and control the acoustic device to switch to the target acoustic mode. Since the current status information of the user includes various information such as motion status information, location information, environmental information, and conversation status information, the status information can comprehensively represent the status of the user in all aspects. Therefore, the method can adaptively adjust the acoustic mode of the acoustic device based on the status information of the user, so that the acoustic mode of the acoustic device can adapt to the status of the user, thereby improving the adaptability of the acoustic mode and the intelligence level of the adaptive adjustment, eliminating the user's operation of adjusting parameters, and improving the user experience.

[0093] In some embodiments of the present disclosure, the acoustic device can respond to the user's adjustment of the acoustic mode of the acoustic device, use the mobile terminal and / or the acoustic device to determine the user's habit based on the adjusted acoustic mode of the user and the status information when the user adjusts the acoustic mode, and save the user's habit in the acoustic device, where the user's habit includes the mapping relationship between the acoustic mode and the status information.

[0094] For example, when the user adjusts the acoustic mode, the acoustic device can send the current status information of the user determined by the sensors integrated on the mobile terminal and / or the acoustic device, and the adjusted acoustic mode of the user (that is, the acoustic mode selected by the user during adjustment) to the mobile terminal, so that the mobile terminal generates the user's habit, that is, the mapping relationship between the current status information of the user and the acoustic mode selected by the user during adjustment is added to the user's habit.

[0095] After the terminal device generates the user's habit, it can send the user's habit to the acoustic device, and the acoustic device receives and saves the user's habit sent by the terminal device.

[0096] Based on this, when the acoustic device determines the target acoustic mode adapted to the current state of the user based on the state information, it can determine the target acoustic mode adapted to the current state of the user according to the user's habits and the state information. For example, it looks up in the user's habits whether there is a piece of habit state information that matches the current state information. If so, it determines the acoustic mode of this habit as the target acoustic mode; if not, it can determine the target acoustic mode in other ways, such as determining the target acoustic mode according to the multi-modal parameter adjustment strategy mentioned in the above embodiment.

[0097] For example, if the user has turned off the active noise reduction function and activated the transparency mode multiple times when walking in the community (which can be determined based on the state information), the transparency mode can be associated with the scenario of walking in the community and saved as a user habit. Furthermore, when the user wears the acoustic device and walks in the community, the state information is obtained by using the acoustic device and / or the mobile terminal. When the acoustic device finds that the state information is walking in the community, it can adaptively turn off the active noise reduction function and activate the transparency mode based on the above habit.

[0098] According to the second aspect of the embodiments of the present disclosure, an acoustic device control device is provided. Please refer to the appendix Figure 5 , the device includes:

[0099] A state module 501, configured to use sensors integrated on the mobile terminal and / or the acoustic device to determine the current state information of the user, where the state information includes at least one of the following information: motion state information, position information, environmental information, and conversation state information;

[0100] A mode module 502, configured to determine a target acoustic mode adapted to the current state of the user based on the state information;

[0101] A control module 503, configured to control the acoustic device to switch to the target acoustic mode.

[0102] In an embodiment of the present disclosure, the state module is configured to:

[0103] Obtain first voice information collected by a microphone of the acoustic device and second voice information collected by a voice pickup unit VPU, and determine the conversation state information of the user according to the first voice information and the second voice information.

[0104] In an embodiment of the present disclosure, when the state module is configured to determine the conversation state information of the user according to the first voice information and the second voice information, it is configured to:

[0105] In response to the relevance between the first voice information and the second voice information being higher than a preset threshold, determine that the conversation state information of the user is in a conversation;

[0106] In response to the relevance between the first voice message and the second voice message not being higher than a preset threshold, determine that the conversation status information of the user is not in conversation.

[0107] In an embodiment of the present disclosure, the first voice message collected by the microphone of the acoustic device includes:

[0108] The voice message collected by the in-ear microphone and the voice message collected by the out-ear microphone.

[0109] In an embodiment of the present disclosure, the mode module is used for:

[0110] In response to the conversation status information of the user being in conversation, determine that the target acoustic mode is the transparent mode.

[0111] In an embodiment of the present disclosure, the mode module is used for:

[0112] In response to the motion state of the acoustic device belonging to a preset motion type, determine that the target acoustic mode is the noise reduction mode, and determine that the level of the noise reduction mode is a level matching the preset motion type.

[0113] In an embodiment of the present disclosure, the device further includes a habit module for:

[0114] In response to the user adjusting the acoustic mode of the acoustic device, use the mobile terminal and / or the acoustic device to determine the user habit based on the adjusted acoustic mode of the user and the status information when the user adjusts the acoustic mode, and save the user habit into the acoustic device, where the user habit includes the mapping relationship between the acoustic mode and the status information;

[0115] The mode module is used for:

[0116] According to the user habit and the status information, determine the target acoustic mode suitable for the current state of the user.

[0117] In an embodiment of the present disclosure, the mode module is used for:

[0118] According to the multi-modal parameter adjustment strategy, determine the target acoustic mode according to various information in the status information.

[0119] Regarding the device in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments of the method in the first aspect, and will not be elaborated here.

[0120] According to the fourth aspect of the embodiments of the present disclosure, please refer to the appendix Figure 6, which exemplarily shows a block diagram of an electronic device. For example, device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0121] Referring to Figure 5 , device 600 may include one or more of the following components: a processing component 602, a memory 604, a power component 606, a multimedia component 608, an audio component 610, an input / output (I / O) interface 612, a sensor component 614, and a communication component 616.

[0122] The processing component 602 generally controls the overall operation of device 600, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.

[0123] The memory 604 is configured to store various types of data to support the operation of device 600. Examples of such data include instructions for any application or method operating on device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0124] The power component 606 provides power to the various components of device 600. The power component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 600.

[0125] The multimedia component 608 includes a screen that provides an output interface between the device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of the touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0126] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC) that is configured to receive external audio signals when the device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 604 or transmitted via the communication component 616. In some embodiments, the audio component 610 further includes a speaker for outputting audio signals.

[0127] The I / O interface 612 provides an interface between the processing component 602 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power button, and a lock button.

[0128] The sensor component 614 includes one or more sensors for providing an assessment of the various aspects of the state of the device 600. For example, the sensor component 614 can detect the on / off state of the device 600, the relative positioning of components, such as the display and the keypad of the device 600. The sensor component 614 can also detect a change in the position of the device 600 or a component of the device 600, the presence or absence of user contact with the device 600, the orientation or acceleration / deceleration of the device 600, and the temperature change of the device 600. The sensor component 614 can also include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 614 can also include a light sensor, such as a CMOS or a CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 614 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0129] The communication component 616 is configured to facilitate communication between the device 600 and other devices in a wired or wireless manner. The device 600 can access a communication standard-based wireless network, such as WiFi, 2G or 3G, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0130] In an exemplary embodiment, the device 600 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the acoustic device control method of the above electronic device.

[0131] In a fourth aspect, in an exemplary embodiment of the present disclosure, there is also provided a non-transitory computer-readable storage medium including instructions, such as a memory 604 including instructions, and the above instructions can be executed by a processor 620 of the device 600 to complete the acoustic device control method of the above electronic device. For example, the non-transitory computer-readable storage medium can be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0132] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the disclosure herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure, which follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed by the present disclosure. The specification and embodiments are only to be regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0133] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. An acoustic device control method, characterized in that, the method includes: using sensors integrated on the mobile terminal and / or the acoustic device to determine the current status information of the user, where the status information includes at least one of the following information: motion status information, location information, environmental information, conversation status information; based on the status information, determine a target acoustic mode adapted to the current status of the user; control the acoustic device to switch to the target acoustic mode.

2. The acoustic device control method according to claim 1, characterized in that, the using sensors integrated on the mobile terminal and / or the acoustic device to determine the current status information of the user includes: obtaining first voice information collected by the microphone of the acoustic device and second voice information collected by the voice pickup unit (VPU), and determining the conversation status information of the user according to the first voice information and the second voice information.

3. The acoustic device control method according to claim 2, characterized in that, the determining the conversation status information of the user according to the first voice information and the second voice information includes: in response to the relevance of the first voice information and the second voice information being higher than a preset threshold, determining that the conversation status information of the user is in conversation; in response to the relevance of the first voice information and the second voice information not being higher than the preset threshold, determining that the conversation status information of the user is not in conversation.

4. The acoustic device control method according to claim 2, characterized in that, the first voice information collected by the microphone of the acoustic device includes: voice information collected by the in-ear microphone and voice information collected by the out-ear microphone.

5. The acoustic device control method according to any one of claims 1 to 4, characterized in that, the based on the status information, determining a target acoustic mode adapted to the current status of the user includes: in response to the conversation status information of the user being in conversation, determining that the target acoustic mode is the transparent mode.

6. The acoustic device control method according to claim 1, characterized in that, the based on the status information, determining a target acoustic mode adapted to the current status of the user includes: in response to the motion status of the acoustic device belonging to a preset motion type, determining that the target acoustic mode is the noise reduction mode, and determining the level of the noise reduction mode as a level matching the preset motion type.

7. The acoustic device control method according to claim 1, characterized in that, the method further includes: in response to the user adjusting the acoustic mode of the acoustic device, using the mobile terminal and / or the acoustic device to determine the user habit based on the adjusted acoustic mode of the user and the status information when the user adjusts the acoustic mode, and saving the user habit into the acoustic device, where the user habit includes the mapping relationship between the acoustic mode and the status information; the based on the status information, determining a target acoustic mode adapted to the current status of the user includes: determining a target acoustic mode adapted to the current status of the user according to the user habit and the status information.

8. The acoustic device control method according to claim 1, wherein, determining a target acoustic mode adapted to the current state of the user based on the state information includes: determining the target acoustic mode according to multiple types of information in the state information according to a multi-modal parameter adjustment strategy.

9. An acoustic device control apparatus, wherein, the apparatus includes: a state module configured to determine the current state information of a user by using sensors integrated on a mobile terminal and / or an acoustic device, where the state information includes at least one of the following types of information: motion state information, location information, environmental information, and conversation state information; a mode module configured to determine a target acoustic mode adapted to the current state of the user based on the state information; a control module configured to control the acoustic device to switch to the target acoustic mode.

10. An electronic device, wherein, the electronic device includes a memory and a processor, the memory is configured to store computer instructions executable on the processor, and the processor is configured to implement the acoustic device control method according to any one of claims 1 to 8 when executing the computer instructions.

11. A computer-readable storage medium having a computer program stored thereon, wherein, the program, when executed by a processor, implements the method according to any one of claims 1 to 8.

Images