Abnormal sound processing method, device, terminal and storage medium

Abstract

The present application relates to an abnormal sound processing method, device, terminal and storage medium, the method comprising: determining whether the terminal is in a shaking state; when it is determined that the terminal is in a shaking state, obtaining current sound information; identifying the current sound information according to preset abnormal sound characteristics, and determining whether an abnormal sound occurs in the camera motor in the terminal, wherein the preset abnormal sound characteristics characterize the sound characteristics of the abnormal sound of the camera motor; after determining that the camera motor has an abnormal sound, starting the camera motor. In the method, when the shaking state of the terminal is determined, the current sound information is identified according to the preset abnormal sound characteristics. If it is determined that the camera motor has an abnormal sound, the camera motor is started so that the camera motor is in a relatively stable focusing state, thereby avoiding the camera motor from continuously making a large abnormal sound, thereby reducing or eliminating the abnormal sound.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an abnormal sound processing method, device, terminal and storage medium. Background Art

[0002] Nowadays, the camera performance of mobile phones and other terminals is getting higher and higher, and the requirements for camera motors are also getting higher and higher. Generally speaking, in order to support the autofocus function or anti-shake function, the camera will be equipped with a focus motor (such as a voice coil motor (VCM)) and an optical image stabilization (OIS) motor to push the lens to achieve autofocus and anti-shake. The corresponding motor and lens have a certain amount of movement space.

[0003] However, when the focus motor is not in use, it will be in a relaxed state. Since it has a certain amount of space for movement, it will cause unusual noises when the phone is shaken. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present application provides an abnormal sound processing method, device, terminal and storage medium.

[0005] According to a first aspect of an embodiment of the present application, a method for processing abnormal sound is provided, the method comprising:

[0006] Determine whether the terminal is in a shaking state;

[0007] When determining that the terminal is in a shaking state, obtaining current sound information;

[0008] According to a preset abnormal sound feature, the current sound information is identified to determine whether an abnormal sound occurs in a camera motor in the terminal, wherein the preset abnormal sound feature represents a sound feature of an abnormal sound occurring in a camera motor;

[0009] After determining that the camera motor makes an abnormal sound, the camera motor is started.

[0010] Optionally, determining whether the terminal is in a shaking state includes:

[0011] Acquiring a motion parameter of the terminal, wherein the motion parameter at least represents a shaking intensity;

[0012] If it is determined that the motion parameter meets a preset shaking condition, it is determined that the terminal is in a shaking state.

[0013] Optionally, the identifying the current sound information according to a preset abnormal sound feature to determine whether a camera motor in the terminal makes an abnormal sound includes:

[0014] Extracting current sound features of the current sound information;

[0015] Comparing the current sound feature with the preset abnormal sound feature;

[0016] If the similarity between the current sound feature and the preset abnormal sound feature is greater than or equal to the preset similarity, it is determined that the camera motor has an abnormal sound.

[0017] Optionally, before starting the camera motor, the method further includes:

[0018] It is determined that a human body exists within a first preset distance of the terminal.

[0019] Optionally, before starting the camera motor, the method further includes:

[0020] Obtaining the current light intensity of the environment in which the terminal is located; and,

[0021] It is determined that the current light intensity is greater than or equal to a preset light intensity.

[0022] Optionally, before starting the camera motor, the method further includes:

[0023] determining whether an obstacle is detected, and when it is determined that an obstacle is detected, obtaining a current distance between the terminal and the obstacle; and,

[0024] If it is determined that the current distance is greater than or equal to the second preset distance.

[0025] According to a second aspect of an embodiment of the present application, there is provided an abnormal sound processing device, the device comprising:

[0026] A first determination module, used to determine whether the terminal is in a shaking state;

[0027] An acquisition module, used to acquire current sound information when determining that the terminal is in a shaking state;

[0028] A second determination module is used to identify the current sound information according to a preset abnormal sound feature, and determine whether the camera motor in the terminal has an abnormal sound, wherein the preset abnormal sound feature represents a sound feature of the abnormal sound of the camera motor;

[0029] A starting module is used to start the camera motor after determining that the camera motor makes an abnormal sound.

[0030] Optionally, the first determining module is specifically configured to:

[0031] Acquiring a motion parameter of the terminal, wherein the motion parameter at least represents a shaking intensity;

[0032] If it is determined that the motion parameter meets a preset shaking condition, it is determined that the terminal is in a shaking state.

[0033] Optionally, the second determining module is specifically configured to:

[0034] Determining a current sound feature of the current sound information;

[0035] Comparing the current sound feature with the preset abnormal sound feature;

[0036] If the similarity between the current sound feature and the preset abnormal sound feature is greater than or equal to the preset similarity, it is determined that the camera motor has an abnormal sound.

[0037] Optionally, the device further comprises:

[0038] A third determining module is configured to determine whether a human body exists within a first preset distance of the terminal before starting the camera motor.

[0039] Optionally, the device further comprises:

[0040] A fourth determination module is used to obtain the current light intensity of the environment where the terminal is located before starting the camera motor; and

[0041] It is determined that the current light intensity is greater than or equal to a preset light intensity.

[0042] Optionally, the device further comprises:

[0043] a fifth determination module, configured to determine whether an obstacle is detected before starting the camera motor, and to obtain a current distance between the terminal and the obstacle when an obstacle is detected; and

[0044] If it is determined that the current distance is greater than or equal to the second preset distance.

[0045] According to a third aspect of an embodiment of the present application, a terminal is provided, the terminal comprising:

[0046] processor;

[0047] a memory for storing processor-executable instructions;

[0048] The processor is configured to execute the method as described in the first aspect.

[0049] According to a fourth aspect of an embodiment of the present application, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the method described in the first aspect.

[0050] The technical solution provided by the embodiment of the present application may include the following beneficial effects: In this method, when the shaking state of the terminal is determined, the current sound information is obtained, and then the current sound information is identified according to the preset abnormal sound characteristics. If it is determined that the camera motor has an abnormal sound, the camera motor is started so that the camera motor is in a relatively stable focusing state, thereby avoiding the camera motor from continuously making loud abnormal sounds, thereby reducing or eliminating abnormal sounds, solving the problem of continuous abnormal sounds when the terminal is shaken, and improving the user experience.

[0051] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0053] Figure 1 The figure is a flowchart of a method for processing abnormal sound according to an exemplary embodiment.

[0054] Figure 2 It is a block diagram of an abnormal sound processing device according to an exemplary embodiment.

[0055] Figure 3 is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0056] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0057] The present disclosure provides an abnormal sound processing method, which is applied to a terminal. In the method, when the shaking state of the terminal is determined, the current sound information is obtained, and then the current sound information is identified according to the preset abnormal sound characteristics. If it is determined that the camera motor has an abnormal sound, the camera motor is started so that the camera motor is in a relatively stable focusing state, thereby avoiding the camera motor from continuously making a large abnormal sound, thereby reducing or eliminating the abnormal sound, solving the problem of continuous abnormal sound when the terminal is shaken, and improving the user experience.

[0058] In an exemplary embodiment, a method for processing abnormal sound is provided. Figure 1 As shown, the method includes:

[0059] S110, determining whether the terminal is in a shaking state;

[0060] S120, when it is determined that the terminal is in a shaking state, obtaining current sound information;

[0061] S130, identifying the current sound information according to a preset abnormal sound feature, and determining whether a camera motor in the terminal has an abnormal sound, wherein the preset abnormal sound feature represents a sound feature of the abnormal sound of the camera motor;

[0062] S140: After determining that the camera motor makes an abnormal sound, start the camera motor.

[0063] In this method, it is first determined whether the terminal is in a shaking state. If it is determined that the terminal is currently in a shaking state, it means that the camera motor of the terminal may have abnormal noise. In order to improve the accuracy of abnormal sound recognition, it is necessary to further obtain the current sound information of the terminal.

[0064] However, the current sound information of the terminal may generally include sound information from the environment where the terminal is currently located and sound information currently originating from inside the terminal.

[0065] Among them, the original sound information of the terminal can be collected through the microphone. After the microphone collection is completed, the collected original sound information can be sent to the processor of the terminal as the current sound information, and the processor can obtain the current sound information.

[0066] It should be noted that after the microphone collects the original sound information, it can also transmit the collected original sound information to the audio codec. The audio codec processes the above original sound information to obtain the current sound information, and then transmits it to the processor, so that the processor can obtain the current sound information.

[0067] Since the present disclosure is intended to be able to identify the abnormal sound of the camera motor, for example, the terminal can be a mobile phone. Generally, the camera in the mobile phone is set in the upper part of the mobile phone. Therefore, the original sound information can be collected through the microphone on the top to better collect the abnormal sound information caused by the shaking of the camera motor, so as to improve the collection effect of the original sound information, and then the camera motor can be processed to better avoid collision with other structures of the terminal and emit continuous abnormal noise.

[0068] It should be noted that when collecting original sound information through a microphone, a microphone can also be set near the location of the camera motor to better improve the sensitivity and reliability of sound collection.

[0069] In step S130, the preset abnormal sound feature represents the sound feature of the abnormal sound of the camera motor, and the preset abnormal sound feature may be set when the terminal leaves the factory, or may be set by the user. If the preset abnormal sound feature is set when the terminal leaves the factory, the preset abnormal sound feature may be modified later according to the actual use of the terminal.

[0070] For example, before the terminal leaves the factory, the abnormal sound of the camera motor in the terminal can be collected, and then its features can be extracted and stored in the terminal in advance as preset abnormal sound features.

[0071] In this step, the current sound information can be identified according to the preset abnormal sound characteristics to determine whether the current sound information matches the preset abnormal sound characteristics. If they match, it is determined that an abnormal sound occurs in the camera motor in the terminal.

[0072] In step S140, when it is determined that the camera motor has an abnormal sound, the camera motor can be powered on by controlling the power management chip to start the camera motor, so that the camera motor is in a focusing state and is fixed in a stable state so that it no longer shakes with the shaking of the terminal, thereby avoiding continuous abnormal noise from the camera motor and eliminating or reducing the abnormal sound of the camera motor.

[0073] It should be noted that the camera motor can also be kept stationary relative to the terminal by other means. For example, a fixed spring clip can be set inside the camera motor. When it is determined that the camera motor makes an abnormal sound, the fixed spring clip can be controlled to pop out, so that the camera motor is clamped inside the terminal and no longer makes abnormal sounds.

[0074] In the method, when the shaking state of the terminal is determined, the current sound information is obtained, which solves the problem of abnormal sound continuously occurring when the terminal is shaken, and can avoid frequent acquisition of current sound information, thereby reducing the energy consumption of the terminal.

[0075] In an exemplary embodiment, a method for processing abnormal sound is provided, which is applied to a terminal. In the method, according to a preset abnormal sound feature, current sound information is identified to determine whether a camera motor in the terminal has an abnormal sound, including:

[0076] S210, extracting current sound features of current sound information;

[0077] S220, comparing the current sound feature with the preset abnormal sound feature;

[0078] S230: If the similarity between the current sound feature and the preset abnormal sound feature is greater than or equal to the preset similarity, it is determined that the camera motor has an abnormal sound.

[0079] In step S210, the current sound feature has the same feature type as the preset abnormal sound feature. For example, if the preset abnormal sound feature includes pitch, the determined current sound feature also includes pitch; if the preset abnormal sound feature includes loudness, the determined current sound feature also includes loudness. The specific method for determining the current sound feature is not described in detail here.

[0080] In step S220, after the current sound feature is determined, the determined current sound feature is compared with the preset abnormal sound feature to determine whether the current sound information is an abnormal sound generated by the camera motor.

[0081] In step S230, the preset similarity can be set when the terminal leaves the factory, or can be set by the user. If the preset similarity is set when the terminal leaves the factory, the preset similarity can be modified later according to the actual use of the terminal.

[0082] When the preset abnormal sound feature includes multiple features, a preset similarity may be set for each feature, or the same preset similarity may be set for all features.

[0083] Example 1,

[0084] The preset abnormal sound features include three features of pitch, loudness and timbre, each feature corresponds to the same preset similarity, and the preset similarity can be 80%.

[0085] After obtaining the current sound information, the feature extraction is performed on the current sound information to determine the current sound features, including pitch, loudness and timbre. The current sound features are then compared with the preset abnormal sound features. If the similarity of the three features is greater than or equal to 80%, it is considered that the current sound information matches the preset abnormal sound features, and it is determined that the camera motor has an abnormal sound. Otherwise, it is determined that the camera motor has no abnormal sound.

[0086] Example 2,

[0087] The preset abnormal sound features include three features: pitch, loudness and timbre. Each feature corresponds to a different preset similarity, where the preset similarity corresponding to the pitch is 80%, the preset similarity corresponding to the loudness is 70%, and the preset similarity corresponding to the timbre is 90%.

[0088] After obtaining the current sound information, feature extraction is performed on the current sound information to determine the current sound features, including pitch, loudness, and timbre. The current sound features are then compared with the preset abnormal sound features. If the similarity of the pitch is greater than or equal to 80%, the similarity of the loudness is greater than or equal to 70%, and the similarity of the timbre is greater than or equal to 90%, it is considered that the current sound information matches the preset abnormal sound features, and it is determined that the camera motor has an abnormal sound. Otherwise, it is determined that the camera motor has no abnormal sound.

[0089] Of course, multiple sound features can also be fused and the similarity of the fused features can be set. For example, this can be achieved through a neural network model. A preset abnormal sound feature sample set of abnormal sounds occurring in the camera motor can be obtained in advance, and a model can be trained based on the preset abnormal sound feature sample set to obtain a trained abnormal sound recognition model. After the current sound feature is extracted, the current sound feature can be identified through the abnormal sound recognition model to determine whether it is an abnormal sound occurring in the camera motor.

[0090] In this method, the current sound feature is compared with the preset abnormal sound feature to determine whether the camera motor has abnormal sound. The judgment result is more accurate and the user experience is better.

[0091] In an exemplary embodiment, a method for processing abnormal sound is provided, which is applied to a terminal. In the method, determining whether the terminal is in a shaking state includes:

[0092] S310: Obtain motion parameters of the terminal; wherein the motion parameters at least represent the intensity of shaking.

[0093] S320: If it is determined that the motion parameter meets a preset shaking condition, then it is determined that the terminal is in a shaking state.

[0094] In step S310, the motion parameters include one or more of the following: current acceleration, current change speed of the tilt angle, current change frequency of the motion direction, etc. Of course, the motion parameters may also include other parameters that may characterize the intensity of the shaking, which will not be described in detail here.

[0095] In step S320, the preset shaking condition refers to a condition that can indicate that the terminal is in a shaking state.

[0096] For example, the motion parameter includes the current acceleration, and the preset shaking condition may be: the current acceleration is greater than or equal to the preset acceleration (e.g., 50 m / s 2 ).

[0097] For another example, the motion parameter includes a current change speed of the tilt angle, and the preset shaking condition may be: the current change speed of the tilt angle is greater than or equal to a preset change speed.

[0098] The tilt angle can be detected by a gravity sensor or an angle sensor.

[0099] For another example, the motion parameter includes a current change frequency of the motion direction, and the preset shaking condition may be: the current change frequency of the motion direction is greater than or equal to a preset change frequency.

[0100] The direction of movement can be detected by a device capable of detecting direction, such as an electronic compass.

[0101] Of course, the motion parameters may also include the above-mentioned multiple parameters at the same time.

[0102] For example, the motion parameters include both the current acceleration and the current change frequency of the motion direction, and the preset shaking condition may be: the current acceleration is greater than or equal to the preset acceleration, and the current change frequency of the motion direction is greater than or equal to the preset change frequency.

[0103] In an exemplary embodiment, a method for processing abnormal sound is provided, which is applied to a terminal. In the method, the motion parameter is a current acceleration.

[0104] Among them, the current acceleration can be detected by the acceleration sensor and then transmitted to the processor, and the processor can obtain the current acceleration of the terminal.

[0105] It should be noted that, generally, the A (acceleration) sensor and the G (gyroscope) sensor are integrated together. In order to facilitate the purchase of parts, it can be set to use the A (acceleration) + G (gyroscope) sensor to detect the current acceleration.

[0106] In this method, the setting method of the preset acceleration is similar to the setting method of the preset abnormal sound feature.

[0107] The preset acceleration may be set when the terminal leaves the factory, or may be set by the user. If the preset acceleration is set when the terminal leaves the factory, the preset acceleration may be modified later according to the actual use of the terminal.

[0108] For example, before the terminal leaves the factory, the camera motor of the terminal is shaken to make an abnormal sound, and the acceleration of the terminal at this time is detected, which is then used as a preset acceleration and stored in the terminal in advance.

[0109] Since the terminal is in a shaking state when the acceleration is the preset acceleration, it can be considered that when the acceleration of the terminal is greater than the preset acceleration, the terminal is still in a shaking state. That is, if the current acceleration of the terminal is greater than or equal to the preset acceleration, it is determined that the terminal is in a shaking state.

[0110] It is understandable that if the current acceleration of the terminal is less than the preset acceleration, it is determined that the terminal is not in a shaking state, and the subsequent action of obtaining the current sound information will not be performed to save energy consumption.

[0111] It should be noted that when the terminal is in a shaking state, the environment in which the terminal is located may be relatively noisy, and the abnormal sound generated by the camera motor is not obvious. Therefore, this method is further designed to determine whether the camera motor needs to be controlled by comparing the current sound information with the preset abnormal sound characteristics. If the sound in the environment is relatively loud and the user can hardly feel the abnormal sound of the camera motor, then the similarity between the current sound information and the preset sound information will be less than the preset similarity, and there is no need to control the camera motor to be in a stationary state relative to the terminal, that is, it is considered that the camera motor does not make an abnormal sound, and the processor does not control the camera motor to be in a stationary state relative to the terminal, thereby avoiding unnecessary control and saving energy consumption of the terminal.

[0112] Example,

[0113] The terminal may be a mobile phone, on which an A+G sensor is provided.

[0114] In this example, the A+G sensor detects the current acceleration of the mobile phone in real time or at a set period, and then transmits its detection result to the processor, which can then obtain the current acceleration of the mobile phone.

[0115] After the processor obtains the current acceleration of the phone, it compares it with the preset acceleration, where the preset acceleration can be 50m / s 2 If the current acceleration value is greater than or equal to 50m / s 2 , it is determined that the phone is in a shaking state.

[0116] When the mobile phone is in a shaking state, the processor controls the microphone to collect original sound information, and then transmits it to the audio codec. After being processed by the audio codec, the current sound information is obtained and transmitted to the processor, and the processor obtains the current sound information.

[0117] It should be noted that in addition to determining the shaking state of the terminal by using acceleration as described above, whether the terminal is in a shaking state can also be determined by other motion state information. Other motion state information may include, for example, speed, speed of change of tilt angle, etc., which will not be elaborated here.

[0118] In this method, the current state of the terminal is first determined by the current acceleration of the terminal. Only when it is determined that the terminal is currently in a shaking state, the step of obtaining the current sound information is executed, which can avoid frequent and continuous acquisition of the current sound information and reduce the energy consumption of the terminal.

[0119] In an exemplary embodiment, a method for processing abnormal sound is provided, which is applied to a terminal. The method further includes:

[0120] S410, determining whether there is a human body within a first preset distance of the terminal;

[0121] S420: If it is determined that there is a human body within the first preset distance of the terminal, start the camera motor.

[0122] That is, in this method, before starting the camera motor, it is also necessary to determine whether there is a human body within a first preset distance of the terminal.

[0123] It should be noted that when the terminal is in some environments, even if it is determined that the camera motor has an abnormal sound, the abnormal sound will not be heard by the user and will not affect the user. In such an environment, there is no need to start the camera motor and the camera motor can be controlled to be stationary relative to the terminal.

[0124] For example, the terminal is packed as an express parcel. During transportation, the terminal is in a shaking state due to bumps. At this time, since there is no user using the terminal, the abnormal noise of the camera motor will not interfere with the user. Therefore, there is no need to control the camera motor to be stationary relative to the terminal.

[0125] In view of the above situation, in the method, it can be first determined whether there is a human body within a first preset distance of the terminal, that is, whether the terminal that issues the abnormality is in a state of being used by a user.

[0126] The present disclosure provides a possible implementation method. Generally, under the action of an external electromagnetic field, an induced electromagnetic field will be generated in the human body. The international scientific community uses the "SAR" value to quantify and measure radiation. The full name of SAR in English is Specific Absorption Rate, which is generally called electromagnetic wave absorption ratio, specific absorption rate or electromagnetic wave absorption ratio in Chinese. It is defined as: under the action of an external electromagnetic field, an induced electromagnetic field will be generated in the human body. Since various organs of the human body are lossy media, the electromagnetic field in the body will generate electric current, resulting in the absorption and dissipation of electromagnetic energy. SAR is often used in biodosimetry to characterize this physical process. The meaning of SAR is the electromagnetic power absorbed or consumed by unit mass of human tissue, with the unit of W / kg, American standard (1.6mw / g, 1g average).

[0127] Therefore, a SAR sensor may be provided in the terminal, and the SAR sensor may be used to determine whether a human body exists within a first preset distance of the terminal.

[0128] It should be noted that other methods may also be used to determine whether there is a human body within the first preset distance.

[0129] For example, a temperature sensor and a distance sensor may be set in the terminal. If the temperature sensor detects that the current temperature is within a preset temperature range (e.g., 30°C-40°C), and the current distance detected by the distance sensor is less than or equal to the first preset distance, it is determined that there is a human body within the first preset distance of the terminal.

[0130] For another example, images may be collected through a camera, and face recognition and detection may be performed to determine whether a human body exists within a first preset distance of the terminal.

[0131] In this method, it is also necessary to detect whether there is a human body within a first preset distance of the terminal. When it is determined that there is a human body, it means that the terminal is being used by the user. In this case, if it is determined that the camera motor has an abnormal sound, the camera motor will be started to make it stationary relative to the terminal, so as to improve the accuracy of control, reduce energy consumption, and enhance the user experience.

[0132] In an exemplary embodiment, a method for processing abnormal sound is provided, which is applied to a terminal. The method further includes:

[0133] S510, obtaining the current light intensity of the environment in which the terminal is located;

[0134] S520, determining whether the current light intensity is greater than or equal to a preset light intensity;

[0135] S530: If it is determined that the current light intensity is greater than or equal to the preset light intensity, start the camera motor.

[0136] When the terminal is in a black box environment such as a package or backpack, the abnormal sound of the camera motor will not affect the user. When the terminal is in a package, the light intensity of the environment is weak. Therefore, it is also possible to determine whether the camera motor needs to be started based on the light intensity of the environment where the terminal is located.

[0137] In this method, the current light intensity can be detected by a light sensor. The preset light intensity is similar to the preset acceleration setting method, which can be preset in advance before the terminal leaves the factory, or can be set and modified by the user.

[0138] Example,

[0139] The terminal may also be provided with a light sensor. When it is determined that the camera motor of the terminal makes an abnormal sound, the processor of the terminal controls the light sensor to detect the current light intensity. After the light sensor detects the current light intensity, it transmits it to the processor, and the processor obtains the current light intensity.

[0140] After the processor obtains the current light intensity, it compares it with the preset light intensity, which can be 50 Lux. If the current light intensity is less than 50 Lux, it is considered that the terminal is in a black box environment such as a package, and there is no need to start the camera motor. If the current light intensity is greater than or equal to 50 Lux, it is considered that the terminal is not in a black box environment, and the camera motor can be started, so that the camera motor is in a stationary state relative to the terminal to eliminate abnormal noise.

[0141] In addition, in this method, it is also possible to directly determine whether there is an obstacle based on the current distance detected by the distance sensor. If the current distance is less than a third preset distance (eg, 50 cm), it is determined that there is an obstacle.

[0142] It should be noted that when the terminal is in a black box environment such as a package, pocket, or backpack, the distance between the terminal and the obstacle is generally small, so the detection of the current distance between the terminal and the obstacle can also be added. That is, the method can also include:

[0143] S610: Determine whether an obstacle is detected, and when it is determined that an obstacle is detected, obtain a current distance between the terminal and the obstacle;

[0144] S620, determining whether the current distance is greater than or equal to a second preset distance;

[0145] S630: If it is determined that the current distance is greater than or equal to the second preset distance, start the camera motor.

[0146] In this method, the camera can be used to detect whether there is an obstacle. If it is determined that there is an obstacle, the current distance between the terminal and the obstacle is detected. The current distance can be detected by the distance sensor. The preset second distance is similar to the setting method of the preset light intensity. It can be preset in advance before the terminal leaves the factory, or it can be set and modified by the user.

[0147] Example,

[0148] The terminal may also be provided with a distance sensor. When it is determined that the camera motor of the terminal makes an abnormal sound, the processor of the terminal controls the distance sensor to detect the current distance. After the distance sensor detects the current distance, it transmits it to the processor, and the processor obtains the current distance.

[0149] After the processor obtains the current distance, it compares it with the preset second distance, which can be 5 cm. If the current distance is less than 5 cm, it is considered that the terminal is in a black box environment such as a package, and there is no need to start the camera motor. If the current distance is greater than or equal to 5 cm, it is considered that the terminal is not in a black box environment, and the camera motor can be started to make the camera motor stationary relative to the terminal and eliminate abnormal noise.

[0150] In addition, a light sensor and a distance sensor may be provided in the terminal at the same time to accurately determine whether the terminal is in a black box environment.

[0151] Example,

[0152] The terminal may be a mobile phone, which is provided with a light sensor and a distance sensor. The preset light intensity may be 50 Lux, and the preset second distance may be set to 5 cm.

[0153] The processor of the mobile phone controls the light sensor to detect the current light intensity of the environment in which the mobile phone is located, and controls the distance sensor to detect the current distance between the mobile phone and the obstacle.

[0154] After receiving the current light intensity from the light sensor and the current distance from the distance sensor, the processor compares the current light intensity with the preset light intensity and the current distance with the preset second distance. If the current light intensity is greater than or equal to 50 Lux and the current distance is greater than or equal to 5 cm, it is determined that the mobile phone is not in a black box environment, that is, it is determined that the mobile phone is in a non-black box environment. Otherwise, it is determined to be in a black box environment.

[0155] In addition, in this example, it can also be set as follows: if the current light intensity is less than 50 Lux and the current distance is less than 5 cm, it is determined that the mobile phone is in a black box environment. Otherwise, it is determined that it is not in a black box environment.

[0156] It should be noted that other methods may also be used to determine whether the terminal is in a black box environment, which will not be described in detail here.

[0157] In this method, the camera motor is started only when it is determined that the camera motor makes an abnormal sound and the terminal is not in a black box environment, so that the camera motor is in a stationary state relative to the terminal, further improving the user experience.

[0158] It should be noted that when both a light sensor and a distance sensor are set in the terminal, the processor can control the two sensors to start at the same time; it can also control the light sensor to start first, and then control the distance sensor to start; or it can control the distance sensor to start first, and then control the light sensor to start. That is, steps S510-S530 and steps S610-S630 can be executed successively or simultaneously, and there is no limitation here.

[0159] In addition, during the abnormal sound processing, if the detection of the shaking state, the detection of the human body, and the detection of the black box environment are set at the same time, the above three detections can be performed simultaneously, sequentially, or cross-executed, without restriction. It can be understood that the order of the three detections, the detection of the human body, the detection of the black box environment, and the detection of the current sound information, is also not restricted. However, only when it is determined that the terminal is in a shaking state, the current sound information will be detected, the current sound information will be obtained, and then it will be determined whether the camera motor has an abnormal sound. Only when the camera motor has an abnormal sound, and there is a human body within the first preset distance of the terminal, and the terminal is not in a black box environment, will the camera motor be started to eliminate the abnormal sound generated by the camera motor.

[0160] In an exemplary embodiment, a method for processing abnormal sound is provided, which is applied to a terminal, and the terminal may be a mobile phone.

[0161] In this method, taking the motion parameter as acceleration as an example, the current acceleration of the terminal is detected in real time or periodically, and then the current acceleration is compared with the preset acceleration. If the current acceleration is less than the preset acceleration, it is determined that the terminal is not in a shaking state, and the processor no longer performs subsequent related actions. If the current acceleration is greater than or equal to the preset acceleration, it is determined that the terminal is in a shaking state.

[0162] After determining that the terminal is in a shaking state, the microphone of the terminal is controlled to collect the original sound information of the terminal (including the sound from inside the terminal and the sound from the environment in which the terminal is located), and then transmit it to the audio decoder. The audio decoder processes the above original sound information to generate current sound information, and then transmits it to the processor of the terminal, which obtains the current sound information.

[0163] After the processor obtains the current sound information, it processes it to obtain the current sound feature. Then the current sound feature is compared with the preset abnormal sound feature. If the similarity between the current sound feature and the preset abnormal sound feature does not reach the preset similarity (for example, 80%), it is determined that the camera motor has no abnormal sound, and the processor of the terminal no longer performs subsequent actions. If the similarity between the current sound feature and the preset abnormal sound feature reaches the preset similarity (for example, 80%), it is determined that the camera motor has an abnormal sound.

[0164] For example, taking the use of a SAR sensor to detect whether a human body exists within the first preset distance of the terminal as an example, after determining that the camera motor makes an abnormal sound, the SAR sensor of the control terminal starts working, and the SAR sensor transmits the detection result to the processor, and the processor determines whether a human body exists within the first preset distance of the terminal based on the above detection result. If it is determined that there is no human body within the first preset distance of the terminal, it is considered that the above shaking state is not caused by the user's shaking, and the processor of the terminal will no longer perform subsequent actions and will not control the power management chip to power on the camera motor. If it is determined that there is a human body within the first preset distance of the terminal, it is considered that the shaking state of the terminal is caused by the user's shaking, and the user may hear the abnormal sound of the camera motor.

[0165] Furthermore, in order to improve accuracy and reduce or avoid the possibility of starting the camera motor in a scene where the human ear cannot hear abnormal sounds, thereby increasing power consumption, after determining that the shaking state of the terminal is caused by the user's shaking, the light sensor and distance sensor of the terminal are controlled to work, and then based on the detection results of the light sensor and distance sensor, it is determined whether the terminal is in the user's pocket or backpack. If it is determined that the terminal is in a pocket or backpack, the processor of the terminal will no longer perform subsequent actions and will not control the power management chip to power on the camera motor. If it is determined that the terminal is not in a pocket or backpack, the power management chip is controlled to power on the camera motor, start the camera motor, and make the camera motor in a stationary state relative to the terminal.

[0166] This method can accurately determine whether the camera motor makes an abnormal sound due to the user shaking the terminal. When the above situation is determined to occur, the processor will send a command to the power management chip to power on the camera motor and start the camera motor. The camera motor will be in a focusing state, so that the camera motor will remain motionless when the terminal is shaken, avoiding the camera motor from continuously making abnormal sounds, significantly improving the user experience, and avoiding the impact on the market due to users' doubts about product quality.

[0167] In an exemplary embodiment, an abnormal sound processing device is provided, which is applied to a terminal. The device is used to implement the above-mentioned method for preventing abnormal sound. Figure 2 As shown, the device includes an acquisition module 101, a first determination module 102a, a second determination module 102b and a start module 103. In the process of implementing the above method:

[0168] A first determining module 102a, configured to determine whether the terminal is in a shaking state;

[0169] The acquisition module 101 is used to acquire current sound information when determining that the terminal is in a shaking state;

[0170] The second determination module 102b is used to identify the current sound information according to a preset abnormal sound feature, and determine whether the camera motor in the terminal has an abnormal sound, wherein the preset abnormal sound feature represents the sound feature of the abnormal sound of the camera motor;

[0171] The starting module 103 is used to start the camera motor after determining that the camera motor makes an abnormal sound.

[0172] In an exemplary embodiment, an abnormal sound processing device is provided, which is applied to a terminal. Figure 2 As shown, in the device, the second determining module 102b is specifically configured to:

[0173] determining current sound characteristics of current sound information;

[0174] Compare the current sound feature with the preset abnormal sound feature;

[0175] If the similarity between the current sound feature and the preset abnormal sound feature is greater than or equal to the preset similarity, it is determined that the camera motor has an abnormal sound.

[0176] In an exemplary embodiment, an abnormal sound processing device is provided, which is applied to a terminal. Figure 2 As shown, in the device, the first determining module 102a is specifically configured to:

[0177] Acquiring a motion parameter of the terminal, wherein the motion parameter at least represents a shaking intensity;

[0178] If it is determined that the motion parameter meets the preset shaking condition, it is determined that the terminal is in a shaking state.

[0179] In an exemplary embodiment, an abnormal sound processing device is provided, which is applied to a terminal. Figure 2 As shown, the device also includes:

[0180] The third determining module 102c is configured to determine whether a human body exists within a first preset distance of the terminal before starting the camera motor.

[0181] In an exemplary embodiment, an abnormal sound processing device is provided, which is applied to a terminal. Figure 2 As shown, the device also includes:

[0182] The fourth determining module 102d is used to obtain the current light intensity of the environment where the terminal is located before starting the camera motor; and

[0183] Determine whether the current light intensity is greater than or equal to the preset light intensity.

[0184] In an exemplary embodiment, an abnormal sound processing device is provided, which is applied to a terminal. Figure 2 As shown, the device also includes:

[0185] The fifth determination module 102e is used to determine whether an obstacle is detected before starting the camera motor, and when it is determined that an obstacle is detected, obtain the current distance between the terminal and the obstacle; and,

[0186] If it is determined that the current distance is greater than or equal to the second preset distance.

[0187] The present application also provides a terminal, which may be a mobile phone, a tablet computer, a laptop computer, a video camera, a camera, or other device with a camera motor.

[0188] In an exemplary embodiment, reference Figure 3 As shown, terminal 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .

[0189] The processing component 402 generally controls the overall operation of the terminal 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.

[0190] The memory 404 is configured to store various types of data to support operations at the terminal 400. Examples of such data include instructions for any application or method operating on the terminal 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk, or an optical disk.

[0191] Power component 406 provides power to various components of terminal 400. Power component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to terminal 400.

[0192] The multimedia component 408 includes a screen that provides an output interface between the terminal 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera module and / or a rear camera module. When the terminal 400 is in an operating mode, such as a shooting mode or a video mode, the front camera module and / or the rear camera module may receive external multimedia data. Each front camera module and the rear camera module may be a fixed optical lens system or have a focal length and optical zoom capability.

[0193] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the terminal 400 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.

[0194] I / O interface 412 provides an interface between processing component 402 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0195] The sensor assembly 414 includes one or more sensors for providing various aspects of status assessment for the terminal 400. For example, the sensor assembly 414 can detect the open / closed state of the terminal 400, the relative positioning of the components, such as the display and keypad of the terminal 400, and the sensor assembly 414 can also detect the position change of the terminal 400 or a component of the terminal 400, the presence or absence of contact between the user and the terminal 400, the orientation or acceleration / deceleration of the terminal 400, and the temperature change of the terminal 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0196] The communication component 416 is configured to facilitate wired or wireless communication between the terminal 400 and other devices. The device 700 can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0197] In an exemplary embodiment, terminal 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.

[0198] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by a processor 420 of a terminal 400 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a tape, a floppy disk, and an optical data storage device. When the instructions in the storage medium are executed by the processor of the terminal, the terminal is enabled to perform the method shown in the above embodiment.

[0199] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present invention are indicated by the claims.

[0200] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for processing abnormal sound, characterized in that: The method comprises: When a camera motor in the terminal is in an unused state, determining whether the terminal is in a shaking state; When determining that the terminal is in a shaking state, obtaining current sound information; According to a preset abnormal sound feature, the current sound information is identified to determine whether the camera motor has an abnormal sound, wherein the preset abnormal sound feature represents a sound feature of the abnormal sound of the camera motor; After determining that the camera motor makes an abnormal sound, the camera motor is started.

2. The method according to claim 1, characterized in that The determining whether the terminal is in a shaking state includes: Acquiring a motion parameter of the terminal, wherein the motion parameter at least represents a shaking intensity; If it is determined that the motion parameter meets a preset shaking condition, it is determined that the terminal is in a shaking state.

3. The method according to claim 1, characterized in that The identifying the current sound information according to the preset abnormal sound feature to determine whether the camera motor has an abnormal sound includes: Extracting current sound features of the current sound information; Comparing the current sound feature with the preset abnormal sound feature; If the similarity between the current sound feature and the preset abnormal sound feature is greater than or equal to the preset similarity, it is determined that the camera motor has an abnormal sound.

4. The method according to any one of claims 1 to 3, characterized in that: Before starting the camera motor, the method further includes: It is determined that a human body exists within a first preset distance of the terminal.

5. The method according to any one of claims 1 to 3, characterized in that: Before starting the camera motor, the method further includes: Obtaining the current light intensity of the environment in which the terminal is located; and, It is determined that the current light intensity is greater than or equal to a preset light intensity.

6. The method according to any one of claims 1 to 3, characterized in that: Before starting the camera motor, the method further includes: determining whether an obstacle is detected, and when it is determined that an obstacle is detected, obtaining a current distance between the terminal and the obstacle; and, If it is determined that the current distance is greater than or equal to the second preset distance.

7. An abnormal sound processing device, characterized in that: The device comprises: A first determination module, configured to determine whether the terminal is in a shaking state when a camera motor in the terminal is in an unused state; An acquisition module, used to acquire current sound information when determining that the terminal is in a shaking state; A second determination module is used to identify the current sound information according to a preset abnormal sound feature to determine whether the camera motor has an abnormal sound, wherein the preset abnormal sound feature represents a sound feature of the abnormal sound of the camera motor; A starting module is used to start the camera motor after determining that the camera motor makes an abnormal sound.

8. The device according to claim 7, characterized in that The first determining module is specifically configured to: Acquiring a motion parameter of the terminal, wherein the motion parameter at least represents a shaking intensity; If it is determined that the motion parameter meets a preset shaking condition, it is determined that the terminal is in a shaking state.

9. The device according to claim 7, characterized in that The second determining module is specifically used to: Determining a current sound feature of the current sound information; Comparing the current sound feature with the preset abnormal sound feature; If the similarity between the current sound feature and the preset abnormal sound feature is greater than or equal to the preset similarity, it is determined that the camera motor has an abnormal sound.

10. The device according to any one of claims 7 to 9, characterized in that: The device also includes: A third determining module is configured to determine whether a human body exists within a first preset distance of the terminal before starting the camera motor.

11. The device according to any one of claims 7 to 9, characterized in that: The device also includes: A fourth determination module is used to obtain the current light intensity of the environment where the terminal is located before starting the camera motor; and It is determined that the current light intensity is greater than or equal to a preset light intensity.

12. The device according to any one of claims 7 to 9, characterized in that: The device also includes: a fifth determination module, configured to determine whether an obstacle is detected before starting the camera motor, and to obtain a current distance between the terminal and the obstacle when an obstacle is detected; and If it is determined that the current distance is greater than or equal to the second preset distance.

13. A terminal, characterized in that: The terminal comprises: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the method according to any one of claims 1 to 6.

Images