Intelligent control method and system for audio equipment

Abstract

The invention relates to the technical field of audio equipment control, in particular to an intelligent control method and system for audio equipment, and the method comprises the following steps: obtaining the internal temperature of an earphone earmuff, and controlling an air exhaust module to adjust the internal temperature of the earphone earmuff according to a preset temperature adjustment rule; the environment where the earphone is located is obtained, and the playing mode of the earphone is adjusted according to different environments; sound of a person or an object in the environment where the earphone is located is obtained, and a user of the earphone is prompted according to preset prompt information; and obtaining a distance between a person or an object in the environment where the earphone is located and an earphone user, and prompting the earphone user according to a preset distance range. By means of the intelligent control method, the earphone can achieve the functions of automatic adjustment of the temperature in the earmuff, environment self-adaption, sound recognition, distance perception and the like, and the wearing comfort and the use experience of a user are remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of audio device control, and particularly to an intelligent control method and system for an audio device. Background Art

[0002] With the popularization of audio devices, especially the widespread use of headphones, users' demand for the intelligence of headphones is increasing day by day. Traditional headphones mainly focus on sound quality and comfort, but there are obvious deficiencies in intelligent control.

[0003] Especially for over-ear headphones, for example, during long-term use, the temperature inside the ear cups will gradually rise, causing discomfort to the user; the playback mode of the headphones cannot be automatically adjusted in different environments, affecting the user experience; the headphones cannot recognize key sounds or keywords in the surrounding environment and cannot timely remind the user; the headphones also cannot sense the distance between people or objects in the surrounding environment and the user and cannot provide corresponding safety prompts. These problems seriously affect the intelligence level and user experience of the headphones, so it is necessary to improve them. Summary of the Invention

[0004] The purpose of the present invention is to provide an intelligent control method and system for an audio device in view of the deficiencies of the prior art. Through the above intelligent control method, the headphones can realize functions such as automatic adjustment of the temperature inside the ear cups, environment adaptability, sound recognition, and distance perception, significantly improving the wearing comfort and user experience of the user.

[0005] To achieve the above purpose, an intelligent control method for an audio device of the present invention includes the following steps:

[0006] Obtain the temperature inside the ear cups of the headphones, determine whether the temperature inside the ear cups is within the range of a preset temperature adjustment value, and control the air extraction module to adjust the temperature inside the ear cups of the headphones according to the adjustment rule of the preset temperature;

[0007] Obtain the environment where the headphones are located, and adjust the playback mode of the headphones according to different environments;

[0008] Obtain the sounds of people or objects in the environment where the headphones are located, determine whether there are preset keywords and sounds, and give a prompt to the user of the headphones according to the preset prompt information;

[0009] Obtain the distance between people or objects in the environment where the headphones are located and the user of the headphones, determine whether it is within the preset distance range, and give a prompt to the user of the headphones according to the preset distance range.

[0010] The present invention also provides an intelligent control system for an audio device. The intelligent control system for an audio device is applied to the intelligent control method for an audio device as described above. The intelligent control system for an audio device includes,

[0011] The temperature control module collects the internal temperature of the earcup through a temperature sensor, determines whether the temperature is within a preset range, and controls the air extraction module (1) to adjust the temperature according to preset rules, and controls the power and running time of the air extraction module (1);

[0012] The environment perception and playback mode adjustment module collects environmental information through a camera and a microphone array, identifies the environmental type, adjusts the playback mode according to the environmental type, and controls the earphone to play in the corresponding mode;

[0013] The keyword and sound detection module collects environmental sounds through a microphone array, uses speech recognition and sound detection algorithms to determine whether there are preset keywords or sounds, and gives a prompt to the user according to the preset prompt information;

[0014] The distance detection and prompt module collects the distance between people or objects in the environment where the earphone is located and the earphone user through an ultrasonic sensor, an infrared sensor or a camera, determines whether the distance is within a preset range, and gives a prompt to the user according to the preset distance range.

[0015] The beneficial effects of the present invention: The present invention monitors the temperature inside the earcup in real time through a temperature sensor. When the temperature exceeds the preset range, it controls the air extraction module to cool down, ensuring that the temperature inside the earcup is always within a comfortable range;

[0016] Identifies the environment where the earphone is located through an environmental sensor, and automatically adjusts the playback mode of the earphone according to the environmental type to meet the needs of the user in different environments;

[0017] Captures the sounds in the surrounding environment through a microphone array, uses speech recognition technology to determine whether there are preset keywords or sounds, and gives a prompt message to the user through the earphone to help the user obtain important information in a timely manner;

[0018] Realtime monitors the distance between surrounding people or objects and the user through devices such as a distance sensor or a camera. When the distance exceeds or is lower than the preset range, a prompt is given to the user through the earphone to enhance the user's sense of security;

[0019] Through the above intelligent control method, the earphone can realize functions such as automatic adjustment of the temperature inside the earcup, environment adaptability, sound recognition and distance perception, significantly improving the user's wearing comfort and usage experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a schematic structural diagram of the present invention.

[0021] Figure 2 It is a schematic cross-sectional structure diagram of the earcup of the present invention.

[0022] Figure 3 This is a schematic structural diagram of the heat exchange channel of the present invention.

[0023] Figure 4 This is a schematic top view structural diagram of the present invention.

[0024] The reference signs include:

[0025] 1. Air extraction module; 11. Radiator; 13. Heat dissipation and heat conduction member; 131. Installation part; 14. Air extraction pump; 15. Heat exchange channel; 151. First sound absorption cavity; 152. Second sound absorption cavity; 1521. Gas blocking column; 153. Heat exchange cavity; 1531. Heat exchange and heat conduction fin; 154. Active sound insulation cavity; 155. First sound pickup microphone; 156. Active noise reduction speaker; 2. Sound absorption material; 21. Ventilation channel; 22. First channel; 23. Second channel; 24. Sealing ring; 25. Limit block; 251. Sliding groove; 252. Limit groove; 26. Lock block; 3. Micro camera. Detailed implementation manners

[0026] The present invention will be described in detail below with reference to the accompanying drawings.

[0027] As Figures 1 to 4 shown, an intelligent control method for an audio device of the present invention includes the following steps:

[0028] Obtain the temperature inside the earcup of the headset, determine whether the temperature inside the earcup is within the range of a preset temperature adjustment value, and control the air extraction module 1 to adjust the temperature inside the earcup of the headset according to the adjustment rule of the preset temperature;

[0029] Obtain the environment where the headset is located, and adjust the playback mode of the headset according to different environments;

[0030] Obtain the sound of people or objects in the environment where the headset is located, determine whether there are preset keywords and sounds, and give a prompt to the user of the headset according to the preset prompt information;

[0031] Obtain the distance between people or objects in the environment where the headset is located and the user of the headset, determine whether it is within the preset distance range, and give a prompt to the user of the headset according to the preset distance range.

[0032] Automatic temperature adjustment is realized. By obtaining the temperature inside the earcup of the headset and controlling the air extraction module 1 according to the preset temperature adjustment rule, the temperature inside the earcup can be effectively adjusted, avoiding discomfort of the user due to long-term use of the headset and improving the wearing comfort.

[0033] Environment adaptive playback mode is realized. By obtaining the environment where the headset is located, the playback mode of the headset is automatically adjusted to ensure that the user can obtain the best sound effect experience in different environments and improve the user's satisfaction.

[0034] Keyword and voice recognition are implemented. By obtaining the sounds of people or objects in the environment where the earphones are located, it is determined whether there are preset keywords and sounds, and the user is prompted according to the preset prompt information to help the user obtain important information in a timely manner and improve the intelligence level of the earphones.

[0035] Distance perception and prompting are implemented. By obtaining the distance between people or objects in the environment where the earphones are located and the user, it is determined whether it is within the preset distance range, and the user is prompted according to the preset distance range to enhance the user's sense of security and usage experience.

[0036] During use, the temperature inside the earcup is monitored in real time through a temperature sensor. When the temperature exceeds the preset range, the air extraction module 1 is controlled to cool down to ensure that the temperature inside the earcup is always within a comfortable range.

[0037] The environment where the earphones are located is identified through an environment sensor (such as indoor, outdoor, noisy environment, etc.), and the playback mode of the earphones (such as noise reduction mode, transparency mode, etc.) is automatically adjusted according to the environment type to meet the needs of the user in different environments.

[0038] The sounds in the surrounding environment are captured through a microphone array, and voice recognition technology is used to determine whether there are preset keywords or sounds, and a prompt message is sent to the user through the earphones to help the user obtain important information in a timely manner.

[0039] The distance between the surrounding people or objects and the user is monitored in real time through devices such as a distance sensor or a camera. When the distance exceeds or is lower than the preset range, a prompt is sent to the user through the earphones to enhance the user's sense of security.

[0040] Through the above intelligent control method, the earphones can realize functions such as automatic temperature adjustment inside the earcup, environment adaption, sound recognition, and distance perception, significantly improving the user's wearing comfort and usage experience.

[0041] As Figure 2 shown, the range of the preset temperature adjustment value in this embodiment is ≥25°C. The air extraction module 1 includes a radiator 11, a heat dissipation and heat conduction member 13, and an air extraction pump 14. A heat exchange channel 15 is provided inside the heat dissipation and heat conduction member 13. The radiator 11 is used to cool down the heat dissipation and heat conduction member 13 so that the temperature of the heat exchange channel 15 decreases. The air extraction pump 14 is connected to the inside of the earcup to extract the air inside the earcup, so that the external air enters the inside of the earcup through the heat exchange channel 15;

[0042] The adjustment rule of the preset temperature is:

[0043] When the temperature outside the earphone is 25°C - 30°C, control the air extraction pump 14 to extract air from the inside of the earphone earcup, so that the outside air enters the inside of the earphone earcup through the heat exchange channel 15 of the heat dissipation and heat conduction member 13;

[0044] When the temperature outside the earphone is 30°C, control the radiator 11 and the air extraction pump 14 to work simultaneously. The radiator 11 cools down the heat dissipation and heat conduction member 13, so that the outside air exchanges heat with the heat dissipation and heat conduction member 13 and then enters the inside of the earphone earcup through the heat exchange channel 15.

[0045] Automatic temperature adjustment is realized, improving the wearing comfort. By real-time monitoring the temperature inside the earphone earcup and dynamically adjusting the working states of the air extraction module 1 and the radiator 11 according to the external environmental temperature, the temperature inside the earcup can be effectively reduced, avoiding the user feeling stuffy and uncomfortable due to long-term wearing of the earphone, and significantly improving the wearing comfort.

[0046] Energy conservation and environmental protection are realized, and energy consumption is optimized. According to different external environmental temperatures, the working modes of the air extraction pump 14 and the radiator 11 are intelligently controlled to work alone or cooperatively, avoiding unnecessary energy consumption and achieving the effect of energy conservation and environmental protection.

[0047] Air circulation is realized, improving the ear environment. By using the air extraction pump 14 to extract the air inside the earcup and introducing the outside air that has exchanged heat, the air circulation inside the earcup can be improved, reducing the accumulation of moisture and odor, and further enhancing the user's wearing experience.

[0048] Among them, the heat dissipation and heat conduction member 13 is usually made of aluminum alloy or thermally conductive plastic, because these materials have the advantages of lightweight and low cost while meeting the heat conduction requirements. If higher thermal conductivity is required, copper or graphite materials may be used, but the cost and weight need to be weighed.

[0049] The radiator is a fan or a liquid cooling system. In this embodiment, the radiator is taken as an example of a fan. The fan is used to force air flow and improve the heat dissipation efficiency.

[0050] As Figure 2 shown, an installation part 131 is arranged outside the heat dissipation and heat conduction member 13 of this embodiment, and the radiator 11 is fixed to the installation part 131;

[0051] As Figure 3 shown, a first sound absorption cavity 151, a second sound absorption cavity 152, a heat exchange cavity 153 and an active noise cancellation cavity 154 are arranged inside the heat exchange channel 15.

[0052] The inner wall of the first sound absorption cavity 151 is set to be rough to absorb the noise generated by the airflow vibration. By frictional and absorption of the noise generated by the airflow vibration, high-frequency noise is reduced.

[0053] A plurality of air baffle columns 1521 for dispersing air flow are arranged inside the second sound absorption cavity 152. By arranging a plurality of air baffle columns 1521 inside, the air flow is dispersed and the air flow speed is reduced, thereby reducing turbulent noise.

[0054] A plurality of heat exchange heat conducting sheets 1531 are arranged inside the heat exchange cavity 153. External air enters the inside of the headphone earcup through the heat exchange channel 15, and the heat exchange heat conducting sheets 1531 inside the heat exchange cavity 153 exchange heat with the air to reduce the air temperature.

[0055] A first sound collecting microphone 155 and an active noise reduction speaker 156 are arranged inside the active noise cancellation cavity 154. The noise inside the active noise cancellation cavity 154 is acquired through the first sound collecting microphone 155, and the active noise reduction speaker 156 is controlled according to the noise inside the active noise cancellation cavity 154 to generate a reverse sound wave to cancel the noise. The noise is cancelled through sound wave interference to achieve the active noise reduction effect.

[0056] The outlet of the heat exchange channel 15 is arranged at the part corresponding to the back of the user's ear inside the headphone earcup.

[0057] The external air is introduced through the heat exchange channel 15 to dissipate heat from the skin around the back of the ear and adjust the temperature inside the headphone earcup. The cold air acts directly on the skin of the back of the ear to achieve efficient heat dissipation.

[0058] Efficient heat dissipation and temperature adjustment are achieved. The external air is introduced into the inside of the headphone earcup through the heat exchange channel 15 to directly dissipate heat from the skin around the back of the user's ear, effectively reducing the temperature inside the earcup and improving the wearing comfort. The heat exchange heat conducting sheets 1531 inside the heat exchange cavity 153 further enhance the heat exchange efficiency between the air and the heat dissipation heat conducting member 13 to ensure the heat dissipation effect.

[0059] Noise control and noise reduction are achieved. First is passive noise reduction. Specifically, the noise generated by the vibration of the air flow is absorbed by the rough inner wall of the first sound absorption cavity 151, and the air baffle columns 1521 inside the second sound absorption cavity 152 disperse the air flow to reduce the air flow noise. Then is active noise reduction. Through the first sound collecting microphone 155 and the active noise reduction speaker 156 inside the active noise cancellation cavity 154, the noise is detected and a reverse sound wave is generated in real time to cancel the noise, further enhancing the user's auditory experience.

[0060] Air flow optimization and comfort are achieved. The design of the heat exchange channel 15 not only realizes the heat dissipation function, but also optimizes the air flow through the sound absorption cavity and the air baffle columns 1521, reducing the air flow noise and discomfort. The outlet of the heat exchange channel 15 is located at the back of the ear part, directly dissipating heat from the skin of the back of the ear, avoiding the stuffy feeling caused by too high temperature inside the earcup.

[0061] It realizes multi-functional integration and intelligence, integrating functions such as heat dissipation, noise reduction, and airflow optimization, and achieving intelligent control of the headphones. Through active noise reduction technology, it can adjust the noise reduction effect in real time according to environmental noise, enhancing the user experience.

[0062] As Figure 2 shown, at the inner edge of the earcup of the headphones in this embodiment, there is a sound-absorbing material 2 for sealing the earcup. The sound-absorbing material 2 is provided with a ventilation channel 21. The air extraction pump 14 is arranged outside the ventilation channel 21. (Preferably, the outer shell of the air extraction pump 14 is provided with a buffer structure. The air extraction pump 14 is fixed to the earcup through the buffer structure and connected to the ventilation channel 21 to adjust the temperature inside the earcup. The buffer structure of the air extraction pump 14 reduces vibration transmission and further improves wearing comfort.

[0063] A sound-insulating and breathable membrane is arranged between the ventilation channel 21 and the air extraction pump 14 to reduce external noise from entering the inside of the ventilation channel 21, enhancing the noise reduction effect. It further blocks the noise during the operation of the air extraction pump 14 to ensure that users enjoy a pure music experience.)

[0064] Among them, the sound-absorbing material 2 can be porous foam material, micro-perforated material or aerogel material.

[0065] As Figure 2 shown, specifically, the ventilation channel 21 includes a first channel 22 provided in the outer shell of the headphones and a second channel 23 provided at one end of the sound-absorbing material 2. The first channel 22 and the second channel 23 are slidably connected. The air extraction pump 14 is arranged on the outer shell of the headphones and connected to the first channel 22. When the air extraction pump 14 works, the air inside the earcup of the headphones enters the second channel 23 and the first channel 22 through the ventilation channel 21 and is discharged out through the air extraction pump 14. By pulling the sound-absorbing material 2, the second channel 23 can slide along the first channel 22, increasing the internal space of the earcup of the headphones, facilitating the user to adjust the distance between the ear and the headphone speaker. It adapts to different ear shapes and personal preferences of users. By adjusting the distance between the ear and the speaker, the user can optimize the sound propagation effect and enhance the sound quality experience.

[0066] Both the first channel 22 and the second channel 23 are provided with sealing rings 24 to increase the sliding tightness between the first channel 22 and the second channel 23, prevent air leakage, and ensure the airflow efficiency of the ventilation channel. The sealing ring 24 not only improves the tightness but also provides a certain damping effect during the sliding process, making the pulling of the sound-absorbing material smoother and avoiding loosening or shaking during the sliding process. At the same time, it can also reduce the conduction of external noise into the inside of the earcup of the headphones and affect the sound listening effect. And the sealing ring 24 plays a role in limiting the first channel 22 and the second channel 23 to keep the first channel 22 and the second channel 23 connected.

[0067] As shown Figure 4 in the figure, a plurality of limiting blocks 25 are arranged in the first channel 22. A sliding groove 251 is formed between the longitudinal limiting blocks 25, and a limiting groove 252 is formed between the transverse limiting blocks 25. A locking block 26 is arranged on the outer wall of the second channel 23. Pulling the sound-absorbing material 2 to slide the locking block 26 along the sliding groove 251 can adjust the axial position between the first channel 22 and the second channel 23. Rotating the sound-absorbing material 2 to make the locking block 26 of the second channel 23 engage with the limiting groove 252 can lock the positions between the first channel 22 and the second channel 23, confirm the stable connection relationship between the first channel 22 and the second channel 23, and facilitate the user to lock the connection state of the first channel 22 and the second channel 23.

[0068] Dynamically control the working power of the air pump 14 by dividing the spectrum of the song played by the earphone into four parts: prelude, verse, chorus, bridge and coda;

[0069] The formula for judging the song part is:

[0070] where E(t) is the energy at time t; fc(t) is the spectral centroid frequency at time t; B(t) is the spectral bandwidth at time t; R(t) is the beat intensity at time t;

[0071] E max 、f max 、B max 、R max are respectively the maximum values of the energy, centroid frequency, bandwidth and beat intensity of the spectrum;

[0072] α, β, γ, δ are weight coefficients, and α + β + γ + δ = 1;

[0073] If S(t) < T intro , it is judged as the prelude;

[0074] If T intro ≤ S(t) < T verse , it is judged as the verse;

[0075] If T verse ≤ S(t) < T chorus , it is judged as the chorus;

[0076] If T chorus ≤ S(t) < T bridge , it is judged as the bridge;

[0077] If S(t) ≥ T bridge , it is judged as the coda;

[0078] T intro 、T verse 、Tchorus , T bridge and T are both status judgment thresholds. Specifically, T intro = 0.3, T verse = 0.5,

[0079] T chorus = 0.7, T bridge = 0.9;

[0080] P min and P max are the minimum and maximum powers of the air extraction pump 14 respectively. The intro, bridge, and coda use the minimum power P min , and the verses and choruses use the higher power P max ;

[0081] The formula for the power P(t) is:

[0082]

[0083] Dynamic heat dissipation and energy-saving optimization are achieved. By dividing the spectrum of the song into four parts: intro, verse, chorus, bridge, and coda, the working power of the air extraction pump 14 is dynamically adjusted to achieve intelligent heat dissipation control. In the low-energy parts (such as the intro, bridge, and coda), the air extraction pump 14 works at the minimum power, and in the high-energy parts (such as the verses and choruses), the air extraction pump 14 works at a higher power, which not only ensures the heat dissipation effect but also reduces energy consumption. At the same time, the noise generated by the operation of the air extraction pump 14 during song playback is also reduced.

[0084] Noise reduction and sound insulation effects are achieved. The design of the sound-absorbing material 2 and the sound-insulating and breathable membrane effectively reduces the entry of external noise into the earphone, improving the noise reduction effect. The sound-insulating and breathable membrane between the air passage 21 and the air extraction pump 14 further blocks the noise generated during the operation of the air extraction pump 14, ensuring that users enjoy a pure music experience.

[0085] Improved wearing comfort is achieved. The sound-absorbing material 2 not only seals the earcup but also enables air circulation through the air passage 21, avoiding stuffiness and dampness inside the earcup.

[0086] Intelligent music perception and control are achieved. By analyzing the spectrum in real time, different parts of the song, namely the intro, verse, chorus, bridge, and coda, are judged, and the power of the air extraction pump 14 is dynamically adjusted according to the energy, spectral centroid frequency, bandwidth, and beat intensity of the music, realizing intelligent control.

[0087] The formula for calculating the energy E(t) of the spectral signal of this embodiment at time t is:

[0088]

[0089] where x i(t) is the i-th sampling point of the spectral signal at time t, and N is the number of sampling points within the window; the audio signal undergoes short-time Fourier transform (STFT) to obtain the spectrum S(f, t), which is used to calculate the center frequency f of the audio c (t), and the formula for calculating the center frequency f c (t) is:

[0090]

[0091] The formula for calculating the bandwidth B(t) of the spectrum is:

[0092]

[0093] The formula for calculating the beat intensity R(t) of the spectral signal is:

[0094] R(t) = beat detection algorithm (x(t)). (Specifically, an energy-based or spectrum-based beat detection algorithm can be used.)

[0095] Through the calculation of the energy, center frequency, bandwidth, and beat intensity of the spectral signal, accurate analysis and intelligent control of the audio signal are achieved. The intelligent level and user experience of audio devices are improved, and at the same time, efficient energy consumption management and multi-functional integration are realized.

[0096] Assume: α = 0.4, β = 0.3, γ = 0.2, δ = 0.1;

[0097] E max = 100, f max = 5000Hz, B max = 2000Hz,, R max = 10;

[0098] T intro = 0.3, T verse = 0.5, T chorus = 0.7, T bridge = 0.9;

[0099] P min = 1W, P max = 5W.

[0100] For example,

[0101] E(t) = 20, f c (t) = 1000Hz, B(t) = 500Hz, R(t) = 2.

[0102] Substitute into the formula to calculate S(t) = 0.21;

[0103] Judge: S(t) < 0.3, belonging to the prelude.

[0104] Power of the vacuum pump (14): P(t)=1W.

[0105] For example,

[0106] E(t)=50,f c (t)=2000Hz, B(t)=1000Hz, R(t)=5.

[0107] Substituting into the formula to calculate S(t) = 0.47;

[0108] Judgment: 0.3≤S(t)<0.5, it belongs to the main song.

[0109] Power of the vacuum pump (14): P(t)=5W.

[0110] In this embodiment, the micro camera 3 is used to obtain an image of the environment in which the headset is located, and the type of environment is analyzed by image recognition technology to adjust the playback mode of the headset. The playback modes of the headset specifically include:

[0111] Office environment,

[0112] The camera can identify the features of desks, computers, and conference rooms, and control the headphones to turn on high-fidelity mode to provide a better sound quality experience.

[0113] At the same time, the microphone array is used to detect whether there are keyboard tapping sounds or conversation sound characteristics. If one of the above characteristics is met, the active noise reduction speaker 156 is controlled to turn on mild noise reduction to save power.

[0114] Street environment,

[0115] The camera is used to identify the characteristics of pedestrians, vehicles, and traffic lights to meet one of the above characteristics. At the same time, the microphone array is used to collect the ambient sound of the user's environment, and the ambient sound is split into distant ambient sound and surrounding ambient sound. Specifically, the distant ambient sound and surrounding ambient sound are separated through sound source positioning and beamforming technology.

[0116] The distant ambient sound is focused on the distant sound source (such as traffic noise) through beamforming technology, and the low-frequency noise is extracted using filtering algorithms (such as low-pass filtering).

[0117] The ambient sound around you is focused on nearby sound sources (such as pedestrian footsteps and vehicle horns) through beamforming technology, and mid- and high-frequency sounds are extracted using filtering algorithms (such as bandpass filtering).

[0118] The active noise reduction speaker 156 is controlled to start strong noise reduction, filter out distant traffic noise, and play the surrounding ambient sound through the active noise reduction speaker 156 to ensure that the user is aware of the environment in which he is located.

[0119] Specifically, image recognition technology uses deep learning or computer vision algorithms to identify features in the environment (such as desks, computers, pedestrians, vehicles, etc.) and determine the type of environment (such as offices, streets).

[0120] It realizes intelligent environmental perception and playback mode adjustment. Through a micro camera and image recognition technology, it can identify the type of environment where the earphones are located in real time (such as offices, streets, etc.), and automatically adjust the playback mode according to environmental characteristics, enhancing the user experience.

[0121] In an office environment, the high-fidelity mode and mild noise reduction are enabled, providing high-quality sound while saving power.

[0122] In a street environment, strong noise reduction is enabled and the surrounding environmental sounds are played, ensuring that users can perceive the surrounding environment while filtering out distant noises, improving safety.

[0123] It realizes precise noise reduction and sound effect optimization. By detecting environmental sound characteristics (such as keyboard typing sounds, conversations, traffic noises, etc.) through a microphone array, precise noise reduction is achieved.

[0124] In an office environment, the mild noise reduction mode saves power; in a street environment, the strong noise reduction mode filters out distant traffic noises and plays the surrounding environmental sounds at the same time, ensuring user safety.

[0125] It realizes the balance between energy conservation and high efficiency. The noise reduction intensity is dynamically adjusted according to the environmental type and sound characteristics, avoiding unnecessary energy consumption and extending the battery life of the earphones. Mild noise reduction is adopted in a low-noise environment (such as an office), and strong noise reduction is adopted in a high-noise environment (such as a street) to achieve the balance between energy conservation and performance.

[0126] It realizes environmental perception and safety improvement; in a street environment, by playing the surrounding environmental sounds (such as pedestrian and vehicle sounds), it ensures that users can perceive the surrounding environment and avoid potential dangers caused by complete noise reduction. By combining image recognition and sound analysis, more comprehensive environmental perception capabilities are provided.

[0127] The specific method for obtaining the sounds of people or objects in the environment where the earphones are located in this embodiment, judging whether there are preset keywords and sounds, and giving prompts to the users of the earphones according to the preset prompt information includes:

[0128] Presetting keywords and preset sounds;

[0129] Collecting environmental sounds. The environmental sounds are collected through a microphone. Through beamforming technology, the sound source in a specific direction is focused, and blind source separation algorithms (such as ICA) or deep learning models are used to separate different sound sources;

[0130] Keyword and sound detection, detecting preset keywords through a speech recognition engine (such as Google Speech-to-Text, Microsoft Azure Speech Service); (Example keywords: the user's name, emergency prompt words (such as "be careful", "dangerous").) Sound detection, using a sound classification model (such as a convolutional neural network CNN) to detect preset sounds; (Example sounds: car horn, alarm sound, knocking sound.)

[0131] User prompt, voice prompt, playing a voice prompt (such as "Please note that a vehicle is approaching") through the earphone; vibration prompt, giving a prompt through the vibration motor of the earphone; visual prompt, if the earphone is connected to a smartphone, displaying a prompt message on the phone screen;)

[0132] Intelligent environmental perception and real-time prompt are realized. Through the microphone array and beamforming technology, environmental sounds can be accurately collected and different sound sources can be separated, realizing real-time detection of preset keywords and sounds. When a preset keyword or sound is detected, the user is notified in a timely manner through voice, vibration or visual prompts, improving the safety and convenience of the user.

[0133] Accurate sound separation and recognition are realized. Using blind source separation algorithms or deep learning models, different sound sources in the environment can be effectively separated, improving the accuracy of keyword and sound detection. Through the speech recognition engine and the sound classification model, preset keywords and sounds can be accurately recognized.

[0134] Multi-modal user prompts are realized, providing three ways of voice prompts, vibration prompts and visual prompts to ensure that users can receive prompt information in a timely manner in different scenarios. Voice prompts are played through the earphone, vibration prompts are realized through the built-in vibration motor of the earphone, and visual prompts are displayed through the connected smartphone screen, meeting the diverse needs of users.

[0135] Enhanced safety and convenience are realized. When an emergency prompt word or a dangerous sound is detected, the user is reminded in a timely manner to avoid potential dangers. When the user's name or an important sound is detected, the user is notified in a timely manner to improve convenience.

[0136] The specific method for obtaining the distance between a person or object in the environment where the earphone is located and the user of the earphone in this embodiment, judging whether it is within a preset distance range, and prompting the user of the earphone according to the preset distance range:

[0137] Distance detection, detecting the distance between a person or object in the environment where the earphone is located and the user of the earphone through a sensor; (Among them, the sensor can be an ultrasonic sensor, an infrared sensor, a millimeter wave radar or a camera with depth perception to realize the detection of the distance between a person or object in the environment where the earphone is located and the user of the earphone.)

[0138] Distance judgment: If the detected distance is less than the preset range, a prompt is triggered.

[0139] User prompt: Play a voice prompt through the earphone (such as "Please note that there is an obstacle ahead"); vibration prompt: Send a prompt through the vibration motor of the earphone; visual prompt: If the earphone is connected to a smart phone, prompt information can be displayed on the phone screen.

[0140] Enhanced safety and convenience are achieved. During walking, exercising, or daily use, users are timely reminded to pay attention to the surrounding environment to avoid collisions or dangers. It is applicable to blind people, the elderly, or user groups that need additional safety guarantees, improving the convenience and safety of use.

[0141] This application of this embodiment also provides an intelligent control system for an audio device. The intelligent control system for an audio device is applied to the intelligent control method of the audio device as described above. The intelligent control system for an audio device includes

[0142] Temperature control module: Collect the temperature inside the earcup through a temperature sensor, judge whether the temperature is within the preset range, and control the air extraction module 1 to adjust the temperature according to the preset rules, controlling the power and running time of the air extraction module 1. Specifically, as in the intelligent control method of an audio device above, obtain the temperature inside the earcup of the earphone, judge whether the temperature inside the earcup is within the range of the preset temperature adjustment value, and control the air extraction module 1 to adjust the temperature inside the earcup of the earphone according to the adjustment rules of the preset temperature.

[0143] Environment perception and playback mode adjustment module: Collect environmental information through a camera and a microphone array, identify the environmental type (such as an office or a street), adjust the playback mode (such as noise reduction, volume, sound quality) according to the environmental type, and control the earphone to play in the corresponding mode. Specifically, as in the intelligent control method of an audio device above, obtain the environment where the earphone is located and adjust the playback mode of the earphone according to different environments.

[0144] Keyword and sound detection module: Collect environmental sounds through a microphone array, use speech recognition and sound detection algorithms to judge whether there are preset keywords or sounds, and send prompts to the user according to the preset prompt information (such as voice prompts, vibration prompts). Specifically, as in the intelligent control method of an audio device above, obtain the sounds of people or objects in the environment where the earphone is located, judge whether there are preset keywords and sounds, and prompt the user of the earphone according to the preset prompt information.

[0145] The distance detection and prompting module collects the distance between people or objects in the environment where the earphone is located and the earphone user through an ultrasonic sensor, an infrared sensor or a camera, determines whether the distance is within a preset range, and issues a prompt (such as a voice prompt or a vibration prompt) to the user according to the preset distance range. Specifically, as in the intelligent control method of an audio device described above, the distance between people or objects in the environment where the earphone is located and the earphone user is obtained, it is determined whether it is within the preset distance range, and a prompt is given to the user of the earphone according to the preset distance range.

[0146] Function integration and intelligent control are realized. Functions such as temperature control, environment perception, keyword and sound detection, and distance detection are integrated into one to achieve the intelligent control of the earphone. Through the collaborative work of multiple modules, the intelligent level, user experience and safety of the earphone are significantly improved.

[0147] The above content is only a preferred embodiment of the present invention. For those of ordinary skill in the art, based on the idea of the present invention, there will be changes in the specific implementation manner and application scope. The content of this specification should not be construed as a limitation to the present invention.

Claims

1. An intelligent control method for an audio device, characterized in that: The steps include: Acquiring the temperature inside the earmuff of the headphone, determining whether the temperature inside the earmuff is within a range of a preset temperature adjustment value, and controlling the exhaust module (1) to adjust the temperature inside the earmuff of the headphone according to a preset temperature adjustment rule; Obtain the environment in which the earphone is located, and adjust the playback mode of the earphone according to different environments; Acquire the sound of people or objects in the environment where the headset is located, determine whether there are preset keywords and sounds, and prompt the user of the headset according to the preset prompt information; The distance between the person or object in the environment of the headset and the headset user is obtained, and whether it is within a preset distance range is determined, and a prompt is given to the headset user according to the preset distance range.

2. The intelligent control method of an audio device according to claim 1, characterized in that: The range of the preset temperature adjustment value is ≥25°C. The air extraction module (1) comprises a radiator (11), a heat dissipation conductive member (13) and an air extraction pump (14). A heat exchange channel (15) is arranged inside the heat dissipation conductive member (13). The radiator (11) is used to cool the heat dissipation conductive member (13) so as to reduce the temperature of the heat exchange channel (15). The air extraction pump (14) is connected to the inside of the earmuff and is used to extract air from the inside of the earmuff so as to allow external air to enter the inside of the earmuff through the heat exchange channel (15). The adjustment rules for the preset temperature are: When the temperature outside the earphone is 25°C-30°C, the air extraction pump (14) is controlled to extract air from the inside of the earmuff, so that the external air enters the earmuff through the heat exchange channel (15) of the heat dissipation and heat conduction member (13); When the temperature outside the earphone is 30° C., the radiator (11) and the air pump (14) are controlled to work simultaneously, and the radiator (11) cools the heat dissipation heat conductive component (13), so that the external air exchanges heat with the heat dissipation heat conductive component (13) and then enters the interior of the earmuff of the earphone through the heat exchange channel (15).

3. The intelligent control method of an audio device according to claim 2, characterized in that: The heat dissipation and heat conduction component (13) is provided with a mounting portion (131) on the outside, and the heat sink (11) is fixed to the mounting portion (131); The heat exchange channel (15) is provided with a first silencing chamber (151), a second silencing chamber (152), a heat exchange chamber (153) and an active silencing chamber (154); The inner wall of the first muffler chamber (151) is roughened to absorb noise generated by air flow vibration; A plurality of air blocking columns (1521) for breaking up the airflow are arranged inside the second muffler cavity (152); A plurality of heat-exchanging heat-conducting sheets (1531) are arranged inside the heat-exchanging cavity (153); The active sound-absorbing chamber (154) is provided with a first microphone (155) and an active noise reduction loudspeaker (156), the noise in the active sound-absorbing chamber (154) is acquired through the first microphone (155), and the active noise reduction loudspeaker (156) is controlled according to the noise in the active sound-absorbing chamber (154) to generate reverse sound waves to cancel out the noise; The outlet of the heat exchange channel (15) is arranged inside the earmuff of the headphone, corresponding to the back of the ear of the user. External air is introduced through the heat exchange channel (15) to dissipate heat from the skin around the back of the ear and to adjust the temperature inside the earmuff of the headphone.

4. The intelligent control method of an audio device according to claim 1, characterized in that: A sound absorbing material (2) for sealing the earmuff is arranged on the inner edge of the earmuff, the sound absorbing material (2) is provided with an air permeable channel (21), and the air pump (14) is arranged on the outside of the air permeable channel (21); The frequency spectrum of the song played by the earphone is divided into four parts: the prelude, the verse, the chorus, the bridge and the outro, and the working power of the air pump (14) is dynamically controlled; The formula for determining the song part is: Where, E(t) is the energy at time t; fc(t) is the frequency of the spectrum center of gravity at time t; B(t) is the spectrum bandwidth at time t; R(t) is the beat intensity at time t; E max 、f max , B max , R max They are the maximum values ​​of spectrum energy, center of gravity frequency, bandwidth, and beat intensity; α, β, γ, and δ are weight coefficients, α+β+γ+δ=1; If S(t) <T intro , then it is judged as a prelude; If T intro ≤S(t)<T verse , then judge it as the main song; If T verse ≤S(t) <T chorus , then it is judged as the chorus; If T chorus ≤S(t) <T bridge , then it is judged as a bridge segment; If S(t)≥T bridge , then it is judged as the coda; T intro 、T verse , T chorus , T bridge are all state judgment thresholds. Specifically, T intro =0.3, T verse =0.5, T chorus =0.7,T bridge =0.9; P min and P max are the lowest and highest powers of the air pump (14), respectively. The lowest power P is used for the prelude, bridge and coda. min , the verse and chorus use higher power P max ; The formula for power P(t) is:

5. The intelligent control method of an audio device according to claim 4, characterized in that: The energy of the spectrum signal at time t is E(t), and the calculation formula is: Among them, x i (t) is the i-th sampling point of the spectrum signal at time t, and N is the number of sampling points in the window; The audio signal is subjected to short-time Fourier transform (STFT) to obtain the spectrum S(f, t), which is used to calculate the center frequency f of the audio. c (t), center of gravity frequency f c The calculation formula of (t) is: The bandwidth B(t) of the spectrum is calculated as: The calculation formula of the beat intensity R(t) of the spectrum signal is: R(t) = beat detection algorithm (x(t)).

6. The intelligent control method of an audio device according to claim 1, characterized in that: The micro camera (3) is used to obtain an image of the environment in which the earphone is located, and the type of the environment is analyzed by image recognition technology to adjust the playing mode of the earphone. The playing mode of the earphone specifically includes: Office environment, The camera can identify the features of desks, computers, and conference rooms, and control the headphones to turn on high-fidelity mode to provide a better sound quality experience. At the same time, the microphone array is used to detect whether there are keyboard tapping sounds or conversation sound characteristics. If one of the above characteristics is met, the active noise reduction speaker (156) is controlled to turn on mild noise reduction to save power; Street environment, The camera recognizes the characteristics of pedestrians, vehicles, and traffic lights to meet one of the above characteristics. At the same time, the microphone array collects the ambient sound of the user's environment and splits the ambient sound into distant ambient sound and surrounding ambient sound. The active noise reduction speaker (156) is controlled to start strong noise reduction, filter distant traffic noise, and play the surrounding ambient sound through the active noise reduction speaker (156), so as to ensure that the user is aware of the environment in which he is located.

7. The intelligent control method of an audio device according to claim 1, characterized in that: The specific method of obtaining the sound of a person or object in the environment where the headset is located, determining whether there are preset keywords and sounds, and prompting the user of the headset according to the preset prompt information includes: Preset keywords and preset sounds; Ambient sound collection: collect ambient sound through microphones, focus on the sound source in a specific direction through beamforming technology, and separate different sound sources using blind source separation algorithms or deep learning models; Keyword and sound detection, detecting preset keywords through the voice recognition engine; Sound detection, using sound classification models to detect preset sounds; User prompts, voice prompts, voice prompts played through headphones.

8. The intelligent control method of an audio device according to claim 1, characterized in that: The specific method of obtaining the distance between the person or object in the environment of the headset and the headset user, determining whether it is within a preset distance range, and prompting the headset user according to the preset distance range: Distance detection, using sensors to detect the distance between the headset user and people or objects in the headset's environment; Distance judgment: if the detected distance is less than the preset range, a prompt will be triggered; User prompts, voice prompts played through headphones; Vibration reminder, which sends reminders through the vibration motor of the headset; Visual prompts: If the headset is connected to a smartphone, prompt information can be displayed on the phone screen.

9. An intelligent control system for audio equipment, characterized in that: The intelligent control system of the audio device is applied to the intelligent control method of the audio device as claimed in any one of claims 1 to 8, and the intelligent control system of the audio device includes: The temperature control module collects the internal temperature of the earmuff through a temperature sensor, determines whether the temperature is within a preset range, controls the air extraction module (1) to adjust the temperature according to preset rules, and controls the power and operating time of the air extraction module (1); The environment perception and playback mode adjustment module collects environment information through the camera and microphone array, identifies the environment type, adjusts the playback mode according to the environment type, and controls the headset to play in the corresponding mode; The keyword and sound detection module collects ambient sound through a microphone array, uses speech recognition and sound detection algorithms to determine whether there are preset keywords or sounds, and issues prompts to the user based on the preset prompt information; The distance detection and prompt module uses an ultrasonic sensor, infrared sensor or camera to collect the distance between the person or object in the environment of the headset and the headset user, determines whether the distance is within a preset range, and issues a prompt to the user based on the preset distance range.

Images