Earphone control method and device, computer readable storage medium and earphone

Abstract

The invention belongs to the technical field of earphone control, and particularly relates to an earphone control method and device, a computer readable storage medium and an earphone. The method comprises the following steps: acquiring an audio signal played by an earphone; performing audio feature information extraction on the audio signal to obtain audio feature information of the audio signal; determining a smell release parameter corresponding to the audio feature information; and controlling the earphone to release the smell according to the smell release parameter. Through the application, the corresponding smell release parameter can be determined on the basis of playing the audio, and the earphone is controlled to release the smell according to the corresponding smell release parameter, so that the audio playing and the smell release of the earphone can be organically combined together, richer sensory stimulation is brought to a user, and the user experience is improved. Therefore, the user can more completely feel the scene and atmosphere created by the audio, and the immersive experience effect of the user is effectively improved.

Description

Technical Field

[0001] The present application belongs to the field of headphone control technology, and in particular, relates to a headphone control method, device, computer-readable storage medium, and headphone. Background Art

[0002] With the continuous advancement of technology, headphones have reached a high level of development in audio playback, and have achieved many results in improving sound quality and wearing comfort. However, for users, when using headphones to listen to audio content, they only receive information through hearing and cannot fully feel the scene and atmosphere created by the audio, and the immersive experience is poor. Summary of the invention

[0003] In view of this, the embodiments of the present application provide a headset control method, device, computer-readable storage medium and headset to solve the problem of poor immersive experience when using headsets in the prior art.

[0004] A first aspect of an embodiment of the present application provides an earphone control method, which may include:

[0005] Get the audio signal played by the earphone;

[0006] Extracting audio feature information from the audio signal to obtain audio feature information of the audio signal;

[0007] Determining an odor release parameter corresponding to the audio feature information;

[0008] The earphone is controlled to release the scent according to the scent release parameter.

[0009] In a specific implementation of the first aspect, determining the odor release parameter corresponding to the audio feature information may include:

[0010] Based on a preset odor mapping relationship, determining the odor release parameter corresponding to the audio feature information;

[0011] Among them, the odor mapping relationship is a mapping relationship between the audio feature information and the odor release parameter.

[0012] In a specific implementation of the first aspect, the odor release parameter may include an odor type; the odor mapping relationship may include an odor type mapping relationship;

[0013] The determining, based on a preset odor mapping relationship, the odor release parameter corresponding to the audio feature information may include:

[0014] Based on the odor type mapping relationship, determine the odor type corresponding to the audio feature information;

[0015] The smell type mapping relationship is a mapping relationship between the audio feature information and the smell type.

[0016] In a specific implementation of the first aspect, the odor release parameter may include odor release intensity; the odor mapping relationship may include odor release intensity mapping relationship;

[0017] The determining, based on a preset odor mapping relationship, the odor release parameter corresponding to the audio feature information may include:

[0018] Based on the odor release intensity mapping relationship, determining the odor release intensity corresponding to the audio feature information;

[0019] Among them, the odor release intensity mapping relationship is a mapping relationship between the audio feature information and the odor release intensity.

[0020] In a specific implementation of the first aspect, the odor release parameter may include an odor release frequency; the odor mapping relationship may include an odor release frequency mapping relationship;

[0021] The determining, based on a preset odor mapping relationship, the odor release parameter corresponding to the audio feature information may include:

[0022] Based on the odor release frequency mapping relationship, determining the odor release frequency corresponding to the audio feature information;

[0023] Among them, the odor release frequency mapping relationship is a mapping relationship between the audio feature information and the odor release frequency.

[0024] In a specific implementation of the first aspect, determining the odor release parameter corresponding to the audio feature information may include:

[0025] Inputting the audio feature information into a preset odor release parameter determination model, and obtaining the odor release parameter output by the odor release parameter determination model corresponding to the audio feature information;

[0026] Wherein, the odor release parameter determination model is a pre-trained artificial intelligence model for determining the odor release parameters.

[0027] In a specific implementation of the first aspect, the earphone may include a gas releaser;

[0028] The controlling the earphone to release the scent according to the scent release parameter may include:

[0029] Determining valve control parameters of the gas releaser according to the odor release parameters;

[0030] The valve of the gas releaser is controlled according to the valve control parameter to release the odor.

[0031] A second aspect of an embodiment of the present application provides an earphone control device, which may include:

[0032] An audio signal acquisition module, used to acquire the audio signal played by the earphone;

[0033] An audio feature information extraction module, used to extract audio feature information from the audio signal to obtain audio feature information of the audio signal;

[0034] An odor release parameter determination module, used to determine an odor release parameter corresponding to the audio feature information;

[0035] The odor release control module is used to control the earphone to release odor according to the odor release parameter.

[0036] In a specific implementation of the second aspect, the odor release parameter determination module can be specifically used to: determine the odor release parameter corresponding to the audio feature information based on a preset odor mapping relationship; wherein the odor mapping relationship is a mapping relationship between the audio feature information and the odor release parameter.

[0037] In a specific implementation of the second aspect, the odor release parameter may include an odor type; the odor mapping relationship may include an odor type mapping relationship;

[0038] The odor release parameter determination module can be specifically used to: determine the odor type corresponding to the audio feature information based on the odor type mapping relationship; wherein the odor type mapping relationship is a mapping relationship between the audio feature information and the odor type.

[0039] In a specific implementation of the second aspect, the odor release parameter may include odor release intensity; the odor mapping relationship may include odor release intensity mapping relationship;

[0040] The odor release parameter determination module can be specifically used to: determine the odor release intensity corresponding to the audio feature information based on the odor release intensity mapping relationship; wherein the odor release intensity mapping relationship is a mapping relationship between the audio feature information and the odor release intensity.

[0041] In a specific implementation of the second aspect, the odor release parameter may include an odor release frequency; the odor mapping relationship may include an odor release frequency mapping relationship;

[0042] The odor release parameter determination module can be specifically used to: determine the odor release frequency corresponding to the audio feature information based on the odor release frequency mapping relationship; wherein the odor release frequency mapping relationship is a mapping relationship between the audio feature information and the odor release frequency.

[0043] In a specific implementation of the second aspect, the odor release parameter determination module can be specifically used to: input the audio feature information into a preset odor release parameter determination model, and obtain the odor release parameters corresponding to the audio feature information output by the odor release parameter determination model; wherein the odor release parameter determination model is a pre-trained artificial intelligence model for determining the odor release parameters.

[0044] In a specific implementation of the second aspect, the earphone may include a gas releaser;

[0045] The odor release control module can be specifically used to: determine the valve control parameter of the gas releaser according to the odor release parameter; and control the valve of the gas releaser according to the valve control parameter to release the odor.

[0046] A third aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any one of the above-mentioned headphone control methods are implemented.

[0047] A fourth aspect of an embodiment of the present application provides a headset, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the above-mentioned headset control methods when executing the computer program.

[0048] A fifth aspect of the embodiments of the present application provides a computer program product. When the computer program product is run on a headset, the headset executes the steps of any one of the above-mentioned headset control methods.

[0049] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the embodiments of the present application obtain the audio signal played by the earphone; extract the audio feature information of the audio signal to obtain the audio feature information of the audio signal; determine the odor release parameter corresponding to the audio feature information; and control the earphone to release the odor according to the odor release parameter. Through the embodiments of the present application, the corresponding odor release parameter can be determined based on the audio playback, and the earphone can be controlled to release the odor accordingly, so that the audio playback of the earphone and the odor release can be organically combined, bringing the user richer sensory stimulation, allowing the user to more completely feel the scene and atmosphere created by the audio, and effectively improving the user's immersive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0051] Figure 1 This is a flow chart of an embodiment of a headset control method in an embodiment of the present application;

[0052] Figure 2 A schematic diagram of an earphone acquiring a played audio signal from an electronic device through a pre-established communication link;

[0053] Figure 3 Schematic diagram of the model for determining odor release parameters;

[0054] Figure 4 This is a structural diagram of an embodiment of an earphone control device in an embodiment of the present application;

[0055] Figure 5 This is a schematic block diagram of an earphone in an embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the embodiments described below are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0058] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0059] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0060] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0061] In addition, in the description of the present application, the terms "first", "second", "third", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0062] With the continuous advancement of technology, headphones have reached a high level of development in audio playback, and have achieved many results in improving sound quality and wearing comfort. However, for users, when using headphones to listen to audio content, they only receive information through hearing and cannot fully feel the scene and atmosphere created by the audio, and the immersive experience is poor.

[0063] In view of this, the embodiments of the present application provide a headset control method, device, computer-readable storage medium and headset to solve the problem of poor immersive experience when using headsets in the prior art.

[0064] In an embodiment of the present application, corresponding odor release parameters can be determined based on the audio playback, and the headphones can be controlled to release odor accordingly, so that the audio playback of the headphones and the odor release can be organically combined, bringing richer sensory stimulation to the user, allowing the user to more completely feel the scene and atmosphere created by the audio, effectively enhancing the user's immersive experience.

[0065] The execution subject of the embodiment of the present application may be headphones, which may include but are not limited to open headphones and other types of headphones.

[0066] See also Figure 1 , an embodiment of a headset control method in the embodiment of the present application may include:

[0067] Step S101: Acquire an audio signal played by headphones.

[0068] In a specific implementation of the embodiment of the present application, Figure 2 As shown, the earphone can obtain the played audio signal from the electronic device through a pre-established communication link.

[0069] The specific type of the electronic device can be flexibly set according to actual conditions, and may include but is not limited to smart phones, smart watches, desktop computers, notebooks, PDAs, servers or other electronic devices, which are not specifically limited in the embodiments of the present application.

[0070] The specific type of the communication link can be flexibly set according to actual conditions, and may include but is not limited to communication links established based on wireless local area networks (WLAN) (for example, wireless fidelity (WiFi)), Bluetooth, Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), infrared technology (IR), Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE) or other communication solutions, and the embodiments of the present application do not specifically limit this.

[0071] In another specific implementation of the embodiment of the present application, the earphone can directly obtain the played audio signal from its own storage medium.

[0072] Step S102: extract audio feature information from the audio signal to obtain audio feature information of the audio signal.

[0073] The specific audio feature information to be extracted can be flexibly set according to actual conditions, and may include but is not limited to root mean square energy, attack time, zero crossing rate, autocorrelation, spectral centroid, Mel-scale Frequency Cepstral Coefficients (MFCC), spectral flatness, spectral flux, fundamental frequency, detuning, loudness, sharpness or other audio feature information, which is not specifically limited in the embodiments of the present application.

[0074] Among them, root mean square energy refers to the energy mean of the signal within a certain time range; attack time refers to the duration of the note energy in the rising stage; zero crossing rate refers to the number of times the signal passes through the zero point per unit time; autocorrelation refers to the similarity between the signal and its displacement along time; spectral centroid refers to the energy concentration point in the signal spectrum, which describes the brightness of the signal timbre. The brighter the signal, the more concentrated the energy is in the high-frequency part and the larger the value of the spectral centroid; Mel-frequency cepstrum coefficient refers to the cepstrum parameter extracted in the Mel-scale frequency domain; spectral flatness refers to the similarity between the quantized signal and noise. The larger the value, the more likely the signal is noise; spectral flux refers to the degree of change between adjacent frames of the quantized signal; fundamental frequency refers to the frequency of the pitch; detuning refers to the degree of deviation between the signal overtone frequency and the integer multiple of the fundamental frequency; loudness refers to the signal strength subjectively felt by the human ear; sharpness refers to the proportion of high-frequency components in the audio signal spectrum. The greater the energy of the high-frequency components, the sharper the human ear feels.

[0075] In an embodiment of the present application, a multi-dimensional analysis of the input audio signal can be performed in real time based on a high-performance digital signal processing algorithm. The specific digital signal processing algorithms used can be flexibly set according to actual conditions, and the embodiment of the present application does not specifically limit this. For example, spectrum analysis techniques, such as Fast Fourier Transform (FFT), etc., can be used to perform spectrum decomposition on the audio signal to obtain information on different frequency components. For the low-frequency part (20 Hz-200 Hz), focus on its energy changes, because low-frequency signals are often related to some grand scenes (such as explosions, thunder, etc.); the harmonic structure and frequency changes of the intermediate frequency part (200 Hz-2000 Hz) can be used to identify the main sound elements (such as voice, instrument timbre, etc.); the high-frequency part (2000 Hz-20000 Hz) can reflect the details of the audio and the environmental sound effects (such as the rustling of leaves, the sound of raindrops, etc.). For example, the rhythm detection algorithm of the autocorrelation function can be used to identify the beat and rhythm pattern in the audio. After being processed by the digital signal processing algorithm, various audio feature information can be extracted. Through these audio feature information, the audio type (such as music, movie sound effects, audio books, etc.), emotional atmosphere (such as cheerfulness, sadness, tension, etc.), scene characteristics (such as natural scenes, battle scenes, romantic scenes, etc.) and other information of the audio signal can be represented.

[0076] Step S103: Determine the odor release parameters corresponding to the audio feature information.

[0077] Among them, the odor release parameters may include but are not limited to odor type, odor release intensity, odor release frequency or other parameters.

[0078] In a specific implementation of the embodiment of the present application, a mapping relationship between audio feature information and odor release parameters can be established in advance, which is recorded as an odor mapping relationship, as shown in the following table:

[0079] Audio feature information Odor release parameters Audio feature information A Odor release parameters 1 Audio feature information B Odor release parameters 2 Audio feature information C Odor release parameters 3 …… ……

[0080] For example, audio feature information A corresponds to odor release parameter 1, audio feature information B corresponds to odor release parameter 2, audio feature information C corresponds to odor release parameter 3, and so on.

[0081] After the audio feature information of the audio signal is extracted, the odor release parameter corresponding to the audio feature information can be determined based on the odor mapping relationship. For example, if the extracted audio feature information is audio feature information B, the odor release parameter corresponding thereto can be determined to be odor release parameter 2 based on the odor mapping relationship.

[0082] In the case where the odor release parameter includes the odor type, the odor mapping relationship may include an odor type mapping relationship, that is, a mapping relationship between audio feature information and odor type. After extracting the audio feature information of the audio signal, the odor type corresponding to the audio feature information may be determined based on the odor type mapping relationship.

[0083] In the case where the odor release parameter includes the odor release intensity, the odor mapping relationship may include the odor release intensity mapping relationship, that is, the mapping relationship between the audio feature information and the odor release intensity. After the audio feature information of the audio signal is extracted, the odor release intensity corresponding to the audio feature information may be determined based on the odor release intensity mapping relationship.

[0084] When the odor release parameter includes the odor release frequency, the odor mapping relationship may include the odor release frequency mapping relationship, that is, the mapping relationship between the audio feature information and the odor release frequency. After the audio feature information of the audio signal is extracted, the odor release frequency corresponding to the audio feature information may be determined based on the odor release frequency mapping relationship.

[0085] As an example, a smell database can be created in advance, in which various types of smell information can be stored. These smells are carefully formulated and classified to correspond to different audio features. For example, for natural scenes, there are forest smells (including mixed scents of pine, moss, wild flowers, etc.), grassland smells (mixed scents of grass and soil), ocean smells (mixed scents of sea salt, seaweed, and moist breath of sea breeze), etc.; for emotional atmosphere, cheerful scenes can correspond to fresh fruity scents (such as mixed scents of orange and lemon), sad scenes can be configured with a light incense smell, and tense scenes are equipped with gunpowder or pungent chemical smells; for specific audio types, such as classical music in music, corresponding elegant scents (such as rose and sandalwood mixtures) can be matched according to different periods and styles, and horror types in movie sound effects can use rancid and gloomy smell combinations. Each smell can have its own unique code and related parameter information in the database, such as smell release intensity (divided into multiple levels from weak to strong), smell release frequency (different release frequencies are set according to different scene requirements), etc.

[0086] When the sound of waves is detected in the audio and the spectral characteristics match the ocean scene, the ocean scent can be selected; when the description of the rose scent or the music melody with a romantic atmosphere appears in the audio, the rose scent can be selected. For the emotional atmosphere, the intensity of the scent release can be adjusted according to the intensity of the emotion. For example, in a strong and tense audio clip, a high-intensity scent related to the tense atmosphere is released; in a soothing and romantic plot, a lighter but lasting romantic scent is released. At the same time, considering the rhythm changes of the audio, the frequency of scent release can be adjusted according to the speed of the rhythm and the strength of the beat. In fast-paced music, the scent release can be in a short pulse, high-frequency mode; in slow-paced audio, the scent release is slower and more continuous.

[0087] In another specific implementation of the embodiment of the present application, Figure 3 As shown, the audio feature information can be input into a preset odor release parameter determination model, and the odor release parameter corresponding to the audio feature information output by the odor release parameter determination model can be obtained. The odor release parameter determination model is a pre-trained artificial intelligence model for determining odor release parameters.

[0088] Specifically, a training data set for training the odor release parameter determination model can be constructed, wherein the training data set can include a number of training samples, each of which includes audio feature information and corresponding odor release parameters. The initial artificial intelligence model is trained with the audio feature information of the training sample as input and the corresponding odor release parameter as the expected output, thereby obtaining a trained odor release parameter determination model.

[0089] During the training process, for each training sample, the audio feature information of the training sample can be processed using an artificial intelligence model to obtain the actual output of the training sample, and then a preset loss function can be used to calculate the training loss value based on the expected output and actual output in the training sample. In the embodiment of the present application, any loss function in the prior art can be selected according to the actual situation to calculate the training loss value, and the embodiment of the present application does not specifically limit this.

[0090] After the training loss value is calculated, the model parameters of the artificial intelligence model can be adjusted according to the training loss value. In the embodiment of the present application, it is assumed that in the initial state, the model parameter of the artificial intelligence model is W1, and the training loss value is back-propagated to modify the model parameter W1 of the artificial intelligence model to obtain the modified model parameter W2. After modifying the parameters, the next training process is continued. In this training process, the training loss value is recalculated, and the training loss value is back-propagated to modify the model parameter W2 of the artificial intelligence model to obtain the modified model parameter W3, ..., and so on, and the above process is repeated continuously. The model parameters can be modified in each training process until the preset training conditions are met, wherein the training condition can be that the number of trainings reaches a preset number threshold, and the number threshold can be set according to the actual situation, for example, it can be set to thousands, tens of thousands, hundreds of thousands or even larger values; the training condition can also be the convergence of the artificial intelligence model; since the number of trainings may not reach the number threshold, but the artificial intelligence model has converged, it may cause unnecessary work to be repeated; or the artificial intelligence model cannot converge, which may lead to an infinite loop and the training process cannot be ended. Based on the above two situations, the training condition can also be that the number of trainings reaches the number threshold or the artificial intelligence model converges. When the training conditions are met, a trained odor release parameter determination model can be obtained.

[0091] Through the above process, the audio feature information of the training samples and the corresponding odor release parameters are used as learning objects of the artificial intelligence model. After the training process, the artificial intelligence model can establish a mapping relationship between the audio feature information and the odor release parameters, so that when faced with new audio feature information, the corresponding odor release parameters can also be obtained according to the mapping relationship.

[0092] After completing the training of the odor release parameter determination model, the extracted audio feature information can be input into the odor release parameter determination model, and the odor release parameters corresponding to the audio feature information output by the odor release parameter determination model can be obtained.

[0093] Step S104: Control the earphone to release the scent according to the scent release parameter.

[0094] In a specific implementation of the embodiment of the present application, the earphone may include a plurality of miniature gas releasers, each of which is responsible for releasing one or several related odors.

[0095] During the process of gas release, the valve control parameter of the gas releaser can be determined according to the odor release parameter, and the valve of the gas releaser can be controlled according to the valve control parameter to release the odor. The valve control parameter may include the opening size of the valve, which is positively correlated with the odor release intensity, that is, the greater the odor release intensity, the larger the valve opening size, and vice versa, the smaller the odor release intensity, the smaller the valve opening size. As an example, the valve opening size can be precisely adjusted within the range of 0.1 mm to 0.5 mm.

[0096] Microfluidics technology can be used inside the odor releaser to precisely control the opening size of the tiny valve between the odor storage chamber and the release channel, so that the odor in the storage chamber evaporates at an appropriate speed, achieving precise control of odor release. The airflow guiding structure of the earphones uses the natural ventilation around the earphones to gently diffuse the odor to the user's olfactory area.

[0097] For ease of understanding, the above-mentioned headphone control process will be illustrated below with a specific application scenario. In this scenario, the user wears headphones and chooses to play a piece of classical music, such as Beethoven's "Moonlight Sonata". This piece of music has a soothing rhythm, delicate emotions, and a romantic and melancholy atmosphere. During the playback process, the headphones process the played audio signal. Through spectrum analysis, it is identified that the piano sound in the mid-low frequency band (about 100 Hz-500 Hz) is the main melody, the high frequency band (1000 Hz-5000 Hz) has a delicate sound effect produced by the resonance of the strings, and the song has a slow and regular rhythm with a beat of about 60 beats per minute. Based on these features, it can be judged that the audio type is classical music and the emotional atmosphere is romantic and slightly sad. According to the audio analysis results, a mixed smell of rose and sandalwood can be selected from the smell database. The smell release intensity is set to medium intensity to match the soothing and deep emotional atmosphere of "Moonlight Sonata". The smell release frequency is set to be slow and lasting, matching the rhythm of the song. At this time, the corresponding odor releaser can be activated, and the microfluidic valve opens to allow the odor in the storage chamber to evaporate at an appropriate speed. The airflow guiding structure uses the natural ventilation around the earphones to gently diffuse the odor to the user's olfactory area. When listening to "Moonlight Sonata", users can smell the elegant aroma of rose and sandalwood at the same time, which further enhances the perception of the romantic and sad atmosphere of the music, as if they are in the quiet moonlight and immersed in the emotional world created by the music.

[0098] In summary, the embodiment of the present application obtains the audio signal played by the earphone; extracts the audio feature information of the audio signal to obtain the audio feature information of the audio signal; determines the odor release parameters corresponding to the audio feature information; and controls the earphone to release the odor according to the odor release parameters. Through the embodiment of the present application, the corresponding odor release parameters can be determined based on the audio playback, and the earphone can be controlled to release the odor accordingly, so that the audio playback of the earphone and the odor release can be organically combined, bringing richer sensory stimulation to the user, allowing the user to more completely feel the scene and atmosphere created by the audio, effectively improving the user's immersive experience.

[0099] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0100] Corresponding to the earphone control method described in the above embodiment, Figure 4 A structural diagram of an embodiment of an earphone control device provided in an embodiment of the present application is shown.

[0101] In this embodiment, an earphone control device may include:

[0102] The audio signal acquisition module 401 is used to acquire the audio signal played by the earphone;

[0103] An audio feature information extraction module 402, configured to extract audio feature information from the audio signal to obtain audio feature information of the audio signal;

[0104] An odor release parameter determination module 403, used to determine an odor release parameter corresponding to the audio feature information;

[0105] The odor release control module 404 is used to control the earphone to release odor according to the odor release parameter.

[0106] In a specific implementation method of an embodiment of the present application, the odor release parameter determination module can be specifically used to: determine the odor release parameter corresponding to the audio feature information based on a preset odor mapping relationship; wherein the odor mapping relationship is a mapping relationship between the audio feature information and the odor release parameter.

[0107] In a specific implementation of the embodiment of the present application, the odor release parameter may include an odor type; the odor mapping relationship may include an odor type mapping relationship;

[0108] The odor release parameter determination module can be specifically used to: determine the odor type corresponding to the audio feature information based on the odor type mapping relationship; wherein the odor type mapping relationship is a mapping relationship between the audio feature information and the odor type.

[0109] In a specific implementation of the embodiment of the present application, the odor release parameter may include odor release intensity; the odor mapping relationship may include odor release intensity mapping relationship;

[0110] The odor release parameter determination module can be specifically used to: determine the odor release intensity corresponding to the audio feature information based on the odor release intensity mapping relationship; wherein the odor release intensity mapping relationship is a mapping relationship between the audio feature information and the odor release intensity.

[0111] In a specific implementation of the embodiment of the present application, the odor release parameter may include an odor release frequency; the odor mapping relationship may include an odor release frequency mapping relationship;

[0112] The odor release parameter determination module can be specifically used to: determine the odor release frequency corresponding to the audio feature information based on the odor release frequency mapping relationship; wherein the odor release frequency mapping relationship is a mapping relationship between the audio feature information and the odor release frequency.

[0113] In a specific implementation method of an embodiment of the present application, the odor release parameter determination module can be specifically used to: input the audio feature information into a preset odor release parameter determination model, and obtain the odor release parameters corresponding to the audio feature information output by the odor release parameter determination model; wherein the odor release parameter determination model is a pre-trained artificial intelligence model for determining the odor release parameters.

[0114] In a specific implementation of the embodiment of the present application, the earphone may include a gas releaser;

[0115] The odor release control module can be specifically used to: determine the valve control parameter of the gas releaser according to the odor release parameter; and control the valve of the gas releaser according to the valve control parameter to release the odor.

[0116] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0117] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0118] Figure 5 A schematic block diagram of an earphone provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0119] like Figure 5 As shown, the headset 5 of this embodiment includes: a processor 50, a memory 51, and a computer program 52 stored in the memory 51 and executable on the processor 50. When the processor 50 executes the computer program 52, the steps in the above-mentioned headset control method embodiments are implemented, for example Figure 1 Alternatively, when the processor 50 executes the computer program 52, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 4 Functions of modules 401 to 404 are shown.

[0120] Exemplarily, the computer program 52 may be divided into one or more modules / units, which are stored in the memory 51 and executed by the processor 50 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 52 in the headset 5.

[0121] Those skilled in the art will understand that Figure 5 It is only an example of the earphone 5 and does not constitute a limitation of the earphone 5. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the earphone 5 may also include input and output devices, network access devices, buses, etc.

[0122] The processor 50 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0123] The memory 51 may be an internal storage unit of the headset 5, such as a hard disk or memory of the headset 5. The memory 51 may also be an external storage device of the headset 5, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the headset 5. Further, the memory 51 may include both an internal storage unit of the headset 5 and an external storage device. The memory 51 is used to store the computer program and other programs and data required by the headset 5. The memory 51 may also be used to temporarily store data that has been output or is to be output.

[0124] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0125] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0126] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0127] In the embodiments provided in the present application, it should be understood that the disclosed devices / earphones and methods can be implemented in other ways. For example, the device / earphone embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0129] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0130] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media do not include electric carrier signals and telecommunication signals.

[0131] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for controlling a headset, characterized in that: include: Get the audio signal played by the earphone; Extracting audio feature information from the audio signal to obtain audio feature information of the audio signal; Determining an odor release parameter corresponding to the audio feature information; The earphone is controlled to release the scent according to the scent release parameter.

2. The headphone control method according to claim 1, characterized in that: The determining of the odor release parameter corresponding to the audio feature information includes: Based on a preset odor mapping relationship, determining the odor release parameter corresponding to the audio feature information; Among them, the odor mapping relationship is a mapping relationship between the audio feature information and the odor release parameter.

3. The earphone control method according to claim 2, characterized in that: The odor release parameter includes an odor type; the odor mapping relationship includes an odor type mapping relationship; The determining, based on a preset odor mapping relationship, the odor release parameter corresponding to the audio feature information includes: Based on the odor type mapping relationship, determine the odor type corresponding to the audio feature information; The smell type mapping relationship is a mapping relationship between the audio feature information and the smell type.

4. The earphone control method according to claim 1, characterized in that: The odor release parameter includes odor release intensity; the odor mapping relationship includes odor release intensity mapping relationship; The determining, based on a preset odor mapping relationship, the odor release parameter corresponding to the audio feature information includes: Based on the odor release intensity mapping relationship, determining the odor release intensity corresponding to the audio feature information; Among them, the odor release intensity mapping relationship is a mapping relationship between the audio feature information and the odor release intensity.

5. The earphone control method according to claim 1, characterized in that: The odor release parameter includes an odor release frequency; the odor mapping relationship includes an odor release frequency mapping relationship; The determining, based on a preset odor mapping relationship, the odor release parameter corresponding to the audio feature information includes: Based on the odor release frequency mapping relationship, determining the odor release frequency corresponding to the audio feature information; Among them, the odor release frequency mapping relationship is a mapping relationship between the audio feature information and the odor release frequency.

6. The earphone control method according to claim 1, characterized in that: The determining of the odor release parameter corresponding to the audio feature information includes: Inputting the audio feature information into a preset odor release parameter determination model, and obtaining the odor release parameter output by the odor release parameter determination model corresponding to the audio feature information; Wherein, the odor release parameter determination model is a pre-trained artificial intelligence model for determining the odor release parameters.

7. The earphone control method according to any one of claims 1 to 6, characterized in that: The earphone includes a gas release device; The controlling the earphone to release the scent according to the scent release parameter comprises: Determining valve control parameters of the gas releaser according to the odor release parameters; The valve of the gas releaser is controlled according to the valve control parameter to release the odor.

8. An earphone control device, characterized in that: include: An audio signal acquisition module, used to acquire the audio signal played by the earphone; An audio feature information extraction module, used to extract audio feature information from the audio signal to obtain audio feature information of the audio signal; An odor release parameter determination module, used to determine an odor release parameter corresponding to the audio feature information; The odor release control module is used to control the earphone to release odor according to the odor release parameter.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the earphone control method according to any one of claims 1 to 7 are implemented.

10. A headset comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the earphone control method according to any one of claims 1 to 7 are implemented.

Images