Sound effect adjustment method, electronic device and computer-readable storage medium

Abstract

The present application provides a sound effect adjustment method, an electronic device, and a computer-readable storage medium. In this method, the electronic device can obtain the user's motion parameters and physiological parameters collected by a motion health monitoring device, or the driving state parameters and / or driving environment parameters collected by a driving device. Furthermore, the electronic device can adjust the sound effect of the audio based on the above parameters, so that the adjusted sound effect is adapted to the user's mood and the environment where the user is located. In this way, the user can hear music that better meets their current physiological and psychological needs, thereby improving the user's music listening experience.

Description

Technical Field

[0001] This application relates to the field of terminals and communication technologies, and particularly to a sound effect adjustment method, an electronic device, and a computer-readable storage medium. Background Art

[0002] People usually play various kinds of music through electronic devices. Music can stimulate people's emotional responses and help people express or release emotions. When the external environment is different or a person's mood is different, the music that people want to hear is often different. How an electronic device provides music that is more suitable for the listening scenario for users is a problem that needs to be solved. Summary of the Invention

[0003] Embodiments of this application provide a sound effect adjustment method, an electronic device, and a computer-readable storage medium. In this method, an electronic device can obtain physiological parameters, motion parameters, or driving state parameters and driving environment parameters of a user collected by another electronic device. Furthermore, the electronic device can adjust the sound effect parameters of music based on the above parameters, so that the sound effect of the music better adapts to the physiological and psychological needs of the user in the current music listening scenario, and improves the user's music listening experience.

[0004] In a first aspect, embodiments of this application provide a sound effect adjustment method, which is applied to a first electronic device. The first electronic device establishes a communication connection with a second electronic device. The method includes: the first electronic device plays a first audio; the first electronic device obtains first data collected by the second electronic device, where the first data includes motion parameters and physiological parameters, or the first data includes driving state parameters and / or driving environment parameters; the first electronic device adjusts the sound effect parameters of the first audio based on the first data to obtain first sound effect parameters.

[0005] The first electronic device can receive the first data collected by the second electronic device. Among them, the first data can include motion parameters and physiological parameters, where the motion parameters and physiological parameters can reflect the physiological state and psychological state of the user. The first data can also include driving state parameters and / or driving environment parameters, which can reflect the user's own state and the surrounding environment when driving. The first electronic device can adjust the sound effect parameters based on the first data, that is, adapt the sound effect parameters of the first audio based on the user's own state or the surrounding environment state, so as to provide music that can better meet the user's needs in the current music listening environment for the user, thereby improving the user's music listening experience.

[0006] In combination with the first aspect, in some embodiments, the first sound effect parameters are obtained by the first electronic device processing the motion parameters and physiological parameters through a first neural network, and the first neural network is used to determine one or more sound effect parameters based on the motion parameters and physiological parameters.

[0007] In combination with the first aspect, in some embodiments, the second electronic device is a sports health monitoring device, and the first data includes sports parameters and physiological parameters.

[0008] That is to say, the sports parameters and physiological parameters in the first data can be measured by a sports health monitoring device such as a smart watch or a smart bracelet. After receiving the sports parameters and physiological parameters, the first electronic device can input the above parameters into the first neural network. The first neural network can receive the inputs of the sports parameters and physiological parameters and output multiple sound effect parameters. Among them, the first neural network can include one or more neural network models. That is to say, the first neural network can receive the inputs of all sports parameters and physiological parameters through a neural network model and then output the values of multiple sound effect parameters. Or, the first neural network can also receive the inputs of one or more sports parameters and one or more physiological parameters through multiple neural network models respectively and then output the values of the sound effect parameters. For example, the first neural network can include neural network model A, neural network model B, and neural network model C. Among them, neural network model A can receive the input of heart rate and output the value of audio loudness; neural network model B can receive the input of acceleration and output the value of playback speed. Neural network model C can receive the values of heart rate change rate and acceleration and output the frequency response gain of sound at different frequencies, etc.

[0009] It can be understood that the first electronic device can change the sound effect of the audio based on the sports parameters and physiological parameters collected by the sports health monitoring device. In this way, in the sports state, the first electronic device can provide diverse sound effects for the user based on the user's sports state, making the sound effect of the music adapt to the user's sports state and enhancing the user's sports experience and the music listening experience during exercise. Among them, the sports health monitoring device can be directly worn on the user's body, so that the first electronic device's acquisition of sports parameters and physiological parameters will not affect the user's movement.

[0010] In combination with the first aspect, in some embodiments, the first sound effect parameter is obtained by the first electronic device through processing the driving state parameters and / or driving environment parameters by a second neural network, and the second neural network is used to determine one or more sound effect parameters based on the driving state parameters and / or driving environment parameters.

[0011] In combination with the first aspect, in some embodiments, the second electronic device is a driving device, and the first data includes driving state parameters and / or driving environment parameters.

[0012] That is to say, the driving state parameters and driving environment parameters in the first data can be determined by the driving device. Among them, the driving device can report the driving state parameters and / or driving environment parameters to the first electronic device, and then the first electronic device can adjust the sound effect parameters based on the driving state parameters and / or driving environment parameters. Among them, the second neural network can also include one or more neural network models. The second neural network can receive the input of multiple driving state parameters and / or driving environment parameters, and then output multiple sound effect parameters. This can be completed by the first electronic device through a neural network model in the second neural network, or can be jointly obtained through multiple neural network models in the second neural network. This application embodiment does not limit this.

[0013] It can be understood that the first electronic device can modify the sound effect parameters of the music based on the driving state of the user during driving and the surrounding environment state, so that the sound effect of the music changes with the user's driving state. In this way, when the user is driving, they can hear music with a sound effect adapted to their driving scenario, thereby improving the user's driving experience and the music listening experience during driving.

[0014] Combined with the first aspect, in some embodiments, when the first data is motion parameters and physiological parameters, the first electronic device processes the first data through the first neural network to obtain the first sound effect parameters; when the first data is driving state parameters and / or driving environment parameters, the first electronic device processes the first data through the second neural network to obtain the first sound effect parameters; among them, the input of the first neural network is motion parameters and physiological parameters, and the output is one or more sound effect parameters, and the input of the second neural network is driving state parameters and / or driving environment parameters, and the output is one or more sound effect parameters.

[0015] That is to say, the first electronic device can distinguish different music listening scenarios based on the content of the first data, and then process the first data using different neural networks. In this way, when the user is exercising, the first data is motion parameters and physiological parameters, and the first electronic device can process the first data based on the first neural network; when the user is driving, the first data is driving state parameters and / or driving environment parameters, and the first electronic device can process the first data based on the second neural network. This can ensure that the first electronic device can provide a sound effect adapted to the user's music listening scenario in different scenarios.

[0016] Combined with the first aspect, in some embodiments, when the second electronic device is a sports health monitoring device, the first electronic device receives the motion parameters and physiological parameters sent by the second electronic device every first time length, and the first electronic device updates the sound effect parameters based on the motion parameters and physiological parameters every second time length.

[0017] That is to say, the second electronic device can report parameters to the first electronic device at a preset period (the first time length), and the first electronic device can update the sound effect parameters based on the second time length. In this way, without the user actively switching the sound effect, the first electronic device can dynamically and real-time adjust the sound effect for the user based on the user's state during exercise, so that the user can obtain music that meets their psychological needs in different exercise states, improving the user's music listening experience.

[0018] Combined with the first aspect, in some embodiments, when the second electronic device is a driving device, the first electronic device receives the driving state parameters and / or driving environment parameters sent by the second electronic device every third time length, and the first electronic device updates the sound effect parameters based on the driving state parameters and / or driving environment parameters every fourth time length.

[0019] That is to say, without the user actively operating, the first electronic device can dynamically adjust the sound effect when the user is driving, so that the user can hear music that adapts to their needs in different driving states, improving the user's music listening experience.

[0020] Combined with the first aspect, in some embodiments, the parameters in the first data and the thresholds corresponding to the parameters satisfy the first condition.

[0021] Among them, the second electronic device can report data to the first electronic device when the parameters in the first data and their corresponding thresholds satisfy the first condition. For example, the first condition may include: the real-time heart rate exceeds its corresponding heart rate threshold. In this way, only when the heart rate meets the above conditions can the second electronic device report data. Among them, the second electronic device can report all parameters, or only report the parameters that meet the first condition, such as the heart rate in the above case. This can reduce the communication content between the first electronic device and the second electronic device, reduce the calculation amount of the first electronic device, and the first electronic device can adjust the sound effect parameters only when the change amount of the parameters collected by the second electronic device exceeds a certain threshold, so as to avoid the sound effect parameter update period being too fixed, resulting in the first electronic device being unable to change the sound effect parameters in time according to the user's state, or the interval for updating the sound effect parameters being too short, etc., affecting the user's music listening experience.

[0022] Combined with the first aspect, in some embodiments, the motion parameters include one or more of the following: speed, motion acceleration, and the physiological parameters include one or more of the following: heart rate, heart rate change rate, psychological stress index, body temperature.

[0023] In combination with the first aspect, in some embodiments, the relationship between the first audio effect parameter and the first data includes one or more of the following: the faster the heart rate, the higher the audio loudness; the faster the heart rate change rate, the greater the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the faster the heart rate change rate, the smaller the frequency response gain of the low frequency signal; the higher the psychological stress index, the longer the reverberation delay; the higher the body temperature, the longer the reverberation delay; the greater the motion acceleration, the faster the playback speed.

[0024] In combination with the first aspect, in some embodiments, the driving state parameters include one or more of the following: vehicle speed, driving acceleration, and the driving environment parameters include one or more of the following: road conditions at the location of the first driving device, temperature.

[0025] In combination with the first aspect, in some embodiments, the relationship between the first audio effect parameter and the first data includes one or more of the following: the faster the vehicle speed, the higher the audio loudness; the greater the driving acceleration, the faster the playback speed; the faster the vehicle speed, the greater the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the more congested the road conditions, the smaller the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the lower the temperature, the shorter the reverberation delay.

[0026] In combination with the first aspect, in some embodiments, after the first electronic device adjusts the audio effect parameter of the first audio based on the first data, the method further includes: the first electronic device receives a first user operation for storing the first audio effect parameter, and in response to the first user operation, the first electronic device stores the first audio effect parameter.

[0027] In combination with the first aspect, in some embodiments, after the first electronic device stores the first audio effect parameter, the method further includes: the first electronic device receives a second user operation for applying the first audio effect parameter, and in response to the second user operation, the first electronic device plays the audio using the first audio effect parameter.

[0028] That is to say, when the user hears a favorite audio effect, the user can save the audio effect parameter corresponding to the audio effect. In this way, the user can directly apply this audio effect when listening to other music later, improving the user's music listening experience.

[0029] In a second aspect, the present application provides an electronic device, which includes a memory and a processor coupled to the memory; the memory stores a computer program, and when the processor executes the above computer program, the electronic device implements the method described in any one of the above first aspects.

[0030] In a third aspect, the present application provides a computer-readable storage medium, which stores a computer program or computer instructions, and the foregoing computer program or computer instructions are executed by a processor to implement the method described in any one of the above first aspects.

[0031] Fourthly, an embodiment of the present application provides a computer program product. When the computer program product is executed by a processor, the method described in any item of the first aspect above will be implemented.

[0032] Fifthly, an embodiment of the present application provides a chip, which includes a processor and a memory. The memory is used to store a computer program or computer instructions, and the processor is used to execute the computer program or computer instructions stored in the memory, so that the chip executes the method described in any item of the first aspect above.

[0033] The solutions provided in the second aspect to the fifth aspect above are used to implement or cooperate with the corresponding methods provided in the first aspect. Therefore, the same or corresponding beneficial effects can be achieved as those of the corresponding methods in the first aspect, and details will not be elaborated here. Description of the Drawings

[0034] Figure 1 is a schematic diagram of the architecture of a communication system 10 provided by an embodiment of the present application;

[0035] Figure 2 is a schematic diagram of the structure of an electronic device 100 provided by an embodiment of the present application;

[0036] Figure 3 is a software structure block diagram of the electronic device 100 provided by an embodiment of the present application;

[0037] Figures 4A - 4N Exemplarily shows a series of user interaction diagrams related to the sound effect adjustment method provided by an embodiment of the present application;

[0038] Figure 5 is a flowchart of the mobile phone 101 provided by an embodiment of the present application for adjusting the sound effect parameters of music;

[0039] Figure 6 is a flowchart of the sound effect adjustment method provided by an embodiment of the present application;

[0040] Figure 7 is a schematic diagram of the structure of a music playing device 700 provided by an embodiment of the present application;

[0041] Figure 8 is a schematic diagram of the structure of a chip provided by an embodiment of the present application. Detailed Embodiments

[0042] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of the present application, the singular forms "a", "an", "the", "above-mentioned", "said", and "this" are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any and all possible combinations of one or more of the listed items.

[0043] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and should not be construed as implying or suggesting relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" is two or more.

[0044] Music can stimulate people's emotional responses and help people express or release emotions. Moreover, different types of music also have different effects on people's physiology or psychology, etc. For example, soft music can relieve muscles and make people feel calm; fast and pleasant music can strengthen muscle tension and boost people's spirits. When listening to music, people often tend to want to listen to music that better meets their current physiological or psychological needs. For example, when working, people are more likely to want to hear music that can lift their spirits and help them concentrate, and before an exam, people are more likely to want to hear music that can soothe their nervousness. However, currently, when an electronic device plays music, it often plays the songs in a preset playlist list unchanged without considering the needs of the user's current music listening scenario.

[0045] To solve the above problems, the embodiments of the present application provide a sound effect adjustment method, an electronic device, and a computer-readable storage medium. In this method, the electronic device can dynamically adjust the sound effect parameters of a song in real time according to a preset period based on information such as the environment where the user is located, or the user's current motion state, physiological state, etc., and then play the song based on the adjusted sound effect parameters. Among them, the sound effect parameters can affect the playback effect of the music and thus affect people's sensory experience when listening to music. By changing the sound effect parameters of the music, the electronic device can make the music present different effects when played. In this way, the electronic device can provide music that better meets the physiological and psychological needs of the user in different scenarios and improve the user's music listening experience.

[0046] The above-mentioned sound effect parameters can refer to various parameters when the music is played. The sound effect parameters can include but are not limited to the loudness of the music, frequency response gain, playback speed, reverberation delay, and so on. Among them:

[0047] Loudness: Loudness can also be referred to as volume or sound intensity. It is the subjective perception of the size and strength of the sound heard by the human ear. Loudness is determined by the amplitude of the vibration of the sound source. The greater the amplitude of the vibration of the sound source, the greater the loudness of the sound it emits.

[0048] Frequency response gain: The frequency response gain is also known as the frequency response amplification. It reflects the amplification or attenuation ability of audio equipment (such as headphones) for sound signals of different frequencies, and can directly affect the sound quality and listening experience of music.

[0049] Playback speed: The playback speed reflects the speed of the music playback progress. Without adjustment, electronic devices usually play music at normal speed, that is, the playback speed of the music is 1x, which is the original playback speed of the music. When the playback speed of the music becomes faster, the time interval between notes will become shorter, and the rhythm and vitality of the music will increase. When the playback speed of the music becomes slower, the time interval between notes will become longer, and the music will become more slow and comfortable.

[0050] Reverberation delay: When sound waves propagate in a room, they will be reflected by obstacles such as indoor walls, ceilings, and floors. Each time the sound waves are reflected, some of them will be absorbed by the obstacles. After the sound source stops emitting sound, the sound waves will still be reflected and absorbed multiple times in the room before disappearing. This phenomenon that multiple sound waves are mixed together and last for a period of time after the sound source stops emitting sound is called reverberation. The length of time when reverberation occurs can be called the reverberation delay.

[0051] In order to provide music that better meets the user's music listening needs, multiple electronic devices can cooperate to collect data and then determine the user's music listening needs. Here, an exemplary scenario in which multiple electronic devices cooperate to collect data and then adjust the sound effect parameters of music is first introduced.

[0052] Figure 1 It is a schematic diagram of the architecture of a communication system 10 provided by an embodiment of the present application. As Figure 1As shown, the communication system 10 may include a mobile phone 101, a sports and health monitoring device (such as a smart bracelet 102), and a driving device (such as a car 103). Among them, the mobile phone 101 and the smart bracelet 102, and the mobile phone 101 and the car 103 can communicate through a wireless network. The above wireless network communication methods may include, for example, wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc.

[0053] Among them, the mobile phone 101 can be used to play music. In the embodiments of the present application, when the mobile phone 101 plays music, it can obtain the exercise parameters and / or physiological parameters of the user collected by the smart bracelet 102, and then adjust the sound effect parameters of the music based on the above parameters. Alternatively, when the mobile phone 101 plays music, it can also obtain the driving state parameters and / or driving environment parameters of the vehicle collected by the car 103, and then adjust the sound effect parameters of the music based on the above parameters.

[0054] The sports and health monitoring device (such as Figure 1 the smart bracelet 102 therein) can be used to collect the exercise parameters and / or physiological parameters of the wearer, and send the above exercise parameters and / or physiological parameters to the mobile phone 101. The above exercise parameters may be one or more parameters reflecting the exercise state of the wearer of the smart bracelet 102, and the exercise parameters may include, but are not limited to, the speed, acceleration, ascending or descending height of the wearer (i.e., the user) during exercise. The physiological parameters may be one or more parameters reflecting the physiological state of the wearer of the smart bracelet 102, and the physiological parameters may include, but are not limited to, the heart rate, heart rate change rate, psychological stress index, body temperature, blood oxygen saturation, pulse, blood pressure, etc. The above psychological stress index may be an index determined by the smart bracelet 102 based on the wearer's heart rate, pulse, blood oxygen saturation, blood pressure, and sleep quality, etc., reflecting the user's psychological stress level. Among them, the higher the psychological stress index, the greater the user's psychological stress.

[0055] The driving device (such as Figure 1The vehicle 103) therein can be a transportation means with computing capabilities. For example, a car computer for processing data can be included in the driving device. Herein, the connection between the driving device and the mobile phone 101 actually means that the car computer inside the driving device establishes a communication connection with the mobile phone 101. The driving device can collect the driving state parameters and / or driving environment parameters of the user, and send the above-mentioned driving state parameters and / or driving environment parameters to the mobile phone 101 through the car computer. The above-mentioned driving state parameters can be one or more parameters reflecting the state of the user driving the vehicle 103 (or the state of the vehicle 103 traveling), and the driving state parameters can include but are not limited to the vehicle speed, acceleration, distance traveled by the vehicle, etc. of the vehicle 103. The driving environment parameters can be one or more parameters reflecting the driving environment of the vehicle 103, which can include the weather, temperature, rainfall, road conditions (such as congestion or smoothness), and flatness state of the road at the location where the vehicle 103 is located, etc.

[0056] In some embodiments, the mobile phone 101 can adjust the sound effect parameters based on the user's music listening scenario. When the mobile phone 101 receives the motion parameters and / or physiological parameters collected by the smart bracelet 102, the mobile phone 101 can determine that the user is in a motion state, and then adjust the sound effect parameters based on the motion parameters and / or physiological parameters. At this time, the communication connection between the mobile phone 101 and the vehicle 103 is optional. When the mobile phone 101 receives the driving state parameters and / or driving environment parameters collected by the vehicle 103, the mobile phone 101 can determine that the user is in a driving state, and then the mobile phone 101 can adjust the sound effect parameters of the music based on the driving state parameters and / or driving environment parameters. At this time, the communication connection between the mobile phone 101 and the smart bracelet 102 is optional.

[0057] In some embodiments, when the mobile phone 101 is connected to multiple devices at the same time, the mobile phone 101 can determine which type of device's parameters to use to adjust the sound effect parameters based on a preset priority. For example, when the mobile phone 101 is connected to both a motion health monitoring device (such as the smart bracelet 102) and a driving device (such as the vehicle 103), the mobile phone 101 can preferentially adjust the sound effect parameters of the music based on the driving state parameters and / or driving environment parameters collected by the driving device, because when the mobile phone 101 is connected to the driving device, the user is more likely to be in a driving scenario. In this scenario, the mobile phone 101 can ignore the motion parameters and / or physiological parameters collected by the motion health monitoring device when adjusting the sound effects. It is not limited to preferentially adjusting the sound effect parameters of the music based on the parameters collected by the driving device, and it can also be preferentially adjusting the sound effect parameters of the music based on the parameters collected by the motion health monitoring device. The embodiments of the present application do not limit this.

[0058] In some other embodiments, when the mobile phone 101 is connected to multiple devices simultaneously, the mobile phone 101 can jointly adjust the audio effect parameters based on the parameters of the multiple devices. For example, when the mobile phone 101 is connected to both a sports health monitoring device (such as the smart bracelet 102) and a driving device (such as the car 103), the mobile phone 101 can jointly adjust the audio effect parameters of the music based on the motion parameters, physiological parameters collected by the sports health monitoring device and the driving state parameters, driving environment parameters collected by the driving device.

[0059] In some embodiments, the mobile phone 101 can also receive an operation in which the user selects a dynamic audio effect mode. In response to this operation, the mobile phone 101 can adjust the audio effect parameters of the music based on the selected dynamic audio effect mode. The above-mentioned dynamic audio effect modes can include a driving mode and a sports mode. In the driving mode, the mobile phone 101 can adjust the audio effect parameters of the music based on the driving state parameters and / or driving environment parameters collected by the driving device; while in the sports mode, the mobile phone 101 can adjust the audio effect parameters of the music based on the motion parameters and / or physiological parameters collected by the sports health monitoring device.

[0060] It should be noted that Figure 1 The electronic devices in the communication system 10 shown are only examples and do not constitute a limitation on the embodiments of the present application. The electronic devices shown in the communication system 10 can also be other electronic devices capable of implementing the above functions. For example, it is not limited to the mobile phone 101 playing music and adjusting the audio effect parameters of the music based on the above parameters. It can also be other electronic devices playing music and adjusting the audio effect of the music. It is not limited to the smart bracelet 102 collecting the motion parameters and / or physiological parameters of the user. It can also be other sports health monitoring devices such as smart watches collecting the motion parameters and / or physiological parameters of the user. It is not limited to the car 103 collecting the driving state parameters and / or driving environment parameters. It can also be other driving devices such as electric vehicles, motorcycles and other driving devices collecting the driving state parameters and / or driving environment parameters.

[0061] For the convenience of description and better understanding, the embodiments of the present application take the communication system 10 as an example to introduce the audio effect adjustment method. The method for other electronic devices in other communication systems to adjust the audio effect of music can refer to the method for the communication system 10 to adjust the audio effect, which will not be elaborated here.

[0062] In some embodiments, the parameters used to adjust the audio effect can also be jointly collected by multiple electronic devices. For example, the mobile phone 101 can be connected to multiple sports health monitoring devices such as the smart bracelet 102 and the smart watch, obtain the motion parameters and / or physiological parameters collected from multiple sports health monitoring devices, and then adjust the audio effect based on the parameters collected by the multiple sports health monitoring devices.

[0063] In some embodiments, the electronic device for playing music, adjusting the sound effect parameters of music, and collecting parameters can be the same one. For example, a sports and health monitoring device such as the smart bracelet 102 can also be used to play music, and after collecting the motion parameters and / or physiological parameters, it can also adjust the sound effect parameters of the music, and then play the music based on the adjusted sound effect parameters. Or, the in-vehicle audio of a driving device such as the car 103 can be used to play music, and adjust the sound effect parameters of the music after collecting the driving state parameters and / or driving environment parameters. Or, the mobile phone 101 can also determine the driving state parameters and / or driving environment parameters of the user when driving a vehicle through the global navigation satellite system (GNSS), and then adjust the sound effect parameters of the music. The above GNSS can include the global positioning system (GPS), the global navigation satellite system (GLONASS), the beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS), and / or the satellite based augmentation systems (SBAS).

[0064] The electronic device can also establish a communication connection with an external wireless headset. In this way, the electronic device can listen to the music with adjusted sound effect parameters through the wireless headset. The sound effect parameters generated by the electronic device can also be saved in the wireless headset, so that the wireless headset can play the audio based on the sound effect parameters. Or, the sound effect parameters can also be saved in a wired headset.

[0065] Next, the exemplary electronic device 100 provided by the embodiments of the present application will be introduced.

[0066] Figure 2 It is a schematic structural diagram of the electronic device 100 provided by the embodiments of the present application.

[0067] Among them, the electronic device 100 can be a smart terminal device, which can be of various types, and the embodiments of the present application do not limit its specific type. For example, the electronic device 100 can be, for example, the mobile phone 101 in the communication system 10, and can also be a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, a smart screen, an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a smart headset, a game console, and can also be a sports health monitoring device (or a wearable device) for detecting the physiological state and movement state of a user, such as a smart watch, the smart bracelet 102 in the communication system 10, and so on. Or, the electronic device 100 can also be a car machine in a driving device, such as a car machine in an electric vehicle, the car machine of the automobile 103 in the communication system 10, and so on. Without limitation, the electronic device 100 can also be an Internet of Things (IOT) device or a smart home device, such as a smart TV, a laptop with a touch-sensitive surface or a touch panel, a desktop computer with a touch-sensitive surface or a touch panel, and other non-portable terminal devices, and so on.

[0068] The following takes the electronic device 100 as an example to specifically illustrate the embodiments. It should be understood that the electronic device 100 can have more or fewer components than those Figure 2 shown in, can combine two or more components, or can have different component configurations. Figure 2 The various components shown in can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0069] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, an antenna 1, a wireless communication module 160, an audio module 170, a speaker 170A, a headphone interface 170B, a sensor module 180, and a display screen 194, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a touch sensor 180B, etc.

[0070] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0071] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0072] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0073] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the wireless communication module 160, the modem processor, the baseband processor, etc.

[0074] The antenna 1 is used for transmitting and receiving electromagnetic wave signals.

[0075] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor can output a sound signal through an audio device (such as the speaker 170A).

[0076] The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100. The wireless communication module 160 receives electromagnetic waves via the antenna 1, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 1 for radiation.

[0077] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to execute mathematical and geometric calculations for graphics rendering.

[0078] The display screen 194 is used to display images, videos, etc.

[0079] The NPU is a neural-network (NN) computing processor. By referring to the biological neural network structure, such as the transmission mode between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized. In the embodiments of the present application, the NPU can also adjust the sound effect parameters of music based on the driving state parameters and / or driving environment parameters through the neural network model, and / or adjust the sound effect parameters of music based on the motion parameters and / or physiological parameters.

[0080] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, files such as music and videos are saved in the external memory card.

[0081] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store the operating system, applications required for at least one function (such as face recognition function, fingerprint recognition function, mobile payment function, etc.). The storage data area can store the data created during the use of the electronic device 100 (such as face information template data, fingerprint information template, etc.). In addition, the internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0082] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the headphone jack 170B, and the application processor, etc. For example, music playback and the like.

[0083] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals.

[0084] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or hands-free calls through the speaker 170A.

[0085] The headphone jack 170B is used to connect a wired headphone.

[0086] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A.

[0087] The touch sensor 180B, also known as the "touch panel". The touch sensor 180B can be disposed on the display screen 194, and the touch sensor 180B and the display screen 194 form a touch screen, also known as the "touch control screen". The touch sensor 180B is used to detect a touch operation acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event.

[0088] Not limited to the above components, the electronic device 100 may further include more Figure 2More or fewer components as shown. For example, when the electronic device 100 is a sports and health monitoring device such as a smart bracelet 102 or a smart watch, the electronic device 100 may further include a temperature sensor, an acceleration sensor, a barometric pressure sensor, a heart rate sensor, a blood oxygen sensor, a blood pressure sensor, a sleep monitoring sensor, and so on. Among them, the temperature sensor is used to detect the user's body temperature; the acceleration sensor is used to collect the acceleration of the movement of the electronic device, and then judge the user's walking speed and movement distance; the barometric pressure sensor is used to measure the barometric pressure; the heart rate sensor is used to monitor the user's heart rate; the blood oxygen sensor is used to measure the oxygen saturation in the user's blood; the blood pressure sensor is used to detect the user's blood pressure, and the sleep monitoring sensor is used to monitor the user's sleep state. When the electronic device 100 is a car machine of a driving device such as a car 103 or an electric vehicle, the electronic device 100 may further include a vehicle speed sensor, an acceleration sensor, a temperature sensor, a radar sensor, and so on. Among them, the vehicle speed sensor can be used to detect the vehicle speed of the driving device; the acceleration sensor is used to detect the acceleration of the driving device during driving; the temperature sensor can be used to measure the temperature of the environment where the driving device is located and / or the temperature inside the cockpit of the driving device; the radar sensor can be used to determine the flatness of the road, identify surrounding vehicles, pedestrians, and so on. The embodiments of the present application do not limit the components that the electronic device 100 may include.

[0089] Figure 3 is a software structure block diagram of the electronic device 100 according to the embodiments of the present application.

[0090] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the system is divided into four layers, from top to bottom are the application layer, the application framework layer, the runtime, and the system library, and the kernel layer.

[0091] The application layer may include a series of application packages.

[0092] As Figure 3 shown, the application packages may include applications such as a camera, a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, a music, a short message, etc. (which may also be referred to as applications).

[0093] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0094] As Figure 3 shown, the application framework layer may include a content provider, a view system, an audio player, a sound effect adjuster, a resource manager, and so on.

[0095] The content provider is used to store and retrieve data, and make this data accessible to applications. The above data can include videos, images, audio, incoming and outgoing calls, browsing history and bookmarks, phone books, etc.

[0096] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can consist of one or more views.

[0097] The audio player is used to implement functions such as music playback and recording.

[0098] The sound effect adjuster is used to adjust sound effect parameters based on one or more of the motion parameters, physiological parameters, driving state parameters, and driving environment parameters.

[0099] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0100] Runtime includes the core libraries and the virtual machine. Runtime is responsible for the scheduling and management of the system.

[0101] The core libraries contain two parts: one part is the functional functions that the programming language (e.g., Java language) needs to call, and the other part is the core libraries of the system.

[0102] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the programming files (e.g., Java files) of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0103] The system libraries can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing library (e.g., OpenGL ES), 2D graphics engine (e.g., SGL), etc.

[0104] The surface manager is used to manage the display subsystem and provides the fusion of 2D (2-Dimensional) and 3D (3-Dimensional) layers for multiple applications.

[0105] The media library supports the playback and recording of various common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0106] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0107] The 2D graphics engine is a drawing engine for 2D drawing.

[0108] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, an audio driver, and a sound effect driver. Among them, the audio driver is used to drive an audio playback device such as the speaker 170A to play music; the sound effect driver is used to update the sound effect parameters of the music, and then the audio driver can play the music according to the updated sound effect parameters. In some embodiments, the sound effect driver and the audio driver can be integrated into the same driver.

[0109] The following introduces the scenario where the mobile phone 101 provided by the embodiments of the present application adjusts the sound effect parameters of music.

[0110] Figures 4A - 4N Exemplarily shown are a series of schematic diagrams of user interactions (user interface, UI) involved in the sound effect adjustment method provided by the embodiments of the present application. Among them:

[0111] As Figure 4A shown, the mobile phone 101 displays the home screen interface 400. The home screen interface 400 may include desktop icons of one or more applications, and may include the icon 401 of the music application among them. The mobile phone 101 can receive an operation of the user on the icon 401 of the music application. In response to this operation, the mobile phone 101 can start the music application and display the home page interface 410 of the music application as Figure 4B shown.

[0112] As Figure 4B shown, the home page interface 410 of the music application may include multiple playlist recommendation cards and a music playback bar 411. The above playlist recommendation cards include, for example, a hot songs selection playlist, a "good morning vitality" playlist, a pure music playlist, a hot songs chart playlist, a "fresh good songs that suit your taste" playlist, a new songs chart playlist, and so on. When a playlist recommendation card receives a click operation of the user, the mobile phone 101 can enter the playlist corresponding to the clicked playlist recommendation card for the user to view and play the music in the playlist. The music playback bar 411 can display the song that the mobile phone 101 played most recently. The music playback bar 411 may include the name of the song "Song AA" and the singer (or performer) of the song: Singer A.

[0113] The mobile phone 101 can receive an operation of the user clicking on the music playback bar 411. In response to this operation, the mobile phone 101 can enter the interface as Figure 4CThe music playback interface 420 shown. Information about the music being played can be displayed in the music playback interface 420, which may include the name of the music "Song AA" and the singer "Singer A". The music playback interface may also include multiple controls for controlling music playback, which may include a slider for displaying and controlling the music playback progress, a playback control button 421 for controlling music playback or pausing, a button for switching music, and a sound effect button 422 for adjusting the sound effect.

[0114] As Figure 4C shown, the mobile phone 101 can receive an operation by the user on the sound effect button 422. In response to this operation, the mobile phone 101 can display a sound effect adjustment interface 430 as Figure 4D shown. The sound effect adjustment interface 430 can be used to adjust the sound effect of the music. Among them, the start / stop button for the dynamic sound effect function, the saved sound effect menu 433, and the return button 434 can be displayed in the sound effect adjustment interface 430.

[0115] Among them, the dynamic sound effect function can include a sports mode and a driving mode. In the sports mode, the mobile phone 101 can adjust one or more sound effect parameters of the music based on sports parameters and / or physiological parameters, where the sports parameters and / or physiological parameters can be collected by a sports and health monitoring device such as the smart bracelet 102; in the driving mode, the mobile phone 101 can adjust one or more sound effect parameters of the music based on driving state parameters and / or driving environment parameters. Among them, the driving state parameters and / or driving environment parameters can be collected by a driving device such as the car 103.

[0116] In some embodiments, the mode of the dynamic sound effect function can be selected by the user. As Figure 4D shown, the start / stop button for the dynamic sound effect function can include a start / stop button 431 for the sports mode and a start / stop button 432 for the driving mode. Among them, the start / stop button 431 for the sports mode is used to control the opening and closing of the sports mode of the dynamic sound effect function; the start / stop button 432 for the driving mode is used to control the opening and closing of the driving mode of the dynamic sound effect function.

[0117] In some other embodiments, Figure 4D the embodiment shown is optional. The mode of the dynamic sound effect function can also be determined by the mobile phone 101 based on the received parameter type. In this way, the mobile phone 101 can display a master switch ( Figure 4D not shown in the figure) for the user to turn on or off the dynamic sound effect function. After the mobile phone 101 detects an operation by the user to turn on the dynamic sound effect function, in response to this operation, the mobile phone 101 determines the mode in which the dynamic sound effect function is turned on.

[0118] The stored sound effect menu 433 can display sound effect options of one or more stored sound effects of the mobile phone 101. For example, it may include a sound effect A option and a sound effect B option. Each sound effect option can correspond to a stored mobile phone sound effect of the mobile phone 101, and is used to select the stored sound effect for editing, application, etc. It can be understood that the sound effect A and sound effect B here are actually sound effect parameters including a series of specific values.

[0119] The return button 434 is used to return to the Figure 4C music playing interface 420 as shown.

[0120] As Figure 4D shown, the mobile phone 101 can receive an operation of the user on the start / stop button 431 of the motion mode. In response to this operation, the mobile phone 101 can start the motion mode of the dynamic sound effect function and adjust the sound effect parameters based on the motion parameters and physiological parameters when the music starts to play.

[0121] As Figure 4E shown, in the motion mode, the mobile phone 101 can display the status of the motion health monitoring device connected to the mobile phone. For example, the mobile phone 101 can display the identification of the currently connected motion health monitoring device such as "smart bracelet". The mobile phone 101 can receive an operation on the return button 434. In response to this operation, as Figure 4F shown, the mobile phone 101 can return to the music playing interface 420.

[0122] The mobile phone 101 can receive an operation of the user on the playback control button 421. In response to this operation, the mobile phone 101 can start playing the song corresponding to the music playing interface 420, that is, song AA. Among them, the mobile phone 101 can play the music with the preset initial sound effect parameters.

[0123] Furthermore, the smart bracelet 102 can report the motion parameters and physiological parameters to the mobile phone according to the preset period 1. The above preset period 1 can be, for example, 10 seconds, 5 seconds or other time lengths, and the embodiments of the present application do not limit this; the mobile phone 101 can update the sound effect of the music based on the motion parameters and physiological parameters according to the preset period 2. The above preset period 2 can be 10 seconds, or 5 seconds, or other time lengths, and the embodiments of the present application do not limit this. Among them, the preset period 1 and the preset period 2 can be the same or different. Among them, the preset period 2 can be set by the user or preset by the mobile phone 101, and the embodiments of the present application do not limit this.

[0124] Exemplarily, if both the preset period 1 and the preset period 2 are 5 seconds, at the 05th second, the smart bracelet 102 can report the motion parameters and physiological parameters from the 00th second to the 05th second to the mobile phone 101. Then, the mobile phone 101 can generate corresponding sound effect parameters based on the motion parameters and physiological parameters from the 00th second to the 05th second, and further adjust the sound effect parameters of the music. Then, the smart bracelet 102 reports the motion parameters and physiological parameters from the 05th second to the 10th second at the 10th second, and the mobile phone 101 adjusts the sound effect parameters based on the received motion parameters and physiological parameters.

[0125] Exemplarily, if the preset period 1 is different from the preset period 2. The preset period 1 can be less than the preset period 2. Taking the preset period 1 as 5 seconds and the preset period 2 as 10 seconds as an example, the smart bracelet 102 can report the motion parameters and physiological parameters collected from the 00th second to the 05th second at the 5th second, and report the motion parameters and physiological parameters collected from the 05th second to the 10th second to the mobile phone 101 at the 10th second. The mobile phone 101 can adjust the sound effect of the music based on the motion parameters and physiological parameters received from the 00th second to the 10th second. Then, the smart bracelet 102 can report the motion parameters and physiological parameters collected from the 10th second to the 15th second at the 15th second, and report the motion parameters and physiological parameters collected from the 15th second to the 20th second to the mobile phone 101 at the 20th second. The mobile phone 101 can adjust the sound effect of the music based on the motion parameters and physiological parameters received from the 10th second to the 20th second.

[0126] Among them, the mobile phone 101 can report only some of the motion parameters and physiological parameters, for example, it can report the heart rate and motion acceleration, but not report the psychological stress index, body temperature, etc.

[0127] The manner in which the driving device reports the driving state parameters and driving environment parameters to the mobile phone 101 can refer to the manner in which the smart bracelet reports the motion parameters and physiological parameters to the mobile phone 101 as described above, and will not be elaborated here.

[0128] Among them, the mobile phone 101 can adjust the sound effect of the music based on all the motion parameters and physiological parameters reported by the smart bracelet 102, or can also adjust the sound effect of the music based on some of the motion parameters and physiological parameters reported by the smart bracelet 102. The embodiments of the present application do not limit this.

[0129] The motion parameters and physiological parameters used by the mobile phone 101 to adjust the sound effect multiple times can overlap or not overlap. The embodiments of the present application do not limit this. The above-mentioned overlap means that the mobile phone 101 uses the motion parameters and / or physiological parameters collected by the smart bracelet within the same time period during multiple adjustments of the sound effect parameters.

[0130] In some embodiments, when the user is not satisfied with the sound effect parameters of the music being played on the mobile phone 101, the sound effect parameters can be switched.

[0131] As Figure 4G shown, after the mobile phone 101 activates the dynamic sound effect function, a sound effect switching button 441 and a sound effect saving button 442 can be displayed. Among them, the sound effect switching button 441 is used to switch the currently adopted sound effect parameters, instructing the mobile phone 101 to readjust the sound effect parameters; the sound effect saving button 442 is used to store the currently adopted sound effect parameters.

[0132] As Figure 4H shown, the mobile phone 101 can receive an operation of the user on the sound effect switching button 441. In response to this operation, the mobile phone 101 can switch the sound effect parameters being used and regenerate new sound effect parameters. Among them, the mobile phone 101 can generate new sound effect parameters based on the motion parameters and physiological parameters within a longer time period or a shorter time period and then play music using these sound effect parameters. Or, the mobile phone 101 can also increase or decrease a preset value for the switched sound effect parameters to obtain new sound effect parameters, and then generate new sound effect parameters. Or, the mobile phone 101 can also play music using the sound effect parameters used last time.

[0133] Furthermore, the mobile phone 101 can also display a prompt box 443, and the prompt box 443 is used to indicate that the sound effect switching is successful.

[0134] In some embodiments, the mobile phone 101 can also save the sound effects generated by the dynamic sound effect function. As Figure 4I shown, the mobile phone 101 can receive an operation of the user on the sound effect saving button 442. In response to this operation, the mobile phone 101 can store the sound effect parameters being used, and the mobile phone 101 can also display a prompt box 444. The prompt box 444 is used to indicate that the sound effect storage is successful. Among them, the prompt box 444 can also include the name of the sound effect when it is stored: Sound Effect C, and this name can be preset by the mobile phone 101. In some embodiments, the name of the sound effect when it is stored can also be set by the user. It can be understood that Sound Effect C corresponds to a set of a series of sound effect parameters being stored.

[0135] In some embodiments, the sound effects saved by the mobile phone 101 can also be copied (or referred to as duplicated) to other electronic devices, so that the user can directly use the saved sound effects when listening to audio on other electronic devices.

[0136] In some embodiments, the mobile phone 101 can also display the recently generated or saved sound effects. As Figure 4J shown, the mobile phone 101 can receive an operation of the user on the sound effect button 422. In response to this operation, the mobile phone 101 can display as Figure 4KThe sound effect adjustment interface 430 shown.

[0137] As Figure 4K shown, in the sound effect adjustment interface 430, the most recent sound effect menu 450 of the mobile phone 101 can be displayed. The most recent sound effect menu 450 can include the sound effects most recently generated by the mobile phone 101. The most recent sound effect menu 450 can include one or more options for the most recently generated sound effects. Each sound effect option can contain the name of the sound effect and the time when the sound effect was generated. For example, the most recent sound effect menu 450 can include Sound Effect 5, Sound Effect 6, and Sound Effect 7. The generation time of Sound Effect 5 was 33 seconds ago, the generation time of Sound Effect 6 was 23 seconds ago, and the generation time of Sound Effect 7 was 3 seconds ago. Taking the current song progress as Figure 4J shown at 02:53 seconds, for example, Sound Effect 7 can be the one applied by the mobile phone when the song was playing to 02:50, and Sound Effect 6 can be the one applied when the song was playing from 02:30 to 02:50. Sound Effect 5 can be the one applied when the song was playing from 02:20 to 02:30. Among them, the application time length of Sound Effect 5 is shorter than that of Sound Effect 6, which may be due to Figure 4H shown that the mobile phone 101 switches Sound Effect 5 in response to a user operation. Among them, each sound effect in the most recent sound effect menu 450 can be stored in the mobile phone 101 for a preset time. The preset time can be, for example, 10 minutes, 20 minutes, or other time, and the embodiments of the present application do not limit this. The above preset time can be set by the user or preset by the mobile phone 101. When the preset time for storing the sound effect exceeds the preset time and the mobile phone 101 does not receive an operation to save the sound effect, the mobile phone 101 can delete the sound effect.

[0138] In the saved sound effect menu 433, a sound effect option newly stored in the mobile phone 101 can be displayed: Sound Effect C. This sound effect option can be displayed after the mobile phone Figure 4I shown saves the sound effect in response to the user clicking the sound effect save button 442.

[0139] In some embodiments, the mobile phone 101 can save or apply the sound effects generated historically. As Figure 4K shown, the mobile phone 101 can receive the operation of the user clicking the sound effect option corresponding to Sound Effect 5. In response to this operation, the mobile phone 101 can display Figure 4L the dialog box 451 shown. The dialog box 451 is used to edit Sound Effect 5. As Figure 4LAs shown, the name of Sound Effect 5 (Sound Effect 5), the generation time of Sound Effect 5 (8:01:30, 1 minute ago), as well as the save button 452 and the apply button 453 can be displayed in the dialog box 451. Among them, the save button 452 is used to store Sound Effect 5 in the memory of the mobile phone 101 or in the cloud server. The apply button 453 is used to apply Sound Effect 5 to subsequent music playback.

[0140] As Figure 4L shown, the mobile phone 101 can receive an operation by the user on the save button 452, and in response to this operation, the mobile phone 101 can store Sound Effect 5. As Figure 4M shown, after the mobile phone 101 stores Sound Effect 5, a sound effect option corresponding to Sound Effect 5 can be displayed in the saved sound effect menu 433.

[0141] The mobile phone 101 can receive an operation by the user on the sound effect option corresponding to Sound Effect 5, and in response to this operation, the mobile phone 101 can display a sound effect details interface 460 as Figure 4N shown. The sound effect details interface 460 can edit or apply Sound Effect 5. For example, the sound effect details interface 460 may include a modify sound effect name button 461, a use sound effect button 462, and a delete sound effect button 463. Among them, the modify sound effect name button 461 is used to change the sound effect of Sound Effect 5, the use sound effect button 462 is used to apply Sound Effect 5, and the delete sound effect button 463 is used to delete the sound effect of Sound Effect 5.

[0142] As Figure 4N shown, the mobile phone 101 can receive an operation by the user on the use sound effect button 462, and in response to this operation, the mobile phone 101 can apply Sound Effect 5 to continue playing subsequent music. It can be understood that when the mobile phone 101 plays music with Sound Effect 5, it means playing music with a series of sound effect parameters corresponding to Sound Effect 5. In some embodiments, in response to the user clicking the use sound effect button 462, the mobile phone 101 can also apply Sound Effect 5 to only part of the music, and the above-mentioned part of the music can be music that meets a preset condition. The above-mentioned preset condition can be, for example, that the music is in a certain playlist, and this playlist can be set by the user or provided by the cloud server.

[0143] Not limited to music applications, the mobile phone 101 can also be based on motion parameters and / or physiological parameters collected by a motion health monitoring device in other applications. The embodiments of the present application do not limit this.

[0144] For the scenario where the mobile phone 101 adjusts the sound effect parameters of music in the driving mode, reference can be made to the scenario where the mobile phone 101 adjusts the sound effect parameters of music in the sports mode above, and details will not be elaborated here.

[0145] Figure 5It is a flowchart for the mobile phone 101 provided by an embodiment of the present application to adjust the sound effect parameters of music.

[0146] As Figure 5 shown, the adjustment of the sound effect parameters of music by the mobile phone 101 may include the following steps:

[0147] S501. Connect the sports health monitoring device and / or the driving device.

[0148] S502. Obtain the sports parameters and physiological parameters from the sports health monitoring device.

[0149] S503. Obtain the driving state parameters and driving environment parameters from the driving device.

[0150] The mobile phone 101 can establish a communication connection with the sports health monitoring device (such as the smart bracelet 102) and / or the driving device (such as the car 103). Furthermore, the mobile phone 101 can obtain the sports parameters and physiological parameters reported by the sports health monitoring device according to the preset period 1, and / or the driving state parameters and driving environment parameters reported by the driving device according to the preset period 3.

[0151] Among them, the sports parameters may include but are not limited to the user's walking speed and motion acceleration, and the physiological parameters may include but are not limited to the user's heart rate, psychological stress index, and body temperature. Among them, the smart bracelet 102 can store the user's initial heart rate, which can be the heart rate when the user is not doing strenuous exercise, or can be the mode or average value of the heart rate values within a certain time period of the user. The smart bracelet 102 can divide the difference between the real-time heart rate and the initial heart rate by the time length of the preset period 1 (that is, the time interval between two adjacent parameter reports of the sports health monitoring device) to obtain the heart rate change rate of the user, that is, the heart rate change rate of the user = (real-time heart rate - initial heart rate) / the time length of the preset period 1. The motion acceleration can be determined based on the walking speed collected by the sports health monitoring device. For example, (walking speed 1 - walking speed 2) / the time interval between the time point when walking speed 1 is collected and the time point when walking speed 2 is collected, and this motion acceleration can include the acceleration of the user's motion in one or more time periods within the preset period 1. Or, this motion acceleration can also be directly measured by an acceleration sensor. Among them, assuming that the period between two adjacent data reports of the smart bracelet 102 is 10 seconds, then the motion acceleration from the 0th second to the 1st second within this period = (walking speed at the 1st second - walking speed at the 0th second) / 1 second, the motion acceleration from the 0th second to the 2nd second = (walking speed at the 2nd second - walking speed at the 0th second) / 2 seconds, and the motion acceleration from the 0th second to the 10th second = (walking speed at the 10th second - walking speed at the 0th second) / 10 seconds. The smart bracelet 102 can report the acceleration in one or more time periods within this period for the mobile phone 101 to determine the sound effect parameters.

[0152] The driving state parameters may include, but are not limited to, the vehicle speed and driving acceleration of the driving device. The driving environment parameters may include, but are not limited to, road conditions and the temperature at the location of the driving device, etc. Among them, the road conditions may be obtained by the radar sensor of the driving device detecting the surrounding vehicles, or may be obtained by the driving device from the network; the temperature may be measured by the temperature sensor of the driving device, or may be obtained by the driving device from the network. The driving acceleration may be determined by the driving device based on the vehicle speed. Among them, the calculation method of the driving acceleration may be (vehicle speed 1 - vehicle speed 2) / the time interval between the time point when vehicle speed 1 is collected and the time point when vehicle speed 2 is collected. The calculation method of the driving acceleration may refer to the calculation method of the above-mentioned motion acceleration. For example, assuming that a reporting period of the driving device is 10 seconds, the driving acceleration from the 0th second to the 10th second = (the vehicle speed at the 10th second - the vehicle speed at the 0th second) / 10 seconds. The vehicle 103 may report the driving acceleration of one or more time periods within a cycle. Among them, the reporting period may be the time period between two adjacent motion parameters and physiological parameters of the motion health monitoring device, or the time period between two adjacent driving state parameters and driving environment parameters of the driving device.

[0153] S504. Determine the dynamic sound effect mode.

[0154] The mobile phone 101 may determine the mode of the dynamic sound effect. Among them, the dynamic sound effect mode may include a sports mode and a driving mode. The introduction of the sports mode and the driving mode may refer to the foregoing embodiments and will not be elaborated here. Among them, the mobile phone 101 may determine the dynamic sound effect mode based on the user operation. For example Figure 4D the embodiments shown. Or, the mobile phone 101 may also autonomously determine the dynamic sound effect mode. Exemplarily, when the mobile phone 101 is only connected to one type of device, the mobile phone 101 may determine the dynamic sound effect mode based on the device type. For example, if the mobile phone is only connected to the motion health monitoring device, the dynamic sound effect mode is the sports mode. Or, the mobile phone 101 may determine the dynamic sound effect mode based on the obtained parameter source. For example, when the mobile phone 101 obtains motion parameters and / or physiological parameters, the mobile phone 101 may also determine the dynamic sound effect mode as the sports mode. When the mobile phone 101 is connected to multiple types of devices at the same time, the mobile phone 101 may set priorities. For example, when the mobile phone is connected to both the motion health monitoring device and the driving device, the mobile phone may preferentially apply the driving mode.

[0155] S505. Use the motion model to determine the sound effect parameters based on the motion parameters and physiological parameters.

[0156] When the mobile phone 101 determines that the dynamic sound effect mode is the sports mode, the mobile phone 101 can use a sports model to process the motion parameters and physiological parameters to obtain sound effect parameters. Among them, the sports model can also be called the first neural network, and the sports model can include one or more neural network models. Among them, the mobile phone 101 can adjust only some of the sound effect parameters each time, rather than all of the sound effect parameters.

[0157] Among them, the neural network model is a mathematical model composed of a large number of nodes (or called neurons) connected to each other. The neural network model can include an input layer, a hidden layer, and an output layer. The input layer is used to receive data input, and the input layer is usually the first layer of the neural network model; the hidden layer is the intermediate processing layer, and the hidden layer can include multiple layers. For example, the hidden layer can include a convolutional layer, a pooling layer, a fully connected layer, an activation layer, and so on. The layers can be locally connected. For example, any neuron in the i+1 layer is only connected to some adjacent neurons in the i layer, or the layers can also be fully connected. For example, any neuron in the i+1 layer is connected to all neurons in the i layer; the output layer is used to output the final processing result.

[0158] In some embodiments, the mobile phone 101 can determine the audio loudness in the sound effect parameters based on the user's heart rate. Among them, the higher the user's heart rate, the higher the audio loudness. This is because when the heart rate is higher, people are often in a more excited state, so the mobile phone 101 can increase the audio loudness to adapt to the excited state of people. Optionally, when the user's heart rate exceeds a certain preset threshold, the mobile phone 101 can reduce the audio loudness to slow down the user's psychological excitement. Among them, the mobile phone 101 can also add the sounds of rock and percussion instruments, etc. to the background music of the music.

[0159] In some embodiments, the mobile phone 101 can determine the playback speed in the sound effect parameters based on the motion acceleration. When the user is accelerating and sprinting, the acceleration increases, and the mobile phone 101 can increase the playback speed of the song to match the user's excited state.

[0160] In some embodiments, the mobile phone 101 can determine the frequency response gain based on the heart rate change rate. When the user is in an excited state, the heart rate change rate is relatively fast. At this time, the user often wants to hear the middle frequency and high frequency sounds more, so the mobile phone 101 can increase the gain of the middle frequency signal and high frequency signal in the music. Correspondingly, the mobile phone 101 can also reduce the gain of the low frequency signal in the music. When the user is jogging, the heart rate changes slowly. At this time, the user wants to hear the low frequency sounds more, and the mobile phone 101 can increase the gain of the low frequency signal in the music. Correspondingly, the mobile phone 101 can also reduce the gain of the middle frequency signal and high frequency signal in the music.

[0161] In some embodiments, the mobile phone 101 can determine the reverberation delay based on body temperature and psychological stress index. Among them, when the body temperature is high, the mobile phone 101 can increase the reverberation delay because a higher reverberation delay gives the feeling of listening to music in a more spacious room, which will make the user feel cool psychologically. When the user's psychological stress is high and the psychological stress index is also high, the mobile phone 101 can increase the reverberation delay to make the song sound more soothing.

[0162] It should be noted that when the mobile phone 101 determines the sound effect parameters based on the parameters, it can be based on the average value, weighted average, etc. of the parameters within the above-mentioned one reporting period, or the values of the parameters at some time points (which can be one or multiple) within a period, or all the parameter values collected within a period to determine the sound effect parameters. This application embodiment will not elaborate further. For example, the mobile phone 101 can determine the audio loudness based on the average heart rate of the user within one reporting period of the smart bracelet, or can determine the audio loudness based on the heart rate at some time points within one reporting period. Or, it can also determine the audio loudness based on all the heart rate values collected by the smart bracelet within one reporting period. Another example, the mobile phone 101 can determine the playback speed based on the motion acceleration in multiple time periods within one reporting period. The motion acceleration in multiple time periods can include, for example, the acceleration in the first 2 seconds, the acceleration in the first 4 seconds, the acceleration in the first 6 seconds, etc. within the period. Or, the mobile phone 101 can determine the playback speed based on the motion acceleration in 1 time period within one reporting period, such as the motion acceleration within the time period included in the entire reporting period, and so on.

[0163] Not limited to the above adjustment methods, there can also be other adjustment methods. In addition to adjusting each sound effect parameter based on the above parameters, the mobile phone 101 can also be adjusted based on other physiological parameters or psychological parameters, or multiple parameters can jointly adjust a certain sound effect parameter. For example, when the user's heart rate is high, the mobile phone 101 can also increase the playback speed of the music, the frequency response gain of the medium and high frequencies, so as to increase the dynamics of the music and adapt to the user's excited mood, and so on. When the user's psychological stress index is high, the mobile phone 101 can also reduce the playback speed, increase the gain of the music in the low frequency, etc., to make the music more soothing and relieve the user's tense mood.

[0164] In some embodiments, the mobile phone 101 can jointly adjust one or more sound effect parameters based on multiple parameters. The same sound effect parameter can be affected by multiple parameters among the motion parameters and physiological parameters. The mobile phone 101 can input the motion parameters and physiological parameters into a neural network, and the neural network can output the values of multiple sound effect parameters based on the motion parameters and physiological parameters. For example, the mobile phone 101 can store a neural network model A, and this neural network model A can receive the input of motion parameters (such as walking speed, motion acceleration) and physiological parameters (such as heart rate, heart rate change rate, pressure, body temperature), and output the values of multiple sound effect parameters such as audio loudness, playing speed, frequency response gain, reverberation delay, etc. Among them, the value of each sound effect parameter will be affected by one or more motion parameters and one or more physiological parameters; alternatively, the mobile phone 101 can also calculate the value of the sound effect parameter through a polynomial. For example, the mobile phone 101 can jointly adjust the playing speed of the audio based on the heart rate and walking speed. For example, every time the heart rate increases by 10 times, the mobile phone 101 increases the playing speed of the audio according to the magnification A, and every time the walking speed increases by 0.5 m / s, the mobile phone 101 can increase the playing speed of the audio according to the magnification B. Then the increase amount of the audio speed = magnification A * {(heart rate change amount) / 10} + magnification B * {walking speed change amount / 0.5}. The above magnification A can be, for example, 0.01, 0.02, and the magnification B can be, for example, 0.01, 0.02. The embodiments of the present application do not limit this.

[0165] Not limited to the above-mentioned motion parameters and physiological parameters, the smart phone can also collect other motion parameters and physiological parameters, and the mobile phone 101 can adjust the sound effect parameters based on other motion parameters and physiological parameters. The embodiments of the present application do not limit this.

[0166] S506. Use a driving model to determine sound effect parameters based on driving state parameters and driving environment parameters.

[0167] When the mobile phone 101 determines that the dynamic sound effect mode is the driving mode, the mobile phone 101 can use the driving model to process the driving state parameters and driving environment parameters to obtain sound effect parameters. Among them, the driving model can also be called a second neural network, and the driving model can include one or more neural network models.

[0168] In some embodiments, the mobile phone 101 can determine the audio loudness based on the vehicle speed. When the driving device is traveling at a relatively high speed, the noise is often relatively large. The mobile phone 101 can increase the audio loudness to avoid the music sound being covered by the noise. Optionally, to ensure driving safety, the mobile phone 101 can also reduce the playing speed of the music when the vehicle speed is too high to reduce the dynamics of the music and reduce the excitement state of the user.

[0169] In some embodiments, the mobile phone 101 may determine the playing speed of music based on the driving acceleration. When the driving acceleration increases, the driving device is in an accelerating state, and the mobile phone 101 may increase the playing speed to match the user's excitement. When the driving acceleration decreases and the driving device decelerates and may enter a congested section, the mobile phone 101 may decrease the playing speed to soothe the user's mood.

[0170] In some embodiments, the mobile phone 101 may adjust the frequency response gain based on one or more of the vehicle speed and road conditions. When the road conditions are congested and / or the vehicle speed is slow, the mobile phone 101 may weaken the dynamic type of the song, reduce the frequency response gain of the intermediate frequency and high frequency signals, and then may increase the frequency response gain of the low frequency signal. Or, when the road conditions are congested and / or the vehicle speed is erratic, the mobile phone 101 may also reduce the frequency response gain of the intermediate frequency and high frequency signals, and then may increase the frequency response gain of the low frequency signal. Among them, the mobile phone 101 may determine the number of surrounding vehicles based on the radar sensor and / or obtain the road congestion condition from the network. Furthermore, the mobile phone 101 may quantify the congestion condition into a numerical value based on data such as the number of surrounding vehicles, the length of the congested road section obtained from the network, and the congestion time, and then input the quantization result into the second neural network. The above-mentioned erratic vehicle speed may mean that the number of times the vehicle speed is lower than the vehicle speed threshold A in one acquisition cycle exceeds the number A, and the number of times higher than the vehicle speed threshold B exceeds the number B. For example, the numbers A and B are 1. In one reporting data cycle of the driving device, the vehicle speed is lower than 10 kilometers per hour (vehicle speed threshold A) and higher than 40 kilometers per hour for many times. The values of the above numbers A, B, vehicle speed threshold A, and vehicle speed threshold B are only examples and do not constitute a limitation of the embodiments of the present application.

[0171] In some embodiments, the mobile phone 101 may determine the reverberation delay based on the temperature at the location where the driving device is located. When the temperature is high, the mobile phone 101 may increase the reverberation delay because when the temperature is high, the user may be relatively hot, and a longer reverberation time will appear empty and make people feel cool. Correspondingly, when the temperature is low, the mobile phone 101 may also reduce the reverberation delay. Optionally, the mobile phone 101 may also determine the reverberation delay based on the temperature inside the cockpit of the driving device.

[0172] Not limited to the above adjustment methods, there may also be other adjustment methods, and each of the above sound effect parameters may also be adjusted based on other driving state parameters and driving environment parameters. For example, when the road conditions are congested, the mobile phone 101 may also reduce the playing speed of the music, making the music more soothing.

[0173] The above driving state parameters and driving environment parameters are only examples and do not constitute a limitation of the embodiments of this application. The driving device may obtain more or fewer driving state parameters and driving environment parameters. In this way, the mobile phone 101 may adjust the sound effect parameters based on more or fewer driving state parameters and driving environment parameters. For example, the driving device may also determine the route complexity or road congestion level when the user is driving. When the road is complex and / or congested, the mobile phone 101 may also make the music more soothing. For example, lower the loudness of the audio, reduce the music playback speed, lower the mid-high frequency response gain, etc., to soothe the user's impatient state.

[0174] In some embodiments, the mobile phone 101 may not distinguish between the motion model and the driving model. When the mobile phone 101 is connected to both a sports health monitoring device and a driving device, the mobile phone 101 may jointly adjust the sound effect based on one or more of the motion parameters, physiological parameters, driving state parameters, and driving environment parameters. For example, when the mobile phone 101 can monitor a person's sleep quality through a smart bracelet, when the sleep quality is poor, the user's fatigue level is relatively high, and when the vehicle is in a state of approximate uniform motion (acceleration close to 0), the mobile phone 101 may increase the audio loudness, increase the playback speed, increase the mid-frequency and high-frequency signal gain, etc., to increase the rhythm of the song, thereby invigorating the user's spirit and avoiding danger when the user is driving in a fatigued state.

[0175] Not limited to the sound effect parameters mentioned in S505 and S506, other sound effect parameters may also be included. The embodiments of this application also do not limit the sound effect parameters that the mobile phone 101 can adjust based on the above parameters such as motion parameters, physiological parameters, driving state parameters, and driving environment parameters.

[0176] The determination or adjustment of the sound effect parameters based on the motion parameters and physiological parameters as described above may refer to inputting one or more of the motion parameters and physiological parameters into the first neural network to obtain the sound effect parameters, or may refer to calculating the sound effect parameters by means of polynomials. Similarly, the determination or adjustment of the sound effect parameters based on the driving state parameters and driving environment parameters may also refer to inputting one or more of the driving state parameters and driving environment parameters into the second neural network to obtain the sound effect parameters, or calculating the sound effect parameters by means of polynomials. For example, the mobile phone 101 determining the music playback speed based on the driving acceleration means that the mobile phone 101 inputs the driving acceleration into the second neural network to obtain the music playback speed, or the mobile phone 101 may calculate by means of polynomials, such as the music playback speed = driving acceleration × magnification factor C.

[0177] S507. Update the sound effect parameters.

[0178] After the mobile phone 101 adjusts the sound effect parameters, the sound effect parameters in the mobile phone 101 can update the sound effect parameters so that they are applied to the player of the application program that is playing music. The application can be a music application or other applications that can play music. The embodiments of the present application do not limit this.

[0179] Figure 6 It is a flowchart of the sound effect adjustment method provided by the embodiments of the present application.

[0180] As Figure 6 shown, the method may include but is not limited to the following steps:

[0181] S601. The first electronic device plays the first audio.

[0182] Among them, the first electronic device may be, for example, the mobile phone 101 in the communication system 10. Without limitation, the first electronic device may also be other types of devices. The embodiments of the present application do not limit this.

[0183] Referring to Figure 4F the embodiment shown, the first electronic device may play the first audio in response to the operation of the user clicking the playback control button 421. Among them, the first electronic device may play the first audio using the second sound effect parameters. The second sound effect parameters may be the sound effect parameters set by the user, or the sound effect parameters stored by the first electronic device. Or, the second sound effect parameters may also be obtained by the first electronic device based on the second data collected by the second electronic device. The second data may include motion parameters and physiological parameters, and / or the second data includes driving state parameters and / or driving environment parameters. The time period during which the second data is collected may be the same as, partially the same as, or completely different from the time period during which the first data is collected.

[0184] S602. The first electronic device obtains the first data collected by the second electronic device. The first data includes motion parameters and physiological parameters, and / or the first data includes driving state parameters and / or driving environment parameters.

[0185] S603. The first electronic device adjusts the sound effect parameters of the first audio based on the first data to obtain the first sound effect parameters.

[0186] The first electronic device may adjust the sound effect parameters of the first audio based on the first data collected by the second electronic device, so that the sound effect parameters when the first audio is played change based on the data collected by the second electronic device. Among them, for the introduction of the method of adjusting the sound effect parameters based on the first data when the first data is motion parameters and physiological parameters, reference may be made to the foregoing step S502. For the introduction of the method of adjusting the sound effect parameters based on the first data when the first data is driving state parameters and driving environment parameters, reference may be made to the foregoing step S503.

[0187] Among them, the method by which the first electronic device determines the first sound effect parameter based on the first data can refer to Figure 5 the introduction of the embodiments shown, which will not be elaborated here.

[0188] In some embodiments, the first sound effect parameter is obtained by the first electronic device through processing the motion parameter and the physiological parameter by a first neural network, and the first neural network is used to determine one or more sound effect parameters based on the motion parameter and the physiological parameter. Optionally, the second electronic device is a motion and health monitoring device, and the first data includes the motion parameter and the physiological parameter.

[0189] For example, the second electronic device can be an intelligent bracelet 102 as shown in Figure 1 The second electronic device can report the motion parameter and the physiological parameter to the first electronic device. In this way, the first electronic device can process the motion parameter and the physiological parameter through the first neural network to obtain the first sound effect parameter. In the embodiments of the present application, the first neural network can also be called a motion model. When the first data is the motion parameter and the physiological parameter, the method by which the first electronic device determines the first sound effect parameter can refer to Figure 5 the steps in the embodiments shown in S505, which will not be elaborated here.

[0190] In some embodiments, the first sound effect parameter is obtained by the first electronic device through processing the driving state parameter and / or the driving environment parameter by a second neural network, and the second neural network is used to determine one or more sound effect parameters based on the driving state parameter and / or the driving environment parameter. Optionally, the second electronic device is a driving device, and the first data includes the driving state parameter and / or the driving environment parameter.

[0191] Among them, the second neural network can be called a driving model. The first electronic device can input the driving state parameter and / or the driving environment parameter into the second neural network, and the second neural network will output one or more sound effect parameters. Among them, the method by which the first electronic device determines the first sound effect based on the driving state parameter and / or the driving environment parameter can refer to the foregoing Figure 5 steps in the embodiments shown in S506, which will not be elaborated here.

[0192] In the case where the first data is the motion parameter and the physiological parameter, the first electronic device processes the first data through the first neural network to obtain the first sound effect parameter; in the case where the first data is the driving state parameter and / or the driving environment parameter, the first electronic device processes the first data through the second neural network to obtain the first sound effect parameter; among them, the input of the first neural network is the motion parameter and the physiological parameter, and the output is one or more sound effect parameters, and the input of the second neural network is the driving state parameter and / or the driving environment parameter, and the output is one or more sound effect parameters.

[0193] Among them, when the first data is motion parameters and physiological parameters, the first electronic device can determine that the dynamic sound effect function is in the sports mode. Furthermore, the first neural network can process the first data using the first neural network. When the first data is driving state parameters and driving environment parameters, the first electronic device's dynamic sound effect function is in the driving mode, and then the second neural network is used to process the first data. Among them, the method by which the first electronic device determines the mode of the dynamic sound effect function can refer to Figure 5 Step S504 in the illustrated embodiment, which will not be elaborated here.

[0194] In some embodiments, when the second electronic device is a sports health monitoring device, the first electronic device receives the motion parameters and physiological parameters sent by the second electronic device every first time length, and the first electronic device updates the sound effect parameters based on the motion parameters and physiological parameters every second time length.

[0195] Among them, the sports health monitoring device can report the motion parameters and / or physiological parameters once every first time length, and this first time length can also be referred to as preset period 1. The first electronic device can update the sound effect parameters every second time length, and the second time length can also be referred to as preset period 2. The relationship between preset period 1 and preset period 2 can refer to the foregoing introduction, which will not be elaborated here.

[0196] In some embodiments, when the second electronic device is a driving device, the first electronic device receives the driving state parameters and / or driving environment parameters sent by the second electronic device every third time length, and the first electronic device updates the sound effect parameters based on the driving state parameters and / or driving environment parameters every fourth time length.

[0197] Among them, the driving device can report the driving state parameters and / or driving environment parameters once every third time length, and the third time length can also be referred to as preset period 3. Among them, the period (fourth time length) for the first electronic device to update the sound effect parameters can be the same as or different from the time period (third time length) for the driving device to report parameters. The embodiments of the present application do not limit this. The relationship between the third time length and the fourth time length can refer to the relationship between the first time length and the second time length described above, which will not be elaborated here.

[0198] In some embodiments, the parameters in the first data and the thresholds corresponding to the parameters satisfy the first condition.

[0199] That is to say, the second electronic device can compare the parameters in the first data with the thresholds corresponding to the parameters, and report the data only when the parameters in the first data and the thresholds corresponding to the parameters meet the first condition. In this way, the second electronic device can exclude the interference caused by some subtle movements from affecting the sound effect. Exemplarily, taking the first data including motion parameters and physiological parameters as an example, the second electronic device can set a step speed threshold for the step speed in the motion parameters, and the step speed threshold can be 1 m / s. The second electronic device can also set a body temperature threshold for the body temperature, and the body temperature threshold can be 37°C. The second electronic device can report the data only when there are parameters exceeding the corresponding thresholds. For example, only when the user's body temperature exceeds 37°C, the second electronic device reports the motion data and physiological parameters to the first electronic device. Or, the second electronic device can also report only the data that exceeds the corresponding threshold. For example, when the user's body temperature exceeds 37°C and the step speed does not exceed the step speed threshold, the second electronic device can report only the body temperature and not report other parameters such as the step speed. In this way, the first electronic device can adjust the sound effect parameters only based on the body temperature, or the first electronic device can adjust the sound effect based on the body temperature, as well as other motion parameters and physiological parameters reported by the second electronic device last time. In the above example, the first condition can include that the step speed exceeds the step speed threshold and the body temperature exceeds the body temperature threshold.

[0200] In some embodiments, the motion parameters include one or more of the following: speed, motion acceleration, and the physiological parameters include one or more of the following: heart rate, heart rate change rate, psychological stress index, body temperature. Among them, the relationship between the first sound effect parameter and the first data includes one or more of the following: the faster the heart rate, the higher the audio loudness; the faster the heart rate change rate, the greater the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the faster the heart rate change rate, the smaller the frequency response gain of the low frequency signal; the higher the psychological stress index, the longer the reverberation delay; the higher the body temperature, the longer the reverberation delay; the greater the motion acceleration, the faster the playback speed.

[0201] Among them, each first sound effect parameter can be determined by one of the motion parameters and physiological parameters, or can be determined by multiple ones, and the embodiments of the present application do not limit this.

[0202] In some embodiments, the driving state parameters include one or more of the following: vehicle speed, driving acceleration, and the driving environment parameters include one or more of the following: road conditions at the location of the first driving device, temperature. Among them, the relationship between the first sound effect parameter and the first data can include one or more of the following: the faster the vehicle speed, the higher the audio loudness; the greater the driving acceleration, the faster the playback speed; the faster the vehicle speed, the greater the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the more congested the road conditions, the smaller the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the lower the temperature, the shorter the reverberation delay.

[0203] In some embodiments, after the first electronic device adjusts the sound effect parameters of the first audio based on the first data, the method further includes: the first electronic device receives a first user operation for storing the first sound effect parameters, and in response to the first user operation, the first electronic device stores the first sound effect parameters.

[0204] Taking Figure 4I the illustrated embodiment as an example, the first user operation may be, for example, an operation of clicking the sound effect save button 442. In response to this operation, the first electronic device may store Sound Effect C, where Sound Effect C may be referred to as the first sound effect parameter.

[0205] In some embodiments, after the first electronic device stores the first sound effect parameters, the method further includes: the first electronic device receives a second user operation for applying the first sound effect parameters, and in response to the second user operation, the first electronic device plays the audio using the first sound effect parameters.

[0206] Taking Figure 4N the illustrated embodiment as an example, the second user operation may be, for example, an operation of the user clicking the use sound effect button 462. In response to this operation, the first electronic device may play the audio using the first sound effect parameters in subsequent audio playback.

[0207] The apparatus for executing the above method provided by the embodiments of the present application will be described below.

[0208] Figure 7 FIG. 700 is a schematic structural diagram of a music playing apparatus 700 provided by an embodiment of the present application. The music playing apparatus 700 may be the electronic device in the embodiments of the present application, or a chip or a chip system within the electronic device.

[0209] As Figure 7 shown, the music playing apparatus 700 may include a communication unit 701, a playing unit 702, and a sound effect adjustment unit 703.

[0210] Among them, the communication unit 701 is used to establish a communication connection with the second electronic device; the playing unit 702 is used to play the first audio. The communication unit 701 is further used to obtain the first data collected by the second electronic device, where the first data includes motion parameters and physiological parameters, or the first data includes driving state parameters and / or driving environment parameters; the sound effect adjustment unit 703 is used to adjust the sound effect parameters of the first audio based on the first data to obtain the first sound effect parameters.

[0211] In some embodiments, the first sound effect parameters are obtained by the sound effect adjustment unit 703 processing the motion parameters and physiological parameters through a first neural network, and the first neural network is used to determine one or more sound effect parameters based on the motion parameters and physiological parameters. Optionally, the second electronic device is a sports and health monitoring device, and the first data includes motion parameters and physiological parameters.

[0212] In some embodiments, the first sound effect parameter is obtained by the sound effect adjustment unit 703 through processing the driving state parameter and / or the driving environment parameter by a second neural network, and the second neural network is used to determine one or more sound effect parameters based on the driving state parameter and / or the driving environment parameter. Optionally, the second electronic device may be a driving device, and the first data includes the driving state parameter and / or the driving environment parameter.

[0213] In some embodiments, when the first data is a motion parameter and a physiological parameter, the sound effect adjustment unit 703 is used to process the first data through a first neural network to obtain a first sound effect parameter; when the first data is a driving state parameter and / or a driving environment parameter, the sound effect adjustment unit 703 is used to process the first data through a second neural network to obtain a first sound effect parameter; wherein, the input of the first neural network is the motion parameter and the physiological parameter, and the output is one or more sound effect parameters, and the input of the second neural network is the driving state parameter and / or the driving environment parameter, and the output is one or more sound effect parameters.

[0214] In some embodiments, when the second electronic device is a sports and health monitoring device, the communication unit 701 is used to receive the motion parameter and the physiological parameter sent by the second electronic device every first time length, and the sound effect adjustment unit 703 can be used to update the sound effect parameter based on the motion parameter and the physiological parameter every second time length.

[0215] In some embodiments, when the second electronic device is a driving device, the communication unit 701 is used to receive the driving state parameter and / or the driving environment parameter sent by the second electronic device every third time length, and the sound effect adjustment unit 703 is used to update the sound effect parameter based on the driving state parameter and / or the driving environment parameter every fourth time length.

[0216] In some embodiments, the music playing device 700 further includes an operation receiving unit and a storage unit. After the sound effect adjustment unit 703 adjusts the sound effect parameter of the first audio based on the first data, the operation receiving unit is used to receive a first user operation for storing the first sound effect parameter, and the storage unit is used to store the first sound effect parameter in response to the first user operation.

[0217] In some embodiments, after the storage unit stores the first sound effect parameter, the operation receiving unit is further used to receive a second user operation for applying the first sound effect parameter, and in response to the second user operation, the sound effect adjustment unit 703 is used to play the audio with the first sound effect parameter.

[0218] Figure 8 It is a schematic structural diagram of a chip provided by an embodiment of the present application. As Figure 8As shown, chip 800 includes one or more than two (including two) processors 801, communication lines 802, and communication interfaces 803. Optionally, chip 800 further includes a memory 804.

[0219] In some embodiments, the memory 804 stores the following elements: executable modules or data structures, or subsets thereof, or extended sets thereof.

[0220] The methods described in the embodiments of the present application above can be applied to the processor 801 or implemented by the processor 801. The processor 801 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above methods can be completed by the integrated logic circuit in the hardware of the processor 801 or by instructions in software form. The above processor 801 may be a general-purpose processor (e.g., a microprocessor or a conventional processor), a digital signal processor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate, transistor logic devices, or discrete hardware components. The processor 801 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application.

[0221] The steps of the methods disclosed in combination with the embodiments of the present application can be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. Among them, the software modules can be located in mature storage media in the art such as random access memory, read-only memory, programmable read-only memory, or electrically erasable programmable read-only memory (EEPROM). This storage medium is located in the memory 804, and the processor 801 reads the information in the memory 804 and combines its hardware to complete the steps of the above methods.

[0222] Communication can be carried out among the processor 801, the memory 804, and the communication interface 803 through the communication lines 802.

[0223] In the above embodiments, the instructions stored in the memory for the processor to execute can be implemented in the form of a computer program product. Among them, the computer program product can be pre-written in the memory, or downloaded and installed in the memory in software form.

[0224] The embodiments of the present application also provide a computer program product, which includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from a website, a computer, a server, or a data center to another website, a computer, a server, or a data center in a wired manner (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or a wireless manner (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a server or a data center that includes one or more available media integrated. For example, the available medium may include a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as a digital versatile disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0225] The embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program or instructions. When the computer program or instructions are executed by a processor, the above-mentioned method is implemented. The method described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If it is implemented in software, the function may be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. The computer-readable medium may include a computer storage medium and a communication medium, and may also include any medium that can transmit a computer program from one place to another. The storage medium may be any target medium accessible by a computer.

[0226] As a possible design, a computer-readable medium may include a compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disc storage; the computer-readable medium may include a magnetic disk storage or other magnetic disk storage device. Moreover, any connecting line may also be properly referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of the medium. As used herein, magnetic disks and optical discs include optical discs (CDs), laser discs, optical discs, DVDs, floppy disks, and Blu-ray discs, where magnetic disks typically reproduce data magnetically, while optical discs utilize lasers to optically reproduce data. Combinations of the above should also be included within the scope of computer-readable media.

[0227] As described above, the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0228] In the above embodiments, depending on the context, the term "when..." can be interpreted to mean "if...", or "after...", or "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "upon determining..." or "if (the stated condition or event) is detected" can be interpreted to mean "if determined...", or "in response to determining...", or "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0229] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more integrated available media. The available medium may be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive), etc.

[0230] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware with a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The foregoing storage medium includes various media that can store program codes such as ROM or random access memory RAM, magnetic disks, or optical discs.

Claims

1. A sound effect adjustment method, characterized in that: The method is applied to a first electronic device, the first electronic device establishes a communication connection with a second electronic device, and the method includes: The first electronic device plays a first audio; The first electronic device acquires first data collected by the second electronic device; The first electronic device processes the first data based on the content of the first data, wherein if the first data includes motion parameters and physiological parameters from a motion health monitoring device, the second electronic device includes the motion health monitoring device, the first electronic device determines that the user is in a motion scene, and the first electronic device processes the first data using a first neural network to obtain a first sound effect parameter, If the first data includes driving state parameters and / or driving environment parameters from a driving device, the second electronic device includes the driving device, the first electronic device determines that the user is in a driving scene, and the first electronic device uses a second neural network to process the first data to obtain the first sound effect parameters, the first sound effect parameters include one or more of the following: audio loudness, frequency response gain, reverberation delay and playback speed, the driving state parameters include one or more of the following: vehicle speed, driving acceleration, and the driving environment parameters include one or more of the following: road conditions, temperature; The first electronic device adjusts the sound effect of the first audio based on the first sound effect parameter; Among them, the input of the first neural network is the motion parameter and the physiological parameter, and the output is one or more sound effect parameters; the input of the second neural network is the driving state parameter and / or driving environment parameter, and the output is one or more sound effect parameters.

2. The method according to claim 1, characterized in that When the second electronic device is a sports health monitoring device, the first electronic device receives the motion parameters and the physiological parameters sent by the second electronic device at a first time length, and the first electronic device updates the sound effect parameters based on the motion parameters and the physiological parameters at a second time length.

3. The method according to claim 1, characterized in that In the case where the second electronic device is a driving device, the first electronic device receives the driving state parameters and / or driving environment parameters sent by the second electronic device at third time intervals, and the first electronic device updates the sound effect parameters based on the driving state parameters and / or driving environment parameters at fourth time intervals.

4. The method according to any one of claims 1 to 3, characterized in that The motion parameters include one or more of the following: speed, motion acceleration; the physiological parameters include one or more of the following: heart rate, heart rate change rate, psychological stress index, body temperature.

5. The method according to claim 4, characterized in that If the first data includes sports parameters and physiological parameters from a sports health monitoring device, the relationship between the first sound effect parameter and the first data includes one or more of the following: the faster the heart rate, the higher the audio loudness; the faster the heart rate change rate, the greater the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the faster the heart rate change rate, the smaller the frequency response gain of the low frequency signal; the higher the psychological stress index, the longer the reverberation delay; the higher the body temperature, the longer the reverberation delay; the greater the movement acceleration, the faster the playback speed.

6. The method according to any one of claims 1 to 3, characterized in that If the first data includes driving state parameters and / or driving environment parameters from a driving device, the relationship between the first sound effect parameter and the first data includes one or more of the following: the faster the vehicle speed, the higher the audio loudness; the greater the driving acceleration, the faster the playback speed; the faster the vehicle speed, the greater the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the more congested the road conditions, the smaller the frequency response gain of the intermediate frequency signal and / or the high frequency signal; the lower the temperature, the shorter the reverberation delay.

7. The method according to any one of claims 1 to 3, characterized in that After the first electronic device adjusts the sound effect parameters of the first audio based on the first data, the method further includes: The first electronic device receives a first user operation of storing the first sound effect parameter, and in response to the first user operation, the first electronic device stores the first sound effect parameter.

8. The method according to claim 7, characterized in that After the first electronic device stores the first sound effect parameter, the method further includes: The first electronic device receives a second user operation of applying the first sound effect parameter, and in response to the second user operation, the first electronic device plays audio using the first sound effect parameter.

9. An electronic device, characterized in that: The electronic device comprises: a display screen, a memory, and a processor coupled to the memory; the display screen is used to display a user interface, the memory stores a computer program, and when the processor executes the computer program, the electronic device implements the method as described in any one of claims 1-8.

10. A computer-readable storage medium storing computer instructions, characterized in that: When the computer instructions are executed on a processor, the method according to any one of claims 1 to 8 is performed.

11. A computer program product comprising computer instructions, characterized in that: When the computer instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images