Audio adjustment method and device, terminal device and earphone
By incorporating a proximity sensor into the headphones, audio parameters are automatically adjusted, resolving the issue of poor audio adjustment in open-back headphones and achieving more accurate and flexible audio optimization.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2025-01-26
- Publication Date
- 2026-07-31
AI Technical Summary
In existing technologies, audio adjustment of open-back headphones relies on users manually adjusting the wearing position, resulting in poor audio adjustment effects.
A proximity sensor is installed in the headphones. By measuring the distance between the sensor and the user's ear, audio parameters are automatically adjusted to optimize audio performance, including volume and sound quality.
By automatically adjusting audio parameters, the accuracy and effectiveness of audio adjustments are improved, avoiding the inconvenience of manual adjustments and enhancing the audio experience.
Smart Images

Figure CN122496742A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of audio technology, and more particularly to an audio adjustment method, apparatus, terminal device, and headphones. Background Technology
[0002] Users can listen to audio by wearing open-back headphones. Because users wearing open-back headphones can hear ambient sounds, they need to adjust the audio playback settings.
[0003] In practical applications, the wearing position of the headphones can be manually adjusted according to the user's ear shape and wearing habits to make the audio playback more suitable for the user's requirements. However, because the user manually adjusts the wearing position to adjust the audio, the audio adjustment effect is relatively poor. Summary of the Invention
[0004] This disclosure provides an audio adjustment method, apparatus, terminal device, and headphones to overcome the problem of poor audio adjustment effect.
[0005] In a first aspect, embodiments of this disclosure provide an audio adjustment method applied to a terminal device, comprising:
[0006] A first distance is acquired from each distance sensor, which is installed in the earphone. The first distance is the distance between the distance sensor and a target position of the human ear, and the target position is determined based on the first position of the distance sensor in the earphone.
[0007] Obtain the first audio currently being played by the headphones;
[0008] Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio.
[0009] Secondly, embodiments of this disclosure provide an audio adjustment method applied to headphones, wherein the headphones are equipped with at least one distance sensor, including:
[0010] Acquire a first distance from each distance sensor, where the first distance is the distance between the distance sensor and the target position of the human ear, and the target position is determined based on the first position of the distance sensor set on the earphone.
[0011] Obtain the first audio currently being played by the headphones;
[0012] Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio.
[0013] Thirdly, embodiments of this disclosure provide an audio adjustment device, which is disposed in a terminal device or headphones, the device comprising:
[0014] The first acquisition module is used to acquire a first distance collected by each distance sensor, wherein the distance sensor is installed in the earphone, and the first distance is the distance between the distance sensor and the target position of the human ear, wherein the target position is determined based on the first position of the distance sensor in the earphone.
[0015] The second acquisition module is used to acquire the first audio currently being played by the headphones;
[0016] The first processing module is used to adjust the first audio based on the first distance collected by each distance sensor to obtain the target audio.
[0017] Fourthly, embodiments of this disclosure provide a terminal device, including: at least one processor and a memory;
[0018] The memory stores computer-executed instructions;
[0019] The at least one processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the audio adjustment method as described in the first aspect and various possible designs of the first aspect.
[0020] Fifthly, embodiments of this disclosure provide an earphone, including: at least one processor and a memory;
[0021] The memory stores computer-executed instructions;
[0022] The at least one processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the audio adjustment method as described in the second aspect above and various possible designs of the second aspect.
[0023] In a sixth aspect, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the audio adjustment method as described in the first aspect and various possible designs of the first aspect, or the second aspect and various possible designs of the second aspect.
[0024] In a seventh aspect, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the audio adjustment method as described in the first aspect and various possible designs of the first aspect, or the second aspect and various possible designs of the second aspect.
[0025] The audio adjustment method, apparatus, terminal device, and headphones provided in this embodiment include at least one distance sensor in the headphones. The system can acquire a first distance collected by each distance sensor in the headphones, as well as the first audio currently being played by the headphones. The first distance is the distance between the distance sensor and a target position of the user's ear. Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio. In this process, since the target position is a feature point corresponding to the user's ear when wearing the headphones, and this feature point is a key location affecting the audio effect heard by the user, adjusting the audio based on the first distance obtained from the target position allows for more accurate audio adjustment. This avoids the need for the user to manually adjust the wearing position of the headphones to adjust the audio, thus improving the audio adjustment effect. Attached Figure Description
[0026] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0027] Figure 1 A schematic diagram illustrating an application scenario provided by an embodiment of this disclosure;
[0028] Figure 2 A flowchart illustrating an audio adjustment method provided in an embodiment of this disclosure;
[0029] Figure 3 This is a schematic diagram illustrating the process of setting up at least one distance sensor according to an embodiment of this application;
[0030] Figure 4 This is a schematic diagram illustrating the process of obtaining the first audio currently being played by the headphones, provided in an embodiment of this application.
[0031] Figure 5 A flowchart illustrating another audio adjustment method provided in this embodiment of the disclosure;
[0032] Figure 6 This is a schematic diagram of the structure of the earphone provided in an embodiment of this application;
[0033] Figure 7 A schematic diagram illustrating the audio adjustment process provided in this embodiment of the disclosure;
[0034] Figure 8 This is a schematic diagram of the structure of an audio adjustment device provided in an embodiment of the present disclosure;
[0035] Figure 9 This is a schematic diagram of another audio adjustment device provided in an embodiment of the present disclosure;
[0036] Figure 10 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present disclosure;
[0037] Figure 11 This is a schematic diagram of the structure of an earphone provided in an embodiment of the present disclosure.
[0038] The accompanying drawings have illustrated specific embodiments of this disclosure, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this disclosure to those skilled in the art through reference to particular embodiments. Detailed Implementation
[0039] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0040] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0041] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with relevant laws, regulations and standards, and corresponding operation entry points are provided for users to choose to authorize or refuse.
[0042] To facilitate understanding, the following will be combined with... Figure 1 The application scenarios applicable to the embodiments of this disclosure are described below.
[0043] Figure 1 This is a schematic diagram illustrating an application scenario provided by an embodiment of this disclosure. Please refer to [link / reference]. Figure 1The system includes a terminal device 101 and earphones 102. Terminal device 101 can be a mobile phone, tablet computer, etc. Earphones 102 can be open-back headphones. After establishing a Bluetooth connection between terminal device 101 and earphones 102, terminal device 101 can send a first audio file to be played to earphones 102. Upon receiving the first audio file, earphones 102 will play it. The first audio file can be adjusted during playback.
[0044] In practical applications, the wearing position of the headphones can be manually adjusted according to the user's ear shape and wearing habits to make the audio playback more suitable for the user's requirements. However, because the user manually adjusts the wearing position to adjust the audio, the audio adjustment effect is relatively poor.
[0045] In this embodiment, the earphone is equipped with at least one distance sensor. It can acquire a first distance collected by each distance sensor and a first audio signal currently being played. The first distance is the distance between the distance sensor and a target position of the user's ear. Based on the first distance collected by each distance sensor, the first audio signal is adjusted to obtain the target audio signal. In this process, since the target position is a feature point corresponding to the user's ear when wearing the earphone, and this feature point is a key location affecting the audio effect heard by the user, adjusting the audio based on the first distance obtained from the target position allows for more accurate audio adjustment. This avoids the need for the user to manually adjust the earphone's wearing position to adjust the audio, thus improving the effectiveness of audio adjustment.
[0046] The method disclosed herein will now be described through specific embodiments. It should be noted that the following embodiments may exist independently or in combination with each other; identical or similar content will not be repeated in different embodiments.
[0047] Figure 2 This is a schematic flowchart illustrating an audio adjustment method provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 2 The method may include:
[0048] S201. Obtain the first distance collected by each distance sensor.
[0049] The execution entity of this disclosure can be a terminal device or headphones, or an audio adjustment device installed in a terminal device or headphones. The audio adjustment device can be implemented through software or a combination of software and hardware. The terminal device can be a mobile phone, tablet computer, computer, etc. The headphones can be open-back headphones.
[0050] If the executing entity is a terminal device, then the terminal device needs to establish a connection with the headset to enable data transmission between them. For example, the terminal device and headset can establish a Bluetooth connection, a wireless network connection, etc. The terminal device can control the headset through an application configured on the terminal device.
[0051] A distance sensor is installed in the earphone. The first distance is the distance between the distance sensor and the target position of the ear. The target position is determined based on the first position of the distance sensor in the earphone.
[0052] Distance sensors can be capacitive sensors based on capacitance characteristics, optics, acoustics, etc. Other types include proximity sensors, time-of-flight sensors, and ultrasonic sensors. Preferably, the distance sensor can be a matrix type.
[0053] Below, in conjunction with Figure 3 The process of setting up the distance sensor will be explained. Figure 3 This is a schematic diagram illustrating the process of setting up at least one distance sensor according to an embodiment of this application. Please refer to... Figure 3 This includes earphone 301. Earphone 301 has three proximity sensors: proximity sensor 1, proximity sensor 2, and proximity sensor 3. Proximity sensor 1 is located at position 1, proximity sensor 2 at position 2, and proximity sensor 3 at position 3.
[0054] When the headphones are worn on the auricle, distance sensor 1 is at position 1, which can be positioned relative to the concha. Therefore, the target position of the ear corresponding to distance sensor 1 is the concha. The first distance collected by distance sensor 1 can be the distance between position 1 and the plane of the ear canal. Distance sensor 2 is at position 2, and the target position of the ear corresponding to distance sensor 2 is the facial area near the front of the helix. The first distance collected by distance sensor 2 can be the distance between position 2 and the facial area near the front of the helix. Based on the first distance collected by distance sensor 2, the relative position of the headphone's ear hook to the helix angle or other ear features can be determined, assessing headphone wearing and interference. Distance sensor 3 is at position 3, and the target position of the ear corresponding to distance sensor 3 is the ear canal entrance. The first distance collected by distance sensor 3 can be the distance between position 3 and the ear canal entrance. Based on the first distance collected by distance sensor 3, adjustment parameters (e.g., gain, equalizer parameters, spatial audio parameters, etc.) can be determined.
[0055] Optionally, position 1 can also be set relative to the helix. Therefore, the target position of the ear corresponding to distance sensor 1 is the helix position. The first distance acquired by distance sensor 1 can be the distance between position 1 and the helix.
[0056] It should be noted that the number of proximity sensors, the initial position of each proximity sensor, and the target position corresponding to each proximity sensor can be determined based on the shape, parameters, and usage scenario of the headphones. This application does not impose any restrictions.
[0057] If the executing entity is the headset, the headset can directly acquire the first distance collected by each distance sensor. If the executing entity is the terminal device, the headset acquires the first distance collected by each distance sensor and then sends the first distance collected by each distance sensor to the terminal device.
[0058] S202, Get the first audio currently playing on the headphones.
[0059] Users can specify the first audio in the terminal device so that the terminal device or headphones can acquire the first audio.
[0060] Below, in conjunction with Figure 4 This section explains the process of obtaining the first audio currently playing from the headphones. Figure 4 This is a schematic diagram illustrating the process of obtaining the first audio currently being played by the headphones, as provided in an embodiment of this application. Please refer to... Figure 4 This includes interfaces 401 to 402. Interfaces 401 and 402 can be pages provided by the terminal device. Referring to interface 401, when the user swipes down on the main page of the terminal device, the terminal device responds by displaying a drop-down control page. The user then clicks the Bluetooth icon on the drop-down control page. In response to this click, the terminal device activates Bluetooth and establishes a Bluetooth connection with the headset.
[0061] Please refer to interface 402. The user clicks the play icon corresponding to song 1 in the drop-down control page. The terminal device responds to the user's click operation and begins to control the headphones to play the first audio song 1. At this time, if the executing entity is the terminal device, the terminal device can directly obtain the first audio song 1. If the executing entity is the headphones, after the terminal device determines that the first audio is song 1, it sends the first audio song 1 to the headphones so that the headphones can obtain the currently playing first audio.
[0062] S203. Based on the first distance collected by each distance sensor, adjust and process the first audio to obtain the target audio.
[0063] The first audio can be adjusted based on the first distance collected by each distance sensor in the following ways: adjusting the volume of the first audio to obtain a target volume; and / or adjusting the sound quality of the first audio to obtain a target sound quality.
[0064] Adjusting the volume of the first audio audio includes increasing or decreasing the volume of the first audio audio; and / or adjusting the sound quality of the first audio audio includes adjusting the frequency response of the first audio audio and at least one of the frequency response-related parameters.
[0065] Frequency response, and frequency response-related parameters, include at least one of the following: equalizer parameters, dynamic equalizer parameters, signal compression and enhancement, delay, spatial object information, low-frequency enhancement and regeneration, or signal amplitude limiting.
[0066] The position of the headphones relative to the human ear can be determined based on the first distance collected by each distance sensor, thereby adjusting and processing the first audio.
[0067] For example, if the headphones are determined to be close to the ear based on the first distance collected by each distance sensor, the volume of the first audio audio can be decreased when adjusting the volume. Conversely, if the headphones are determined to be far from the ear based on the first distance collected by each distance sensor, the volume of the first audio audio can be increased when adjusting the volume.
[0068] The audio adjustment method provided in this disclosure acquires a first distance collected by each distance sensor. It also acquires the first audio currently playing through the headphones. Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain a target audio. In this process, since the target position is a feature point corresponding to the user's ear when wearing the headphones, and these feature points are key locations affecting the audio's sound quality, adjusting the audio based on the first distance obtained from the target position allows for more accurate audio adjustment. This avoids the need for the user to manually adjust the headphone's wearing position to adjust the audio, thus improving the audio adjustment effect.
[0069] Based on any of the above embodiments, the following, in conjunction with Figure 5 The audio adjustment process (S203) is explained in detail.
[0070] Figure 5 This is a flowchart illustrating another audio adjustment method provided in an embodiment of this disclosure. Please refer to... Figure 5 The method includes:
[0071] S501. Determine the wearing status of the headphones based on the first distance collected by each distance sensor.
[0072] The wearing status of the headphones can be determined based on the first distance collected by each distance sensor in the following manner: if the first distance collected by at least one of the distance sensors is greater than a preset distance, the wearing status of the headphones is determined to be an unworn status; otherwise, the wearing status of the headphones is determined to be a worn status.
[0073] The preset distance can be determined based on ergonomic wearing comfort simulations and adjustments made based on actual product wearing conditions. The preset distance can be set in advance and stored in the preset storage space of the terminal device or headphones.
[0074] For example, assuming the headphones are as described above Figure 3 The earphone 301 shown contains distance sensor 1, distance sensor 2, and distance sensor 3. Distance sensor 1 is located at position 1, distance sensor 2 at position 2, and distance sensor 3 at position 3. The preset distance is 8mm. The specific acquisition of the first distance from each distance sensor is shown in Table 1.
[0075] Table 1
[0076] Distance sensor First distance Distance sensor 1 1mm Distance sensor 2 2mm Distance sensor 3 0.8mm
[0077] As shown in Table 1, it can be determined that the first distance collected by each distance sensor is less than the preset distance of 8mm. Therefore, it can be determined that the headphones are being worn.
[0078] S502. If the wearing status is "worn", determine the adjustment parameters based on the first distance collected by each distance sensor.
[0079] Adjustment parameters include preset volume and / or at least one preset gain.
[0080] If the first audio is adjusted based on the first distance collected by each distance sensor, including adjusting the volume of the first audio, to obtain the target volume, then the adjustment parameters include the preset volume.
[0081] If the first audio is adjusted based on the first distance collected by each distance sensor, including adjusting the sound quality of the first audio to obtain the target sound quality, then the adjustment parameters include at least one preset gain.
[0082] If the first audio is adjusted based on the first distance collected by each distance sensor, including adjusting the volume and sound quality of the first audio, then the adjustment parameters include a preset volume and at least one preset gain.
[0083] When adjusting the sound quality, each sound quality corresponds to a preset gain parameter, or at least one sound quality corresponds to a preset gain parameter. This application does not impose any limitations.
[0084] For example, the parameters for adjusting the first audio quality include the frequency response, equalizer parameters, and delay of the first audio. Then at least one preset gain includes the preset gain corresponding to the frequency response, the preset gain corresponding to the equalizer parameters, and the preset gain corresponding to the delay. Alternatively, the preset gain can be the preset gain corresponding to the frequency response, equalizer parameters, and delay of the first audio.
[0085] The target distance can be obtained by processing the first distance collected by each distance sensor using a first preset algorithm. Adjustment parameters are then determined based on the target distance.
[0086] At least one distance range and corresponding adjustment parameters for each distance range can be preset. The preset storage space of the terminal device or headphones can then be stored for these parameters.
[0087] After adjusting the first audio file, a target volume and / or target audio quality are obtained. The volume of the target audio file is determined as the target volume, and / or the audio quality of the target audio file is determined as the target audio quality.
[0088] For example, by processing at least one of the first distances shown in Table 1 above using a preset algorithm, a target distance of 5mm is obtained. The distance range corresponding to 5mm is obtained from the preset storage space as 4mm to 6mm, and the adjustment parameter corresponding to 4mm to 6mm is obtained as adjustment parameter 2. Adjustment parameter 2 includes preset volume 2, preset gain A2 corresponding to frequency response, preset gain B2 corresponding to equalizer parameters, and preset gain C2 corresponding to delay.
[0089] S503. Adjust the first audio according to the adjustment parameters to obtain the target audio.
[0090] For example, as illustrated above, adjustment parameter 2 includes preset volume 2, preset gain A2 corresponding to frequency response, preset gain B2 corresponding to equalizer parameters, and preset gain C2 corresponding to delay. Assuming the first audio is audio 1, adjusting audio 1 includes the following three scenarios:
[0091] Case 1: Adjust the volume of the first audio file. Determine the current volume of audio 1. If the current volume of audio 1 is the preset volume 2, then determine audio 1 as the target audio. If the current volume of audio 1 is not the preset volume 2, then adjust the current volume of audio 1 to the preset volume 2, and determine audio 1 as the target audio, while setting the current volume of audio 1 to the preset volume 2.
[0092] Scenario 2: Adjust the sound quality of the first audio file. Based on the preset gain A2 corresponding to the frequency response, adjust the frequency response of audio 1 to obtain the target frequency response. Based on the preset gain B2 corresponding to the equalizer parameters, adjust the equalizer of audio 1 to obtain the target equalizer. Based on the preset gain C2 corresponding to the delay, adjust audio 1 to obtain the target noise reduction. The target audio file is determined to be audio 1, which includes the target frequency response, target equalizer, and target delay.
[0093] Case 3: Adjust the volume and sound quality of the first audio file. Perform Case 1 and Case 2 processing on audio 1 respectively to obtain the target volume and target sound quality. The target audio file is determined to be audio 1, and the current volume of audio 1 is the preset volume 2. Audio 1 includes the target frequency response, target equalizer, and target delay.
[0094] S504. If the headphones are equipped with an inertial sensor, then acquire the inertial measurement parameters collected by the inertial sensor.
[0095] Inertial sensors can be accelerometers, gyroscopes, etc.
[0096] If the executing entity is the headset, the headset can directly acquire the inertial measurement parameters collected by the inertial sensor. If the executing entity is the terminal device, the headset, after acquiring the inertial measurement parameters collected by the inertial sensor, sends the inertial measurement parameters collected by the inertial sensor to the terminal device.
[0097] S505. Determine the current motion state of the user wearing the headphones based on inertial measurement parameters.
[0098] The current motion state can be a stationary state, a walking state, a running state, etc.
[0099] If the inertial sensor is an accelerometer, then the inertial measurement parameter can be at least one acceleration. Based on the magnitude of at least one acceleration, the current motion state of the user wearing the headphones is determined.
[0100] S506. Based on the current motion state of the user wearing the headphones and the first distance corresponding to each distance sensor, the first audio is adjusted and processed to obtain the target audio.
[0101] The system can weight the current motion state of the user wearing the headphones and the first distance corresponding to each distance sensor to obtain the target distance. Based on the target distance, adjustment parameters are determined, thereby adjusting the first audio signal.
[0102] It should be noted that the process of adjusting the first audio can be found in S502 to S503, and will not be repeated here.
[0103] The first audio is adjusted based on the user's current movement state and the first distance corresponding to each proximity sensor. This adjustment improves the flexibility and effectiveness of audio adjustment.
[0104] S507. If a three-dimensional model corresponding to the human ear is stored, the first audio is adjusted and processed according to the three-dimensional model corresponding to the human ear to obtain the target audio.
[0105] If the executing entity is a terminal device, the terminal device can acquire a first image, which includes an image of a human ear collected by the terminal device and an image of the position of the earphone at the human ear; process the first distance and the first image collected by each distance sensor to obtain a three-dimensional model corresponding to the human ear; and adjust the first audio according to the three-dimensional model corresponding to the human ear to obtain the target audio.
[0106] If the executing entity is an earphone, the earphone can send the first distance collected by each distance sensor to the terminal device, so that the terminal device can obtain a three-dimensional model corresponding to the human ear based on the first distance and the first image, where the first image is the human ear image collected by the terminal device; receive the three-dimensional model corresponding to the human ear sent by the terminal device; and adjust the first audio according to the three-dimensional model corresponding to the human ear to obtain the target audio.
[0107] A second preset algorithm can be used to process the first distance and the first image acquired by each distance sensor to obtain a three-dimensional model corresponding to the human ear. The three-dimensional model may also include relevant feature information corresponding to the user's head.
[0108] The 3D model more clearly indicates the distance between various feature points in the human ear and the headphones. Using the 3D model, adjustment parameters can be determined more accurately, improving the accuracy of audio adjustments.
[0109] It should be noted that the process of adjusting the first audio can be found in S502 to S503, and will not be repeated here.
[0110] After receiving the target audio, if the executing entity is a terminal device, the terminal device can send the target audio to the headphones, causing the headphones to play the target audio through the speakers. If the executing entity is the headphones, the headphones can directly play the target audio through the speakers.
[0111] At least one sensor can be installed in the earphone. Based on any of the above embodiments, the following will be combined with... Figure 6 The structure of the headphones will be explained. Figure 6 This is a schematic diagram of the structure of the earphone provided in an embodiment of this application. Please refer to... Figure 6The system includes a headset 601. The headset 601 comprises a main controller, battery, antenna module, RF module, microphone array, speaker, control buttons, distance sensor, and inertial sensor (optional). The main controller is a wireless system-on-chip (SOC) module, and the battery powers the entire system. The antenna module wirelessly connects to the terminal device or other devices via the RF module, transmitting the user's voice call signals collected by the microphone array to the mobile phone. The speaker plays the received voice signals. The control buttons are used for user input, enabling functions such as playback, volume adjustment, and answering calls. The distance sensor collects the first distance. The system can integrate the first distance collected by the distance sensor and the user's current motion state collected and determined by the inertial sensor, and transmit this information to the main controller. The main controller can send the first distance collected by the distance sensor and the user's current motion state collected and determined by the inertial sensor to the terminal device or cloud server to complete sensor information fusion, thereby performing operations such as 3D modeling, relative position analysis, and audio adjustment processing.
[0112] The audio adjustment method provided in this disclosure adjusts a first audio signal based on a first distance collected by each distance sensor to obtain a target audio signal. If the headphones are equipped with an inertial sensor, the first audio signal can also be adjusted based on the first distance collected by each distance sensor and inertial measurement parameters to obtain the target audio signal. If a three-dimensional model corresponding to a human ear is stored, the first audio signal can be adjusted based on the three-dimensional model to obtain the target audio signal. In the above process, audio adjustment can be performed based on the first distance obtained from the target position, allowing for more accurate audio adjustment. This avoids the need for users to manually adjust the wearing position of the headphones to adjust the audio, improving the audio adjustment effect. Furthermore, the first audio signal can be adjusted based on inertial measurement parameters and / or the three-dimensional model corresponding to the human ear. Further, adjusting the first audio signal based on the user's current state and a more accurate three-dimensional model improves the flexibility and accuracy of audio adjustment.
[0113] Based on any of the above embodiments, the following, in conjunction with Figure 7 The process of audio adjustment will be illustrated with an example.
[0114] Figure 7 This is a schematic diagram illustrating the audio adjustment process provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 7The system includes a terminal device 701 and an earphone 702. The terminal device 701 can be a mobile phone, tablet computer, computer, etc. The earphone 702 can be an open-back headset, equipped with three distance sensors and an inertial sensor. After the terminal device 701 and the earphone 702 establish a connection, the terminal device 701 can control the earphone 702 to play audio 2 via an application. At this time, the earphone 702 can acquire the first distance collected by each distance sensor and the inertial measurement parameters collected by the inertial sensor, and send these parameters to the terminal device 701.
[0115] After receiving the first distance collected by each distance sensor and the inertial measurement parameters collected by the inertial sensor, the terminal device 701 retrieves a preset distance from the preset storage space. It determines that the first distance collected by each distance sensor is less than the preset distance. Therefore, the terminal device 701 determines that the headphones are being worn. The terminal device 701 performs weighted processing on the current motion state of the headphone user and the first distance corresponding to each distance sensor, obtaining a target distance of 3mm. The terminal device 701 determines the distance range within the preset storage space and determines the corresponding adjustment parameters for this distance range, including a preset volume of 45, a preset gain of 0.2 for the equalizer parameters, a preset gain of 0.35 for the delay, and a preset gain of 1.2 for the signal amplitude limit.
[0116] Terminal device 701 determines that adjusting audio 2 includes adjusting its volume and sound quality. Therefore, terminal device 701 determines that the current volume of audio 2 is 30, and adjusts it to 45. Terminal device 701 then adjusts the frequency response of audio 2 according to a preset gain of 0.2 to obtain the target frequency response. According to a preset gain of 0.35 for the equalizer parameters, it adjusts the equalizer parameters of audio 2 to obtain the target equalizer parameters. According to a preset gain of 1.2 for the delay, it adjusts the delay to obtain the target delay. According to a preset gain of 1.2 for the signal amplitude limit, it adjusts the signal amplitude of audio 2 to obtain the target signal amplitude. The target audio is determined to be audio 2, with a target volume of 45. Audio 2 includes the target frequency response, target equalizer parameters, target delay, and target signal amplitude. After determining the target audio, terminal device 701 sends the target audio to headphones 702. Headphones 702 can play the target audio through their speakers.
[0117] The audio adjustment process provided in this disclosure involves acquiring a first distance from each distance sensor, and obtaining the first audio currently being played by the headphones. Based on the first distance acquired by each distance sensor, the first audio is adjusted to obtain the target audio. In this process, since the target position is a feature point corresponding to the user's ear when wearing the headphones, and these feature points are key locations affecting the audio's quality when played, adjusting the audio based on the first distance obtained from the target position allows for more accurate audio adjustment. This avoids the need for the user to manually adjust the headphone's wearing position to adjust the audio, thus improving the audio adjustment effect. Furthermore, the first audio can be adjusted based on inertial measurement parameters and / or a three-dimensional model corresponding to the human ear. Further adjustments based on the user's current state and a more accurate three-dimensional model enhance the flexibility and accuracy of audio adjustment.
[0118] Figure 8 This is a schematic diagram of an audio adjustment device provided in an embodiment of this disclosure. The audio adjustment device can be installed in a terminal device or headphones. Please refer to [link / reference]. Figure 8 The audio adjustment device 10 may include:
[0119] The first acquisition module 801 is used to acquire a first distance collected by each distance sensor, wherein the distance sensor is installed in the earphone, and the first distance is the distance between the distance sensor and the target position of the human ear, wherein the target position is determined based on the first position of the distance sensor in the earphone.
[0120] The second acquisition module 802 is used to acquire the first audio currently being played by the headphones;
[0121] The first processing module 803 is used to adjust the first audio based on the first distance collected by each distance sensor to obtain the target audio.
[0122] According to one or more embodiments of this disclosure, the first processing module 803 is specifically used for:
[0123] The volume of the first audio is adjusted to obtain a target volume; and / or the sound quality of the first audio is adjusted to obtain a target sound quality.
[0124] According to one or more embodiments of this disclosure, the volume adjustment process of the first audio includes increasing or decreasing the volume of the first audio; and / or, the sound quality adjustment process of the first audio includes adjusting the frequency response of the first audio and at least one of the frequency response-related parameters.
[0125] According to one or more embodiments of this disclosure, the first processing module 803 is specifically used for:
[0126] The wearing status of the headphones is determined based on the first distance collected by each distance sensor;
[0127] If the wearing state is "worn", then the first audio is adjusted to obtain the target audio. According to one or more embodiments of this disclosure, the first processing module 803 is specifically used for:
[0128] If the first distance collected by at least one of the distance sensors is greater than a preset distance, the wearing state of the headphones is determined to be an unworn state.
[0129] Otherwise, the wearing status of the headphones is determined to be "worn".
[0130] According to one or more embodiments of this disclosure, the first processing module 803 is specifically used for:
[0131] Based on the first distance collected by each distance sensor, adjustment parameters are determined, including preset volume and / or at least one preset gain;
[0132] The first audio is adjusted according to the adjustment parameters to obtain the target audio.
[0133] The audio adjustment device provided in this embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here.
[0134] Figure 9 This is a schematic diagram of another audio adjustment device provided in an embodiment of this disclosure. Figure 8 Based on the illustrated embodiments, please refer to Figure 9 The audio adjustment device 10 also includes a second processing module 804.
[0135] The second processing module 804 is used for:
[0136] Obtain the inertial measurement parameters acquired by the inertial sensor;
[0137] Based on the inertial measurement parameters, determine the current motion state of the user wearing the headphones;
[0138] Based on the current motion state of the user wearing the headphones and the first distance corresponding to each distance sensor, the first audio is adjusted to obtain the target audio.
[0139] The audio adjustment device is installed in the terminal device, and the second processing module 804 is used for:
[0140] Acquire a first image, the first image including an image of a human ear captured by the terminal device and an image of the position of the earphone in the human ear;
[0141] The first distance and the first image acquired by each distance sensor are processed to obtain a three-dimensional model corresponding to the human ear;
[0142] Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted to obtain the target audio.
[0143] The audio adjustment device is disposed in the headphones, and the second processing module 804 is used for:
[0144] The terminal device sends the first distance collected by each distance sensor to the terminal device, so that the terminal device can obtain a three-dimensional model corresponding to the human ear based on the first distance and the first image, wherein the first image is the human ear image collected by the terminal device;
[0145] Receive the three-dimensional model corresponding to the human ear sent by the terminal device;
[0146] Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted and processed to obtain the target audio.
[0147] The audio adjustment device provided in this embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here.
[0148] Figure 10 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 10 This document illustrates a structural schematic diagram of a terminal device 1000 suitable for implementing embodiments of the present disclosure. The terminal device 1000 can be either wearable or non-wearable. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers, portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 10 The terminal device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.
[0149] like Figure 10As shown, the terminal device 1000 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the terminal device 1000. The processing unit 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.
[0150] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows terminal device 1000 to exchange data via wireless or wired communication with other devices. Although Figure 10 A terminal device 1000 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.
[0151] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1008, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.
[0152] Figure 11 This is a schematic diagram of the structure of an earphone provided in an embodiment of this disclosure. Please refer to... Figure 11 It shows a structural schematic diagram suitable for implementing the headphone 1100 of the embodiments of this disclosure. Figure 11 The server shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.
[0153] like Figure 11As shown, the headset 1100 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1101, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1102 or a program loaded from storage device 1108 into random access memory (RAM) 1103. The RAM 1103 also stores various programs and data required for the operation of the headset 1100. The processing device 1101, ROM 1102, and RAM 1103 are interconnected via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.
[0154] Typically, the following devices can be connected to I / O interface 1105: input devices 1106 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 1107 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1108 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1109. Communication device 1109 allows headset 1100 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 11 The headset 1100 is shown with various devices; however, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or included alternatively.
[0155] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1109, or installed from storage device 1108, or installed from ROM 1102. When the computer program is executed by processing device 1101, it performs the functions defined in the methods of embodiments of this disclosure.
[0156] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0157] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.
[0158] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.
[0159] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0160] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0161] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".
[0162] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0163] In a first aspect, according to one or more embodiments of this disclosure, an audio adjustment method is provided, applied to a terminal device, comprising:
[0164] A first distance is acquired from each distance sensor, which is installed in the earphone. The first distance is the distance between the distance sensor and a target position of the human ear, and the target position is determined based on the first position of the distance sensor in the earphone.
[0165] Obtain the first audio currently being played by the headphones;
[0166] Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio.
[0167] According to one or more embodiments of this disclosure, the adjustment processing of the first audio includes:
[0168] The volume of the first audio is adjusted to obtain a target volume; and / or the sound quality of the first audio is adjusted to obtain a target sound quality.
[0169] According to one or more embodiments of this disclosure, the volume adjustment process of the first audio includes increasing or decreasing the volume of the first audio; and / or, the sound quality adjustment process of the first audio includes adjusting the frequency response of the first audio and at least one of the frequency response-related parameters.
[0170] According to one or more embodiments of this disclosure, adjusting the first audio based on a first distance acquired by each distance sensor to obtain the target audio includes:
[0171] The wearing status of the headphones is determined based on the first distance collected by each distance sensor;
[0172] If the wearing state is "worn", then the first audio is adjusted to obtain the target audio.
[0173] According to one or more embodiments of this disclosure, determining the wearing status of the headphones based on a first distance collected by each distance sensor includes:
[0174] If the first distance collected by at least one of the distance sensors is greater than a preset distance, the wearing state of the headphones is determined to be an unworn state.
[0175] Otherwise, the wearing status of the headphones is determined to be "worn".
[0176] According to one or more embodiments of this disclosure, adjusting the first audio based on a first distance acquired by each distance sensor to obtain the target audio includes:
[0177] Based on the first distance collected by each distance sensor, adjustment parameters are determined, including preset volume and / or at least one preset gain;
[0178] The first audio is adjusted according to the adjustment parameters to obtain the target audio.
[0179] According to one or more embodiments of this disclosure, the earphone is further provided with an inertial sensor, and the method further includes:
[0180] Obtain the inertial measurement parameters acquired by the inertial sensor;
[0181] Based on the inertial measurement parameters, determine the current motion state of the user wearing the headphones;
[0182] Based on the current motion state of the user wearing the headphones and the first distance corresponding to each distance sensor, the first audio is adjusted to obtain the target audio.
[0183] According to one or more embodiments of this disclosure, the method further includes:
[0184] Acquire a first image, which includes an image of a human ear captured by the terminal device and an image of the position of the earphone in the human ear;
[0185] The first distance and the first image acquired by each distance sensor are processed to obtain a three-dimensional model corresponding to the human ear;
[0186] Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted to obtain the target audio.
[0187] Secondly, according to one or more embodiments of this disclosure, an audio adjustment method is provided, applied to headphones, wherein the headphones are provided with at least one distance sensor, including:
[0188] Acquire a first distance from each distance sensor, where the first distance is the distance between the distance sensor and the target position of the human ear, and the target position is determined based on the first position of the distance sensor set on the earphone.
[0189] Obtain the first audio currently being played by the headphones;
[0190] Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio.
[0191] According to one or more embodiments of this disclosure, the method further includes:
[0192] The terminal device sends the first distance collected by each distance sensor to the terminal device, so that the terminal device can obtain a three-dimensional model corresponding to the human ear based on the first distance and the first image, wherein the first image is the human ear image collected by the terminal device;
[0193] Receive the three-dimensional model corresponding to the human ear sent by the terminal device;
[0194] Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted and processed to obtain the target audio.
[0195] Thirdly, according to one or more embodiments of this disclosure, an audio adjustment device is provided, the audio adjustment device being disposed in a terminal device or headphones, the device comprising:
[0196] The first acquisition module is used to acquire a first distance collected by each distance sensor, wherein the distance sensor is installed in the earphone, and the first distance is the distance between the distance sensor and the target position of the human ear, wherein the target position is determined based on the first position of the distance sensor in the earphone.
[0197] The second acquisition module is used to acquire the first audio currently being played by the headphones;
[0198] The first processing module is used to adjust the first audio based on the first distance collected by each distance sensor to obtain the target audio.
[0199] According to one or more embodiments of this disclosure, the first processing module is specifically used for:
[0200] The volume of the first audio is adjusted to obtain a target volume; and / or the sound quality of the first audio is adjusted to obtain a target sound quality.
[0201] According to one or more embodiments of this disclosure, the volume adjustment process of the first audio includes increasing or decreasing the volume of the first audio; and / or, the sound quality adjustment process of the first audio includes adjusting the frequency response of the first audio and at least one of the frequency response-related parameters.
[0202] According to one or more embodiments of this disclosure, the first processing module is specifically used for:
[0203] The wearing status of the headphones is determined based on the first distance collected by each distance sensor;
[0204] If the wearing state is "worn", then the first audio is adjusted to obtain the target audio. According to one or more embodiments of this disclosure, the first processing module is specifically used for:
[0205] If the first distance collected by at least one of the distance sensors is greater than a preset distance, the wearing state of the headphones is determined to be an unworn state.
[0206] Otherwise, the wearing status of the headphones is determined to be "worn".
[0207] According to one or more embodiments of this disclosure, the first processing module is specifically used for:
[0208] Based on the first distance collected by each distance sensor, adjustment parameters are determined, including preset volume and / or at least one preset gain;
[0209] The first audio is adjusted according to the adjustment parameters to obtain the target audio.
[0210] According to one or more embodiments of this disclosure, the apparatus further includes a second processing module.
[0211] The second processing module is used for:
[0212] Obtain the inertial measurement parameters acquired by the inertial sensor;
[0213] Based on the inertial measurement parameters, determine the current motion state of the user wearing the headphones;
[0214] Based on the current motion state of the user wearing the headphones and the first distance corresponding to each distance sensor, the first audio is adjusted to obtain the target audio.
[0215] The audio adjustment device is installed in the terminal device, and the second processing module is used for:
[0216] Acquire a first image, the first image including an image of a human ear captured by the terminal device and an image of the position of the earphone in the human ear;
[0217] The first distance and the first image acquired by each distance sensor are processed to obtain a three-dimensional model corresponding to the human ear;
[0218] Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted to obtain the target audio.
[0219] The audio adjustment device is installed in the headphones, and the second processing module is used for:
[0220] The terminal device sends the first distance collected by each distance sensor to the terminal device, so that the terminal device can obtain a three-dimensional model corresponding to the human ear based on the first distance and the first image, wherein the first image is the human ear image collected by the terminal device;
[0221] Receive the three-dimensional model corresponding to the human ear sent by the terminal device;
[0222] Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted and processed to obtain the target audio.
[0223] Fourthly, according to one or more embodiments of this disclosure, a terminal device is provided, comprising: at least one processor and a memory;
[0224] The memory stores computer-executed instructions;
[0225] The at least one processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the audio adjustment method as described in the first aspect and various possible designs of the first aspect.
[0226] Fifthly, according to one or more embodiments of the present disclosure, an earphone is provided, comprising: at least one processor and a memory;
[0227] The memory stores computer-executed instructions;
[0228] The at least one processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the audio adjustment method as described in the second aspect above and various possible designs of the second aspect.
[0229] Sixthly, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided that stores computer-executable instructions, which, when executed by a processor, implement the audio adjustment method as described in the first aspect and various possible designs of the first aspect, or the second aspect and various possible designs of the second aspect.
[0230] In a seventh aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the audio adjustment method as described in the first aspect and various possible designs of the first aspect, or the second aspect and various possible designs of the second aspect.
[0231] All or part of the steps in the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a readable memory. When the program is executed, it performs the steps of the above-described method embodiments; and the aforementioned memory (storage medium) includes: read-only memory (ROM), random access memory (RAM), flash memory, hard disk, solid-state drive, magnetic tape, floppy disk, optical disk, and any combination thereof.
[0232] This disclosure describes embodiments of methods, apparatus (systems), and computer program products according to embodiments of this disclosure with reference to flowchart illustrations and / or block diagrams. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0233] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0234] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0235] Obviously, those skilled in the art can make various modifications and variations to the embodiments of this disclosure without departing from the spirit and scope of this disclosure. Therefore, if these modifications and variations to the embodiments of this disclosure fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include these modifications and variations.
[0236] In this disclosure, the term "comprising" and its variations can refer to non-restrictive inclusion; the term "or" and its variations can refer to "and / or". The terms "first", "second", etc., in this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. In this disclosure, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.
Claims
1. An audio adjustment method, characterized in that, Applied to a terminal device, the method includes: A first distance is acquired from each distance sensor, which is installed in the earphone. The first distance is the distance between the distance sensor and a target position of the human ear, and the target position is determined based on the first position of the distance sensor in the earphone. Obtain the first audio currently being played by the headphones; Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio.
2. The method according to claim 1, characterized in that, The adjustment process for the first audio includes: The volume of the first audio is adjusted to obtain a target volume; and / or the sound quality of the first audio is adjusted to obtain a target sound quality.
3. The method according to claim 2, characterized in that, The volume adjustment process for the first audio includes increasing or decreasing the volume of the first audio; and / or, the sound quality adjustment process for the first audio includes adjusting the frequency response of the first audio, and at least one of the frequency response-related parameters.
4. The method according to claim 1, characterized in that, The step of adjusting the first audio based on the first distance collected by each distance sensor to obtain the target audio includes: The wearing status of the headphones is determined based on the first distance collected by each distance sensor; If the wearing state is "worn", then the first audio is adjusted to obtain the target audio.
5. The method according to claim 4, characterized in that, The step of determining the wearing status of the headphones based on the first distance collected by each distance sensor includes: If the first distance collected by at least one of the distance sensors is greater than a preset distance, the wearing state of the headphones is determined to be an unworn state. Otherwise, the wearing status of the headphones is determined to be "worn".
6. The method according to claim 1, characterized in that, The step of adjusting the first audio based on the first distance collected by each distance sensor to obtain the target audio includes: Based on the first distance collected by each distance sensor, adjustment parameters are determined, including preset volume and / or at least one preset gain; The first audio is adjusted according to the adjustment parameters to obtain the target audio.
7. The method according to claim 1, characterized in that, The earphones also include an inertial sensor, and the method further includes: Obtain the inertial measurement parameters acquired by the inertial sensor; Based on the inertial measurement parameters, determine the current motion state of the user wearing the headphones; Based on the current motion state of the user wearing the headphones and the first distance corresponding to each distance sensor, the first audio is adjusted to obtain the target audio.
8. The method according to claim 1, characterized in that, The method further includes: Acquire a first image, the first image including an image of a human ear captured by the terminal device and an image of the position of the earphone in the human ear; The first distance and the first image acquired by each distance sensor are processed to obtain a three-dimensional model corresponding to the human ear; Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted to obtain the target audio.
9. An audio adjustment method, characterized in that, Applied to headphones, wherein the headphones are provided with at least one proximity sensor, the method includes: Acquire a first distance from each distance sensor, where the first distance is the distance between the distance sensor and the target position of the human ear, and the target position is determined based on the first position of the distance sensor set on the earphone. Obtain the first audio currently being played by the headphones; Based on the first distance collected by each distance sensor, the first audio is adjusted to obtain the target audio.
10. The method according to claim 9, characterized in that, The method further includes: The terminal device sends the first distance collected by each distance sensor to the terminal device, so that the terminal device can obtain a three-dimensional model corresponding to the human ear based on the first distance and the first image, wherein the first image is the human ear image collected by the terminal device; Receive the three-dimensional model corresponding to the human ear sent by the terminal device; Based on the three-dimensional model corresponding to the human ear, the first audio is adjusted and processed to obtain the target audio.
11. An audio adjustment device, characterized in that, The device includes: The first acquisition module is used to acquire a first distance collected by each distance sensor, wherein the distance sensor is installed in the earphone, and the first distance is the distance between the distance sensor and the target position of the human ear, wherein the target position is determined based on the first position of the distance sensor in the earphone. The second acquisition module is used to acquire the first audio currently being played by the headphones; The first processing module is used to adjust the first audio based on the first distance collected by each distance sensor to obtain the target audio.
12. A terminal device, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the audio adjustment method as described in any one of claims 1 to 8.
13. An earphone, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the audio adjustment method as described in any one of claims 9 to 10.
14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the audio adjustment method as described in any one of claims 1 to 8, or as described in any one of claims 9 to 10.
15. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the audio adjustment method as described in any one of claims 1 to 8, or as described in any one of claims 9 to 10.