Audio playing method, electronic device and computer readable storage medium
Patent Information
- Application Number
- CN202410783396.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-17
- Publication Date
- 2026-08-28
- Estimated Expiration
- 2044-06-17
AI Technical Summary
[0003]本申请提供一种音频播放方法、电子设备及计算机可读存储介质,解决了现有的音频处理技术中无法实现个性化的音频处理方案的问题
[0055]第六方面,提供一种计算机程序产品,当计算机程序产品在电子设备上运行时,使得电子设备执行上述第一方面中所述的音频播放方法。
Smart Images

Figure CN121214965B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of audio processing, and more particularly to an audio playback method, an electronic device, and a computer-readable storage medium. Background Technology
[0002] Spatial audio technology processes audio to reconstruct the distance and direction information of sound in three-dimensional space, providing listeners with a more immersive and spatial audio experience, allowing them to feel as if they are actually there. Current spatial audio technologies generally use standardized audio processing schemes to simulate the reflection of sound by the user's head and ears, producing a spatial sound, without considering individual differences and therefore failing to achieve personalized audio processing solutions. Summary of the Invention
[0003] This application provides an audio playback method, an electronic device, and a computer-readable storage medium, which solves the problem that existing audio processing technologies cannot achieve personalized audio processing solutions.
[0004] To achieve the above objectives, this application adopts the following technical solution:
[0005] In a first aspect, an audio playback method is provided, applied to an electronic device, the electronic device including a radar, the method comprising:
[0006] The system acquires the user's ear size information, which includes a first distance between the auricle and the eardrum, the first distance being determined based on first detection information obtained when the radar detects the user's ears; acquires the user's head size information; determines a first parameter of the head-related transfer function based on the first distance and the head size information; processes the audio using the head-related transfer function with the first parameter as the parameter, and plays the processed audio.
[0007] In the above embodiments, the user's ears are detected by radar, and the first distance between the user's auricle and eardrum is obtained based on the first detection information. Based on the first distance and head size information, the first parameter of the head-related transfer function is determined, thereby obtaining the parameters of the user's personalized head-related transfer function. This allows the head-related transfer function with the first parameter to more accurately simulate the reflection of sound by the user's ears. Then, the audio is processed according to the head-related transfer function with the first parameter. The user's personalized audio processing scheme can be used to process the audio, improve the audio processing accuracy, and thus improve the user's auditory experience.
[0008] In one embodiment, obtaining the user's ear size information includes:
[0009] When the radar is in a first position, the first detection information is acquired. The first detection information includes a mixed signal of the radar's reference signal and an echo signal. The reference signal is the same as the radar's transmitted signal, and the echo signal is the signal obtained after the transmitted signal is reflected by the user's ear. The first distance is determined based on the mixed signal. Determining the first distance using the mixed signal can improve the accuracy and response speed of distance detection.
[0010] In one embodiment, determining the first distance based on the mixing signal includes:
[0011] The highest and lowest frequencies of the mixing signal are determined; the first distance is determined based on the highest and lowest frequencies, thereby improving computational efficiency.
[0012] In one embodiment, obtaining the user's head size information includes:
[0013] When the radar is in the second position, the second detection information of the radar is acquired; the head size information is determined based on the second detection information.
[0014] In the above embodiments, determining head size information through radar detection can improve the environmental adaptability of the head size information detection process.
[0015] In one embodiment, determining the head size information based on the second detection information includes:
[0016] The user's head contour features are determined based on the second detection information; the user's head image is obtained; the head contour features are corrected based on the head image to obtain the head size information, thereby combining the advantages of image detection and radar detection to further improve the accuracy of the obtained head size information.
[0017] In one embodiment, obtaining the user's head size information includes: obtaining the user's head image; and determining the head size information based on the head image. This method is simple to operate and has high detection efficiency.
[0018] In one embodiment, determining the first parameter of the head-related transfer function based on the first distance and the head size information includes: inputting the first distance and the head size information into a prediction model to obtain the first parameter output by the prediction model. Determining the first parameter through a pre-trained prediction model can improve the accuracy of the obtained first parameter.
[0019] In one embodiment, the electronic device includes a display screen and a bezel, the display screen and the bezel forming a mounting cavity;
[0020] The radar is located inside the mounting cavity and is adjacent to the antenna module inside the mounting cavity, thereby saving the space occupied by the radar.
[0021] Alternatively, the radar is located inside the mounting cavity and adjacent to the camera module inside the mounting cavity, thereby saving the space occupied by the radar;
[0022] Alternatively, the radar may be located within the mounting cavity and mounted on the frame, thereby not affecting the display effect of the electronic device's screen;
[0023] Alternatively, the radar may be located within the mounting cavity and adjacent to the display screen, thereby facilitating position correction during radar detection.
[0024] In one embodiment, the electronic device is a wireless earphone system, which includes wireless earphones and a housing. The radar is located inside the housing, so that the ear size can be detected using the earphone housing without affecting the weight and size of the earphones.
[0025] In one embodiment, the radar is a millimeter-wave radar. Millimeter waves have stronger penetration and anti-interference capabilities during transmission, giving millimeter-wave radar a stronger detection capability and improving the accuracy of the detection results.
[0026] In a second aspect, an audio playback device is provided for use in an electronic device, the electronic device including a radar, and the device including an acquisition module, a determination module and a processing module.
[0027] The acquisition module is used to acquire the user's ear size information, which includes a first distance between the auricle and the eardrum. The first distance is determined based on first detection information obtained when the radar detects the user's ear.
[0028] The acquisition module is also used to acquire the user's head size information;
[0029] The determining module is used to determine the first parameter of the head-related transfer function based on the first distance and the head size information;
[0030] The processing module is used to process the audio according to the head-related transfer function with the first parameter as the parameter, and play the processed audio.
[0031] In one embodiment, the acquisition module is specifically used for:
[0032] When the radar is in a first position, the first detection information is acquired. The first detection information includes a mixed signal of the radar's reference signal and the echo signal. The reference signal is the same as the radar's transmitted signal, and the echo signal is the signal obtained after the transmitted signal is reflected by the user's ear.
[0033] The first distance is determined based on the mixed frequency signal.
[0034] In one embodiment, the acquisition module is specifically used for:
[0035] Determine the highest and lowest frequencies of the mixing signal;
[0036] The first distance is determined based on the highest frequency and the lowest frequency.
[0037] In one embodiment, the acquisition module is specifically used for:
[0038] When the radar is in the second position, the second detection information of the radar is acquired;
[0039] The head size information is determined based on the second detection information.
[0040] In one embodiment, the acquisition module is specifically used for:
[0041] The user's head contour features are determined based on the second detection information;
[0042] Obtain the user's head image;
[0043] The head contour features are corrected based on the head image to obtain the head size information.
[0044] In one embodiment, the acquisition module is specifically used for:
[0045] Obtain the user's head image;
[0046] The head size information is determined based on the head image.
[0047] In one embodiment, the determining module is specifically used for:
[0048] The first distance and the head size information are input into the prediction model to obtain the first parameter output by the prediction model.
[0049] In one embodiment, the electronic device includes a display screen and a frame, the display screen and the frame forming a mounting cavity; the radar is located within the mounting cavity and adjacent to an antenna module within the mounting cavity; or, the radar is located within the mounting cavity and adjacent to a camera module within the mounting cavity; or, the radar is located within the mounting cavity and disposed on the frame; or, the radar is located within the mounting cavity and adjacent to the display screen.
[0050] In one embodiment, the electronic device is a wireless earphone system, which includes wireless earphones and a housing, with the radar located inside the housing.
[0051] In one embodiment, the radar is a millimeter-wave radar.
[0052] Thirdly, an electronic device is provided, including a processor for executing a computer program stored in a memory to implement the audio playback method as described in the first aspect above.
[0053] Fourthly, a computer-readable storage medium is provided, the computer-readable storage medium storing a computer program, which, when executed by a processor, implements the audio playback method as described in the first aspect above.
[0054] Fifthly, a chip is provided, the chip including a processor and a memory coupled thereto, the processor executing a computer program or instructions stored in the memory to implement the audio playback method as described in the first aspect above.
[0055] Sixthly, a computer program product is provided that, when the computer program product is run on an electronic device, causes the electronic device to execute the audio playback method described in the first aspect above.
[0056] It is understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description
[0057] Figure 1 A scene diagram illustrating the propagation of sound in space, provided as an embodiment of this application;
[0058] Figure 2 This is a schematic diagram showing the location of the radar within a mobile phone, as provided in an embodiment of this application.
[0059] Figure 3 This is a schematic diagram showing the location of the radar inside a laptop computer, as provided in an embodiment of this application.
[0060] Figure 4 This is a schematic diagram showing the location of the radar within the wireless earphone system, as provided in an embodiment of this application.
[0061] Figure 5 A schematic diagram showing the position settings of the transmitting and receiving antennas of the radar provided in an embodiment of this application;
[0062] Figure 6 This is a schematic diagram illustrating an application scenario of the audio playback method provided in an embodiment of this application;
[0063] Figure 7 This is a diagram of a sound effects settings page provided in an embodiment of this application;
[0064] Figure 8A test scenario diagram of a first distance provided in an embodiment of this application;
[0065] Figure 9 This is a test scenario diagram illustrating head size information provided in one embodiment of this application;
[0066] Figure 10 A page diagram showing the completion of sound effect settings provided in an embodiment of this application;
[0067] Figure 11 A flowchart illustrating an audio playback method provided in an embodiment of this application;
[0068] Figure 12 A radar detection principle diagram provided for an embodiment of this application;
[0069] Figure 13 A schematic diagram of the first distance provided for an embodiment of this application;
[0070] Figure 14 A schematic diagram illustrating the calculation principle of the first distance provided in this application embodiment;
[0071] Figure 15 A schematic diagram of the frequency domain signal obtained by frequency mixing signal conversion provided in an embodiment of this application;
[0072] Figure 16 A schematic diagram illustrating head size information provided in one embodiment of this application;
[0073] Figure 17 A schematic diagram illustrating head size information provided in one embodiment of this application;
[0074] Figure 18 A flowchart illustrating the implementation of an audio playback method according to an embodiment of this application;
[0075] Figure 19 A software structure block diagram of an electronic device provided in an embodiment of this application;
[0076] Figure 20 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0077] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.
[0078] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.
[0079] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0080] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."
[0081] Furthermore, in the description of this application, the terms "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0082] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0083] For example, the electronic device described in this application embodiment may be a mobile phone, tablet computer, handheld computer, personal digital assistant (PDA), augmented reality (AR) / virtual reality (VR) device, media player, wearable device, or other device with a speaker. This application embodiment does not impose any special limitations on the specific form / type of the electronic device. The aforementioned electronic device includes, but is not limited to, devices equipped with speakers. Devices running Harmony OS or other operating systems.
[0084] like Figure 1 As shown, when sound travels through space, the human head and ears reflect, block, or diffract sound waves from different directions to varying degrees. Therefore, in different scenarios, the sound heard by the human ear is the result of different degrees of reflection, blocking, or diffraction. Thus, when the sound source 11 is located in different positions, the brain can identify the direction of the sound source based on the sound heard by the human ear, and the sound heard by the human ear is a sound with a sense of space.
[0085] By processing the audio to be played on electronic devices, the reflection, blocking, or diffraction of sound by the human head and ears can be simulated. This can restore the position and direction information of the sound source in three-dimensional space, giving the audio played by electronic devices a sense of space and thus improving the user's auditory experience.
[0086] Head Related Transfer Functions (HRTF) is a sound localization processing technique that uses the user's head center as the center and processes the audio to be played through transfer functions to simulate the influence of the user's head, ears, torso on sound transmission, thereby giving the processed audio a sense of space and stereo.
[0087] HRTF (Head and Ear Dimensions For Processing) technology for audio processing requires obtaining the user's head and ear dimensions. This can be achieved by taking a photograph of the user's head or ears, and the dimensions can be determined from the image. However, determining head and ear dimensions through photography is susceptible to ambient light variations, and the ears are often obscured during the photographing process, resulting in inaccurate ear dimensions. Furthermore, the image cannot reveal the internal structure of the ear, which varies among users (e.g., eardrum depth), and this internal structure significantly impacts the audio processing performance of HRTF technology.
[0088] Therefore, this application provides an audio playback method that uses radar to detect the user's ear, obtains a first distance between the user's auricle and eardrum based on the obtained first detection information, and determines the parameters of the head-related transfer function based on the first distance and the user's head size information. Using radar detection improves the accuracy of the obtained first distance, and combining the first distance with head size information allows for a more accurate simulation of the user's ear's reflection, obstruction, or diffraction of sound, obtaining personalized head-related transfer function parameters. The audio is then processed based on the determined head-related transfer function, allowing for personalized audio processing schemes, improving audio processing accuracy, enhancing the spatial effect of audio played by electronic devices, and ultimately improving the user's auditory experience.
[0089] The audio playback method provided in this application will be described in detail below.
[0090] The audio playback method provided in this application is applied to an electronic device, which includes a radar. By pointing the radar on the electronic device at a target, the target can be detected. For example, by pointing the radar at a user's ear, the radar detects the user's ear, obtaining first detection information. Based on this first detection information, the electronic device can determine a first distance between the user's auricle and eardrum.
[0091] In one embodiment, the electronic device is a mobile phone, tablet computer, or laptop computer. The electronic device includes a display screen and a bezel, which form a mounting cavity in which the radar is located.
[0092] For example, an antenna module is disposed within the mounting cavity of the electronic device, and a radar is located within the mounting cavity and adjacent to the antenna module, thereby saving installation space. Alternatively, a camera module is disposed within the mounting cavity, and a radar is located within the mounting cavity and adjacent to the camera module, thereby saving installation space. Alternatively, the radar is located within the mounting cavity and disposed on the frame, i.e., the radar is disposed inside the frame, thereby saving installation space without affecting the display effect of the screen. Alternatively, the radar is located within the mounting cavity and adjacent to the display screen, i.e., the radar is disposed below the display screen.
[0093] For example, such as Figure 2 As shown, the electronic device is a mobile phone. The mobile phone's display screen 21 and frame 22 form a mounting cavity. The radar 23 is located inside the mounting cavity and below the display screen 21.
[0094] For example, such as Figure 3 As shown, the electronic device is a laptop computer. The laptop computer's display screen 31 and bezel 32 form a mounting cavity, and the radar 33 is located inside the mounting cavity and below the display screen 31.
[0095] In another embodiment, such as Figure 4 As shown, the electronic device is a wireless earphone system, which includes an earphone 41 and a housing 42. The radar 43 is located inside the housing 42, thus without increasing the size of the earphone.
[0096] It is understood that the position of the radar within the electronic device can be designed according to actual needs. In other embodiments, the radar can also be protruding from the electronic device. The embodiments of this application do not limit the position of the radar within or on the electronic device.
[0097] A radar system comprises multiple transmitting antennas and multiple receiving antennas, thereby improving the accuracy of the detected information. The number of transmitting antennas and receiving antennas can be equal or unequal. These multiple transmitting and receiving antennas can be positioned in different areas of the radar system or arranged in an alternating pattern.
[0098] For example, such as Figure 5 As shown, the radar's multiple transmitting antennas 51 and multiple receiving antennas 52 are integrated on a single chip. The multiple transmitting antennas 51 and multiple receiving antennas 52 are arranged alternately, that is, each transmitting antenna 51 is arranged adjacent to a receiving antenna 52, which can improve the coverage of the transmitting and receiving antennas and thus improve the radar's detection accuracy.
[0099] In one embodiment, the radar is a millimeter-wave radar, which performs detection by transmitting and receiving millimeter-wave signals. Millimeter waves are electromagnetic waves of 1–10 millimeters in diameter with frequencies of 30–300 GHz, which gives them stronger penetration and anti-interference capabilities during transmission, thus enhancing the detection capabilities of the millimeter-wave radar. Using millimeter-wave radar to detect a user's ear can improve the accuracy of the detected internal ear structure. Furthermore, the waveband of millimeter waves is different from the electromagnetic waves used for communication in electronic devices such as mobile phones, so it will not affect the normal communication of these devices.
[0100] The following section, in conjunction with the aforementioned radar, introduces the application scenarios of the audio playback method provided in the embodiments of this application.
[0101] For example, in one application scenario, the audio playback method provided in this application embodiment is executed on a mobile phone. Figure 6 As shown, mobile phone 61 and earphone 62 are connected for communication.
[0102] like Figure 7 As shown in the image, the phone opens the sound effects settings page based on user input. This sound effects settings page can be used to adjust the phone's sound settings, or it can be the sound effects settings page of an application (such as a music player or video player). For example, the sound effects settings page displays multiple sound effect options for the user to choose from. For instance, the sound effect options include Sound Effect 1, Sound Effect 2, and Immersive Sound Effect, where the immersive sound effect uses HRTF technology.
[0103] When the phone detects a user tapping the immersive sound effect, it determines whether the user is using the immersive sound effect for the first time. If it is, the phone tests and saves the user's anthropometric parameters. These parameters include the first distance between the auricle and eardrum, as well as head size information.
[0104] For example, such as Figure 8 As shown in (a), when the phone detects that the user has activated the immersive sound effect for the first time, it displays a human characteristic parameter test and a "Start Test" option on the screen. If the user clicks the "Start Test" option, the following will be displayed: Figure 8 The test prompt page is shown in (b) above. The page displays "Please hold the phone directly in front of your left ear" and "Radar is testing; please do not move the phone." The phone determines the initial distance to the left ear based on the radar's detection information. After obtaining the initial distance to the left ear, the electronic device outputs a prompt asking if the left ear test is complete and whether to continue. If the user's input to continue the test is detected, the phone displays the following: Figure 8 The test prompt page is shown in (c). The test prompt page displays "Please hold the front of the phone directly towards your right ear" and "Radar is testing, please do not move the phone." The phone determines the initial distance to the right ear based on the radar's detection information of the ear.
[0105] In one embodiment, when the mobile phone detects that the user has clicked the "Start Test" option, it can also output a prompt message asking whether to turn on the radar. If the user's instruction to turn on the radar is detected, the user's ear will be detected. If the user's instruction not to turn on the radar is detected, radar detection will not be performed, thereby allowing different tests to be performed based on the user's usage, thus improving the user experience.
[0106] After completing the tests for the left and right ears, if a user inputs a command to continue the test, the following will be displayed: Figure 9 The camera takes a picture, and displays normal test prompts. For example, the prompts might say, "Please point the camera directly at your head" and "Testing head size, please do not move your phone." The phone determines the user's head size based on the image of their head captured by the camera.
[0107] After obtaining the initial distance and head size information, the phone displays the following on the screen: Figure 10 The sound effect launch page is shown below. For example, the sound effect launch page displays "Test complete, start sound effect". After the phone detects the user clicking "Test complete, start sound effect", it determines the first parameter of HRTF based on the first distance and head size information, saves the first parameter, and completes the sound effect settings.
[0108] Subsequently, when the phone detects the user's audio playback action, it processes the audio according to the HRTF with the first parameter as the parameter, and sends the processed audio to the headphones for playback.
[0109] In one embodiment, after the phone completes the initial sound effect settings, if the phone detects the user's activation of immersive sound effects again, the phone can determine the HRTF based on the pre-stored first parameter, process the audio according to the HRTF, and instruct the headphones to play the processed audio.
[0110] In one embodiment, after the phone completes the initial sound effect settings, if it detects another user activation of immersive sound effects, the phone displays an identifier corresponding to at least one sound effect parameter on the screen. Each sound effect parameter corresponds to a user, and the identifier can be a username. The phone can determine the sound effect parameter selected by the user based on the identifier selected and process the audio using the corresponding HRTF. The phone can also retest human feature parameters based on the user's creation of new sound effect parameters to obtain and save new sound effect parameters. By setting different sound effect parameters, the needs of multiple users can be met.
[0111] The following section provides a detailed description of the specific implementation process of the audio playback method provided in the embodiments of this application, based on the above application scenarios.
[0112] like Figure 11 As shown, an embodiment of this application provides an audio playback method including the following steps.
[0113] S1101: Obtain the user's ear size information, the ear size information including a first distance between the auricle and the eardrum, the first distance being determined based on first detection information obtained when the radar detects the user's ear.
[0114] Specifically, the electronic device is positioned so that the radar is in a first position. This first position can be located to the side of the head, directly opposite the ear. When the radar is in this first position, it can detect the user's ear. The electronic device activates the radar based on the user's input, obtains the radar's initial detection information, and determines a first distance based on this information.
[0115] In one embodiment, such as Figure 12As shown, the radar includes a synthesizer 1201, a transmitting antenna 1202, a receiving antenna 1203, and a mixer 1204. The synthesizer 1201 outputs a detection signal, which can be a frequency-modulated continuous wave (FMCW) or a pulse wave. Using FMCW as the detection signal allows for simultaneous measurement of the distances to multiple targets, improving radar detection efficiency. Furthermore, FMCW's high resolution enhances radar detection accuracy. The detection signal comprises two signals: a transmitted signal and a reference signal, which are identical. The transmitted signal is transmitted to the detection area via the transmitting antenna 1202, reflected by the detection area to obtain an echo signal, which is received by the receiving antenna 1203. The echo signal and the reference signal are mixed in the mixer 1204, and the mixer outputs the mixed signal.
[0116] like Figure 13 As shown, when the radar is in the first position, the radar's transmitting antenna is pointed towards the user's ear. The transmitted signal from the transmitting antenna enters the user's ear, allowing the radar's receiving antenna to receive the echo signal reflected by the auricle 1301 and eardrum 1302. The echo signal and the reference signal are mixed in a mixer, and the mixed signal output by the mixer is the first detection information. The electronic equipment determines the first distance between the auricle 1301 and eardrum 1302 based on the mixed signal.
[0117] Specifically, the transmitted signal is FMCW, and the corresponding reference signal is also FMCW. For example... Figure 14 As shown in (a), the horizontal axis represents time t, and the vertical axis represents frequency f. For a reference signal 1401 within any period, the echo signal is 1402, and the mixing signal is as follows. Figure 14 As shown in (b) above. The sweep slope of the transmitted signal is set to S, f i Let f represent the frequency of the mixing signal, and c represent the speed of light. The distance R to the target object can be determined from this mixing signal using the formula: R = c * f. i / 2S, the target distance refers to the distance between the target and the radar.
[0118] When the radar detects the ear, according to the above formula for calculating distance R, the formula for calculating the distance R1 of the auricle is R1=c*f1 / 2S, and the formula for calculating the distance R2 of the eardrum is R2=c*f2 / 2S, where f1 represents the frequency of the mixing signal corresponding to the auricle and f2 represents the frequency of the mixing signal corresponding to the eardrum.
[0119] Perform frequency domain transformation on the mixed signal to obtain, as follows Figure 15The frequency domain signal is shown. The horizontal axis represents frequency f, and the vertical axis represents amplitude A. Different frequencies in the frequency domain signal represent the distances of targets to the radar at different distances. The closer the target is to the radar, the lower the frequency of the mixing signal; the farther the target is from the radar, the higher the frequency of the mixing signal. When the radar detects an ear, the auricle is closest to the radar, and the eardrum is farthest. Therefore, the highest frequency in the mixing signal represents the mixing signal corresponding to the eardrum, and the lowest frequency represents the mixing signal corresponding to the auricle. Thus, the highest frequency in the frequency domain signal is the frequency of the mixing signal corresponding to the eardrum, and the lowest frequency is the frequency of the mixing signal corresponding to the auricle. The distance to the auricle can be determined based on the frequency of the mixing signal corresponding to the auricle, and the distance to the eardrum can be determined based on the frequency of the mixing signal corresponding to the eardrum. The difference between the distance to the auricle and the distance to the eardrum is the first distance. It can be understood that f in the distance calculation formula... i Replace it with the difference between the highest and lowest frequencies, and the first distance can be directly obtained according to the distance calculation formula.
[0120] In another embodiment, the electronic device may also determine the first distance between the user's auricle and eardrum based on the transmission time of the transmitted signal and the time of receiving the echo signal.
[0121] In one embodiment, such as Figure 7 As shown, when an electronic device determines that audio processing is needed based on the user's audio settings, it instructs the user to adjust the position of the electronic device, which in turn adjusts the position of the radar, placing the radar in a first position. For example, the radar may be located below the screen of the electronic device, prompting the user to point the screen towards their ear when a first distance needs to be detected. Alternatively, the radar may be located to the side of the camera module of the electronic device, prompting the user to point the camera module towards their ear when a first distance needs to be detected. Or, the radar may be located inside the earphone system, prompting the user to point the earphone body towards their ear when a first distance needs to be detected.
[0122] like Figure 8 As shown, after receiving a user's instruction that the electronic device has completed its adjustments, the electronic device activates the radar to detect the user's ears.
[0123] In one embodiment, the electronic device determines the detection distance between the auricle and the eardrum based on first detection information from the radar. If the detection distance is within a preset range, the radar is determined to be in a first position, and the detection distance is used as the first distance. If the detection distance is not within the preset range, the radar is determined not to be in the first position, and the user is prompted to readjust the position of the electronic device.
[0124] In another embodiment, after prompting the user to adjust the position of the electronic device, the electronic device activates the camera and determines the radar's position based on an image of the ear captured by the camera. For example, the electronic device determines the position of the ear image in the image captured by the camera when the radar is in a first position, based on the relative positional relationship between the camera and the radar. If the position of the ear image in the image captured by the camera matches a preset position, the radar is determined to be in the first position; otherwise, the radar is determined not to be in the first position. When the radar is in the first position, the electronic device activates the radar to detect the user's ear and obtains first detection information.
[0125] In another embodiment, after prompting the user to adjust the position of the electronic device, the electronic device activates the radar to detect until the detection distance obtained based on the detection information is within a preset range, and the detection distance is used as the first distance.
[0126] In one embodiment, the electronic device performs multiple detections on the user's ear, with the radar signal emitted in a different direction each time, and obtains first detection information for each detection. For each first detection information, a corresponding distance between the auricle and eardrum is calculated. The average of these distances is used to obtain the first distance, thereby eliminating the measurement error introduced by the positional offset of the electronic device during ear detection and improving the accuracy of the obtained first distance.
[0127] In one embodiment, the user's ear size information also includes the diameter of various parts of the ear canal, the length and width of the auricle, etc., obtained based on the first detection information. For example, the electronic device acquires the first detection information from the radar, and uses a super-resolution algorithm to perform three-dimensional reconstruction of the user's ear based on the first detection information, thereby restoring the structure of the ear, and determining the first distance, the diameter of various parts of the ear canal, and the length and width of the auricle based on the structure of the ear.
[0128] S1102: Obtain the user's head size information.
[0129] The user's head size information may include the length and width of the head, the length and width of the ears, the distance between the inner sides of the two ears, the distance between the outer sides of the two ears, and the width and depth of the nose. For example, Figure 16 As shown, the head size information includes the head width *a* and length *b*, and the distance *c* between the inner sides of the two auricles. (As...) Figure 17 As shown, the head size information includes the width d and length e of the auricle. After obtaining the distance between the outer sides of the two auricles, the electronic device can also determine the distance between the two eardrums based on the first distance detected by radar, and use the distance between the two eardrums as the head size information.
[0130] In one embodiment, the electronic device instructs the user to adjust the position of the electronic device so that the radar is in a second position. The second position can be a single position, such as a position directly facing the center of the user's face, or it can include three positions, such as a position directly facing the center of the user's face, a position on one side of the face directly facing the left ear, and a position on one side of the face directly facing the right ear.
[0131] Once the radar is located in the second position, the electronic equipment activates the radar. The radar's transmitted signal is directed towards the user's head, and after reflection from the user's head, an echo signal is obtained. This echo signal is mixed with a reference signal to obtain a mixed signal, which is the second detection information. The electronic equipment determines the user's head size information based on the second detection information.
[0132] For example, the electronic device determines the positions of multiple targets based on the second detection information. The positions of the multiple targets form a point cloud of the head. Image reconstruction is performed based on the point cloud of the head to obtain the head contour features. The head contour features reflect the size of the head in three-dimensional space. The head size information can be determined based on the head contour features.
[0133] In another embodiment, the electronic device acquires second detection information and determines the head contour features based on this information. Then, the electronic device acquires a head image obtained by photographing the head, corrects the head contour features based on the head image to obtain corrected head contour features, and determines head size information based on these corrected head contour features. By fusing radar detection information and image information, the accuracy of the obtained head size information can be improved. Specifically, the electronic device can employ a pre-trained correction model to correct the head contour features using the head image. The correction model is trained using contour features obtained from multiple sample images and radar detection information, and is used to output the corrected contour features based on the input image and the contour features obtained from the radar detection information.
[0134] In another embodiment, such as Figure 9 As shown, the electronic device acquires an image of the user's head and determines head size information based on the image. For example, the electronic device determines the actual head size, i.e., the head size information, based on the distance between the electronic device and the head, and the head size in the head image. The distance between the electronic device and the head can be preset, input by the user, determined based on the size of a reference object captured by the electronic device when photographing the head, or measured by a distance sensor on the electronic device. The electronic device can also determine the correspondence between the ear image in the captured head image and the actual ear size obtained from the first detection information, and determine the position of the electronic device relative to the ear based on this correspondence, thereby determining the distance between the electronic device and the head.
[0135] In another embodiment, the electronic device can also acquire head size information input by the user. For example, the electronic device outputs input boxes for head length, head width, ear length, ear width, distance between the outer sides of the two ears, and distance between the inner sides of the two ears, and determines the head size information based on the data entered by the user in the input boxes.
[0136] For example, when the electronic device detects that a user has enabled a preset sound effect (e.g., immersive sound), it outputs a prompt message asking the user to input head size information and provides input method options, including radar detection, camera capture, and user input. When the electronic device detects that radar detection has been selected, it prompts the user to place the device in a second position to obtain radar detection information and determines the head size information based on that information. When the electronic device detects that camera capture has been selected, it prompts the user to place the device in a designated position so that the camera can capture an image of the user's head and determine the head size information based on that image. When the electronic device detects that user input has been selected, it outputs an input box for the user to input their head size information.
[0137] S1103: Determine the first parameter of the head-related transfer function based on the first distance and the head size information.
[0138] In one embodiment, the electronic device inputs a first distance and head size information into a prediction model to obtain a first parameter output by the prediction model. The prediction model is trained using multiple sets of data as training samples. Each set of data includes head size information, the distance between the auricle and the eardrum, and parameters of the head-related transfer function. The prediction model is used to output the head-related transfer function based on the head size information and the distance between the auricle and the eardrum.
[0139] In another embodiment, the ear size information includes a first distance and auricle size. After obtaining the ear size information and head size information, the electronic device corrects the auricle size in the head size information using the auricle size in the ear size information to obtain the corrected head size information. Then, the first distance and head size information are input into the prediction model to obtain the first parameter output by the prediction model. This allows for the input of more accurate human feature parameters into the prediction model, resulting in first parameters that better match the user's human features.
[0140] In another embodiment, after obtaining the first distance and head size information, the electronic device performs a fusion process on the first distance and head size information to remove duplicate data and obtain key feature parameters, which are then used as human body feature parameters. The electronic device may employ correlation analysis and feature elimination methods for the fusion process. Subsequently, the electronic device inputs the human body feature parameters into a prediction model to obtain the first parameter output by the prediction model.
[0141] In another embodiment, the electronic device matches the first distance and head size information with a preset database to obtain the set of data in the preset database that is closest to the first distance and head size information. This closest set of data is then used as the current user's human feature parameters. The human feature parameters are then input into a prediction model to obtain the first parameter output by the prediction model. The preset database stores multiple sets of pre-measured human parameter data. For example, the preset database could be a CIPIC (Center for Image Processing and Integrated Computing) database, or it could be human parameter data obtained from testing actual human data pre-stored by the developer. The electronic device can sequentially calculate the similarity between the first distance and head size information and each set of human parameter data stored in the preset database, and use the human parameter data with the highest similarity as the current user's human feature parameters.
[0142] In another embodiment, the electronic device first determines the set of data that is closest to the first distance and head size information from a preset database, performs fusion processing on the closest set of data to obtain key feature parameters, uses the key feature parameters as human body feature parameters, and then inputs the human body feature parameters into the prediction model to obtain the first parameter output by the prediction model.
[0143] In one embodiment, the electronic device also acquires the user's neck size information (e.g., the width and length of the neck), inputs the first distance, head size information, and neck size information into the prediction model, and obtains the first parameter output by the prediction model to further improve the fit between the first parameter and the user.
[0144] S1104: Process the audio according to the head-related transfer function with the first parameter, and play the processed audio.
[0145] Specifically, the head correlation function is used to modulate the frequency, phase, and amplitude of sound, acting as a filter. After acquiring audio, the electronic device determines the frequency, phase, and amplitude of the audio, and modulates these parameters according to the head correlation function to obtain the processed audio. The electronic device then plays the processed audio, or instructs a device communicating with it (such as headphones) to play the audio.
[0146] In the above embodiments, the user's ears are detected by radar, and a first distance between the user's auricle and eardrum is obtained based on the first detection information. Based on the first distance and the head size information, a first parameter of the head-related transfer function is determined, thereby more accurately simulating the reflection of sound by the user's ears and obtaining the parameters of the user's personalized head-related transfer function. Then, the audio is processed according to the head-related transfer function with the first parameter. The user's personalized audio processing scheme can be used to process the audio, improve the audio processing accuracy, and thus improve the user's auditory experience.
[0147] The implementation flow of the audio playback method provided in one embodiment of this application is as follows: Figure 18 As shown, the electronic device includes a camera and a millimeter-wave radar. The electronic device acquires head images captured by the camera and determines the size information of the head and auricle based on these images. It also acquires ear detection information from the millimeter-wave radar, obtaining the size information of the auricle and a first distance between the auricle and the eardrum. The head and auricle size information determined from the head image, the auricle size information obtained from the millimeter-wave radar, and the first distance are fused to obtain human feature parameters. The electronic device inputs these human feature parameters into a prediction model, obtaining the first parameter of the HRTF output by the prediction model. Subsequently, the electronic device processes the audio using the HRTF with the first parameter, obtaining and playing the processed audio, making the played audio more compatible with the user's human features and providing better spatial effects.
[0148] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0149] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of an electronic device.
[0150] Figure 19 This is a software structure block diagram of an electronic device according to an embodiment of the present invention.
[0151] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0152] The application layer can include a series of application packages.
[0153] like Figure 19 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0154] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0155] like Figure 19 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0156] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0157] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0158] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0159] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).
[0160] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0161] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0162] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.
[0163] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0164] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0165] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0166] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0167] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0168] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0169] A 2D graphics engine is a graphics engine for 2D drawing.
[0170] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0171] For example, Figure 20 A schematic diagram of an electronic device 100 is shown.
[0172] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0173] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0174] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0175] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0176] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0177] In some embodiments, processor 110 may include one or more interfaces.
[0178] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0179] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks) and Bluetooth (BT).
[0180] Electronic device 100 implements display functions through a GPU, display screen 194, and application processor. Display screen 194 is used to display images, videos, etc.
[0181] Electronic device 100 can perform shooting functions through an ISP, camera 193, video codec, GPU, display 194, and application processor. Camera 193 is used to capture still images or videos. The ISP is used to process the data fed back from camera 193.
[0182] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.
[0183] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0184] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0185] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0186] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0187] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. In some embodiments, the electronic device 100 may also be equipped with three, four, or more microphones 170C to acquire sound signals, reduce noise, identify sound sources, and perform directional recording functions, etc.
[0188] The 170D headphone jack is used to connect wired headphones.
[0189] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0190] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0191] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.
[0192] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0193] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0194] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the above-described embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying the computer program code to a photographic device / electronic device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks.
[0195] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0196] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0197] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0198] Finally, it should be noted that the above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. An audio playback method, characterized in that, Applied to an electronic device, the electronic device including radar, the method includes: The system acquires the user's ear size information, which includes a first distance between the auricle and the eardrum. This first distance is determined based on first detection information obtained when the radar detects the user's ear. The first detection information includes a mixed signal of the radar's reference signal and an echo signal. The reference signal is the same as the radar's transmitted signal, and the echo signal is the signal obtained after the transmitted signal is reflected by the user's ear. Obtain the user's head size information; Based on the first distance and the head size information, determine the first parameter of the head-related transfer function; The audio is processed using the head-related transfer function with the first parameter as its parameter, and the processed audio is then played.
2. The method according to claim 1, characterized in that, The process of obtaining the user's ear size information includes: When the radar is in the first position, the first detection information is acquired; The first distance is determined based on the mixed frequency signal.
3. The method according to claim 2, characterized in that, Determining the first distance based on the mixing signal includes: Determine the highest and lowest frequencies of the mixing signal; The first distance is determined based on the highest frequency and the lowest frequency.
4. The method according to claim 1, characterized in that, The process of obtaining the user's head size information includes: When the radar is in the second position, the second detection information of the radar is acquired; The head size information is determined based on the second detection information.
5. The method according to claim 4, characterized in that, Determining the head size information based on the second detection information includes: The user's head contour features are determined based on the second detection information; Obtain the user's head image; The head contour features are corrected based on the head image to obtain the head size information.
6. The method according to claim 1, characterized in that, The process of obtaining the user's head size information includes: Obtain the user's head image; The head size information is determined based on the head image.
7. The method according to claim 1, characterized in that, The step of determining the first parameter of the head-related transfer function based on the first distance and the head size information includes: The first distance and the head size information are input into the prediction model to obtain the first parameter output by the prediction model.
8. The method according to any one of claims 1 to 7, characterized in that, The electronic device includes a display screen and a frame, the display screen and the frame forming a mounting cavity; The radar is located inside the mounting cavity and is adjacent to the antenna module inside the mounting cavity; Alternatively, the radar is located within the mounting cavity and is adjacent to the camera module within the mounting cavity; Alternatively, the radar may be located within the mounting cavity and disposed on the frame; Alternatively, the radar may be located within the mounting cavity and adjacent to the display screen.
9. The method according to any one of claims 1 to 7, characterized in that, The electronic device is a wireless earphone system, which includes a wireless earphone and a housing, with the radar located inside the housing.
10. The method according to claim 1, characterized in that, The radar in question is a millimeter-wave radar.
11. An electronic device, characterized in that, The method includes a processor for executing a computer program stored in a memory to implement the method as claimed in any one of claims 1 to 10.
12. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 10.
13. A computer program product, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1 to 10.
Citation Information
Patent Citations
System of sound spatialization and method personalization for the implementation thereof
US5987142A
Sound protecting headset with proximity collision avoidance protection
US7015812B1