Data processing method and device and electronic equipment

Abstract

The invention provides a data processing method and device and electronic equipment, and the method comprises the steps: modulating an audio signal of the electronic equipment to two ultrasonic carriers with different frequencies, and obtaining at least two modulation signals; outputting the processed at least two modulation signals through at least two vibration units of a loudspeaker of the electronic equipment; a loudspeaker of the electronic equipment comprises two channel types, each channel type corresponds to at least one vibration unit, and the center frequencies of modulation signals output by the channel types are different. An audio signal of a target frequency which can be sensed by a target object exists in the signal propagation medium; the target frequency is the difference between the two ultrasonic carrier frequencies.

Description

Technical Field

[0001] This disclosure relates to the field of loudspeaker technology, and more particularly to a data processing method, apparatus, and electronic device. Background Technology

[0002] Microelectromechanical systems loudspeakers (MEMS loudspeakers) have the advantages of small size and low distortion; however, the size of electronic devices also limits the diaphragm area of ​​MEMS loudspeakers, making it difficult to push enough air volume, resulting in significant attenuation of low-frequency (frequency less than 500Hz) sound pressure level (SPL), leading to insufficient low-frequency performance and making it unsuitable for free-field external sound playback. Summary of the Invention

[0003] This disclosure provides a data processing method, apparatus, and electronic device to at least solve the above-mentioned technical problems existing in the prior art.

[0004] According to a first aspect of this disclosure, a data processing method is provided, comprising: The audio signal of the electronic device is modulated onto two ultrasonic carriers of different frequencies to obtain at least two modulated signals; At least two modulated signals are processed by the output of at least two vibration units of the loudspeaker of the electronic device; the loudspeaker of the electronic device includes two channel types, each channel type corresponding to at least one vibration unit, and the center frequency of the modulated signal output by each channel type is different; so that an audio signal of a target frequency that can be perceived by the target object exists in the signal propagation medium; the target frequency is the difference between two ultrasonic carrier frequencies.

[0005] In the above scheme, before modulating the audio signal of the electronic device onto two ultrasonic carriers of different frequencies, the method further includes: Based on the type of electronic device, determine the target distance between the vibration unit that outputs the modulation signal and the target object; The time delay between the vibration unit and the target object is determined based on the target distance; The dynamic range of the audio signal is determined based on the modulation signal output by each vibration unit, the time delay between each vibration unit and the target object, and the volume configuration information of the electronic device. Adjust the frequency of the audio signal to enhance the bass and / or treble in the audio signal.

[0006] In the above scheme, determining the time delay between the vibration unit and the target object based on the target distance includes: Determine the distance between each vibrating element in the loudspeaker and the target object; The time delay corresponding to each vibration unit is determined based on the distance between each vibration unit and the target object and the speed of sound.

[0007] In the above scheme, modulating the audio signal of the electronic device onto two ultrasonic carriers of different frequencies includes: The frequencies of the two ultrasonic carriers are determined based on the target frequency and the frequency range of the ultrasonic carriers. The audio signal is modulated onto the two ultrasonic carrier waves to obtain at least two modulated signals; The at least two modulated signals are filtered.

[0008] The method in the above scheme further includes: The number of power amplification channels is determined based on the number of vibrating units in the loudspeaker of the electronic device; Based on the volume configuration of the electronic device, the at least two modulation signals are input to the power amplification channel for power amplification processing to obtain at least two amplified signals; In this power amplification channel, the number of modulation signals of different frequencies is the same.

[0009] The method in the above scheme further includes: The number of impedance matching channels is determined based on the number of vibrating units in the loudspeaker of the electronic device. The at least two amplified signals are input to an impedance matching channel for impedance matching processing to obtain at least two matched signals. At least two matching signals are output through the vibration unit of the speaker of the electronic device; each vibration unit outputs one matching signal.

[0010] According to a second aspect of this disclosure, a data processing apparatus is provided, the apparatus including a modulation unit and a speaker; The loudspeaker includes two channel types, each channel type corresponding to at least one vibration unit, and the number of vibration units in the loudspeaker is an even number. A modulation unit is used to modulate the audio signal of an electronic device onto at least two ultrasonic carriers of different frequencies to obtain at least two modulated signals; A loudspeaker for outputting at least two modulated signals after processing based on at least two vibration units; the signal propagation medium contains an audio signal whose frequency is a difference between different ultrasonic carrier frequencies that the target object can receive.

[0011] In the above scheme, the loudspeaker includes two vibration units, and each vibration unit corresponds to one channel; If the loudspeaker includes at least four vibration units, the at least four vibration units are arranged in an array; the vibration units in the same row of the array correspond to the same channel type, and the vibration units of different channel types are alternately arranged in the same column; or, the vibration units in the same column of the array correspond to the same channel type, and the vibration units of different channel types are alternately arranged in the same row and column.

[0012] In the above scheme, the modulation signals output by vibration units with the same channel type correspond to the same ultrasonic carrier frequency; The modulation signals output by vibration units with different channel types correspond to different ultrasonic carrier frequencies.

[0013] According to a third aspect of this disclosure, an electronic device is provided, comprising: At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform: modulating an audio signal of an electronic device onto two ultrasonic carriers of different frequencies to obtain at least two modulated signals; At least two modulated signals are processed by the output of at least two vibration units of the loudspeaker of the electronic device; the loudspeaker of the electronic device includes two channel types, each channel type corresponding to at least one vibration unit, and the center frequency of the modulated signal output by each channel type is different; so that an audio signal of a target frequency that can be perceived by the target object exists in the signal propagation medium; the target frequency is the difference between two ultrasonic carrier frequencies.

[0014] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0015] The above and other objects, features, and advantages of this disclosure will become readily apparent from the following detailed description of exemplary embodiments, taken in conjunction with the accompanying drawings. Several embodiments of this disclosure are illustrated in the drawings by way of example and not limitation, in which: In the accompanying drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

[0016] Figure 1 A schematic diagram of an optional flow of the data processing method provided in an embodiment of this disclosure is shown; Figure 2 A schematic diagram of the principle provided in the embodiments of this disclosure is shown; Figure 3 A schematic diagram of a first optional structure of a loudspeaker provided in an embodiment of this disclosure is shown; Figure 4 A schematic diagram of a second optional structure of a loudspeaker provided in an embodiment of this disclosure is shown; Figure 5 A schematic diagram of a speaker array provided in an embodiment of this disclosure is shown; Figure 6 A schematic diagram of a second optional flow of the data processing method provided in an embodiment of this disclosure is shown; Figure 7 A schematic diagram of the architecture of the data processing method provided in an embodiment of this disclosure is shown; Figure 8 A schematic diagram is shown to determine the time delay and amplitude corresponding to the vibration unit; Figure 9 A schematic diagram of an optional structure of the data processing apparatus provided in an embodiment of this disclosure is shown; Figure 10 A schematic diagram of the composition structure of an electronic device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0017] To make the objectives, features, and advantages of this disclosure more apparent and understandable, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0018] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0019] In the following description, the terms "first" and "second" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first" and "second" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this disclosure described herein can be implemented in an order other than that illustrated or described herein.

[0020] Unless otherwise defined, all technical and scientific terms used in this disclosure have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terminology used in this disclosure is for the purpose of describing embodiments of this disclosure only and is not intended to be limiting of this disclosure.

[0021] It should be understood that in the various embodiments of this disclosure, the sequence number of each implementation process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this disclosure.

[0022] Figure 1 An optional flowchart of the data processing method provided in the embodiments of this disclosure is shown, and the steps will be described accordingly.

[0023] Step S101: Modulate the audio signal of the electronic device onto two ultrasonic carriers of different frequencies to obtain at least two modulated signals.

[0024] In some embodiments, the electronic device acquires audio signals, including audio signals recorded by the electronic device, audio signals to be played by applications running on the electronic device, audio signals to be played for the electronic device's call function, and audio signals received by the electronic device from other electronic devices. The applications may include video / audio applications, social applications, browsers, conferencing applications, etc.

[0025] In some embodiments, the loudspeaker of the electronic device includes two channel types, each channel type corresponding to at least one vibration unit, and each vibration unit corresponding to one channel. The center frequency of the modulation signal output by each channel type is different. The center frequency of the modulation signal output by any channel type is the frequency of the ultrasonic carrier wave corresponding to that channel type.

[0026] The ultrasonic carrier described in this embodiment includes an ultrasonic signal with a frequency greater than 20,000 Hz, i.e., a signal that cannot be heard by the human ear. The ultrasonic carrier can be obtained based on an ultrasonic carrier generator.

[0027] In some embodiments, the carrier determines the frequencies of the two ultrasonic carriers respectively and modulates the audio signal onto the two ultrasonic carriers respectively to obtain at least two modulated signals.

[0028] In some alternative embodiments, the number of modulation signals is the same as the number of vibration units, that is, each vibration unit outputs one modulation signal.

[0029] In step S102, at least two modulated signals are output by at least two vibration units of the loudspeaker of the electronic device after processing.

[0030] In some embodiments, the electronic device outputs at least two processed modulated signals through at least two vibration units of the speaker, the processing including at least one of dynamic range control (DRC), equalization (EQ), filtering, amplification, and impedance matching.

[0031] In some embodiments, the at least two vibration units output at least two processed modulation signals, which are demodulated in air to obtain a first frequency signal, a second frequency signal, and a signal with the same frequency as the two ultrasonic carriers. The first frequency signal has the sum of the frequencies of the two ultrasonic carriers and is unreceptible to the human ear; the second frequency signal has the difference between the frequencies of the two ultrasonic carriers and is receptive to the human ear.

[0032] Optionally, if the frequency difference between the two ultrasonic carriers is less than a frequency threshold, the second frequency signal can be determined to be a low-frequency signal, representing a low-frequency sound pressure level signal generated by the diaphragm of the vibrating unit being unable to push the air up. The frequency threshold can be any frequency within 1000Hz.

[0033] Figure 2 A schematic diagram of the principle provided in the embodiments of this disclosure is shown.

[0034] like Figure 2 As shown, after modulating the audio signal onto at least two ultrasonic carrier waves, a modulation signal with frequency f1 and a modulation signal with frequency f2 are obtained. The loudspeaker outputs the two modulation signals, which are then demodulated in the air through the nonlinear effect of the medium (air) to obtain a first frequency signal with frequency f1 + f2. The second frequency signal, and the modulation signal with frequency f1 and the modulation signal with frequency f2; wherein, the first frequency signal, the modulation signal with frequency f1 and the modulation signal with frequency f2 cannot be received by the human ear, only the frequency f1 is received by the human ear. The second frequency signal can be received by the human ear, which is why we can hear sounds.

[0035] Specifically, during propagation, the ultrasonic carrier wave (ultrasound wave) generates intermodulation components due to nonlinear effects. The two modulated signals interact to produce... Second frequency signals, such as 48.5 kHz and 48 kHz, can produce audible sounds at 500 Hz.

[0036] Thus, the data processing method provided in this disclosure addresses the problem that the diaphragm of a vibrating unit is unable to push air to generate low-frequency sound pressure level signals. Instead of the traditional approach of increasing amplitude or vibrating area, it proposes outputting ultrasonically modulated signals through multiple channels of a two-channel speaker, allowing the modulated signals of different frequencies to demodulate in the air, thereby obtaining low-frequency sound pressure level signals that the diaphragm cannot generate. Specifically, currently, the low-frequency signals directly output by the diaphragm of a vibrating unit attenuate too quickly. To overcome this problem, a high-frequency modulated signal that attenuates more slowly and is undetectable by the human ear is output by the diaphragm, allowing it to demodulate in the air to obtain a low-frequency signal, thus improving the speaker's playback performance.

[0037] In some embodiments, the loudspeaker provided in this disclosure includes two channel types, each channel type corresponding to at least one vibration unit, and the number of vibration units in the loudspeaker is an even number.

[0038] In some embodiments, if the loudspeaker includes two vibration units, each vibration unit corresponds to one channel, and the two channels have different channel types (e.g., one channel type is L, and the other channel type is R); if the loudspeaker includes at least four vibration units, the at least four vibration units are arranged in an array; vibration units in the same row of the array correspond to the same channel type, and vibration units of different channel types are alternately arranged in the same column; or, vibration units in the same column of the array correspond to the same channel type, and vibration units of different channel types are alternately arranged in the same row and column. The more vibration units there are, the higher the sound pressure level that can be driven.

[0039] Among them, the modulation signals output by vibration units with the same channel type correspond to the same ultrasonic carrier frequency; the modulation signals output by vibration units with different channel types correspond to different ultrasonic carrier frequencies.

[0040] Figure 3 A schematic diagram of a first alternative structure of a loudspeaker provided in an embodiment of this disclosure is shown, and will be described in terms of each part.

[0041] Figure 3 The loudspeaker shown includes two vibration units and two channel types, namely channel type 1 and channel type 2. Each channel type corresponds to one channel, and each channel corresponds to one vibration unit.

[0042] In some embodiments, if the audio signal is modulated onto ultrasonic carrier 1 and ultrasonic carrier 2 respectively to obtain modulation signal 1 and modulation signal 2, then the two vibration units included in the loudspeaker will each output a modulation signal, such as the vibration unit corresponding to channel type 1 outputting modulation signal 1 and the vibration unit corresponding to channel type 2 outputting modulation signal 2; or, the vibration unit corresponding to channel type 1 outputting modulation signal 2 and the vibration unit corresponding to channel type 2 outputting modulation signal 1.

[0043] In this way, frequencies of can be demodulated in the air. The demodulated signal.

[0044] Figure 4 A schematic diagram of a second alternative structure for a loudspeaker provided in an embodiment of this disclosure is shown, and will be described in terms of the various parts.

[0045] Figure 4The loudspeaker shown includes 16 vibrating units, each corresponding to one channel. The loudspeaker includes two channel types: Channel Type 1 and Channel Type 2. Each channel type includes 8 channels, and the channels of the same type output the same signal frequency. The 16 vibration units are arranged in an array; as shown Figure 3 As shown, vibration units in the same column of the array correspond to the same channel type, while vibration units with different channel types are alternately arranged in the same row and column. Alternatively, it can be... Figure 3 The speaker is rotated so that the vibration units in the same row of the array have the same channel type, and the vibration units with different channel types are staggered in the same column.

[0046] In some embodiments, if the audio signal is modulated onto ultrasonic carrier 1 and ultrasonic carrier 2 respectively to obtain modulation signal 1 and modulation signal 2, then the two channel types corresponding to the speaker will each output a modulation signal. For example, the eight vibration units corresponding to channel type 1 will output modulation signal 1, and the eight vibration units corresponding to channel type 2 will output modulation signal 2, or the eight vibration units corresponding to channel type 1 will output modulation signal 2, and the eight vibration units corresponding to channel type 2 will output modulation signal 1.

[0047] Figure 5 A schematic diagram of a speaker array provided in an embodiment of this disclosure is shown.

[0048] To facilitate the display of parameters, Figure 5 The display shows only one row or one column of speaker arrays; or the speaker arrays are arranged in one row or one column.

[0049] like Figure 5 As shown, the loudspeaker array includes multiple vibrating units, each of which is rectangular. Parameters include element width, element spacing, element pitch (the distance between the centers of two adjacent vibrating units), element length, and the longest dimension of the array (transducer width), such as the total width laterally. Specific values ​​can be set according to production requirements.

[0050] Figure 6 A second alternative flowchart of the data processing method provided in this disclosure embodiment is shown, and will be described according to each step.

[0051] Step S201: Modulate the audio signal of the electronic device onto two ultrasonic carriers of different frequencies to obtain at least two modulated signals.

[0052] In some embodiments, the electronic device determines the frequencies of the two ultrasonic carriers based on a target frequency and the frequency range of the ultrasonic carriers; and modulates the audio signal onto the two ultrasonic carriers to obtain at least two modulated signals.

[0053] In some embodiments, the target frequency includes a frequency that the target object can receive, i.e., the difference between the frequencies of two ultrasonic carriers that the human ear can hear, typically less than 1000 Hz. The electronic device determines the frequency of each ultrasonic carrier based on the target frequency and the frequency range of the two ultrasonic carriers, such that the difference between the frequencies of the two ultrasonic carriers is the target frequency.

[0054] In some alternative embodiments, the electronic device may also filter the at least two modulation signals.

[0055] Step S202: Process at least two modulation signals to obtain at least two processed modulation signals.

[0056] In some embodiments, processing the at least two modulation signals may include multi-channel amplification of the at least two modulation signals to provide sufficient driving power to the speaker's vibration unit, wherein the number of amplification channels is the same as the number of vibration units; then impedance matching is performed on the amplified modulation signals to ensure that the amplified signals can be efficiently transmitted to the speaker, reducing energy loss and optimizing sound quality.

[0057] Step S203: Determine the delay and amplitude of the audio signal based on the type of electronic device.

[0058] In some embodiments, the location information of the target object differs depending on the type of electronic device; the target object includes the location of the object receiving the audio signal.

[0059] In some embodiments, users have different habits when using different types of electronic devices; for example, if the electronic device is a computer, it is usually placed on a desktop and used at a certain distance from the user; if the electronic device is a mobile phone, it is usually held in hand and used at a shorter distance from the user. Furthermore, when sound travels to different distances or to different focal points, the time delay and amplitude of the signals emitted by each vibrating unit differ.

[0060] In practice, if the electronic device is a computer, the target object should be positioned 50cm to 60cm away from the screen; if the electronic device is a mobile phone or tablet, the target object should be positioned 25cm to 40cm away from the screen. In other words, the target object's position is determined based on the user's habits when using different electronic devices.

[0061] In some embodiments, the electronic device can determine the distance between each vibration unit and the target object, and determine a reference distance between the first vibration unit and the target object; based on the difference between the reference distance and the distance between each vibration unit and the target object, and the speed of sound, it can determine the time delay of other vibration units relative to the first vibration unit, so that the signals output by each vibration unit can reach the target object simultaneously.

[0062] The first vibration unit can be any vibration unit, or it can be the vibration unit at the center of the array, the closest to the target object, or the edge of the array.

[0063] In some embodiments, the carrier determines the signal amplitude corresponding to the location of the target object based on the volume configuration information of the electronic device, and determines the amplitude of the audio signal corresponding to each vibration unit based on the signal amplitude corresponding to the location of the target object. Optionally, the carrier can adjust the dynamic range (or amplitude) of the audio signal corresponding to each vibration unit based on dynamic range control.

[0064] In some embodiments, the carrier processes the modulated signal based on the amplitude and time delay corresponding to each vibration unit.

[0065] Step S204: At least two modulated signals are output by at least two vibration units of the loudspeaker of the electronic device after processing.

[0066] The specific steps of step S204 are the same as those of step S102, and will not be repeated here.

[0067] Thus, through the data processing method provided in this disclosure, addressing the problem that the diaphragm of the vibrating unit is unable to push the air to generate low-frequency sound pressure level signals, this disclosure proposes to output ultrasonically modulated signals from the two channels of the speaker, allowing the modulated signals with different frequencies to be demodulated in the air to obtain low-frequency sound pressure level signals that the diaphragm cannot generate. Specifically, currently, the low-frequency signals directly output by the diaphragm of the vibrating unit attenuate too quickly. To overcome this problem, a high-frequency modulated signal that attenuates more slowly and is undetectable by the human ear is output from the diaphragm, allowing it to be demodulated in the air to obtain a low-frequency signal, thereby improving the speaker's playback effect.

[0068] Figure 7 A schematic diagram of the architecture of the data processing method provided in the embodiments of this disclosure is shown, and will be described in terms of each part.

[0069] In some embodiments, the hardware involved in audio signal processing includes a microcontroller unit (MCU) and a digital signal processor (DSP), which includes a dynamic range control unit (DRC), an equalizer (EQ), a modulation module, and a filter module; a multichannel amplifier and a matching network.

[0070] In some embodiments, the hardware in the system is powered by a digital voltage drain (DVDD), and data is transmitted between the hardware components based on the Inter-IC Sound (I2S) protocol.

[0071] In some embodiments, the microcontroller unit is used for power amplifier configuration, sampling frequency configuration, and switching frequency control; the audio signal is first input to the digital signal processor, then the dynamic range control unit optimizes the dynamic range of the audio signal to avoid distortion, and then the equalizer adjusts the frequency response of the audio signal to improve the sound quality of the audio signal.

[0072] The acoustic carrier wave, after being processed by a filter, yields a modulated signal.

[0073] The modulated signal is input to a multi-channel amplification module for multi-channel amplification, providing sufficient drive power to the speaker array. Finally, it undergoes impedance matching via a matching network to ensure efficient transmission of the amplified modulated signal to the speakers, reducing energy loss and optimizing sound quality. The impedance matching unit consists of resistors, capacitors, and inductors.

[0074] In some embodiments, in order to focus the processed modulation signal onto the position of the target object, it is necessary to adjust the processed modulation signal output by each vibration unit.

[0075] Figure 8 A schematic diagram is shown to determine the time delay and amplitude corresponding to the vibration unit.

[0076] like Figure 8 As shown, the location of the virtual sound source formed by focusing corresponds to the location of the target object, that is, the location where the audio signal may be received.

[0077] To focus the signals output from multiple vibration units, the time delay and amplitude of the processed modulated signals from each unit need to be adjusted so that they arrive at the virtual sound source simultaneously. The virtual sound source receives the signals from these multiple processed modulated signals. include:

[0078] in, Characterizing the first The signal output by each vibration unit (processed modulated signal); Characterizing the first The weight of each vibration element, Characterizing the first The time delay of each vibration unit relative to the reference point (the first vibration unit involved in step S203).

[0079] Furthermore, the acoustic pressure equation for the signal (after demodulation) in the medium is:

[0080]

[0081] in, The peak sound pressure level of the demodulated signal in the time domain; The sound pressure of the audible sound (i.e., the second frequency signal) demodulated in the medium; For air nonlinear coefficients; The frequency of the signal output by the vibration unit; For ultrasonic carrier sound pressure; For the distance of propagation; Speed ​​of sound; air density; This is the modulation envelope function. It can be obtained through the following formula:

[0082] in, For temperature, This refers to relative humidity.

[0083] Figure 9 A schematic diagram of an optional structure of the data processing apparatus provided in an embodiment of this disclosure is shown, and the details will be described in terms of each part.

[0084] In some embodiments, the data processing apparatus includes a speaker and a modulation unit.

[0085] The loudspeaker includes two channel types, each channel type corresponding to at least one vibration unit, and the number of vibration units in the loudspeaker is an even number. A modulation unit is used to modulate the audio signal of an electronic device onto at least two ultrasonic carriers of different frequencies to obtain at least two modulated signals; A loudspeaker for outputting at least two modulated signals after processing based on at least two vibration units; the signal propagation medium contains an audio signal whose frequency is a difference between different ultrasonic carrier frequencies that the target object can receive.

[0086] In some embodiments, if the loudspeaker includes two vibration units, then each vibration unit corresponds to a channel type; If the loudspeaker includes at least four vibration units, the at least four vibration units are arranged in an array; the vibration units in the same row of the array correspond to the same channel type, and the vibration units of different channel types are alternately arranged in the same column; or, the vibration units in the same column of the array correspond to the same channel type, and the vibration units of different channel types are alternately arranged in the same row and column.

[0087] In some embodiments, the modulation signals output by vibration units of the same channel type correspond to the same ultrasonic carrier frequency; The modulation signals output by vibration units with different channel types correspond to different ultrasonic carrier frequencies.

[0088] The modulation unit is further configured to determine the position information of the target object based on the type of electronic device before at least two modulation signals are output after processing by at least two vibration units of the speaker of the electronic device. The time delay corresponding to each vibration unit is determined based on the position information of the target object; The dynamic range of the audio signal is determined based on the modulation signal output by each vibration unit, the time delay between each vibration unit and the target object, and the volume configuration information of the electronic device. Adjust the frequency of the audio signal to enhance the bass and / or treble in the audio signal.

[0089] The modulation unit is specifically used to determine the distance between each vibration unit in the loudspeaker and the target object; The time delay corresponding to each vibration unit is determined based on the distance between each vibration unit and the target object and the speed of sound.

[0090] The modulation unit is specifically used to determine the frequencies of the two ultrasonic carriers based on the target frequency and the frequency range of the ultrasonic carriers. The audio signal is modulated onto the two ultrasonic carrier waves to obtain at least two modulated signals; The at least two modulated signals are filtered.

[0091] The modulation unit is specifically used to determine the number of power amplification channels based on the number of vibration units in the loudspeaker of the electronic device. Based on the volume configuration of the electronic device, the at least two modulation signals are input to the power amplification channel for power amplification processing to obtain at least two amplified signals; In this power amplification channel, the number of modulation signals of different frequencies is the same.

[0092] The modulation unit is specifically used to determine the number of impedance matching channels based on the number of vibration units in the loudspeaker of the electronic device. The at least two amplified signals are input to an impedance matching channel for impedance matching processing to obtain at least two matched signals. At least two matching signals are output through the vibration unit of the speaker of the electronic device; each vibration unit outputs one matching signal.

[0093] According to embodiments of this disclosure, this disclosure also provides an electronic device and a readable storage medium.

[0094] Figure 10 A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0095] like Figure 10 As shown, the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes based on a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. The RAM 803 may also store various programs and data required for the operation of the electronic device 800. The computing unit 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0096] Multiple components in electronic device 800 are connected to I / O interface 805, including: input unit 806, such as keyboard, mouse, etc.; speaker 807, such as various types of monitors, speakers, etc.; storage unit 808, such as disk, optical disk, etc.; and communication unit 809, such as network card, modem, wireless transceiver, etc. Communication unit 809 allows electronic device 800 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0097] The computing unit 801 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as data processing methods. For example, in some embodiments, the data processing method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 800 via ROM 802 and / or communication unit 809. When the computer program is loaded into RAM 803 and executed by the computing unit 801, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform data processing methods by any other suitable means (e.g., by means of firmware).

[0098] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0099] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0100] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0101] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0102] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0103] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0104] It should be understood that the various forms of processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0105] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this disclosure, "a plurality of" means two or more, unless otherwise explicitly specified.

[0106] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A data processing method, the method comprising: The audio signal of the electronic device is modulated onto two ultrasonic carriers of different frequencies to obtain at least two modulated signals; At least two modulated signals are processed by the output of at least two vibration units of the loudspeaker of the electronic device; the loudspeaker of the electronic device includes two channel types, each channel type corresponding to at least one vibration unit, and the center frequency of the modulated signal output by each channel type is different; so that an audio signal of a target frequency that can be perceived by the target object exists in the signal propagation medium; the target frequency is the difference between two ultrasonic carrier frequencies.

2. The method according to claim 1, further comprising, before the at least two modulated signals processed by the at least two vibration units of the loudspeaker of the electronic device are output: Determine the location information of the target object based on the type of electronic device; The time delay corresponding to each vibration unit is determined based on the position information of the target object; The dynamic range of the audio signal is determined based on the modulation signal output by each vibration unit, the time delay between each vibration unit and the target object, and the volume configuration information of the electronic device. Adjust the frequency of the audio signal to enhance the bass and / or treble in the audio signal.

3. The method according to claim 2, wherein determining the time delay between the vibration unit and the target object based on the target distance comprises: Determine the distance between each vibrating element in the loudspeaker and the target object; The time delay corresponding to each vibration unit is determined based on the distance between each vibration unit and the target object and the speed of sound.

4. The method according to claim 1, wherein modulating the audio signal of the electronic device onto two ultrasonic carriers of different frequencies comprises: The frequencies of the two ultrasonic carriers are determined based on the target frequency and the frequency range of the ultrasonic carriers. The audio signal is modulated onto the two ultrasonic carrier waves to obtain at least two modulated signals; The at least two modulated signals are filtered.

5. The method according to claim 1, further comprising: The number of power amplification channels is determined based on the number of vibrating units in the loudspeaker of the electronic device; Based on the volume configuration of the electronic device, the at least two modulation signals are input to the power amplification channel for power amplification processing to obtain at least two amplified signals; In this power amplification channel, the number of modulation signals of different frequencies is the same.

6. The method according to claim 5, further comprising: The number of impedance matching channels is determined based on the number of vibrating units in the loudspeaker of the electronic device. The at least two amplified signals are input to an impedance matching channel for impedance matching processing to obtain at least two matched signals. At least two matching signals are output through the vibration unit of the speaker of the electronic device; each vibration unit outputs one matching signal.

7. A data processing apparatus, the apparatus comprising a modulation unit and a speaker; The loudspeaker includes two channel types, each channel type corresponding to at least one vibration unit, and the number of vibration units in the loudspeaker is an even number. A modulation unit is used to modulate the audio signal of an electronic device onto at least two ultrasonic carriers of different frequencies to obtain at least two modulated signals; A loudspeaker for outputting at least two modulated signals after processing based on at least two vibration units; the signal propagation medium contains an audio signal whose frequency is a difference between different ultrasonic carrier frequencies that the target object can receive.

8. The apparatus according to claim 7, If the loudspeaker includes two vibration units, then each vibration unit corresponds to one channel; If the loudspeaker includes at least four vibration units, the at least four vibration units are arranged in an array; the vibration units in the same row of the array correspond to the same channel type, and the vibration units of different channel types are alternately arranged in the same column; or, the vibration units in the same column of the array correspond to the same channel type, and the vibration units of different channel types are alternately arranged in the same row and column.

9. The apparatus according to claim 7, Vibration units with the same channel type output modulation signals have the same ultrasonic carrier frequency. The modulation signals output by vibration units with different channel types correspond to different ultrasonic carrier frequencies.

10. An electronic device, characterized in that, include: At least one processor; And a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform: modulating an audio signal of an electronic device onto two ultrasonic carriers of different frequencies to obtain at least two modulated signals; At least two modulated signals are processed by the output of at least two vibration units of the loudspeaker of the electronic device; the loudspeaker of the electronic device includes two channel types, each channel type corresponding to at least one vibration unit, and the center frequency of the modulated signal output by each channel type is different; so that an audio signal of a target frequency that can be perceived by the target object exists in the signal propagation medium; the target frequency is the difference between two ultrasonic carrier frequencies.

Images