Methods for sound reinforcement, voice recording, and text summarization using loudspeakers and mobile terminals
By working in tandem with the loudspeaker and the mobile terminal, synchronous collaboration of multiple audio source inputs, mixing processing, real-time sound amplification playback, and text summarization is achieved. This solves the problems of discrepancies between recording and playback effects and low device integration in existing technologies, and improves recording fidelity and operational efficiency.
Patent Information
- Application Number
- CN202611288497.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-24
- Publication Date
- 2026-11-10
AI Technical Summary
Existing amplification equipment suffers from problems such as discrepancies between recorded content and actual external playback effect in synchronous recording and text processing, limited collaborative modes, and the need for additional equipment, making it difficult to meet the integrated needs of synchronous sound reinforcement, real-time recording, and automatic summarization in scenarios such as teaching and meetings.
The loudspeaker works in tandem with the mobile terminal, enabling synchronous collaboration between sound amplification playback, recording, and text generation through multi-source audio input, mixing, real-time sound amplification playback, analog audio acquisition, digital audio transmission, speech recognition, and text summarization.
It achieves consistency between recorded and external audio, improves recording fidelity, simplifies device integration, reduces deployment costs, and meets the needs of real-time recording and automatic summarization in scenarios such as teaching and meetings.
Smart Images

Figure CN123075334A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of audio amplification and speech information processing technology, and in particular to a method for amplification, speech recording and text summarization in collaboration between a loudspeaker and a mobile terminal. Background Technology
[0002] While existing public address systems possess multi-source audio input and power amplification capabilities, they suffer from several shortcomings in the collaborative application of simultaneous recording and text processing. Firstly, the audio acquisition nodes of existing amplifiers are mostly located at the audio input front end, only capable of capturing the raw signal from a single source. They cannot acquire the final playback audio after mixing and volume adjustment, resulting in discrepancies between the recorded content and the actual external playback effect, failing to fully reproduce the authentic sound of the amplified environment. Secondly, the collaboration mode between existing public address systems and mobile terminals is relatively simple, only supporting post-transmission of audio files. It cannot simultaneously complete audio acquisition, real-time uploading, and text processing while amplifying playback, leading to poor timeliness of voice recording and content organization, and cumbersome operation steps. Thirdly, existing solutions require additional independent recording and text processing equipment to achieve recording transcription and summary generation, resulting in low system integration, high deployment costs, and difficulty in meeting the integrated needs of simultaneous amplification, real-time recording, and automatic summarization in scenarios such as teaching and meetings. Summary of the Invention
[0003] This application provides a method for sound amplification, voice recording, and text summarization that integrates a loudspeaker and a mobile terminal. It aims to solve the problems of existing solutions that require additional independent recording and text processing equipment to achieve recording transcription and summary generation, resulting in low system integration, high deployment costs, and difficulty in meeting the integrated needs of simultaneous sound amplification, real-time recording, and automatic summarization in scenarios such as teaching and meetings.
[0004] In a first aspect, embodiments of this application provide a method for sound amplification, voice recording, and text summarization in collaboration between a loudspeaker and a mobile terminal, the method comprising: The amplifier receives dedicated wireless audio signals, Bluetooth audio signals, and digital audio signals input via a wired interface. The amplifier decodes and mixes the multiple input audio signals, and after volume adjustment and power amplification, drives the sound unit to amplify the sound in real time. While the loudspeaker is playing amplified audio, it collects the complete mixed analog audio signal from the power amplifier output and converts the analog audio signal into digital audio data; the loudspeaker then transmits the digital audio data synchronously to the mobile terminal via a wired data interface. The system controls the mobile terminal to perform speech recognition processing on the received digital audio data and generate text content corresponding to the audio content; it also controls the mobile terminal to perform key semantic extraction processing on the generated text content and generate corresponding text summaries.
[0005] In some embodiments, the control amplifier receives a dedicated wireless audio signal, a Bluetooth audio signal, and a digital audio signal input via a wired interface, including: the control amplifier acquires a dedicated wireless audio signal through a dedicated wireless receiving unit, the control amplifier acquires a Bluetooth audio signal through a Bluetooth receiving unit, the control amplifier receives a digital audio signal input from an external device through a wired data interface, and the three audio signals are simultaneously sent to the internal processing module of the amplifier.
[0006] In some embodiments, the control amplifier performs decoding and mixing of multiple input audio signals, including: controlling the amplifier to perform digital decoding processing on dedicated wireless audio signals, performing decoding processing on Bluetooth audio signals and digital audio signals input through wired interfaces respectively, and hardware superimposing all decoded audio signals to generate a unified mixed audio signal.
[0007] In some embodiments, driving the sound-generating unit to perform real-time sound amplification playback after volume adjustment and power amplification includes: sending the mixed audio signal to the analog volume adjustment unit to perform stepless volume adjustment processing, sending the adjusted audio signal to the power amplification unit to perform power amplification processing, and outputting the amplified audio signal to the sound-generating unit to complete real-time sound amplification playback.
[0008] In some embodiments, the control amplifier, while playing amplified audio, acquires the complete mixed analog audio signal from the power amplifier output terminal, including: setting an audio acquisition node at the output terminal of the power amplifier unit, and acquiring all analog audio signals after mixing and volume adjustment in real time throughout the entire process of amplified audio playback.
[0009] In some embodiments, the conversion of analog audio signals into digital audio data includes: sending the acquired analog audio signals into the analog-to-digital conversion module built into the audio main control unit, performing analog-to-digital signal conversion processing, and generating standardized digital audio data.
[0010] In some embodiments, the control amplifier synchronously transmits digital audio data to a mobile terminal via a wired data interface, including: packaging the digital audio data according to a preset transmission protocol, transmitting the packaged data to the mobile terminal in real time via the wired data interface, and keeping the transmission timing synchronized with the sound reinforcement playback timing.
[0011] In some embodiments, the control of the mobile terminal to perform speech recognition processing on the received digital audio data to generate text content corresponding to the audio content includes: the mobile terminal performing segmented preprocessing on the received digital audio data, calling a speech recognition model to recognize and convert the preprocessed audio data, and generating continuous text content corresponding to the audio semantics.
[0012] In some embodiments, the control of the mobile terminal to perform key semantic extraction processing on the generated text content and generate a corresponding text summary includes: the mobile terminal performing semantic segmentation and core information recognition on the generated text content, filtering and retaining key sentences and core semantics in the text, and generating a concise text summary after removing redundant content.
[0013] In some embodiments, the method further includes: the mobile terminal aligning and binding the generated text content and text summary with digital audio data according to the timeline to generate an audio-text synchronization recording file that supports rapid keyword location.
[0014] This application supports multi-source audio input and unified mixing for amplified sound, compatible with dedicated wireless, Bluetooth, and wired audio input methods, adapting to different amplification needs and broadening its applicability. By acquiring complete mixed analog audio from the power amplifier output, the recorded audio is completely consistent with the actual external sound, realistically reflecting the amplification effect after volume adjustment and multi-source mixing, significantly improving recording fidelity. It achieves synchronized collaboration across the entire process of amplified playback, audio acquisition, data transmission, speech recognition, and text summarization, eliminating the need for separate post-processing and significantly improving the efficiency of voice recording and content organization. Relying on the collaborative division of labor between amplifier hardware acquisition and mobile terminal intelligent processing, no additional independent recording and transcription equipment is required, resulting in high system integration and reduced deployment and usage costs.
[0015] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description
[0016] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0017] Figure 1 This is a schematic flowchart illustrating the steps of a method for sound amplification, voice recording, and text summarization in collaboration with a loudspeaker and a mobile terminal, according to an embodiment of this application. Figure 2 This is a schematic diagram illustrating the principle of a method for sound amplification, voice recording, and text summarization in collaboration with a loudspeaker and a mobile terminal, provided in one embodiment of this application. Figure 3 This is a circuit diagram of a loudspeaker provided in one embodiment of this application; Figure 4 This is a schematic block diagram of a loudspeaker and mobile terminal collaborative sound amplification, voice recording and text summarization system provided in one embodiment of this application; Figure 5 This is a schematic block diagram of the structure of a computer device provided in an embodiment of this application.
[0018] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Detailed Implementation
[0019] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0020] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.
[0021] It should be understood that, in order to clearly describe the technical solutions of the embodiments of the present invention, the terms "first" and "second" are used in the embodiments of the present invention to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.
[0022] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.
[0023] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0024] While existing public address systems possess multi-source audio input and power amplification capabilities, they suffer from several shortcomings in the collaborative application of simultaneous recording and text processing. Firstly, the audio acquisition nodes of existing amplifiers are mostly located at the audio input front end, only capable of capturing the raw signal from a single source. They cannot acquire the final playback audio after mixing and volume adjustment, resulting in discrepancies between the recorded content and the actual external playback effect, failing to fully reproduce the authentic sound of the amplified environment. Secondly, the collaboration mode between existing public address systems and mobile terminals is relatively simple, only supporting post-transmission of audio files. It cannot simultaneously complete audio acquisition, real-time uploading, and text processing while amplifying playback, leading to poor timeliness of voice recording and content organization, and cumbersome operation steps. Thirdly, existing solutions require additional independent recording and text processing equipment to achieve recording transcription and summary generation, resulting in low system integration, high deployment costs, and difficulty in meeting the integrated needs of simultaneous amplification, real-time recording, and automatic summarization in scenarios such as teaching and meetings.
[0025] This embodiment provides a method for sound amplification, voice recording, and text summarization through collaboration between a loudspeaker and a mobile terminal. It can be applied to various scenarios requiring simultaneous sound amplification and content retention, such as classroom sound amplification, meeting recording, and on-site presentations. This method is executed collaboratively by the loudspeaker and the mobile terminal. The loudspeaker handles audio reception, mixing, sound amplification, data acquisition, and data uploading, while the mobile terminal handles speech recognition and text summarization processing. All audio and text data involved in this method are collected, transmitted, and processed with user authorization, and the entire process complies with relevant data security and privacy protection regulations.
[0026] Figure 1 This is a schematic diagram of the overall process of this method, which is divided into three core execution stages; Figure 2 This diagram illustrates the system application scenario of this method, showing the connection relationship and data flow between the speaker, wireless speaking device, loudspeaker, and mobile terminal. Figure 3 The amplifier hardware circuit schematic diagram is provided to support this method and is used to illustrate the specific implementation at the hardware level.
[0027] The provided method for sound amplification, voice recording, and text summarization in collaboration with a loudspeaker and a mobile terminal includes steps S101 to S103. Details are as follows: Step S101. Control the amplifier to receive dedicated wireless audio signals, Bluetooth audio signals and wired interface input digital audio signals respectively; control the amplifier to decode and mix the multi-channel input audio signals, and drive the sound unit to amplify the sound in real time after volume adjustment and power amplification.
[0028] Specifically, this step is the core execution stage of amplified playback, which is completed independently by the amplifier. The specific implementation process is as follows: First, the loudspeaker simultaneously activates three audio input channels: a dedicated wireless audio input channel, a Bluetooth audio input channel, and a wired digital audio input channel. These three channels operate in parallel, allowing simultaneous reception of audio signals from different sources. The loudspeaker also automatically switches between channels based on signal input status, eliminating the need for manual switching by the user.
[0029] The first channel is a dedicated wireless audio channel. The amplifier receives wireless radio frequency (RF) audio signals from external wireless speaking devices through a built-in dedicated RF receiver unit. The RF receiver unit demodulates and removes interference from the RF signals to restore the original audio encoded data. This channel is mainly used for the input of dedicated audio devices such as wireless microphones and wireless projection transmitters. It features low latency and strong anti-interference capabilities, making it suitable for real-time speech amplification scenarios.
[0030] The second channel is a Bluetooth audio channel. The amplifier establishes a Bluetooth audio connection with external Bluetooth audio devices through its built-in Bluetooth communication unit, receives the audio data stream encapsulated by the Bluetooth protocol, and decodes it according to the standard Bluetooth audio encoding specifications to obtain the original audio signal. This channel is mainly used for background music and accompaniment audio input on portable devices such as mobile phones and tablets, suitable for everyday multimedia playback scenarios.
[0031] The third channel is a wired digital audio channel. The amplifier establishes a physical connection with external wired audio devices through an external wired data interface, receives standard digital audio stream data, and parses it according to the corresponding wired audio transmission protocol to obtain the original digital audio signal. This channel is mainly used for high-quality audio input from wired devices such as computers and media players, while also providing power and data transmission capabilities.
[0032] After receiving the three audio signals, the amplifier performs unified decoding and mixing on each input audio signal. For digital audio signals from the dedicated wireless channel, they are directly sent to the audio control unit for digital domain decoding, preserving the high-fidelity characteristics of digital audio throughout. For audio signals from the Bluetooth and wired channels, corresponding decoding processes are performed according to the signal type, converting them into audio signals of a unified format. After decoding, the multiple audio signals are superimposed through a hardware mixing circuit to generate a unified mixed audio signal, enabling synchronized playback of vocals, background music, and multiple audio streams.
[0033] After mixing, the unified mixed audio signal is sent to the subsequent volume adjustment and power amplification links. First, the mixed audio signal is input to the analog volume control unit, which uses a passive analog voltage divider structure. By changing the voltage division ratio through a physical adjustment knob, the amplitude of the mixed audio signal is continuously and steplessly adjusted, achieving real-time volume control. The analog volume adjustment process does not undergo digital processing, resulting in no delay or quantization loss. The adjustment process is smooth and natural, avoiding the stepped sound and popping issues common in digital volume adjustments.
[0034] The audio signal, after volume adjustment, is sent to the power amplifier unit. The power amplifier unit amplifies the small-amplitude audio signal, improving its driving capability and outputting sufficient power to the sound-generating unit. Finally, the amplified audio signal drives the sound-generating unit to convert the electrical signal into a sound signal, which is then radiated into the external space, completing real-time sound amplification playback.
[0035] Step S102. While the loudspeaker is playing amplified audio, it collects the complete mixed analog audio signal from the power amplifier output terminal and converts the analog audio signal into digital audio data; it then controls the loudspeaker to transmit the digital audio data synchronously to the mobile terminal through a wired data interface.
[0036] Specifically, this step is the core stage of audio recording and data transmission, and it is executed synchronously throughout the entire sound reinforcement playback process to achieve a simultaneous recording and playback effect. The specific implementation process is as follows: An audio acquisition node is installed between the output of the power amplifier unit and the input of the sound-generating unit. This acquisition node directly picks up the analog audio signal from the output circuit of the power amplifier. Since the acquisition node is located at the output of the power amplifier, the audio signal at this point has already undergone multi-channel mixing and volume adjustment processing, making it completely equivalent to the audio signal ultimately sent to the sound-generating unit for playback. Therefore, the acquired audio content is completely consistent with the actual external sound, and the volume and mixing ratio are synchronized with the external playback effect, realistically reproducing the actual playback effect at the sound reinforcement site.
[0037] Throughout the entire sound reinforcement playback process, the audio acquisition node continuously picks up analog audio signals. The acquisition process maintains strict time synchronization with the sound reinforcement playback, preventing recording delays or content loss. After impedance matching and simple filtering, the acquired analog audio signals are sent to the audio main control unit for further processing.
[0038] After acquiring the analog audio signal, the audio control unit uses its built-in analog-to-digital converter (ADC) to perform digital conversion. The ADC samples, quantizes, and encodes the continuous analog audio signal according to a preset sampling frequency and quantization precision, converting the continuously changing analog voltage signal into discrete digital audio data. The conversion process uses a standard pulse code modulation format to generate universally formatted digital audio data, ensuring that the mobile terminal can directly recognize and process it without additional format conversion.
[0039] After generating digital audio data, the loudspeaker synchronously transmits the data to the mobile terminal via a wired data interface. Before transmission, the audio control unit packages the digital audio data according to a preset transmission protocol, adding a corresponding timestamp to each audio segment for subsequent timing alignment. After packaging, the data packets are sent to the mobile terminal in real time via the wired data interface. The transmission process is synchronized with the loudspeaker playback, ensuring that the time the mobile terminal receives the audio corresponds to the time the loudspeaker plays the sound, achieving low-latency synchronous recording.
[0040] The wired data interface serves the dual functions of data transmission and power supply. It can upload the captured digital audio data to the mobile terminal, and also receive power from the mobile terminal or external power source to provide operating power for the entire amplifier, reducing the need for additional power lines and improving system integration.
[0041] Step S103. Control the mobile terminal to perform speech recognition processing on the received digital audio data to generate text content corresponding to the audio content; control the mobile terminal to perform key semantic extraction processing on the generated text content to generate a corresponding text summary.
[0042] Specifically, this step is the intelligent audio content processing stage, completed by the mobile terminal. It converts the received audio data into text and extracts the core summary. The specific implementation process is as follows: After receiving digital audio data packets via a wired data interface, the mobile terminal first unpacks the data packets to extract the original digital audio data and corresponding timestamp information. Then, the mobile terminal performs speech recognition processing on the digital audio data, converting the speech content in the audio into corresponding text content.
[0043] During speech recognition processing, the mobile terminal first performs preprocessing operations on the digital audio data, including noise reduction, endpoint detection, and frame-by-frame windowing to remove environmental noise and silent segments from the audio, thereby improving the accuracy of speech recognition. After preprocessing, the mobile terminal calls its built-in speech recognition model to extract features and convert each audio frame, generating corresponding text content segment by segment, and finally splicing them together to form a continuous and complete text content that perfectly corresponds to the audio content. During recognition, the mobile terminal marks the corresponding time node for each sentence of text based on the timestamp carried in the data packet, achieving timeline alignment between the text and audio.
[0044] After generating the complete text content, the mobile terminal further performs key semantic extraction processing to generate a corresponding text summary. Specifically, the mobile terminal first performs semantic segmentation and word segmentation on the complete text, breaking the long text down into multiple independent semantic and sentence units. Then, a semantic analysis model identifies the core information and key sentences in the text, filtering out sentences containing core viewpoints, key points, and important conclusions, while removing repetitive, redundant, and transitional phrases. Finally, the selected key sentences are reorganized and refined according to the logical order of the original text to generate a concise and complete text summary, allowing users to quickly grasp the core content of the entire audio clip without having to read the entire text.
[0045] In some embodiments, the control amplifier receives a dedicated wireless audio signal, a Bluetooth audio signal, and a digital audio signal input via a wired interface, including: the control amplifier acquires a dedicated wireless audio signal through a dedicated wireless receiving unit, the control amplifier acquires a Bluetooth audio signal through a Bluetooth receiving unit, the control amplifier receives a digital audio signal input from an external device through a wired data interface, and the three audio signals are simultaneously sent to the internal processing module of the amplifier.
[0046] This embodiment further refines the multi-source audio reception process in step S101.
[0047] In this embodiment, the loudspeaker is equipped with three independent audio receiving units: a dedicated wireless receiving unit, a Bluetooth receiving unit, and a wired interface receiving unit. The three receiving units work independently and in parallel without interfering with each other.
[0048] The dedicated wireless receiving unit is designed for receiving dedicated wireless audio signals. Internally, it includes a radio frequency (RF) antenna, an RF demodulation module, and a baseband processing module. The RF antenna receives wireless RF signals in space. The RF demodulation module down-converts and demodulates the high-frequency RF signal to recover the baseband audio encoded signal. The baseband processing module decodes the encoded signal to obtain the original digital audio signal, which is then sent to subsequent processing modules.
[0049] The Bluetooth receiver unit receives Bluetooth audio signals and includes a Bluetooth antenna, a Bluetooth protocol processing module, and an audio decoding module. The Bluetooth antenna receives Bluetooth radio frequency signals, the Bluetooth protocol processing module establishes the Bluetooth connection and parses the audio data stream, and the audio decoding module decodes the encoded Bluetooth audio to obtain analog or digital audio signals.
[0050] The wired interface receiving unit is for receiving wired digital audio signals. The unit includes a wired interface socket, a protocol processing module, and an audio parsing module. The wired interface socket is used to connect external wired devices, the protocol processing module completes the handshake and data exchange for the wired audio protocol, and the audio parsing module extracts the digital audio signal from the data stream.
[0051] The audio signals output from the three receiving units are synchronously sent to the processing module inside the amplifier, enabling parallel access and real-time processing of the three audio sources. It supports individual playback of any single audio source and simultaneous mixed playback of multiple audio sources.
[0052] In some embodiments, the control amplifier performs decoding and mixing of multiple input audio signals, including: controlling the amplifier to perform digital decoding processing on dedicated wireless audio signals, performing decoding processing on Bluetooth audio signals and digital audio signals input through wired interfaces respectively, and hardware superimposing all decoded audio signals to generate a unified mixed audio signal.
[0053] This embodiment further refines the decoding and mixing process in step S101.
[0054] In this embodiment, the loudspeaker uses a split-channel decoding process for audio signals from different sources, and then performs mixing and superposition through hardware circuitry to ensure that the sound quality of each audio signal is not interfered with.
[0055] For dedicated wireless audio signals, a fully digital decoding path is adopted. The signal is processed in digital format within the audio main control unit throughout the entire process, without undergoing digital-to-analog conversion. This avoids the sound quality loss during the digital-to-analog conversion process and ensures the clarity of human voices when speaking wirelessly.
[0056] Bluetooth audio signals and wired interface input digital audio signals are independently decoded by their respective decoding modules and converted into analog audio signals of a unified standard. The two analog audio signals are then input into the hardware mixing circuit.
[0057] The hardware mixing circuit employs an adder circuit structure composed of operational amplifiers. Through resistor matching, it achieves linear superposition of multiple analog audio signals, merging multiple input analog audio signals into a single unified mixed audio signal. The hardware mixing process is implemented using purely analog circuitry, requiring no digital chip involvement in computation. This results in extremely low latency, eliminates the introduction of additional digital noise, and produces a natural and smooth mixing effect.
[0058] By combining split-channel decoding with hardware mixing, the high-fidelity digital characteristics of dedicated wireless vocals are preserved, while smooth mixing of multiple background music tracks is achieved, balancing vocal clarity and natural mixing.
[0059] In some embodiments, driving the sound-generating unit to perform real-time sound amplification playback after volume adjustment and power amplification includes: sending the mixed audio signal to the analog volume adjustment unit to perform stepless volume adjustment processing, sending the adjusted audio signal to the power amplification unit to perform power amplification processing, and outputting the amplified audio signal to the sound-generating unit to complete real-time sound amplification playback.
[0060] This embodiment further refines the volume adjustment and power amplification process in step S101.
[0061] In this embodiment, volume adjustment is achieved using a purely analog passive potentiometer, and power amplification is achieved using an independent power amplifier chip to provide sufficient driving capability.
[0062] The analog volume control unit uses a linear carbon film potentiometer as its core adjustment element. The input of the potentiometer is connected to the mixed analog audio signal, and the output is connected to the subsequent power amplifier unit. The adjustment terminal is linked to the physical knob structure. When the user rotates the physical knob, the slider inside the potentiometer moves, changing the voltage division ratio at the output terminal, thereby continuously changing the amplitude of the output audio signal and realizing stepless adjustment of the volume.
[0063] The potentiometer adjusts the entire range of analog signals in a continuous manner, without the quantization levels of digital volume. Therefore, the adjustment process is smooth and stepless, and there will be no volume jumps or popping sounds. The adjustment feel and effect are superior to digital volume adjustment solutions.
[0064] The power amplifier unit employs a Class AB or Class D power amplifier structure to amplify the small audio signal output from the potentiometer, providing sufficient current and power to drive the speaker unit to produce a sufficiently loud sound. The input of the power amplifier unit is equipped with a DC blocking capacitor to block DC components and prevent DC signals from damaging the speaker unit; the output is equipped with a filter network to suppress high-frequency noise and improve playback sound quality.
[0065] In some embodiments, the control amplifier, while playing amplified audio, acquires the complete mixed analog audio signal from the power amplifier output terminal, including: setting an audio acquisition node at the output terminal of the power amplifier unit, and acquiring all analog audio signals after mixing and volume adjustment in real time throughout the entire process of amplified audio playback.
[0066] This embodiment further refines the analog audio acquisition process in step S102.
[0067] In this embodiment, the audio acquisition node is specifically set at the output end of the power amplifier unit, that is, on the connection line between the power amplifier circuit and the sound generation unit, rather than at the front end of the audio source input or the front end of the volume adjustment.
[0068] The acquisition node adopts a high-impedance voltage divider acquisition structure, which picks up a small proportion of audio signals from the power amplifier output line through a large-value resistor. The input impedance of the acquisition circuit is much higher than the output impedance of the power amplifier. Therefore, the acquisition process will not affect the normal output of the power amplifier, and will not change the external speaker volume and sound quality, thus achieving lossless acquisition.
[0069] The acquired audio signal has undergone all the preceding processing steps, including mixing effects from multiple audio sources and amplitude changes from simulated volume adjustment, making it completely consistent with the signal ultimately sent to the speaker unit for playback. Therefore, regardless of how the user adjusts the volume or switches between different audio sources, the acquired audio can accurately reflect the actual external sound effect, without issues such as discrepancies between the recorded volume and the external playback volume, or the recording lacking a particular audio source.
[0070] The acquisition process continues throughout the entire sound reinforcement playback. As long as the loudspeaker is playing, the acquisition circuit works synchronously to achieve complete synchronization between playback and recording, ensuring no loss of recorded content.
[0071] In some embodiments, the conversion of analog audio signals into digital audio data includes: sending the acquired analog audio signals into the analog-to-digital conversion module built into the audio main control unit, performing analog-to-digital signal conversion processing, and generating standardized digital audio data.
[0072] This embodiment further refines the analog-to-digital conversion process in step S102.
[0073] In this embodiment, the digital conversion of analog audio signals is completed by the analog-to-digital conversion module built into the audio main control unit, eliminating the need for an additional independent analog-to-digital conversion chip, simplifying the hardware circuit structure and reducing the overall cost.
[0074] The audio control unit has a built-in multi-channel analog-to-digital converter module, supporting simultaneous acquisition of multiple channels of analog signals. The acquired analog mixed audio signals are then directly connected to the analog-to-digital converter input pins of the main control chip after simple RC low-pass filtering.
[0075] The analog-to-digital converter (ADC) samples the analog signal at a fixed sampling frequency, which can be set to different levels according to sound quality requirements. The quantization precision is set to 16 bits to ensure sufficient dynamic range and sound quality. During the conversion process, the reference voltage module inside the main control chip provides a stable reference voltage for the ADC, ensuring conversion accuracy.
[0076] After conversion, standard-format digital audio data is generated directly within the main control chip, eliminating the need for additional transmission links, reducing noise interference introduced by external lines, and improving the signal-to-noise ratio of the digital audio. Simultaneously, the control logic for analog-to-digital conversion is directly executed by the main control chip, allowing for flexible adjustment of sampling parameters to adapt to different application requirements.
[0077] In some embodiments, the control amplifier synchronously transmits digital audio data to a mobile terminal via a wired data interface, including: packaging the digital audio data according to a preset transmission protocol, transmitting the packaged data to the mobile terminal in real time via the wired data interface, and keeping the transmission timing synchronized with the sound reinforcement playback timing.
[0078] This embodiment further refines the wired data transmission process in step S102.
[0079] In this embodiment, the transmission of digital audio data is achieved through a wired data interface, and a timestamp mechanism is used to ensure that the transmission timing is synchronized with the playback timing.
[0080] Before transmission, the audio control unit first splits the continuous digital audio data into fixed-length data packets, each containing a segment of audio data. Simultaneously, the control unit adds a corresponding timestamp to each data packet, recording the playback time of that audio segment, with the time base consistent with the playback clock inside the loudspeaker.
[0081] The data packets are encapsulated according to a standard bulk transfer protocol and sent to the mobile terminal via a wired data interface. After receiving the data packets, the mobile terminal first extracts the timestamp information, sorts and buffers the data packets according to the timestamp order, and then performs subsequent speech recognition processing.
[0082] Through a timestamp mechanism, even with minor delays during transmission, the mobile terminal can reconstruct the audio in the correct chronological order, ensuring a strict correspondence between the voice recognition time point and the actual amplified playback time point, achieving true synchronous recording. Furthermore, wired transmission is far more stable than wireless transmission, avoiding packet loss and connection drops caused by signal interference, resulting in higher data transmission reliability.
[0083] In some embodiments, the control of the mobile terminal to perform speech recognition processing on the received digital audio data to generate text content corresponding to the audio content includes: the mobile terminal performing segmented preprocessing on the received digital audio data, calling a speech recognition model to recognize and convert the preprocessed audio data, and generating continuous text content corresponding to the audio semantics.
[0084] This embodiment further refines the speech recognition processing in step S103.
[0085] In this embodiment, the mobile terminal uses a segmented preprocessing plus model recognition method to perform speech recognition, thereby improving recognition accuracy and processing efficiency.
[0086] First, the mobile terminal segments the received digital audio data, breaking down long audio into multiple short audio segments according to a fixed duration, and processing each segment individually to avoid consuming too much memory resources when processing long audio at once.
[0087] For each audio segment, preprocessing operations are performed: First, noise reduction is performed to filter out environmental background noise and circuit noise in the audio through noise reduction algorithms, thereby improving the signal-to-noise ratio of the speech signal; Second, endpoint detection is performed to identify effective speech segments and silent segments in the audio segment, and silent segments are eliminated to reduce the computational load of subsequent recognition; Third, frame-segmentation and windowing are performed to split the continuous audio signal into multiple short frames to facilitate the extraction of speech features.
[0088] After preprocessing, the mobile terminal calls the trained speech recognition model to extract acoustic features from each frame of audio. Then, the language model converts the acoustic features into corresponding text content, and the text is concatenated into a complete sentence after frame-by-frame recognition. After all segments are recognized, the text of each segment is concatenated in chronological order to form a complete continuous text content.
[0089] The segmented processing method supports simultaneous reception and recognition, allowing processing to begin without waiting for all audio to be transmitted, significantly reducing overall processing latency and achieving near real-time speech-to-text results.
[0090] In some embodiments, the control of the mobile terminal to perform key semantic extraction processing on the generated text content and generate a corresponding text summary includes: the mobile terminal performing semantic segmentation and core information recognition on the generated text content, filtering and retaining key sentences and core semantics in the text, and generating a concise text summary after removing redundant content.
[0091] This embodiment further refines the text summary generation process in step S103.
[0092] In this embodiment, the text summary is generated by semantic analysis and key sentence filtering to ensure that the summary information is complete and logically coherent.
[0093] First, the mobile terminal performs semantic segmentation on the complete text content, starting with word segmentation and part-of-speech tagging, and then dividing the text into multiple independent sentences and semantic paragraphs. Subsequently, a semantic analysis model scores the importance of each sentence, based on dimensions such as the sentence's position, the number of keywords it contains, whether it contains a concluding statement, and whether it is a topic sentence.
[0094] After scoring, the sentences are sorted from highest to lowest importance, and the top-ranked sentences are selected as core sentences. During the selection process, sentences with repetitive expressions, meaningless sentences using modal particles, and transitional preambles are removed, retaining only the key sentences that carry the core information.
[0095] Finally, the selected key sentences are arranged in the order of their appearance in the original text, and the connections between sentences are appropriately simplified and optimized to ensure that the summary content is logically coherent, semantically fluent, and much shorter than the original text, enabling users to quickly grasp the core content of the audio.
[0096] The generated text summary can be saved separately or stored in conjunction with the full text and original audio, making it convenient for users to quickly view and review it.
[0097] In some embodiments, the method further includes: the mobile terminal aligning and binding the generated text content and text summary with digital audio data according to the timeline to generate an audio-text synchronization recording file that supports rapid keyword location.
[0098] This embodiment is an additional function embodiment based on the core steps, realizing the synchronous binding and rapid positioning of audio and text.
[0099] In this embodiment, after the mobile terminal completes speech recognition and text summary generation, it aligns and binds the generated complete text content, text summary, and original digital audio data according to the timeline.
[0100] In practice, the mobile terminal associates each sentence of text with the corresponding audio segment at the time point based on the timestamps marked during speech recognition. Each key sentence in the text summary is also marked with its corresponding time position in the original audio.
[0101] Once the binding is complete, a unified audio-text synchronization record file is generated. The file contains the original audio data, the complete text content and the text summary content, as well as the time correspondence between the parts.
[0102] When users view the record file, they can click on any sentence in the text to jump directly to the corresponding time point in the audio for playback; they can also search the text by entering keywords to quickly locate the corresponding segment in the audio, greatly improving the efficiency of content review and information retrieval.
[0103] This record file can be stored locally on the mobile device or exported to other devices for backup and sharing. It is suitable for scenarios that require long-term retention and quick retrieval, such as meeting minutes and classroom recording transcription.
[0104] In some embodiments, this embodiment combines Figure 3The hardware circuit diagram shown provides a complete description of the loudspeaker hardware circuit supporting the above method, and explains in detail how the method is implemented from a hardware perspective.
[0105] like Figure 3 As shown, the loudspeaker hardware circuit mainly consists of six core parts: a power management module, an audio main control unit module, a wireless and Bluetooth communication module, a wired interface module, an audio power amplification module, and a data acquisition module. These parts work together to implement all the aforementioned methods and steps.
[0106] The first part is the power management module, which is responsible for providing a stable power supply to all circuits in the device. The power management module receives input from a wired interface or the built-in battery. After processing by a buck and regulator circuit, it outputs DC power at different voltage levels to power various circuits, including the audio control unit, communication module, and power amplifier module. The power module incorporates multiple sets of filter capacitors to suppress power ripple and prevent power noise from interfering with the audio circuitry and affecting sound quality. Simultaneously, the power management module includes a charging management circuit, allowing for seamless switching between wired and battery power supply by charging the built-in battery via the wired interface.
[0107] The second part is the audio main control unit module, which is the core control and audio processing core of the entire device, corresponding to functions such as digital audio processing, analog-to-digital conversion, and logic control. The audio main control unit is an integrated main control chip, internally integrating a processor core, digital audio interface, analog-to-digital conversion module, input / output control pins, and other resources. The main control chip's digital audio interface connects to a dedicated wireless receiver unit to receive wireless digital audio signals; the built-in analog-to-digital conversion channel connects to a retrieval acquisition circuit to acquire analog mixing signals; the main control chip's output interface connects to subsequent audio processing circuits to output the processed audio signal. Simultaneously, the main control chip's general-purpose input / output pins connect to various function buttons and indicator lights, enabling human-machine interaction. A crystal oscillator circuit is located around the main control chip to provide a stable operating clock; filter capacitors are also included to ensure stable power supply.
[0108] The third part is the wireless and Bluetooth communication module, responsible for dedicated wireless audio reception and Bluetooth audio reception. The dedicated wireless receiving circuit includes an RF antenna, a matching network, and a wireless receiving chip, receiving audio signals from external wireless speaking devices and transmitting digital audio to the audio main control unit through a digital audio interface. The Bluetooth communication circuit includes a Bluetooth antenna and a Bluetooth chip, realizing Bluetooth audio reception and Bluetooth data transmission functions. The analog audio signal decoded by the Bluetooth chip is output to the mixing circuit.
[0109] The fourth part is the wired interface module, which includes a wired interface socket, external protection circuitry, and matching circuitry. The wired interface uses a reversible universal wired connector, supporting audio data transmission, power transmission, and data communication. An electrostatic discharge (ESD) protection device is installed at the interface to prevent ESD damage to the internal circuitry; an impedance matching circuit is also included to ensure signal quality for high-speed data transmission. The wired interface connects to the Bluetooth module and the main control unit, enabling the transmission of both wired digital audio and retrieved digital audio data, while also providing power.
[0110] The fifth part is the audio power amplifier module, responsible for amplifying the audio signal and driving the speaker unit to produce sound. The power amplifier module includes a power amplifier chip and external resistors, capacitors, and filters. The mixed analog audio signal is input to the power amplifier chip after passing through the volume control potentiometer. The power amplifier chip amplifies the signal and outputs it to the speaker unit interface to drive the external speaker unit. The power amplifier output is equipped with an output filter network to suppress high-frequency interference and improve sound quality; it also includes overcurrent and overheat protection circuits to ensure the safe operation of the power amplifier chip.
[0111] The sixth part is the audio acquisition module, corresponding to the analog audio acquisition function in the method. The input of the acquisition circuit is connected to the output of the power amplifier chip, that is, the line between the power amplifier output and the sound unit. The acquisition circuit picks up a small proportion of the audio signal from the power amplifier output through a voltage divider resistor network. After filtering and impedance matching, it is sent to the analog-to-digital conversion channel built into the audio main control unit. The acquisition circuit adopts a high impedance design, which will not affect the load of the power amplifier output and ensure that the external sound quality is not interfered with by the acquisition circuit. The acquired analog signal is converted into digital audio data inside the main control chip, and then uploaded to the mobile terminal through a wired interface.
[0112] The above six circuit modules work together to fully realize all the hardware functions of multi-source audio reception, mixing and amplification, power amplifier sampling, analog-to-digital conversion, and wired data transmission, providing complete hardware support for the aforementioned method steps and ensuring that the method can be implemented stably and reliably.
[0113] Please see Figure 4 As shown, Figure 4This is a schematic diagram of the structure of a loudspeaker and mobile terminal collaborative sound amplification, voice recording, and text summarization system 200 provided in this application embodiment. The loudspeaker and mobile terminal collaborative sound amplification, voice recording, and text summarization system 200 is used to execute the steps of the loudspeaker and mobile terminal collaborative sound amplification, voice recording, and text summarization methods shown in the above embodiments. The loudspeaker and mobile terminal collaborative sound amplification, voice recording, and text summarization system 200 can be a single server or a server cluster, or it can be a terminal, such as a handheld terminal, laptop computer, wearable device, or robot.
[0114] like Figure 4 As shown, the loudspeaker and mobile terminal collaborative sound reinforcement, voice recording, and text summarization system 200 includes: The sound reinforcement and playback unit 201 is used to control the loudspeaker to receive dedicated wireless audio signals, Bluetooth audio signals and digital audio signals input through the wired interface; to control the loudspeaker to decode and mix the multi-channel input audio signals, and to drive the sound-emitting unit to perform real-time sound reinforcement and playback after volume adjustment and power amplification. The data transmission unit 202 is used to control the loudspeaker to collect the complete mixed analog audio signal output from the power amplifier output terminal while playing the sound amplification, and to convert the analog audio signal into digital audio data; and to control the loudspeaker to transmit the digital audio data synchronously to the mobile terminal through the wired data interface. The summary generation unit 203 is used to control the mobile terminal to perform speech recognition processing on the received digital audio data and generate text content corresponding to the audio content; and to control the mobile terminal to perform key semantic extraction processing on the generated text content and generate a corresponding text summary.
[0115] In some embodiments, the control amplifier receives a dedicated wireless audio signal, a Bluetooth audio signal, and a digital audio signal input via a wired interface, including: the control amplifier acquires a dedicated wireless audio signal through a dedicated wireless receiving unit, the control amplifier acquires a Bluetooth audio signal through a Bluetooth receiving unit, the control amplifier receives a digital audio signal input from an external device through a wired data interface, and the three audio signals are simultaneously sent to the internal processing module of the amplifier.
[0116] In some embodiments, the control amplifier performs decoding and mixing of multiple input audio signals, including: controlling the amplifier to perform digital decoding processing on dedicated wireless audio signals, performing decoding processing on Bluetooth audio signals and digital audio signals input through wired interfaces respectively, and hardware superimposing all decoded audio signals to generate a unified mixed audio signal.
[0117] In some embodiments, driving the sound-generating unit to perform real-time sound amplification playback after volume adjustment and power amplification includes: sending the mixed audio signal to the analog volume adjustment unit to perform stepless volume adjustment processing, sending the adjusted audio signal to the power amplification unit to perform power amplification processing, and outputting the amplified audio signal to the sound-generating unit to complete real-time sound amplification playback.
[0118] In some embodiments, the control amplifier, while playing amplified audio, acquires the complete mixed analog audio signal from the power amplifier output terminal, including: setting an audio acquisition node at the output terminal of the power amplifier unit, and acquiring all analog audio signals after mixing and volume adjustment in real time throughout the entire process of amplified audio playback.
[0119] In some embodiments, the conversion of analog audio signals into digital audio data includes: sending the acquired analog audio signals into the analog-to-digital conversion module built into the audio main control unit, performing analog-to-digital signal conversion processing, and generating standardized digital audio data.
[0120] In some embodiments, the control amplifier synchronously transmits digital audio data to a mobile terminal via a wired data interface, including: packaging the digital audio data according to a preset transmission protocol, transmitting the packaged data to the mobile terminal in real time via the wired data interface, and keeping the transmission timing synchronized with the sound reinforcement playback timing.
[0121] In some embodiments, the control of the mobile terminal to perform speech recognition processing on the received digital audio data to generate text content corresponding to the audio content includes: the mobile terminal performing segmented preprocessing on the received digital audio data, calling a speech recognition model to recognize and convert the preprocessed audio data, and generating continuous text content corresponding to the audio semantics.
[0122] In some embodiments, the control of the mobile terminal to perform key semantic extraction processing on the generated text content and generate a corresponding text summary includes: the mobile terminal performing semantic segmentation and core information recognition on the generated text content, filtering and retaining key sentences and core semantics in the text, and generating a concise text summary after removing redundant content.
[0123] In some embodiments, the method further includes: the mobile terminal aligning and binding the generated text content and text summary with digital audio data according to the timeline to generate an audio-text synchronization recording file that supports rapid keyword location.
[0124] It should be noted that those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described loudspeaker and mobile terminal collaborative sound reinforcement, voice recording and text summarization system and its modules can be referred to the corresponding content in the various embodiments of the above-described loudspeaker and mobile terminal collaborative sound reinforcement, voice recording and text summarization method, and will not be repeated here.
[0125] The aforementioned method for amplifying sound, recording voice, and summarizing text in conjunction with a loudspeaker and a mobile terminal can be implemented as a computer program. This computer program can be used in various ways, such as... Figure 4 It runs on the system shown.
[0126] Please see Figure 5 , Figure 5 This is a schematic block diagram of the structure of a computer device provided in an embodiment of this application. The computer device includes a processor, a memory, and a network interface connected via a device bus, wherein the memory may include a storage medium and internal memory.
[0127] The storage medium may store operating devices and computer programs. The computer program includes program instructions that, when executed, cause the processor to perform any method of sound reinforcement, voice recording, and text summarization in conjunction with a loudspeaker and a mobile terminal.
[0128] The processor provides computing and control capabilities, supporting the operation of the entire computer device.
[0129] Internal memory provides an environment for the execution of computer programs in non-volatile storage media. When executed by a processor, the computer program enables the processor to perform any method of sound reinforcement, voice recording, and text summarization in collaboration with a loudspeaker and a mobile terminal.
[0130] This network interface is used for network communication, such as sending assigned tasks. Those skilled in the art will understand that... Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the terminal to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0131] It should be understood that the processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.
[0132] In one embodiment, the processor is configured to run a computer program stored in memory to perform the following steps: The amplifier receives dedicated wireless audio signals, Bluetooth audio signals, and digital audio signals input via a wired interface. The amplifier decodes and mixes the multiple input audio signals, and after volume adjustment and power amplification, drives the sound unit to amplify the sound in real time. While the loudspeaker is playing amplified audio, it collects the complete mixed analog audio signal from the power amplifier output and converts the analog audio signal into digital audio data; the loudspeaker then transmits the digital audio data synchronously to the mobile terminal via a wired data interface. The system controls the mobile terminal to perform speech recognition processing on the received digital audio data and generate text content corresponding to the audio content; it also controls the mobile terminal to perform key semantic extraction processing on the generated text content and generate corresponding text summaries.
[0133] In some embodiments, the control amplifier receives a dedicated wireless audio signal, a Bluetooth audio signal, and a digital audio signal input via a wired interface, including: the control amplifier acquires a dedicated wireless audio signal through a dedicated wireless receiving unit, the control amplifier acquires a Bluetooth audio signal through a Bluetooth receiving unit, the control amplifier receives a digital audio signal input from an external device through a wired data interface, and the three audio signals are simultaneously sent to the internal processing module of the amplifier.
[0134] In some embodiments, the control amplifier performs decoding and mixing of multiple input audio signals, including: controlling the amplifier to perform digital decoding processing on dedicated wireless audio signals, performing decoding processing on Bluetooth audio signals and digital audio signals input through wired interfaces respectively, and hardware superimposing all decoded audio signals to generate a unified mixed audio signal.
[0135] In some embodiments, driving the sound-generating unit to perform real-time sound amplification playback after volume adjustment and power amplification includes: sending the mixed audio signal to the analog volume adjustment unit to perform stepless volume adjustment processing, sending the adjusted audio signal to the power amplification unit to perform power amplification processing, and outputting the amplified audio signal to the sound-generating unit to complete real-time sound amplification playback.
[0136] In some embodiments, the control amplifier, while playing amplified audio, acquires the complete mixed analog audio signal from the power amplifier output terminal, including: setting an audio acquisition node at the output terminal of the power amplifier unit, and acquiring all analog audio signals after mixing and volume adjustment in real time throughout the entire process of amplified audio playback.
[0137] In some embodiments, the conversion of analog audio signals into digital audio data includes: sending the acquired analog audio signals into the analog-to-digital conversion module built into the audio main control unit, performing analog-to-digital signal conversion processing, and generating standardized digital audio data.
[0138] In some embodiments, the control amplifier synchronously transmits digital audio data to a mobile terminal via a wired data interface, including: packaging the digital audio data according to a preset transmission protocol, transmitting the packaged data to the mobile terminal in real time via the wired data interface, and keeping the transmission timing synchronized with the sound reinforcement playback timing.
[0139] In some embodiments, the control of the mobile terminal to perform speech recognition processing on the received digital audio data to generate text content corresponding to the audio content includes: the mobile terminal performing segmented preprocessing on the received digital audio data, calling a speech recognition model to recognize and convert the preprocessed audio data, and generating continuous text content corresponding to the audio semantics.
[0140] In some embodiments, the control of the mobile terminal to perform key semantic extraction processing on the generated text content and generate a corresponding text summary includes: the mobile terminal performing semantic segmentation and core information recognition on the generated text content, filtering and retaining key sentences and core semantics in the text, and generating a concise text summary after removing redundant content.
[0141] In some embodiments, the method further includes: the mobile terminal aligning and binding the generated text content and text summary with digital audio data according to the timeline to generate an audio-text synchronization recording file that supports rapid keyword location.
[0142] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the steps of the loudspeaker and mobile terminal collaborative sound amplification, voice recording, and text summarization method provided in any embodiment of this application.
[0143] The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiments, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, SmartMedia Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the computer device.
[0144] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A method for sound amplification, voice recording, and text summarization in collaboration with a loudspeaker and a mobile terminal, characterized in that, include: The amplifier receives dedicated wireless audio signals, Bluetooth audio signals, and digital audio signals input via a wired interface. The amplifier decodes and mixes the multiple input audio signals, and after volume adjustment and power amplification, drives the sound unit to amplify the sound in real time. While the loudspeaker is playing amplified audio, it collects the complete mixed analog audio signal from the power amplifier output and converts the analog audio signal into digital audio data; the loudspeaker then transmits the digital audio data synchronously to the mobile terminal via a wired data interface. The system controls the mobile terminal to perform speech recognition processing on the received digital audio data and generate text content corresponding to the audio content; it also controls the mobile terminal to perform key semantic extraction processing on the generated text content and generate corresponding text summaries.
2. The method according to claim 1, characterized in that, The control amplifier receives dedicated wireless audio signals, Bluetooth audio signals, and digital audio signals input via a wired interface, including: The loudspeaker acquires dedicated wireless audio signals through a dedicated wireless receiving unit, acquires Bluetooth audio signals through a Bluetooth receiving unit, and receives digital audio signals input from external devices through a wired data interface. All three audio signals are simultaneously sent to the loudspeaker's internal processing module.
3. The method according to claim 1, characterized in that, The control amplifier decodes and mixes multiple input audio signals, including: The amplifier controls the digital decoding of dedicated wireless audio signals, performs decoding on Bluetooth audio signals and wired interface input digital audio signals respectively, and performs hardware superposition of all decoded audio signals to generate a unified mixed audio signal.
4. The method according to claim 3, characterized in that, The method of driving the sound unit for real-time sound amplification after volume adjustment and power amplification includes: The mixed audio signal is sent to the analog volume adjustment unit for stepless volume adjustment, the adjusted audio signal is sent to the power amplification unit for power amplification, and the amplified audio signal is output to the sound unit to complete real-time sound reinforcement playback.
5. The method according to claim 1, characterized in that, While the loudspeaker is amplifying the sound, it simultaneously acquires the complete mixed analog audio signal from the power amplifier output, including: An audio acquisition node is set at the output of the power amplifier unit to acquire all analog audio signals after mixing and volume adjustment in real time throughout the entire sound reinforcement playback process.
6. The method according to claim 1, characterized in that, The process of converting analog audio signals into digital audio data includes: The acquired analog audio signal is sent to the analog-to-digital converter module built into the audio main control unit to perform analog-to-digital signal conversion processing and generate standardized digital audio data.
7. The method according to claim 1, characterized in that, The control amplifier synchronously transmits digital audio data to the mobile terminal via a wired data interface, including: Digital audio data is packaged according to a preset transmission protocol and transmitted to a mobile terminal in real time via a wired data interface, with the transmission timing synchronized with the sound reinforcement playback timing.
8. The method according to claim 1, characterized in that, The control mobile terminal performs speech recognition processing on the received digital audio data to generate text content corresponding to the audio content, including: The mobile terminal performs segmented preprocessing on the received digital audio data, calls the speech recognition model to recognize and convert the preprocessed audio data, and generates continuous text content corresponding to the audio semantics.
9. The method according to claim 1, characterized in that, The control mobile terminal performs key semantic extraction processing on the generated text content to generate a corresponding text summary, including: The mobile terminal performs semantic segmentation and core information recognition on the generated text content, filters and retains key sentences and core semantics in the text, and generates a concise text summary after removing redundant content.
10. The method according to claim 1, characterized in that, The method further includes: The mobile terminal aligns and binds the generated text content and text summary with the digital audio data according to the timeline, generating an audio-text synchronized recording file that supports rapid keyword location.
