Audio and video transmission system based on 4G network

Abstract

The embodiment of the invention provides an audio and video transmission system based on a 4G network, and the system comprises an image collection module which is used for collecting image data; the audio acquisition module is used for acquiring audio data; the signal processing and transmission module is used for processing the image data and the audio data to generate transmission data, and the processing comprises video coding of the image data and audio coding of the audio data, and packaging of the coded data; the 4G communication module is used for uploading the transmission data to a cloud server through a 4G network so as to support remote video live broadcast and on-demand preview; and the power management module is used for managing the power consumption of the image acquisition module, the audio acquisition module, the signal processing and transmission module and the 4G communication module. By constructing a highly integrated low-power-consumption transmission architecture, stable and efficient transmission in a 4G network environment, especially in a low-bandwidth scene, is realized.

Description

Technical Field

[0001] The embodiments in this specification relate to the field of communication technology, and in particular to audio and video transmission systems based on 4G networks. Background Technology

[0002] Existing audio and video transmission systems face significant challenges in remote areas or mobile application scenarios, primarily due to their high dependence on a stable network environment. Traditional transmission solutions often experience data transmission interruptions or severe quality degradation in areas with weak 4G network coverage. At the same time, existing equipment power management mechanisms are relatively crude, making it difficult to maintain long-term stable operation in complex field environments. Furthermore, they lack adaptive data adjustment capabilities when bandwidth fluctuates, resulting in low transmission efficiency and resource waste. These factors collectively limit the widespread application of existing technologies in fields such as emergency communication and remote monitoring.

[0003] Therefore, a better solution is urgently needed. Summary of the Invention

[0004] In view of this, the embodiments of this specification provide an audio and video transmission system based on a 4G network to solve the technical defects existing in the prior art.

[0005] According to a first aspect of the embodiments of this specification, an audio and video transmission system based on a 4G network is provided, comprising: The image acquisition module is used to acquire image data; The audio acquisition module is used to acquire audio data; The signal processing and transmission module is used to process the image data and the audio data to generate transmission data, wherein the processing includes video encoding of the image data and audio encoding of the audio data, and packaging the encoded data; A 4G communication module is used to upload the transmitted data to a cloud server via a 4G network to support remote video live streaming and on-demand preview. The power management module is used to manage the power consumption of the image acquisition module, the audio acquisition module, the signal processing and transmission module, and the 4G communication module.

[0006] In one possible implementation, the image acquisition module includes a CMOS image sensor and a USB interface; The CMOS image sensor is used to convert optical images into digital image signals, and the USB interface is used to transmit the digital image signals to the signal processing and transmission module; wherein the CMOS image sensor supports configurable resolution modes and includes automatic exposure and white balance adjustment functions.

[0007] In one possible implementation, the audio acquisition module includes an audio array and an analog-to-digital converter; The audio array is used to convert analog sound signals into analog electrical signals, and the analog-to-digital converter is used to sample and quantize the analog electrical signals to generate digital audio signals, and transmit the digital audio signals to the signal processing and transmission module via a USB interface; wherein the audio array employs multi-microphone beamforming technology to enhance the target sound and suppress background noise.

[0008] In one possible implementation, the signal processing and transmission module includes a video encoding unit, an audio encoding unit, a data multiplexing unit, and a buffer management unit; The video encoding unit is used to compress the image data using the H.264 or H.265 encoding standard; the audio encoding unit is used to compress the audio data using the AAC or OPUS encoding algorithm; the data multiplexing unit is used to multiplex the compressed audio and video data into a stream and add a timestamp, sequence number, and error check code; the buffer management unit is used to adjust the data transmission rate according to network conditions.

[0009] In one possible implementation, the 4G communication module includes a multi-band radio frequency unit, an adaptive modulation and coding unit, and a data transmission control unit; the multi-band radio frequency unit is used to support multi-band 4G network connections. The adaptive modulation and coding unit is used to dynamically adjust transmission parameters according to the real-time network signal quality; the data transmission control unit is used to trigger data packet splitting and selective retransmission mechanisms in low-bandwidth environments, dividing large data packets into smaller units for transmission and retransmitting key data segments when packets are lost; the 4G communication module also uses a handshake protocol and encrypted transmission to ensure connection security and data security.

[0010] In one possible implementation, the power management module includes a power consumption monitoring unit, a battery management unit, and a power control unit; The power consumption monitoring unit is used to monitor the power consumption status of the image acquisition module, the audio acquisition module, the signal processing and transmission module, and the 4G communication module in real time; the battery management unit is used to protect the lithium-ion battery during charging and discharging, including overcharge, over-discharge, and short-circuit protection; the power control unit is used to implement intelligent power consumption control strategies, switching the image acquisition module and the audio acquisition module to low-power standby mode when no audio or video activity is detected, and putting the 4G communication module into sleep mode during transmission intervals; the power management module also supports multiple external power inputs.

[0011] In one possible implementation, an antenna module is also included; The antenna module is connected to the 4G communication module to enhance the 4G signal. The antenna module adopts an omnidirectional multi-band antenna design and optimizes signal transmission efficiency through impedance matching circuit. It supports multiple input multiple output technology and includes a signal strength detection function to provide feedback for the adaptive transmission of the 4G communication module.

[0012] In one possible implementation, the 4G communication module further includes a transmission rate calculation unit for calculating the actual transmission rate based on network conditions, wherein the actual transmission rate R is calculated using the following formula: Calculate the effective value of the signal voltage of the i-th antenna:

[0013] Among them, signal voltage samples Obtained from the baseband signal processing unit of the 4G communication module, it represents the original signal voltage value acquired by the i-th receiving antenna at the k-th sampling time, where K represents the total number of sampling points in a single statistical period. This parameter is determined by the sampling rate configuration of the 4G communication module. Calculate the RMS value of the noise voltage of the i-th antenna:

[0014] Among them, noise voltage samples The background noise voltage value measured by the i-th receiving antenna at the k-th sampling time is obtained from the idle time slot signal monitoring unit of the 4G communication module. Calculate the signal-to-noise ratio of the i-th antenna:

[0015] in, This represents the estimated signal-to-noise ratio of the i-th receiving antenna; Calculate the average signal-to-noise ratio:

[0016] Where M represents the total number of receiving antennas, this parameter is obtained from the antenna configuration register of the 4G communication module; Calculate the signal-to-noise ratio variance:

[0017] Calculate the standard deviation of the signal-to-noise ratio:

[0018] Calculate the root mean square value of the signal-to-noise ratio:

[0019] Calculate the equivalent integrated signal-to-noise ratio:

[0020] in, This represents the equivalent overall signal-to-noise ratio after spatial diversity processing;

[0021] in, This indicates the physical resource block bandwidth currently used by the 4G communication module. This parameter is obtained from the resource allocation information sent by the base station. Indicates the theoretical channel capacity;

[0022] in, This represents the coding efficiency factor, which is obtained from the lookup table of the modulation and coding scheme currently used by the adaptive modulation and coding unit.

[0023] In one possible implementation, the power management module further includes a battery life calculation unit for calculating the system's battery life T, wherein the battery life T is calculated using the following formula: Calculate the total power consumption of the system:

[0024] in, This represents the instantaneous power consumption of the image acquisition module at the nth sampling moment, which is calculated by measuring the power supply current and voltage of the module. This represents the instantaneous power consumption of the audio acquisition module at the nth sampling moment; This represents the instantaneous power consumption of the signal processing and transmission module at the nth sampling moment; This represents the instantaneous power consumption of the 4G communication module at the nth sampling time. Calculate average power consumption:

[0025] Where N represents the number of sampling points within the power consumption statistics period, and this parameter is set by the sampling configuration register of the power management module; Calculate the power consumption variance:

[0026] Calculate the standard deviation of power consumption:

[0027] Calculate the root mean square value of power consumption:

[0028]

[0029] in, This represents the equivalent average power consumption after considering power consumption fluctuation characteristics;

[0030] in, This indicates the nominal capacity value of the battery, which is obtained from the battery parameter memory of the battery management unit.

[0031] In one possible implementation, the signal processing and transmission module further includes a bandwidth mode control unit for reducing the video frame rate and audio sampling rate in a low bandwidth mode to save bandwidth.

[0032] This specification provides an audio and video transmission system based on a 4G network. The system includes: an image acquisition module for acquiring image data; an audio acquisition module for acquiring audio data; a signal processing and transmission module for processing the image and audio data to generate transmission data, wherein the processing includes video encoding of the image data and audio encoding of the audio data, and packaging the encoded data; a 4G communication module for uploading the transmission data to a cloud server via the 4G network to support remote live video streaming and on-demand preview; and a power management module for managing the power consumption of the image acquisition module, audio acquisition module, signal processing and transmission module, and 4G communication module. By constructing a highly integrated low-power transmission architecture, stable and efficient transmission is achieved in a 4G network environment, especially in low-bandwidth scenarios. Its multi-module collaborative working mechanism significantly improves the system's adaptability in remote areas, the optimized power management strategy effectively extends the device's battery life, and the intelligent data processing method ensures the transmission quality of audio and video data under limited bandwidth conditions. The overall system has good environmental adaptability and resource utilization efficiency. Attached Figure Description

[0033] Figure 1 This is a schematic diagram of an audio and video transmission system based on a 4G network, provided in one embodiment of this specification. Detailed Implementation

[0034] Many specific details are set forth in the following description to provide a full understanding of this specification. However, this specification can be implemented in many other ways than those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this specification. Therefore, this specification is not limited to the specific implementations disclosed below.

[0035] The terminology used in one or more embodiments of this specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of this specification. The singular forms “a” and “the” as used in one or more embodiments of this specification and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in one or more embodiments of this specification refers to and includes any or all possible combinations of one or more associated listed items.

[0036] It should be understood that although the terms first, second, etc., may be used to describe various information in one or more embodiments of this specification, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, first may also be referred to as second without departing from the scope of one or more embodiments of this specification, and similarly, second may also be referred to as first. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to a determination."

[0037] This specification provides an audio and video transmission system based on a 4G network, which will be described in detail in the following embodiments.

[0038] See Figure 1 , Figure 1 This diagram illustrates a system schematic of an audio and video transmission system based on a 4G network according to an embodiment of this specification. Specifically, it includes an image acquisition module for acquiring image data; an audio acquisition module for acquiring audio data; a signal processing and transmission module for processing the image data and the audio data to generate transmission data, wherein the processing includes video encoding of the image data and audio encoding of the audio data, and packaging the encoded data; a 4G communication module for uploading the transmission data to a cloud server via a 4G network to support remote live video streaming and on-demand preview; and a power management module for managing the power consumption of the image acquisition module, the audio acquisition module, the signal processing and transmission module, and the 4G communication module.

[0039] In practical applications, an image acquisition module can refer to a hardware component responsible for capturing visual information in the environment and converting it into digital signals for image data acquisition. Image data refers to digital image information, representing the captured visual scene, which can be processed by subsequent modules. An audio acquisition module can refer to a hardware component responsible for capturing sound information in the environment and converting it into digital signals for audio data acquisition. Audio data refers to digital audio information, representing the captured sound signals, which can be processed by subsequent modules. A signal processing and transmission module refers to a processing unit responsible for encoding, compressing, and packaging image and audio data for data processing and generating transmission data. Transmission data refers to the encoded and packaged data stream, suitable for network transmission and capable of being uploaded via 4G networks. Video encoding can refer to a compression technology that converts raw image data into a more efficient format to reduce data volume, thus reducing video data size. Audio encoding refers to a compression technology that converts raw audio data into a more efficient format to reduce data volume, thus reducing audio data size. A 4G communication module refers to a wireless communication component that supports 4G network protocols for data transmission, used to transmit data to the cloud. 4G network refers to a wireless communication technology that provides high-speed data transmission services and supports remote data upload. A cloud server refers to a cloud-based server that provides data storage and access services, capable of storing and streaming audio and video data. Remote video streaming refers to a service that allows users to watch remote video streams in real time to support real-time monitoring. On-demand preview refers to a service that allows users to access historical video recordings at any time for playback and review. A power management module refers to a power control unit responsible for optimizing and allocating system power consumption, extending device battery life. Power consumption refers to the electrical energy consumed by a device during operation, which can affect its battery life.

[0040] As a concrete example: Deployed in field environmental monitoring, the system's image acquisition module uses a 1080p resolution CMOS sensor to acquire image data at a rate of 30 frames per second. The audio acquisition module uses a microphone array with a 16kHz sampling rate to capture ambient sound. The signal processing and transmission module applies H.264 video encoding to the image data and AAC audio encoding to the audio data, packaging the encoded data into MP4 format for transmission. The 4G communication module connects to the 4G network via the Band 3 frequency band, uploading the transmitted data to the cloud server at a rate of 2Mbps per second. The cloud server stores the data and supports users to remotely stream and preview video via a web interface. The power management module monitors the power consumption of each module in real time, switching the image acquisition module to a low-power mode during idle periods to keep the total system power consumption below 5W, thereby ensuring that the device can operate continuously for more than 24 hours after a single charge.

[0041] This application achieves efficient audio and video transmission in a 4G network environment through an integrated modular design. The system can maintain stable data transmission quality even under low bandwidth conditions. Intelligent power management significantly improves the device's battery life in remote areas. At the same time, it supports real-time and on-demand services to enhance the user experience and improve the overall reliability and applicability of the system.

[0042] In one possible implementation, the image acquisition module includes a CMOS image sensor and a USB interface; the CMOS image sensor is used to convert optical images into digital image signals, and the USB interface is used to transmit the digital image signals to the signal processing and transmission module; wherein the CMOS image sensor supports configurable resolution modes and includes automatic exposure and white balance adjustment functions.

[0043] In practical applications, a CMOS image sensor refers to a semiconductor image sensor device that converts light signals into electrical signals based on complementary metal-oxide-semiconductor (CMOS) technology, used to convert optical images into digital image signals. A USB interface refers to a universal serial bus physical interface that provides a standardized data transmission connection, enabling the transmission of digital image signals to signal processing and transmission modules. An optical image refers to the optical image formed on the sensor through an optical lens system, representing the captured visual scene and serving as the raw input for image acquisition. A digital image signal refers to the digitized image data after analog-to-digital conversion, containing pixel information and color depth, for processing and analysis by digital systems. Resolution mode refers to the switchable pixel output settings of the image sensor, controlling the spatial detail of the image and adjusting image sharpness and file size. Auto exposure refers to the image sensor's built-in exposure control function, automatically adjusting shutter speed or gain according to ambient light to optimize image brightness and contrast. White balance adjustment refers to the image sensor's color correction function, automatically compensating for color temperature deviations under different light sources to ensure image color accuracy and consistency.

[0044] As a specific example: In smart security camera applications, the CMOS image sensor is set to a configurable 1080p resolution mode. In indoor environments, the automatic exposure function is automatically triggered to adjust the image brightness, and white balance adjustment is applied to correct color deviations under fluorescent lights. The captured optical image is converted into a digital image signal in real time and transmitted to the signal processing and transmission module at a rate of 480Mbps via a USB 3.0 interface for subsequent encoding processing.

[0045] This application enhances the flexibility and efficiency of image acquisition by integrating a CMOS image sensor and a USB interface. The configurable resolution mode adapts to the needs of different application scenarios, and the automatic exposure and white balance adjustment functions improve the consistency of image quality. Overall, it improves the reliability of the system and the user experience in changing environments.

[0046] In one possible implementation, the audio acquisition module includes an audio array and an analog-to-digital converter; the audio array is used to convert analog sound signals into analog electrical signals, and the analog-to-digital converter is used to sample and quantize the analog electrical signals to generate digital audio signals, and transmit the digital audio signals to the signal processing and transmission module via a USB interface; wherein the audio array employs multi-microphone beamforming technology to enhance the target sound and suppress background noise.

[0047] In practical applications, an audio array can refer to a data acquisition device composed of multiple microphone units arranged in a specific geometric structure. It achieves directional sound pickup through spatial distribution and is used to convert analog sound signals into analog electrical signals. Analog sound signals refer to continuous sound wave signals propagating in the air, containing all the information of the original sound, and can be captured by the microphone units. Analog electrical signals refer to the continuous voltage signals generated by the microphone conversion, proportional to the change in sound wave pressure, and are transmitted to an analog-to-digital converter (ADC). An ADC is an electronic device that converts continuous analog signals into discrete digital signals, including sampling and quantization processes, used to generate digital audio signals. Sampling refers to the process of measuring the amplitude of an analog signal at fixed time intervals, converting a continuous signal into discrete samples, preserving the signal's temporal characteristics. Quantization refers to the process of mapping the sampled continuous amplitude values ​​to finite discrete values, determining the amplitude accuracy of the digital signal, and enabling the digital representation of the signal. Digital audio signals refer to the discrete digital sequences obtained after sampling and quantization, using pulse code modulation format, for transmission through a digital interface. A USB interface refers to a universal serial bus physical connection interface, providing a standardized digital data transmission channel for connecting the audio acquisition module and the processing module. Multi-microphone beamforming technology refers to signal processing techniques that utilize the spatiotemporal differences of multiple microphones. Through phase adjustment, it achieves directional enhancement, improving the sound acquisition quality in the target direction. Target sound refers to the audio signal emitted by a specific sound source that needs to be focused on, such as human voice or the sound of a specific device, and can be the primary processing target of the system. Background noise refers to interfering sound signals generated by non-target sound sources in the environment, including environmental noise and equipment noise, which are suppressed and eliminated by the system.

[0048] As a concrete example: when this audio acquisition module is deployed in a video conferencing system, the audio array uses a linear array of four omnidirectional microphones. When the speaker speaks, multi-microphone beamforming technology is activated to align the main beam with the direction of the sound source. The analog-to-digital converter samples and quantizes the analog electrical signal at a sampling rate of 48kHz and a resolution of 24 bits. The resulting digital audio signal is transmitted in real time to the signal processing and transmission module via a USB-C interface at a rate of 192kbps. During this process, the system effectively suppresses background noise such as keyboard clicks and air conditioning noise, improving speech clarity by approximately 40%.

[0049] This application achieves high-quality audio acquisition through a combination design of an audio array and a high-precision analog-to-digital converter. Beamforming technology significantly improves the sound capture capability in a specific direction, effectively suppresses environmental noise interference, and digital transmission ensures signal integrity. Overall, it improves the voice acquisition quality and environmental adaptability of the system.

[0050] In one possible implementation, the signal processing and transmission module includes a video encoding unit, an audio encoding unit, a data multiplexing unit, and a buffer management unit; the video encoding unit is used to compress the image data using the H.264 or H.265 encoding standard, and the audio encoding unit is used to compress the audio data using the AAC or OPUS encoding algorithm; the data multiplexing unit is used to multiplex the compressed audio and video data into a stream and add a timestamp, sequence number, and error check code; the buffer management unit is used to adjust the data transmission rate according to network conditions.

[0051] In practical applications, a video coding unit can refer to a hardware or software component specifically designed for video compression. It implements specific coding algorithms to reduce data size and is used to compress image data using H.264 or H.265 coding standards. H.264 is a widely used video compression standard that employs advanced predictive and transform coding techniques to achieve high compression ratios while maintaining good video quality. H.265 is a next-generation, high-efficiency video coding standard that further optimizes compression efficiency based on H.264, reducing data volume by approximately 50% while maintaining the same quality. Video compression can also refer to the process of reducing video data size by removing spatial and temporal redundancy while retaining key visual information, thus reducing storage and transmission requirements. An audio coding unit refers to a hardware or software component specifically designed for audio compression. It implements specific audio coding algorithms and is used to compress audio data using AAC or OPUS coding algorithms. AAC is an advanced audio coding standard that employs an improved perceptual coding model, enabling high-quality audio at lower bitrates. OPUS encoding refers to an open-source audio encoding format that supports multiple bitrates from narrowband to full-band to adapt to audio transmission needs under different network conditions. Audio compression refers to the process of reducing audio data size by eliminating auditory redundancy; leveraging the characteristics of human hearing, it can significantly reduce audio data volume. A data multiplexing unit refers to a processing unit that merges multiple independent data streams into a single composite stream, adding necessary synchronization information to multiplex compressed audio and video data into a single stream. An audio / video data stream can refer to a composite data stream organized according to a specific format, containing interleaved video and audio frames to ensure synchronized audio and video playback. A timestamp refers to time stamp information embedded in the data stream, recording the acquisition or processing time of each data unit to maintain the synchronization of audio and video signals. A sequence number refers to a consecutive number assigned to data packets, identifying the sequential position of the data packets, used to detect data loss and rearrange data order. An error check code refers to check information appended to the data, employing a cyclic redundancy check algorithm to detect errors during data transmission. The buffer management unit refers to the control unit that manages the data temporary storage area. It adjusts data read / write strategies based on real-time network conditions and can adjust the data transmission rate according to network status. Network status refers to a set of parameters reflecting the current network connection quality, including bandwidth, latency, and packet loss rate, which serve as the basis for adjusting the transmission rate. The data transmission rate refers to the amount of data transmitted through the network per unit time and is dynamically adjusted based on available bandwidth to balance transmission efficiency and stability.

[0052] As a concrete example: In a mobile video surveillance system, the signal processing and transmission module receives 1080p / 30fps image data and 48kHz / 16bit audio data. The video encoding unit uses the H.265 encoding standard to control the video bitrate at 2Mbps, the audio encoding unit uses the OPUS algorithm to compress the audio to 64kbps, the data multiplexing unit packages the compressed audio and video data into an MPEG-TS stream, and adds a millisecond-precision timestamp, an incrementing sequence number, and a CRC32 error check code to each data packet. The buffer management unit monitors the 4G network bandwidth fluctuations in real time and automatically reduces the data transmission rate from 2.2Mbps to 1.5Mbps when the network is congested to ensure the continuity of data transmission.

[0053] This application achieves efficient compression and reliable transmission of audio and video data through a multi-unit collaborative processing architecture. Intelligent buffer management effectively copes with network fluctuations, and a multi-level verification mechanism ensures data integrity, thereby improving the overall transmission stability and resource utilization efficiency of the system in mobile environments.

[0054] In one possible implementation, the 4G communication module includes a multi-band radio frequency unit, an adaptive modulation and coding unit, and a data transmission control unit; the multi-band radio frequency unit is used to support multi-band 4G network connections; the adaptive modulation and coding unit is used to dynamically adjust transmission parameters according to real-time network signal quality; the data transmission control unit is used to trigger data packet segmentation and selective retransmission mechanisms in low-bandwidth environments, dividing large data packets into smaller units for transmission and retransmitting critical data segments when packets are lost; the 4G communication module also uses a handshake protocol and encrypted transmission to ensure connection security and data security.

[0055] In practical applications, a multi-band radio frequency unit (RF unit) can refer to a transceiver circuit system that supports multiple 4G frequency band signals, including power amplifiers and filter components, used for automatic connection switching between different operator networks. An adaptive modulation and coding unit (IMC / COD unit) refers to a processing unit that dynamically adjusts the modulation scheme and coding rate according to channel conditions, achieved through a feedback mechanism, balancing transmission efficiency and reliability. Transmission parameters refer to a set of adjustable parameters affecting data transmission performance, including modulation order and coding rate, to optimize network resource utilization. A data transmission control unit refers to a control module that manages data transmission strategies, implementing flow control and error recovery mechanisms to maintain transmission stability under harsh network conditions. A low-bandwidth environment refers to communication conditions where available network bandwidth is significantly lower than normal levels, typically manifested as high latency and limited data throughput, which can trigger special transmission strategies. Data packetization refers to the process of dividing large data units into multiple smaller transmission units, adhering to the maximum transmission unit limit, and avoiding efficiency losses caused by network layer fragmentation. A selective retransmission mechanism refers to an error control mechanism that retransmits only lost or corrupted data packets, based on receiver feedback information, to improve retransmission efficiency. Critical data segments refer to data units in audio and video streams that have significant decoding value, such as video keyframes and audio synchronization frames, used to prioritize transmission quality. Handshake protocols refer to the interactive process of exchanging confirmation information when two communicating parties establish a connection. A three-way handshake mechanism is used to verify connection availability and identity legitimacy. Encrypted transmission refers to the technology of using cryptographic algorithms to keep transmitted data confidential. Using the AES-256 encryption algorithm can prevent data from being stolen or tampered with during transmission.

[0056] As a concrete example: when this 4G communication module is deployed in a mobile emergency communication vehicle, the multi-band radio frequency unit simultaneously monitors the signal strength of three 4G frequency bands: Band 1 (2100MHz), Band 3 (1800MHz), and Band 20 (800MHz). The adaptive modulation and coding unit automatically switches from 64QAM to QPSK modulation mode based on the real-time measured signal-to-noise ratio. When the data transmission control unit detects that the bandwidth is less than 1Mbps, it initiates a data packet splitting mechanism, dividing 2MB of video data into 1024 independent data packets for transmission, and selectively retransmits lost I-frame data. At the same time, a secure connection is established through the TLS 1.3 handshake protocol, and the national cryptographic SM4 algorithm is used to implement end-to-end encryption of the transmitted data.

[0057] This application enhances the device's connectivity in network coverage edge areas through multi-band radio frequency technology and adaptive modulation and coding. The intelligent data transmission control mechanism effectively copes with bandwidth fluctuations, and multi-level security protection ensures reliable transmission of sensitive data. Overall, it improves the system's communication quality and security level in complex mobile environments.

[0058] In one possible implementation, the power management module includes a power consumption monitoring unit, a battery management unit, and a power control unit. The power consumption monitoring unit is used to monitor the power consumption status of the image acquisition module, the audio acquisition module, the signal processing and transmission module, and the 4G communication module in real time. The battery management unit is used to protect the lithium-ion battery from charging and discharging, including overcharge, over-discharge, and short-circuit protection. The power control unit is used to implement an intelligent power consumption control strategy, switching the image acquisition module and the audio acquisition module to a low-power standby mode when no audio or video activity is detected, and putting the 4G communication module into a sleep state during transmission intervals. The power management module also supports multiple external power inputs.

[0059] In practical applications, a power consumption monitoring unit (PCU) refers to a detection circuit that collects current and voltage parameters of each module in real time. It employs a high-precision analog-to-digital converter (ADC) to continuously monitor the power consumption status of each component in the system. Power consumption status refers to a data set reflecting the real-time energy consumption of each module, including instantaneous power and cumulative energy consumption indicators, which can serve as a basis for power consumption control decisions. A battery management unit (BMU) refers to an integrated circuit specifically handling battery charging and discharging management, integrating multiple protection mechanisms to achieve safe charging and discharging control of lithium-ion batteries. A lithium-ion battery can refer to a secondary battery using the lithium-ion intercalation / deintercalation principle, possessing high energy density characteristics and serving as the main energy storage unit of the system. Overcharge protection refers to a protection function that prevents the battery voltage from exceeding a safe threshold, implemented through a voltage comparator, preventing battery damage due to overcharging. Over-discharge protection refers to a protection mechanism that prevents damage caused by excessively low battery voltage, employing an undervoltage lockout circuit to maintain battery operation within a safe voltage range. Short-circuit protection refers to a protection function that automatically cuts off the power supply when a short circuit occurs at the output terminal, based on current detection and a fast shutdown mechanism, used to prevent circuit damage. A power control unit refers to the core control unit that adjusts power allocation according to system status, incorporating intelligent decision-making algorithms to implement dynamic power management strategies. Intelligent power control strategies refer to schemes that adaptively adjust power consumption based on usage scenarios, using state machines to achieve mode switching and optimize system battery life. Low-power standby mode refers to the lowest power consumption operating state to maintain basic functions, shutting down unnecessary peripheral circuits to significantly reduce energy consumption when the system is idle. Sleep mode refers to the energy-saving mode of the communication module when there is no data transmission, maintaining network registration but suspending data transmission and reception to reduce communication power consumption. External power input refers to a power supply interface other than the built-in battery, supporting various input sources such as solar panels and vehicle power supplies, expanding the system's power supply flexibility.

[0060] As a specific example: In a field ecological environment monitoring station, the power management module's power consumption monitoring unit collects the power consumption of each module once per second. When no audio or video activity is detected for 10 consecutive seconds, the power control unit activates an intelligent power consumption control strategy, switching the image acquisition module to a low-power standby mode of 0.5W, the audio acquisition module to a silent state, and the 4G communication module to enter a deep sleep state during data transmission intervals, reducing power consumption to 15mW. The battery management unit implements triple protection for the 48Wh lithium-ion battery, triggering overcharge protection when the input voltage exceeds 12.6V and over-discharge protection when the voltage is below 9V. It also supports automatic switching between dual external power inputs: a 12V solar panel and a 24V vehicle power supply.

[0061] This application achieves refined management of system energy consumption through an intelligent power management architecture, multiple battery protection mechanisms ensure the safety and reliability of the power system, adaptive power control significantly extends the working time of the device in an environment without external power supply, and multi-source power supply design enhances the system's adaptability in different application scenarios.

[0062] In one possible implementation, an antenna module is also included; the antenna module is connected to the 4G communication module to enhance the 4G signal; the antenna module adopts an omnidirectional multi-band antenna design and optimizes signal transmission efficiency through impedance matching circuit, supports multiple input multiple output technology, and includes a signal strength detection function to provide feedback for the adaptive transmission of the 4G communication module.

[0063] In practical applications, an antenna module can refer to an electromagnetic conversion device specifically designed for transmitting and receiving wireless signals. It consists of a radiating element and a feeding network, used to enhance the transmission and reception capabilities of 4G signals. Omnidirectional multi-band antenna design refers to an antenna structure that radiates signals uniformly in a 360-degree horizontal plane, covering multiple 4G frequency bands and maintaining stable signal coverage in all directions. Impedance matching circuitry refers to a passive network that transforms the impedance between the RF front-end and the antenna. Through LC matching topology, it optimizes signal transmission efficiency and reduces reflection loss. Signal transmission efficiency refers to the transmission effectiveness of RF energy from the communication module to the antenna, measured by the VSWR (Standing Wave Ratio), used to evaluate the matching quality of the RF link. Multiple-input multiple-output (MIMO) technology refers to a wireless technology that utilizes multiple antennas to simultaneously transmit and receive data streams. Through spatial multiplexing gain, it can improve data transmission rate and reliability. Signal strength detection function refers to a detection circuit that measures the received signal power in real time. Using an RF power detection chip, it provides feedback information for adaptive transmission. Adaptive transmission refers to a mechanism that dynamically adjusts transmission parameters according to channel conditions, relying on real-time channel state feedback to optimize communication performance under different environments.

[0064] As a concrete example: In mobile video transmission equipment, the antenna module adopts an omnidirectional multi-band design, supporting six 4G frequency bands such as Band 1 / 3 / 5 / 7 / 8 / 20. The VSWR is optimized to below 1.5 through a π-type impedance matching circuit. The integrated 4x4 MIMO technology increases the data transmission rate to 2.8 times that of a single antenna. The signal strength detection unit collects the RSRP reference signal received power every 100 milliseconds. When the detected signal strength is below -110dBm, the transmission parameter adjustment mechanism of the 4G communication module is automatically triggered.

[0065] This application significantly improves the signal reception quality of the device in mobile environments through optimized antenna design, enhances network compatibility through multi-band support, and provides accurate environmental awareness for adaptive transmission through intelligent signal detection. Overall, it improves the communication stability and data transmission efficiency of the system in complex wireless environments.

[0066] In one possible implementation, the 4G communication module further includes a transmission rate calculation unit for calculating the actual transmission rate based on network conditions, wherein the actual transmission rate R is calculated using the following formula: Calculate the effective value of the signal voltage of the i-th antenna:

[0067] Among them, signal voltage samples Obtained from the baseband signal processing unit of the 4G communication module, it represents the original signal voltage value acquired by the i-th receiving antenna at the k-th sampling time, where K represents the total number of sampling points in a single statistical period. This parameter is determined by the sampling rate configuration of the 4G communication module. Calculate the RMS value of the noise voltage of the i-th antenna:

[0068] Among them, noise voltage samples The background noise voltage value measured by the i-th receiving antenna at the k-th sampling time is obtained from the idle time slot signal monitoring unit of the 4G communication module. Calculate the signal-to-noise ratio of the i-th antenna:

[0069] in, This represents the estimated signal-to-noise ratio of the i-th receiving antenna; Calculate the average signal-to-noise ratio:

[0070] Where M represents the total number of receiving antennas, this parameter is obtained from the antenna configuration register of the 4G communication module; Calculate the signal-to-noise ratio variance:

[0071] Calculate the standard deviation of the signal-to-noise ratio:

[0072] Calculate the root mean square value of the signal-to-noise ratio:

[0073] Calculate the equivalent integrated signal-to-noise ratio:

[0074] in, This represents the equivalent overall signal-to-noise ratio after spatial diversity processing;

[0075] in, This indicates the physical resource block bandwidth currently used by the 4G communication module. This parameter is obtained from the resource allocation information sent by the base station. Indicates the theoretical channel capacity;

[0076] in, This represents the coding efficiency factor, which is obtained from the lookup table of the modulation and coding scheme currently used by the adaptive modulation and coding unit.

[0077] As a concrete example: In a mobile video surveillance system, the transmission rate calculation unit of the 4G communication module initiates the actual transmission rate calculation process. The system is configured with M=2 receiving antennas, the sampling rate is set to K=1000 sampling points, and the baseband signal processing unit provides the signal voltage samples from antenna 1. arrive The voltage sequences are 0.5V, 0.6V, etc., for antenna 2. arrive The idle time slot signal monitoring unit provides noise voltage samples for antenna 1, with sequences of 0.4V and 0.7V, respectively. arrive The voltage sequences are 0.1V, 0.2V, etc., for antenna 2. arrive Using sequences of 0.15V and 0.25V, the effective signal voltage of antenna 1 is first calculated to be 0.55V and the effective noise voltage to be 0.18V, resulting in an SNR1 of approximately 9.3. The effective signal voltage of antenna 2 is calculated to be 0.58V and the effective noise voltage to be 0.22V, resulting in an SNR2 of approximately 6.9. Then, the average signal-to-noise ratio is calculated to be 8.1, the SNR variance is 1.44, the SNR standard deviation is 1.2, the root mean square value of the SNR is 8.3, and the equivalent comprehensive SNR is 11.7. The resource allocation information issued by the base station indicates that the physical resource block bandwidth B is 10MHz, and the theoretical channel capacity C is calculated to be approximately 43.6Mbps. The adaptive modulation and coding unit obtains the coding efficiency factor η from the lookup table as 0.75, and the final actual transmission rate R is calculated to be approximately 32.7Mbps. The system adjusts the data transmission strategy according to this rate to optimize network utilization.

[0078] This application introduces a transmission rate calculation mechanism based on multi-antenna signal processing, which enables accurate assessment and dynamic adaptation of 4G network transmission capabilities. The use of spatial diversity technology effectively improves the comprehensiveness of signal quality assessment. The signal-to-noise ratio calculation method that comprehensively considers the statistical characteristics of the signal enhances the accuracy of rate prediction. The calculation model based on real-time measurement values ​​ensures the timeliness of transmission strategy adjustment. Overall, it improves the transmission efficiency and resource utilization of the system in fluctuating network environments.

[0079] In one possible implementation, the power management module further includes a battery life calculation unit for calculating the system's battery life T, wherein the battery life T is calculated using the following formula: Calculate the total power consumption of the system:

[0080] in, This represents the instantaneous power consumption of the image acquisition module at the nth sampling moment, which is calculated by measuring the power supply current and voltage of the module. This represents the instantaneous power consumption of the audio acquisition module at the nth sampling moment; This represents the instantaneous power consumption of the signal processing and transmission module at the nth sampling moment; This represents the instantaneous power consumption of the 4G communication module at the nth sampling time. Calculate average power consumption:

[0081] Where N represents the number of sampling points within the power consumption statistics period, and this parameter is set by the sampling configuration register of the power management module; Calculate the power consumption variance:

[0082] Calculate the standard deviation of power consumption:

[0083] Calculate the root mean square value of power consumption:

[0084]

[0085] in, This represents the equivalent average power consumption after considering power consumption fluctuation characteristics;

[0086] in, This indicates the nominal capacity value of the battery, which is obtained from the battery parameter memory of the battery management unit.

[0087] As a specific example: In field emergency communication equipment, the power management module's battery life calculation unit initiates the battery life assessment process. The system sets the number of sampling points N=3600 (corresponding to a 1-hour statistical cycle), and reads the nominal capacity from the battery parameter memory. =48Wh, the power consumption monitoring unit continuously collects data from each module: image acquisition module power consumption. The power consumption of the audio acquisition module fluctuates between 0.8W and 2.5W. The power consumption of the processing module remained stable at 0.3W. The power consumption of the communication module varies between 1.2W and 2.0W. It fluctuates drastically between 0.5W and 3.5W. The total power consumption sequence was obtained through calculation. Average power consumption in the range of 2.8W to 8.3W =4.6W, power consumption variance =2.89, power consumption standard deviation =1.7W, root mean square power consumption =5.1W, final equivalent average power consumption =7.2W, system battery life T=48 / 7.2≈6.7 hours. This calculation provides on-site personnel with an accurate prediction of equipment availability.

[0088] This application establishes a battery life calculation model that considers power consumption fluctuation characteristics, thereby achieving accurate prediction of the remaining working time of the device. It adopts a multi-parameter comprehensive evaluation method to improve the accuracy of battery life estimation, a dynamic power consumption monitoring mechanism to ensure the real-time nature of the calculation results, and a statistical feature-based analysis method to enhance the reliability of the prediction. Overall, it improves the intelligence level of power management and the user experience.

[0089] In one possible implementation, the signal processing and transmission module further includes a bandwidth mode control unit for reducing the video frame rate and audio sampling rate in a low bandwidth mode to save bandwidth.

[0090] In practical applications, the bandwidth mode control unit refers to an intelligent control module that dynamically adjusts audio and video parameters based on network conditions. It has built-in mode switching logic to automatically activate optimization strategies when insufficient bandwidth is detected. Low bandwidth mode refers to an energy-saving operating state where the system runs under limited network resources, achieved by reducing data throughput, maintaining basic functions while reducing traffic consumption. Video frame rate refers to the number of video frames transmitted per second, directly affecting video smoothness and data volume, serving as a key parameter for bandwidth adjustment. Audio sampling rate refers to the number of audio samples collected per second, determining the audio frequency response range and file size, used to balance sound quality and bandwidth requirements. Traffic saving refers to the effect of reducing network resource consumption through optimized data transmission strategies. Employing intelligent compression and frame rate reduction technologies can reduce operating costs and extend network availability.

[0091] As a specific example: In a power inspection system in a remote area, when the signal processing and transmission module detects that the 4G network bandwidth is consistently below 512kbps, the bandwidth mode control unit automatically activates the low bandwidth mode, gradually reducing the video frame rate from 30fps to 8fps, while adjusting the audio sampling rate from 48kHz to 16kHz. The video encoding bitrate is correspondingly reduced from 1.5Mbps to 384kbps, and the audio bitrate is adjusted from 128kbps to 32kbps. These adjustments reduce the daily data transmission volume from the original 15GB to 3.2GB, achieving approximately 78% data saving while ensuring critical monitoring functions.

[0092] This application significantly improves the system's adaptability in restricted network environments through an intelligent bandwidth control mechanism. The adaptive parameter adjustment strategy effectively reduces network resource consumption while maintaining basic functions. Dynamic frame rate and sampling rate adjustment balance the contradiction between quality and efficiency, and overall enhances the system's practicality and economy in emergency communication and remote area applications.

[0093] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments in this specification are not limited to the described order of actions, because according to the embodiments in this specification, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the embodiments in this specification.

[0094] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0095] The preferred embodiments disclosed above are merely illustrative of this specification. The optional embodiments do not exhaustively describe all details, nor do they limit the invention to the specific implementations described. Clearly, many modifications and variations can be made based on the embodiments described herein. These embodiments are selected and specifically described in this specification to better explain the principles and practical applications of the embodiments, thereby enabling those skilled in the art to better understand and utilize this specification. This specification is limited only by the claims and their full scope and equivalents.

Claims

1. An audio and video transmission system based on a 4G network, characterized in that, include: The image acquisition module is used to acquire image data; The audio acquisition module is used to acquire audio data; The signal processing and transmission module is used to process the image data and the audio data to generate transmission data, wherein the processing includes video encoding of the image data and audio encoding of the audio data, and packaging the encoded data; A 4G communication module is used to upload the transmitted data to a cloud server via a 4G network to support remote video live streaming and on-demand preview. The power management module is used to manage the power consumption of the image acquisition module, the audio acquisition module, the signal processing and transmission module, and the 4G communication module.

2. The system according to claim 1, characterized in that, The image acquisition module includes a CMOS image sensor and a USB interface; The CMOS image sensor is used to convert optical images into digital image signals, and the USB interface is used to transmit the digital image signals to the signal processing and transmission module; wherein the CMOS image sensor supports configurable resolution modes and includes automatic exposure and white balance adjustment functions.

3. The system according to claim 1, characterized in that, The audio acquisition module includes an audio array and an analog-to-digital converter; The audio array is used to convert analog sound signals into analog electrical signals, and the analog-to-digital converter is used to sample and quantize the analog electrical signals to generate digital audio signals, and transmit the digital audio signals to the signal processing and transmission module via a USB interface; wherein the audio array employs multi-microphone beamforming technology to enhance the target sound and suppress background noise.

4. The system according to claim 1, characterized in that, The signal processing and transmission module includes a video encoding unit, an audio encoding unit, a data multiplexing unit, and a buffer management unit; The video encoding unit is used to compress the image data using the H.264 or H.265 encoding standard; the audio encoding unit is used to compress the audio data using the AAC or OPUS encoding algorithm; the data multiplexing unit is used to multiplex the compressed audio and video data into a stream and add a timestamp, sequence number, and error check code; the buffer management unit is used to adjust the data transmission rate according to network conditions.

5. The system according to claim 1, characterized in that, The 4G communication module includes a multi-band radio frequency unit, an adaptive modulation and coding unit, and a data transmission control unit; the multi-band radio frequency unit is used to support multi-band 4G network connections. The adaptive modulation and coding unit is used to dynamically adjust transmission parameters according to the real-time network signal quality; the data transmission control unit is used to trigger data packet segmentation and selective retransmission mechanisms in low-bandwidth environments, segment data packets into units for data transmission, and retransmit key data segments when packets are lost; the 4G communication module also uses a handshake protocol and encrypted transmission to ensure connection security and data security.

6. The system according to claim 1, characterized in that, The power management module includes a power consumption monitoring unit, a battery management unit, and a power control unit; The power consumption monitoring unit is used to monitor the power consumption status of the image acquisition module, the audio acquisition module, the signal processing and transmission module, and the 4G communication module in real time; the battery management unit is used to protect the lithium-ion battery during charging and discharging, including overcharge, over-discharge, and short-circuit protection; the power control unit is used to implement intelligent power consumption control strategies, switching the image acquisition module and the audio acquisition module to low-power standby mode when no audio or video activity is detected, and putting the 4G communication module into sleep mode during transmission intervals; the power management module also supports multiple external power inputs.

7. The system according to claim 1, characterized in that, It also includes an antenna module; The antenna module is connected to the 4G communication module to enhance the 4G signal. The antenna module adopts an omnidirectional multi-band antenna design and optimizes signal transmission efficiency through impedance matching circuit. It supports multiple input multiple output technology and includes a signal strength detection function to provide feedback for the adaptive transmission of the 4G communication module.

8. The system according to claim 1, characterized in that, The 4G communication module also includes a transmission rate calculation unit, used to calculate the actual transmission rate based on network conditions, wherein the actual transmission rate R is calculated using the following formula: Calculate the effective value of the signal voltage of the i-th antenna: Among them, signal voltage samples Obtained from the baseband signal processing unit of the 4G communication module, representing the original signal voltage value acquired by the i-th receiving antenna at the k-th sampling time, where K represents the total number of sampling points in a single statistical period; Calculate the RMS value of the noise voltage of the i-th antenna: Among them, noise voltage samples The background noise voltage value measured by the i-th receiving antenna at the k-th sampling time is obtained from the idle time slot signal monitoring unit of the 4G communication module. Calculate the signal-to-noise ratio of the i-th antenna: in, This represents the estimated signal-to-noise ratio of the i-th receiving antenna; Calculate the average signal-to-noise ratio: Where M represents the total number of receiving antennas: Calculate the standard deviation of the signal-to-noise ratio: Calculate the root mean square value of the signal-to-noise ratio: Calculate the equivalent integrated signal-to-noise ratio: in, This represents the equivalent overall signal-to-noise ratio after spatial diversity processing; in, This indicates the physical resource block bandwidth currently used by the 4G communication module; in, This represents the coding efficiency factor.

9. The system according to claim 1, characterized in that, The power management module also includes a battery life calculation unit for calculating the system's battery life, wherein the battery life T is calculated using the following formula: Calculate the total power consumption of the system: in, This represents the instantaneous power consumption of the image acquisition module at the nth sampling moment, which is calculated by measuring the power supply current and voltage of the module. This represents the instantaneous power consumption of the audio acquisition module at the nth sampling moment; This represents the instantaneous power consumption of the signal processing and transmission module at the nth sampling moment; This represents the instantaneous power consumption of the 4G communication module at the nth sampling time. Calculate average power consumption: Where N represents the number of sampling points within the power consumption statistics period; Calculate the power consumption variance: Calculate the standard deviation of power consumption: Calculate the root mean square value of power consumption: in, This represents the equivalent average power consumption after considering power consumption fluctuation characteristics; in, This indicates the battery's nominal capacity.

10. The system according to claim 1, characterized in that, The signal processing and transmission module also includes a bandwidth mode control unit, which is used to reduce the video frame rate and audio sampling rate in low bandwidth mode to save bandwidth.

Images