Live broadcast all-in-one machine system
By designing a live broadcast all-in-one system including video acquisition, audio acquisition, personalized orchestration, network streaming and interaction modules, the problems of poor portability and insufficient interactivity of outdoor live broadcast equipment are solved, and efficient live broadcast equipment performance and management capabilities are achieved.
Patent Information
- Application Number
- CN202411697207.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-26
- Publication Date
- 2024-12-27
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing live broadcast equipment has poor portability, large equipment size, serious light impact, inconvenient operation, high power demand, and lack of live broadcasters in outdoor live broadcasts, resulting in poor live broadcast effect.
A live broadcast all-in-one system is designed, including server, video acquisition module, audio acquisition module, personalized orchestration module, network streaming module and interaction module, using camera unit, follow unit, noise reduction unit, environmental acquisition unit and evaluation unit. Through the cooperation of these modules, video and audio acquisition, arrangement, streaming and real-time monitoring are realized, providing dynamic display and interactive functions.
It realizes the advantages of easy portability, good live broadcast effect, convenient operation, controllable interaction process, high interactive comfort, high intelligence and accurate monitoring and management, and improves the portability and management capabilities of live broadcast equipment.
Smart Images

Figure CN119211589A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of content distribution, and in particular to a live broadcast all-in-one system. Background Art
[0002] With the rise of outdoor live broadcasting, more and more content creators need to broadcast live in different outdoor environments. However, existing live broadcasting equipment is usually large in size, inconvenient to carry, and difficult to adapt to various complex outdoor environments, such as extreme weather and complex terrain.
[0003] For example, the all-in-one live broadcast machine for internet celebrities disclosed in Chinese patent CN111866244A adopts a foldable structure, which greatly reduces the space occupied when live streaming outdoors. The microphone moves with the telescopic movement of the telescopic tube, so that the live performer can adjust his or her body posture at will during the live broadcast. During the live broadcast, the mobile phone keyboard control keys on the connecting seat can conveniently control the mobile phone on the mobile phone clamp. Although it can achieve the convenience of outdoor live streaming, it cannot achieve refined management and the live streaming environment cannot be accurately controlled, resulting in poor live streaming effects.
[0004] Especially with the popularity of outdoor live broadcasting, traditional live broadcasting equipment has exposed many problems in terms of portability and adaptability to complex outdoor environments. Existing live broadcasting equipment usually relies on display screens to view the shooting images and monitor the live broadcast effects. This display method has the following major defects: The equipment is bulky: Traditional display screens are usually large and difficult to carry, which is not suitable for the portable needs of outdoor live broadcasts.
[0005] Severe light impact: In outdoor environments, the display screen is greatly affected by ambient light, especially under strong light or reflective conditions. The display effect will be significantly reduced, affecting the anchor's viewing and operation of the screen.
[0006] Inconvenient operation: Traditional display screens require a large space to operate and are not suitable for use in outdoor environments with narrow or complex terrain.
[0007] High power demand: Large-size displays usually require higher power supply, which increases the difficulty of power management of the device during outdoor live broadcasts, especially for long periods of time.
[0008] Lack of interaction between broadcasters: In traditional live broadcasts, it is impossible to directly observe the live broadcast effects of the broadcasters. It requires the cooperation of multiple people, which increases the difficulty of live broadcasts and makes it difficult to provide a comfortable live broadcast experience.
[0009] The present invention is made to solve the common problems in the field such as being difficult to carry, bulky equipment, inconvenient to operate, high labor intensity, inability to interactively view the live broadcast status, low intelligence, lack of accurate monitoring and management of the live broadcast environment, and poor live broadcast management level. Summary of the invention
[0010] The purpose of the present invention is to propose a live broadcast all-in-one system to address the current deficiencies.
[0011] In order to overcome the shortcomings of the prior art, the present invention adopts the following technical solutions: A live broadcast all-in-one system, comprising a server and a shell, the live broadcast all-in-one system also comprising a video acquisition module, an audio acquisition module, a personality arrangement module, a network streaming module, an interaction module and an evaluation module, the server being connected to the video acquisition module, the audio acquisition module, the personality arrangement module, the network streaming module, the interaction module and the evaluation module respectively; The video acquisition module, audio acquisition module, personality arrangement module, network streaming module, interaction module and evaluation module are all arranged in the shell. The video acquisition module acquires image data of the anchor's live broadcast process, the audio acquisition module acquires sound data of the anchor's live broadcast process, the personality arrangement module arranges the image data of the video acquisition module and the sound data acquired by the audio acquisition module to form live broadcast data, the network streaming module pushes the live broadcast data to the live broadcast platform, the evaluation module acquires environmental data of the live broadcast process, and evaluates the interaction process according to the environmental data to form an evaluation result, and the interaction module dynamically displays the live broadcast process according to the evaluation result, so that the anchor can view the live broadcast process; The interactive module includes a display unit and a display control unit. The display unit allows the anchor to view the current playback status. The display control unit adjusts the display parameters of the display unit according to the evaluation result.
[0012] Optionally, the video acquisition module includes a camera unit and a follower unit, the camera unit acquires live video data of the anchor, and the follower unit adjusts the position of the camera unit so that the anchor is always located in the acquisition range of the video camera; The following unit includes a sampling sensor component, an analysis component, an electric pan-tilt platform and a feedback component. The sampling sensor component collects the position data of the anchor and the camera unit. The analysis component analyzes the position of the live broadcast according to the position data collected by the sampling sensor component to form an analysis result. The feedback component feeds back the analysis result to the electric pan-tilt platform to trigger the electric pan-tilt platform to drive the camera unit to rotate. Wherein, the camera unit is arranged on the electric pan-tilt head and rotates along with the rotation of the electric pan-tilt head.
[0013] Optionally, the audio collection module includes a sound collection unit, a transmission unit, and a noise reduction unit, wherein the sound collection unit collects sound data of the anchor's live broadcast process, the noise reduction unit performs noise reduction processing on the sound data, and the transmission unit transmits the sound data after noise reduction processing to the personalized arrangement module; The transmission unit transmits the processed sound data to the personalized arrangement module via wired and wireless means.
[0014] Optionally, the personalized editing module includes a video processing unit, an audio processing unit, a synchronization unit, and a synthesis unit. The video processing unit decodes the video data, the audio processing unit decodes the audio data, the synchronization unit adds a timestamp to the decoded video data and audio data to ensure synchronous processing, and the synthesis unit synthesizes the processed audio and video data to form complete live broadcast data.
[0015] Optionally, the network streaming module includes a streaming unit, a data cache unit, and a streaming monitoring unit. The streaming unit automatically adjusts the encoding bitrate of the video and audio according to the current network bandwidth and stability, and transmits the video and audio to the live broadcast platform. The streaming monitoring unit monitors the streaming process of the streaming unit and dynamically adjusts the encoding bitrate. The data cache unit is used to temporarily store video and audio data. Among them, when the network condition is unstable, the video and audio data are temporarily stored in the data cache unit, and are pushed to the live broadcast platform through the streaming unit after the network is restored.
[0016] Optionally, the evaluation module includes an environment collection unit and an evaluation unit, the environment collection unit collects live environment data of the current location, and the evaluation unit evaluates the interaction process according to the live environment data collected by the environment collection unit: The environment acquisition unit includes an environment acquisition component and a data storage device, wherein the environment acquisition component acquires live environment data of the current location, and the data storage device stores the live environment data acquired by the environment acquisition component; Wherein, the environment collection unit is arranged on the outer wall surface of the shell.
[0017] Optionally, the evaluation unit obtains the live broadcast environment data and calculates the environment change index E according to the following formula: index : ; In the formula, R T is the rate of change of ambient temperature, R H is the rate of change of ambient humidity, R L is the rate of change of ambient light intensity, RN is the rate of change of the ambient noise level, R AQ is the rate of change of ambient air quality, R W is the rate of change of wind speed in the environment; If the environmental change index E index If it does not fall within the monitoring range [E1, E2] set by the system, the display parameters of the interactive module are triggered to be adjusted.
[0018] Optionally, the environment acquisition component includes a temperature sensor, a humidity sensor, a light sensor, a noise sensor, an air quality sensor and a wind speed sensor.
[0019] Optionally, the noise reduction unit includes a preamplifier, an analog-to-digital converter, a digital signal processor and a noise detection sensor, the preamplifier is used to amplify the low-level signal output by the microphone array to a usable level in preparation for subsequent processing and encoding, the analog-to-digital converter is used to convert the analog signal into a digital signal, the digital signal processor performs noise reduction processing on the sound data, the noise reduction processing includes filtering, echo cancellation, gain control and equalization processing, and the noise detection sensor is used to detect the ambient noise level.
[0020] Optionally, the noise reduction process of the noise reduction unit includes the following steps: S1. Initialization: Initialization of the sound collection unit, preamplifier, analog-to-digital converter, digital signal processor and noise detection sensor; S2. Sound collection: The microphone array collects the host’s voice, and the preamplifier amplifies the signal; S3, analog signal conversion: The analog-to-digital converter converts the amplified analog signal into a digital signal; S4, Noise detection: Noise detection sensor detects the ambient noise level in real time; S5. Digital signal processing: The digital signal processor performs noise reduction processing based on the noise detection data S6. Data transmission: The processed sound data is transmitted to the personalized arrangement module via wired and wireless means.
[0021] The beneficial effects achieved by the present invention are: 1. Through the cooperation between the interactive module and the evaluation module, the live broadcast process can obtain the best interactive experience, ensuring that the entire system has the advantages of easy portability, good live broadcast effect, convenient operation, controllable interactive process, high interactive comfort, high intelligence and precise monitoring and management; 2. Through the cooperation between the video acquisition module, the audio acquisition module and the personalized arrangement module, the audio and video of the live broadcast process can be processed and personalized arrangement can be performed, ensuring that the entire device has the advantages of good audio and video synchronization, high intelligence, strong ability to manage the live broadcast process in a refined manner, strong ability to manage the live broadcast process and high convenience of personalized operation; 3. Through the cooperation between the personalized arrangement module and the network streaming module, the live streaming data can be accurately streamed, ensuring that the entire device has the advantages of strong active operation capability, high intelligence, good streaming monitoring flexibility, and reliable live streaming management capability; 4. Through the cooperation between the video acquisition module and the audio acquisition module, the audio and video of the live broadcast process can be collected, ensuring that the entire device has the advantages of more convenient live broadcast operation, high portability, low labor intensity, and strong live broadcast management capabilities. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The present invention can be further understood from the following description in conjunction with the accompanying drawings. The components in the figures are not necessarily drawn to scale, but the emphasis is placed on illustrating the principles of the embodiments. In different views, the same reference numerals designate the same parts.
[0023] Figure 1 It is an overall block diagram of the present invention.
[0024] Figure 2 It is a block diagram of the display unit, display control unit, environment acquisition unit and evaluation unit of the present invention.
[0025] Figure 3 It is a block diagram of the camera unit and the follow-up unit of the present invention.
[0026] Figure 4 The block diagram of the video processing unit, audio processing unit, synchronization unit and synthesis unit of the present invention.
[0027] Figure 5 It is a block diagram of the streaming unit, data cache unit and streaming monitoring unit of the present invention.
[0028] Figure 6 It is a front view schematic diagram of the present invention.
[0029] Figure 7 It is a top view schematic diagram of the present invention.
[0030] Figure 8 for Figure 7 Schematic cross-sectional view at AA in the middle.
[0031] Fig. 9 for Figure 8 A magnified schematic diagram of point B in the middle.
[0032] Fig.10 It is a schematic structural diagram of the pitch adjustment component, the lateral steering component and the camera unit of the present invention.
[0033] Fig.11 for Fig.10 Enlarged schematic diagram of point C in the middle.
[0034] Fig.12 for Fig.10 Enlarged schematic diagram of point D in the middle.
[0035] Fig.13 It is a schematic structural diagram of the curtain and the propping sub-component of the present invention.
[0036] Fig.14 It is a rear view schematic diagram of the sound collection unit of the present invention.
[0037] Explanation of the reference numerals: 1. housing; 2. γ infrared sensor; 3. γ ultrasonic sensor; 4. gyroscope; 5. η ultrasonic sensor; 6. η infrared sensor; 7. sound collection unit; 8. camera; 9. lifting rod; 10. action seat; 11. pitch seat; 12. connecting rod; 13. moving gear; 14. pitch drive mechanism; 15. pitch collection probe; 16. pitch detection member; 17. angle detection member; 18. identification probe; 19. vertical seat; 20. horizontal seat; 21. horizontal drive mechanism; 22. steering gear; 23. protrusion; 24. connecting joint; 25. curtain; 26. lower support seat; 27. upper support seat; 28. opening rod; 29. placement slot; 30. holographic display; 31. fixed seat; 32. rotating rod; 33. rotating gear; 34. angle positioning probe; 35. rotation position positioning member; 36. rotating seat; 37. rotation drive mechanism. DETAILED DESCRIPTION
[0038] The following is an explanation of the embodiments of the present invention through specific embodiments. Those skilled in the art can understand the advantages and effects of the present invention from the contents disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and the details in this specification can also be modified and changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. In addition, the drawings of the present invention are only simple schematic illustrations and are not depicted according to actual sizes. It is stated in advance. The following embodiments will further explain the relevant technical contents of the present invention in detail, but the disclosed contents are not intended to limit the scope of protection of the present invention.
[0039] Embodiment 1: According to Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6, Figure 7 , Figure 8 , Fig. 9 , Fig.10 , Fig.11 , Fig.12 , Fig.13 and Fig.14 As shown, this embodiment provides a live broadcast all-in-one system, which includes a server and a shell 1. The live broadcast all-in-one system also includes a video acquisition module, an audio acquisition module, a personality arrangement module, a network streaming module, an interaction module and an evaluation module. The server is connected to the video acquisition module, the audio acquisition module, the personality arrangement module, the network streaming module, the interaction module and the evaluation module respectively, and the intermediate data and process data of the video acquisition module, the audio acquisition module, the personality arrangement module, the network streaming module, the interaction module and the evaluation module are stored in the database of the server for query or call; The video acquisition module, audio acquisition module, personality arrangement module, network streaming module, interaction module and evaluation module are all arranged in the housing 1. The video acquisition module acquires image data of the host's live broadcast process, the audio acquisition module acquires sound data of the host's live broadcast process, the personality arrangement module arranges the image data of the video acquisition module and the sound data acquired by the audio acquisition module to form live broadcast data, the network streaming module pushes the live broadcast data to the live broadcast platform, the evaluation module acquires environmental data of the live broadcast process, and evaluates the interaction process according to the environmental data to form an evaluation result, and the interaction module dynamically displays the live broadcast process according to the evaluation result, so that the host can view the live broadcast process; The live broadcast all-in-one system also includes a central processor, which is respectively connected to the video acquisition module, the audio acquisition module, the personalized arrangement module, the network streaming module, the interactive module and the evaluation module, and centrally controls the video acquisition module, the audio acquisition module, the personalized arrangement module, the network streaming module, the interactive module and the evaluation module based on the central processor, and stores the control data of the central processor in the server, so that the whole system can perform refined management and intelligent control of the live broadcast process; The interactive module includes a display unit and a display control unit, wherein the display unit is used by the anchor to view the current playback status, and the display control unit adjusts the display parameters of the display unit according to the evaluation result; Optionally, the video acquisition module includes a camera unit and a follower unit, the camera unit acquires live video data of the anchor, and the follower unit adjusts the position of the camera unit so that the anchor is always located in the acquisition range of the video camera; The following unit includes a sampling sensor component, an analysis component, an electric pan-tilt platform and a feedback component. The sampling sensor component collects the position data of the anchor and the camera unit. The analysis component analyzes the position of the live broadcast according to the position data collected by the sampling sensor component to form an analysis result. The feedback component feeds back the analysis result to the electric pan-tilt platform to trigger the electric pan-tilt platform to drive the camera unit to rotate. Wherein, the camera unit is arranged on the electric pan-tilt platform and rotates along with the rotation of the electric pan-tilt platform; The sampling sensor assembly includes a gamma infrared sensor 2, a gyroscope 4, and a gamma ultrasonic sensor 3. The gamma infrared sensor 2 is used to detect the position of the anchor, the gyroscope 4 detects the angle of the camera unit, and the gamma ultrasonic sensor 3 is used to detect the distance between the anchor and the camera unit. Among them, the gamma infrared sensor 2 is installed in front of the camera unit to cover the anchor's activity area, the gyroscope 4 is integrated in the camera unit or the electric pan / tilt head to detect the angle and position changes of the camera unit in real time, and the gamma ultrasonic sensor 3 is installed in front of or around the camera unit to ensure that the anchor's activity range can be covered; The analysis component obtains the position data and distance data detected by the gamma infrared sensor 2, the gyroscope 4, and the gamma ultrasonic sensor 3, and calculates the required rotation angle △θ and pitch angle △φ of the camera unit according to the following steps: S11. Calculate the position of the anchor relative to the camera unit: Among them, the position data and distance data detected by the gamma infrared sensor, gyroscope, and gamma ultrasonic sensor include: With the current position of the camera unit as the origin, a coordinate system xy is established, where the current position of the camera unit is (x camera ,y camera ), γ infrared sensor provides P host (x host ,y host ), γ ultrasonic sensor provides d distance ; S12, calculate the relative position difference: ; S13, calculate the target angle: Target angle θ target is the direction of the anchor relative to the camera unit, then: ; S14, calculating the angle that the camera unit needs to rotate: The angle of the current camera unit is θcamera; Calculate the required rotation angle Δθ, then: ; S15. Calculate the pitch angle (vertical angle): The height of the camera unit is h camera , the height of the anchor is h host , then the height difference: ; Then, the target pitch angle φ target Calculate according to the following formula: ; Pitch angle △φ: ; The feedback component includes a feedback controller and a communication interface, the communication interface is connected to the electric pan-tilt platform and transmits a control signal, and the feedback controller transmits the control signal corresponding to the pitch angle △φ and the angle Δθ required to be rotated to the electric pan-tilt platform through the communication interface; The electric pan / tilt head comprises a lateral steering component and a pitch adjustment component, wherein the lateral steering component is used to adjust the lateral angle of the camera unit, and the pitch adjustment component is used to adjust the pitch angle of the camera unit; Wherein, the lateral steering component includes a vertical seat 19, a horizontal seat 20, a horizontal driving mechanism 21, an identification probe 18, a steering gear 22, and at least two angle detection members 17. A protrusion 23 is provided on one side of the horizontal seat 20. The protrusion 23 is hinged to one side end face of the vertical seat 19 to form a rotating part. The steering gear 22 is nested on the protrusion 23. The horizontal driving mechanism 21 is arranged on the vertical seat 19 and meshes with the steering gear 22 so that the horizontal seat 20 rotates along the axis of the rotating part. At least two angle detection members 17 are arranged on one side end face of the vertical seat 19 close to the horizontal seat 20 and are evenly spaced around the axis of the rotating part. The identification probe 18 is arranged on the horizontal seat 20 and is arranged opposite to at least two angle detection members 17. When the transverse seat 20 rotates, the identification probe 18 rotates along with the transverse seat 20 and detects at least two angle detection members 17 during the rotation, thereby realizing precise control of the transverse (horizontal) rotation of the transverse seat 20; Specifically, during the horizontal rotation of the transverse seat 20, the central processor controls the transverse driving mechanism 21 to drive the transverse seat 20 to rotate, and drives the identification probe 18 to rotate synchronously. During the rotation, if the angle corresponding to the angle detection member 17 identified by the identification probe 18 matches the preset angle, the rotation is stopped, otherwise, the rotation continues until the preset angle is reached. The pitch adjustment member is arranged on the transverse seat 20 and rotates along with the transverse seat 20, so as to realize the horizontal transverse rotation of the camera unit; At the same time, the pitch adjustment component adjusts the pitch angle of the camera unit, and the pitch adjustment component includes a pitch seat 11, an action seat 10, a pitch drive mechanism 14, a pitch acquisition probe 15, a moving gear 13, and at least two pitch marking members. The pitch seat 11 is arranged on the end surface of the transverse seat 20, and a connecting rod 12 is provided on one side of the action seat 10. One end of the connecting rod 12 is hinged with the side of the pitch seat 11 to form a pitch adjustment portion, and the axis of the connecting rod 12 is parallel to the rotation direction of the transverse seat 20. The moving gear 13 is nested on the rod body of the connecting rod 12. The pitch drive mechanism 14 is arranged on the pitch seat 11 and meshes with the moving gear 13. At least two pitch marking members are arranged on the pitch adjustment seat and are distributed at equal intervals along the circumference of the axis of the pitch adjustment portion. The pitch acquisition probe 15 is arranged on the action seat 10 and rotates with the rotation of the action seat 10 to realize the acquisition of the pitch angle. In this embodiment, different angles correspond to unique pitch markers; When the rotating seat 36 rotates, the pitch acquisition probe 15 rotates along with the rotating seat 36, and during the rotation, at least two pitch marking members are aligned, thereby achieving precise control of the pitch rotation angle of the rotating seat 36; Specifically, during the pitch adjustment of the rotating seat 36, the central processor controls the pitch driving mechanism 14 to drive the rotating seat 36 to rotate, and drives the pitch acquisition probe 15 to rotate synchronously. During the rotation process, if the pitch angle corresponding to the pitch marker identified by the pitch acquisition probe 15 is consistent with the preset pitch angle, the rotation is stopped, otherwise, the rotation continues until the preset pitch angle is reached; Wherein, the camera unit is arranged on the action seat 10; The camera unit includes a camera 8, a support base, and a lifting member. The support base is used to support the camera 8, and the camera 8 collects video data of the live broadcast process of the anchor. The lifting member adjusts the height of the support base to adapt to the live broadcast needs of different heights or angles. The lifting component includes a lifting rod 9, a lifting drive mechanism and a lifting detection member. One end of the lifting rod 9 is connected to the lifting drive mechanism to form a lifting part. The lifting part is arranged on the upper end surface of the shell 1. In addition, a hidden cavity for placing the camera unit 8 is provided in the middle of the upper end surface of the shell 1. The lifting part is hidden in the hidden cavity. The other end of the lifting rod 9 extends toward a side away from the lifting part and the end is connected to the support seat. The lifting detection member detects the lifting height of the lifting rod 9 and feeds the height back to the central processor. The lifting drive mechanism is controlled by the central processor so that the lifting drive mechanism drives the lifting rod 9 to perform a lifting operation, thereby achieving precise control of the lifting height of the camera 8. Optionally, the audio collection module includes a sound collection unit 7, a transmission unit, and a noise reduction unit. The sound collection unit 7 collects sound data of the anchor's live broadcast process, the noise reduction unit performs noise reduction processing on the sound data, and the transmission unit transmits the sound data after noise reduction processing to the personalized arrangement module; Wherein, the transmission unit transmits the processed sound data to the personalized arrangement module by wired and wireless means; The sound collection unit 7 includes a microphone array and a sound buffer. The microphone array collects the sound data of the anchor's live broadcast process, and the sound buffer stores the sound data collected by the microphone array; The microphone array includes a high-sensitivity microphone, a directional microphone, a windshield, and a shockproof mount. The high-sensitivity microphone is used to collect the host's voice, the directional microphone is used to reduce environmental noise and focus on picking up the host's voice, the windshield is used to reduce wind noise and improve audio collection quality, and the shockproof mount reduces the impact of physical vibration on sound collection; Wherein, the highly sensitive microphone and the directional microphone are arranged on the shockproof seat; In addition, if Fig.14 As shown, the sound collection unit 7 is clamped on the clothes or body of the anchor (such as Fig.14 Equipped with a clamping plate that can be clamped on clothes or ties); In this embodiment, the collection process of the sound collection unit 7 includes: Each microphone captures the sound signal; Reduce wind noise with a windscreen; Reduce the interference of physical vibration through anti-vibration mount; Optionally, the noise reduction unit includes a preamplifier, an analog-to-digital converter, a digital signal processor and a noise detection sensor, the preamplifier is used to amplify the low-level signal output by the microphone array to reach a usable level to prepare for subsequent processing and encoding, the analog-to-digital converter is used to convert the analog signal into a digital signal, the digital signal processor performs noise reduction processing on the sound data, the noise reduction processing includes filtering, echo cancellation, gain control and equalization processing, and the noise detection sensor is used to detect the ambient noise level; Optionally, the noise reduction process of the noise reduction unit includes the following steps: S1. Initialization: Initialization of the sound collection unit 7, preamplifier, analog-to-digital converter, digital signal processor and noise detection sensor; S2. Sound collection: The microphone array collects the host’s voice, and the preamplifier amplifies the signal; S3, analog signal conversion: The analog-to-digital converter converts the amplified analog signal into a digital signal; S4, Noise detection: Noise detection sensor detects the ambient noise level in real time; S5. Digital signal processing: The digital signal processor performs noise reduction processing based on the noise detection data; The transmission unit includes a wired transmission component and a wireless transmission component, wherein the wired transmission component transmits the noise-reduced sound data to the personalized arrangement module in a wired transmission manner, and the wireless transmission component transmits the noise-reduced sound data to the personalized arrangement module in a wireless transmission manner; The operator can select one or both of the wired transmission component and the wireless transmission component for transmission, which will not be described in detail here; The wired transmission component includes a transmission interface and a transmission line, one end of the transmission line is connected to the transmission interface, and the other end of the transmission line is connected to the personalized arrangement module, and transmits the sound data after noise reduction processing to the personalized arrangement module; The wireless transmission component includes a wireless transmitter and a wireless receiver, wherein the wireless transmitter is connected to the noise reduction unit and transmits the noise-reduced sound data to the wireless receiver, and the wireless receiver is used to receive the sound data sent by the wireless transmitter; The wireless receiver is connected to the personalized arrangement module so that the noise-reduced sound data transmitted wirelessly can be transmitted to the personalized arrangement module; At the same time, wired transmission: use standard interface to transmit sound data to the personalized arrangement module via wired mode; Wireless transmission: Use wireless transmitters and receivers to transmit sound data to the personalized arrangement module wirelessly; Through the cooperation between the video acquisition module and the audio acquisition module, the audio and video of the live broadcast process can be collected, ensuring that the entire device has the advantages of more convenient live broadcast operation, high portability, low labor intensity, and strong live broadcast management capability; Optionally, the personalized arrangement module includes a video processing unit, an audio processing unit, a synchronization unit, and a synthesis unit, wherein the video processing unit decodes the video data, the audio processing unit decodes the audio data, the synchronization unit adds a time stamp to the decoded video data and audio data to ensure synchronous processing, and the synthesis unit synthesizes the processed audio and video data to form complete live broadcast data; The video processing unit includes a video decoder and a video processor, wherein the video decoder decodes the video data and extracts the video frames, and the video processor pre-processes and enhances the decoded video data; The video processing unit processes the image data according to the following steps: S21. Image preprocessing After obtaining the original video signal, the video stream is decoded and the video frame is extracted; Noise suppression: reducing the noise in the image by using a filter. In this embodiment, common methods include median filtering, Gaussian filtering, etc.; wherein, median filtering, Gaussian filtering, etc. are technical means well known to those skilled in the art, and thus will not be described in detail in this embodiment; White balance adjustment: adjust the color in the image to make the white part closer to natural white; S22, video processor for image enhancement Contrast and brightness adjustment: The video processor adjusts the contrast and brightness of the image to improve picture quality; Color enhancement: Enhance the color performance of the image to make the image more vivid; Sharpening: Enhance the edges of the image to make the details clearer; S23. Special effects added Add special effects as needed, such as blurred background, dynamic effects, etc. Filter Application Apply filters as needed, such as black and white, vintage, etc.; Among them, in this embodiment, adding special effects and applying filters are technical means well known to those skilled in the art, and thus they are not described in detail in this embodiment; S24, Video Coding Encode the processed image data into a video stream for transmission or storage; S25. Data transmission The encoded video data is transmitted to the next module, such as a network streaming module; the audio processing unit includes an audio decoder and an audio processor, the audio decoder decodes the audio data collected by the audio collection module, and the audio processor processes and enhances the decoded audio data; The sound processing unit processes the sound data according to the following steps: S31. Audio data acquisition Receiving the encoded audio data from the sound collection unit 7 or the transmission unit; S32, audio decoder initialization Initialize hardware audio decoders (such as AAC, MP3 decoders); S33, audio decoding Decode the encoded audio data using an audio decoder and convert it into uncompressed audio samples; S34, audio processor initialization Initialize the digital signal processor (DSP); S35, Noise Suppression Perform noise suppression on the decoded audio data to reduce background noise; S36, gain control Automatic gain control (AGC) processing to ensure the volume of the audio signal is within an appropriate range; S37, Balanced Processing Adjust the audio frequency response through the equalizer to improve the sound quality; S38, echo cancellation Perform echo cancellation on audio data to improve speech clarity; S39, audio data output Prepare the processed audio data and transmit it to the synchronization unit for further processing; The synchronization unit includes a timestamp generator and a synchronization controller, wherein the timestamp generator adds timestamps to the video data and the audio data, and the synchronization controller performs synchronization processing on the audio and video data; The synchronization unit performs the steps of synchronizing the video and audio including: S51, initialize the timestamp generator: Initialize the timestamp generator to ensure the real-time clock (RTC) is running correctly; S52, adding a timestamp to the video data: Use the timestamp generator to add timestamps to the decoded and processed video data; S53, initializing the synchronous controller: Initialize the synchronization controller to prepare for the synchronization of audio and video data; S54, synchronous controller receives timestamp: The synchronization controller receives time stamp information of the video and audio data; S55. Calculate time difference: Calculate the time difference between the video and audio data to determine the synchronization offset: ; Where ΔT is the time difference, which represents the time offset between the video frame and the audio sample, T video is the timestamp of the video frame, indicating the time when the video frame is captured or decoded, T audio The timestamp of the audio sample, indicating the time when the audio sample was captured or decoded; S56. Adjust audio and video data: According to the time difference, the playback order and speed of video and audio data are adjusted to achieve synchronization; S57, synchronized data output: Output the synchronized audio and video data, ready for synthesis processing; The synthesis unit includes a multimedia synthesizer, a video encoder, an audio encoder and a synchronization controller, the multimedia synthesizer synthesizes the synchronized audio and video data to form complete multimedia data, the video encoder encodes the synthesized multimedia data to generate a video stream suitable for transmission or storage, the audio encoder encodes the audio data to ensure synchronous encoding of the audio and video, and the synchronization controller synchronizes the video stream and the audio to ensure synchronous operation between the audio encoder and the video encoder; The synthesis unit synthesizes the video and audio data according to the following steps: S61, initialize the multimedia synthesizer: Initialize the multimedia synthesizer and prepare for audio and video synthesis; S62, synthesize the synchronized audio and video data: Inputting the synchronized audio and video data into a multimedia synthesizer for synthesis processing; S63, initializing the video encoder: Initialize the video encoder to prepare for encoding the synthesized multimedia data; S64, video data encoding: encoding the synthesized multimedia data using a video encoder; S65, initializing the audio encoder: Initialize the audio encoder and prepare to encode the audio data; S66, audio data encoding: Encoding the synchronized audio data using an audio encoder; S67, Synchronous interface initialization: Initialize the synchronization interface to ensure the synchronous operation of the audio encoder and video encoder; S68, Synchronous Control: Ensure synchronization between audio and video encoders, and adjust the operation of the encoders to ensure synchronization of the synthesized data; S69, output the encoded synthetic data: Merge and output the encoded audio and video data to form a complete live data stream; In this embodiment, through the mutual cooperation between the video acquisition module, the audio acquisition module and the personalized arrangement module, the audio and video of the live broadcast process are processed and can be personalized arranged, ensuring that the entire device has the advantages of good audio and video synchronization effect, high intelligence, strong refined management ability of the live broadcast process, strong management ability of the live broadcast process and high convenience of personalized operation; Optionally, the network streaming module includes a streaming unit, a data cache unit, and a streaming monitoring unit. The streaming unit automatically adjusts the encoding bitrate of the video and audio according to the current network bandwidth and stability, and transmits the video and audio to the live broadcast platform. The streaming monitoring unit monitors the streaming process of the streaming unit and dynamically adjusts the encoding bitrate. The data cache unit is used to temporarily store video and audio data. Wherein, when the network condition is unstable, the video and audio data are temporarily stored in the data cache unit, and pushed to the live broadcast platform through the streaming unit after the network is restored; The streaming unit includes a network interface and a hardware encoder. The hardware encoder automatically adjusts the encoding bit rate of the video and audio according to the current network bandwidth and stability. The network interface is responsible for the transmission of video and audio data. The network interface includes an Ethernet interface, a Wi-Fi module, etc., which are well known to those skilled in the art and will not be described in detail here. The data cache unit includes a data cache memory and a cache controller. The data cache memory temporarily stores video and audio data and waits for the network to recover before transmitting. The cache controller manages the reading, writing and transmission of cache data. The data cache unit temporarily stores video and audio data; saves data when the network is unstable and waits for the network to recover before transmitting; The streaming monitoring unit includes a bandwidth detector, a stability monitor, and a bitrate adjustment controller. The streaming monitoring unit detects the current network bandwidth, monitors network stability, and dynamically adjusts the encoding bit rate to ensure smooth streaming. The streaming monitoring unit dynamically adjusts the encoding bit rate according to the following steps: S71, initialization: Initialize the streaming unit, data cache unit and streaming monitoring unit; Set the maximum bit rate R max and minimum bit rate R min ; S72, video and audio data encoding: The streaming unit uses a hardware encoder to encode video and audio data; S73, network status detection: The streaming monitoring unit detects the current network bandwidth B through the bandwidth detector current ; Monitor the network packet loss rate P through the stability monitor loss ; S74, Dynamic Bit Rate Adjustment: The streaming monitoring unit uses the bitrate adjustment controller to dynamically adjust the encoding bitrate based on the detected network bandwidth and packet loss rate; Calculate the new coding rate R new : ; Where P loss To monitor the network packet loss rate through the stability monitor, B current To detect the current network bandwidth through the bandwidth detector, R max is the maximum bit rate set by the system, R min The minimum bit rate set for the system; S75, applying the new bit rate: if the new bit rate is different from the current bit rate, applying the new bit rate; S76, data cache: If the network condition is unstable (e.g., low bandwidth or high packet loss), the data cache unit temporarily stores the encoded video and audio data; S77, Data transmission: When the network becomes stable again, the data cache unit transfers the cached data to the streaming unit. The streaming unit transmits the encoded data to the live broadcast platform through the network interface; S78, streaming process monitoring: The streaming monitoring unit continuously monitors the streaming process, detects network bandwidth and packet loss rate in real time, and dynamically adjusts the encoding bit rate to ensure a stable streaming process. In this embodiment, through the mutual cooperation between the personalized arrangement module and the network streaming module, the live broadcast data can be accurately streamed, ensuring that the entire device has the advantages of strong active operation capability, high intelligence, good streaming monitoring flexibility, and reliable live broadcast management capability; Optionally, the evaluation module includes an environment collection unit and an evaluation unit, the environment collection unit collects live environment data of the current location, and the evaluation unit evaluates the interaction process according to the live environment data collected by the environment collection unit: The environment acquisition unit includes an environment acquisition component and a data storage device, wherein the environment acquisition component acquires live environment data of the current location, and the data storage device stores the live environment data acquired by the environment acquisition component; Wherein, the environment collection unit is arranged on the outer wall surface of the shell; Optionally, the environment acquisition component includes a temperature sensor, a humidity sensor, a light sensor, a noise sensor, an air quality sensor and a wind speed sensor; The evaluation unit needs to process the live environment data before calculating the environmental change index to determine the rate of change of the ambient temperature R T , Environmental humidity change rate R H , the rate of change of ambient light intensity R L , the rate of change of the environmental noise level R N , the rate of change of ambient air quality R AQ and the ambient wind speed change rate R W ; Among them, the rate of change of ambient temperature R T Calculate according to the following formula: ; Where, T env is the real-time temperature data, T ideal The appropriate temperature value set for the system to ensure that the live broadcast equipment and anchors work in the best condition; for example, 25°C may be an appropriate temperature value; Ambient humidity change rate R H Calculate according to the following formula: ; In the formula, H env is the real-time humidity data, H ideal The most suitable relative humidity value set for the system to ensure that the equipment and environment work at the optimal humidity; for example, 50% may be a suitable humidity value; The rate of change of ambient light intensity R L Calculate according to the following formula: ; Where, L env is the real-time light intensity data, L ideal The most suitable light intensity value set for the system to ensure clear video images and uniform lighting; for example, 500 lux may be a suitable light intensity value; The rate of change of the environmental noise level R N Calculate according to the following formula: ; Where N env is the real-time noise level data, N ideal The most suitable ambient noise level for the system to ensure the quality of audio acquisition; for example, 30 decibels (dB) may be a suitable noise level; The rate of change of ambient air quality R AQ Calculate according to the following formula: ; Where AQ env For real-time air quality data, AQ ideal The most suitable air quality index (AQI) set for the system to ensure the health of the streamer and the normal operation of the equipment; for example, an air quality index less than 50 may be a suitable value; Environmental wind speed change rate R W Calculate according to the following formula: ; Where AQ env For real-time ambient wind speed data, AQ ideal The most suitable wind speed value set for the system to ensure a stable environment without affecting audio and video acquisition; for example, 2 meters per second (m / s) may be a suitable wind speed value; Optionally, the evaluation unit obtains the live broadcast environment data and calculates the environment change index E according to the following formula: index : ; In the formula, R T is the rate of change of ambient temperature, R H is the rate of change of ambient humidity, R L is the rate of change of ambient light intensity, R N is the rate of change of the ambient noise level, R AQ is the rate of change of ambient air quality, R W is the rate of change of wind speed in the environment; If the environmental change index E indexIf it does not fall within the monitoring range [E1, E2] set by the system, the display parameters of the interactive module are triggered to be adjusted; If the environmental change index E index If it falls within the monitoring range [E1, E2] set by the system, it means that the display status of the current interactive module meets the system's expectations and does not need to be adjusted; Among them, the monitoring range set by the system is set by the administrator or operator according to the actual situation. This is a technical means well known to those skilled in the art. Those skilled in the art can refer to relevant technical manuals to learn about the technology, so it will not be described in detail in this embodiment; At the same time, the specific input values of the monitoring range [E1, E2] set by the system can be adjusted by the operator according to the actual situation and input and adjusted from the human-machine interface of the system; The interactive unit includes a display component and an angle adjustment component, wherein the display component is used to display interactive information of the live broadcast process, and the angle adjustment component adjusts the display angle of the display component; The display component includes a holographic display 30, a curtain 25, and a stretching sub-component. The holographic display 30 performs holographic projection of the live broadcast process, and the stretching sub-component stretches the curtain 25 so that the curtain 25 diffusely reflects the display content projected by the holographic display 30 to enhance the display effect. The curtain 25 is installed behind the holographic display 30 to receive and reflect light from the hologram or projection system; Meanwhile, in this embodiment, the distance between the curtain 25 and the holographic display 30 should be appropriate, so as to receive sufficient light without affecting the clarity and viewing angle of the image; The expansion sub-component includes an upper support seat 27, a lower support seat 26, two connecting joints 24 (a structure in which two rods are hinged to each other), an expansion driving mechanism and an expansion rod 28. The upper support seat 27 and the lower support seat 26 are parallel to each other, and the two ends of the curtain 25 are respectively connected to the upper support seat 27 and the lower support seat 26. The joints of the two connecting joints 24 are symmetrically arranged at the two ends of the upper support seat 27 and the lower support seat 26, and are connected to the ends of the upper support seat 27 and the lower support seat 26. One end of the expansion rod 28 is connected to the expansion driving mechanism to form an expansion part, and the other end of the expansion rod 28 is connected to the rod body of the connecting joint 24; When the expansion drive mechanism drives the expansion rod 28 to perform a telescopic action, the expansion rod 28 drives the connecting joint 24 to move, so that the curtain 25 can be unfolded; The propping sub-component further includes a placement slot 29, which is disposed in the housing, and the placement cavity is used for placing the lower support seat 26 and the curtain 25; In this embodiment, when the curtain 25 is in an unopened state, it is hidden in the placement cavity; The holographic display 30 includes a light source, a hologram, a projector, an optical element, and a display controller. The light source provides an illumination light source to form an interference pattern. The hologram stores three-dimensional image information and forms a three-dimensional image through interference and diffraction of light. In this embodiment, a digital hologram is used, wherein the live interactive data is converted into a digital hologram and projected and displayed by a projector. The projector projects the holographic image into the air. The optical element adjusts and controls the viewing angle of the viewer to ensure that the three-dimensional image can be seen from different angles. The display controller controls the parameters of the holographic display and adjusts the settings of the light source and the projector. Meanwhile, in this embodiment, the live broadcast process and the data of live broadcast interaction are converted into digital holograms through the following process: 1) Data collection: The camera unit and audio unit collect the host's audio and video data and the audience's interactive data in real time to generate real-time audio and video data streams and interactive data streams; 2) Data processing: The data processor processes and encodes the collected audio and video data, converts the interactive data into a digital format suitable for holographic display; 3) Hologram generation: the processed data is input into a hologram generator, and a digital hologram is generated by calculating the interference pattern; in this embodiment, the digital hologram can be generated by hologram generation software or hardware (such as a GPU); 4) Hologram projection: A digital hologram is projected into the air through a high-resolution digital projector to form a visible three-dimensional image; 5) Viewing angle control: Use optical elements such as lenses, reflectors and gratings to adjust the projection angle and direction to ensure that viewers from different angles can see the three-dimensional image; 6) Display control: The display controller adjusts the light source brightness, projection parameters, etc. in real time according to factors such as ambient light and viewing angle to optimize the display effect and ensure the clarity and stability of the holographic image; The display control unit obtains the evaluation result (environmental change index E index ), and the monitoring range [E1, E2] set by the system, and calculate the holographic display parameters according to the following formula: ; ; ; ; ; In the formula, Brightness adjustedis the brightness adjustment value, Contrast adjusted is the contrast adjustment value, ColorTemp adjusted is the color temperature adjustment value, Transparency adjusted Adjust the value for transparency, Stability adjusted Adjust the value for image stability, Brightness base The brightness base value is set by the system, which is equivalent to the default value. base The contrast base value is set by the system, which is equivalent to the default value. base is the basic value of color temperature, which is set by the system and is equivalent to the default value. base It is the transparency base value, which is set by the system and is equivalent to the default value. base is the basic value of image stability, which is set by the system and is equivalent to the default value. k is the adjustment coefficient, which is determined according to the following formula: ; In the formula, E index is the environmental change index, E1 is the lower limit of the monitoring range set by the system, and E2 is the upper limit of the monitoring range set by the system; In this embodiment, through the mutual cooperation of the interaction module and the evaluation module, the live broadcast process obtains the best interactive experience, ensuring that the entire system has the advantages of easy portability, good live broadcast effect, convenient operation, controllable interaction process, high interaction comfort, high intelligence and precise monitoring and management.
[0040] Embodiment 2: This embodiment should be understood to include all the features of any of the above embodiments, and further improve upon them. Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6 , Figure 7 , Figure 8 , Fig. 9 , Fig.10 , Fig.11 , Fig.12 , Fig.13 and Fig.14As shown, the interaction unit further includes a direction collecting component, an analyzing subunit and a rotating component. The direction collecting component collects the position of the anchor to form position data. The analyzing subunit analyzes the anchor position according to the position data collected by the direction collecting component to form an analysis result. The rotating component triggers the adjustment of the display angle direction of the display component and the stretching subcomponent according to the analysis result. Wherein, the display component and the opening sub-component are both arranged on the rotating component and rotate along with the rotation of the rotating component; The direction acquisition component includes a control button and a direction acquisition component. The control button is used to start the direction acquisition component to collect (when the control button is triggered, the follow-up unit is in an untriggered state, and the two cannot be enabled at the same time). The direction acquisition component senses the position of the anchor to obtain the position data of the anchor; The direction acquisition component includes an n infrared sensor 6, an acceleration sensor, and an n ultrasonic sensor 5. The n infrared sensor 6 is used to detect the position of the live broadcast, the acceleration sensor is used to detect the position change and direction of the anchor, and the n ultrasonic sensor 5 is used to measure the distance between the anchor and the sensor; Wherein, the acceleration sensor is worn on the anchor; The n infrared sensor 6 is installed on the peripheral side of the housing 1 to detect the position of the anchor; The analysis subunit analyzes the position of the anchor according to the following steps: S81, Initialization: Initialize the holographic display 30, the direction acquisition component, the analysis subunit and the servo motor; Ensure that all sensors and control modules are functioning properly; Set the position of the holographic display 30 to the origin (0,0); S82, calculate the position using the data of the η ultrasonic sensor 5: Assume that there are two η ultrasonic sensors, located at (x 1 ,y 1 ) and (x 2 ,y 2 ), the measured distances are d 1 and d 2 ; The position of the holographic display is defined as the origin of the coordinate system (0,0), and the two ultrasonic sensors are located at (x 1 ,y 1 ) and (x 2 ,y 2 ); Use the distance formula between two points: ; Solve the above two equations to get the anchor's position coordinates (U, V); S83, calculating the target angle β according to the anchor position target : ; Where, (U, V) is the position coordinate of the anchor; Calculate the rotation angle △β: ; In the formula, β current is the current angle of the curtain or holographic display; The analysis subunit transmits the calculated rotation angle △β to the rotation component, and controls the curtain 25 and the holographic display 30 through the rotation component to follow the anchor, thereby improving the convenience and comfort of the anchor's interaction; The rotating member includes a rotating seat 36, a fixed seat 31, a rotating driving mechanism 37, a rotating gear 33, an angle positioning probe 34, and at least two rotating position positioning members 35. The fixed seat 31 is used to support the rotating seat 36, and a rotating rod 32 is provided on one side of the rotating seat 36. The rotating rod 32 is hinged to one side end surface of the fixed seat 31 to form a rotating portion. At least two rotating position positioning members 35 are distributed at equal intervals along the circumference of the axis of the rotating portion. The rotating gear 33 is embedded in the rod body of the rotating rod 32. The rotating driving mechanism 37 is meshed with the rotating gear 33 to drive the rotating seat 36 to rotate along the axis of the rotating portion. The angle positioning probe 34 is arranged on the rotating seat 36 and extends toward one side of the at least two rotating position positioning members 35, and identifies the at least two rotating position positioning probes. The rotation position positioning probes at different angles are all different and are identified by the angle positioning probe 34; The central processor obtains the rotation angle △β obtained by the analysis of the analysis subunit, and controls the rotation drive mechanism 37 to drive the rotating seat 36 to rotate the angle △β. Meanwhile, during the rotation process, the angle positioning probe 34 collects the real-time rotation angle of the rotating seat 36. If the rotation angle of the rotating seat 36 is consistent with the required rotation angle △β, the driving of the rotating seat 36 is stopped. Otherwise, the rotating seat 36 continues to rotate until the rotating seat 36 rotates to the required rotation angle △β. In this embodiment, during the rotation of the rotating seat 36, the display component and the propping sub-component are driven to rotate, so that the live broadcaster can view the status of the live broadcast process and the interactive data of the live broadcast; Through the mutual cooperation among the direction acquisition component, the analysis subunit, the rotating component, the display component and the spreading subcomponent, the host obtains the best interactive comfort, ensuring that the entire device has a good interactive effect and can actively follow the host's position. It has the advantages of high intelligence, strong monitoring capability, good interactive capability, and strong ability to manage the interaction in the live broadcast process.
[0041] The contents disclosed above are only preferred feasible embodiments of the present invention, and do not limit the protection scope of the present invention. Therefore, all equivalent technical changes made using the contents of the present invention specification and drawings are included in the protection scope of the present invention. In addition, the elements therein can be updated as technology develops.
Claims
1. A live broadcast all-in-one system, comprising a server and a shell, characterized in that: The live broadcast all-in-one system also includes a video acquisition module, an audio acquisition module, a personalized arrangement module, a network streaming module, an interactive module and an evaluation module, and the server is connected to the video acquisition module, the audio acquisition module, the personalized arrangement module, the network streaming module, the interactive module and the evaluation module respectively; The video acquisition module, audio acquisition module, personality arrangement module, network streaming module, interaction module and evaluation module are all arranged in the shell. The video acquisition module acquires image data of the anchor's live broadcast process, the audio acquisition module acquires sound data of the anchor's live broadcast process, the personality arrangement module arranges the image data of the video acquisition module and the sound data acquired by the audio acquisition module to form live broadcast data, the network streaming module pushes the live broadcast data to the live broadcast platform, the evaluation module acquires environmental data of the live broadcast process, and evaluates the interaction process according to the environmental data to form an evaluation result, and the interaction module dynamically displays the live broadcast process according to the evaluation result, so that the anchor can view the live broadcast process; The interactive module includes a display unit and a display control unit. The display unit allows the anchor to view the current playback status. The display control unit adjusts the display parameters of the display unit according to the evaluation result.
2. The live broadcast all-in-one system according to claim 1, characterized in that: The video acquisition module includes a camera unit and a follower unit, wherein the camera unit acquires live video data of the anchor, and the follower unit adjusts the position of the camera unit so that the anchor is always located in the acquisition range of the video camera; The following unit includes a sampling sensor component, an analysis component, an electric pan-tilt platform and a feedback component. The sampling sensor component collects the position data of the anchor and the camera unit. The analysis component analyzes the position of the live broadcast according to the position data collected by the sampling sensor component to form an analysis result. The feedback component feeds back the analysis result to the electric pan-tilt platform to trigger the electric pan-tilt platform to drive the camera unit to rotate. Wherein, the camera unit is arranged on the electric pan-tilt head and rotates along with the rotation of the electric pan-tilt head.
3. The live broadcast all-in-one system according to claim 2, characterized in that: The audio collection module includes a sound collection unit, a transmission unit, and a noise reduction unit. The sound collection unit collects the sound data of the anchor's live broadcast process, the noise reduction unit performs noise reduction processing on the sound data, and the transmission unit transmits the noise-reduced sound data to the personalized arrangement module; The transmission unit transmits the processed sound data to the personalized arrangement module via wired and wireless means.
4. The live broadcast all-in-one system according to claim 3, characterized in that: The personalized editing module includes a video processing unit, an audio processing unit, a synchronization unit, and a synthesis unit. The video processing unit decodes the video data, the audio processing unit decodes the audio data, the synchronization unit adds a timestamp to the decoded video data and audio data to ensure synchronous processing, and the synthesis unit synthesizes the processed audio and video data to form complete live broadcast data.
5. The live broadcast all-in-one system according to claim 4, characterized in that: The network streaming module includes a streaming unit, a data cache unit, and a streaming monitoring unit. The streaming unit automatically adjusts the encoding bit rate of the video and audio according to the current network bandwidth and stability, and transmits them to the live broadcast platform. The streaming monitoring unit monitors the streaming process of the streaming unit and dynamically adjusts the encoding bit rate. The data cache unit is used to temporarily store video and audio data. Among them, when the network condition is unstable, the video and audio data are temporarily stored in the data cache unit, and are pushed to the live broadcast platform through the streaming unit after the network is restored.
6. The live broadcast all-in-one system according to claim 5, characterized in that: The evaluation module includes an environment collection unit and an evaluation unit. The environment collection unit collects live environment data of the current location. The evaluation unit evaluates the interaction process according to the live environment data collected by the environment collection unit: The environment acquisition unit includes an environment acquisition component and a data storage device, wherein the environment acquisition component acquires live environment data of the current location, and the data storage device stores the live environment data acquired by the environment acquisition component; Wherein, the environment collection unit is arranged on the outer wall surface of the shell.
7. The live broadcast all-in-one system according to claim 6, characterized in that: The evaluation unit obtains the live broadcast environment data and calculates the environment change index E according to the following formula: index : ; In the formula, R T is the rate of change of ambient temperature, R H is the rate of change of ambient humidity, R L is the rate of change of ambient light intensity, R N is the rate of change of the ambient noise level, R AQ is the rate of change of ambient air quality, R W is the rate of change of environmental wind speed; If the environmental change index E index If it does not fall within the monitoring range [E1, E2] set by the system, the display parameters of the interactive module are triggered to be adjusted.
8. The live broadcast all-in-one system according to claim 7, characterized in that: The environment acquisition component includes a temperature sensor, a humidity sensor, a light sensor, a noise sensor, an air quality sensor and a wind speed sensor.
9. The live broadcast all-in-one system according to claim 8, characterized in that: The noise reduction unit includes a preamplifier, an analog-to-digital converter, a digital signal processor and a noise detection sensor. The preamplifier is used to amplify the low-level signal output by the microphone array to reach a usable level and prepare for subsequent processing and encoding. The analog-to-digital converter is used to convert the analog signal into a digital signal. The digital signal processor performs noise reduction processing on the sound data. The noise reduction processing includes filtering, echo cancellation, gain control and equalization processing. The noise detection sensor is used to detect the ambient noise level.
10. The live broadcast all-in-one system according to claim 9, characterized in that: The noise reduction process of the noise reduction unit includes the following steps: S1. Initialization: Initialization of the sound collection unit, preamplifier, analog-to-digital converter, digital signal processor and noise detection sensor; S2. Sound collection: The microphone array collects the host’s voice, and the preamplifier amplifies the signal; S3, analog signal conversion: The analog-to-digital converter converts the amplified analog signal into a digital signal; S4, Noise detection: Noise detection sensor detects the ambient noise level in real time; S5. Digital signal processing: The digital signal processor performs noise reduction processing based on the noise detection data; S6. Data transmission: The processed sound data is transmitted to the personalized arrangement module via wired and wireless means.
Citation Information
Patent Citations
Plug flow data processing method based on live broadcast, computing equipment and storage medium
CN113365094A
Live broadcast display system based on multi-platform stream pushing and pushing method thereof
CN116567356A
Outdoor electronic information broadcast network system
CN202475667U
Multifunctional live broadcast interaction equipment
CN215815115U
Cited By
Audio and video transmission system based on 4G network
CN121864769A
