Multi-purpose audio and video integrated equipment based on one core
By using 4 evenly distributed cameras and multiple microphone arrays in the intelligent conference machine, combined with the main control module, 360-degree panoramic video acquisition and sound source positioning, the problems of small video viewing angle and delayed screen switching are solved, and the problem of improved Meeting efficiency and user experience.
Patent Information
- Application Number
- CN202411090359.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-11-26
AI Technical Summary
In video conferencing, existing smart conference machines have problems such as small video perspective, inability to quickly focus on the protagonist, serious delay in video switching, and inability to achieve 360-degree panoramic display in video conferencing, especially when multiple people are talking at the same time.
Design a one-core, multi-purpose audio and video integrated equipment, adopts 4 uniformly distributed camera modules to achieve 360-degree panoramic video acquisition, combines multiple microphone arrays to perform 360-degree sound source positioning, and video and audio signal processing are performed through the main control module. , realize automatic switching and multiple intelligent display modes.
Achieve 360-degree panoramic video acquisition and display without dead angles, quickly and accurately automatically switch images, improve meeting efficiency, simplify system structure, enhance user experience, and improve device portability and flexibility.
Smart Images

Figure CN119031089A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of audio and video technology, and in particular to a one-chip multi-purpose audio and video integrated device suitable for scenes such as video conferencing, distance education, and security monitoring. Background Art
[0002] With the rapid development of imaging technology, people's living needs are constantly improving, and audio and video equipment has quickly entered people's work and life. The current intelligent conference machine mainly obtains the position of the speaker in the meeting through sound source positioning, and then adjusts the camera position and angle by driving the pan / tilt to display the speaker on the video screen. However, this technical solution is not flexible enough. There will be a large delay from the speaker starting to speak to the camera adjusting the position and angle and displaying it in real time, and the viewing angle is also relatively limited. When more than two people speak at the same time, the system cannot determine which person is the best choice to display. In this system solution, the video screen is directly switched in real time through sound source positioning without rotating the camera position and angle. When multiple people are speaking, the speaker screen is directly and quickly switched to the position of the person with high priority through the preset position priority judgment, realizing fast intelligent capture and real-time display. At the same time, the current intelligent conference machine also has an independent omnidirectional microphone device for calls to realize the duplex function of receiving and speaking. Our equipment combines audio and video together to solve the direct call of audio and video.
[0003] The current audio and video equipment has the following problems:
[0004] 1) The video has a narrow viewing angle and cannot show all people and scenes more widely;
[0005] 2) The video cannot automatically and quickly focus on the main character alone, which makes the user experience poor;
[0006] 3) For devices with rotatable cameras, it is impossible to quickly track the caller, and the video screen switching delay is relatively serious;
[0007] 4) Most of the sound is sent and received through computers, televisions, external microphones and other devices. Summary of the invention
[0008] The purpose of the present invention is to provide a multi-purpose audio and video integrated device based on one chip.
[0009] To achieve the above object, the present invention provides the following technical solutions:
[0010] A one-chip multi-purpose audio and video integrated device, comprising:
[0011] A main control module, used for processing audio and video signals and controlling various modules of the device;
[0012] A plurality of camera modules are electrically connected to the main control module and are used to collect 360-degree panoramic videos;
[0013] A plurality of microphone arrays, electrically connected to the main control module, for performing 360-degree sound source positioning;
[0014] A speaker module, electrically connected to the main control module, for outputting audio;
[0015] A lifting control module, electrically connected to the main control module, and used to control the lifting of the multiple camera modules;
[0016] Among them, the main control module controls the multiple camera modules to switch video images based on the sound source localization results of the multiple microphone arrays.
[0017] Specifically, it also includes:
[0018] A power management module, electrically connected to the main control module, for managing the power supply of the device;
[0019] The power management module includes a USB power supply interface, a DC power supply interface and a battery module.
[0020] Specifically, it also includes:
[0021] A remote control module, electrically connected to the main control module, for receiving remote control instructions;
[0022] The remote control module includes an RF radio remote control receiver.
[0023] Specifically, it also includes:
[0024] A storage module, electrically connected to the main control module, for storing audio and video data;
[0025] The storage module supports local TF card storage and network cloud storage.
[0026] Specifically, it also includes:
[0027] The Bluetooth module is electrically connected to the main control module and is used to implement a Bluetooth audio output function.
[0028] Specifically, the multiple camera modules include 4 cameras, which are evenly distributed to achieve 360-degree panoramic shooting;
[0029] The multiple camera modules are electrically connected to the main control module via independent cables.
[0030] Specifically, the plurality of microphone arrays are evenly distributed on the top of the device to form a circular array;
[0031] The main control module determines the location of the sound source by performing time difference and intensity difference analysis on the sound signals collected by the multiple microphone arrays.
[0032] Specifically, the main control module is implemented based on the GSG3082 chip;
[0033] The main control module is used to perform distortion correction, image splicing, color restoration and image noise reduction on the video image.
[0034] Specifically, the main control module is also used to realize a variety of video display modes, including panoramic + close-up mode, panoramic + main speaker mode, panoramic + left and right split screen mode, panoramic + left and right automatic cruise, full-screen close-up mode, full-screen main speaker mode, full-screen 360-degree left and right cruise mode, and up and down 180-degree split screen mode; the panoramic + close-up mode can simultaneously display a certain proportion of the panoramic image and an image of a certain perspective, and the image of this perspective can change with the positioning of the sound source; the panoramic + main speaker mode can simultaneously display a certain proportion of the panoramic image and an image of a fixed perspective; the panoramic + left and right split screen mode can simultaneously display a certain proportion of the panoramic image and the upper left and right two images. The left and right screens can be rotated independently to display specific images; the panoramic + cruise mode can display a certain proportion of panoramic images and 360-degree left and right cruising images; the full-screen close-up mode displays images of a certain angle in full screen, and the images of this angle can change with the positioning of the sound source; in the full-screen main speaker mode, you can select images at specific locations through the left and right buttons; in the full-screen 360-degree left and right cruising mode, the image is automatically patrolled 360 degrees left and right; in the top and bottom split screen mode, the 360-degree image can be cut into two 180-degree images, and then displayed in a certain proportion; when the machine is turned on, a mode is set as the default according to specific requirements, and the eight display modes can be switched between each other.
[0035] Specifically, it also includes:
[0036] A button module, electrically connected to the main control module, including 4 touch buttons and 1 mechanical button;
[0037] MCU module, electrically connected to the main control module, used to control the lifting control module, monitor the indicator light status and detect the battery power;
[0038] A duplex call module, electrically connected to the main control module, includes two microphones and a speaker feedback detection circuit for achieving audio noise reduction, echo cancellation and ambient noise elimination
[0039] The beneficial effects of the present invention include:
[0040] 1. Realize 360-degree panoramic video acquisition and display without blind spots, greatly improving the conference experience;
[0041] 2. Through sound source positioning technology, fast and accurate automatic screen switching is achieved to improve meeting efficiency;
[0042] 3. The integrated design integrates audio and video functions, simplifies the system structure, and is easy to install and use;
[0043] 4. Multiple intelligent display modes meet different meeting needs and enhance user experience;
[0044] 5. Plug-and-play design, compatible with a variety of mainstream conference software, improves the versatility and portability of the equipment;
[0045] 6. Automatic lifting mechanism protects the camera when not in use, extending the service life of the equipment;
[0046] 7. Multiple power supply modes and storage options increase the flexibility of equipment use. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 It is a system block diagram of the audio and video integrated device of the present invention;
[0048] Figure 2 This is a schematic diagram of the top cover structure of the audio and video integrated device of the present invention;
[0049] Figure 3 A schematic diagram of a four-lens module of the audio and video integrated device of the present invention;
[0050] Figure 4 A schematic diagram of a mainboard of the audio and video integrated device of the present invention;
[0051] Figure 5 A schematic diagram of a speaker module of the audio and video integrated device of the present invention;
[0052] Figure 6 A schematic diagram of a bottom plate of the audio and video integrated device of the present invention;
[0053] Figure 7 This is a schematic diagram of the appearance of the audio and video integrated device of the present invention;
[0054] Figure 8 This is a startup flow chart of the audio and video integrated device of the present invention;
[0055] Fig. 9 Schematic diagram of various display modes of the audio and video integrated device of the present invention. DETAILED DESCRIPTION
[0056] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0057] The present invention provides a multi-purpose audio and video integrated device based on a single chip, the core structure of which is as follows Figure 1The system block diagram is shown in Figure 1. The device mainly consists of the following modules:
[0058] The main control module 1 is based on the GSG3082 chip and is the core of the entire device. The GSG3082 chip has powerful audio and video processing capabilities and can process multiple video signals and audio signals at the same time. At the same time, the video image processing module also needs to process the location of the sound source, the instructions of the button, the instructions of the remote sensing module, and process the video image accordingly and output it, such as mode switching, camera switch, viewing angle adjustment, etc.
[0059] The main functions of the main control module include:
[0060] a) Video processing: Perform real-time stitching, distortion correction, color restoration and image noise reduction on the videos collected by the four cameras to output high-quality 360-degree panoramic images.
[0061] b) Audio processing: Process the audio signals collected by the microphone array to achieve functions such as sound source localization and audio noise reduction.
[0062] c) System control: coordinate the work of each module to realize multiple display modes and function switching.
[0063] The device uses 4 camera modules2, evenly distributed to achieve 360-degree panoramic shooting. Each camera module is connected to the motherboard via an independent cable to ensure high-speed and stable data transmission.
[0064] The microphone array 3 is evenly distributed on the top of the device to form a circular array. This design can achieve 360-degree omnidirectional sound collection. The main control module 1 can accurately calculate the direction of the sound source by analyzing the time difference and intensity difference of the sound signals received by different microphones and combining a complex sound source localization algorithm.
[0065] Speaker module 4 is responsible for audio output and is connected to the base amplifier via a 2PIN wired connector.
[0066] The lifting control module 5 is controlled by the MCU and is used to control the automatic lifting of the camera module 2. When the device is turned on or a USB connection is detected, the camera module 2 automatically rises; when the device is turned off or the USB connection is disconnected, the camera module 2 automatically lowers, which not only protects the camera but also improves the portability of the device.
[0067] The power management module 6 supports multiple power supply modes, including USB power supply, 5V / 2A DC power supply and internal 4.2V battery power supply. This design increases the applicability and portability of the device.
[0068] The remote control module 7 includes an RF radio remote control receiver, which can receive control instructions sent by the remote control. The remote control sends the control instructions in a manner including but not limited to infrared remote control and RF radio remote control. The receiving module receives the instructions of the transmitting module and sends them to the audio and video image processing module for processing. The remote control has buttons including but not limited to the following: a switch button, a disable button, a left / right adjustment button, a mute button, a mode selection button, etc. The switch button function: turn the conference machine on and off; disable button: turn off / on the cameras one by one; left / right adjustment button: fine-tune the main video screen left and right in panoramic + close-up mode, panoramic + main speaker mode, and full-screen close-up mode, adjust the upper and lower split screen mode to the upper and lower split screen position, and adjust the direction of the cruise display in panoramic + cruise mode and full-screen cruise mode.
[0069] The storage module 8 stores and manages the audio and video of the conference machine, supports local TF card storage and network cloud storage, and facilitates conference recording and playback.
[0070] The Bluetooth module 9 is used to implement the Bluetooth audio output function, which expands the application scenarios of the device.
[0071] The button module 10 includes 4 touch buttons and 1 mechanical button. The functions of the touch buttons are mode button / left and right button (left and right rotation or volume +-) / camera switch (press once to turn off a camera and keep rotating until all cameras are turned off and then all cameras are turned on), and the mechanical button is the lens module lifting switch.
[0072] MCU module 11 is responsible for controlling the lifting and lowering of the lens module, monitoring the indicator light status and detecting the battery power; MIC duplex call module, this module has 2 MIC pickups and a speaker feedback detection circuit, and uses algorithms to achieve audio and video call noise reduction (implementing echo elimination, environmental noise elimination, etc.) to improve call quality.
[0073] like Figure 2-6 As shown in the schematic diagram of the appearance, the overall structure of the device is, from top to bottom, a top cover plate 12, a 4-lens module 13, a main board 14, a speaker module 15 and a bottom plate 16.
[0074] The top cover plate 12 has 5 functional modules, which are connected to the main board through a connector. MIC positioning module: The top cover plate is a circle with a diameter of about 60MM. There is an omnidirectional microphone array module on the front of the board. The module consists of multiple microphones placed on the same plane. Each microphone is evenly placed on the edge of the board with equal spacing. The sound receiving holes are vertically imaged, covering the entire scene 360 degrees. When someone speaks near the smart panoramic audio and video conferencing machine, all microphones pick up the sound. When a speaker in a certain direction speaks continuously for more than a preset time and a preset sound intensity, the speech will be determined as a valid speech through sound algorithm processing. This method can be used to accurately locate the sound source and determine the position of the speaker. In the character close-up mode, the main screen automatically switches to the position of the microphone to achieve sound source positioning.
[0075] The 4-lens module 13 is mainly used to capture panoramic images. This module is connected to the main board 14 via 4 independent cables.
[0076] The main functions of the mainboard module are: connecting with the lens module, top panel and bottom panel. It realizes the splicing of 4-way videos, the conversion processing of sound source positioning, the fusion of sound source and video, processes the panoramic audio and video we actually want, transmits it to the USB processing IC for processing, and outputs the 360 panoramic audio and video we want.
[0077] Speaker module 15: mainly for audio output (outputting music or human voice), connected to the baseboard amplifier through a 2PIN wired connector.
[0078] The bottom plate 16 is connected to the main board 14 via a flat cable to provide power to the main board and output various control signals and audio and video.
[0079] The bottom plate 16 has a Bluetooth module, an amplifier module, a battery charging and discharging module, a USB output interface, a DC5V power supply port, a lifting drive and connection motor interface, a speaker interface, a battery interface, and a power switch. All external connections required for the entire operation are realized through this board.
[0080] When using the device, first turn on the power button, then insert the USB cable. When the internal battery is charged and the USB cable is connected to the computer or other device, the conference machine lens module automatically rises, and the device enters the power-on mode. Open the conference software to see the power-on progress and the power-on screen display. It takes about 40 seconds to start up. After the machine is turned on, you can see a 360-degree panoramic picture. On the operation interface, you can turn on the speaker / MIC control switch, and you can control related functions by pressing buttons. When the USB cable is unplugged, the conference machine automatically turns off and enters Bluetooth mode. You can play music by connecting Bluetooth with a mobile phone. After the power button is turned on, the device will automatically enter Bluetooth mode without inserting the USB cable. The switch between Bluetooth and conference equipment is judged by whether the USB cable is plugged in for power supply. When the battery is out of power, you need to insert a DC-5V power supply device for normal calls.
[0081] The workflow is as follows:
[0082] 1. Turn on the machine: Figure 8 As shown in the power-on flowchart, the user turns on the power button and inserts the USB cable.
[0083] 2. Automatic lifting: After detecting the USB connection, the camera module automatically rises.
[0084] 3. Initialization: The device enters the boot mode and displays the boot screen (about 40 seconds).
[0085] 4. Normal operation: Displays a 360-degree panoramic image, and users can control various functions through buttons or remote control.
[0086] 5. Intelligent switching: Automatically switch the display mode and screen according to the sound source positioning results.
[0087] 6. Shutdown / Standby: After unplugging the USB cable, the device automatically shuts down and enters Bluetooth mode.
[0088] like Fig. 9As shown, the intelligent panoramic audio and video conference machine includes but is not limited to the above eight modes, panoramic + close-up mode, panoramic + main speaker mode, panoramic + left and right split screen mode, panoramic + left and right automatic cruise, full screen close-up mode, full screen main speaker mode, full screen 360 degree left and right cruise mode, and up and down 180 degree split screen mode. Panorama + close-up mode can simultaneously display a certain proportion of panoramic images and images of a certain perspective, and the image of this perspective can change with the location of the sound source. Panorama + main speaker mode can simultaneously display a certain proportion of panoramic images and images of a fixed perspective. Panorama + left and right split screen mode can simultaneously display a certain proportion of panoramic images and the upper left and right two pictures, and the left and right two pictures can be rotated independently to display specific images. Panorama + cruise mode can display a certain proportion of panoramic images and 360 degree left and right cruise images. Full screen close-up mode, full screen display of a certain perspective image, and the image of this perspective can change with the location of the sound source. Full screen main speaker mode, you can select a specific position image by left and right buttons. Full screen 360 degree left and right cruise mode, automatic left and right 360 degree patrol image. The top-bottom split screen mode can cut a 360-degree image into two 180-degree images and then display them in a certain ratio. When the machine is turned on, a certain mode is set by default according to specific requirements, and the eight display modes can be switched between each other.
[0089] The intelligent panoramic audio and video conferencing machine described in the present invention realizes sound source positioning through a microphone array. In the panoramic + close-up mode, the display screen automatically switches to the viewing angle of the sound source position as the sound source changes, thereby realizing the intelligent panoramic switching function of the conference machine. During the meeting, this intelligent panoramic audio and video conferencing machine is placed in the center of the conference table, which can display the conference room screen in real time at 360 degrees to achieve an immersive meeting. At the same time, the application scenarios of the intelligent panoramic audio and video conferencing machine described in the present invention are very wide, not only suitable for small and medium-sized conference rooms, but also suitable for other scenarios, such as remote teaching, training, speeches, competition sites, etc. This intelligent panoramic conference machine is compatible with various mainstream video conferencing software, such as Tencent Conference, DingTalk, Google Conference, TEAMS, SKYPE, Zoom, and can be plug-and-play, which is very convenient.
[0090] These modes can be switched by buttons or remote control to meet the needs of different meeting scenarios.
[0091] The components are described as follows:
[0092] 1.GSG3082 chip: main control chip, responsible for audio and video signal processing and system control.
[0093] 2. Camera module: collects video images, 4 in total, evenly distributed.
[0094] 3. Microphone: collects audio signals and forms a circular array.
[0095] 4. Speaker: audio output device.
[0096] 5. Lifting motor: controls the lifting and lowering of the camera module.
[0097] 6.USB interface: used for power supply and data transmission.
[0098] 7.DC power interface: 5V / 2A power supply.
[0099] 8.Battery: 4.2V built-in battery.
[0100] 9.RF wireless receiver: receives remote control signals.
[0101] 10.TF card slot: for local storage.
[0102] 11.Bluetooth module: realize Bluetooth audio function.
[0103] 12. Touch button: user operation interface.
[0104] 13. Mechanical button: controls the lens lifting and lowering.
[0105] 14.MCU: controls lifting, indicator light and battery detection.
[0106] 15. Power amplifier module: audio signal amplification.
[0107] Example 1: Video conference scenario
[0108] Application scenario: small and medium-sized meeting rooms
[0109] Hardware Setup:
[0110] 1. Place the device in the center of the conference table.
[0111] 2. Connect the power supply (USB power supply or DC power supply can be selected).
[0112] 3. Connect to the computer in the meeting room via USB cable.
[0113] Steps:
[0114] 1. Turn on the device power, the device automatically enters the power-on mode, and the camera module automatically rises.
[0115] 2. Open the video conferencing software on your computer (such as Tencent Meeting, Zoom, etc.).
[0116] 3. Select this device as the audio and video output in the software.
[0117] 3. Select this device as the audio and video input and output device in the software.
[0118] 4. The device enters the panorama + close-up mode by default, displaying a 360-degree panoramic image and a close-up image of the current speaker.
[0119] 5. After the meeting starts, the device will automatically switch the close-up screen to the current speaker based on the sound source positioning.
[0120] 6. The host can switch different display modes at any time by remote control or touch button, such as:
[0121] Switch to the panoramic + presenter mode to display the presenter's screen permanently.
[0122] Switch to full-screen 360-degree cruise mode to automatically patrol the entire conference room.
[0123] 7. If you need to turn off a camera (for example, if a participant does not want to be filmed), you can use the remote control or touch buttons to turn off / on the cameras one by one.
[0124] 8. After the meeting, disconnect the USB connection, the device will automatically shut down and the camera module will automatically lower.
[0125] Working mode description:
[0126] 1. Sound source localization mode: On by default, it analyzes the audio signals collected by the microphone array in real time to locate the speaker.
[0127] 2. Automatic tracking mode: In panorama + close-up and full-screen close-up modes, the close-up screen is automatically switched according to the sound source positioning results.
[0128] 3. Manual control mode: You can manually adjust the viewing angle, switch the display mode, etc. through the remote control or touch buttons.
[0129] 4. Power saving mode: When it detects that no one is talking for a long time, it automatically enters power saving mode to reduce power consumption.
[0130] Parameter settings:
[0131] 1. Sound source localization sensitivity: can be adjusted by remote control to adapt to different meeting room environments.
[0132] 2. Automatic switching time threshold: set to 2 seconds, that is, the screen switching is triggered only when valid speech is detected for more than 2 seconds to avoid frequent switching.
[0133] 3. Screen switching speed: adjustable, the default setting is smooth transition, providing a natural visual experience.
[0134] 4. Power saving mode trigger time: Set to automatically enter power saving mode if no one speaks for 5 minutes.
[0135] Example 2: Remote education scenario
[0136] Application scenario: online classroom, lecturers give remote lectures
[0137] Hardware Setup:
[0138] 1. Place the device in the center of the podium or in a suitable location at the front of the classroom.
[0139] 2. Connect the power supply (DC power supply is recommended to ensure long-term stable operation).
[0140] 3. Connect to the instructor's computer via USB cable.
[0141] Steps:
[0142] 1. Turn on the device power, the device automatically enters the power-on mode, and the camera module automatically rises.
[0143] 2. Open the online teaching platform on your computer.
[0144] 3. Select this device as the audio and video input and output device in the platform.
[0145] 4. The device enters the panoramic + lecturer mode by default, showing the classroom panoramic view and the lecturer's close-up.
[0146] 5. After the class begins, the instructor can switch to different display modes as needed:
[0147] Use full-screen presentation mode to focus on the lecturer's explanation.
[0148] Switch to panoramic + left and right split screen mode to display the lecturer and student interaction areas at the same time.
[0149] Use full-screen 360-degree left and right cruise mode to display the entire classroom environment.
[0150] 6. During the student questioning session, you can switch to panoramic + close-up mode to automatically locate and display the speaking students.
[0151] 7. After the course, disconnect the USB connection, the device will automatically shut down and the camera module will automatically lower.
[0152] Working mode description:
[0153] 1. Lecturer mode: Default mode, focusing on displaying the lecturer's screen.
[0154] 2. Interactive mode: Enabled during student interaction, automatically tracks the speaking students.
[0155] 3. Presentation mode: When the lecturer uses an electronic whiteboard or PPT, he or she can switch to this mode to optimize the screen to clearly display the teaching content.
[0156] 4. Patrol mode: Patrol the classroom regularly to understand students’ class status.
[0157] Parameter settings:
[0158] 1. Lecture area setting: You can preset the lecturer's activity area through the remote control and optimize the lecture screen.
[0159] 2. Student area setting: mark student seating areas to improve positioning accuracy in interactive mode.
[0160] 3. Screen switching frequency: In interactive mode, a lower switching frequency can be set to avoid frequent interruptions of teaching.
[0161] 4. Audio gain: Adjust the microphone sensitivity to ensure audio quality according to the classroom size and teaching method.
[0162] These two embodiments demonstrate the application of the present invention in different scenarios, highlighting the versatility and adaptability of the device. In the video conferencing scenario, the device's automatic tracking and multiple display modes can effectively improve the efficiency of the meeting; in the distance education scenario, the device's flexibility and panoramic coverage provide a better experience for online teaching. Through these embodiments, the feasibility and practical value of the present invention are fully demonstrated.
[0163] It should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A one-chip multi-purpose audio and video integrated device, characterized in that: include: A main control module, used for processing audio and video signals and controlling various modules of the device; A plurality of camera modules are electrically connected to the main control module and are used to collect 360-degree panoramic videos; A plurality of microphone arrays, electrically connected to the main control module, for performing 360-degree sound source positioning; A speaker module, electrically connected to the main control module, for outputting audio; A lifting control module, electrically connected to the main control module, and used to control the lifting of the multiple camera modules; Among them, the main control module controls the multiple camera modules to switch video images based on the sound source localization results of the multiple microphone arrays.
2. The integrated audio and video device according to claim 1, characterized in that: Also includes: A power management module, electrically connected to the main control module, for managing the power supply of the device; The power management module includes a USB power supply interface, a DC power supply interface and a battery module.
3. The integrated audio and video device according to claim 1, characterized in that: Also includes: A remote control module, electrically connected to the main control module, for receiving remote control instructions; The remote control module includes an RF radio remote control receiver.
4. The integrated audio and video device according to claim 1, characterized in that: Also includes: A storage module, electrically connected to the main control module, for storing audio and video data; The storage module supports local TF card storage and network cloud storage.
5. The integrated audio and video device according to claim 1, characterized in that: Also includes: The Bluetooth module is electrically connected to the main control module and is used to implement a Bluetooth audio output function.
6. The integrated audio and video device according to claim 1, characterized in that: The multiple camera modules include 4 cameras, which are evenly distributed to achieve 360-degree panoramic shooting; The multiple camera modules are electrically connected to the main control module via independent cables.
7. The integrated audio and video device according to claim 1, characterized in that: The multiple microphone arrays are evenly distributed on the top of the device to form a circular array; The main control module determines the location of the sound source by performing time difference and intensity difference analysis on the sound signals collected by the multiple microphone arrays.
8. The integrated audio and video device according to claim 1, characterized in that: The main control module is implemented based on the GSG3082 chip; The main control module is used to perform distortion correction, image splicing, color restoration and image noise reduction on the video image.
9. The integrated audio and video device according to claim 1, characterized in that: The main control module is also used to realize a variety of video display modes, including panoramic + close-up mode, panoramic + main speaker mode, panoramic + left and right split screen mode, panoramic + left and right automatic cruise, full screen close-up mode, full screen main speaker mode, full screen 360 degree left and right cruise mode, and up and down 180 degree split screen mode; panoramic + close-up mode can simultaneously display a certain proportion of panoramic images and images of a certain perspective, and the image of this perspective can change with the location of the sound source; panoramic + main speaker mode can simultaneously display a certain proportion of panoramic images and images of a fixed perspective; panoramic + left and right split screen mode can simultaneously display a certain proportion of panoramic images and two upper left and right images , the left and right screens can rotate independently to display specific images; in panoramic + cruise mode, a certain proportion of panoramic images and 360-degree left and right cruising images can be displayed; in full-screen close-up mode, images of a certain angle of view are displayed in full screen, and the images of this angle of view can change with the positioning of the sound source; in full-screen speaker mode, images of specific locations can be selected through the left and right buttons; in full-screen 360-degree left and right cruising mode, images are automatically patrolled 360 degrees left and right; in top and bottom split screen mode, a 360-degree image can be cut into two 180-degree images, and then displayed in a certain proportion; when the power is turned on, a certain mode is defaulted according to specific requirements, and the eight display modes can be switched between each other.
10. The integrated audio and video device according to claim 1, characterized in that: Also includes: A button module, electrically connected to the main control module, including 4 touch buttons and 1 mechanical button; MCU module, electrically connected to the main control module, used to control the lifting control module, monitor the indicator light status and detect the battery power; The duplex call module is electrically connected to the main control module and includes two microphones and a speaker feedback detection circuit for realizing audio noise reduction, echo cancellation and environmental noise cancellation.
