Panoramic audio and video device for wirelessly transmitting live broadcast plug flow

Abstract

The invention discloses a panoramic audio and video device for wireless transmission of live broadcast and stream pushing, which comprises a shell, the shell is spherical and comprises an upper shell, a lower shell and a middle shell, the bottom end of the lower shell is connected with a connection table, and the middle shell is connected with a plurality of groups of visual sensing modules around the circumferential direction of the middle shell; a middle frame is arranged in the middle of the machine shell, the multiple sets of view sensing modules are arranged around the middle frame, and the middle frame is connected with multiple sets of image quality processors matched with the multiple sets of view sensing modules. The bottom of the middle frame is connected with data memories matched with the multiple sets of visual sensing modules, a high-speed data bus is connected between the multiple data memories, and the high-speed data bus is connected with a main control chip. Compared with the prior art, the panoramic audio and video device has the advantages that the panoramic audio and video device is convenient to operate and use and capable of meeting panoramic audio and video collection and guaranteeing video definition.

Description

Technical Field

[0001] The present invention relates to the field of panoramic audio and video technology for live streaming and in particular to a panoramic audio and video device for wirelessly transmitting live streaming. Background Art

[0002] The 5G panoramic audio-visual production and broadcasting technology application development project is based on 5G panoramic audio-visual production and broadcasting technology to develop a corresponding series of software and hardware products, including "panoramic audio-visual acquisition equipment", "panoramic audio-visual program editing software" and "panoramic audio-visual program player software" as well as "panoramic audio-visual product production".

[0003] With the rapid development of computer technology, microelectronics technology, optical technology and multimedia technology, people's demand for information exchange is constantly increasing, and the demand for innovation in information communication methods is increasing day by day. The traditional method of collecting audio and video information with a single camera and transmitting it to a remote location through the network for video intercom can no longer meet people's growing demand for image and video information collection without blind spots. A panoramic audio and video acquisition device that breaks through tradition and brings users an immersive experience without blind spots has emerged.

[0004] At present, most panoramic audio and video acquisition devices can only realize panoramic video acquisition, while the audio can hardly meet the usage needs. At the same time, binocular camera solutions are mostly adopted, that is, two camera modules are placed back to back or staggered in the horizontal direction, which is prone to problems such as insufficient pixel density, large image distortion and unclear picture quality. Summary of the invention

[0005] The technical problem to be solved by the present invention is to overcome the above technical defects and provide a panoramic audio and video device for wireless transmission, live streaming and streaming that is easy to operate and use, can meet the needs of panoramic audio and video acquisition, and ensure video clarity.

[0006] In order to solve the above technical problems, the technical solution provided by the present invention is as follows: a panoramic audio and video device for wireless transmission of live streaming, comprising a housing, the housing being spherical and comprising an upper housing, a lower housing and a middle housing, the bottom end of the lower housing being connected with a docking station, and the middle housing being connected with a plurality of visual sensor modules around its circumference;

[0007] A middle frame is provided in the middle of the housing, and a plurality of sets of visual sensor modules are arranged around the middle frame. A plurality of sets of image quality processors are respectively connected to the middle frame to cooperate with the plurality of sets of visual sensor modules;

[0008] The bottom of the middle frame cooperates with multiple groups of visual sensor modules and is connected to a data storage device, a high-speed data bus is connected between the multiple data storage devices, and the high-speed data bus is connected to a main control chip;

[0009] The middle frame is provided with a plurality of small microphones connected to the upper shell, the lower shell and the middle shell, and the plurality of small microphones form a spherical distributed microphone array.

[0010] Preferably, the number of the visual sensing modules is greater than four and they are equidistantly distributed from each other, and the visual sensing modules are fisheye ultra-wide-angle sensors, and the acquisition specifications of the fisheye ultra-wide-angle sensors are 1920x1080~7680x3840, 30FPS~60FPS.

[0011] Preferably, the small microphones are provided in 32 groups.

[0012] Preferably, the main control chip includes image expansion, splicing, fusion processing and encoding, and the main control chip performs data compression and live encoding on the processed image.

[0013] Preferably, the compression format is the H.264 / 265 video format, and the live broadcast encoding includes 3840x2160 60FPS real-time live broadcast encoding, which is encoded and streamed in RTMP / RTSP format.

[0014] The advantages of the present invention compared with the prior art are: in the present invention, multi-image collection and arrangement are carried out with the help of the setting of at least four groups of fisheye ultra-wide-angle sensors to achieve 360° acquisition without dead angles. At the same time, in the present invention, small microphones are arranged on the upper, middle and lower parts of the device, and the microphone array is distributed in a spherical shape, so as to meet the panoramic audio collection effect, realize "audio and video synchronous collection, in-machine processing", "unified media format" use, and can be directly connected to the panoramic video program production and broadcasting software for editing and playback, which greatly improves the convenience and ease of use. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 The present invention is a structural diagram of a panoramic audio and video device for wireless transmission, live streaming and pushing.

[0016] Figure 2 The invention discloses a first-person structural diagram of an exploded view of a panoramic audio and video device for wireless transmission, live streaming and streaming.

[0017] Figure 3 The invention discloses a second perspective structural diagram of an exploded view of a panoramic audio and video device for wireless transmission live streaming.

[0018] As shown in the figure: 1. Casing, 2. Upper shell, 3. Lower shell, 4. Middle shell, 5. Docking station, 6. Visual sensor module, 7. Middle frame, 8. Image quality processor, 9. Data storage device, 10. Main control chip, 11. Small microphone. DETAILED DESCRIPTION

[0019] The present invention is further described in detail below in conjunction with the accompanying drawings.

[0020] References to embodiments of the present invention will now be provided in detail, one or more examples of which are described below. Each example is provided as an explanation rather than a limitation of the present invention. In fact, it will be apparent to those skilled in the art that various modifications and variations may be made to the present invention without departing from the scope or spirit of the present invention. For example, a feature illustrated or described as part of one embodiment may be used in another embodiment to produce a further embodiment.

[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art of the present invention. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more related listed items.

[0022] The terms "comprises", "includes" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features.

[0023] In the description of the invention, "multiple" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined. In the description of the invention, "several" means at least one, such as one, two, etc., unless otherwise clearly and specifically defined.

[0024] Combined with Figure 1-3 As shown, a panoramic audio and video device for wireless transmission of live streaming includes a housing 1, which is spherical and includes an upper shell 2, a lower shell 3 and a middle shell 4. The bottom end of the lower shell 3 is connected to a docking station 5, and the middle shell 4 is connected to a plurality of visual sensor modules 6 around its circumferential direction.

[0025] A middle frame 7 is provided in the middle of the housing 1, and a plurality of visual sensor modules 6 are arranged around the middle frame 7. The middle frame 7 is provided with a plurality of image quality processors 8 respectively connected to the plurality of visual sensor modules 6. Meanwhile, a data storage device 9 is connected to the bottom of the middle frame 7 in cooperation with the plurality of visual sensor modules 6. A high-speed data bus is connected between the plurality of data storage devices 9. The high-speed data bus is connected to a main control chip 10. When in use, the main control chip 10 includes image expansion, splicing, fusion processing and encoding. The main control chip 10 performs data compression on the processed image and performs live encoding.

[0026] More specifically, the compression format is the H.264 / 265 video format, and the live broadcast encoding includes 3840x216060FPS real-time live broadcast encoding, which is encoded and streamed through the RTMP / RTSP format.

[0027] In order to meet the requirements of panoramic audio collection, a plurality of small microphones 11 are connected to the upper shell 2, the lower shell 3 and the middle shell 4 on the middle frame 7. The plurality of small microphones 11 are spherically distributed microphone arrays, and 32 groups of small microphones 11 are provided.

[0028] In order to meet the image quality requirements during use, the number of visual sensor modules 6 is greater than four and they are equidistantly distributed from each other. The visual sensor module 6 is a fisheye ultra-wide-angle sensor, and the acquisition specifications of the fisheye ultra-wide-angle sensor are 1920x1080~7680x3840, 30FPS~60FPS.

[0029] In the specific implementation of the present invention, the main control chip 10 is no less than QCS8250, 8 cores, and the data storage device is no less than 2TB SSD.

[0030] In addition, a 5G radio frequency communication module or a USB5G network card can be installed, WIFI / 802.11b / g / n / ac, 2.4 / 5GHz, and a communication distance ≥20m. The specifications of the visual sensor module 6 are greater than those of SONY IMX283.

[0031] The contents not described in detail in this specification belong to the prior art known to professional and technical personnel in this field.

[0032] The present invention and its embodiments are described above, and such description is not restrictive. The drawings show only one embodiment of the present invention, and the actual structure is not limited thereto. In short, if ordinary technicians in the field are inspired by it, without departing from the purpose of the invention, they can design a structure and embodiment similar to the technical solution without creativity, which should belong to the protection scope of the present invention.

Claims

1. A panoramic audio and video device for wireless transmission of live streaming, characterized by: The device comprises a housing (1), wherein the housing (1) is spherical and comprises an upper housing (2), a lower housing (3) and a middle housing (4); a docking platform (5) is connected to the bottom end of the lower housing (3); and a plurality of visual sensor modules (6) are connected to the middle housing (4) in a circumferential direction thereof; A middle frame (7) is provided in the middle of the housing (1), and a plurality of sets of visual sensor modules (6) are arranged around the middle frame (7); and a plurality of sets of image quality processors (8) are respectively connected to the plurality of sets of visual sensor modules (6) on the middle frame (7); The bottom of the middle frame (7) cooperates with a plurality of visual sensor modules (6) and is connected to a data storage device (9); a high-speed data bus is connected between the plurality of data storage devices (9); and the high-speed data bus is connected to a main control chip (10); The middle frame (7) is provided with a plurality of small microphones (11) connected to the upper shell (2), the lower shell (3) and the middle shell (4), and the plurality of small microphones (11) form a spherically distributed microphone array.

2. A panoramic audio and video device for wireless transmission of live streaming according to claim 1, characterized in that: The number of the visual sensor modules (6) is greater than four and they are equidistantly distributed from each other. The visual sensor modules (6) are fisheye ultra-wide-angle sensors, and the acquisition specifications of the fisheye ultra-wide-angle sensors are 1920x1080-7680x3840 and 30FPS-60FPS.

3. A panoramic audio and video device for wireless transmission of live streaming according to claim 1, characterized in that: The small microphones (11) are provided in 32 groups.

4. A panoramic audio and video device for wireless transmission of live streaming according to claim 1, characterized in that: The main control chip (10) includes image expansion, splicing, fusion processing and encoding, and the main control chip (10) performs data compression on the processed image and performs live encoding.

5. A panoramic audio and video device for wireless transmission of live streaming according to claim 4, characterized in that: The compression format is the H.264 / 265 video format, and the live broadcast encoding includes 3840x2160 60FPS real-time live broadcast encoding, which is encoded and streamed in RTMP / RTSP format.

Images