Wireless multi-channel video processing device

Abstract

The invention provides a wireless multi-channel video processing device which is used for being connected with at least one wireless device and a receiving device, and comprises a wireless communication unit which is used for being wirelessly connected with the at least one wireless device so as to receive videos from the at least one wireless device; the image processing unit is used for transmitting a connection request signal to the at least one wireless device through the wireless communication unit, so that the at least one wireless device returns a connection permission signal and a video according to the connection request signal and processes the video to form a plurality of output videos, the image processing unit processes the video according to the selected video display mode, and the wireless multi-channel video processing device provides a plurality of endpoints for the receiving device according to the number of the output videos so as to transmit the output videos to the receiving device.

Description

Technical Field

[0001] The present invention relates to a wireless multi-channel video processing device, and in particular to a wireless multi-channel video processing device wirelessly connected to at least one wireless device. Background Art

[0002] In video conferencing, using wireless connections allows users to set up and adjust the position of the camera more conveniently and freely.

[0003] Please refer to Figure 1 , Figure 1 It is a schematic diagram of an existing wireless video transmission device. The existing audio and video transmission system includes a wireless video transmission device 10, a wireless device 11, a receiving device 12, and a display device 13. The wireless device 11 is a wireless device used to return a connection permission signal SA and a video D according to a connection request signal SR transmitted by the wireless video transmission device 10. The source of the video D may be other sources on the network, such as a video player, etc., in addition to the wireless device 11, depending on actual needs. In other words, the wireless device 11 may be a network camera device or a camera device with a wireless communication unit. If the camera device is a network camera device, the wireless video transmission device 10 is connected to the Internet via a wireless communication unit and then connected to it, which is different from Figure 1 The wireless device 11 with a wireless communication unit can be directly connected via wifi.

[0004] However, in a video conference, it is usually necessary to simultaneously display videos from multiple cameras or to simply process the videos from the cameras for the purpose of conducting the conference.

[0005] Therefore, a method is needed to efficiently process videos from multiple photographing devices simultaneously so as to clearly display the videos from each photographing device simultaneously.

[0006] In addition, existing video conferencing usually involves multiple users in different locations using cameras on electronic devices such as computers, smart phones, tablet computers, etc. in conjunction with specific instant messaging applications to conduct simultaneous video connections and voice calls.

[0007] However, this method still requires the installation, execution or setting of specific communication software or the corresponding camera driver. In addition, most video software uses cameras connected to electronic devices and cannot use cameras on the network or a wireless camera. Therefore, it is generally necessary to install a virtual device or driver. This will be limited by the compatibility of software and hardware, and it will also require the use of specific camera devices.

[0008] Therefore, it is necessary to provide a video processing device that can wirelessly connect multiple photographic devices to achieve a more instant and easier way of sharing videos. Summary of the invention

[0009] In order to effectively solve the above-mentioned problems, the present invention proposes a wireless multi-channel video processing device for connecting to at least one wireless device and a receiving device, the wireless multi-channel video processing device comprising: a wireless communication unit for wirelessly connecting to the at least one wireless device to receive at least one video from the at least one wireless device; and an image processing unit, which transmits a connection request signal to the at least one wireless device through the wireless communication unit, so that the at least one wireless device returns a connection permission signal and the at least one video according to the connection request signal, and processes the at least one video to become a plurality of output videos, wherein the image processing unit processes the at least one video according to a selected video display mode, and wherein the wireless multi-channel video processing device provides a plurality of endpoints for the receiving device according to the number of the output videos to transmit the output videos to the receiving device.

[0010] Preferably, the wireless communication unit and the at least one wireless device are wirelessly connected using a WiFi protocol.

[0011] Preferably, the image processing unit includes a video processor, a neural network processor, a memory, and a storage unit, and the video processor and the neural network processor use a program stored in the storage unit to perform the processing, and the memory is used to store the at least one video and the output videos.

[0012] Preferably, the wireless multi-channel video processing device further includes: a USB control unit, receiving the output videos to report an endpoint information to the receiving device based on the output videos and providing the receiving device with the endpoints based on the number of the output videos; and a connection port unit, receiving the output videos from the USB control unit to transmit the output videos to the receiving device.

[0013] Preferably, the video display modes include picture-in-picture, side-by-side, cropped, overlapped, zoomed in and out, original

[0014] Preferably, the processing further includes a format processing to convert the format of the at least one received video into a format that complies with the USB video level, so that the connection port unit can transmit the output videos.

[0015] Preferably, the processing further includes a resolution processing to convert the resolution of the at least one received video into a resolution that matches the receiving device.

[0016] In order to make those skilled in the art understand the purpose, features and effects of the present invention, the present invention is described in detail as follows through the following specific embodiments and in conjunction with the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a schematic diagram of an existing wireless video transmission device;

[0018] Figure 2 A schematic diagram of a wireless multi-channel video processing device according to the present invention;

[0019] Figure 3 A block diagram of a wireless multi-channel video processing device according to an embodiment of the present invention.

[0020] Description of Figure Numbers:

[0021] 10: Wireless video transmission device

[0022] 11: Wireless Device

[0023] 12: Receiving device

[0024] 13: Display device

[0025] 100: Wireless multi-channel video processing device

[0026] 102: Wireless communication unit

[0027] 104: Image processing unit

[0028] 106:USB control unit

[0029] 108: Connection port unit

[0030] 1042: Video processor

[0031] 1044: Memory

[0032] 1046: Storage unit

[0033] 1048: Neural Network Processor

[0034] D,D1-D4: Video

[0035] D': Output video

[0036] EP: Endpoint Information

[0037] SA: Connection permission signal

[0038] SR: Connection request signal DETAILED DESCRIPTION

[0039] Please refer to Figure 2 , Figure 2A schematic diagram of a wireless multi-channel video processing device 100 according to the present invention. The wireless multi-channel video processing device 100 of the present invention can be wirelessly connected to multiple wireless devices 11 to receive videos D1 to D4 from the wireless devices 11. It is preferred to use a WiFi protocol for connection, but the present invention is not limited to this. The wireless device may include any device with a wireless connection function, including but not limited to a panoramic camera, a camera with a PTZ (Pan / Tilt / Zoom) function, a mobile phone and other devices with a photographic function. In addition, the wireless device itself may not have a photographic function, but may be connected to a processing or transmission device of a photographic device with a photographic function. For example, the wireless device can receive videos transmitted by multiple photographic devices with a photographic function, process the videos, and wirelessly transmit the processed videos to the wireless multi-channel video processing device 100 of the present invention.

[0040] Therefore, it is understandable that the videos D1 to D4 received by the wireless multi-channel video processing device 100 of the present invention may include but are not limited to any processed or unprocessed videos. For example, the processed videos may include videos processed by a wireless device with a video processing function. The processing includes but is not limited to picture-in-picture, picture-by-picture, picture cropping, picture overlap, picture zooming in and out, and the like. In addition, the processed videos may also have various resolutions, specifications, ratios, and the like. In addition, for example, the unprocessed videos may include but are not limited to videos with various resolutions, specifications, and ratios taken by various different photographic devices. It is understandable that the present invention does not limit the number of received videos, and the wireless multi-channel video processing device 100 may wirelessly receive one to multiple videos.

[0041] Please refer to Figure 3 , Figure 3A block diagram of a wireless multi-channel video processing device according to an embodiment of the present invention. In this embodiment, the wireless multi-channel video processing device 100 includes: a wireless communication unit 102, which is used to wirelessly connect to a wireless device 11 to receive a video D from the wireless device 11; an image processing unit 104, which transmits a connection request signal SR to the wireless device 11 through the wireless communication unit 102, so that the wireless device 11 returns a connection permission signal SA and the video D according to the connection request signal SR, and processes the video D to become an output video D'; a USB control unit 106, which receives the output video D', reports the endpoint information EP to the receiving device 12 according to the output video D', and provides a plurality of endpoints for the receiving device 12 according to the number of the output videos D'; and a connection port unit 108, which receives the output video D' from the USB control unit 106, and transmits the output video D' to the receiving device 12. Specifically, the wireless multi-channel video processing device 100 is connected to the receiving device 12 via the connection port unit 108, and the connection port unit 108 may support USB 2.0, USB 3.0, USB Type-C, a multi-cable connection port, or a customized connection port, but is not limited thereto.

[0042] Specifically, when the wireless multi-channel video processing device 100 is coupled to the wireless device 11 via the wireless communication unit 102, the wireless multi-channel video processing device 100 transmits a connection request signal SR to the wireless device 11 via the wireless communication unit 102, and the wireless device 11 identifies the wireless multi-channel video processing device 100 according to the connection request signal SR to return a connection permission signal SA and video D.

[0043] Specifically, the USB control unit 106 provides the receiving device 12 with a plurality of endpoints corresponding to the number of output videos D' according to the number of the output videos D', so as to transmit the output videos D' to the receiving device 12. For example, when the number of the output videos D' received by the USB control unit 106 is six output videos D', the USB control unit 106 provides the receiving device 12 with six endpoints so that the receiving device 12 can simultaneously receive the six output videos D', and so on.

[0044] It is understood that the image processing unit 104 processes the video D according to the selected video display mode to transmit the output video D' to the receiving device 12. It is understood that the image processing unit 104 may also not process the video D according to the selected video display mode, for example, process the video D before outputting it (or directly output the video D without processing it) as the output video D' to transmit to the receiving device 12.

[0045] In addition, the image processing unit 104 includes: a video processor 1042; a memory 1044; a storage unit 1046; and a neural network processor 1048, which uses an artificial intelligence engine to adaptively assist the image processing of the image processing unit 104. The video processor 1042 and the neural network processor 1048 use the program stored in the storage unit 1046 to execute the video display mode, and the memory 1044 is used to store the video D and output the video D'. Specifically, the memory 1044 and the storage unit 1046 may include any form of memory, including but not limited to RAM.

[0046] Please refer to Figure 2 , Figure 3 In the present embodiment, the wireless multi-channel video processing device 100 can be wirelessly connected to a plurality of wireless devices 11 to receive videos D1 to D4 from the wireless devices 11. Specifically, the image processing unit 104 of the wireless multi-channel video processing device 100 transmits a connection request signal SR to each wireless device 11 through the wireless communication unit 102, so that each wireless device 11 returns a connection permission signal SA and videos D1 to D4 according to the connection request signal SR, and processes the videos D1 to D4 with the image processing unit 104 to become the output video D'.

[0047] Specifically, the image processing unit 104 processes the videos D1 to D4 according to the selected video display mode. The video display mode includes but is not limited to picture-in-picture, side-by-side, cut-out, overlap, zoom in and out, original picture, etc. It is understandable that when the selected video display mode is the original picture, the image processing unit 104 may not process the video D to directly output the video D as the output video D'. In addition, the video display mode may also include processing the incoming video using a computer vision algorithm through the neural network processor 1048, such as edge detection, image segmentation, and feature extraction. Again, a person detection algorithm is used to identify and locate the person in the video, such as the face, body shape, or other target of interest of the participant. Again, a person detection algorithm is used to identify and locate the person in the picture or image. Again, once the person is identified, the artificial intelligence algorithm can use motion tracking technology to track the movement of the person over time. In addition, the image processing unit 104 may also process the videos D1 to D4 in different video display modes. For example, the video D1 is processed in the first video display mode, and the videos D2-D4 are processed in the second video display mode. However, the present invention is not limited thereto.

[0048] For example, assuming that video D1 is a video captured by a panoramic camera and the captured video includes five people, then according to the selected video display mode, the image processing unit 104 can identify the five people respectively, and output five cropped videos tracking the five people and the original panoramic video. Therefore, the image processing unit 104 will process the video D1 and output six output videos D'. Therefore, according to the selected video display mode, the image processing unit 104 can output multiple output videos D' in a multi-channel (Multi-Stream) manner. Or, for example, according to another selected video display mode, videos D1 to D4 can all be displayed as one video in a side-by-side mode, so the image processing unit 104 will output one output video D'.

[0049] Accordingly, the USB control unit 106 receives at least one output video D', and reports an endpoint information EP to the receiving device 12 according to the at least one output video D'. For example, assuming that the image processing unit 104 outputs six output videos D', the endpoint information EP reported by the USB control unit 106 is six endpoints, so that the receiving device 12 is prepared to transmit channels for six videos, and so on.

[0050] In addition, the processing further includes format processing and resolution processing. When the image processing unit 104 receives the video D and processes the video D to become the output video D', the image processing unit 104 will simultaneously convert the video D into a format that complies with the USB Video Class (UVC) so that the connection port unit 108 can transmit the output video D'. For example, if the format of the video D of the wireless device 11 is a non-UVC format, such as Real Time Streaming Protocol (RTSP) streaming, the image processing unit 104 will perform format processing to convert the format into the UVC format. For example, if the format of the video D of the wireless device 11 is the UVC format, the most common technology is the Motion Joint Photographic Experts Group (MJPEG) format, then the image processing unit 104 does not need to perform format processing. In addition, in other embodiments, the receiving device 12 and the display device 13 can be an integrated device with a display function, such as a mobile phone, a tablet, a laptop or any portable device.

[0051] Moreover, the processing further includes resolution processing. If the video D outputted from the wireless device 11 to the wireless multi-channel video processing device 100 has a first resolution (e.g., 1080p), and the resolution of the receiving device 12 is set to a second resolution (e.g., 720p), the image processing unit 104 performs resolution processing on the video D, such as scaling, to adjust the outputted output video D' to the second resolution. It should be noted that the second resolution can be greater than the first resolution depending on actual needs, for example, the second resolution is 4Kp, which is greater than the first resolution of 1080p.

[0052] Compared to the prior art, since the UVC driver is a generic driver that is preinstalled in most operating systems, the wireless multi-channel video processing device 100 and the wireless device 11 do not need to install, execute or set a specific driver to receive the connected video on the required receiving device 12, which can avoid the driver compatibility problem, reduce the difficulty of use and improve convenience. In actual use, users can use content from various devices and media devices to flexibly transmit through any wireless device, and the wireless multi-channel video processing device 100 will automatically adjust the resolution setting through video processing to match the resolution of the receiving device 12, and set the displayed video format as needed.

[0053] The present invention is not limited to the above-described embodiments, and it is obvious to those skilled in the art that various modifications and variations may be made to the present invention without departing from the spirit or scope of the present invention.

[0054] Thus, it is intended that the present invention covers the modifications and variations of the present invention provided they come within the scope of the appended claims and their equivalents.

Claims

1. A wireless multi-channel video processing device, used to connect to at least one wireless device and a receiving device, the wireless multi-channel video processing device comprising: A wireless communication unit, configured to establish a wireless connection with the at least one wireless device to receive at least one video from the at least one wireless device; as well as an image processing unit, which transmits a connection request signal to the at least one wireless device through the wireless communication unit, so that the at least one wireless device returns a connection permission signal and the at least one video according to the connection request signal, and processes the at least one video to generate at least one output video, The image processing unit processes at least one video according to the selected video display mode, and The wireless multi-channel video processing device provides a plurality of endpoints for the receiving device according to the quantity of the at least one output video, so as to transmit the at least one output video to the receiving device.

2. The wireless multi-channel video processing device according to claim 1, wherein: The wireless communication unit and the at least one wireless device are wirelessly connected using the WiFi protocol.

3. The wireless multi-channel video processing device according to claim 1, in, The image processing unit includes a video processor, a neural network processor, a memory, and a storage unit, and The video processor and the neural network processor use the program stored in the storage unit to perform the processing, and the memory is used to store the at least one video and the at least one output video.

4. The wireless multi-channel video processing device according to claim 1, further comprising: A USB control unit receives the at least one output video, reports an endpoint information to the receiving device according to the at least one output video, and provides the receiving device with the plurality of endpoints according to the number of the at least one output video; as well as The connection port unit receives the at least one output video from the USB control unit to transmit the at least one output video to the receiving device.

5. The wireless multi-channel video processing device according to claim 1, wherein: The video display modes include picture-in-picture, side-by-side pictures, picture cropping, picture overlapping, picture zooming in and out, and original picture.

6. The wireless multi-channel video processing device according to claim 4, wherein: The processing further includes format processing to convert the format of the received at least one video into a format that complies with USB video level so that the connection port unit can transmit the at least one output video.

7. The wireless multi-channel video processing device according to claim 1, wherein: The processing further includes resolution processing to convert the resolution of the at least one received video into a resolution that matches the resolution of the receiving device.

Images