Wireless multipath bidirectional video processing system

Abstract

The invention provides a wireless multi-channel bidirectional video processing system, which comprises a video input / output device for receiving at least one photographic video from at least one photographic device and carrying out first processing on the at least one photographic video to form video information; the video processing device is wirelessly connected with the video input and output device and is used for receiving the video information, carrying out second processing on the video information to form a plurality of output videos and transmitting the output videos to a host device, the host device outputs at least one display video to the video processing device, and the video processing device is used for receiving the video information and carrying out second processing on the video information to form the plurality of output videos. The wireless multi-channel bidirectional video processing system processes the at least one display video to form a device video, and displays the device video on a display device connected to the wireless multi-channel bidirectional video processing system.

Description

Technical Field

[0001] The present invention relates to a wireless multi-channel two-way video processing system, and more particularly to a multi-channel two-way video processing system for two-way transmission of information. Background Art

[0002] In video conferencing, using a wireless connection allows users to set up and adjust the position of the camera device more conveniently and freely.

[0003] In addition, in video conferencing, it is usually necessary to simultaneously display videos from multiple camera devices or simply process the videos of the camera devices for the conference. In addition, after processing, it is also necessary to directly and conveniently play the videos.

[0004] Therefore, a method that can efficiently process videos of multiple camera devices and transmit information bidirectionally needs to be proposed.

[0005] In addition, after a computer receives videos from multiple camera devices, there is often a need to display the images on a large screen or a TV, and using a wireless connection allows users to set up and adjust the position of the computer more conveniently and freely.

[0006] Therefore, a multi-channel two-way video processing system is needed, which has the two-way video processing functions of receiving videos from multiple camera devices and displaying the images processed by the computer on a display device (for example, a display device with a large screen). Summary of the Invention

[0007] To effectively solve the above problems, the present invention proposes a wireless multi-channel two-way video processing system, including: a video input / output device that receives at least one camera video from at least one camera device and performs a first process on the at least one camera video to become video information; and a video processing device wirelessly connected to the video input / output device to receive the video information, perform a second process on the video information to become multiple output videos, and transmit the output videos to a host device, wherein the host device outputs at least one display video to the video processing device, and wherein the wireless multi-channel two-way video processing system processes the at least one display video to become a device video and displays the device video on a display device connected to the wireless multi-channel two-way video processing system.

[0008] Preferably, the video processing device provides multiple endpoints for the host device according to the number of the output videos and the at least one display video to transmit the output videos to the host device and receive the at least one display video from the host device, and wherein the host device generates the at least one display video through the output videos.

[0009] Preferably, the video processing device includes: a wireless communication unit for wirelessly receiving the video information from the video input / output device and transmitting a display information to the video input / output device; an image processing unit for performing the second processing on the video information to become the output videos; a USB control unit for receiving the output videos to report an endpoint information to the host device according to the output videos, and receiving the at least one display video to provide the endpoints for the host device according to the number of the output videos and the at least one display video; and a port unit for receiving the output videos from the USB control unit to transmit the output videos to the host device, and receiving the at least one display video from the host device to transmit the at least one display video to the USB control unit; and a mode control unit for adjusting the at least one display video received from the host device to become the display information.

[0010] Preferably, the image processing unit of the video processing device includes a video processor, a neural network processor, a memory, and a storage unit, and wherein, the video processor and the neural network processor execute processing using a program stored in the storage unit, and the memory is used for storing the at least one captured video and the output videos.

[0011] Preferably, the mode control unit includes: a video conversion unit for adjusting the at least one display video, wherein, the mode control unit receives the at least one display video from the USB control unit, and wherein, the adjustment includes adjusting the format of the at least one display video and compressing the at least one display video with the adjusted format into the at least one display information for wireless transmission.

[0012] Preferably, before the mode control unit adjusts the at least one display video, the image processing unit performs a third processing on the at least one display video, wherein, the third processing on the at least one display video includes at least one video display mode, the image processing unit performs the third processing on the at least one display video according to the selected video display mode, and wherein, the video display mode includes picture-in-picture, side-by-side pictures, picture cropping, picture overlapping, picture zooming, and original picture.

[0013] Preferably, the display device is connected to the video processing device. Wherein, the third processing further includes making the at least one display video become the device video. And wherein, the video processing device further includes: a video input controller for controlling a video received from another host device; a video output controller for controlling the device video output to the display device; a video input port for receiving the video from the another host device to transmit the video to the video input controller; and a video output port for receiving the device video from the image processing unit to transmit the device video to the display device.

[0014] Preferably, the second processing includes at least one video display mode, and the image processing unit processes the at least one video according to the selected video display mode. And wherein, the video display modes include picture-in-picture, side-by-side pictures, picture cropping, picture overlapping, picture zooming, and original picture.

[0015] Preferably, the second processing further includes: a format processing for converting the format of the received at least one video into a format conforming to the USB video level to enable the port unit to transmit the output videos; and a resolution processing for converting the resolution of the received at least one video into a resolution conforming to that of the host device.

[0016] Preferably, the display device is connected to the video input / output device. And the video input / output device includes: a wireless communication unit for wirelessly transmitting the video information to the video processing device and receiving the display information from the video processing device; an image processing unit for performing the first processing on the at least one captured video to become the video information, and performing a fourth processing on the display information to become the device video; a video input controller for controlling the at least one captured video received; a video output controller for controlling the device video output to the display device; a video input port for receiving the at least one captured video from the at least one imaging device to transmit the at least one captured video to the video input controller; and a video output port for receiving the device video from the video output controller to transmit the device video to the display device.

[0017] Preferably, the image processing unit of the video input / output device includes a video processor, a neural network processor, a memory, and a storage unit. And wherein, the video processor and the neural network processor execute processing using programs stored in the storage unit, and the memory is used for storing the at least one captured video and the device videos.

[0018] Preferably, the first process and the fourth process include at least one video display mode, and the image processing unit performs the first process and the fourth process according to the selected video display mode. Among them, the video display modes include picture-in-picture, side-by-side pictures, picture cropping, picture overlapping, picture zooming, and the original picture.

[0019] To enable those skilled in the art to understand the purpose, features, and effects of the present invention, the present invention will be described in detail below through the following specific embodiments in conjunction with the accompanying drawings. Description of the Drawings

[0020] Figure 1 It is a schematic diagram of an existing wireless video transmission system;

[0021] Figure 2 It is a schematic diagram of a wireless multi-channel bidirectional video processing system according to the present invention;

[0022] Figure 3 It is another schematic diagram of a wireless multi-channel bidirectional video processing system according to the present invention;

[0023] Figure 4 It is a block diagram of a wireless multi-channel bidirectional video processing system according to the first embodiment of the present invention;

[0024] Figure 5 It is a block diagram of a wireless multi-channel bidirectional video processing system according to the second embodiment of the present invention;

[0025] Figure 6 It is a block diagram of a wireless multi-channel bidirectional video processing system according to the first embodiment of the present invention for transmitting signals from the photography end to the host device end; and

[0026] Figure 7 It is a block diagram of a wireless multi-channel bidirectional video processing system according to the first embodiment of the present invention for transmitting signals from the host device end to the display end.

[0027] Explanation of the Reference Numerals in the Drawings:

[0028] 1: Wireless multi-channel bidirectional video processing system

[0029] 10: Wireless video transmission device

[0030] 11, 11a - 11c: Wireless devices

[0031] 12: Host device

[0032] 13, 14b, 15: Display devices

[0033] 14a: Photography device

[0034] 100: Video processing device

[0035] 102: Wireless communication unit

[0036] 104: Image processing unit

[0037] 106: USB control unit

[0038] 108: Port unit

[0039] 110: Mode control unit

[0040] 200: Video input / output device

[0041] 202: Wireless communication unit

[0042] 204: Image processing unit

[0043] 206: Video input controller

[0044] 208: Video output controller

[0045] 210: Video input port

[0046] 212: Video output port

[0047] 1042: Video processor

[0048] 1044: Memory

[0049] 1046: Storage unit

[0050] 1048: Neural network processor

[0051] 1102: Video conversion unit

[0052] 2042: Video processor

[0053] 2044: Memory

[0054] 2046: Storage unit

[0055] 2048: Neural network processor

[0056] D: Video information

[0057] D’: Output video

[0058] DI: Display information

[0059] DV: Device video

[0060] VI, VI’: Display video

[0061] EP: Endpoint information Detailed implementation manners

[0062] Please refer to Figure 1 , Figure 1 which is a schematic diagram of an existing wireless video transmission device. The existing audio and video transmission system includes a wireless video transmission device 10, a wireless device 11, a host device 12, and a display device 13. The wireless device 11 is a wireless device for transmitting video information. In addition to the wireless device 11, the source of the video information can also be other sources on the network according to actual needs, such as a video player, etc. That is to say, the wireless device 11 can be a network camera device or a camera device with a wireless communication unit. If the camera device is a network camera device, the wireless video transmission device 10 is connected to it through the wireless communication unit by connecting to the Internet, which is different from Figure 1 the wireless device 11 with a wireless communication unit in which can be directly connected in the way of wifi.

[0063] Please refer to Figure 2 , Figure 2Schematic diagram of the wireless multi-channel two-way video processing system 1 according to the present invention. The wireless multi-channel two-way video processing system 1 of the present invention includes: a video processing device 100 and a video input / output device 200. In the first direction of transmitting signals from the photography end to the host device end, the video input / output device 200 receives the photographed video from the photography device 14a and performs a first process on the photographed video to become video information D. The video processing device 100 is wirelessly connected to the video input / output device 200 to receive the video information D, performs a second process on the video information D to become an output video D', and transmits the output video D' to the host device 12. In addition, in the second direction of transmitting signals from the host device end to the display end, the host device 12 outputs a display video to the video processing device 100. Then, the video processing device 100 performs a third process on the display video to become display information DI and transmits it to the video input / output device 200. Finally, the video input / output device 200 performs a fourth process on the display information DI to become a device video and displays the device video on the display device 14b connected to the video input / output device. Preferably, the WiFi protocol is used for connection, but the present invention is not limited thereto. Specifically, the photography device 14a can be any device with a photography function, which can be connected to the video input / output device 200 wirelessly or wiredly. The photography device 14a includes but is not limited to a panoramic camera, a camera with functions of turning left and right / tilting up and down / zooming (PTZ, Pan / Tilt / Zoom), a mobile phone, and other devices with a photography function. In addition, multiple photography devices 14a of different types can be connected to the video input / output device 200 to receive different videos from these photography devices 14a. Specifically, the display device 14b includes but is not limited to a smart TV, a smart projector, a mobile phone, a tablet, etc. In addition, multiple display devices 14b of different types can be connected to the video input / output device 200 to play the device video on these display devices 14b simultaneously.

[0064] It can be understood that in the wireless multi-channel two-way video processing system 1 of the present invention, in addition to the video processing device 100, the video input / output device 200 can also be wirelessly connected to multiple wireless devices 11a to 11c to wirelessly receive videos from these wireless devices 11a to 11c. Alternatively, the video processing device 100 can also be wirelessly connected to multiple wireless devices 11a to 11c to wirelessly receive videos from these wireless devices 11a to 11c.

[0065] It is understandable that the video information received by the wireless multi-channel bidirectional video processing system 1 of the present invention may include, but is not limited to, any processed or unprocessed video. For example, the processed video may include the video processed by a wireless device with video processing functions. Such processing includes, but is not limited to, picture-in-picture, picture-by-picture, picture cropping, picture overlapping, picture zooming in and out, etc. In addition, the processed video may also have various different resolutions, specifications, ratios, etc. Further, for example, the unprocessed video may include, but is not limited to, videos with various different resolutions, specifications, and ratios captured by various different photographic devices. It is understandable that the present invention also does not limit the number of videos received, and the wireless multi-channel bidirectional video processing system 1 may receive one or more videos.

[0066] In addition, the wireless multi-channel bidirectional video processing system 1 of the present invention has a function of bidirectional transmission, that is, information can be transmitted from the wireless devices 11a, 11b, 11c and the photographic device 14a to the host device 12 and information can be transmitted from the host device 12 to the display device 14b.

[0067] Figure 3 Another schematic diagram of the wireless multi-channel bidirectional video processing system according to the present invention. In Figure 2 the video processing device 100 is a connector (dongle) directly connected to the host device 12, but the present invention is not limited thereto. As Figure 3 shown, the video processing device 100 may also be a device box with other ports. For example, the video processing device 100 may include an output port connected to the display device 15. Further, in other embodiments, the video processing device 100 may include an input port connected to another host device.

[0068] Figure 4 A block diagram of the wireless multi-channel bidirectional video processing system 1 according to the first embodiment of the present invention. Please refer to Figure 2 、 Figure 4 In the first embodiment of this case, the wireless multi-channel bidirectional video processing system 1 includes: a video processing device 100 and a video input / output device 200.

[0069] Specifically, the video processing device 100 includes: a wireless communication unit 102 for making a wireless connection to receive video information and transmit display information to the video input / output device 200. The dashed line in the figure represents the wireless connection between the wireless communication unit 102 of the video processing device 100 and the wireless communication unit 202 of the video input / output device 200; an image processing unit 104 for processing the video information D to become the output video D'; a USB control unit 106 for receiving the output video D' and providing multiple endpoints for the host device 12 according to the output video D' and the number of display videos received from the host device; a port unit 108 for receiving the output video D' from the USB control unit 106 to transmit the output video D' to the host device 12; and a mode control unit 110 for receiving the display video from the host device 12 and converting the display video into display information DI. Specifically, the video processing device 100 is connected to the host device 12 through the port unit 108, and the supported formats of the port unit 108 can be USB 2.0, USB3.0, USB Type-C, a multi-flat cable port, or a customized port, but are not limited thereto.

[0070] In addition, the image processing unit 104 includes: a video processor 1042; a memory 1044; a storage unit 1046; and a neural network processor 1048 that uses an artificial intelligence engine to adaptively assist the image processing of the image processing unit 104. The video processor 1042 and the neural network processor 1048 execute the video display mode using the program stored in the storage unit 1046, and the memory 1044 is used to store the video information D and the output video. Specifically, the memory 1044 and the storage unit 1046 can include any form of memory, including but not limited to RAM.

[0071] In addition, the mode control unit 110 includes: a video conversion unit 1102 for converting and compressing the display video.

[0072] Specifically, the video input / output device 200 includes: a wireless communication unit 202 for making a wireless connection to transmit the video information D to the video processing device 100 and receive the video information and the display information DI; an image processing unit 204 for performing a first processing on the photographed video and a fourth processing on the display information DI; a video input controller 206 for controlling the received photographed video; a video output controller 208 for controlling the device video output to the display device 14b in a wireless or wired manner; a video input port 210 for receiving the photographed video from the photographing device 14a to transmit it to the video input controller 206; and a video output port 212 for receiving the device video from the video output controller 208 to output it to the display device 14b.

[0073] In addition, the image processing unit 204 includes: a video processor 2042; a memory 2044; a storage unit 2046; and a neural network processor 2048, which uses an artificial intelligence engine to adaptively assist the image processing of the image processing unit 204. The video processor 2042 and the neural network processor 2048 perform image processing using programs stored in the storage unit 2046, and the memory 2044 is used to store the photographed video and the device video. Specifically, the memory 2044 and the storage unit 2046 may include any form of memory, including but not limited to RAM.

[0074] Figure 5 FIG. is a block diagram of the wireless multi-channel two-way video processing system 1 according to the second embodiment of the present invention. Please refer to Figure 3 、 Figure 5 In this regard, the second embodiment of the present case is different from the first embodiment in that the video processing device 100 further includes: a video input controller 112 for controlling the received photographed video; a video input port 114 for receiving video from another host device and transmitting it to the video input controller 112; a video output controller 116 for controlling the device video output to the display device 15; and a video output port 118 for receiving the device video from the video output controller 116 and outputting it to the display device 15.

[0075] It can be understood that in the second embodiment of the present case, the video processing device 100 can receive video from multiple host devices and can be connected to the display device 15 to output the device video from the display device 15.

[0076] will be further described below with reference to Figure 6 、 Figure 7 the two-way transmission of the present invention. It can be understood that the wireless multi-channel two-way video processing system 1 of the present invention can be used for two-way signal transmission. The first direction is the direction of the photographing end transmitting signals to the host device end, and the second direction is the direction of the host device end transmitting signals to the display end.

[0077] Figure 6 FIG. is a block diagram of the wireless multi-channel two-way video processing system 1 according to the first embodiment of the present invention for transmitting signals from the photographing end to the host device end. Please refer to Figure 6, when the wireless multi-channel bidirectional video processing system 1 transmits signals from the photography end to the host device end, the following components of the wireless multi-channel bidirectional video processing system 1 will perform corresponding functions: The video input port 210 receives the photographed video V from the photographing device 14a to transmit it to the video input controller 206; the video input controller 206 is used to control the received photographed video V and transmit it to the image processing unit 204; the image processing unit 204 performs a first processing on the photographed video V to become video information D and transmits it to the wireless communication unit 202; the wireless communication unit 202 wirelessly transmits the video information D to the wireless communication unit 102; the wireless communication unit 102 receives the video information D from the wireless communication unit 202; the image processing unit 104 performs a second processing on the video information D to become the output video D'; the USB control unit 106 receives the output video D' to report endpoint information EP to the host device 12 according to the output video D', and provides multiple endpoints for the host device 12 according to the quantity of the output video D'; and the port unit 108 receives the output video D' and the endpoint information EP from the USB control unit 106 to transmit the output video D' and the endpoint information EP to the host device 12.

[0078] The first processing will be described in detail below.

[0079] Specifically, the first processing of the image processing unit 204 includes performing a first processing on the photographed video V according to the selected video display mode. The video display mode includes but is not limited to picture-in-picture, side-by-side pictures, picture cropping, picture overlapping, picture zooming, original picture, etc. Understandably, when the selected video display mode is the original picture, the image processing unit 204 may not process the photographed video V and directly output the photographed video V as the video information D. In addition, the video display mode may also include processing the incoming video using computer vision algorithms through the neural network processor 2048, such as edge detection, image segmentation, and feature extraction. Also, a person detection algorithm is used to identify and locate the people in the video, for example, the faces of the participants, the human body shape, or other targets of interest. Also, a person detection algorithm is used to identify and locate the people in the picture or image. Also, once a person is identified, the artificial intelligence algorithm can use motion tracking technology to track the movement of the person over time. In addition, the image processing unit 204 may also process multiple photographed videos in different video display modes. For example, process the first photographed video in the first video display mode and process the second photographed video in the second video display mode. However, the present invention is not limited thereto. Also, the first processing of the image processing unit 204 further includes compression processing. That is, the image processing unit 204 compresses the photographed video V into the video information D for easy wireless transmission.

[0080] The second processing will be described in detail below.

[0081] Specifically, the second processing of the image processing unit 104 includes a video display mode. The image processing unit 104 performs second processing on the video information D according to the selected video display mode to transmit the output video D' to the host device 12. Specifically, the image processing unit 104 processes the video information D according to the selected video display mode. The video display mode includes but is not limited to picture-in-picture, side-by-side display, picture cropping, picture overlapping, picture zooming, and the original picture. Understandably, when the selected video display mode is the original picture, the image processing unit 104 may not process the video information D and directly output the video information D as the output video D'. In addition, the video display mode may also include using a computer vision algorithm by the neural network processor 1048 to process the incoming video, such as edge detection, image segmentation, and feature extraction. Also, a person detection algorithm is used to identify and locate people in the video, for example, the faces, body shapes, or other targets of interest of the participants. Also, a person detection algorithm is used to identify and locate people in the picture or image. Also, once a person is identified, the artificial intelligence algorithm can use motion tracking technology to track the movement of the person over time. In addition, the image processing unit 104 can also process multiple video information in different video display modes. For example, the first video information is processed in the first video display mode, and the second video information is processed in the second video display mode. However, the present invention is not limited thereto.

[0082] For example, assume that the video information D is a video captured by a panoramic camera and the captured video includes five people. Then, according to the selected video display mode, the image processing unit 104 can identify the five people respectively and output five cropped videos tracking the five people and the original panoramic video. Therefore, the image processing unit 104 will output six output videos D' after processing the video information D. Therefore, according to the selected video display mode, the image processing unit 104 can output multiple output videos D' in a multi-stream manner. Or, for example, according to another selected video display mode, multiple video information can all be displayed in a side-by-side display mode as one video. Therefore, the image processing unit 104 will output one output video D'.

[0083] Accordingly, the USB control unit 106 receives at least one output video D' and reports an endpoint information EP to the host device 12 according to at least one output video D'. For example, assume that the image processing unit 104 outputs six output videos D'. Then, the endpoint information EP reported by the USB control unit 106 is six endpoints, so that the host device 12 prepares channels for transmitting six videos, and so on.

[0084] In addition, the second processing further includes format processing and resolution processing. When the image processing unit 104 receives the video information D and performs the second processing on the video information D to become the output video D', the image processing unit 104 will simultaneously convert the video information D into a format compliant with the USB Video Class (UVC) so that the port unit 108 can transmit the output video D'. For example, if the format of the video information D is a non-UVC format, such as a Real Time Streaming Protocol (RTSP) stream, the image processing unit 104 will perform format processing to convert the format to the UVC format. Also, for example, if the format of the video information D is the UVC format, and the most common technology is the Motion Joint Photographic Experts Group (MJPEG) format, the image processing unit 104 does not need to perform format processing. Additionally, in other embodiments, the host device 12 and the display device 13 can be an integrated device with a display function, such as a mobile phone, a tablet, a laptop computer, or any portable device.

[0085] Also, the second processing further includes resolution processing. If the video information D has a first resolution (e.g., 1080p), and the resolution of the host device 12 is set to a second resolution (e.g., 720p). The image processing unit 104 will perform resolution processing on the video information D, such as scaling, to adjust the output video D' to the second resolution. It should be noted that the second resolution can be greater than the first resolution according to actual needs. For example, the second resolution is 4Kp, which is greater than the first resolution of 1080p.

[0086] Compared with the prior art, since the UVC driver is a native driver preinstalled in most operating systems, both the video processing device 100 and the video input / output device 200 do not need to install, execute, or set a specific driver separately to receive the connected video on the required host device 12, which can avoid driver compatibility problems, reduce the usage difficulty, and improve convenience at the same time. In actual use, users can use the content from various different devices and media devices and flexibly transmit it through any wireless device. Moreover, the video processing device 100 will automatically adjust the resolution setting through video processing to conform to the resolution of the host device 12 and set the display video format as needed.

[0087] Figure 7 It is a block diagram of the wireless multi-channel bidirectional video processing system according to the first embodiment of the present invention for transmitting signals from the host device end to the display end. Please refer to Figure 7, when the host device transmits a signal to the display end, the following components of the wireless multi-channel bidirectional video processing system 1 will perform corresponding functions: The port unit 108 receives the display video VI from the host device 12 to transmit the display video VI to the USB control unit 106; The USB control unit 106 receives the display video VI from the port unit 108 to transmit the display video VI to the mode control unit 110 or the image processing unit 104, and provides endpoints for the host device 12 according to the number of the output video D' and the display video VI; The image processing unit 104 performs a third process on the display video VI to become the display video VI'; The mode control unit 110 adjusts the display video VI or the display video VI' to become the display information DI, and transmits the display information DI to the wireless communication unit 202 through the wireless communication unit 102; The wireless communication unit 202 receives the display information DI from the wireless communication unit 102 and transmits it to the image processing unit 204; The image processing unit 204 performs a fourth process on the display information DI to become the device video DV, and transmits it to the video output controller 208; The video output controller 208 is used to control the output of the device video DV and transmits the device video DV to the display device 14b connected to the video output port 212.

[0088] It is understandable that the display video VI is any video set by the user. For example, the user generates the display video VI using the received output video D' in the host device 12.

[0089] Here, the method by which the USB control unit 106 provides endpoints will be specifically described. The USB control unit 106 provides endpoints for the host device 12 according to the number of the output video D' and the display video VI. For example, when the number of the output video D' received by the USB control unit 106 is N output videos D' (N is any positive integer) and the host device 12 does not output the display video VI, the USB control unit 106 provides N endpoints for the host device 12 so that the host device 12 can receive N output videos D' simultaneously. When the USB control unit 106 does not receive the output video D' and the host device 12 outputs M display videos VI (M is any positive integer), the USB control unit 106 provides M endpoints for the host device 12 so that the host device 12 can transmit M display videos VI simultaneously. When the number of the output video D' received by the USB control unit 106 is N output videos D' and the host device 12 outputs M display videos VI, the USB control unit 106 provides N + M endpoints for the host device 12 so that the host device 12 can receive N output videos D' and transmit M display videos VI simultaneously.

[0090] The following will detail the third process.

[0091] Specifically, the third process of the image processing unit 104 includes a video display mode. The image processing unit 104 performs a third process on the display video VI according to the selected video display mode to transmit the display video VI to the mode control unit 110. Specifically, the image processing unit 104 processes the display video VI according to the selected video display mode. The video display mode includes but is not limited to picture-in-picture, side-by-side display, picture cropping, picture overlay, picture zooming in and out, etc. In addition, the video display mode may also include processing the incoming video using computer vision algorithms through the neural network processor 1048, such as edge detection, image segmentation, and feature extraction. Also, a person detection algorithm is used to identify and locate the people in the video, for example, the faces of the participants, the human body shape, or other targets of interest. Also, a person detection algorithm is used to identify and locate the people in the picture or image. Also, once a person is identified, the artificial intelligence algorithm can use motion tracking technology to track the movement of the person over time. In addition, the image processing unit 104 can also process multiple video information in different video display modes. For example, the image processing unit 104 adds the cropped video of the person temporarily stored to at least one display video VI and transmits the processed at least one display video to the mode control unit 110. Also, for example, the first display video is processed in the first video display mode, and the second display video is processed in the second video display mode. However, the present invention is not limited thereto.

[0092] It can be understood that in the second embodiment, the image processing unit 104 can directly generate the device video DV based on the display video VI and output the device video DV to the video output controller 116 to output the device video DV to the display device 15 through the video output port 118. That is, in the second embodiment, the wireless multi-way bidirectional video processing system 1 can play the device video DV through at least one of the display device 15 or the display device 14b according to the user's setting.

[0093] The adjustment of the display video VI or the display video VI' by the mode control unit 110 will be described in detail below.

[0094] Specifically, the video conversion unit 1102 in the mode control unit 110 adjusts the display videos VI and VI' according to the format reply signal to become the display information DI. Then, the mode control unit 110 transmits the display information DI to the wireless communication unit 202 of the video input / output device 200 through the wireless communication unit 102. The format reply signal may include but is not limited to the display format information, compression format information, transmission format information, etc. of the display device 14b.

[0095] Accordingly, the adjustment includes adjusting the formats of the display videos VI and VI' to the format of the target display device and compressing the adjusted display video VI into the at least one display information DI for wireless transmission.

[0096] The fourth process will be described in detail below.

[0097] Specifically, the first process of the image processing unit 204 includes performing a first process on the display information DI according to the selected video display mode. The video display mode includes but is not limited to picture-in-picture, side-by-side pictures, picture cropping, picture overlapping, picture zooming, original picture, etc. Understandably, when the selected video display mode is the original picture, the image processing unit 204 may not process the display information DI and directly output the display information DI as the device video DV. In addition, the video display mode may also include processing the incoming video using computer vision algorithms through the neural network processor 2048, such as edge detection, image segmentation, and feature extraction. Also, a person detection algorithm is used to identify and locate the people in the video, for example, the faces of the participants, the human body shape, or other targets of interest. Also, a person detection algorithm is used to identify and locate the people in the picture or image. Also, once a person is identified, the artificial intelligence algorithm can use motion tracking technology to track the movement of the person over time. In addition, the image processing unit 204 can also process multiple captured videos in different video display modes. For example, process the first display information in the first video display mode and process the second display information in the second video display mode. However, the present invention is not limited to this. Also, the first process of the image processing unit 204 further includes a decompression process. That is, the image processing unit 204 decompresses the display information DI into the device video DV for wireless transmission.

[0098] Accordingly, the video processing device of the present invention has the function of two-way signal transmission. Through endpoint setting, it can more conveniently transmit the video from the host device to the display device with the function of playing display information while receiving the videos of multiple wireless devices.

[0099] The present invention is not limited to the above embodiments. It is obvious to those skilled in the art of this technology that various modifications and changes can be made to the present invention without departing from the spirit or scope of the present invention.

[0100] Therefore, the present invention aims to cover the modifications and changes made to the present invention or falling within the scope of the appended claims and their equivalent scopes.

Claims

1. A wireless multi-channel bidirectional video processing system, comprising: The video input and output device receives at least one photographic video from at least one photographic device and performs a first process on the at least one photographic video to generate video information; as well as a video processing device wirelessly connected to the video input and output device to receive the video information, perform a second processing on the video information to generate a plurality of output videos, and transmit the plurality of output videos to a host device, The host device outputs at least one display video to the video processing device, and The wireless multi-channel two-way video processing system processes the at least one display video to become a device video, and displays the device video on a display device connected to the wireless multi-channel two-way video processing system.

2. The wireless multi-channel bidirectional video processing system according to claim 1, wherein: The video processing device provides a plurality of endpoints for the host device according to the number of the plurality of output videos and the at least one display video, so as to transmit the plurality of output videos to the host device and receive the at least one display video from the host device, and The host device generates the at least one display video through the multiple output videos.

3. The wireless multi-channel bidirectional video processing system according to claim 1, wherein: The video processing device comprises: a wireless communication unit for wirelessly receiving the video information from the video input and output device and transmitting display information to the video input and output device; An image processing unit, performing the second processing on the video information to generate the plurality of output videos; A USB control unit receives the plurality of output videos to report endpoint information to the host device according to the plurality of output videos, and receives the at least one display video to provide the plurality of endpoints to the host device according to the number of the plurality of output videos and the at least one display video; and a port unit receiving the plurality of output videos from the USB control unit to transmit the plurality of output videos to the host device, and receiving the at least one display video from the host device to transmit the at least one display video to the USB control unit; and The mode control unit adjusts the at least one display video received from the host device to become the display information.

4. The wireless multi-channel bidirectional video processing system according to claim 3, in, The image processing unit of the video processing device includes a video processor, a neural network processor, a memory, and a storage unit, and The video processor and the neural network processor perform processing using a program stored in the storage unit, and the memory is used to store the at least one photographic video and the multiple output videos.

5. The wireless multi-channel bidirectional video processing system according to claim 4, wherein: The mode control unit comprises: A video conversion unit, configured to adjust the at least one display video, The mode control unit receives the at least one display video from the USB control unit, and The adjustment includes adjusting the format of the at least one display video and compressing the at least one display video after the adjustment into the at least one display information for the convenience of wireless transmission.

6. The wireless multi-channel bidirectional video processing system according to claim 5, wherein: Before the mode control unit adjusts the at least one display video, the image processing unit of the video processing device performs a third process on the at least one display video. The third processing of the at least one display video includes at least one video display mode, and the image processing unit of the video processing device performs the third processing on the at least one display video according to the selected video display mode, and The video display modes include picture-in-picture, side-by-side, cropped, overlapped, zoomed in and out, and original.

7. The wireless multi-channel bidirectional video processing system according to claim 6, in, The display device is connected to the video processing apparatus, The third process further includes making the at least one display video become the device video, and Wherein, the video processing device further comprises: A video input controller for controlling video received from another host device; a video output controller for controlling the device video output to the display device; a video input port receiving the video from the other host device to transmit the video to the video input controller; and A video output port receives the device video from the image processing unit to transmit the device video to the display device.

8. The wireless multi-channel bidirectional video processing system according to claim 1, in, The second processing includes at least one video display mode, and the image processing unit of the video processing device processes at least one video according to the selected video display mode, and The video display modes include picture-in-picture, side-by-side, cropped, overlapped, zoomed in and out, and original.

9. The wireless multi-channel bidirectional video processing system according to claim 8, wherein: The second process further comprises: format processing, for converting the format of the at least one received video into a format that complies with the USB video level, so that the port unit can transmit the plurality of output videos; and Resolution processing is used to convert the resolution of the at least one received video into a resolution that matches the resolution of the host device.

10. The wireless multi-channel bidirectional video processing system according to claim 1, wherein: The display device is connected to the video input and output device, and Wherein, the video input and output device includes: a wireless communication unit for wirelessly transmitting the video information to the video processing device and receiving the display information from the video processing device; An image processing unit, performing the first processing on the at least one photographic video to obtain the video information, and performing a fourth processing on the display information to obtain the device video; A video input controller, used to control the at least one photographic video received; a video output controller for controlling the device video output to the display device; a video input port for receiving the at least one photographic video from the at least one photographic device to transmit the at least one photographic video to the video input controller; and The video output port receives the device video from the video output controller to transmit the device video to the display apparatus.

11. The wireless multi-channel bidirectional video processing system according to claim 10, wherein: The image processing unit of the video input and output device includes a video processor, a neural network processor, a memory, and a storage unit, and The video processor and the neural network processor perform processing using a program stored in the storage unit, and the memory is used to store the at least one photographic video and the multiple device videos.

12. The wireless multi-channel bidirectional video processing system according to claim 10, in, The first process and the fourth process include at least one video display mode, and the image processing unit of the video input and output device performs the first process and the fourth process according to the selected video display mode, and The video display modes include picture-in-picture, side-by-side, cropped, overlapped, zoomed in and out, and original.

Images