General return control system and method for image acquisition equipment and related equipment

Abstract

The invention provides a general return control system and method for image acquisition equipment and related equipment, and the general return control system comprises a first connection module which is used for carrying out data transmission with the image acquisition equipment; the decoding module is used for decoding the image data sent by the image acquisition equipment to obtain decoded image data; the analysis module is used for analyzing parameter information of the image acquisition equipment; the second connection module is used for sending the decoded image data and the parameter information to the display device and receiving a control signal sent by the display device. Compared with the prior art, the universal return control system provided by the invention has the advantages that the return control function of the image acquisition equipment can be realized under the condition that other equipment does not need to be additionally mounted, and the cost is lower; the image acquisition device can support transmission of various image data formats, has different types of interfaces to be connected with the display device, and realizes a universal return control function of the image acquisition device while the resolution of the image data is not reduced.

Description

Technical Field

[0001] The present invention is applicable to the field of image transmission technology, and particularly relates to a general feedback control system, method and related devices for an image acquisition device. Background Art

[0002] With the development of information technology, industries such as video conferencing and live streaming have gradually emerged, and feedback control technology is often required during video conferencing or live streaming to achieve

[0003] However, when the existing image acquisition device and display device are wirelessly connected for feedback control, they are expensive and have distance limitations. Moreover, if the image data transmitted by the image acquisition device is in the mjpeg format, it will be limited by the wifi bandwidth due to the large amount of data, resulting in only a small resolution being used for transmission. At the same time, if the image acquisition device transmits image data in formats such as h264 / h265, although the amount of data of the image data itself is relatively small, 1080p and 60Hz can be supported through the wifi bandwidth. However, image acquisition devices in conferencing software (such as teams / Tencent Meeting) only support the mjpeg format and do not support highly compressed audio and video formats such as h264 / h265.

[0004] Therefore, there is an urgent need for a new general feedback control system, method and related devices for an image acquisition device to solve the above technical problems. Summary of the Invention

[0005] The present invention provides a general feedback control system, method and related devices for an image acquisition device, aiming to solve the problems of high price, distance limitation, low image quality of transmitted images and few supported image formats in the existing feedback control methods of image acquisition devices.

[0006] In a first aspect, the present invention provides a general feedback control system for an image acquisition device, and the general feedback control system includes a first connection module, a decoding module, an analysis module and a second connection module;

[0007] The first connection module is communicatively connected to the image acquisition device and is used for data transmission with the image acquisition device;

[0008] The decoding module, the decoding module is communicatively connected to the first connection module and is used for decoding the image data sent by the image acquisition device to obtain decoded image data;

[0009] The analysis module, the analysis module is communicatively connected to the first connection module and is used for analyzing the parameter information of the image acquisition device;

[0010] The second connection module is communicatively connected to the decoding module, the parsing module, and the display device respectively, and is configured to send the decoded video data and the parameter information to the display device, and receive the control signal sent by the display device.

[0011] Preferably, the general feedback control system further includes an analysis module communicatively connected to the first connection module and the second connection module respectively;

[0012] The analysis module is configured to parse the control signal to obtain a control instruction, and send the control instruction to the image acquisition device through the first connection module, so that the image acquisition device performs corresponding operations according to the control instruction.

[0013] Preferably, the second connection module includes an HDMI interface unit, a CEC interface unit, and a Uart interface unit that are respectively communicatively connected to the decoding module, the parsing module, and the display device;

[0014] The HDMI interface unit is configured to perform data transmission with the display device through an HDMI interface;

[0015] The CEC interface unit is configured to perform data transmission with the display device through a CEC interface;

[0016] The Uart interface unit is configured to perform data transmission with the display device through a Uart interface.

[0017] Preferably, when the HDMI interface unit performs data transmission to the display device, the HDMI interface unit integrates the parameter information in the horizontal sync blanking time and vertical sync blanking time of the decoded video data to obtain integrated data, and transmits the integrated data to the display device.

[0018] Preferably, the parameter information includes the model information, function information, control option information, and resolution information of the image acquisition device.

[0019] Preferably, the first connection module includes a USB interface communicatively connected to the image acquisition device.

[0020] Preferably, the video data includes one of mjpeg format, h264 format, and YUY2 format.

[0021] In a second aspect, the present invention further provides a general feedback control method for an image acquisition device. The general feedback control method is based on the general feedback control system of the image acquisition device according to any one of the above embodiments. The general feedback control method includes the following steps:

[0022] S1. Receive the image data sent by the image acquisition device through the first connection module;

[0023] S2. Decode the image data through the decoding module to obtain decoded image data;

[0024] S3. Obtain the parameter information of the image acquisition device through the parsing module;

[0025] S4. Send the decoded image data and the parameter information to the display device through the second connection module;

[0026] S5. Analyze the control signal sent by the display device through the general feedback control system to obtain a control instruction;

[0027] S6. Perform corresponding operations on the image acquisition device according to the control instruction.

[0028] In a third aspect, the present invention further provides a computer device, including: a memory, a processor, and a general feedback control program of an image acquisition device stored on the memory and executable on the processor. When the processor executes the general feedback control program of the image acquisition device, the steps in the general feedback control method of the image acquisition device as described in the above embodiments are implemented.

[0029] In a fourth aspect, the present invention further provides a computer-readable storage medium, on which a general feedback control program of an image acquisition device is stored. When the general feedback control program of the image acquisition device is executed by a processor, the steps in the general feedback control method of the image acquisition device as described in the above embodiments are implemented.

[0030] Compared with the prior art, the general feedback control system proposed by the present invention can realize the use of the feedback control function of the image acquisition device without the need to additionally install other devices, and has a lower cost; it can support the transmission of multiple image data formats and has different types of interfaces to connect to the display device, and realizes the general feedback control function of the image acquisition device without reducing the resolution of the image data. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The present invention will be described in detail below with reference to the drawings. Through the detailed description in combination with the following drawings, the above or other aspects of the present invention will become clearer and easier to understand. In the drawings:

[0032] Figure 1 is a structural diagram of the general feedback control system of the image acquisition device provided by an embodiment of the present invention;

[0033] Figure 2It is a schematic diagram of wireless transmission of the general feedback control system of the image acquisition device provided by the embodiment of the present invention;

[0034] Figure 3 It is a flowchart of the general feedback control method of the image acquisition device provided by the embodiment of the present invention;

[0035] Figure 4 It is a structural diagram of the computer device provided by the embodiment of the present invention. Detailed implementation manners

[0036] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0037] Embodiment 1

[0038] The embodiment of the present invention further provides a general feedback control system 200 for an image acquisition device 100. Please refer to Figure 1 , Figure 1 which is a schematic structural diagram of the general feedback control system 200 of the image acquisition device provided by the embodiment of the present invention. The general feedback control system 200 includes a first connection module 201, a decoding module 202, an analysis module 203, and a second connection module 204;

[0039] The first connection module 201 is communicatively connected to the image acquisition device 100 and is used for data transmission with the image acquisition device 100;

[0040] The decoding module 202 is communicatively connected to the first connection module 201 and is used for decoding the image data sent by the image acquisition device 100 to obtain decoded image data. Specifically, the decoding module 202 receives the image data through the general interfaces of USB Video Class (UVC) and USB Audio Class (UAC).

[0041] The analysis module 203 is communicatively connected to the first connection module 201 and is used for analyzing the parameter information of the image acquisition device 100;

[0042] The second connection module 204 is communicatively connected to the decoding module 202, the parsing module 203, and the display device 300 respectively, and is configured to send the decoded video data and the parameter information to the display device 300, and receive a control signal sent by the display device 300. Specifically, the decoded video data and the parameter information are compressed by lossless TMDS into a corresponding output format and then sent to the display device 300

[0043] Specifically, please refer to Figure 2 , Figure 2 which is a schematic diagram of wireless transmission of the general feedback control system 200 of the image acquisition device provided in an embodiment of the present invention. The second connection module 204 can be communicatively connected to the display device 300 in a wireless or wired form. The second connection module 204 can be indirectly wirelessly connected by being wired to a sending-end device, with the receiving-end device and the sending-end device being wirelessly communicatively connected, and the sending-end device being communicatively connected to the display device 300, thereby reducing the distance limitation during feedback control.

[0044] In an embodiment of the present invention, the general feedback control system 200 further includes an analysis module 205, and the analysis module 205 is communicatively connected to the first connection module 201 and the second connection module 204 respectively;

[0045] The analysis module 205 is configured to parse the control signal to obtain a control instruction, and send the control instruction to the image acquisition device 100 through the first connection module 201, so that the image acquisition device 100 performs corresponding operations according to the control instruction. Specifically, the analysis module 205 parses the control signal through UVC command.

[0046] In an embodiment of the present invention, the second connection module 204 includes an HDMI interface unit 2042, a CEC interface unit 2043, and a Uart interface unit 2041 that are all communicatively connected to the decoding module 202, the parsing module 203, and the display device 300 respectively; specifically, each of the HDMI interface unit 2042, the CEC interface unit 2043, and the Uart interface unit 2041 is communicatively connected to the decoding module 202, the parsing module 203, and the display device 300 respectively.

[0047] The HDMI interface unit 2042 is used to transmit data to the display device 300 through an HDMI interface (High Definition Multimedia Interface). Specifically, the HDMI interface unit 2042 uses TMDS (Transition Minimized Differential Signaling) differential signal transmission technology to compress and transmit the decoded video data to the display device 300.

[0048] The CEC interface unit 2043 is used to transmit data to the display device 300 through a CEC interface (Consumer Electronics Control);

[0049] The Uart interface unit 2041 is used to transmit data to the display device 300 through a Uart interface (Universal Asynchronous Receiver / Transmitter).

[0050] Specifically, in the present invention, data is transmitted to the display device 300 through the CEC interface unit 2043 and the Uart interface unit 2041. At the same time, if the display device 300 does not support the CEC interface or the Uart interface, data is transmitted through the HDMI interface. When the HDMI interface unit 2042 transmits data to the display device 300, the HDMI interface unit 2042 integrates the parameter information into the horizontal synchronization blanking time and vertical synchronization blanking time of the decoded video data (i.e., h sync blanking time or v sync blanking time. The horizontal synchronization blanking time refers to the time period between the end of one line of video signal and the start of the next line of video signal in the horizontal direction; the vertical synchronization blanking time refers to the time period between the end of the last line of one frame of video image and the start of the first line of the next frame of image in the vertical direction), obtains the integrated data, and transmits the integrated data to the display device 300. After receiving the integrated data, the display device 300 uses dynamic switching of the EDID content to send the control information back to the general feedback control system 200.

[0051] In the embodiment of the present invention, the parameter information includes the model information, function information, control option information, and resolution information of the image acquisition device 100.

[0052] In the embodiment of the present invention, the first connection module 201 includes a USB interface communicatively connected to the image acquisition device 100. The USB interface includes, but is not limited to, interfaces such as type A, type B, type C, and USB 3.0.

[0053] In the embodiment of the present invention, the image data includes one of the mjpeg format, h264 format, and YUY2 format.

[0054] Compared with the prior art, the general return control system proposed by the present invention can realize the use of the return control function of the image acquisition device without the need to install other devices additionally, and has lower cost; it can support multiple image data formats for transmission, and has different types of interfaces to connect with the display device, and realizes the general return control function of the image acquisition device while not reducing the resolution of the image data.

[0055] Embodiment Two

[0056] Please refer to Figure 3 , the present invention also provides a general return control method for an image acquisition device. The general return control method is based on the general return control system 200 of the image acquisition device described in any one of the above embodiments. The general return control method includes the following steps:

[0057] S1. Receive the image data sent by the image acquisition device 100 through the first connection module 201;

[0058] In the embodiment of the present invention, the image data includes one of the mjpeg format, h264 format, and YUY2 format.

[0059] In the embodiment of the present invention, the first connection module 201 includes a USB interface communicatively connected to the image acquisition device 100. The USB interface includes, but is not limited to, interfaces such as type A, type B, type C, and USB3.0.

[0060] S2. Perform decoding processing on the image data through the decoding module 202 to obtain decoded image data;

[0061] In the embodiment of the present invention, the decoding module 202 performs decoding processing on the image data to obtain decoded image data with the original image quality.

[0062] S3. Obtain the parameter information of the image acquisition device 100 through the parsing module 203;

[0063] In the embodiment of the present invention, the parameter information includes the model information, function information, control option information, and resolution information of the image acquisition device 100. S4. Send the decoded image data and the parameter information to the display device 300 through the second connection module 204;

[0064] In an embodiment of the present invention, when the second connection module 204 performs data transmission with the display device 300, data transmission can be carried out through an HDMI interface, a CEC interface, and a Uart interface. When performing data transmission with the display device 300 through the HDMI interface (High Definition Multimedia Interface), the TMDS (Transition Minimized Differential Signaling) differential signal transmission technology is adopted to compress and transmit the decoded video data to the display device 300.

[0065] Specifically, if the display device 300 does not support the CEC interface or the Uart interface, data transmission is carried out through the HDMI interface. When performing data transmission with the display device 300 through the HDMI interface, the parameter information is integrated into the horizontal synchronization blanking time and the vertical synchronization blanking time of the decoded video data (i.e., h sync blanking time or v sync blanking time. The horizontal synchronization blanking time refers to the time period between the end of one line of video signal and the start of the next line of video signal in the horizontal direction; the vertical synchronization blanking time refers to the time period between the end of the last line of one frame of video image and the start of the first line of the next frame of image in the vertical direction), to obtain integrated data, and the integrated data is transmitted to the display device 300. After receiving the integrated data, the display device 300 uses dynamic switching of the EDID content to send the control information back to the general return control system 200. S5. Analyze the control signal sent by the display device 300 through the general return control system 200 to obtain a control instruction;

[0066] In an embodiment of the present invention, after receiving the control signal, the general return control system 200 analyzes the corresponding UVC command (i.e., a command for controlling a device compliant with the USB Video Class protocol) to obtain a control instruction.

[0067] S6. Perform corresponding operations on the image acquisition device 100 according to the control instruction.

[0068] The second connection module 204 can be communicatively connected to the display device 300 in a wireless or wired form. The second connection module 204 can be indirectly wirelessly connected by being wired to a sending device, with the receiving device and the sending device being wirelessly communicatively connected, and the sending device being communicatively connected to the display device 300, thereby reducing the distance limitation during return control.

[0069] The general feedback control method of the image acquisition device is based on the general feedback control system 200 of the image acquisition device as described in the above embodiments, and can achieve the same technical effects. Refer to the description in the above embodiments, and details are not repeated here.

[0070] Embodiment III

[0071] The embodiment of the present invention also provides a computer device. Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of the computer device provided by the embodiment of the present invention. The computer device 400 includes: a memory 402, a processor 401, and a general feedback control program of the image acquisition device stored on the memory 402 and operable on the processor 401.

[0072] The processor 401 calls the general feedback control program stored in the memory 402 and executes the steps in the general feedback control method of the image acquisition device provided by the embodiment of the present invention. Please refer to Figure 3 , which specifically includes the following steps:

[0073] S1. Receive the image data sent by the image acquisition device 100 through the first connection module 201;

[0074] S2. Perform decoding processing on the image data through the decoding module 202 to obtain decoded image data;

[0075] S3. Obtain the parameter information of the image acquisition device 100 through the parsing module 203;

[0076] S4. Send the decoded image data and the parameter information to the display device 300 through the second connection module 204;

[0077] S5. Parse the control signal sent by the display device 300 through the general feedback control system to obtain a control instruction;

[0078] S6. Perform corresponding operations on the image acquisition device 100 according to the control instruction.

[0079] The computer device 400 provided by the embodiment of the present invention can implement the steps in the method in the above embodiments and can achieve the same technical effects. Refer to the description in the above embodiments, and details are not repeated here.

[0080] Embodiment IV

[0081] An embodiment of the present invention further provides a computer-readable storage medium, on which a general return control program for an image acquisition device is stored. When the general return control program for the image acquisition device is executed by a processor, each process and step in the general return control method for the image acquisition device provided by the embodiment of the present invention is implemented, and the same technical effects can be achieved. To avoid repetition, it will not be elaborated here.

[0082] Those of ordinary skill in the art can understand that all or part of the processes of implementing the methods in the above embodiments can be completed by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.

[0083] It should be noted that in this article, the term "including", "comprising", or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article, or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article, or device. Without more limitations, an element defined by the statement "including a..." does not exclude the existence of another identical element in the process, method, article, or device including that element.

[0084] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases, the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to enable a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0085] The embodiments of the present invention have been described above in conjunction with the accompanying drawings. What is disclosed is only the preferred embodiments of the present invention. However, the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Those of ordinary skill in the art, under the inspiration of the present invention, without departing from the spirit and scope protected by the present invention and the claims, can also make many equivalent changes in form, all of which fall within the protection scope of the present invention.

Claims

1. A universal feedback control system for image acquisition equipment, characterized in that: The universal feedback control system includes a first connection module, a decoding module, a parsing module and a second connection module; The first connection module is in communication connection with the image acquisition device, and is used for performing data transmission with the image acquisition device; The decoding module is communicatively connected with the first connection module and is used to decode the image data sent by the image acquisition device to obtain decoded image data; The parsing module is communicatively connected with the first connection module and is used to parse parameter information of the image acquisition device; The second connection module is respectively connected to the decoding module, the parsing module and the display device for communication, and is used to send the decoded image data and the parameter information to the display device, and receive a control signal from the display device.

2. The universal feedback control system of the image acquisition device according to claim 1, characterized in that: The universal feedback control system further includes an analysis module, and the analysis module is respectively connected to the first connection module and the second connection module for communication; The analysis module is used to analyze the control signal to obtain a control instruction, and send the control instruction to the image acquisition device through the first connection module, so that the image acquisition device performs a corresponding operation according to the control instruction.

3. The universal feedback control system of the image acquisition device according to claim 1, characterized in that: The second connection module includes an HDMI interface unit, a CEC interface unit and a Uart interface unit, which are respectively connected to the decoding module, the parsing module and the display device for communication; The HDMI interface unit is used to perform data transmission with the display device via the HDMI interface; The CEC interface unit is used to perform data transmission with the display device via the CEC interface; The Uart interface unit is used to perform data transmission with the display device via a Uart interface.

4. The universal feedback control system of the image acquisition device as claimed in claim 3, characterized in that: When the HDMI interface unit transmits data to the display device, the HDMI interface unit integrates the parameter information into the horizontal synchronization blanking time and the vertical synchronization blanking time of the decoded image data to obtain integrated data, and transmits the integrated data to the display device.

5. The universal feedback control system of the image acquisition device according to claim 1, characterized in that: The parameter information includes model information, function information, control option information and resolution information of the image acquisition device.

6. The universal feedback control system of the image acquisition device according to claim 1, characterized in that: The first connection module includes a USB interface that is communicatively connected to the image acquisition device.

7. The universal feedback control system of the image acquisition device according to claim 1, characterized in that: The image data includes one of the mjpeg format, the h264 format and the YUY2 format.

8. A general return control method for an image acquisition device, characterized in that: The universal feedback control method is based on the universal feedback control system of the image acquisition device according to any one of claims 1 to 7, and the universal feedback control method comprises the following steps: S1. receiving image data sent by the image acquisition device through the first connection module; S2. Decoding the image data by the decoding module to obtain decoded image data; S3, obtaining parameter information of the image acquisition device through the analysis module; S4, sending the decoded image data and the parameter information to the display device through the second connection module; S5, parsing the control signal sent by the display device through the universal feedback control system to obtain a control instruction; S6. Execute corresponding operations on the image acquisition device according to the control instruction.

9. A computer device, characterized in that: include: A memory, a processor, and a general return control program for an image acquisition device stored in the memory and executable on the processor, wherein the processor implements the steps in the general return control method for an image acquisition device as described in claim 8 when executing the general return control program for the image acquisition device.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a general return control program for the image acquisition device, and when the general return control program for the image acquisition device is executed by the processor, the steps in the general return control method for the image acquisition device as described in claim 8 are implemented.

Images