Data transmission method, video capture system, electronic equipment and storage medium

Abstract

The invention relates to the field of USB signal transmission, and discloses a data transmission method based on a USB transmission protocol, a video capture system, electronic equipment and a computer readable storage medium. The data transmission method comprises the steps that frame image data collected by a video capture device and identification data corresponding to the frame image data are obtained, and the identification data comprise at least one of the data length, the frame completion identification, the device state parameter and the image timestamp corresponding to the frame image data; and based on a USB transmission protocol, sequentially sending the identification data and the frame image data to a video receiving device according to a sequence that the identification data is in front of the frame image data. Compared with the prior art, the data transmission method based on the USB transmission protocol, the video capture system, the electronic equipment and the computer readable storage medium provided by the embodiment of the invention have the advantages that the data processing burden of the processor can be reduced while the data processor efficiency of the processor can be improved.

Description

Technical Field

[0001] The present invention relates to the field of USB signal transmission, and in particular to a data transmission method based on a USB transmission protocol, a video capture system, an electronic device and a computer-readable storage medium. Background Art

[0002] With the rapid development of computer technology, especially in the field of image acquisition, camera devices are increasingly becoming a trend in demand, especially those that require multiple cameras. Usually, connecting a camera requires occupying a data transmission channel, through which the data collected by a camera is transmitted to the processor. Among them, when transmitting the data collected by the camera through the data transmission channel, it is necessary to follow a certain transmission protocol. The USB protocol is widely used as a common data transmission protocol, and more and more cameras use the USB protocol to transmit image data. Among the many USB transmission protocols, the UVC protocol, the full name of which is: USB video (device) class, is currently the most widely used USB-based image transmission protocol.

[0003] When the camera uses the UVC protocol for data transmission, it not only needs to transmit the image data collected by the camera, but also needs to transmit some identification data corresponding to the image data collected by the camera. After these data are transmitted to the processor, the processor can analyze and use the image data collected by the camera according to the identification data. However, the processor of the prior art needs to copy the image data at least once in the process of analyzing and using the image data collected by the camera according to the identification data, which reduces the data processing efficiency of the processor and also brings some additional burden to the processor. Summary of the invention

[0004] The object of the present invention is to provide a data transmission method, a video capture system, an electronic device and a computer-readable storage medium based on a USB transmission protocol, which can improve the data processor efficiency of a processor while reducing the data processing burden of the processor.

[0005] In a first aspect, an embodiment of the present invention provides a data transmission method based on a USB transmission protocol, which is applied to a video capture device. The data transmission method based on the USB transmission protocol includes: acquiring frame image data collected by the video capture device and identification data corresponding to the frame image data, the identification data including at least one of a data length, a frame completion identifier, a device status parameter, and an image timestamp corresponding to the frame image data; based on the USB transmission protocol, sending the identification data and the frame image data to a video receiving device in the order of the identification data first and the frame image data later.

[0006] Compared with the prior art, in the data transmission method based on the USB transmission protocol provided in the embodiment of the present invention, when the video capture device performs data transmission, it first obtains the frame image data collected by it and the identification data corresponding to the frame image data, and then sends the identification data and the frame image data to the video receiving device in sequence based on the USB transmission protocol. Since the order of sending the identification data and the frame image data is the identification data first and the frame image data later, the video receiving device can first receive the identification data when receiving the data sent by the video capture device, and can directly receive the frame image data to the corresponding storage location according to the data length, frame completion mark, device status parameters, image timestamp and other information of the frame image data included in the identification data, without copying and transferring the frame image data, thereby improving the data processor efficiency of the processor while reducing the data processing burden of the processor.

[0007] In an optional embodiment, there are multiple frame image data and multiple identification data, and the identification data and the frame image data are sent to the video receiving device in the order of the identification data first and the frame image data later, including: sending multiple frame image data and multiple identification data to the video receiving device alternately in sequence, for each frame image data, the data sent before is the identification data corresponding to the frame image data, and for each identification data, the data sent after is the frame image data corresponding to the identification data.

[0008] In an optional embodiment, after sending the identification data and the frame image data to the video receiving device in the order of the identification data first and the frame image data later, the data transmission method based on the USB transmission protocol also includes: updating the device status parameters of the video capture device.

[0009] In an optional embodiment, updating the device state parameters of the video capture device includes: receiving a parameter update instruction, the parameter update instruction including a target device state parameter; and updating the device state parameters of the video capture device according to the target device state parameter.

[0010] In a second aspect, an embodiment of the present invention provides a data transmission method based on a USB transmission protocol, which is applied to a video receiving device. The data transmission method based on the USB transmission protocol includes: based on the USB transmission protocol, receiving the identification data sent by the video capture device, the identification data including at least one of the data length corresponding to the frame image data, a frame completion mark, a device status parameter, and an image timestamp; determining a target storage address according to the identification data, and receiving the frame image data and storing it at the target storage address.

[0011] Compared with the prior art, in the data transmission method based on the USB transmission protocol provided in the embodiment of the present invention, after receiving the identification data sent by the video capture device, the video receiving device can determine the target storage address of the subsequently received frame image data according to the data length, frame completion mark, device status parameters, image timestamp and other information corresponding to the frame image data included in the identification data. When the frame image data is subsequently received, the frame image data can be directly received and stored at the target storage address to complete the reception of the frame image data, without the need to copy and transfer the frame image data, thereby improving the data processor efficiency of the processor and reducing the data processing burden of the processor.

[0012] In an optional embodiment, receiving the frame image data to the target storage address for storage includes: receiving the frame image data to the target storage address for storage based on a direct storage access technology.

[0013] In an optional embodiment, the identification data does not include the frame completion identifier, and determining the target storage address based on the identification data includes: determining an end storage address of the most recently received historical frame image data, and determining the end storage address as the target storage address.

[0014] In a third aspect, an embodiment of the present invention provides a video capture system, comprising: a video capture device and a video receiving device connected based on a USB transmission protocol communication; the video capture device is used to collect frame image data and generate corresponding identification data and execute the aforementioned data transmission method based on the USB transmission protocol to send the identification data and the frame image data to the video receiving device; the video receiving device is used to execute the aforementioned data transmission method based on the USB transmission protocol to receive the identification data and the frame image data sent by the video capture device.

[0015] In a fourth aspect, an embodiment of the present invention provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the data transmission method based on the USB transmission protocol as described above.

[0016] In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the aforementioned data transmission method based on the USB transmission protocol. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can also be obtained based on these drawings.

[0018] Figure 1 A flowchart of a data transmission method based on the USB transmission protocol provided in the first embodiment of the present invention;

[0019] Figure 2 A schematic diagram of a flow chart of a data transmission method based on the USB transmission protocol provided in the second embodiment of the present invention;

[0020] Figure 3 A schematic diagram of the structure of a video capture system provided in Embodiment 3 of the present invention;

[0021] Figure 4 This is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0023] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed but is merely representative of selected embodiments of the present invention.

[0024] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0025] In addition, the terms “first”, “second”, etc., if used, are merely used to distinguish between the descriptions and should not be understood as indicating or implying relative importance.

[0026] It should be noted that, in the absence of conflict, the features in the embodiments of the present invention may be combined with each other.

[0027] The embodiment of the present invention provides a data transmission method based on the USB transmission protocol, a video capture system, an electronic device and a computer-readable storage medium. Among them, the video capture system includes a video capture device and a video receiving device connected by a USB transmission protocol communication. The video capture device can perform image acquisition to obtain video data. The video data acquired by the video capture device is specifically composed of a large amount of frame image data; after the video capture device acquires the frame image data, it can generate identification data corresponding to the frame image data, and then use the data transmission method based on the USB transmission protocol provided by the embodiment of the present invention to send the acquired frame image data and the generated identification data to the video receiving device. The video receiving device can also use the data transmission method based on the USB transmission protocol provided by the embodiment of the present invention to receive the frame image data and the corresponding identification data sent by the video capture device. Below, the data transmission method based on the USB transmission protocol, the video capture system, the electronic device and the computer-readable storage medium provided by different embodiments of the present invention will be specifically described.

[0028] Embodiment 1

[0029] Embodiment 1 of the present invention provides a data transmission method based on the USB transmission protocol, which is applied to a video capture device to send data to a video receiving device, such as Figure 1 As shown, the data transmission method based on the USB transmission protocol provided in this embodiment includes the following steps:

[0030] Step S101: acquiring frame image data collected by a video capture device and identification data corresponding to the frame image data.

[0031] Specifically, the number of frame image data and corresponding identification data collected by the video capture device may be multiple. In this step, the acquired frame image data and identification data are the frame image data and identification data that currently need to be sent.

[0032] The identification data is data generated by the video capture device and corresponding to the frame image data, which may specifically include data length, frame completion mark, device status parameters, image timestamp, etc. corresponding to the frame image data. It can be understood that the above is an example of identification data in some embodiments of the present invention, and in different embodiments of the present invention, the identification data may include part or all of the data.

[0033] Taking the identification data including the image timestamp as an example, after receiving the control of the host computer to start video capture, the video capture device can collect multiple frames of image data to form a captured video. When each frame of image data is collected, the video capture device records the device time of the video capture device when the frame of image data is collected as the corresponding identification data. Similarly, when the identification data includes data length corresponding to the frame of image data, or frame completion mark, or device status parameter data, the video capture device can also generate the corresponding data length, or frame completion mark, or device status parameter data as the corresponding identification data.

[0034] Step S102: Based on the USB transmission protocol, the identification data and the frame image data are sent to the video receiving device in the order of identification data first and frame image data later.

[0035] Specifically, in this step, for the case of only including a single frame image data and a single corresponding identification data, the identification data and the frame image data can be directly sent to the video receiving device in the order of the identification data first and the frame image data later.

[0036] In the case where there are multiple frame image data and identification data, the identification data and frame image data are sent in sequence in this step, which may include: sending multiple frame image data and multiple identification data to the video receiving device alternately in sequence, and for each frame image data, the data sent before is the identification data corresponding to the frame image data, and for each identification data, the data sent after is the frame image data corresponding to the identification data. That is, for each frame image data, the identification data corresponding to it is sent before it, and for each identification data, the frame image data corresponding to it is sent after it. Specifically, after receiving the transmission start instruction, the data type of the previously sent data is detected, and if the previously sent data is the identification data, the frame image data corresponding to the identification data is sent to the video receiving device as the next sent data, and if the previously sent data is the frame image data, another identification data is sent to the video receiving device as the next sent data, and this is repeated until all the frame image data and identification data are sent.

[0037] In some other embodiments of the present invention, when the identification data includes device status parameters, the embodiment in which the frame image data and the identification data are sent in sequence as described above can also be: after receiving the transmission start instruction, the data type of the previously sent data is detected, and if the previously sent data is the identification data, the frame image data corresponding to the identification data is sent as the next data to be sent to the video receiving device, and after one frame image data is sent, the video capture device can also update the device parameters of the video capture device; then when the next identification data is sent, the device status parameters included in the identification data are the updated device status parameters, and the updated device status parameters are added to the identification data as the next data to be sent to the video receiving device, and this is repeated until all the frame image data and identification data are sent.

[0038] In addition, in some embodiments of the present invention, the aforementioned video capture device updates the device parameters of the video capture device after a frame of image data is sent. Specifically, after receiving a parameter update instruction sent by a host computer, such as a controller, a server, a video receiving device, etc., the device state parameters of the video capture device are updated according to the target device state parameters included in the received parameter update instruction. Thus, the host computer controls the video data captured by the video capture device, so that the subsequently sent frame image data better meets the requirements of the host computer. In the embodiments of the present invention, the updated device state parameters are added to the identification data as the next sent data to the video receiving device, so that the video receiving device can classify and receive the corresponding frame image data according to different device state parameters, thereby reducing the confusion in the receiving process of the frame image data collected by the video capture device under different device state parameters.

[0039] Compared with the prior art, in the data transmission method based on the USB transmission protocol provided in the first embodiment of the present invention, when the video capture device performs data transmission, it first obtains the frame image data collected by it and the identification data corresponding to the frame image data, and then sends the identification data and the frame image data to the video receiving device in sequence based on the USB transmission protocol. Since the order of sending the identification data and the frame image data is the identification data first and the frame image data later, the video receiving device can first receive the identification data when receiving the data sent by the video capture device, and can directly receive the frame image data to the corresponding storage location according to the data length, frame completion mark, device status parameters, image timestamp and other information of the frame image data included in the identification data, without copying and transferring the frame image data, thereby improving the data processor efficiency of the processor while reducing the data processing burden of the processor.

[0040] Embodiment 2

[0041] Embodiment 2 of the present invention provides a data transmission method based on the USB transmission protocol, which is applied to a video receiving device to receive data sent by a video capturing device, such as Figure 2 As shown, the data transmission method based on the USB transmission protocol provided in this embodiment includes the following steps:

[0042] Step S201: Based on the USB transmission protocol, receiving identification data sent by the video capture device.

[0043] Specifically, the video capture device can transmit the identification data and the frame image data according to the data transmission method based on the USB transmission protocol provided in the first embodiment. Therefore, in this step, the video receiving device receives the data in the order of identification data first and frame image data later. The first data received is the identification data sent by the video capture device. The identification data can specifically include at least one of the data length corresponding to the frame image data, the frame completion mark, the device status parameter, and the image timestamp.

[0044] Step S202: determining a target storage address according to the identification data, and receiving the frame image data to the target storage address for storage.

[0045] In this step, the target storage address is determined according to the identification data. Specifically, different methods can be used to determine the target storage address according to the specific data type in the identification data.

[0046] Specifically, taking the example that the identification data specifically includes the data length corresponding to the frame image data, the corresponding target storage address determined according to the identification data can be that a storage unit with a storage space greater than or equal to the data length is selected in the memory of the video receiving device according to the data length included in the identification data, and the address of the determined storage unit is used as the target storage address.

[0047] Alternatively, taking the example that the identification data specifically includes a frame completion identification corresponding to the frame image data, the target storage address determined according to the identification data can be the storage address at the end of the storage space for storing the frame image as the target storage address.

[0048] Alternatively, taking the example that the identification data specifically includes the device state parameter corresponding to the frame image data, the corresponding target storage address determined according to the identification data can be selected as the target storage address for storing the frame image data corresponding to the device state parameter in the memory of the video receiving device according to the device state parameter included in the identification data. That is, corresponding storage space is allocated in advance for each different device state parameter, and in this step, the corresponding storage space can be determined according to the received device state parameter, and the address of the corresponding storage space is used as the target storage address.

[0049] Alternatively, taking the example that the identification data specifically includes an image timestamp corresponding to the frame image data, the corresponding target storage address determined according to the identification data can be the storage location of the frame image data with the same image timestamp determined according to the image timestamp included in the identification data, and the end address of the storage location of the frame image data with the same image timestamp is used as the target storage address.

[0050] Alternatively, taking the example that the identification data does not include the frame completion identification corresponding to the frame image data, the corresponding target storage address determined according to the identification data can be used to determine the end storage address of the most recently received historical frame image data, and the end storage address is determined as the target storage address.

[0051] It can be understood that the above is only an example of a specific method for determining a target storage address according to identification data in some embodiments of the present invention, and can be selected according to different actual needs in different embodiments of the present invention.

[0052] Furthermore, in this step, after determining the target storage address, the frame image data corresponding to the identification data can be received subsequently and then directly received and stored at the target storage address. Specifically, for example, the frame image data can be received and stored at the target storage address based on direct storage access technology.

[0053] Compared with the prior art, in the data transmission method based on the USB transmission protocol provided in the second embodiment of the present invention, after receiving the identification data sent by the video capture device, the video receiving device can determine the target storage address of the subsequently received frame image data according to the data length, frame completion mark, device status parameters, image timestamp and other information corresponding to the frame image data included in the identification data. When the frame image data is subsequently received, the frame image data can be directly received and stored at the target storage address to complete the reception of the frame image data, without the need to copy and transfer the frame image data, thereby improving the data processor efficiency of the processor and reducing the data processing burden of the processor.

[0054] Embodiment 3

[0055] Embodiment 3 of the present invention provides a video capture system, such as Figure 3 As shown, it includes: a video capture device 301 and a video receiving device 302 connected by USB transmission protocol communication. The video capture device is used to collect frame image data and generate corresponding identification data and execute the data transmission method based on USB transmission protocol provided in the above embodiment 1 to send identification data and frame image data to the video receiving device; the video receiving device is used to execute the data transmission method based on USB transmission protocol provided in the above embodiment 2 to receive the identification data and frame image data sent by the video capture device.

[0056] Compared with the prior art, in the video capture system provided by the third embodiment of the present invention, when the video capture device performs data transmission, it first obtains the frame image data it has collected and the identification data corresponding to the frame image data, and then sends the identification data and the frame image data to the video receiving device in sequence based on the USB transmission protocol. Since the order of sending the identification data and the frame image data is the identification data first and the frame image data later, the video receiving device can first receive the identification data when receiving the data sent by the video capture device. After receiving the identification data sent by the video capture device, the video receiving device can determine the target storage address of the subsequently received frame image data according to the data length, frame completion mark, device status parameters, and image timestamp corresponding to the frame image data included in the identification data. When the frame image data is subsequently received, the frame image data can be directly received and stored at the target storage address to complete the reception of the frame image data, without the need to copy and transfer the frame image data, thereby improving the data processor efficiency of the processor while reducing the data processing burden of the processor.

[0057] Embodiment 4

[0058] A fourth embodiment of the present invention relates to an electronic device, such as Figure 4 As shown, it includes: at least one processor 401; and a memory 402 that is communicatively connected to the at least one processor 401; wherein the memory 402 stores instructions that can be executed by the at least one processor 401, and the instructions are executed by the at least one processor 401 so that the at least one processor 401 can execute the data transmission method based on the USB transmission protocol provided in the above-mentioned embodiments.

[0059] Among them, the memory and the processor are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors and memories together. The bus can also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor.

[0060] The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory can be used to store data used by the processor when performing operations.

[0061] Specifically, if the processor 401 in the electronic device provided in this embodiment executes the data transmission method based on the USB transmission protocol provided in Example 1, the electronic device provided in this embodiment is a video capture device; and if the processor 401 in the electronic device provided in this embodiment executes the data transmission method based on the USB transmission protocol provided in Example 2, the electronic device provided in this embodiment is a video receiving device.

[0062] Furthermore, if two or more electronic devices provided in this embodiment are connected to communicate based on the USB transmission protocol and respectively execute the data transmission methods based on the USB transmission protocol provided in Example 1 and Example 2, then two or more electronic devices provided in this embodiment together constitute a video capture system provided in Example 3.

[0063] Embodiment 5

[0064] Embodiment 5 of the present invention relates to a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the data transmission method based on the USB transmission protocol provided in the above embodiments.

[0065] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0066] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A data transmission method based on USB transmission protocol, characterized in that: Applied to a video capture device, the data transmission method based on the USB transmission protocol includes: Acquire frame image data collected by the video capture device and identification data corresponding to the frame image data, wherein the identification data includes at least one of a data length, a frame completion identifier, a device status parameter, and an image timestamp corresponding to the frame image data; Based on the USB transmission protocol, the identification data and the frame image data are sent to the video receiving device in sequence in the order of the identification data first and the frame image data second.

2. The data transmission method based on the USB transmission protocol according to claim 1, characterized in that: There are multiple frame image data and identification data, and sending the identification data and the frame image data to the video receiving device in the order of the identification data first and the frame image data second, including: The plurality of frame image data and the plurality of identification data are sent alternately to the video receiving device in sequence. For each frame image data, the data sent previously is the identification data corresponding to the frame image data. For each identification data, the data sent subsequently is the frame image data corresponding to the identification data.

3. The data transmission method based on the USB transmission protocol according to claim 1, characterized in that: After the identification data and the frame image data are sent to the video receiving device in the order of the identification data first and the frame image data second, the data transmission method based on the USB transmission protocol further includes: The device state parameters of the video capture device are updated.

4. The data transmission method based on the USB transmission protocol according to claim 3, characterized in that: The updating of the device status parameters of the video capture device comprises: receiving a parameter update instruction, wherein the parameter update instruction includes a target device state parameter; The device state parameters of the video capture device are updated according to the target device state parameters.

5. A data transmission method based on USB transmission protocol, characterized in that: Applied to a video receiving device, the data transmission method based on the USB transmission protocol includes: Based on the USB transmission protocol, receiving the identification data sent by the video capture device, the identification data including at least one of a data length corresponding to the frame image data, a frame completion mark, a device status parameter, and an image timestamp; A target storage address is determined according to the identification data, and the frame image data is received and stored at the target storage address.

6. The data transmission method based on the USB transmission protocol according to claim 5, characterized in that: The receiving the frame image data to the target storage address for storage comprises: The frame image data is received and stored at the target storage address based on direct storage access technology.

7. The data transmission method based on the USB transmission protocol according to claim 5, characterized in that: The identification data does not include the frame completion identification, and determining the target storage address according to the identification data includes: determining the end storage address of the historical frame image data received most recently, and determining the end storage address as the target storage address.

8. A video capture system, characterized in that: include: A video capture device and a video receiving device connected via USB transmission protocol communication; The video capture device is used to collect frame image data and generate identification data corresponding thereto and execute the data transmission method based on the USB transmission protocol according to any one of claims 1 to 4 to send the identification data and the frame image data to the video receiving device; The video receiving device is used to execute the data transmission method based on the USB transmission protocol as described in any one of claims 5 to 7 to receive the identification data and the frame image data sent by the video capturing device.

9. An electronic device, characterized in that: include: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the data transmission method based on the USB transmission protocol as described in any one of claims 1 to 8.

10. A computer-readable storage medium storing a computer program, characterized in that: The computer program is executed by a processor to implement the data transmission method based on the USB transmission protocol as described in any one of claims 1 to 8.

Images