Video processing card and electronic equipment
By designing a video processing card that integrates multi-channel content source data processing and encoding and decoding functions, it solves the problems of high host-side resource usage and low performance in the existing technology, and achieves more efficient video data processing and output.
Patent Information
- Application Number
- CN202420240958.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-31
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2034-01-31
AI Technical Summary
When existing video acquisition devices process multi-channel video data, the host side needs to perform heavy video processing, resulting in high resource usage and low performance.
Design a video processing card that includes multiple input interfaces, at least one processor, and an output interface. It can integrate multiple channels of content source data on a carrier, process and encode and decode them, and directly output the processed data.
Through the processing and encoding and decoding of the video processing card, the resource occupation of the host system is reduced, the pressure of video processing is reduced, the overall performance is improved, and it supports multiple display protocols and codec specifications.
Smart Images

Figure CN222381701U_ABST
Abstract
Description
Technical Field
[0001] The utility model relates to the technical field of video acquisition, and more specifically to a video processing card and electronic equipment. Background Art
[0002] Currently, video acquisition is required in many scenarios, and video data of different scenarios are acquired by different video acquisition devices. After acquiring the video data, each video acquisition device will send the acquired video data to the host side, and the host side will process the received video data accordingly based on the needs. Utility Model Content
[0003] In view of this, the utility model provides the following technical solutions:
[0004] A video processing card, comprising:
[0005] A carrier 10 for carrying and conducting electronic components;
[0006] A plurality of input interfaces 20 provided on the carrier 10 are used to obtain content source data provided by the content source providing end after establishing a connection with the corresponding content source providing end;
[0007] At least one processor 30 disposed on the carrier 10 is capable of processing the obtained multiple content source data into target output data;
[0008] The output interface 40 disposed on the carrier 10 is used to directly output the target output data to a target application of an electronic device after establishing a connection with the electronic device.
[0009] Optionally, it also includes:
[0010] A plurality of codecs 50 disposed on the carrier 10 are electrically connected to the plurality of input interfaces 20 correspondingly, and are used to perform codec processing on the content source data;
[0011] The plurality of codecs 50 are electrically connected to the processor 30 , and can provide the content source data after codec processing to the processor 30 .
[0012] Optionally, the codec 50 includes:
[0013] A decoder, used for converting content source data in the channel into LVTTL digital video data;
[0014] The encoder is connected to the decoder signal and is used to encode the LVTTL digital video data into Universal Serial Bus Video Class protocol data.
[0015] Optionally, the processor 30 is the only video processing unit disposed on the carrier 10, and the video processing unit has a plurality of input pins and at least one output pin;
[0016] The multiple codecs 50 respectively establish a signal connection with the unique video processing unit through at least one input pin;
[0017] The unique video processing unit establishes a signal connection with the output interface 40 via at least one output pin.
[0018] Optionally, the display protocols supported by the multiple input interfaces 20 are the same or different;
[0019] and / or,
[0020] The specifications of the plurality of codecs 50 may be the same or different.
[0021] Optionally, the processor 30 is further connected to the output interface 40 and a control pin in at least one input interface 20 by signal, and the control pin is used for the electronic device to send a control instruction to a corresponding content source provider.
[0022] Optionally, the output interface 40 further includes a power supply pin, and the power supply pin can obtain power data from an electronic device after the output interface 40 is connected to the electronic device, so as to supply power to the processor 30 and the plurality of codecs 50 .
[0023] Optionally, an indication component is further included which is arranged on the carrier 10 and can indicate the working status of the processor 30 and / or the plurality of codecs 50 .
[0024] Optionally, a shell is further included, wherein the shell is formed with a receiving space, and the carrier 10 is disposed in the receiving space;
[0025] The housing further includes avoidance openings corresponding to the input interface 20 and the output interface 40 , the avoidance openings are in communication with the accommodation space, and the input interface 20 and the output interface 40 are at least partially exposed outside the housing through the avoidance openings.
[0026] The present application also discloses an electronic device, which includes any one of the above-mentioned video processing cards. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] In order to more clearly illustrate the embodiments of the utility model or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only embodiments of the utility model. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
[0028] Figure 1 A schematic diagram of the structure of a video processing card disclosed in an embodiment of the present application;
[0029] Figure 2 A schematic diagram of the signal structure of a video processing card disclosed in an embodiment of the present application;
[0030] Figure 3 A schematic diagram of the application architecture of a video processing card disclosed in an embodiment of the present application. DETAILED DESCRIPTION
[0031] The following will be combined with the drawings in the embodiments of the utility model to clearly and completely describe the technical solutions in the embodiments of the utility model. Obviously, the described embodiments are only part of the embodiments of the utility model, not all of the embodiments. Based on the embodiments in the utility model, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the utility model.
[0032] Figure 1 This is a schematic diagram of the structure of a video processing card disclosed in an embodiment of the present application. Figure 1 As shown, the video processing card may include:
[0033] A carrier 10 for carrying and conducting electronic components;
[0034] A plurality of input interfaces 20 provided on the carrier 10 are used to obtain content source data provided by the content source providing end after establishing a connection with the corresponding content source providing end;
[0035] At least one processor 30 disposed on the carrier 10 is capable of processing the obtained multiple content source data into target output data;
[0036] The output interface 40 disposed on the carrier 10 is used to directly output the target output data to a target application of an electronic device after establishing a connection with the electronic device.
[0037] The video processing card of this embodiment can be, but is not limited to, a video capture card, a content provider, etc., and this application does not impose any fixed restrictions on its specific product form in practical applications. The video processing card has multiple input interfaces 20, which can receive multiple content sources and perform corresponding processing on these content sources, and then output the processed data.
[0038] Among them, the carrier 10 used to carry and conduct electronic components can be a PCB (Printcd Cicuils Board) board, which serves as a substrate to support various electronic components and can connect the various electronic components included in the video processing card to ensure the normal signal transmission, data transmission and other operations between the electronic components.
[0039] The carrier 10 is provided with a plurality of input interfaces 20, each of which can be connected to a content provider. The content providers connected to different input interfaces 20 can be devices of the same type or devices of different types, such as cameras, PC devices, mobile phones, tablets, and other devices that can provide content sources. The communication protocols supported by the content source provider can also be different, so the plurality of input interfaces 20 can include at least one of the following types of interfaces: HDMI (High Definition Multimedia Interface, High Definition Multimedia Interface Interface, DP (Display Port, Digital Video Interface Standard) Interface, THUNDER Interface (Thunderbolt Interface), TYPE-C (A USB Interface Shape Standard) Interface, VGA (Video Graphics Array, Video Graphics Array) Interface, etc.
[0040] The at least one processor 30 on the carrier 10 may be a VPU (Video Processing Unit), or may be at least one of other types of processors such as an NPU (Neural Processing Unit), a CPU (Central Processing Unit), a GPU (graphics processing unit), or a DPU (Data Processing Unit). Based on the requirements of the application scenario, the type and quantity of the at least one processor 30 on the carrier 10 may be configured autonomously.
[0041] For example, if the processor 30 needs to perform video splicing in the application scenario, the processor 30 may be a VPU; if the processor 30 needs to perform text editing on video data in the application scenario, the processor 30 may be a DPU; if the processor 30 needs to perform feature recognition and tracking in the application scenario, the processor 30 may be an NPU. Of course, in implementation, when the processor 30 on the carrier 10 includes multiple or even more processors, the processor 30 may be a combination of at least two of the aforementioned different types of processors.
[0042] In this embodiment, there may be only one output interface 40 for transmitting the target output data processed by the processor 30. Regardless of which input interface the content source corresponding to the target output data comes from, the content source data from different input interfaces 20 can be uniformly output through the output interface 40 after being processed by the processor 30. The output interface 40 may be a wired interface or a wireless interface, or may support both wired and wireless.
[0043] In an optional implementation, the output interface 40 may be a wired interface such as a USB port supporting the UVC (USB Video Class) protocol; the output interface 40 may be a wireless interface such as a wifi interface to support wireless output of target output data.
[0044] In actual applications, the video processing card can have multiple video inputs, and the multiple video inputs are not directly input to the host system (application or business system that requires video data), but are processed by the processor 30 of the video processing card and then output to the host system. This design can greatly reduce the resource usage of the host system, and the host's CPU and memory are no longer needed to perform resource-intensive activities such as video processing, which can free up the host system's CPU and memory to do more other work.
[0045] Since the video processing card described in the present application solution includes a processor, it is capable of integrating multiple content source data into one place and performing corresponding processing on the multiple content source data. Therefore, the content source data can be directly processed based on the needs of downstream applications or businesses. The target output data outputted thereby can be directly provided to the consumer application or business for use after conversion through the UVC protocol, without the need for the processor of the downstream application or business system to perform other processing operations. This can greatly reduce the data processing pressure on the electronic device end that outputs the data from the video processing card and improve its overall performance.
[0046] In other implementations, in addition to the components described in the above embodiments, the video processing card may further include: a plurality of codecs 50 disposed on the carrier 10, electrically connected to the plurality of input interfaces 20, and used to perform codec processing on the content source data. The plurality of codecs 50 are electrically connected to the processor 30, and can provide the content source data after codec processing to the processor 30.
[0047] Figure 2 The signal structure diagram of a video processing card disclosed in the embodiment of the present application is shown in FIG. Figure 2 As shown, the codec 50 is arranged between the input interface 20 and the processor 30, and specifically, it may include a decoder and an encoder, wherein the decoder is used to convert the content source data in the path into LVTTL digital video data, and the decoder is connected to the encoder signal to encode the LVTTL digital video data into Universal Serial Bus Video Class Protocol data.
[0048] That is, the decoder is used to uniformly convert the content source data received by the input interface 20 into LVTTL digital video data. As mentioned above, different input interfaces 20 can be connected to different content providers and can also support different communication protocols. In this embodiment, no matter what type of protocol the content source data received by the input interface 20 is, the decoder will uniformly convert the received content source data into LVTTL digital video data to unify the standard for subsequent processing by the processor 30.
[0049] Based on the above, the display protocols supported by the multiple input interfaces 20 are the same or different; and / or the specifications of the multiple codecs 50 are the same or different. For example, all the input interfaces in the multiple input interfaces 20 are DP interfaces; for another example, there are at least two interfaces supporting different display protocols in the multiple input interfaces 20, and the multiple input interfaces 20 include HDMI interfaces and VGA interfaces.
[0050] After the decoder uniformly decodes the content source data of each channel into LVTTL digital video data, the encoder then encodes the LVTTL digital video data into universal serial bus video class protocol data to transmit to the processor. In this embodiment, the codec uniformly converts the multiple content source data into digital video data of the same protocol type and transmits them to the processor, so that the processor can process the digital video data.
[0051] In one implementation, the processor 30 is a unique video processing unit disposed on the carrier 10, and the video processing unit has a plurality of input pins and at least one output pin. The plurality of codecs 50 can respectively establish a signal connection with the unique video processing unit through at least one input pin, so that each channel of content source data can be transmitted to the processor 30 for processing. The unique video processing unit can establish a signal connection with the output interface 40 through at least one output pin, so as to transmit the processed target output data to the output interface 40.
[0052] That is, the processor 30 and the plurality of codecs 50 are connected in a one-to-one correspondence through a plurality of input pins, and the processor 30 is also connected to the output interface 40 through an output pin.
[0053] Figure 3 The following is a schematic diagram of the application architecture of a video processing card disclosed in an embodiment of the present application. Figure 3 As shown, the overall workflow can include:
[0054] 1. Video input: The video signal input from the input interface can be in HDMI, DP, Type-C and other video formats, and is input to the Encode / Decode Controller (video stream encoding and decoding controller). Multiple channels can be input simultaneously;
[0055] 2. Decoding: The video stream codec controller decodes the received HDMI, DP, Type-C and other video stream formats and converts them into LVTTL (Low Voltage Transistor Transistor Logic) digital video streams. This process is the decoding process of the video stream. Each channel has a codec controller to decode the video stream.
[0056] 3. Encoding: The video codec controller encodes the decoded LVTTL digital video stream into UVC format and then sends it to the video processing center controller. Each channel of encoded UVC data is sent to the video processing center (processor);
[0057] 4. Video processing: The video processing center (VPU) processes all the received UVC data. The content of video processing may include but is not limited to: a) video stitching and integration, such as 360-degree seamless connection processing of video data from multiple cameras; b) video optimization and selection, such as screening multiple videos of the same scene collected to keep only the clearest or most complete video; c) artificial intelligence related processing, such as automatically capturing and saving records of a specific need (for example, after tracking a person's appearance, all video time periods related to the person are captured, etc.);
[0058] 5. Video output: The video data processed by the video processing unit (VPU) is uniformly output to the host in UVC format. In this way, the host gets the processed video data without the need for the host CPU or GPU to process it again.
[0059] In other implementations, the processor 30 is further connected to the output interface 40 and a control pin in at least one input interface 20 by signal, and the control pin is used for the electronic device to send a control instruction to the corresponding content source provider.
[0060] The control pin may be a reverse control pin, wherein reverse control refers to the electronic device controlling the control operation of the content provider through the processor 30. In practical applications, the reverse control pin may be a CEC pin or an AUX auxiliary pin or other reserved pin, and this application does not impose any fixed restrictions on this.
[0061] In this embodiment, the electronic device can realize reverse control over the content provider, and send the control instruction to the video processing center (VPU) through the UVC interface. The video processing center will parse the control instruction and then send it to the content provider device to realize reverse control of the electronic device over the input device, such as controlling the power on and off of each content provider device, modifying the screen resolution and refresh rate of each content provider device, modifying the horizontal and vertical screen display, modifying the light intensity of the input device, etc. This design allows the user to directly control each content provider device at the electronic device end (host end) without having to go to the content provider device to modify the configuration in person.
[0062] In the implementation, after the video processing center parses the control instructions of the electronic device, there are many ways to control the input device. For example, in one implementation, for the standard HDMI type content provider, the CEC (Consumer Electronics Control) pin can be used, and for the standard DP or Type-C type content provider, the AUX (Auxiliary) signal can be used to convey the control instructions to the content provider device. Of course, the premise is that the content provider device has a jointly negotiated protocol and is designed accordingly. In other implementations, for product chains with their own ecosystems (with communication protocols defined by brands or cooperative enterprises themselves), a special pin can also be defined for reverse control and transmission of control instructions.
[0063] The video processing card described in this embodiment can integrate multiple content sources together and process them centrally, and then output the processed data to the electronic device for direct use. In this way, the electronic device will no longer need to process the received video data, reducing the video processing pressure and improving the overall performance. In addition, in this solution, the user can reversely control the content provider through the electronic device without having to go to each content provider device on site to control and configure it, which greatly facilitates user management.
[0064] In one implementation, the output interface 40 may further include a power supply pin, and the power supply pin can obtain power data from an electronic device after the output interface 40 is connected to the electronic device, so as to supply power to the processor 30 and the plurality of codecs 50 .
[0065] That is, after the output interface 40 establishes a connection with the electronic device, in addition to being able to transmit data and instructions through the output interface 40, it can also transmit electrical energy. The electronic device can supply power to the video processing card through the output interface 40, so that the video processing card does not need to be connected to other power sources, avoiding the complexity of unnecessary power lines, and making the video processing card suitable for a variety of scenarios.
[0066] In one implementation, the video processing card may further include an indication component disposed on the carrier 10 , and the indication component may indicate the working status of the processor 30 and / or the plurality of codecs 50 .
[0067] The indicating component may be an indicator light, and the indicator light may be one or more, and is used to indicate the working state of the processor 30 and / or the plurality of codecs 50, so that the user can understand the working state of the video processing card in real time. For example, the indicating component includes a first indicator light corresponding to the processor 30, and a plurality of second indicator lights corresponding to the plurality of codecs 50, respectively. The appearance of the first indicator light and the second indicator light may be different, or there may be corresponding device identifications next to different indicator lights, so that the user can identify them. The indicator lights may indicate different working states by different colors, or may indicate different working states by the state of lighting up / extinguishing.
[0068] In one implementation, the video processing card may further include a housing, the housing is formed with a storage space, and the carrier 10 is disposed in the storage space. The housing further includes a avoidance opening corresponding to the input interface 20 and the output interface 40, the avoidance opening is connected to the storage space, and the input interface 20 and the output interface 40 are at least partially exposed outside the housing through the avoidance opening.
[0069] The housing can provide support and protection for the components of the video processing card. From the appearance of the housing, the internal components, including the carrier, processor, codec, etc., are not visible, and the multiple input interfaces 20 and the output interface 40 are only exposed on one side for connecting to the content provider, so as to facilitate connecting to the content provider through the corresponding cable. The indicator component in the above content can also be set on the housing so that the user can observe it intuitively.
[0070] Furthermore, the present application also discloses an electronic device, which may include any one of the video processing cards in the aforementioned embodiments. The video processing card may at least include: a carrier 10 for carrying and conducting electronic components; multiple input interfaces 20 arranged on the carrier 10, which are used to obtain content source data provided by the content source provider after establishing a connection with the corresponding content source provider; at least one processor 30 arranged on the carrier 10, which can process the obtained multiple content source data into target output data; an output interface 40 arranged on the carrier 10, which is used to directly output the target output data to the target application of the electronic device after establishing a connection with an electronic device.
[0071] The video processing card of the electronic device described in the present application solution includes a processor, which can integrate multiple content source data into one place and process the multiple content source data accordingly. Therefore, the content source data can be processed directly based on the needs of downstream applications or businesses. The target output data outputted thereby can be directly provided to the consumer application or business for use after conversion through the UVC protocol, without the need for the processor of the downstream application or business system to perform other processing operations; this can greatly reduce the data processing pressure on the electronic device end where the video processing card outputs data, and improve its overall performance.
[0072] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0073] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A video processing card, characterized in that: include: A carrier (10) for carrying and conducting electronic components; A plurality of input interfaces (20) arranged on the carrier (10) and used to obtain content source data provided by the content source providing end after establishing a connection with the corresponding content source providing end; At least one processor (30) arranged on the carrier (10) is capable of processing the obtained multiple content source data into target output data; The output interface (40) arranged on the carrier (10) is used to directly output the target output data to a target application of an electronic device after establishing a connection with the electronic device.
2. The video processing card according to claim 1, characterized in that: Also includes: A plurality of codecs (50) arranged on the carrier (10), electrically connected to the plurality of input interfaces (20) correspondingly, and used for performing codec processing on the content source data; The plurality of codecs (50) are electrically connected to the processor (30) and are capable of providing the content source data after codec processing to the processor (30).
3. The video processing card according to claim 2, characterized in that: The codec (50) comprises: A decoder, used for converting content source data in the channel into LVTTL digital video data; The encoder is connected to the decoder signal and is used to encode the LVTTL digital video data into Universal Serial Bus Video Class protocol data.
4. The video processing card according to claim 2, characterized in that: The processor (30) is the only video processing unit arranged on the carrier (10), and the video processing unit has a plurality of input pins and at least one output pin; The plurality of codecs (50) respectively establish a signal connection with the unique video processing unit via at least one input pin; The unique video processing unit establishes a signal connection with the output interface (40) via at least one output pin.
5. The video processing card according to claim 2, characterized in that: The display protocols supported by the multiple input interfaces (20) are the same or different; and / or, The specifications of the plurality of codecs (50) are the same or different.
6. The video processing card according to claim 1, characterized in that: The processor (30) is also signal-connected to the output interface (40) and a control pin in at least one input interface (20), wherein the control pin is used for the electronic device to send a control instruction to a corresponding content source provider.
7. The video processing card according to claim 1, characterized in that: The output interface (40) also includes a power supply pin, which can obtain power data from an electronic device after the output interface (40) is connected to the electronic device, so as to supply power to the processor (30) and the plurality of codecs (50).
8. The video processing card according to claim 2, characterized in that: It also includes an indication component arranged on the carrier (10), and the indication component is capable of indicating the working status of the processor (30) and / or the plurality of codecs (50).
9. The video processing card according to claim 1, characterized in that: It also includes a shell, the shell is formed with a receiving space, and the carrier (10) is arranged in the receiving space; The shell further comprises a relief opening arranged corresponding to the input interface (20) and the output interface (40), the relief opening being in communication with the accommodation space, and the input interface (20) and the output interface (40) being at least partially exposed outside the shell through the relief opening.
10. An electronic device, characterized in that: The method comprises the video processing card as claimed in any one of claims 1 to 9.