Photoelectric video balanced transmission processing method and device, electronic equipment and storage medium

Abstract

The invention belongs to the technical field of image processing, and particularly discloses a photoelectric video balanced transmission processing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining line and field synchronization signals corresponding to multiple paths of photoelectric video data; acquiring a line synchronization count, a field synchronization count and a frame count in the line and field synchronization signal; based on the line synchronization count, the field synchronization count and the frame count, determining reading priorities respectively corresponding to the multiple paths of photoelectric video data; and reading and outputting the multi-channel photoelectric video data based on the reading priority. The method can reduce the performance requirement and cost of photoelectric video data transmission on a hardware platform.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and more specifically, relates to a method, device, electronic device and storage medium for photoelectric video balanced transmission processing. Background Art

[0002] When using fiber channels or high-speed networks to transmit ultra-high-resolution optoelectronic video data, due to the large amount of data transmitted, a large bandwidth is usually occupied, and abnormal fluctuations may occur on the transmission line or switching node, resulting in a large amount of data backlog and burst transmission, which makes it impossible for the back-end display device to process it in time, resulting in video data packet loss, and ultimately causing the optoelectronic video display screen to jitter or freeze, affecting user observation. Therefore, it is necessary to solve the problem of burst transmission of large amounts of video data, so that the transmission volume of video data in each time period fluctuates less, the bandwidth occupancy is more balanced, and avoid the situation where a large amount of sudden video data cannot be processed in time.

[0003] The current mainstream solution is to achieve balanced data transmission on the data transmission link by real-time monitoring of transmission status, optimizing link structure, dynamic networking, and real-time configuration of switching nodes. However, due to the complex algorithms for the functions of real-time monitoring of transmission status and dynamic configuration, specific software and hardware platform support is required, and the collaborative design capabilities of the entire software and hardware system are required to be high and the cost is high. It is difficult to achieve in technical solutions with average hardware platform performance and strict cost control. Summary of the invention

[0004] In view of the defects of the prior art, the purpose of this application is to provide an optoelectronic video balanced transmission processing method, device, electronic device and storage medium, aiming to solve the problem that the prior art has complex algorithms and requires specific software and hardware platform support, resulting in high requirements for software and hardware system collaborative design capabilities and high costs.

[0005] To achieve the above objectives, in a first aspect, the present application provides a method for photoelectric video balanced transmission processing, comprising: Obtaining line and field synchronization signals corresponding to multiple channels of optoelectronic video data; Acquire a line synchronization count, a field synchronization count and a frame count in the line and field synchronization signal; Based on the line synchronization count, the field synchronization count and the frame count, determining the reading priorities respectively corresponding to the multiple channels of optoelectronic video data; The multiple channels of optoelectronic video data are read and output based on the read priority.

[0006] This application detects the line and field synchronization signals of each channel of optoelectronic video in real time, sets the reading priority of each channel of optoelectronic video data based on the line synchronization count, field synchronization count and frame count, and controls the video data reading and writing of the external memory according to the reading priority relationship, so as to achieve smaller fluctuations in the transmission volume of optoelectronic video data in each time period and more balanced bandwidth occupancy, avoiding the situation where a large amount of sudden video data cannot be processed in time by the back-end display device. The algorithm is simple, the hardware cost is low, the implementation effect is good, multiple functional modules can be flexibly reused and expanded, the performance requirements for the hardware platform are low, and the portability is high.

[0007] According to a method for balanced transmission of optoelectronic video provided by the present application, after acquiring the line and field synchronization signals respectively corresponding to the multiple channels of optoelectronic video data, the method further includes: A corresponding number of ping-pong buffers are set according to the number of optoelectronic video channels, and the optoelectronic video data of each channel is written into the ping-pong buffer respectively.

[0008] Since the clock for receiving video data is different from the clock for writing data to the external memory, the present application writes the video data into the ping-pong buffer, thereby realizing asynchronous processing of the video data across clock domains.

[0009] According to a method for photoelectric video balanced transmission processing provided by the present application, after acquiring the line synchronization count, field synchronization count and frame count in the line and field synchronization signal, the method further includes: matching a standard resolution based on the line sync count, field sync count, and frame count; Based on the standard resolution, a standard line and field synchronization signal is generated.

[0010] After the optical and electrical videos are mixed and transmitted, abnormal fluctuations may occur on the transmission lines or switching nodes, resulting in a large amount of data backlog and burst transmission. At this time, the received line and field synchronization signals can no longer reflect their original resolution. Therefore, the present application finds the standard resolution corresponding to the video according to the line synchronization count, field synchronization count and frame count of each optical and electrical video.

[0011] According to a method for balanced transmission of optoelectronic video provided by the present application, the reading priorities corresponding to the multiple optoelectronic video data are determined based on the line synchronization count, the field synchronization count and the frame count, including: Calculating total counts corresponding to multiple channels of optoelectronic video data respectively, wherein the total count is the product of the line synchronization count, the field synchronization count and the frame count; The reading priorities corresponding to the multiple channels of optoelectronic video data are set in descending order of total count.

[0012] According to a method for balanced transmission of optoelectronic video provided by the present application, the reading and outputting of the multiple optoelectronic video data based on the reading priority includes: Read the multiple channels of optoelectronic video data in sequence according to the reading priority, and suspend the reading process of other channels of optoelectronic video data during the reading process; The read multiple channels of optoelectronic video data are buffered and then output.

[0013] According to a method for balanced transmission of optoelectronic video provided by the present application, the method of caching and outputting the read multiple optoelectronic video data includes: Writing the read multi-channel optoelectronic video data into a preset output buffer; When the output buffer completes writing of a line of optoelectronic video data, it is immediately read and transmitted to the unified output interface for output.

[0014] In a second aspect, the present application provides an optoelectronic video balanced transmission processing device, comprising: A construction module is used to construct a global unified graphics memory management interface based on the computing fast link CXL protocol on a local server, wherein the global unified graphics memory management interface is used to implement global unified management of graphics memory resources; The sharing module is used to share the video memory of the local server with the user terminal based on the remote direct memory access RDMA protocol.

[0015] In a third aspect, the present application provides an electronic device comprising: at least one memory for storing programs; and at least one processor for executing the programs stored in the memory. When the programs stored in the memory are executed, the processor is used to execute the optoelectronic video balanced transmission processing method described in the first aspect or any possible implementation method of the first aspect.

[0016] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the optoelectronic video balanced transmission processing method described in the first aspect or any possible implementation of the first aspect.

[0017] In a fifth aspect, the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the optoelectronic video balanced transmission processing method described in the first aspect or any possible implementation of the first aspect.

[0018] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0019] In general, the above technical solutions conceived by this application have the following beneficial effects compared with the prior art: By real-time detection of the line and field synchronization signals of each channel of optoelectronic video, the reading priority of each channel of optoelectronic video data is set based on the line synchronization count, field synchronization count and frame count, and the video data read and write control of the external memory is performed according to the reading priority relationship, so as to achieve smaller fluctuations in the transmission volume of optoelectronic video data in each time period and more balanced bandwidth occupancy, avoiding the situation where a large amount of sudden video data cannot be processed in time by the back-end display device. The algorithm is simple, the hardware cost is low, the implementation effect is good, multiple functional modules can be flexibly reused and expanded, the performance requirements of the hardware platform are low, and the portability is high. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the present application or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 It is a flowchart of the optoelectronic video balanced transmission processing method provided in an embodiment of the present application; Figure 2 It is a schematic diagram of the architecture of the optoelectronic video balanced transmission processing method provided in an embodiment of the present application; Figure 3 It is a structural diagram of an optoelectronic video balanced transmission processing device provided in an embodiment of the present application; Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0023] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The symbol " / " in this article indicates that the associated objects are in an or relationship, for example, A / B means A or B.

[0024] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0025] In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two. For example, multiple processing units refer to two or more processing units, etc.; multiple elements refer to two or more elements, etc.

[0026] Next, combine Figure 1-Figure 2 The optoelectronic video balanced transmission processing method provided in the embodiment of the present application is introduced.

[0027] Figure 1 is a flow chart of the optoelectronic video balanced transmission processing method provided in the embodiment of the present application, such as Figure 1 As shown, the method comprises the following steps: Step 100, obtaining line and field synchronization signals corresponding to multiple channels of optoelectronic video data respectively; Optionally, multiple channels of mixed optoelectronic video data may be received and then demultiplexed to obtain multiple channels of optoelectronic video data.

[0028] The multi-channel mixed video data contains the channel number, which indicates which video the current data packet belongs to. Each data packet can be selected according to the channel number, and the data packets with the same channel number belong to the same video.

[0029] While obtaining multiple channels of optoelectronic video data, the corresponding line and field synchronization signals can be obtained respectively.

[0030] Step 110, obtaining a line synchronization count, a field synchronization count and a frame count in a line and field synchronization signal; After acquiring the line and field synchronization signals, they are detected, that is, the high-level duration of the line synchronization signal and the field synchronization signal are counted respectively to obtain the line synchronization count HScnt, the field synchronization count VScnt and the frame count Fcnt, wherein HScnt refers to the pixel clock cycle count during the high-level duration of the line synchronization signal, VScnt refers to the line synchronization signal cycle count during the high-level duration of the field synchronization signal, and Fcnt refers to the frame count within 1 second.

[0031] Step 120, determining the reading priorities corresponding to the multiple channels of optoelectronic video data respectively based on the line synchronization count, the field synchronization count and the frame count; The memory read priority relationship is set according to the line synchronization count HScnt, the field synchronization count VScnt and the frame count Fcnt of each channel of optoelectronic video, and the priority relationship determines the reading order of each channel of optoelectronic video data.

[0032] Step 130 , reading and outputting multiple channels of optoelectronic video data based on the reading priority.

[0033] The present application provides a method for balanced transmission of optoelectronic video, which detects the line and field synchronization signals of each channel of optoelectronic video in real time, sets the reading priority of each channel of optoelectronic video data based on the line synchronization count, field synchronization count and frame count, and performs video data read and write control on the external memory according to the reading priority relationship, thereby achieving smaller fluctuations in the transmission volume of optoelectronic video data in each time period, more balanced bandwidth occupancy, and avoiding the situation where a large amount of sudden video data cannot be processed in time by the back-end display device. The algorithm is simple, the hardware cost is low, the implementation effect is good, multiple functional modules can be flexibly reused and expanded, the performance requirements for the hardware platform are low, and the portability is high.

[0034] In some embodiments, after step 100, the method further includes: Step 101 , setting a corresponding number of ping-pong buffers according to the number of optoelectronic video channels, and writing optoelectronic video data of each channel into the ping-pong buffer respectively.

[0035] Since the clock for receiving video data is different from the clock for writing data to the external memory, the video data needs to be written into the ping-pong buffer, thereby realizing cross-clock domain asynchronous processing of the video data.

[0036] A corresponding number of ping-pong buffers are set according to the number of optoelectronic video channels that need to be processed, and the size of the ping-pong buffer can be determined according to the maximum line synchronization count of each optoelectronic video channel. However, in actual use, the number and size of the ping-pong buffers are pre-set according to the current hardware platform processing capability and the commonly used video resolution. In one embodiment of the present application, the number of ping-pong buffers can be set to 16, and the buffer size can be set to 3840, and a corresponding number of ping-pong buffers can be used in a one-to-one correspondence with the number of optoelectronic video channels.

[0037] When the horizontal synchronization signal and the field synchronization signal of each optoelectronic video are both at high level, the video data is written into the ping-pong buffer and waits for reading.

[0038] In some embodiments, after step 110, the method further includes: Step 111, matching the standard resolution based on the line synchronization count, the field synchronization count and the frame count; Step 112: Generate a standard horizontal and vertical synchronization signal based on the standard resolution.

[0039] In the Video Electronics Standards Association (VESA) standard, there are specific provisions for the horizontal and vertical synchronization signals and frame rates of video data that conform to the standard, that is, how many pixel clock cycles each horizontal synchronization signal cycle lasts, and how many horizontal synchronization signal cycles each field synchronization signal cycle contains are clearly specified.

[0040] After the mixed transmission of various optical and electrical videos, abnormal fluctuations may occur on the transmission lines or switching nodes, resulting in a large amount of data backlog and burst transmission. At this time, the received line and field synchronization signals can no longer reflect their original resolution. Therefore, it is necessary to find out the standard resolution corresponding to the video according to the line synchronization count HScnt, field synchronization count VScnt and frame count Fcnt of each optical and electrical video, and generate standard line and field synchronization signals according to the preset standard resolution parameters.

[0041] The resolution matching unit has multiple sets of commonly used resolution parameters preset. For example, if the line synchronization count HSCnt of a certain optical video is detected to be 1920, the field synchronization count VScnt is 1080, and the frame count Fcnt is 60, then according to the preset commonly used resolution parameters, the VESA standard resolution of the optical video is matched to 1920×1080@60Hz.

[0042] The resolution matching unit can generate pixel clock and standard line field synchronization signal according to the five parameters of pixel clock frequency, number of pixels for line effective signal and line blanking signal, and number of lines for field effective signal and field blanking signal given in the VESA standard resolution. For example, for the commonly used resolution 1920×1080@60Hz, the VESA standard gives its pixel clock frequency as 148.5MHz, the line effective signal lasts for 1920 pixel clock cycles, the line blanking signal lasts for 280 pixel clock cycles, the field effective signal lasts for 1080 lines, and the field blanking signal lasts for 45 lines. The resolution matching unit generates a 148.5MHz pixel clock, and then uses the clock to generate line field synchronization signal. The high level of each cycle of the line synchronization signal lasts for 1920 pixel clock cycles, and the low level lasts for 280 pixel clock cycles. One cycle of the line synchronization signal represents one line of the optoelectronic video. The high level of each cycle of the field synchronization signal lasts for 1080 lines, and the low level lasts for 45 lines. One cycle of the field synchronization signal represents one frame of the optoelectronic video.

[0043] In some embodiments, step 120 specifically includes: Step 1201, calculating the total counts corresponding to the multiple channels of optoelectronic video data, where the total count is the product of the line synchronization count, the field synchronization count and the frame count; Step 1202, setting the reading priorities corresponding to the multiple channels of optoelectronic video data in descending order of total counts.

[0044] The memory read priority relationship is set according to the line synchronization count HScnt, field synchronization count VScnt and frame count Fcnt of each optical video. By calculating the total count Tcnt of each optical video, it is determined that the branch video data with a relatively large Tcnt value has a higher priority for reading from the external memory. The Tcnt calculation formula is as follows: ; Among them, HSCnt refers to the pixel clock cycle count during the period when the horizontal synchronization signal is at a high level, VScnt refers to the horizontal synchronization signal cycle count during the period when the vertical synchronization signal is at a high level, and Fcnt refers to the frame count within 1 second.

[0045] In some embodiments, step 130 specifically includes: Step 1301, reading multiple channels of optoelectronic video data in sequence according to the reading priority, and pausing the reading process of other channels of optoelectronic video data during the reading process; Step 1302, buffering and outputting the read multi-channel optoelectronic video data.

[0046] First, according to the number of video channels, a corresponding number of areas can be divided in the external memory to store the video data of each channel. Since the storage space of the external memory is large and meets the storage requirements of multiple video data, for the convenience of processing, the size of the divided area can be determined according to the row and column count of the maximum video resolution. For example, the current commonly used maximum video resolution is 3840×2160@30Hz. When storing multiple video data in the external memory, a storage area with 3840 columns and 2160 rows can be designated for each video. Each frame of data of each video channel is written into its corresponding storage area in the external memory, and is also read from this storage area when reading.

[0047] An external memory read signal is generated according to the standard line field synchronization signal of each optoelectronic video, and each optoelectronic video data is read from the external memory according to the external memory read signal. When the external memory read signals of multiple optoelectronic videos arrive at the same time, they are processed according to the read priority relationship, that is, the optoelectronic video data with higher priority is read first, and the optoelectronic video reading process with lower priority is suspended at this time. After the optoelectronic video reading process with higher priority is completed, the optoelectronic video with lower priority is resumed to read. After the optoelectronic video reading process from the external memory is completed, an external memory write signal with a corresponding number of clock cycles is generated according to the line synchronization count of each optoelectronic video, and the corresponding optoelectronic video data of each channel is read from the ping-pong buffer according to the external memory write signal and written into the external memory. In the process of writing to the external memory, if an external memory read signal arrives, the writing process is suspended, the reading operation is performed first, and the writing process is resumed after the reading operation is completed. The read and write operations of the external memory are all based on a row of optoelectronic video data as the basic implementation unit, that is, in a read or write process of the optoelectronic video, after all the data of a row of the optoelectronic video is read or written, the read or write process is completed.

[0048] After reading each channel of optoelectronic video data from the external memory, the data needs to be cached and then output.

[0049] In some embodiments, step 1302 specifically includes: Step 13021, writing the read multi-channel optoelectronic video data into a preset output buffer; Step 13022: When the output buffer completes writing a line of optoelectronic video data, it is immediately read and transmitted to the unified output interface for output.

[0050] A corresponding number of output buffers may be set according to the number of optoelectronic video channels to be processed, and the size of the output buffer may be determined according to the maximum line synchronization count of each optoelectronic video channel. However, in actual use, the number and size of the output buffers are pre-set according to the current hardware platform processing capability and the commonly used video resolution. In one embodiment of the present application, the number of output buffers may be set to 16, and the buffer size may be set to 3840, and a corresponding number of output buffers may be used in a one-to-one correspondence with the number of optoelectronic video channels.

[0051] Each channel of optoelectronic video data read from the external memory is written into its corresponding output buffer. When the output buffer completes writing of a row of optoelectronic video data, it is read immediately. The optoelectronic video data read from each output buffer is uniformly output as mixed optoelectronic video data after balanced transmission processing.

[0052] It should be noted that as long as a row of data of a certain video is completely read from its corresponding output cache, it is immediately transmitted to the unified output interface for output. There is no need to wait for all videos to be read or for all rows of data of the video to be read.

[0053] Figure 2 Schematic diagram of the architecture of the optoelectronic video balanced transmission processing method provided in the embodiment of the present application, such as Figure 2 As shown, in some embodiments, the present application implements optoelectronic video balanced transmission processing through a video data branch selection unit, a ping-pong buffer unit, a line field synchronization detection unit, a resolution matching unit, a read priority setting unit, a memory read and write control unit, an output buffer unit and an external memory, wherein: The video data branch selection unit is used to select the multi-channel mixed optoelectronic video data according to their channel numbers and send them to the ping-pong buffer unit and the line-field synchronization detection unit respectively; The ping-pong buffer unit is used to receive and buffer the optical video data of each channel sent by the video data branch selection unit. After the optical video data of each channel arrives, it is immediately written into its corresponding ping-pong buffer, and then the video data is read out according to the external memory write signal and sent to the memory read-write control unit; The line and field synchronization detection unit is used to receive the optical video data of each channel sent by the video data branch selection unit, detect the line and field synchronization signals of each channel of optical video, that is, count the high level duration of the line synchronization signal and the field synchronization signal respectively, and send the obtained line synchronization count HScnt, field synchronization count VScnt and frame count Fcnt to the resolution matching unit and the memory read and write control unit; The resolution matching unit matches the standard resolution according to the received line synchronization count HScnt, field synchronization count VScnt and frame count Fcnt, generates the optoelectronic video standard line and field synchronization signals according to the standard resolution parameters, sends the line synchronization count HScnt, field synchronization count VScnt and frame count Fcnt of each optoelectronic video to the read priority setting unit, and sends the standard line and field synchronization signals of each optoelectronic video to the memory read and write control unit; The read priority setting unit calculates the memory read priority relationship according to the line synchronization count HScnt, field synchronization count VScnt and frame count Fcnt of each optoelectronic video, and sends a priority setting command to the memory read and write control unit; The memory read / write control unit generates an external memory read signal according to the standard line and field synchronization signals of each channel of optoelectronic video sent by the resolution matching unit and the priority setting command sent by the read priority setting unit, performs a read operation on the external memory, and sends the read optoelectronic video data of each channel to the output buffer unit. After completing the external register reading process, an external memory write signal of a corresponding number of clock cycles is generated according to the line synchronization count of each channel of optoelectronic video sent by the line and field synchronization detection unit, and the corresponding optoelectronic video data of each channel is read from the ping-pong buffer unit according to the external memory write signal and written into the external memory.

[0054] The output buffer unit is used to receive and buffer the optoelectronic video data of each channel read from the external memory. When the output buffer completes writing a row of optoelectronic video data, it is read immediately. The optoelectronic video data read from each output buffer is uniformly output as multi-channel mixed optoelectronic video data after balanced transmission processing.

[0055] The external memory is used to read and write the optoelectronic video data of each channel according to the read and write instructions of the memory read and write control unit.

[0056] Figure 3 is a structural diagram of the optoelectronic video balanced transmission processing device provided in an embodiment of the present application, such as Figure 3 As shown, the device includes a first acquisition module 310, a second acquisition module 320, a determination module 330 and a transmission module 340, wherein: The first acquisition module 310 is used to acquire the line and field synchronization signals corresponding to the multiple channels of optoelectronic video data; The second acquisition module 320 is used to acquire the line synchronization count, the field synchronization count and the frame count in the line and field synchronization signal; A determination module 330, for determining the reading priorities respectively corresponding to the multiple channels of optoelectronic video data based on the line synchronization count, the field synchronization count and the frame count; The transmission module 340 is used to read and output multiple channels of optoelectronic video data based on the reading priority.

[0057] It should be understood that the above-mentioned device is used to execute the method in the above-mentioned embodiment. The implementation principle and technical effect of the corresponding program module in the device are similar to those described in the above-mentioned method. The working process of the device can refer to the corresponding process in the above-mentioned method, which will not be repeated here.

[0058] Based on the method in the above embodiment, Figure 4 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 4As shown, an embodiment of the present application provides an electronic device, which may include: a processor (processor) 410, a communication interface (CommunicationsInterface) 420, a memory (memory) 430 and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call the logic instructions in the memory 430 to execute the optoelectronic video balanced transmission processing method in the above embodiment.

[0059] In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the optoelectronic video balanced transmission processing method described in each embodiment of the present application.

[0060] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the optoelectronic video balanced transmission processing method in the above embodiment.

[0061] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the optoelectronic video balanced transmission processing method in the above embodiment.

[0062] It is understandable that the processor in the embodiment of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0063] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0064] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0065] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.

[0066] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for photoelectric video balanced transmission processing, characterized in that: include: Obtaining line and field synchronization signals corresponding to multiple channels of optoelectronic video data; Acquire a line synchronization count, a field synchronization count and a frame count in the line and field synchronization signal; Based on the line synchronization count, the field synchronization count and the frame count, determining the reading priorities respectively corresponding to the multiple channels of optoelectronic video data; The multiple channels of optoelectronic video data are read and output based on the read priority.

2. The optoelectronic video balanced transmission processing method according to claim 1, characterized in that: After acquiring the line and field synchronization signals respectively corresponding to the multiple channels of optoelectronic video data, the method further includes: A corresponding number of ping-pong buffers are set according to the number of optoelectronic video channels, and the optoelectronic video data of each channel is written into the ping-pong buffer respectively.

3. The optoelectronic video balanced transmission processing method according to claim 1, characterized in that: After acquiring the line synchronization count, the field synchronization count and the frame count in the line and field synchronization signal, the method further includes: matching a standard resolution based on the line sync count, field sync count, and frame count; Based on the standard resolution, a standard line and field synchronization signal is generated.

4. The optoelectronic video balanced transmission processing method according to claim 1, characterized in that: The determining the reading priorities respectively corresponding to the multiple channels of optoelectronic video data based on the line synchronization count, the field synchronization count and the frame count includes: Calculating total counts corresponding to multiple channels of optoelectronic video data respectively, wherein the total count is the product of the line synchronization count, the field synchronization count and the frame count; The reading priorities corresponding to the multiple channels of optoelectronic video data are set in descending order of total count.

5. The optoelectronic video balanced transmission processing method according to claim 1, characterized in that: The reading and outputting of the multiple channels of optoelectronic video data based on the reading priority includes: Read the multiple channels of optoelectronic video data in sequence according to the reading priority, and suspend the reading process of other channels of optoelectronic video data during the reading process; The read multiple channels of optoelectronic video data are buffered and then output.

6. The optoelectronic video balanced transmission processing method according to claim 5, characterized in that: The step of caching and outputting the read multiple-channel optoelectronic video data comprises: Writing the read multi-channel optoelectronic video data into a preset output buffer; When the output buffer completes writing of a line of optoelectronic video data, it is immediately read and transmitted to the unified output interface for output.

7. An optoelectronic video balanced transmission processing device, characterized in that: include: The first acquisition module is used to acquire the line and field synchronization signals respectively corresponding to the multiple channels of optoelectronic video data; A second acquisition module, used for acquiring a line synchronization count, a field synchronization count and a frame count in the line and field synchronization signal; A determination module, used for determining the reading priorities respectively corresponding to the multiple channels of optoelectronic video data based on the line synchronization count, the field synchronization count and the frame count; A transmission module is used to read and output the multiple channels of optoelectronic video data based on the reading priority.

8. An electronic device, characterized in that: include: at least one memory for storing a computer program; At least one processor is used to execute the program stored in the memory. When the program stored in the memory is executed, the processor is used to execute the optoelectronic video balanced transmission processing method as described in any one of claims 1-6.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program runs on a processor, the processor executes the optoelectronic video balanced transmission processing method according to any one of claims 1 to 6.

10. A computer program product, characterized in that When the computer program product runs on a processor, the processor executes the optoelectronic video balanced transmission processing method according to any one of claims 1 to 6.

Images