Video signal processing method and device, equipment, storage medium and program product
Patent Information
- Application Number
- CN202411655119.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-19
- Publication Date
- 2025-02-18
AI Technical Summary
The prior art lacks flexibility when processing video signals and cannot match the analysis needs of different terminals, resulting in the analysis terminal being unable to obtain complete video data or being unable to parse the video signals.
By obtaining the signal synchronization information of the original video signal at non-standard resolution, and converting the signal synchronization information based on the pixel missing information between the target resolution and the non-standard resolution, it can match the target resolution, thereby performing video signal processing .
The video signal at non-standard resolution is realized to be fully displayed at the target resolution, which improves the flexibility of video signal processing and avoids the problem that the analysis terminal cannot analyze the video signal.
Smart Images

Figure CN119484920A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of signal processing technology, and in particular to a video signal processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art
[0002] With the development of science and technology, video signal processing technology is also constantly iterating. In order to meet the display requirements of videos on different terminals, processing video signals based on the VESA (Video Electronics Standards Association) standard is one of the common solutions. For example, FPGA (Field Programmable Gate Array) is used to process video signals into 818 video signals that comply with the ARINC818 protocol.
[0003] At present, in the process of processing video signals, signal data is usually processed at the source end, and then the required video resolution is written into the program logic according to the VESA standard. However, since the standard resolution defined by the VESA standard is limited and at the same time, the resolutions between terminals in different application scenarios are different, the video signal transmitted by the source end cannot match the parsing requirements of the parsing terminal, which makes it easy for the parsing terminal to fail to obtain complete video data or fail to parse the video signal after parsing the video signal. Therefore, the current video signal processing has low processing flexibility. Summary of the invention
[0004] Based on this, it is necessary to provide a video signal processing method, apparatus, computer equipment, computer-readable storage medium and computer program product to improve the processing flexibility of video signal processing in order to address the above technical problems.
[0005] In a first aspect, the present application provides a video signal processing method, comprising:
[0006] Acquire first signal synchronization information corresponding to an original video signal at a non-standard resolution, wherein the first signal synchronization information is used to characterize at least one of a line synchronization feature and a field synchronization feature of the original video signal;
[0007] According to pixel missing information between the non-standard resolution and the target resolution, converting the first signal synchronization information into second signal synchronization information matching the target resolution;
[0008] The original video signal is processed according to the second signal synchronization information to obtain a target video signal.
[0009] In one of the embodiments, converting the first signal synchronization information into second signal synchronization information matching the target resolution according to pixel missing information between the non-standard resolution and the target resolution includes:
[0010] In a case where it is detected based on the pixel missing information that the original video signal satisfies a preset signal conversion condition, determining a target resolution corresponding to the original video signal according to the first signal synchronization information, and converting the first signal synchronization information into second signal synchronization information according to a correlation relationship between the target resolution and a standard resolution;
[0011] When it is detected based on the pixel missing information that the original video signal does not satisfy the preset signal conversion condition, the pixel conversion difference between the non-standard resolution and the target resolution is determined according to the pixel missing information, and the first signal synchronization information is converted into the second signal synchronization information according to the pixel conversion difference.
[0012] In one embodiment, converting the first signal synchronization information into the second signal synchronization information according to the association relationship between the target resolution and the standard resolution includes:
[0013] If the target resolution is the standard resolution, using the first signal synchronization information as the second signal synchronization information;
[0014] If the target resolution is not the standard resolution, the second signal synchronization information is generated according to the first signal synchronization information.
[0015] In one embodiment, determining the target resolution corresponding to the original video signal according to the first signal synchronization information includes:
[0016] Extracting first signal enable information from the first signal synchronization information;
[0017] extracting first signal line information of the original video signal from the first signal synchronization information according to a first rising edge and a first falling edge of the first signal enable information;
[0018] extracting the first signal field information of the original video signal from the first signal synchronization information according to the second rising edge and the second falling edge of the first signal line information;
[0019] The target resolution is detected according to the first signal line information and the first signal field information.
[0020] In one embodiment, generating the second signal synchronization information according to the first signal synchronization information includes:
[0021] storing the first signal line information and the first signal field information into a preset storage space according to the first signal synchronization information;
[0022] According to the target resolution and the second signal enable information at the target resolution, parsing the first signal line information into second signal line information, and parsing the first signal field information into second signal field information;
[0023] The second signal enable information, the second signal line information and the second signal field information are collectively used as the second signal synchronization information.
[0024] In one embodiment, the pixel conversion difference includes a pixel supplement value and a pixel redundancy value; and converting the first signal synchronization information into the second signal synchronization information according to the pixel conversion difference includes one of the following:
[0025] generating third signal enable information at the target resolution according to the pixel supplement value, and converting the first signal synchronization information into the second signal synchronization information according to the third signal enable information, wherein the third signal enable information is used to extend a conversion time of converting the first signal synchronization information into the second signal synchronization information;
[0026] According to the pixel redundancy value, fourth signal enable information at the target resolution is generated, and according to the fourth signal enable information, the first signal synchronization information is converted into the second signal synchronization information, wherein the fourth signal enable information is used to shorten the conversion time of converting the first signal synchronization information into the second signal synchronization information.
[0027] In a second aspect, the present application further provides a video signal processing device, comprising:
[0028] An acquisition module, used for acquiring first signal synchronization information corresponding to an original video signal at a non-standard resolution, wherein the first signal synchronization information is used for characterizing at least one of a line synchronization feature and a field synchronization feature of the original video signal;
[0029] A conversion module, configured to convert the first signal synchronization information into second signal synchronization information matching the target resolution according to pixel missing information between the non-standard resolution and the target resolution;
[0030] The processing module is used to process the original video signal according to the second signal synchronization information to obtain the target video signal.
[0031] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:
[0032] Acquire first signal synchronization information corresponding to the original video signal at a non-standard resolution; convert the first signal synchronization information into second signal synchronization information matching the target resolution based on pixel missing information between the non-standard resolution and the target resolution; and process the original video signal based on the second signal synchronization information to obtain a target video signal.
[0033] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:
[0034] Acquire first signal synchronization information corresponding to the original video signal at a non-standard resolution; convert the first signal synchronization information into second signal synchronization information matching the target resolution based on pixel missing information between the non-standard resolution and the target resolution; and process the original video signal based on the second signal synchronization information to obtain a target video signal.
[0035] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:
[0036] Acquire first signal synchronization information corresponding to the original video signal at a non-standard resolution; convert the first signal synchronization information into second signal synchronization information matching the target resolution based on pixel missing information between the non-standard resolution and the target resolution; and process the original video signal based on the second signal synchronization information to obtain a target video signal.
[0037] The above-mentioned video signal processing method, apparatus, computer equipment, computer-readable storage medium and computer program product first obtain the first signal synchronization information corresponding to the original video signal at the non-standard resolution, and then complete the conversion of the first signal synchronization information to the second signal synchronization information matching the target resolution through the pixel missing information between the non-standard resolution and the target resolution, that is, based on the display missing situation between the non-standard resolution and the target resolution, the first signal synchronization information is converted to the second signal synchronization information, that is, at least one of the line synchronization feature and the field synchronization feature of the original video signal is converted, and finally the original video signal is processed through the second signal synchronization information to obtain the target video signal, that is, the target video signal is converted. The video data obtained by analyzing the signal can be fully displayed at the target resolution, which can achieve the purpose of processing the original video signal at a non-standard resolution into a target video signal that can be fully displayed at the target resolution, rather than being able to transmit and process the video signal only at the standard resolution defined by the VESA standard. Therefore, it overcomes the technical defect that the standard resolution defined by the VESA standard is limited. At the same time, the resolutions between terminals in different application scenarios are different, resulting in the video signal transmitted by the source end being unable to match the analysis requirements of the analysis terminal, which makes it easy for the analysis terminal to fail to obtain complete video data or fail to parse the video signal after parsing the video signal. Therefore, the processing flexibility of video signal processing is improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0039] Figure 1 is a flow chart of a video signal processing method in one embodiment;
[0040] Figure 2 A schematic diagram of a scene of video signal transmission of a video signal processing method in an embodiment;
[0041] Figure 3 is a flow chart of a video signal processing method in another embodiment;
[0042] Figure 4 is a structural block diagram of a video signal processing device in one embodiment;
[0043] Figure 5 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0045] First of all, it should be understood that in the field of video communication, FC (Fibre Channel) consists of five standard layers, namely the physical link layer, the codec layer, the protocol control layer, the general service layer and the high-level protocol mapping layer. The sending and receiving of video data frames and video data packets are all implemented in the codec layer. The codec layer defines the frame structure, command set, sequence, exchange and classification service content. The codec layer defines the following four data transmission units: frame, frame sequence, frame exchange and data packet. Among them, the data frame consists of a frame start, a frame header, a data field, a redundancy check code and a frame end. In the FC network, the audio and video data stream is usually divided into a series of information blocks and sent in a certain time sequence. Each frame of video information block is encapsulated in a container for transmission. The container system is the basic unit for transmitting video stream information in the ARINC818 bus. Each container consists of a container header and a group of objects. The container header describes the location of the data in the container and the type of the object. Among them, the ARINC818 protocol is a common video communication protocol, which consists of a proprietary frame start, frame header, data payload, CRC (Cyclic Redundancy Check, cyclic redundancy check), frame end and container header and other data structures. According to the ARINC818 protocol, commonly used video signals, such as 24-bit RGB video signals, can be processed into 818 signals that comply with the ARINC818 protocol for transmission. At present, the ARINC818 source usually processes video signals at standard resolution (such as 24-bit RGB video signals) into ARINC818 format signals for output. Usually, a line of 24-bit RGB video data of the video is processed into 32-bit RGB video data, that is, on the basis of red, green and blue channels, a transparency channel is added, and then the required video resolution is filled in the relevant information into the program logic according to the VESA standard. However, the above signal processing logic is only applicable to the standard resolution defined in the VESA standard. For non-standard resolutions that are not in the VESA standard, the following problems will arise: 1) A line of data with a non-standard resolution cannot completely form 32-bit RGB data; 2) Since there is no non-standard related information in the VESA standard, the user needs to manually calculate the row and field information, which makes it impossible for the ARINC818 receiver to parse the complete video data or process the video with such row and field information during the process of receiving the video signal for parsing. That is, the current processing limitations of video signal processing are high. Therefore, there is an urgent need for a video signal processing method that improves the processing flexibility of video signal processing.
[0046] In one embodiment, Figure 1As shown, a video signal processing method is provided. This embodiment takes the method applied to a terminal as an example. The terminal includes, but is not limited to, a personal computer, a laptop computer, a smart phone, and a tablet computer. The terminal includes an acquisition module, a conversion module, and a processing module. The acquisition module is used to acquire first signal synchronization information corresponding to an original video signal at a non-standard resolution. The conversion module is used to convert the first signal synchronization information into second signal synchronization information matching the target resolution according to pixel missing information between the non-standard resolution and the target resolution. The processing module is used to process the original video signal according to the second signal synchronization information to obtain a target video signal. Then, through information interaction among the acquisition module, the conversion module, and the processing module, the original video signal at the non-standard resolution can be processed into a signal matching the target resolution. The target video signal that matches the original video signal is converted, that is, at least one of the line synchronization feature and the field synchronization feature of the original video signal is converted, so as to ensure that the original video signal at the non-standard resolution can be completely parsed at the target resolution, thereby avoiding the limited standard resolution defined by the VESA standard. At the same time, the resolutions between terminals in different application scenarios are different, resulting in the video signal transmitted by the source end being unable to match the parsing requirements of the parsing terminal, and thus making it easy for the parsing terminal to fail to obtain complete video data or fail to parse the video signal after parsing the video signal. The technical defect, therefore, can improve the processing flexibility of video signal processing. It is understandable that the method can also be applied to a server, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:
[0047] Step 202: Acquire first signal synchronization information corresponding to the original video signal at a non-standard resolution, wherein the first signal synchronization information is used to characterize at least one of a line synchronization feature and a field synchronization feature of the original video signal.
[0048] It should be noted that the original video signal at a non-standard resolution does not mean that the signal quality is low or does not meet a certain standard; in some specific application scenarios, non-standard resolution may be necessary or a better choice. For example, in some video systems with high performance requirements, a resolution higher than the target resolution may be required to provide clearer images. In addition, with the continuous advancement of display technology, more new non-standard resolutions may appear in the future to adapt to the ever-changing market and user needs.
[0049] It should be noted that non-standard resolution refers to a resolution that does not meet the VESA standard definition, wherein the VESA standard definition includes VGA (640×640), SVGA (800×600) and XGA (1024×768), etc. The original video signal is a video signal converted from the video input signal based on the non-standard resolution. For example, in one practicable manner, refer to Figure 2 , Figure 2 The schematic diagram of the scene of video signal transmission is shown in FIG. 1 , wherein A is an ARINC818 source output terminal, B is an ARINC818 receiving terminal, and the video input signal is a 24-bit RGB video signal. The 24-bit RGB video signal is processed into a 32-bit RGB video signal through the ARINC818 source output terminal, that is, the ARINC818 signal is obtained by processing. A is used to send the ARINC818 signal through the optical fiber interface, and B is used to receive the optical fiber signal through the optical fiber interface and has the ARINC818 signal parsing function. The optical fiber interface refers to the electrical signal after the GTX-IP core converts it. It can be understood that since the ARINC818 signal is a signal after the common video signal is processed, some proprietary parameters related to the ARINC818 format will be set. One is that the video signal data is sent in frames, and the other is that the ARINC818 signal will send a 32-bit data frame for transmitting video-related information before each frame of video data is transmitted to parse the ARINC818 signal, and the video-related information needs to be resolved after the video signal enters the FPGA and before the video data is processed.
[0050] It should be noted that the video signal contains signal synchronization information, and the signal synchronization information is used to ensure the correct display of the video data in the video signal. The first signal synchronization information is used to characterize at least one of the line synchronization characteristics and field synchronization characteristics of the original video signal. The first signal synchronization information can specifically be signal line synchronization information, signal field synchronization information and signal enable information, wherein the signal line synchronization information is used to control the scanning synchronization of the video signal in the horizontal direction, the signal field synchronization information is used to control the scanning synchronization of the video signal in the vertical direction, and the signal enable information is used to indicate the valid data interval in the video signal.
[0051] As an example, step 202 includes: acquiring a video input signal, converting the video input signal into an original video signal at a non-standard resolution, and extracting first signal synchronization information from the original video signal.
[0052] Step 204: convert the first signal synchronization information into second signal synchronization information matching the target resolution according to the pixel missing information between the non-standard resolution and the target resolution.
[0053] It should be noted that the pixel missing information is used to characterize the pixel missing situation between the non-standard resolution and the target resolution, and can be specifically a pixel missing value. The target resolution refers to a resolution that meets user requirements. It can be understood that the first signal synchronization information and the second signal synchronization information are different signal synchronization information. The first signal synchronization information matches the non-standard resolution, and the second signal synchronization information matches the target resolution. For example, in an implementable method, the conversion rule can be set in advance through the pixel missing value between the non-standard resolution and the target resolution, and the conversion of the first signal synchronization information can be completed relying on the conversion rule.
[0054] As an example, step 204 includes: querying the conversion rule corresponding to the first signal synchronization information based on the pixel missing value between the non-standard resolution and the target resolution, and converting the first signal synchronization information according to the conversion rule to obtain the second signal synchronization information, wherein the conversion rule is used to characterize the mapping relationship between the non-standard resolution and the target resolution.
[0055] Step 206: Process the original video signal according to the second signal synchronization information to obtain a target video signal.
[0056] As an example, step 206 includes: processing the original video signal into a target video signal according to the second signal synchronization information.
[0057] In the above-mentioned video signal processing method, the input video input signal is first converted to obtain the original video signal at a non-standard resolution, and the first signal synchronization information is extracted from the original video signal, and then the pixel missing value matching conversion rule between the non-standard resolution and the target resolution is used, and the first signal synchronization information is converted into the second signal synchronization information matching the target resolution through the conversion rule, and finally the original video signal is processed into the target video signal through the second signal synchronization information, that is, at least one of the line synchronization feature and the field synchronization feature of the original video signal is converted, so that the video data obtained by parsing the target video signal can be fully displayed at the target resolution, and the original video signal at the non-standard resolution is processed into the target video signal that can be fully displayed at the target resolution. The purpose of transmitting and processing the video signal can be achieved instead of only transmitting and processing the video signal at the standard resolution defined by the VESA standard. Therefore, the technical defect that the standard resolution defined by the VESA standard is limited and the resolutions between terminals in different application scenarios are different, resulting in the video signal transmitted by the source end cannot match the parsing requirements of the parsing terminal, and thus the parsing terminal is prone to fail to obtain complete video data or fail to parse the video signal after parsing the video signal, so the processing flexibility of video signal processing is improved.
[0058] In one embodiment, Figure 3 As shown, according to the pixel missing information between the non-standard resolution and the target resolution, the first signal synchronization information is converted into the second signal synchronization information matching the target resolution, including:
[0059] Step 302, when it is detected based on the pixel missing information that the original video signal meets the preset signal conversion condition, the target resolution corresponding to the original video signal is determined according to the first signal synchronization information, and the first signal synchronization information is converted into the second signal synchronization information according to the correlation relationship between the target resolution and the standard resolution.
[0060] It should be noted that since the matching relationship between the non-standard resolution and the target resolution is unknown, it is necessary to detect whether the preset signal conversion conditions are met in the process of converting the original video signal to the target video signal through pixel missing information. It can be understood that if the standard resolution and the target resolution match, the first signal synchronization information can be directly converted. If the standard resolution and the target resolution do not match, it is necessary to complete the pixel difference to prevent the loss of video data.
[0061] It should be noted that the preset signal conversion condition is set by the user according to the needs. For example, the preset signal conversion condition can be whether the pixel missing value is a preset pixel missing threshold value, that is, if the pixel missing value is the preset pixel missing threshold value, it means that the original video signal meets the preset signal conversion condition. If the pixel missing value is not the preset pixel missing threshold value, it means that the original video signal does not meet the preset signal conversion condition. The pixel missing value can be calculated based on a preset pixel missing value calculation formula. The preset pixel missing value calculation formula is as follows:
[0062]
[0063] Among them, Z is the pixel missing value, Y is the non-standard resolution information of the original video signal, which can be specifically the line data length under the non-standard resolution, x is the number of the first signal channel of the original video signal, y is the number of the second signal channel of the target video signal, and the preset pixel missing threshold is 0.
[0064] It can be understood that when the pixel missing value is not 0, it means that the original video signal does not meet the preset signal conversion conditions. At the same time, since there are only integers in the FPGA language Verilog and no floating-point calculations, the calculation formula uses the remainder calculation symbol "%". When the pixel missing value is 0, it means that the target resolution and the non-standard resolution match, and then the conversion of the first signal synchronization information can be completed by detecting the correlation between the target resolution and the standard resolution, that is, the original video signal at the non-standard resolution is automatically supplemented with video data to the target video signal at the standard resolution.
[0065] As an example, step 302 includes: obtaining non-standard resolution information corresponding to the original video signal, the first signal channel number of the original video signal, and the second signal channel number of the target video signal, and determining the pixel missing value between the non-standard resolution and the standard resolution based on the non-standard resolution information, the first signal channel number, and the second signal channel number; when the pixel missing value is a preset pixel missing threshold, it is determined that the original video signal meets the preset signal conversion condition, and based on the first signal synchronization information, the standard resolution corresponding to the original video signal is determined, and based on the association between the target resolution and the standard resolution, the first signal synchronization information is converted into the second signal synchronization information.
[0066] Step 304, when it is detected based on the pixel missing information that the original video signal does not meet the preset signal conversion condition, the pixel conversion difference between the non-standard resolution and the target resolution is determined according to the pixel missing information, and the first signal synchronization information is converted into the second signal synchronization information according to the pixel conversion difference.
[0067] It should be noted that the pixel conversion difference is used to characterize the missing video data between the non-standard resolution and the target resolution, and specifically can be the length of the missing row data. For example, in one feasible method, after calculating the missing pixel value, the size of the data to be supplemented can be calculated based on the missing pixel value. When the missing pixel value is 0, it means that the preset signal conversion condition is met. When the missing pixel value is 1, it means that 3 24-bit RGB data need to be supplemented to meet the preset signal conversion condition. When the missing pixel value is 2, it means that 2 24-bit RGB data need to be supplemented to meet the preset 1 conversion condition. When the missing pixel value is 3, it means that 1 24-bit RGB data needs to be supplemented to meet the preset signal conversion condition.
[0068] As an example, step 304 includes: when it is detected that the pixel missing value is not a preset pixel missing threshold, determining that the original video signal does not meet the preset signal conversion condition, and based on the pixel missing information, querying the pixel conversion difference between the non-standard resolution and the target resolution, and based on the pixel conversion difference, converting the first signal synchronization information into the second signal synchronization information.
[0069] In this embodiment, the correlation between the original video signal and the preset signal conversion condition is detected by the pixel missing value. When the original video signal is converted to the target video signal without video data loss, the conversion of the first signal synchronization information to the second signal synchronization information is completed by directly detecting the correlation between the target resolution and the standard resolution. When the original video signal is converted to the target video signal and video data is lost, it is necessary to determine the pixel conversion difference between the non-standard resolution and the target resolution, and adaptively supplement the first signal synchronization information based on the pixel conversion difference. Therefore, it is ensured that the converted second signal synchronization information can enable the video data of the original video signal to be completely parsed at the parsing terminal. Therefore, on the basis of improving the processing flexibility of video signal processing, the processing accuracy of video signal processing is improved.
[0070] In one embodiment, according to the association relationship between the target resolution and the standard resolution, converting the first signal synchronization information into the second signal synchronization information includes:
[0071] If the target resolution is the standard resolution, the first signal synchronization information is used as the second signal synchronization information; if the target resolution is not the standard resolution, the second signal synchronization information is generated according to the first signal synchronization information.
[0072] It should be noted that the target resolution can be a standard resolution or a non-standard resolution. It can be understood that when the target resolution is not a standard resolution, the target resolution is also different from the resolution type of the non-standard resolution. When the target resolution is a standard resolution, there is no need to perform additional pixel supplementation, and the first signal synchronization information can be directly used as the second signal synchronization information. When the target resolution is not a standard resolution, it is necessary to specifically generate the second signal synchronization information. For example, in one feasible method, the target resolution can be compared with the standard resolution to compare and calculate the appropriate standard resolution size (when it is a standard resolution, it is only necessary to restore the first signal synchronization information of the original video signal. When it is not a standard resolution, it is necessary to perform subsequent DDR storage operations and data supplement operations based on the first signal synchronization information of the original video signal after calculation).
[0073] As an example, compare whether the target resolution and the standard resolution are consistent. When the target resolution and the standard resolution are consistent, the first signal synchronization information is used as the second signal synchronization information; when the target resolution and the standard resolution are inconsistent, the second signal synchronization information is generated based on the first signal synchronization information.
[0074] In this embodiment, after the preset signal conversion conditions are met, the non-standard resolution can be automatically supplemented with the standard resolution to ensure the integrity of the video signal, that is, the conversion of the first signal synchronization information to the second signal synchronization information is completed by detecting whether the target resolution and the standard resolution are consistent, thereby further improving the processing accuracy of the video signal processing.
[0075] In one embodiment, determining a target resolution corresponding to the original video signal according to the first signal synchronization information includes:
[0076] Extract the first signal enable information from the first signal synchronization information; extract the first signal line information of the original video signal from the first signal synchronization information according to the first rising edge and the first falling edge of the first signal enable information; extract the first signal field information of the original video signal from the first signal synchronization information according to the second rising edge and the second falling edge of the first signal line information; detect the target resolution according to the first signal line information and the first signal field information.
[0077] It should be noted that in some application scenarios, if the target resolution is not set in advance, real-time detection of the target resolution is required, that is, the first signal line information can be determined by the high-level duration of the first signal enable information, and then the first signal field information can be determined by the first signal line information, so that the product of the first signal line information and the first signal field information is used as the target resolution size of the video.
[0078] In an implementable manner, the high level count of the first signal enable information is calculated by detecting the rising edge of the first signal enable information, and the high level count of the first signal enable information is calculated by detecting the falling edge of the first signal enable information. At this time, the video line length is obtained. When detecting the high level count of the first signal enable information, if the high level length is greater than 10000, it can be determined that the video input has been disconnected and the subsequent steps can be ended; the rising edge count of the first signal enable information is calculated by detecting the falling edge of the first signal row information, and the rising edge count of the first signal enable information is calculated by detecting the rising edge of the first signal row information. At this time, the video column length is obtained. When detecting the rising edge count of DE, if the rising edge count is greater than 10000, it can be determined that the video input has been disconnected and the subsequent steps can be ended. At this time, the row length plus the column length can obtain the resolution of the video.
[0079] As an example, extract the first signal enable information from the first signal synchronization information; extract the first signal line information of the original video signal from the first signal synchronization information according to the first rising edge and the first falling edge of the first signal enable information; extract the first signal field information of the original video signal from the first signal synchronization information according to the second rising edge and the second falling edge of the first signal line information; and use the product of the first signal line information and the first signal field information as the target resolution. This embodiment determines the first signal line information and the first signal field information in the original video signal in real time through the first signal enable signal in the circuit, and then realizes the purpose of real-time detection to obtain the target resolution through the first signal line information and the first signal field information, thereby further improving the processing flexibility of video signal processing.
[0080] In one embodiment, generating second signal synchronization information according to first signal synchronization information includes:
[0081] According to the target resolution and the second signal enable information at the target resolution, the first signal row information is parsed into the second signal row information, and the first signal field information is parsed into the second signal field information; the second signal enable information, the second signal row information and the second signal field information are collectively used as the second signal synchronization information.
[0082] It should be noted that in the process of generating the second signal synchronization information based on the first signal synchronization information, after extracting the first signal line information and the first signal field information from the first signal synchronization information, the video data will be stored in the DDR using a ping-pong operation based on the first signal line information and the first signal field information before calculation, and the calculated second signal line information and the second signal field information will be generated. Based on the second signal line information and the second signal field information, the video data will be extracted from the DDR and filled into it using a ping-pong operation, that is, the second signal synchronization information is generated for the processing of the original video signal.
[0083] As an example, the first signal line information and the first signal field information are extracted from the first signal synchronization information, and the first signal line information and the first signal field information are stored in the designated storage space of the DDR; according to the target resolution and the second signal enable information at the target resolution, the first signal line information is parsed in the designated storage space to obtain the second signal line information, and the first signal field information is parsed in the designated storage space to obtain the second signal field information; the second signal enable information, the second signal line information and the second signal field information are integrated into the second signal synchronization information. In this embodiment, the signal line field information of the target video signal is obtained by the designated parsing processing of the first signal synchronization information, and the second signal synchronization information can be obtained by combining the second signal enable information, so as to lay a foundation for improving the processing flexibility of video signal processing.
[0084] In one embodiment, the pixel conversion difference value includes a pixel supplement value and a pixel redundancy value; and converting the first signal synchronization information into the second signal synchronization information according to the pixel conversion difference value includes one of the following:
[0085] According to the pixel complement value, third signal enable information at the target resolution is generated, and according to the third signal enable information, the first signal synchronization information is converted into second signal synchronization information, wherein the third signal enable information is used to extend the conversion time of the first signal synchronization information into the second signal synchronization information; according to the pixel redundancy value, fourth signal enable information at the target resolution is generated, and according to the fourth signal enable information, the first signal synchronization information is converted into second signal synchronization information, wherein the fourth signal enable information is used to shorten the conversion time of the first signal synchronization information into the second signal synchronization information.
[0086] It should be noted that, when the original video signal does not meet the preset signal conversion conditions, the conversion of the first signal synchronization information can be completed based on the pixel supplement value and the pixel redundancy value. For example, the missing video data length of the non-standard resolution can be supplemented based on the pixel supplement value, that is, the corresponding extended third signal enable information is generated by the pixel supplement value (if the pixel supplement value is 0, the original first signal enable information can be used and DDR storage is not required). After calculation, the video data is stored in the DDR using a ping-pong operation based on the third signal enable information before the delay and the first signal row information before the calculation. The second signal row information, the second signal field information and the data supplement are restored based on the third signal enable information and the resolution size (the second signal row information and the second signal field information at this time are in the form required for internal design and do not comply with the VESA standard). Finally, the video data is extracted from the DDR and filled into it using a ping-pong operation based on the second signal row information and the second signal field information. It can also be based on pixel redundancy. The missing video data length of the non-standard resolution is supplemented by the pixel supplement value, that is, the corresponding extended fourth signal enable information is generated by the pixel supplement value (if the pixel supplement value is 0, the original first signal enable information can be used and DDR storage is not required), and after calculation, the video data is stored in the DDR using a ping-pong operation according to the fourth signal enable information before the delay and the first signal row information before the calculation, and then the second signal row information, the second signal field information and data supplement are restored according to the fourth signal enable information and the resolution size (the second signal row information and the second signal field information at this time are in the form required for internal design and do not comply with the VESA standard), and finally, the video data is extracted from the DDR and filled into it using a ping-pong operation according to the second signal row information and the second signal field information, wherein the third signal enable information is used to extend the conversion time of the first signal synchronization information into the second signal synchronization information, and the fourth signal enable information is used to shorten the conversion time of the first signal synchronization information into the second signal synchronization information.
[0087] As an example, based on the pixel complement value, third signal enable information at the target resolution is generated, and based on the third signal enable information, the first signal row information is converted into second signal row information, and the first signal field information is converted into second signal field information; based on the pixel redundancy value, fourth signal enable information at the target resolution is generated, and based on the fourth signal enable information, the first signal row information is converted into second signal row information, and the first signal field information is converted into second signal field information.
[0088] In one feasible method, in the process of processing ARINC818 signals of non-standard resolution videos, the following three methods can be used to process the signals: automatically supplement the video data of non-standard resolution to standard resolution; supplement the missing video data length of non-standard resolution; remove the redundant video data length of non-standard resolution. The optimal solution can be selected according to the specific situation to complete the processing of non-standard videos.
[0089] Since the video data obtained by parsing the target video signal can be fully displayed at the target resolution, the purpose of processing the original video signal at a non-standard resolution into a target video signal that can be fully displayed at the target resolution can be achieved, rather than only being able to transmit and process the video signal at the standard resolution defined by the VESA standard. Therefore, the problem that the standard resolution defined by the VESA standard is limited and at the same time, the resolutions between terminals in different application scenarios are different, resulting in the video signal transmitted by the source end being unable to match the parsing requirements of the parsing terminal, and thus making it easy for the parsing terminal to fail to obtain complete video data or fail to parse the video signal after parsing the video signal is overcome. Therefore, the processing flexibility of video signal processing is improved.
[0090] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0091] Based on the same inventive concept, the embodiment of the present application further provides a video signal processing device for implementing the video signal processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more video signal processing device embodiments provided below can refer to the limitations of the video signal processing method above, and will not be repeated here.
[0092] In an exemplary embodiment, Figure 4 As shown, a video signal processing device is provided, including: an acquisition module 401, a conversion module 402 and a processing module 403, wherein:
[0093] An acquisition module 401 is used to acquire first signal synchronization information corresponding to an original video signal at a non-standard resolution, wherein the first signal synchronization information is used to characterize at least one of a line synchronization feature and a field synchronization feature of the original video signal;
[0094] A conversion module 402, configured to convert the first signal synchronization information into second signal synchronization information matching the target resolution according to pixel missing information between the non-standard resolution and the target resolution;
[0095] The processing module 403 is used to process the original video signal according to the second signal synchronization information to obtain a target video signal.
[0096] In one embodiment, the conversion module 402 is further configured to:
[0097] In a case where it is detected based on the pixel missing information that the original video signal satisfies a preset signal conversion condition, the target resolution corresponding to the original video signal is determined according to the first signal synchronization information, and the first signal synchronization information is converted into second signal synchronization information according to the association between the target resolution and the standard resolution; in a case where it is detected based on the pixel missing information that the original video signal does not satisfy the preset signal conversion condition, the pixel conversion difference between the non-standard resolution and the target resolution is determined according to the pixel missing information, and the first signal synchronization information is converted into the second signal synchronization information according to the pixel conversion difference.
[0098] In one embodiment, the conversion module 402 is further configured to:
[0099] If the target resolution is the standard resolution, the first signal synchronization information is used as the second signal synchronization information; if the target resolution is not the standard resolution, the second signal synchronization information is generated according to the first signal synchronization information.
[0100] In one embodiment, the conversion module 402 is further configured to:
[0101] Extract the first signal enable information from the first signal synchronization information; extract the first signal line information of the original video signal from the first signal synchronization information according to the first rising edge and the first falling edge of the first signal enable information; extract the first signal field information of the original video signal from the first signal synchronization information according to the second rising edge and the second falling edge of the first signal line information; detect the target resolution according to the first signal line information and the first signal field information.
[0102] In one embodiment, the conversion module 402 is further configured to:
[0103] According to the target resolution and the second signal enable information at the target resolution, the first signal row information is parsed into second signal row information, and the first signal field information is parsed into second signal field information; the second signal enable information, the second signal row information and the second signal field information are collectively used as the second signal synchronization information.
[0104] In one embodiment, the pixel conversion difference value includes a pixel supplement value and a pixel redundancy value; the conversion module 402 is further used for:
[0105] According to the pixel complement value, third signal enable information at the target resolution is generated, and according to the third signal enable information, the first signal synchronization information is converted into the second signal synchronization information, wherein the third signal enable information is used to extend the conversion time of converting the first signal synchronization information into the second signal synchronization information; according to the pixel redundancy value, fourth signal enable information at the target resolution is generated, and according to the fourth signal enable information, the first signal synchronization information is converted into the second signal synchronization information, wherein the fourth signal enable information is used to shorten the conversion time of converting the first signal synchronization information into the second signal synchronization information.
[0106] Each module in the above video signal processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0107] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 5As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a video signal processing method is implemented. Those skilled in the art can understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0108] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.
[0109] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0110] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0111] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0112] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0113] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A video signal processing method, characterized in that: The method comprises: Acquire first signal synchronization information corresponding to an original video signal at a non-standard resolution, wherein the first signal synchronization information is used to characterize at least one of a line synchronization feature and a field synchronization feature of the original video signal; According to pixel missing information between the non-standard resolution and the target resolution, converting the first signal synchronization information into second signal synchronization information matching the target resolution; The original video signal is processed according to the second signal synchronization information to obtain a target video signal.
2. The method according to claim 1, characterized in that The converting the first signal synchronization information into second signal synchronization information matching the target resolution according to the pixel missing information between the non-standard resolution and the target resolution includes: In a case where it is detected based on the pixel missing information that the original video signal satisfies a preset signal conversion condition, determining a target resolution corresponding to the original video signal according to the first signal synchronization information, and converting the first signal synchronization information into second signal synchronization information according to a correlation relationship between the target resolution and a standard resolution; When it is detected based on the pixel missing information that the original video signal does not satisfy the preset signal conversion condition, the pixel conversion difference between the non-standard resolution and the target resolution is determined according to the pixel missing information, and the first signal synchronization information is converted into the second signal synchronization information according to the pixel conversion difference.
3. The method according to claim 2, characterized in that The converting the first signal synchronization information into the second signal synchronization information according to the association relationship between the target resolution and the standard resolution includes: If the target resolution is the standard resolution, using the first signal synchronization information as the second signal synchronization information; If the target resolution is not the standard resolution, the second signal synchronization information is generated according to the first signal synchronization information.
4. The method according to claim 2, characterized in that: The determining, according to the first signal synchronization information, a target resolution corresponding to the original video signal includes: Extracting first signal enable information from the first signal synchronization information; extracting first signal line information of the original video signal from the first signal synchronization information according to a first rising edge and a first falling edge of the first signal enable information; extracting the first signal field information of the original video signal from the first signal synchronization information according to the second rising edge and the second falling edge of the first signal line information; The target resolution is detected according to the first signal line information and the first signal field information.
5. The method according to claim 4, characterized in that The generating the second signal synchronization information according to the first signal synchronization information includes: parsing the first signal line information into second signal line information and parsing the first signal field information into second signal field information according to the target resolution and the second signal enable information at the target resolution; The second signal enable information, the second signal line information and the second signal field information are collectively used as the second signal synchronization information.
6. The method according to claim 2, characterized in that The pixel conversion difference includes a pixel supplement value and a pixel redundancy value; and the converting the first signal synchronization information into the second signal synchronization information according to the pixel conversion difference includes one of the following: generating third signal enable information at the target resolution according to the pixel supplement value, and converting the first signal synchronization information into the second signal synchronization information according to the third signal enable information, wherein the third signal enable information is used to extend a conversion time of converting the first signal synchronization information into the second signal synchronization information; According to the pixel redundancy value, fourth signal enable information at the target resolution is generated, and according to the fourth signal enable information, the first signal synchronization information is converted into the second signal synchronization information, wherein the fourth signal enable information is used to shorten the conversion time of converting the first signal synchronization information into the second signal synchronization information.
7. A video signal processing device, characterized in that: The device comprises: An acquisition module, used for acquiring first signal synchronization information corresponding to an original video signal at a non-standard resolution, wherein the first signal synchronization information is used for characterizing at least one of a line synchronization feature and a field synchronization feature of the original video signal; A conversion module, configured to convert the first signal synchronization information into second signal synchronization information matching the target resolution according to pixel missing information between the non-standard resolution and the target resolution; The processing module is used to process the original video signal according to the second signal synchronization information to obtain the target video signal.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.