A video adaptive standardization and shaping processing method and device

Abstract

The present invention relates to the field of image and video display technology, and provides a method and device for adaptive video standardization and shaping processing. The method comprises decoding an original video source, and optimizing decoding parameters based on a target video source obtained by decoding; the optimization comprises a primary optimization configuration and a secondary optimization configuration, and ultimately obtaining an optimal target video source with consistent time delays for each channel data and minimal deformation relative to the original video source; and adjusting the resolution and frame rate of the optimal target video source according to the optimal display resolution and optimal frame rate of the display device to match the display device. The present invention converts the original video source into a target video source so that it can be output on a display device. The present invention also obtains optimal decoding parameters through a primary optimization configuration and a secondary optimization configuration, so that the time delays for each channel data are consistent and the deformation relative to the original video source is minimal, thereby improving the quality of the video output to the display device.

Description

Technical Field

[0001] The present invention relates to the technical field of image and video display, and in particular to a method and device for adaptive video standardization and shaping processing. Background Art

[0002] With the rapid development of technologies in display and related fields and the changing needs of users for high-performance graphics and image display devices, various high-performance graphics and image display processing equipment, multimodal display equipment, ultra-high-definition video switching, video conferencing systems and other advanced graphics and image-related front-end and terminal products have been emerging and applied in recent years.

[0003] In some video application venues, such as large conference halls, large curtain walls, and ship command cabins, various practical factors, such as funding, space, and audience habits, often make it difficult to simultaneously renovate or upgrade the front-end and back-end equipment of video information systems. As a result, high-performance graphics display equipment and high-performance terminal equipment cannot be matched and updated simultaneously. In the process of gradual technological and equipment upgrades, compatibility issues inevitably arise with both new and old technologies.

[0004] Compatibility issues are mainly reflected in the inconsistency of display interfaces between old and new devices, the inconsistency between the low-resolution receiving capabilities of old video display devices and the high-resolution output requirements of new graphics and image processing devices, the inconsistency of standards between the video output of old graphics and image processing devices and the video input of high-performance general standard display terminals, and the inconsistency between the relatively low performance indicators of existing mature technologies and the high standards of video display quality required by the new generation of users.

[0005] When matching existing graphics and image processing equipment (which can be understood as older video providers) with new display devices / terminals or video post-application processing equipment (which can be understood as newer video receivers), the main contradiction is that, due to the limitations of the technology and testing methods during the equipment development period, the video output by the existing graphics and image processing equipment may not comply with the VESA standard. Meanwhile, the development and testing of new display devices / terminals are mainly based on commercial or general video standards, using general-purpose video interface chips or modules, and do not support the display or processing of non-standard videos. This results in the video output by the existing graphics and image processing equipment not being displayed normally on the new display devices.

[0006] However, the video resolution that the existing display devices / terminals can receive is low, the aspect ratio of the received video is fixed, and the adaptability is poor. The output video resolution of the newly added graphics and image processing equipment is high and the backward compatibility is poor (especially the VGA interface). This will cause the existing display terminals to be unable to display the video source of the newly added graphics and image processing equipment or to be unable to adapt to full-screen display of the input video source.

[0007] In view of this, overcoming the defects of the prior art is an urgent problem to be solved in this technical field. Summary of the Invention

[0008] The technical problem to be solved by the present invention is the video incompatibility between old devices and new devices, which results in the video of the old graphics and image processing device not being able to be displayed normally on the new device, or the video of the new graphics and image processing device not being able to be displayed normally on the old device.

[0009] In a first aspect, the present invention provides a video adaptive normalization and shaping processing method, comprising:

[0010] Decoding the original video source and optimizing the decoding parameters according to the target video source obtained by decoding, so that the optimal target video source can be obtained by decoding according to the optimized final decoding parameters;

[0011] The optimizing of the decoding parameters includes optimizing the decoding parameters once according to the target video source obtained by decoding, so that the time delay of each channel data in the target video source obtained by decoding according to the optimized decoding parameters is consistent.

[0012] and selecting a corresponding configuration parameter library, performing secondary optimization configuration on the primary decoding parameters, so that a target video source with the smallest deformation relative to the original video source is obtained by decoding according to the final decoding parameters after the secondary optimization configuration; the target video source with consistent time delay of each channel data and the smallest deformation relative to the original video source is the optimal target video source;

[0013] After decoding to obtain the optimal target video source with consistent time delay of the data of each channel, the resolution and frame rate of the optimal target video source are adjusted according to the optimal display resolution and optimal frame rate of the display device to match the display device.

[0014] Preferably, the decoding parameters are optimized based on the target video source obtained by decoding, so that the delay of each channel data in the target video source obtained by decoding based on the optimized decoding parameters is consistent, thereby solving the transmission inconsistency of each video channel caused by hardware characteristics such as printed circuit board wiring and chip differences, which specifically includes:

[0015] Using original video test sequences with different resolutions, decoding the original video test sequences with different resolutions;

[0016] During the decoding process, the decoding parameters are adjusted to make the time delays between the channel data of the decoded target video test sequence consistent;

[0017] The decoding parameters used when the time delays between the channel data of the decoded target video test sequence are consistent are used as the standard decoding parameters at the corresponding resolution;

[0018] According to the resolution of the original video source, standard decoding parameters at the resolution are selected as decoding parameters after an optimization configuration.

[0019] Preferably, during the decoding process, the decoding parameters are adjusted to make the time delays between the channel data of the decoded target video test sequence consistent, specifically including:

[0020] Acquire a first target video test sequence obtained by decoding a first original video test sequence at a first resolution;

[0021] Acquire channel data of the R channel, channel data of the G channel, channel data of the B channel, and a pixel clock from the first target video test sequence;

[0022] Obtaining a reference clock according to the pixel clock and clock phase parameters;

[0023] According to the reference clock, the first original video test sequence is played out as reference data according to a reference beat parameter;

[0024] The channel data of the R channel is numerically aligned with the reference data to obtain the R channel alignment difference; the channel data of the G channel is numerically aligned with the reference data to obtain the G channel alignment difference; the channel data of the B channel is numerically aligned with the reference data to obtain the B channel alignment difference;

[0025] The decoding parameters are adjusted according to the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference, so that the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are within a preset difference range.

[0026] Preferably, adjusting the decoding parameters according to the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference so that the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are within a preset difference range specifically includes:

[0027] When the R channel calibration difference value, the G channel calibration difference value, and the B channel calibration difference value are all outside the preset difference range, adjusting the clock phase parameter or the reference beat parameter, thereby adjusting the reference clock, until at least one of the R channel calibration difference value, the G channel calibration difference value, and the B channel calibration difference value is within the preset difference range;

[0028] When at least one of the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference is within a preset difference range, and a calibration difference of a corresponding channel is outside the preset difference range, adjust the output phase parameter of the corresponding channel until the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are all within the preset difference range; wherein the output phase parameter of the channel is one of the decoding parameters used when decoding the first target video test sequence obtained by decoding the first original video test sequence.

[0029] Preferably, performing secondary optimization configuration on the primary decoding parameters so that the target video source with the smallest deformation relative to the original video source is obtained by decoding according to the final decoding parameters after the secondary optimization configuration, specifically includes:

[0030] According to the target video source obtained by decoding, channel data of the R channel, channel data of the G channel, channel data of the B channel, a pixel clock, a horizontal synchronization signal, and a vertical synchronization signal are obtained from the target video source;

[0031] Determining the polarity of the horizontal synchronization signal and the polarity of the field synchronization signal;

[0032] sampling an input video source using a clock co-sourced with the pixel clock according to the polarity of the horizontal synchronization signal and the polarity of the vertical synchronization signal;

[0033] Obtaining a line-effective parameter value and a field-effective parameter value of the input video source according to the sampled data obtained by sampling;

[0034] Performing video format matching in a corresponding video format library using the row-valid parameter value and the field-valid parameter value;

[0035] The configuration parameters of the matched video format are used to perform a secondary optimization configuration on the primary decoding parameters.

[0036] Preferably, the using the row-effective parameter value and the field-effective parameter value to perform video format matching in a corresponding video format library specifically includes:

[0037] Match the video format in the standard video format library corresponding to the target video source. If no corresponding video format can be matched;

[0038] Then, an external video format library in the external device is read, and video format matching is performed in the external video format library; if the existing video format library cannot be matched, the current video format is appended to the external video format library of the external device.

[0039] Preferably, the row effective parameter value includes one or more of a row effective pixel value, a row total pixel value and a row synchronization header width;

[0040] The field effective parameter value includes one or more of the field effective line number, the field total line number and the field synchronization header bandwidth.

[0041] Preferably, adjusting the resolution and frame rate of the optimal target video source according to the optimal display resolution and optimal frame rate of the display device to match the display device specifically includes:

[0042] Acquire an optimal resolution and an optimal frame rate of the device according to the extended display identification data information of the display device;

[0043] Video scaling is performed on the optimal target video source according to the optimal resolution, and the frame rate of the optimal target video source is adjusted according to the optimal frame rate to obtain the optimal target video source with the optimal resolution and the optimal frame rate.

[0044] Preferably, the resolution of the original video source applicable to the method is one or more of 640×480, 800×600, 1024×768, 1280×720, 1280×1024, 1440×900, 1600×1200, and 1920×1080.

[0045] In a second aspect, the present invention further provides a video adaptive normalization and shaping processing device for implementing the video adaptive normalization and shaping processing method described in the first aspect, the device comprising:

[0046] At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the processor to perform the video adaptive normalization and shaping processing method described in the first aspect.

[0047] In a third aspect, the present invention further provides a non-volatile computer storage medium storing computer executable instructions, which are executed by one or more processors to complete the video adaptive normalization and shaping processing method described in the first aspect.

[0048] The present invention decodes an original video source to convert it into a target video source so that it can be output on a display device. At the same time, the present invention also obtains optimal decoding parameters through primary optimization configuration and secondary optimization configuration, so that the data delay of each channel of the decoded target video source is consistent and the deformation relative to the original video source is minimized, thereby improving the quality of the video output to the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] To more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments of the present invention. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.

[0050] Figure 1 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0051] Figure 2 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0052] Figure 3 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0053] Figure 4 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0054] Figure 5 1 is a schematic diagram of the architecture of a video adaptive normalization and shaping processing system provided by an embodiment of the present invention;

[0055] Figure 6 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0056] Figure 7 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0057] Figure 8 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0058] Figure 9 1 is a flow chart of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0059] Figure 10 1 is a schematic diagram showing the effect of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0060] Figure 11 1 is a schematic diagram showing the effect of a video adaptive normalization and shaping processing method provided by an embodiment of the present invention;

[0061] Figure 12 The figure is a schematic diagram of the architecture of a video adaptive normalization and shaping processing device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0062] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0063] In the description of the present invention, the terms "inside", "outside", "longitudinal", "lateral", "upper", "lower", "top", "bottom", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and do not require that the present invention must be constructed and operated in a specific orientation. Therefore, they should not be understood as limitations on the present invention.

[0064] In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0065] Embodiment 1:

[0066] With the gradual update and iteration of display technology and display devices, the video standards of old and new devices may be inconsistent and incompatible. For example, if the old device uses the analog VGA video standard, while the new device uses the VESA digital video standard, the video of the old device cannot be displayed normally on the new device, or the video of the new device cannot be displayed normally on the old device.

[0067] In order to solve this problem, the embodiment 1 of the present invention provides a video adaptive standardization and shaping processing method, such as Figure 1 As shown, including:

[0068] In step 201, the original video source is decoded, and decoding parameters are optimized according to the target video source obtained by decoding, so that the optimal target video source is obtained by decoding according to the optimized final decoding parameters.

[0069] In this embodiment, the original video source is decoded to obtain a target video source, and the decoding parameters corresponding to the target video source are optimized according to the target video source. The aforementioned process is iteratively processed until the optimized final decoding parameters are obtained. The subsequent video sources are decoded according to the final decoding parameters to obtain the optimal target video source.

[0070] The decoding parameters are dynamically updated according to the target video source obtained by the previous decoding until the final decoding parameters are obtained.

[0071] The original video source is obtained from a video provider, and the target video source is decoded from the original video source and conforms to the video standard of the video receiver. For example, the original video source is a VGA analog video source provided by an existing graphics and image processing device, and the target video source is a VESA digital video source, which can be displayed on a newly added display device.

[0072] Decoding is typically performed by an ADC decoder. A video source typically refers to a video source over a period of time, or starting at a specific moment, and contains data from multiple moments. Decoding a video source is a continuous process, during which data from the target video source is continuously decoded. Adjustments to decoding parameters at a specific moment in time take effect after that moment, affecting the data decoded after that moment. Decoding parameters are a general term for multiple parameters used in decoding.

[0073] The decoding parameter optimization includes optimizing the decoding parameters once based on the target video source obtained by decoding, so that the time delay of each channel data in the target video source obtained by decoding according to the first decoding parameters after the first optimization configuration is consistent. The first optimization configuration may include the process of optimizing the decoding parameters multiple times until the time delay of each channel data in the target video source obtained by decoding according to the optimized decoding parameters is consistent, thereby resolving transmission inconsistencies of each video channel caused by hardware characteristics such as printed circuit board wiring and chip differences.

[0074] And select the corresponding configuration parameter library, and perform secondary optimization configuration on the said first decoding parameters, so that the target video source with the smallest deformation relative to the original video source is obtained by decoding according to the final decoding parameters after the secondary optimization configuration; the target video source with consistent time delay of each channel data and the smallest deformation relative to the original video source is the optimal target video source; wherein, the secondary optimization configuration may include the process of optimizing the decoding parameters multiple times until the target video source obtained by decoding with the optimized decoding parameters has consistent time delay of each channel data and the smallest deformation relative to the original video source.

[0075] Before performing the primary optimization configuration and the secondary optimization configuration, the decoding parameters used are default initialization parameters obtained by those skilled in the art based on analysis of the original video source.

[0076] As an optional implementation, the primary optimization configuration first decodes the original video test sequence, and iteratively optimizes the decoding parameters to obtain the primary decoding parameters. The primary optimization configuration process can be understood as an adjustment made to the transmission inconsistency of each video channel caused by hardware characteristics such as printed circuit board wiring and chip differences. The secondary optimization configuration is a parameter adjustment for the real video source on the basis of ensuring the consistency of hardware channel delay, so as to ensure that the target video source obtained by decoding has the least deformation relative to the original video source.

[0077] In step 202, after decoding to obtain an optimal target video source with consistent time delays for the data of each channel (i.e., obtaining final decoding parameters and decoding the original video source according to the final decoding parameters), the resolution and frame rate of the optimal target video source are adjusted to match the display device according to the optimal display resolution and optimal frame rate of the display device. The display device is a video receiving end.

[0078] This embodiment decodes the original video source to convert it into a target video source so that it can be output on a display device. In addition, this embodiment uses primary and secondary optimization configurations to obtain optimal decoding parameters, so that the data delay of each channel of the decoded target video source is consistent and the deformation relative to the original video source is minimized, thereby improving the quality of the video output to the display device.

[0079] In actual use, there may be a variety of original video sources with different resolutions. For original video sources with different resolutions, the delay of each channel data caused by hardware characteristics may be different, so different decoding parameters need to be used. To address this problem, there is also the following preferred implementation method, that is, according to the target video source obtained by decoding, the decoding parameters are optimized and configured once, so that the delay of each channel data in the target video source decoded according to the first decoding parameters after the optimization configuration is consistent, as shown in FIG. Figure 2 As shown, specifically including:

[0080] In step 301, original video test sequences with different resolutions are used to decode the original video test sequences with different resolutions.

[0081] In step 302, during the decoding process, the decoding parameters are adjusted to make the time delays between the channel data of the decoded target video test sequence consistent.

[0082] In step 303, the decoding parameters used when the time delays between the channel data of the decoded target video test sequence are consistent are used as standard decoding parameters at the corresponding resolution.

[0083] In step 304, based on the resolution of the original video source, standard decoding parameters at the resolution are selected as decoding parameters after a first optimization configuration.

[0084] The original video source resolution applicable to the method is one or more of 640×480, 800×600, 1024×768, 1280×720, 1280×1024, 1440×900, 1600×1200, and 1920×1080. The original video test sequences of different resolutions may also be selected from the above-mentioned resolutions.

[0085] This embodiment also provides an optional implementation method for adjusting the delay of each channel data to be consistent, that is, in the decoding process, adjusting the decoding parameters to make the delay between each channel data of the decoded target video test sequence consistent, such as Figure 3 As shown, specifically including:

[0086] In step 401, a first target video test sequence obtained by decoding a first original video test sequence with a first resolution is obtained.

[0087] In step 402, channel data of the R channel, channel data of the G channel, channel data of the B channel and a pixel clock are acquired from the first target video test sequence.

[0088] In step 403, a reference clock is obtained according to the pixel clock and clock phase parameters;

[0089] In step 404, based on the reference clock, the first original video test sequence is played out as reference data according to reference beat parameters.

[0090] In step 405, the channel data of the R channel is numerically aligned with the reference data to obtain the R channel alignment difference; the channel data of the G channel is numerically aligned with the reference data to obtain the G channel alignment difference; the channel data of the B channel is numerically aligned with the reference data to obtain the B channel alignment difference.

[0091] In step 406 , decoding parameters are adjusted according to the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference, so that the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are within a preset difference range.

[0092] The decoding parameters include the reference beat and the clock phase parameter.

[0093] The consistency of the time delay between the channel data does not mean that the channel data are completely synchronized, but means that the R channel calibration difference, the G channel calibration difference and the B channel calibration difference are within a preset difference range.

[0094] The preset difference range is obtained by those skilled in the art based on analysis of the delay consistency requirements of the display device.

[0095] The decoding parameters are adjusted according to the R channel calibration difference, the G channel calibration difference and the B channel calibration difference, so that the R channel calibration difference, the G channel calibration difference and the B channel calibration difference are within the preset difference range, such as Figure 4 As shown, specifically including:

[0096] In step 501, when the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are all outside the preset difference range, the clock phase parameter or the reference beat parameter is adjusted to adjust the reference clock until at least one of the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference is within the preset difference range.

[0097] In step 502, when at least one of the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference is within a preset difference range, and a calibration difference of a corresponding channel is outside the preset difference range, the output phase parameter of the corresponding channel is adjusted until the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are all within the preset difference range; wherein the output phase parameter of the channel is one of the decoding parameters used when decoding the first target video test sequence obtained by decoding the first original video test sequence.

[0098] Step 501 can be considered a coarse adjustment of the delay, while step 502 can be considered a fine adjustment of the delay. First, through coarse adjustment, the calibration difference of at least one of the channels is adjusted to fall within the preset difference range. Then, through fine adjustment, the calibration difference of each channel is adjusted to fall within the preset difference range, thereby achieving numerical calibration for each channel. During coarse adjustment, the channel with the smallest calibration difference is preferentially selected and adjusted to fall within the preset difference range. During fine adjustment, the calibration differences of the other two channels are then adjusted.

[0099] The performing secondary optimization configuration on the primary decoding parameters so that the target video source with the smallest deformation relative to the original video source is obtained by decoding according to the final decoding parameters after the secondary optimization configuration specifically includes:

[0100] According to the target video source obtained by decoding, channel data of the R channel, channel data of the G channel, channel data of the B channel, a pixel clock, a horizontal synchronization signal, and a vertical synchronization signal are acquired from the target video source.

[0101] The polarity of the horizontal synchronization signal and the polarity of the field synchronization signal are determined.

[0102] According to the polarity of the horizontal synchronization signal and the polarity of the field synchronization signal, the input video source is sampled using the same clock as the pixel clock. The input video source is relative to the ADC decoder used for decoding and can be regarded as the original video source in this embodiment.

[0103] According to the sampled data obtained by sampling, the line effective parameter value and the field effective parameter value of the input video source are obtained.

[0104] Video format matching is performed in a corresponding video format library using the row-valid parameter value and the field-valid parameter value.

[0105] The configuration parameters of the matched video format are used to perform a secondary optimization configuration on the primary decoding parameters.

[0106] The row effective parameter value includes one or more of the row effective pixel value, the row total pixel value and the row synchronization header width; the field effective parameter value includes one or more of the field effective row number, the field total row number and the field synchronization header width.

[0107] Among them, depending on the different ADC decoders used for decoding, some ADC decoders can directly output the polarity of the synchronization signal and the polarity of the field synchronization signal, while some cannot output the polarity. In this case, it is necessary to judge the polarity of the horizontal synchronization signal and the polarity of the field synchronization signal, specifically including:

[0108] Use the pixel clock to count the high-level periods of the line and field synchronization signals to obtain the number of high-level signals in the line synchronization signal during the sampling period h1count and the number of high-level signals in the field synchronization signal during the sampling period v1count. Based on h1count and v1count, the polarity of the line synchronization signal and the polarity of the field synchronization signal of the VADC output video are determined.

[0109] It should be noted here that the primary optimization configuration and the secondary optimization configuration target different parameters. The primary optimization configuration mainly targets the delay of each channel and adjusts the first parameter related to the delay, while the secondary optimization configuration mainly adjusts the second parameter other than the first parameter related to the delay based on the resolution and frame rate, so that the primary optimization configuration and the secondary optimization configuration do not affect each other. In the actual decoding process, the primary optimization configuration and the secondary optimization configuration are both performed simultaneously during the decoding process.

[0110] In actual use, a matching format may not be found in the video format library. To address this problem, a preferred implementation is provided herein, that is, using the row-valid parameter value and the field-valid parameter value to perform video format matching in the corresponding video format library, specifically including:

[0111] Match the video format in the standard video format library corresponding to the target video source. If the corresponding video format cannot be matched.

[0112] Then, an external video format library in the external device is read, and video format matching is performed in the external video format library. If the existing video format library cannot be matched, the current video format is added to the external video format library of the external device.

[0113] The external video format library of the external device can be manually added and modified by the user, wherein the external video format library is obtained by the user according to the format analysis of the original video source and the content of the external device is added or modified.

[0114] The current video format is the video format of the target video source, and the adding of the current video format to the external video format library of the external device specifically includes: manually adjusting and optimizing parameters to ultimately use parameters that meet user requirements as final decoding parameters, and matching the manually adjusted final decoding parameters with the current video format and adding them to the external video format library to facilitate subsequent decoding of videos in the current video format.

[0115] In actual use, the resolution or frame rate of the display device and the target video source may be different, resulting in the video not being displayed normally. To address this problem, there is a preferred implementation method of adjusting the resolution and frame rate of the optimal target video source according to the optimal display resolution and optimal frame rate of the display device to match the display device, specifically including:

[0116] An optimal resolution and an optimal frame rate of the device are obtained according to the extended display identification data information of the display device.

[0117] Video scaling is performed on the optimal target video source according to the optimal resolution, and the frame rate of the optimal target video source is adjusted according to the optimal frame rate to obtain the optimal target video source with the optimal resolution and the optimal frame rate.

[0118] The display device in this embodiment may exist in various forms, including but not limited to:

[0119] (1) Mobile communication devices: These devices are characterized by their mobile communication capabilities and primarily provide voice and data communications. With the development of technology, most of these devices also have video playback or video projection capabilities. These terminals include smartphones (e.g., iPhones), multimedia phones, and feature phones.

[0120] (2) Ultra-mobile personal computer devices: These devices fall under the category of personal computers and have computing and processing capabilities, and generally also have video playback or video projection capabilities. These terminals include PDAs, MIDs, and UMPCs, such as the iPad.

[0121] (3) Portable entertainment devices: These devices can display and play video content. These devices include video players, handheld game consoles, smart toys, and portable car navigation devices.

[0122] (4) Server: A device that provides computing services. The server consists of a processor, hard disk, memory, system bus, etc. The server is similar to a general computer architecture, but because it needs to provide highly reliable services, it has higher requirements in terms of processing power, stability, reliability, security, scalability, and manageability.

[0123] (5) Other electronic devices with video playback function.

[0124] Example 2:

[0125] The present invention is based on the method described in Example 1, combined with specific application scenarios, and uses technical descriptions in related scenarios to illustrate the implementation process of the present invention in characteristic scenarios.

[0126] The present invention is applied to the video adaptive normalization and shaping processing method described in Example 1. Figure 5 Taking the video adaptive standardization and shaping processing system shown as an example, the system mainly includes a universal video ADC decoder, a programmable digital video processor, a programmable read-write storage unit, a dynamic storage unit, a video output driver, an equalizer, and a human-computer interaction host computer, etc., which is mainly used to decode the VGA video source (which can be understood as the original video source in Example 1) of the current graphics and image processing equipment into a VESA video source (which can be understood as the target video source in Example 1) so that it can be displayed normally on the newly added display device.

[0127] The hardware system should meet the following basic requirements: Universal video three-channel ADC decoder (in the subsequent embodiments will be referred to as VADC, namely Video Analog-to-Digital The configuration interface of the video analog-to-digital converter (ADC) is connected to the programmable digital video processor (referred to as FPGA in subsequent embodiments) and meets the electrical characteristics of the serial communication bus (such as I2C) line; the parallel video, clock, synchronization output, reset input and other signals of the VADC are connected to the corresponding bank (logic block) of the FPGA and meet the corresponding impedance matching requirements; the configuration interface of the programmable read-write storage unit is connected to the FPGA and meets the electrical characteristics of the serial communication bus (such as I2C); the dynamic storage unit is connected to the FPGA, including address signals (block select, row select, column select and address bus, etc.), data signals (parallel data bus, clock signal), etc., and meet the corresponding bandwidth data transmission characteristics; the configuration interface of the video output driver or equalizer unit (hereinafter referred to as VDAC) is connected to the FPGA and meets the electrical characteristics of the serial communication bus; the parallel video, clock, synchronization input, reset input and other signals of the VDAC are connected to the corresponding bank of the FPGA and meet the impedance matching requirements; the FPGA is connected to the display terminal or video post-application equipment (hereinafter referred to as the video receiving end) and meets the electrical characteristics of the serial communication bus; the FPGA is connected to the host computer through a serial port or other bus, specifically:

[0128] The universal video ADC decoder is primarily used for analog-to-digital conversion of analog VGA video and related processing of synchronization signals. The three channels of the video ADC decoder can be configured separately to adjust for delay inconsistencies among the red, green, and blue channels during video transmission or processing.

[0129] The programmable digital video processor mainly includes a digital video signal receiving and recognition unit, a VESA standard video format and ADC configuration parameter library, a video format and configuration parameter read and write control unit, a video format standardization adjustment control unit, a human-computer interaction unit, a video resolution conversion and frame rate adjustment unit, a current display terminal device optimal resolution detection unit, and a dynamic storage management unit.

[0130] The programmable read-write control unit is a storage and management unit for the video format pattern library and the ADC configuration parameter library corresponding to each video format. The stored data has the characteristic of permanent preservation, that is, it can still be used in the subsequent decoding process of other VGA videos.

[0131] The dynamic storage unit is mainly used to cache the intermediate data generated during the video resolution conversion and frame rate adjustment process. The stored data does not have the characteristic of permanent preservation, that is, the cached data is cleared after the device is powered off or reset.

[0132] The video output driver or equalizer unit is mainly used to perform digital-to-analog conversion, drive or equalize the standardized and shaped video data, and is used to drive display terminals or video post-application equipment.

[0133] In this system, the video adaptive standardization and shaping processing method is as follows: Figure 6 As shown, specifically including:

[0134] In step 601, a universal video ADC decoder is first used to perform A / D conversion on the analog VGA video (which can be understood as the decoding process described in Example 1).

[0135] In step 602, the digital video signal converted by the ADC decoder is detected in real time, and the decoding parameters are adjusted according to the results of the real-time detection to perform adaptive adjustment. This process is completed by the ADC decoder configuration unit, the video format real-time monitoring unit, and the video signal quality evaluation unit.

[0136] Among them, the video format and configuration parameter read and write control unit retrieves the default initialization parameters of the ADC decoder from the ADC configuration parameter library; the ADC decoder configuration unit first initializes the ADC decoder using the default parameters; the video format real-time monitoring unit completes real-time monitoring of the video format; the video signal quality evaluation unit evaluates the video quality, that is, the delay consistency between channels. The ADC decoder configuration unit adjusts the parameters of the ADC decoder (which can be understood as the decoding parameters in Example 1) based on the delay consistency between channels to perform an optimized configuration.

[0137] In step 603, the video format pattern recognition unit completes the format recognition of the input video.

[0138] In step 604, the identified format information is matched with the existing video mode, which is accomplished by the video format and configuration parameter read and write control unit and the video format mode library.

[0139] In step 605, it is determined whether the input video meets the VESA standard, and the video format is standardized for the input video that does not meet the VESA standard. The processing units involved in this process include the VESA standard video ADC configuration parameter library, the VESA standard video format library (which can be understood as the standard video format library corresponding to the target video source), the video format standardization adjustment control unit, the microcontroller and storage management unit, and the dynamic storage unit.

[0140] Specifically: the video format real-time monitoring unit completes the real-time monitoring of the video format; the video format pattern recognition unit completes the format recognition of the input video; and the VESA standard video format library is used to determine whether the input video meets the VESA standard. Specifically, there are three situations:

[0141] The first case: for videos that meet the VESA standard, the ADC decoder configuration unit calls the VESA standard video ADC configuration parameter library to adjust the parameters of the ADC decoder, completing the secondary optimization configuration of the ADC decoder.

[0142] The second case: For videos that do not meet the VESA standard but have matching patterns in the video format pattern library, the ADC decoder configuration unit calls the ADC configuration parameter library to adjust the parameters of the ADC decoder to complete the secondary optimization configuration of the ADC decoder.

[0143] The third scenario: For videos that neither meet the VESA standard nor have a matching pattern in the video format pattern library, the ADC decoder parameters are configured online through the video decoder parameter setting unit and the ADC decoder configuration unit of the human-computer interaction unit. After online configuration, the video format pattern library and the ADC configuration parameter library are updated. The ADC configuration parameter library is used to adjust the ADC decoder parameters, completing the secondary optimization configuration of the ADC decoder. These video parameters are then set as the power-on default initialization parameters.

[0144] In step 606, it is determined whether the current video format matches the current display device (video receiving end). The optimal resolution identification of the display device (video receiving end) is completed by the optimal resolution control unit of the current display terminal device (which stores the extended display identification data information). If the current video format is not the optimal resolution of the video receiving end, the video resolution conversion and frame rate adjustment unit, the micro-control and storage management unit, and the dynamic storage unit cooperate to complete the video format scaling or frame rate adjustment.

[0145] The extended display identification data (EDID) will be directly described as EDID in subsequent embodiments.

[0146] In step 607, when the output video format meets the system requirements, the video output driver or equalizer unit outputs the video signal to the display terminal or video post-processing application device.

[0147] Wherein, the one-time optimization configuration is as follows: Figure 7 As shown, specifically including:

[0148] In step 701, the original video test sequence is connected to the system as a video source and adjusted one by one. The original video test sequence should be a video that complies with the VESA standard with a resolution of 640×480, 800×600, 1024×768, 1280×720, 1280×1024, 1440×900, 1600×1200, 1920×1080, etc., and the video refresh rate is generally 60 or 75.

[0149] In step 702, the FPGA resets the VADC, and initializes the VADC by referring to the original video test sequence parameters through the ADC decoder configuration unit in the FPGA.

[0150] In step 703, the output signal of the VADC (which can be understood as the target video test sequence in Example 1) is received by the video format real-time monitoring unit in the FPGA, including parallel R, G, and B data (which can be understood as the channel data of the R channel, the channel data of the G channel, and the channel data of the B channel in Example 1, respectively) and the pixel clock. The pixel clock is used as an input of an internal clock management unit of the FPGA, and the single clock output of the clock management unit is used as the input clock of the video signal quality evaluation unit (which can be understood as the reference clock in Example 1). The original video test sequence built into the video signal quality evaluation unit is output according to the reference beat (which can be understood as the reference beat parameter in Example 1) and numerically aligned with the parallel R, G, and B data from the VADC.

[0151] In step 704, delay consistency synchronization processing is performed based on the parallel calibration differences of the three channels R, G, and B (which can be understood as the calibration difference of the R channel, the calibration difference of the G channel, and the calibration difference of the B channel). That is, if the calibration differences are all within the acceptable range, no adjustment is required. If the calibration difference of a video channel exceeds the range, it can be adjusted in two ways. One is to adjust the video output phase of a single channel in the test sequence in the VADC configuration parameters (that is, the parameters of the ADC decoder mentioned above, which can also be understood as the decoding parameters in Example 1). The other is to adjust the parallel data of the video channel in the FPGA (such as adjusting the input clock phase or increasing or decreasing the reference beat) until all three channels meet the calibration. Specifically:

[0152] When the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are all outside the preset difference range, the clock phase parameter or the reference beat parameter is adjusted to adjust the reference clock until at least one of the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference is within the preset difference range.

[0153] When at least one of the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference is within a preset difference range, and a calibration difference of a corresponding channel is outside the preset difference range, adjust the output phase parameter of the corresponding channel until the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are all within the preset difference range; wherein the output phase parameter of the channel is one of the decoding parameters used when decoding the first target video test sequence obtained by decoding the first original video test sequence.

[0154] In step 705 , the VGA test sequence is changed and the process returns to step 702 until all original video test sequences are aligned.

[0155] In step 706, the input video source is changed from the original video test sequence to the actual video input, the VADC is reset through the FPGA, and the VADC is initialized according to the aligned VADC configuration parameters.

[0156] The secondary optimization configuration is as follows: Figure 8 As shown, specifically including:

[0157] In step 801, the real-time video format monitoring unit within the FPGA receives the output signal of the VADC, including parallel R, G, and B data, pixel clock, and horizontal and vertical synchronization signals (or data enable signals). For VADCs that cannot set the polarity of the output synchronization signal, the polarity of the horizontal and vertical synchronization signals must first be determined. The pixel clock is used to count the high-level periods of the horizontal and vertical synchronization signals to obtain h1count and v1count. The polarity of the horizontal and vertical synchronization signals of the VADC output video can be determined based on h1count and v1count.

[0158] In step 802, according to the VADC output video line and field synchronization polarity, the input video signal is sampled by using the same clock as the VADC output pixel clock to obtain the effective line pixel value (hcount), the effective field line number (vcount), the total line pixel value (total_hcount), the total field line number (total_vcount), the line synchronization header width (hs_cnt) and the field synchronization header bandwidth (vs_cnt). Among them, the effective line pixel value, the total line pixel value and the line synchronization header width can be understood as the effective line parameter values ​​in Example 1; the effective field line number, the total field line number and the field synchronization header bandwidth can be understood as the effective field parameter values ​​in Example 1.

[0159] In step 803, the video format pattern recognition unit inside the FPGA performs video pattern matching on the row-effective parameter values ​​and field-effective parameter values ​​obtained in step 802 in the built-in VESA standard video format library. If the match is successful, the corresponding configuration parameters in the VESA standard video ADC configuration parameter library are called to perform secondary optimization configuration on the VADC.

[0160] In step 804, if a matching VESA standard video mode cannot be obtained in step 803, the video format pattern library in the external programmable read-write storage unit is read and pattern matching is performed again. If the existing video format can be matched, the corresponding parameters in the ADC configuration parameter library are called to perform secondary optimization configuration on the VADC.

[0161] In step 805, if the video mode still cannot be successfully matched with the existing video mode in step 804, the video mode is added to the video format mode library as a new video format, and the VADC channel setting parameters are manually adjusted by the host computer until the video quality meets the user's requirements. Finally, the manually adjusted VADC channel setting parameters are added to the ADC configuration parameter library.

[0162] The video format scaling or frame rate adjustment, such as Figure 9 As shown, specifically including:

[0163] In step 901, the EDID information of the video receiving end is read by the optimal resolution checking unit of the current display terminal device inside the FPGA to determine the optimal display resolution of the video receiving end.

[0164] In step 902, the optimal display resolution obtained in step 901 is used to retrieve the resolution video parameters from the VESA standard video format library built into the FPGA and use it as the output video format.

[0165] In step 903, the input video is standardized and shaped by the video resolution conversion and frame rate adjustment unit inside the FPGA, and the video receiving end is driven by the video output driver or equalizer unit, thereby improving the user experience.

[0166] Figure 10 The diagram illustrates the display effects of the video source of the current graphics and image processing equipment on the newly added display terminal before and after the video adaptive standardization and shaping processing method is performed. Before the video adaptive standardization and shaping method is performed, the video cannot be effectively displayed on the newly added display terminal. After the video adaptive standardization and shaping method is performed, the video is displayed normally on the newly added display terminal.

[0167] Figure 11 It illustrates the display effects of the video source of the newly added graphics and image processing equipment on the active display terminal before and after the video adaptive standardization and shaping processing method is performed. Before the video adaptive standardization and shaping processing method is performed, the video cannot be effectively displayed on the active display terminal. After the video adaptive standardization and shaping processing method is performed, the video is displayed normally on the active display terminal.

[0168] Example 3:

[0169] like Figure 12 FIG. 1 is a schematic diagram of the architecture of a video adaptive normalization and shaping processing device according to an embodiment of the present invention. The video adaptive normalization and shaping processing device according to this embodiment includes one or more processors 21 and a memory 22. Figure 12A processor 21 is taken as an example.

[0170] The processor 21 and the memory 22 may be connected via a bus or other means. Figure 12 The bus connection is taken as an example.

[0171] The memory 22, as a non-volatile readable and writable storage medium, can be used to store non-volatile software program object code and non-volatile computer executable programs, such as the video adaptive normalization and shaping processing method in Example 1. The processor 21 executes the video adaptive normalization and shaping processing method by running the non-volatile software program and instructions stored in the memory 22.

[0172] The memory 22 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state memory device. In some embodiments, the memory 22 may optionally include a memory remotely located relative to the processor 21, and such remote memory may be connected to the processor 21 via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0173] The program instructions / modules are stored in the memory 22 , and when executed by the one or more processors 21 , the video adaptive normalization and shaping processing methods in the above-mentioned embodiments 1 and 2 are performed.

[0174] It is worth noting that the information interaction, execution process, etc. between the modules and units within the above-mentioned devices and systems are based on the same concept as the processing method embodiment of the present invention. The specific content can be found in the description of the method embodiment of the present invention and will not be repeated here.

[0175] Those skilled in the art will understand that all or part of the steps in the various methods of the embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a disk or an optical disk, etc.

[0176] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A video adaptive normalization and shaping processing method, characterized in that: include: Decoding the original video source and optimizing the decoding parameters according to the target video source obtained by decoding, so that the optimal target video source can be obtained by decoding according to the optimized final decoding parameters; The optimizing of the decoding parameters includes optimizing the decoding parameters once according to the target video source obtained by decoding, so that the time delay of each channel data in the target video source obtained by decoding according to the optimized decoding parameters is consistent. and selecting a corresponding configuration parameter library, performing secondary optimization configuration on the primary decoding parameters, so that a target video source with the smallest deformation relative to the original video source is obtained by decoding according to the final decoding parameters after the secondary optimization configuration; the target video source with consistent time delay of each channel data and the smallest deformation relative to the original video source is the optimal target video source; After decoding to obtain the optimal target video source with consistent time delay of the data of each channel, the resolution and frame rate of the optimal target video source are adjusted according to the optimal display resolution and optimal frame rate of the display device to match the display device.

2. The video adaptive normalization and shaping processing method according to claim 1, characterized in that: The step of optimizing the decoding parameters based on the target video source obtained by decoding so that the delay of each channel data in the target video source obtained by decoding based on the optimized decoding parameters is consistent specifically includes: Using original video test sequences with different resolutions, decoding the original video test sequences with different resolutions; During the decoding process, the decoding parameters are adjusted to make the time delays between the channel data of the decoded target video test sequence consistent; The decoding parameters used when the time delays between the channel data of the decoded target video test sequence are consistent are used as the standard decoding parameters at the corresponding resolution; According to the resolution of the original video source, standard decoding parameters at the resolution are selected as decoding parameters after an optimization configuration.

3. The video adaptive normalization and shaping processing method according to claim 2, characterized in that: During the decoding process, adjust the decoding parameters to make the delay between the channel data of the decoded target video test sequence consistent, specifically including: Acquire a first target video test sequence obtained by decoding a first original video test sequence at a first resolution; Acquire channel data of the R channel, channel data of the G channel, channel data of the B channel, and a pixel clock from the first target video test sequence; Obtaining a reference clock according to the pixel clock and clock phase parameters; According to the reference clock, the first original video test sequence is played out as reference data according to a reference beat parameter; The channel data of the R channel is numerically aligned with the reference data to obtain the R channel alignment difference; the channel data of the G channel is numerically aligned with the reference data to obtain the G channel alignment difference; the channel data of the B channel is numerically aligned with the reference data to obtain the B channel alignment difference; The decoding parameters are adjusted according to the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference, so that the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are within a preset difference range.

4. The video adaptive normalization and shaping processing method according to claim 3, characterized in that: The step of adjusting the decoding parameters according to the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference so that the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are within a preset difference range specifically includes: When the R channel calibration difference value, the G channel calibration difference value, and the B channel calibration difference value are all outside the preset difference range, adjusting the clock phase parameter or the reference beat parameter, thereby adjusting the reference clock, until at least one of the R channel calibration difference value, the G channel calibration difference value, and the B channel calibration difference value is within the preset difference range; When at least one of the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference is within a preset difference range, and a calibration difference of a corresponding channel is outside the preset difference range, adjust the output phase parameter of the corresponding channel until the R channel calibration difference, the G channel calibration difference, and the B channel calibration difference are all within the preset difference range; wherein the output phase parameter of the channel is one of the decoding parameters used when decoding the first target video test sequence obtained by decoding the first original video test sequence.

5. The video adaptive normalization and shaping processing method according to claim 1, characterized in that: The performing secondary optimization configuration on the primary decoding parameters so that the target video source with the smallest deformation relative to the original video source is obtained by decoding according to the final decoding parameters after the secondary optimization configuration specifically includes: According to the target video source obtained by decoding, channel data of the R channel, channel data of the G channel, channel data of the B channel, a pixel clock, a horizontal synchronization signal, and a vertical synchronization signal are obtained from the target video source; Determining the polarity of the horizontal synchronization signal and the polarity of the field synchronization signal; sampling an input video source using a clock co-sourced with the pixel clock according to the polarity of the horizontal synchronization signal and the polarity of the vertical synchronization signal; Obtaining a line-effective parameter value and a field-effective parameter value of the input video source according to the sampled data obtained by sampling; Performing video format matching in a corresponding video format library using the row-valid parameter value and the field-valid parameter value; The configuration parameters of the matched video format are used to perform a secondary optimization configuration on the primary decoding parameters.

6. The video adaptive normalization and shaping processing method according to claim 5, characterized in that: The performing of video format matching in a corresponding video format library using the row-valid parameter value and the field-valid parameter value specifically includes: Match the video format in the standard video format library corresponding to the target video source. If no corresponding video format can be matched; Then, an external video format library in the external device is read, and video format matching is performed in the external video format library; if the existing video format library cannot be matched, the current video format is appended to the external video format library of the external device.

7. The video adaptive normalization and shaping processing method according to claim 5, characterized in that: The row effective parameter value includes one or more of a row effective pixel value, a row total pixel value and a row synchronization header width; The field effective parameter value includes one or more of the field effective line number, the field total line number and the field synchronization header bandwidth.

8. The video adaptive normalization and shaping processing method according to any one of claims 1 to 7, characterized in that: The adjusting the resolution and frame rate of the optimal target video source according to the optimal display resolution and optimal frame rate of the display device to match the display device specifically includes: Acquire an optimal resolution and an optimal frame rate of the device according to the extended display identification data information of the display device; Video scaling is performed on the optimal target video source according to the optimal resolution, and the frame rate of the optimal target video source is adjusted according to the optimal frame rate to obtain the optimal target video source with the optimal resolution and the optimal frame rate.

9. The video adaptive normalization and shaping processing method according to any one of claims 1 to 7, characterized in that: The resolution of the original video source is one or more of 640×480, 800×600, 1024×768, 1280×720, 1280×1024, 1440×900, 1600×1200, and 1920×1080.

10. A video adaptive standardization and shaping processing device, characterized in that: The device comprises: At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the processor to perform the video adaptive normalization and shaping processing method according to any one of claims 1 to 9.

Images