Display control method, apparatus, display device, and computer readable medium
By splitting and merging the source video streams of the display panel, the problem of low flexibility in video image processing of display devices is solved, and the monitoring and effect visualization of multiple video processing operations on the same device are realized.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BOE TECHNOLOGY GROUP CO LTD
- Filing Date
- 2021-10-27
- Publication Date
- 2026-06-26
AI Technical Summary
In existing technologies, display devices have low flexibility in video image processing, making it difficult to monitor the results of multiple video image processing simultaneously.
The source video stream of the display panel is split into multiple identical sub-video streams. After processing according to the processing parameters of each sub-video stream, they are tiled and merged for output. This process includes steps such as transformation processing, video analysis, and difference analysis.
It enhances the flexibility of video image processing, enabling simultaneous monitoring of the results of multiple video processing operations on the same display device, thereby improving user convenience and visualizing the effects.
Smart Images

Figure CN116888573B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of display technology, and in particular to a display control method, display control device, display equipment, and computer-readable medium. Background Technology
[0002] In some display device (such as monitor) usage scenarios, there are usually high requirements for the display quality and color reproduction level of the image. Users often need to change video image parameters, perform corresponding video image processing tasks, and monitor the results of video image processing. At present, the flexibility of video image processing is relatively low when performing this operation, and it is also difficult for users to monitor the results of multiple video image processing simultaneously. Summary of the Invention
[0003] This disclosure aims to solve at least one of the technical problems existing in the prior art, and proposes a display control method, display control device, display equipment, and computer-readable medium.
[0004] To achieve the above objectives, in a first aspect, embodiments of this disclosure provide a display control method, comprising:
[0005] In response to a multi-channel display control command, the source video stream of the display panel is split into multiple identical sub-video streams.
[0006] For each of the sub-video streams, obtain the processing parameters corresponding to the sub-video stream, and process the sub-video stream according to the processing parameters;
[0007] The processed sub-video streams are tiled and merged to obtain an output video stream; the output video stream is then output to the display panel for display.
[0008] In some embodiments, before performing multi-channel display control command to split the source video stream of the display panel to obtain multiple identical sub-video streams, the method further includes:
[0009] The source video stream is transformed according to the display parameters of the display panel, wherein the display parameters include at least one of timing parameters, color parameters, resolution parameters, and frame rate parameters.
[0010] In some embodiments, for each sub-video stream, before obtaining the processing parameters corresponding to the sub-video stream and processing the sub-video stream according to the processing parameters, the method further includes:
[0011] Perform video analysis on the sub-video stream based on the preset first analysis item;
[0012] The first analysis item includes:
[0013] At least one of the following: color waveform analysis, video brightness waveform analysis, video color histogram analysis, video brightness histogram analysis, video color vector analysis, video brightness pseudocolor marking, video focus quality analysis, video brightness area marking, and video pixel visualization marking.
[0014] In some embodiments, the processing parameters include at least one of color gamut parameters, brightness parameters, color temperature parameters, and sharpness parameters.
[0015] In some embodiments, before tiling and merging the processed sub-video streams to obtain an output video stream, the method further includes:
[0016] According to the preset second analysis item, at least two of the processed sub-video streams are subjected to pairwise difference analysis.
[0017] The second analysis item includes at least one of pixel value difference analysis, pixel grayscale value difference analysis, and pixel gradient feature value difference analysis.
[0018] In some embodiments, after performing pairwise difference analysis on at least two of the processed sub-video streams according to a preset second analysis term, the method includes:
[0019] Based on the difference analysis results, pixels that meet the preset marking conditions are marked through a screen menu adjustment method. The marking condition is that the difference value between two pixels undergoing difference analysis is greater than a preset difference threshold.
[0020] In some embodiments, the multi-display control command includes the number of channels;
[0021] The process of responding to a multi-channel display control command by splitting the source video stream of the display panel to obtain multiple identical sub-video streams includes:
[0022] The source video stream is split into multiple streams based on the number of streams and the resolution of the display panel.
[0023] In some embodiments, tiling and merging the processed sub-video streams to obtain an output video stream includes:
[0024] A timing control signal is generated based on the timing parameters corresponding to the display panel. The timing of each of the processed sub-video streams is adjusted according to the timing control signal, and the timing-adjusted sub-video streams are tiled and merged.
[0025] In some embodiments, tiling and merging the processed sub-video streams to obtain an output video stream includes:
[0026] Based on the number of sub-video streams and the resolution of the display panel, the arrangement method is determined, and the first display area corresponding to each sub-video stream is determined;
[0027] Based on the arrangement and the first display area corresponding to each sub-video stream, the processed sub-video streams are tiled and merged.
[0028] In some embodiments, for each of the sub-video streams, the display control method further includes:
[0029] Perform video analysis on the sub-video stream based on the preset first analysis item;
[0030] The step of determining the arrangement method based on the number of sub-video streams and the resolution of the display panel, and determining the first display area corresponding to each sub-video stream, includes:
[0031] Based on the number of sub-video streams and the resolution of the display panel, the arrangement method is determined, the first display area corresponding to each sub-video stream is determined, and the second display area corresponding to the video analysis result image is determined.
[0032] The step of tiling and merging the processed sub-video streams according to the arrangement and the first display area corresponding to each sub-video stream includes:
[0033] Based on the arrangement, the first display area corresponding to each sub-video stream, and the second display area corresponding to the video analysis result image, the processed sub-video streams and the video analysis result image are tiled and merged.
[0034] Secondly, embodiments of this disclosure also provide a display control device, including:
[0035] The splitting processing module has multiple splitting output terminals; the splitting processing module is used to respond to a multi-channel display control command to split the source video stream of the display panel to obtain multiple identical sub-video streams; and to output each of the sub-video streams through a corresponding splitting output terminal;
[0036] The sub-video stream processing module has multiple processing units, each processing unit corresponding to one of the branch output terminals; the processing unit is used to obtain the processing parameters corresponding to the sub-video stream, process the sub-video stream according to the processing parameters, and output it.
[0037] The tiling and merging module is used to tile and merge the processed sub-video streams to obtain an output video stream; and to output the output video stream to the display panel for display.
[0038] In some embodiments, the display control device further includes:
[0039] The transformation processing module is used to transform the source video stream according to the display parameters of the display panel, wherein the display parameters include at least one of timing parameters, color parameters, resolution parameters, and frame rate parameters.
[0040] In some embodiments, the sub-video stream processing module further includes: a plurality of analysis units corresponding one-to-one with the plurality of processing units;
[0041] The analysis unit is used to perform video analysis on the sub-video stream according to a preset first analysis item;
[0042] The first analysis item includes:
[0043] At least one of the following: color waveform analysis, video brightness waveform analysis, video color histogram analysis, video brightness histogram analysis, video color vector analysis, video brightness pseudocolor marking, video focus quality analysis, video brightness area marking, and video pixel visualization marking.
[0044] In some embodiments, the display control device further includes:
[0045] The difference analysis module is used to perform pairwise difference analysis on at least two of the processed sub-video streams according to a preset second analysis item.
[0046] The second analysis item includes at least one of pixel value difference analysis, pixel grayscale value difference analysis, and pixel gradient feature value difference analysis.
[0047] In some embodiments, the tile merging module further includes:
[0048] A timing control unit is used to generate timing control signals based on the timing parameters corresponding to the display panel;
[0049] The tiling and merging module is specifically used to perform timing adjustment on each of the processed sub-video streams according to the timing control signal, and to tile and merge the timing-adjusted sub-video streams.
[0050] In some embodiments, the tiling merging module is specifically used to determine the arrangement method based on the number of sub-video streams and the resolution of the display panel, and to determine the first display area corresponding to each sub-video stream; and to tile and merge the processed sub-video streams according to the arrangement method and the first display area corresponding to each sub-video stream.
[0051] In some embodiments, the sub-video stream processing module includes a plurality of the analysis units;
[0052] The tiling and merging module is specifically used to determine the arrangement method based on the number of sub-video streams and the resolution of the display panel, determine the first display area corresponding to each sub-video stream, and determine the second display area corresponding to the video analysis result image of the analysis unit, wherein the first display area and the second display area do not overlap; and to perform tiling and merging on the processed sub-video streams and the video analysis result image based on the arrangement method, the first display area corresponding to each sub-video stream, and the second display area corresponding to the video analysis result image.
[0053] Thirdly, embodiments of this disclosure also provide a display device, including: a display panel and a display control device;
[0054] The display control device is any of the display control devices described in the above embodiments.
[0055] Fourthly, embodiments of this disclosure also provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed, it implements the display control method as described in any of the above embodiments. Attached Figure Description
[0056] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the embodiments of the present disclosure to explain the disclosure and do not constitute a limitation thereof. The above and other features and advantages will become more apparent to those skilled in the art from the detailed description of exemplary embodiments with reference to the accompanying drawings, in which:
[0057] Figure 1 A flowchart of a display control method provided in an embodiment of this disclosure;
[0058] Figure 2 A flowchart of another display control method provided in an embodiment of this disclosure;
[0059] Figure 3 This is a flowchart of a specific implementation method of step S1 in this disclosure embodiment;
[0060] Figure 4 This is a flowchart of a specific implementation method of step S3 in this disclosure embodiment;
[0061] Figure 5 This is a flowchart illustrating another specific implementation method of step S3 in this disclosure.
[0062] Figure 6 This is a schematic diagram of one arrangement in step S3 of an embodiment of the present disclosure;
[0063] Figure 7A flowchart illustrating yet another display control method provided in this disclosure embodiment;
[0064] Figure 8 This is a schematic diagram of another arrangement in step S3 of an embodiment of this disclosure;
[0065] Figure 9 A flowchart illustrating yet another display control method provided in this disclosure embodiment;
[0066] Figure 10 This is a schematic diagram of the structure of a display control device provided in an embodiment of the present disclosure;
[0067] Figure 11 This is a schematic diagram of a display device provided in some embodiments of the present disclosure;
[0068] Figure 12 A block diagram of an electronic device provided in an embodiment of this disclosure;
[0069] Figure 13 This is a block diagram illustrating the composition of a computer-readable medium provided in an embodiment of the present disclosure. Detailed Implementation
[0070] To enable those skilled in the art to better understand the technical solutions of this disclosure, the display control method, display control device, display equipment, and computer-readable medium provided in this disclosure will be described in detail below with reference to the accompanying drawings.
[0071] Exemplary embodiments will be described more fully below with reference to the accompanying drawings; however, these exemplary embodiments may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will enable those skilled in the art to fully understand the scope of this disclosure.
[0072] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. As used herein, the singular forms “a” and “the” are also intended to include the plural forms unless the context clearly indicates otherwise. It will also be understood that when the terms “comprising” and / or “made of” are used in this specification, the presence of the said feature, integral, step, operation, element, and / or component is specified, but the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof is not excluded.
[0073] It will be understood that while the terms first, second, etc., may be used herein to describe various elements, these elements should not be limited to these terms. These terms are used only to distinguish one element from another. Therefore, without departing from the teachings of this disclosure, the first element, first component, or first module discussed below may be referred to as a second element, second component, or second module.
[0074] Unless otherwise specified, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this disclosure, and will not be interpreted as having an idealized or overly formal meaning, unless expressly so defined herein.
[0075] Figure 1 This is a flowchart illustrating a display control method provided in an embodiment of this disclosure. Figure 1 As shown, the method includes:
[0076] Step S1: In response to the multi-channel display control command, the source video stream of the display panel is split into multiple identical sub-video streams.
[0077] In this embodiment, the same sub-video streams not only have the same data content, but are also time-synchronized; in some embodiments, the sub-video stream is a video stream with a different data format and / or resolution than the source video stream, but with the same perceptible video content; in some embodiments, the source video stream is input to multiple parallel video interfaces for multi-path expansion to achieve de-pathing processing; and in some embodiments, to cooperate with de-pathing processing, storage control logic for each sub-video stream is configured, and a buffer is set.
[0078] Step S2: For each sub-video stream, obtain the processing parameters corresponding to the sub-video stream, and process the sub-video stream according to the processing parameters.
[0079] In this process, video image processing is performed on the sub-video streams according to the processing parameters. This process corresponds to the processing process that can be perceived by the human eye, such as changing the sub-video streams in terms of color and brightness.
[0080] In some embodiments, pre-stored preset processing parameters are obtained, or in some embodiments, processing parameters input by the system in real time are obtained.
[0081] In some embodiments, the processing parameters include at least one of the following: color gamut parameters, brightness parameters, color temperature parameters, and sharpness parameters.
[0082] In some embodiments, the processing parameters corresponding to each sub-video stream are different. For example, for one sub-video stream, its color gamut parameter is adjusted, while for another sub-video stream, its brightness parameter is adjusted. Thus, different video image processing operations can be performed on multiple sub-video streams with the same content at the same time, or the same type of video image processing operations can be performed on multiple sub-video streams with different parameter configurations at the same time.
[0083] Step S3: Tile and merge the processed sub-video streams to obtain the output video stream, and output the output video stream to the display panel for display.
[0084] The process of tiling and merging the processed sub-video streams corresponds to splicing the processed sub-video streams together to make the resulting output video stream suitable for the display panel. It does not change the video content of each sub-video stream, but only splices the processed sub-video streams into a complete output video stream, so that the processed sub-video streams can be displayed on the same display device.
[0085] This disclosure provides a display control method that can be used to split a source video stream to obtain multiple identical sub-video streams. Each sub-video stream is processed based on different processing parameters, and the processed sub-video streams are tiled and merged. This allows multiple video processing operations to be performed on the same source video stream simultaneously, and the results of each video processing operation can be displayed on the same screen. This improves the flexibility of video image processing, and the results of multiple video processing operations can be monitored simultaneously using a single display device.
[0086] Figure 2 A flowchart illustrating another display control method provided in an embodiment of this disclosure. (See attached flowchart.) Figure 2 As shown, this method is based on Figure 1 A specific alternative implementation of the method shown is provided. Specifically, the method includes not only steps S1 to S3, but also step S01 preceding step S1. Step S01 will be described in detail below.
[0087] Step S01: Transform the source video stream according to the display parameters of the display panel.
[0088] In step S01, after completing the transformation processing of the source video stream, step S1 is executed to perform split processing on the source video stream of the display panel; wherein, the transformation processing corresponds to the preprocessing process of the source video stream so that the preprocessed source video stream meets the display requirements of the display panel, which may specifically include format conversion and resolution conversion.
[0089] The display parameters include at least one of the following: timing parameters, color parameters, resolution parameters, and frame rate parameters. Color parameters correspond to the adapted color space, such as RGB (Red, Green, Blue) color space or YUV (Luminosity, Chromaticity, and Visibility) color space. Resolution parameters correspond to Full High Definition (FHD), 4K, 8K, etc. Frame rate parameters can be 50Hz, 60Hz, 120Hz, etc. For each of the above types of display parameters, the source video stream is transformed through processing including: timing synchronization, color space transformation, upsampling or downsampling, and frame rate transformation.
[0090] In some embodiments, the display parameters also include splicing method parameters, also known as arrangement method parameters, such as the Two Sample Interleave (2SI) method and the Square Division (SQD) method for 4K image video streams; corresponding to the type of display parameter, the source video stream is transformed, including splicing method transformation processing.
[0091] In some embodiments, the subsequent module devices corresponding to the subsequent steps include a fixed algorithm module, which has strict requirements on the timing and data format of the input signal. For example, each processing channel of the subsequent module that processes multiple video streams in parallel is adapted to process RGB444 / FHD / 60hz / SQD format videos. In this case, step S01 needs to be executed to perform transformation processing to ensure that the video format and timing meet the input requirements of the subsequent device modules.
[0092] Figure 3 This is a flowchart illustrating a specific implementation of step S1 in this disclosure. Specifically, the multi-channel display control command can be input by the user, and the multi-channel display control command may include the number of channels; such as... Figure 3 As shown, step S1, which is a step of splitting the source video stream of the display panel to obtain multiple identical sub-video streams in response to a multi-channel display control command, includes step S101.
[0093] Step S101: Perform split processing on the source video stream according to the number of splits and the resolution of the display panel.
[0094] In some embodiments, the resolution of each sub-data stream is determined based on the number of splits and the resolution of the display panel, such as by determining the resolution of each sub-data stream based on the ratio of the display panel resolution to the number of splits. The source video stream is then processed to obtain multiple sub-data streams, where the number of sub-data streams is the number of splits and the resolution is the previously determined resolution. Alternatively, in some embodiments, a minimum resolution for the sub-data streams or a maximum number of sub-data streams is pre-configured. The resolution of each sub-data stream and the actual number of splits are determined based on the number of splits and the resolution of the display panel, thereby processing the source video stream to obtain multiple sub-data streams.
[0095] Figure 4 This is a flowchart illustrating a specific implementation method of step S3 in this disclosure. Figure 4 As shown, step S3, which involves tiling and merging the processed sub-video streams to obtain the output video stream, includes step S301.
[0096] Step S301: Generate timing control signals according to the timing parameters corresponding to the display panel, adjust the timing of each processed sub-video stream according to the timing control signals, and tile and merge the timing-adjusted sub-video streams.
[0097] Since the resolution of the sub-video stream may not correspond to the display parameters of the display panel, and its timing may also not correspond to the timing parameters of the display panel, the timing of each sub-video stream is adjusted so that each sub-video stream can be displayed normally after tiling and merging.
[0098] Figure 5 This is a flowchart illustrating another specific implementation of step S3 in this disclosure. Figure 5 As shown, step S3, which involves tiling and merging the processed sub-video streams to obtain the output video stream, includes steps S31 and S32.
[0099] Step S31: Determine the arrangement method based on the number of sub-video streams and the resolution of the display panel, and determine the first display area corresponding to each sub-video stream.
[0100] This involves determining the arrangement method corresponding to the tiling and merging, and determining the pixel display position corresponding to each sub-video stream, which is the first display area.
[0101] Step S32: According to the arrangement and the first display area corresponding to each sub-video stream, the processed sub-video streams are tiled and merged.
[0102] Figure 6 This is a schematic diagram illustrating one arrangement in step S3 of an embodiment of this disclosure. For example... Figure 6As shown, it exemplifies an arrangement for two and four sub-video streams respectively. In (a), it exemplifies an arrangement for two sub-video streams, which is a tiled arrangement in the column direction, where V1 and V2 represent the first display areas for the two sub-video streams respectively. In (b), it exemplifies an arrangement for four sub-video streams, which is a tiled arrangement in the row and column directions, where V3, V4, V5, and V6 represent the first display areas for the four sub-video streams respectively. It should be noted that in some embodiments, the first display area can be a regular shape, such as a rectangle, triangle, or circle, and can be tiled in the column, row, or diagonal directions. Alternatively, in some embodiments, the first display area can be an irregular shape depending on actual needs. In some embodiments, the first display area for each sub-video stream is the same size, or in some embodiments, the first display area for each sub-video stream can be different, allowing the selection of the primary, interesting sub-video stream to occupy a larger area in its first display area.
[0103] Figure 7 A flowchart illustrating another display control method provided in this disclosure embodiment. Specifically, the method is based on... Figure 1 and Figure 5 A specific alternative implementation of the method shown is provided. For example... Figure 6 As shown, the method includes not only steps S1 to S32, but also step S201 before step S2. In some embodiments, for step S3, step S31 includes step S311, and step S32 includes step S321. The following describes steps S201, S311, and S321 in detail only.
[0104] Specifically, for each sub-video stream, before performing step S2 to obtain the processing parameters corresponding to the sub-video stream and process the sub-video stream according to the processing parameters, the method further includes step S201.
[0105] Step S201: For each sub-video stream, perform video analysis on the sub-video stream according to the preset first analysis item;
[0106] Before performing video image processing on each sub-video stream, it can be analyzed to determine its various video image parameters for accurate subsequent processing. The first analysis item includes at least one of the following: color waveform analysis, video brightness waveform analysis, video color histogram analysis, video brightness histogram analysis, video color vector analysis, video brightness pseudo-color marking, video focus quality analysis, video brightness area marking, and video pixel visualization marking.
[0107] In some embodiments, such as Figure 7As shown, in step S201, for each sub-video stream, based on video analysis of the sub-video stream according to the preset first analysis item: step S31, determining the arrangement method and determining the first display area corresponding to each sub-video stream according to the number of sub-video streams and the resolution of the display panel, including step S311; step S32, tiling and merging the processed sub-video streams according to the arrangement method and the first display area corresponding to each sub-video stream, including step S321.
[0108] Step S311: Based on the number of sub-video streams and the resolution of the display panel, determine the arrangement method, determine the first display area corresponding to each sub-video stream, and determine the second display area corresponding to the video analysis result image.
[0109] The first display area is used to display the sub-video streams; the second display area, also known as the reserved area, is used to display the video analysis result image corresponding to each sub-video stream. This video analysis result image is generated based on the video analysis results and can represent various video image parameters of the sub-video stream. Setting up the second display area can improve the perceptibility of video image processing operations, allowing users to intuitively determine the video image processing effect and the degree of change. In addition, the setting of the second display area can also avoid excessive transformation of the resolution of the sub-video streams and prevent the display image from being compressed or stretched.
[0110] Step 321: Based on the arrangement, the first display area corresponding to each sub-video stream, and the second display area corresponding to the video analysis result image, the processed sub-video streams and video analysis result images are tiled and merged.
[0111] Figure 8 This is a schematic diagram illustrating another arrangement in step S3 of an embodiment of this disclosure. For example... Figure 8 As shown, it exemplifies an arrangement for two and three sub-video streams respectively. Specifically, in (c), it exemplifies an arrangement for two sub-video streams, which is a tiling arrangement in the row direction. V11 and V21 represent the first display areas corresponding to the two sub-video streams, and Blank1 and Blank2 represent two second display areas, which can be used to display the video analysis result image corresponding to at least one of the two sub-video streams. In (d), it exemplifies an arrangement for three sub-video streams, where V7, V8, and V9 represent the first display areas corresponding to the three sub-video streams, and Blank3 and Blank4 represent two second display areas, which can be used to display the video analysis result image corresponding to at least one of the three sub-video streams.
[0112] Figure 9A flowchart illustrating another display control method provided in an embodiment of this disclosure. Specifically, the method is based on... Figure 7 A specific alternative implementation of the method shown is provided. For example... Figure 9 As shown, the method includes not only steps S1 to S321, but also steps S202 and S203 before step S3. The following describes steps S202 and S203 in detail only.
[0113] Prior to step S3, which involves tiling and merging the processed sub-video streams to obtain the output video stream, the method further includes:
[0114] Step S202: According to the preset second analysis item, perform pairwise difference analysis on at least two of the processed sub-video streams.
[0115] The second analysis item includes at least one of pixel value difference analysis, pixel grayscale value difference analysis, and pixel gradient feature value difference analysis. Corresponding to each of the above second analysis items, when performing difference analysis, it is performed on two pixels in the same time sequence, the same frame, and at the same pixel position in the two sub-video streams. Specifically, when performing pixel value difference analysis, the pixel values of the two pixels can be compared to obtain the difference analysis result; when performing pixel grayscale value difference analysis, the grayscale values of the two pixels can be compared to obtain the difference analysis result; when performing pixel gradient feature value difference analysis, the gradient feature values of the two pixels within the same frame can be compared to obtain the difference analysis result.
[0116] In some embodiments, the second analysis item may further include pixel subpixel component difference analysis; specifically, when performing pixel subpixel component difference analysis, the values of the subpixel components of two pixels can be compared to obtain the difference analysis result, such as for a sub-video stream based on red-green-blue color space, comparing any one of the red component, green component and blue component of two pixels to obtain the difference analysis result.
[0117] Step S203: Based on the difference analysis results, the pixels that meet the preset marking conditions are marked through the on-screen menu adjustment (On Screen Display, OSD).
[0118] The marking condition is that the difference value between the two pixels undergoing difference analysis is greater than a preset difference threshold. When marking pixels, both pixels undergoing difference analysis can be marked simultaneously, or only one of them can be marked. In some embodiments, the pixel can be marked by covering it with a dot of a specific color, or by selecting it with a frame of a specific color. Such methods can include red dots, red frames, etc.
[0119] It should be noted that the above-mentioned combination of video analysis and difference analysis is only a specific optional implementation scheme provided by the embodiments of this disclosure, and it will not affect the protection scope of the technical solution of this disclosure. The two implementations independently are equally applicable to the technical solution of this disclosure.
[0120] This disclosure provides a display control method that can be used to perform video analysis on sub-video streams before video image processing, enabling users to clearly monitor various image parameters; and to perform pairwise difference analysis on sub-video streams after video image processing, enabling users to accurately judge the video image processing effect and quality by combining the actual processed image and the perceptible difference; if the above two are implemented in combination, the perceptibility of the difference between different video image processing operations is improved, while allowing users to intuitively monitor specific image parameters.
[0121] Figure 10 This is a schematic diagram of a display control device provided in an embodiment of this disclosure. Figure 10 As shown, the device includes: a splitting processing module 1, a sub-video stream processing module 2, and a tiling merging module 3.
[0122] The splitting processing module 1 has multiple splitting output terminals 11. The splitting processing module 1 is used to split the source video stream of the display panel in response to the multi-channel display control command to obtain multiple identical sub-video streams. It also outputs each sub-video stream through a corresponding splitting output terminal 11. That is, each splitting output terminal 11 corresponds to a transmission path for transmitting one sub-video stream.
[0123] The sub-video stream processing module 2 has multiple processing units 22, each processing unit 22 corresponding to a split output terminal 11; the processing unit 22 is used to obtain the processing parameters corresponding to the sub-video stream, process the sub-video stream according to the processing parameters and output it.
[0124] The tile merging module 3 is used to tile and merge the processed sub-video streams to obtain the output video stream; and to output the output video stream to the display panel for display.
[0125] In some embodiments, each branch output terminal 11 of the branch processing module 1 is connected to the sub-video stream processing module 2 through a buffer device (such as a register) for data buffering.
[0126] In some embodiments, such as Figure 10 As shown, the display control device also includes a transformation processing module 4.
[0127] The transformation processing module 4 is used to transform the source video stream according to the display parameters of the display panel. The display parameters include at least one of the following: timing parameters, color parameters, resolution parameters, and frame rate parameters.
[0128] In some embodiments, such as Figure 10 As shown, the sub-video stream processing module 2 also includes multiple analysis units 21 corresponding to the multiple processing units 22; the analysis unit 21 is used to perform video analysis on the sub-video stream according to a preset first analysis item; wherein, the first analysis item includes at least one of the following: color waveform analysis, video brightness waveform analysis, video color histogram analysis, video brightness histogram analysis, video color vector analysis, video brightness pseudo-color marking, video focus quality analysis, video brightness area marking, and video pixel visualization marking.
[0129] In some embodiments, the tiling merging module 3 is specifically used to determine the arrangement method based on the number of sub-video streams and the resolution of the display panel, and to determine the first display area corresponding to each sub-video stream; and to tile and merge the processed sub-video streams according to the arrangement method and the first display area corresponding to each sub-video stream.
[0130] In some embodiments, based on the sub-video stream processing module including multiple analysis units 21, the tiling and merging module 3 is specifically used to determine the arrangement method according to the number of sub-video streams and the resolution of the display panel, determine the first display area corresponding to each sub-video stream, and determine the second display area corresponding to the video analysis result image of the analysis unit 21, wherein the first display area and the second display area do not overlap; and to tile and merge the processed sub-video streams and the video analysis result image according to the arrangement method, the first display area corresponding to each sub-video stream, and the second display area corresponding to the video analysis result image.
[0131] In some embodiments, such as Figure 10 As shown, the display control device also includes: a difference analysis module 5.
[0132] The difference analysis module 5 is used to perform pairwise difference analysis on at least two of the processed sub-video streams according to a preset second analysis item; wherein the second analysis item includes at least one of pixel value difference analysis, pixel grayscale value difference analysis and pixel gradient feature value difference analysis.
[0133] In some embodiments, the display control device further includes a marking module (not shown) for marking pixels that meet preset marking conditions by means of a screen menu adjustment method based on the difference analysis results.
[0134] In some embodiments, the tile merging module further includes a timing control unit (not shown in the figure). The timing control unit is used to generate a timing control signal according to the timing parameters corresponding to the display panel; the tile merging module 3 is specifically used to perform timing adjustment on each processed sub-video stream according to the timing control signal, and to tile and merge the timing-adjusted sub-video streams.
[0135] In some embodiments, the tiling and merging module 3 determines the first display area corresponding to each sub-video stream. Then, for each frame of each sub-video stream, according to the timing control signal, the data of each pixel position of the frame is read in the same scanning order and synchronously written to each first display area. After the writing of each first display area is completed, a frame of the output video stream is obtained and output.
[0136] In some embodiments, the display control device further includes a parameter control module (not shown in the figure), which is connected to the system control surface, has external storage function, and can transmit the above-mentioned multi-channel display control commands, processing parameters, display parameters of the display panel, first analysis item, resolution of the display panel, second analysis item, timing parameters corresponding to the display panel, etc.
[0137] In some embodiments, the display control device further includes: a memory module, a first storage control unit correspondingly disposed in the split processing module 1, and a second storage control unit correspondingly disposed in the tiling and merging module 3 (not shown in the figure); the memory module has an internal storage function for interacting with the first storage control unit and the second storage control unit to perform data caching of the source video stream and the sub-video stream, and it may adopt a double data rate synchronous dynamic random access memory (DDR).
[0138] Figure 11 This is a schematic diagram of a display device provided in some embodiments of the present disclosure, such as... Figure 11 As shown, the display device includes a display panel 200 and the aforementioned display control device 300. The display panel 200 is used to display the output image generated by the display control device 300. In some embodiments, the display device may be a monitor device.
[0139] Figure 12 This is a block diagram illustrating the composition of an electronic device according to an embodiment of this disclosure. Figure 12As shown, the electronic device includes: one or more processors 101, a memory 102, and one or more I / O interfaces 103; the one or more processors 101 have one or more programs stored thereon, which, when executed by the one or more processors, cause the one or more processors 101 to implement any of the display control methods described in the above embodiments. The one or more I / O interfaces 103 are connected between the processor and the memory and configured to enable information interaction between the processor and the memory.
[0140] The processor 101 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 102 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH); the I / O interface (read / write interface) 103 is connected between the processor 101 and the memory 102, enabling information exchange between the processor 101 and the memory 102, including but not limited to a data bus (Bus).
[0141] In some embodiments, the processor 101, memory 102, and I / O interface 103 are interconnected via bus 104, and thus connected to other components of the computing device.
[0142] In some embodiments, the plurality of processors 101 include a plurality of graphics processors (GPUs) that can be combined to form a graphics processor array.
[0143] Figure 13 This is a block diagram illustrating the composition of a computer-readable medium provided in an embodiment of the present disclosure. The computer-readable medium stores a computer program, which, when executed by a processor, implements any of the display control methods described in the above embodiments.
[0144] It will be understood by those skilled in the art that all or some of the steps in the methods disclosed above, and the functional modules / units in the apparatus, can be implemented as software, firmware, hardware, and suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.
[0145] Example embodiments have been disclosed herein, and while specific terminology has been used, it is for illustrative purposes only and should be construed as such, and is not intended to be limiting. In some instances, it will be apparent to those skilled in the art that features, characteristics, and / or elements described in connection with particular embodiments may be used alone, or in combination with features, characteristics, and / or elements described in connection with other embodiments, unless otherwise expressly indicated. Therefore, those skilled in the art will understand that various changes in form and detail may be made without departing from the scope of this disclosure as set forth by the appended claims.
Claims
1. A display control method, wherein, include: In response to a multi-channel display control command, the source video stream of the display panel is split into multiple identical sub-video streams. Perform video analysis on the sub-video stream based on the preset first analysis item; For each of the sub-video streams, obtain the processing parameters corresponding to the sub-video stream, and process the sub-video stream according to the processing parameters; The processed sub-video streams are tiled and merged to obtain the output video stream, including: Based on the number of sub-video streams and the resolution of the display panel, the arrangement is determined, the first display area corresponding to each sub-video stream is determined, and the second display area corresponding to the video analysis result image is determined, wherein the first display area and the second display area do not overlap; According to the arrangement, the first display area corresponding to each sub-video stream, and the second display area corresponding to the video analysis result image, the processed sub-video streams and the video analysis result image are tiled and merged. The output video stream is then output to the display panel for display.
2. The display control method according to claim 1, wherein, The first analysis item includes: At least one of the following: color waveform analysis, video brightness waveform analysis, video color histogram analysis, video brightness histogram analysis, video color vector analysis, video brightness pseudocolor marking, video focus quality analysis, video brightness area marking, and video pixel visualization marking.
3. The display control method according to claim 1 or 2, wherein, The processing parameters include at least one of the following: color gamut parameters, brightness parameters, color temperature parameters, and sharpness parameters.
4. The display control method according to claim 1, wherein, Before performing multi-channel display control command to split the source video stream of the display panel into multiple identical sub-video streams, the method further includes: The source video stream is transformed according to the display parameters of the display panel, wherein the display parameters include at least one of timing parameters, color parameters, resolution parameters, and frame rate parameters.
5. The display control method according to claim 1, wherein, Before tiling and merging the processed sub-video streams to obtain the output video stream, the method further includes: According to the preset second analysis item, at least two of the processed sub-video streams are subjected to pairwise difference analysis. The second analysis item includes at least one of pixel value difference analysis, pixel grayscale value difference analysis, and pixel gradient feature value difference analysis.
6. The display control method according to claim 5, wherein, After performing pairwise difference analysis on at least two of the processed sub-video streams according to the preset second analysis term, the process includes: Based on the difference analysis results, pixels that meet the preset marking conditions are marked through a screen menu adjustment method. The marking condition is that the difference value between two pixels undergoing difference analysis is greater than a preset difference threshold.
7. The display control method according to claim 1, wherein, The multi-channel display control command includes the number of channels; The process of responding to a multi-channel display control command by splitting the source video stream of the display panel to obtain multiple identical sub-video streams includes: The source video stream is split into multiple streams based on the number of streams and the resolution of the display panel.
8. The display control method according to claim 1, wherein, The step of tiling and merging the processed sub-video streams to obtain the output video stream includes: A timing control signal is generated based on the timing parameters corresponding to the display panel. The timing of each of the processed sub-video streams is adjusted according to the timing control signal, and the timing-adjusted sub-video streams are tiled and merged.
9. A display control device, wherein, include: The branch processing module has multiple branch output terminals; The splitting processing module is used to split the source video stream of the display panel in response to the multi-channel display control command, so as to obtain multiple identical sub-video streams; And, each of the sub-video streams is output through a corresponding branch output terminal; The sub-video stream processing module has multiple processing units, each processing unit corresponding to one of the aforementioned split-output terminals; The processing unit is used to obtain the processing parameters corresponding to the sub-video stream, process the sub-video stream according to the processing parameters, and output it. The tiling and merging module is used to tile and merge the processed sub-video streams to obtain the output video stream; And, the output video stream is output to the display panel for display; The sub-video stream processing module further includes: a plurality of analysis units corresponding one-to-one with the plurality of processing units; the analysis unit is used to perform video analysis on the sub-video stream according to a preset first analysis item; The tiling and merging module is specifically used to determine the arrangement method based on the number of sub-video streams and the resolution of the display panel, determine the first display area corresponding to each sub-video stream, and determine the second display area corresponding to the video analysis result image of the analysis unit, wherein the first display area and the second display area do not overlap; and to perform tiling and merging on the processed sub-video streams and the video analysis result image based on the arrangement method, the first display area corresponding to each sub-video stream, and the second display area corresponding to the video analysis result image.
10. The display control device according to claim 9, wherein, Also includes: The transformation processing module is used to transform the source video stream according to the display parameters of the display panel, wherein the display parameters include at least one of timing parameters, color parameters, resolution parameters, and frame rate parameters.
11. The display control device according to claim 9, wherein, The first analysis item includes: At least one of the following: color waveform analysis, video brightness waveform analysis, video color histogram analysis, video brightness histogram analysis, video color vector analysis, video brightness pseudocolor marking, video focus quality analysis, video brightness area marking, and video pixel visualization marking.
12. The display control device according to claim 9, wherein, Also includes: The difference analysis module is used to perform pairwise difference analysis on at least two of the processed sub-video streams according to a preset second analysis item. The second analysis item includes at least one of pixel value difference analysis, pixel grayscale value difference analysis, and pixel gradient feature value difference analysis.
13. The display control device according to claim 9, wherein, The tile merging module also includes: A timing control unit is used to generate timing control signals based on the timing parameters corresponding to the display panel; The tiling and merging module is specifically used to perform timing adjustment on each of the processed sub-video streams according to the timing control signal, and to tile and merge the timing-adjusted sub-video streams.
14. A display device, comprising: Display panel and display control device; The display control device is the display control device as described in any one of claims 9 to 13.
15. A computer-readable medium having a computer program stored thereon, wherein, When the program is executed, it implements the display control method as described in any one of claims 1 to 8.