A display device
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HISENSE VISUAL TECH CO LTD
- Filing Date
- 2023-09-18
- Publication Date
- 2026-06-09
Smart Images
Figure CN119649775B_ABST
Abstract
Description
Technical Field
[0001] This application relates to image processing technology. More specifically, it relates to a display device. Background Technology
[0002] With the development of technology, people have put forward higher requirements for image display, not only requiring clear images, but also requiring complete image display.
[0003] In existing technologies, because the aspect ratio of some images differs from that of the display screen, black borders are added to the images to ensure the full content is displayed. This makes the aspect ratio of the processed image match that of the display screen before it is transmitted to the display device. However, during the process of adding black borders or during transmission, interference can easily occur, resulting in the black borders in the image received by the display device not being truly black, leading to lower image contrast and poor display quality.
[0004] Therefore, there is an urgent need for an image processing method that can process the image received by the display device to make the black border of the displayed image black. Summary of the Invention
[0005] This application provides a display device to address the urgent need for an image processing method that can process images received by the display device to achieve black borders on the displayed image.
[0006] In a first aspect, embodiments of this application provide a display device, the display device comprising:
[0007] The display screen and the processor, wherein the processor is configured to:
[0008] Get the current frame image from the video to be displayed;
[0009] A preset black border detection method is used to detect black borders in the current frame image to obtain a detection result, which is used to indicate whether there is a black border area or not.
[0010] If the detection result indicates the presence of a black border area, then the grayscale value of the pixels within the target black border area is set to zero to obtain the image to be displayed.
[0011] If the detection result indicates that there is no black border area, then the grayscale value of the current frame image will not be modified, and the current frame image will be used as the image to be displayed.
[0012] The display screen is configured to display the image to be displayed.
[0013] The beneficial effects of this embodiment are as follows: After the processor acquires the current frame image, it performs black border detection on the current frame image using a preset black border detection method to obtain the detection result. If the detection result indicates the existence of a black border area, the grayscale value of the pixels within the target black border area is set to zero, and the resulting image is then displayed on the screen. This solution, by performing black border detection on the current frame image and setting the grayscale value of the pixels within the detected black border area to zero before displaying, ensures that the black borders in the displayed image are black, improving image contrast and enhancing the display effect.
[0014] In some embodiments of this application, when the processor is used to perform black border detection on the current frame image using a preset black border detection method and obtain a detection result, it is specifically used for:
[0015] Determine the reference image corresponding to the current frame image;
[0016] Based on the brightness values of the pixels in the current frame image and the brightness values of the pixels in the reference image, black border detection is performed on the current frame image to obtain the detection result.
[0017] The beneficial effects of this embodiment are: by first determining the reference image, and then using the brightness values of the pixels in the current frame image and the reference image to perform black edge detection, the accuracy of the detection results is improved.
[0018] In some embodiments of this application, when the processor is used to determine the reference image corresponding to the current frame image, it is specifically used for:
[0019] A predetermined number of images adjacent to the current frame image in the video to be displayed are used as the reference images.
[0020] The beneficial effect of this embodiment is that by using images adjacent to the current frame image as reference images, the detection results generated using the reference images are more accurate.
[0021] In some embodiments of this application, when the processor performs black border detection on the current frame image based on the brightness values corresponding to pixels in the current frame image and the brightness values corresponding to pixels in the reference image, and obtains a detection result, it is specifically used for:
[0022] The first brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the reference image.
[0023] Determine whether there are first image pixels in the preset first black border area and the preset second black border area whose first brightness difference does not fall within the preset first brightness threshold range; the preset first black border area is located at the top and bottom edges of the display screen, and the preset second black border area is located at the left and right edges of the display screen;
[0024] If a first image pixel exists in the preset first black border area and the preset second black border area, a detection result indicating that no black border area exists is generated.
[0025] If there are no first image pixels in the preset first black border area or the preset second black border area, then the black border area in which there are no first image pixels is taken as the target black border area.
[0026] The detection result is generated based on the relationship between the number of first-image pixels outside the target black border area and a preset image number threshold.
[0027] The beneficial effects of this embodiment are as follows: by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the reference image, the first brightness difference of the pixel is obtained. Then, based on whether there are first screen pixels in the preset first black border area and the preset second black border area whose first brightness difference does not belong to the preset first brightness threshold range, a detection result is generated, making the detection result more accurate.
[0028] In some embodiments of this application, when the processor generates a detection result based on the relationship between the number of first image pixels outside the target black border area and a preset image number threshold, it is specifically used for:
[0029] Determine whether the number of pixels in the first frame outside the target black border area reaches or exceeds a preset frame number threshold.
[0030] If the number of first-image pixels outside the target black border area reaches or exceeds a preset image number threshold, a detection result indicating the presence of a black border area is generated.
[0031] If the number of pixels in the first frame outside the target black border area does not reach a preset frame number threshold, a detection result indicating that there is no black border area is generated.
[0032] The beneficial effect of this embodiment is that the detection result is generated based on the relationship between the number of first-frame pixels outside the target black border area and the preset frame number threshold, making the detection result more accurate.
[0033] In some embodiments of this application, when the processor is used to determine the reference image corresponding to the current frame image, it is specifically used for:
[0034] The preset first black-bordered image and the preset second black-bordered image are used as the reference images;
[0035] Wherein, the brightness value of the pixels in the preset first black border area of the preset first black border image is zero, and the brightness value of the pixels in the preset second black border area of the preset second black border image is zero; the preset first black border area is located at the upper and lower edges of the display screen, and the preset second black border area is located at the left and right edges of the display screen.
[0036] The beneficial effect of this embodiment is that by using the preset first black-border image and the preset second black-border image as reference images, the detection results generated using the reference images are more accurate.
[0037] In some embodiments of this application, when the processor performs black border detection on the current frame image based on the brightness values corresponding to pixels in the current frame image and the brightness values corresponding to pixels in the reference image, and obtains a detection result, it is specifically used for:
[0038] The second brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset first black border image.
[0039] The third brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset second black border image.
[0040] Determine whether there are second image pixels within the preset first black border area whose second brightness difference does not fall within the preset second brightness threshold range;
[0041] If there are second image pixels in the preset first black border area, then determine whether there are third image pixels in the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range.
[0042] If a third image pixel exists within the preset second black border area, a detection result indicating that no black border area exists is generated.
[0043] If there are no third-image pixels within the preset second black border area, a detection result is generated based on the relationship between the number of third-image pixels outside the preset second black border area and the preset image number threshold.
[0044] If there are no second image pixels within the preset first black border area, a detection result is generated based on the relationship between the number of second image pixels outside the preset first black border area and the preset image number threshold.
[0045] The beneficial effects of this embodiment are as follows: by subtracting the brightness values corresponding to pixels in the current frame image from the brightness values corresponding to pixels in the preset first black border image and the preset second black border image respectively, a second brightness difference and a third brightness difference of the pixels are obtained. Then, based on whether there are second-image pixels in the preset first black border area whose second brightness difference does not belong to the preset second brightness threshold range, and whether there are third-image pixels in the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range, a detection result is generated, making the detection result more accurate.
[0046] In some embodiments of this application, when the processor generates a detection result based on the relationship between the number of third-image pixels outside the preset second black border area and a preset image number threshold, it is specifically used for:
[0047] Set the preset second black border area as the target black border area;
[0048] Determine whether the number of third-view pixels outside the target black border area reaches or exceeds a preset screen number threshold;
[0049] If the number of third-view pixels outside the target black border area reaches or exceeds a preset screen number threshold, a detection result indicating the presence of a black border area is generated.
[0050] If the number of third-view pixels outside the target black border area does not reach the preset number of view pixels threshold, a detection result indicating that there is no black border area is generated.
[0051] The beneficial effect of this embodiment is that the detection result is generated based on the relationship between the number of third-view pixels outside the target black border area and the preset number of view pixels threshold, making the detection result more accurate.
[0052] In some embodiments of this application, when the processor generates a detection result based on the relationship between the number of pixels in the second frame outside the preset first black border area and a preset frame number threshold, it is specifically used for:
[0053] Set the preset first black border area as the target black border area;
[0054] Determine whether the number of pixels in the second frame outside the target black border area reaches or exceeds a preset frame number threshold.
[0055] If the number of second-image pixels outside the target black border area reaches or exceeds a preset image number threshold, a detection result indicating the presence of a black border area is generated.
[0056] If the number of pixels in the second frame outside the target black border area does not reach the preset frame number threshold, a detection result indicating that there is no black border area is generated.
[0057] The beneficial effect of this embodiment is that the detection result is generated based on the relationship between the number of second-image pixels outside the target black border area and the preset image number threshold, making the detection result more accurate.
[0058] In some embodiments of this application, before setting the grayscale value of pixels within the existing target black border region to zero, the processor is further configured to:
[0059] Determine whether there are any pixels with non-zero grayscale values within the target black border area;
[0060] Accordingly, when the processor is used to set the grayscale value of pixels within the existing target black border area to zero, it specifically performs the following:
[0061] If there are pixels with non-zero grayscale values within the target black border area, then the grayscale values of the pixels within the target black border area are set to zero.
[0062] The beneficial effects of this embodiment are: after detecting a black border area, if there are pixels with non-zero gray values in the black border area, the gray values of the pixels in the black border area are set to zero, making the detection of whether the black border is displayed as black more accurate and ensuring that the black border of the displayed image is black. Attached Figure Description
[0063] To more clearly illustrate the implementation methods in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.
[0064] Figure 1 A schematic diagram of the 16:9 image provided in this application after adding top and bottom black borders;
[0065] Figure 2 A schematic diagram of the 16:9 image provided in this application after adding black borders on the left and right sides;
[0066] Figure 3 This is a schematic diagram of the structure of the display device provided in this application;
[0067] Figure 4 A flowchart illustrating the image processing method provided in this application;
[0068] Figure 5 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 1 ;
[0069] Figure 6 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 2 ;
[0070] Figure 7 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 3 ;
[0071] Figure 8 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 4 ;
[0072] Figure 9 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 5 ;
[0073] Figure 10 This is a schematic diagram of the structure of an embodiment of the image processing apparatus provided in this application. Detailed Implementation
[0074] To make the objectives, implementation methods and advantages of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.
[0075] Based on the exemplary embodiments described in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of the appended claims. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete implementation on its own.
[0076] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0077] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities and do not necessarily imply a specific order or sequence, unless otherwise indicated. It should be understood that such terms can be used interchangeably where appropriate, for example, to implement the application in a sequence other than those given in the embodiments illustrated or described herein.
[0078] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.
[0079] With the development of technology, images can be processed in various ways to meet people's different needs. Now it is possible to display the full content of an image even when the image size ratio is different from the display screen size ratio.
[0080] In existing technologies, since the aspect ratio of some images is different from that of the display screen in the display device, in order to display the full content of the image, black borders can be added to the image so that the aspect ratio of the processed image is the same as that of the display screen, and then the processed image is transmitted to the display device for display.
[0081] For example, if the image has a 21:9 aspect ratio and the screen's aspect ratio is 16:9, black borders need to be added to the top and bottom of the image to achieve a 16:9 ratio. For instance, Figure 1 This is a schematic diagram of the 16:9 image provided in this application after adding top and bottom black borders, as shown below. Figure 1 As shown, the top and bottom edges of the image are black borders.
[0082] For example, if the image has a 4:3 aspect ratio and the screen's aspect ratio is 16:9, black borders need to be added to the left and right sides of the image to achieve a 16:9 ratio. For instance, Figure 2 This is a schematic diagram of the 16:9 image provided in this application after adding black borders on the left and right sides, as shown below. Figure 2 As shown, the left and right edges of the image are black borders.
[0083] However, during the process of adding black borders to an image, or during transmission, interference can easily occur, causing the black borders in the image received by the display device to not be black, resulting in lower image contrast and poor display quality. Therefore, there is an urgent need for an image processing method that can process the image received by the display device to ensure that the black borders in the displayed image are black.
[0084] To address the problems existing in the prior art, the inventors, during their research on image processing methods, discovered that to display black borders in an image as black, after acquiring the current frame image, black border detection is performed. If a black border area is detected, the grayscale value of the pixels within that area is set to zero, resulting in the final image to be displayed. In this displayed image, the black borders are black, effectively improving image contrast and display quality. Based on the above inventive concept, the image processing scheme described in this application was designed.
[0085] The following provides examples illustrating the application scenarios of the image processing method provided in this application.
[0086] For example, in this scenario, a user watches a video using a display device. After the display device acquires the current frame image, it uses a preset black border detection method to detect black borders in the current frame image and obtains the detection result.
[0087] If the detection result indicates the presence of a black border area, the grayscale value of the pixels within the target black border area is set to zero to obtain the image to be displayed, which is then displayed for the user to view.
[0088] The black borders in the displayed image are black, which improves the display effect.
[0089] It should be noted that the above scenario is only an example of an application scenario provided by the embodiments of this application. The embodiments of this application do not limit the actual form of the various devices included in the scenario. In the specific application of the solution, it can be set according to actual needs.
[0090] Figure 3 This is a schematic diagram of the structure of the display device provided in this application, such as... Figure 3 As shown, the display device includes a processor, a display screen connected to the processor, a communication unit connected to the processor, an external interface, and a memory. Figure 4 This is a flowchart illustrating the image processing method provided in this application. The execution subject of this method can be a display device. The method in this embodiment can be implemented by software, hardware, or a combination of software and hardware.
[0091] like Figure 4 As shown, the processor in the display device is configured to perform the following steps:
[0092] S401: Get the current frame image from the video to be displayed.
[0093] After receiving the current frame image from the video to be displayed, the external interface or communication unit in the display device transmits it to the processor for processing.
[0094] S402: Use a preset black border detection method to perform black border detection on the current frame image and obtain the detection result.
[0095] After the processor acquires the current frame image, it can use a preset black border detection method to perform black border detection on the current frame image and obtain the detection result. The detection result is used to indicate whether there is a black border area or not.
[0096] Specifically, a reference image corresponding to the current frame image can be determined first; then, based on the brightness values of the pixels in the current frame image and the brightness values of the pixels in the reference image, black border detection can be performed on the current frame image to obtain the detection result.
[0097] During the black border detection process, if a black border area is detected, the target black border area will also be identified.
[0098] S403: If the detection result indicates the existence of a black border area, the grayscale value of the pixels in the target black border area is set to zero to obtain the image to be displayed.
[0099] After the processor receives the detection results, if the detection results indicate the existence of a black border area, it sets the grayscale value of the pixels in the target black border area to zero, thus obtaining the image to be displayed.
[0100] It should be noted that if a pixel includes multiple sub-pixels, the grayscale value of each sub-pixel within the target black border area will be set to zero.
[0101] It should be noted that if the detection result indicates that there is no black border area, the grayscale value of the current frame image will not be modified, and the current frame image will be used as the image to be displayed.
[0102] The display screen is configured to display the image to be displayed. Because the grayscale values of the pixels within the target black border area of the image to be displayed are set to zero, the target black border area in the displayed image appears black.
[0103] The display device provided in this embodiment includes a display screen and a processor. The processor is configured to acquire a current frame image, perform black border detection on the current frame image using a preset black border detection method, and obtain a detection result. If the detection result indicates the existence of a black border area, the grayscale value of the pixels within the target black border area is set to zero, and the resulting image is displayed on the display screen. This solution, by performing black border detection on the current frame image and setting the grayscale value of the pixels within the detected black border area to zero before displaying, achieves black borders in the displayed image, improving image contrast and display effect.
[0104] Furthermore, based on the above embodiments, this application embodiment describes the case where the processor uses a preset number of images adjacent to the current frame image as reference images and performs black border detection based on the reference images. Figure 5 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 1 The processor in the display device is configured to perform the following steps:
[0105] S501: Subtract the brightness value of the pixel in the current frame image from the brightness value of the pixel in the reference image to obtain the first brightness difference value of the pixel.
[0106] After the processor obtains the current frame image, it can use a preset number of images adjacent to the current frame image in the video to be displayed as reference images.
[0107] For each pixel, the difference between the brightness value of the pixel in the current frame image and the brightness value of the pixel in the reference image is used to obtain the first brightness difference value of the pixel.
[0108] It should be noted that the preset number of images adjacent to the current frame in the video to be displayed can be: a preset number of images before the current frame; a preset number of images after the current frame; or a preset number of images randomly selected from the preset number of images before and after the current frame. The preset number can be 2, 3, 5, etc. This application embodiment does not limit the preset number of images adjacent to the current frame in the video to be displayed, and the preset number can be determined according to the actual situation.
[0109] S502: Determine whether there are any first image pixels in the preset first black border area and the preset second black border area whose first brightness difference does not fall within the preset first brightness threshold range. If there are first image pixels in the preset first black border area and the preset second black border area, proceed to step S503; if there are no first image pixels in the preset first black border area or the preset second black border area, proceed to step S504.
[0110] After obtaining the first brightness difference of each pixel, the processor determines whether there are first image pixels in the preset first black border area and preset second black border area whose first brightness difference does not belong to the preset first brightness threshold range.
[0111] The first black border area is preset to be located at the top and bottom edges of the display screen, and the second black border area is preset to be located at the left and right edges of the display screen.
[0112] It should be noted that the preset first brightness threshold range can be [-2, 2], [-3, 3], [-5, 5], etc. This application embodiment does not limit the preset first brightness threshold range, and it can be set according to the actual situation.
[0113] S503: Generate detection results for areas without black borders.
[0114] If the processor determines that there are first image pixels in the preset first black border area and the preset second black border area, it means that there is no black border in the current frame image, and then generates a detection result that there is no black border area.
[0115] S504: The black border area that does not contain any pixels of the first image among the preset first black border area and the preset second black border area shall be taken as the target black border area.
[0116] If the processor determines that there are no first image pixels in the preset first black border area or the preset second black border area, but still cannot determine whether there is a black border in the current frame image, it needs to take the black border area that does not contain first image pixels from the preset first black border area and the preset second black border area as the target black border area.
[0117] S505: Generate detection results based on the relationship between the number of pixels in the first frame outside the target black border area and the preset frame number threshold.
[0118] After the processor obtains the target black border area, it can generate a detection result based on the relationship between the number of first-frame pixels outside the target black border area and the preset frame number threshold.
[0119] It should be noted that a detection result can be generated for each reference image. When all detection results indicate the existence of a black border area, the detection result indicating the existence of a black border area will be used as the detection result required by this scheme. That is, the gray value of the pixels in the black border area needs to be set to zero based on the detection result.
[0120] When a detection result indicating the absence of a black border region exists, that result will be used as the detection result required by this solution.
[0121] The display device provided in this embodiment obtains a first brightness difference value for a pixel by subtracting the brightness value corresponding to a pixel in the current frame image from the brightness value corresponding to a pixel in the reference image. Then, it generates a detection result based on whether there are first screen pixels in the preset first black border area and preset second black border area whose first brightness difference value does not belong to the preset first brightness threshold range, making the detection result more accurate.
[0122] Furthermore, based on the above embodiments, this application embodiment describes how the processor generates detection results based on the relationship between the number of first frame pixels outside the target black border area and a preset frame number threshold. Figure 6 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 2 The processor in the display device is configured to perform the following steps:
[0123] S601: Determine whether the number of first-view pixels outside the target black border area reaches or exceeds the preset number of pixels threshold; if the number of first-view pixels outside the target black border area reaches or exceeds the preset number of pixels threshold, then execute step S602; if the number of first-view pixels outside the target black border area does not reach or exceeds the preset number of pixels threshold, then execute step S603.
[0124] After the processor obtains the target black border area, it determines whether the number of first-frame pixels outside the target black border area reaches or exceeds a preset frame number threshold to determine whether there is a black border in the current frame image.
[0125] It should be noted that the preset threshold for the number of frames can be 300,000, 550,000, 1,400,000, etc. This application embodiment does not limit the preset threshold for the number of frames, and it can be set according to the actual situation.
[0126] S602: Generate detection results for areas with black borders.
[0127] If the processor determines that the number of pixels in the first frame outside the target black border area reaches or exceeds the preset frame number threshold, it indicates that there is a black border in the current frame image, and then generates a detection result indicating the presence of a black border area.
[0128] S603: Generate detection results for areas without black borders.
[0129] If the processor determines that the number of pixels in the first frame outside the target black border area does not reach the preset frame number threshold, it means that there is no black border in the current frame image, and the current frame image may be a black image. In this case, a detection result indicating that there is no black border area is generated.
[0130] The display device provided in this embodiment generates a detection result indicating the presence of a black border area when the number of first-screen pixels outside the target black border area reaches or exceeds a preset screen number threshold; and generates a detection result indicating the absence of a black border area when the number of first-screen pixels outside the target black border area does not reach or exceed the preset screen number threshold, thus making the detection result more accurate.
[0131] Furthermore, based on the above embodiments, this application embodiment describes the situation where the processor uses a preset first black border image and a preset second black border image as reference images, and performs black border detection based on the reference images. Figure 7 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 3 The processor in the display device is configured to perform the following steps:
[0132] S701: Subtract the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset first black border image to obtain the second brightness difference value of the pixel.
[0133] After the processor obtains the current frame image, it can use the preset first black border image and the preset second black border image as reference images.
[0134] In the preset first black border image, the brightness value of the pixels in the preset first black border area is zero, and the brightness value of the pixels in the preset second black border area is zero; the preset first black border area is located at the top and bottom edges of the display screen, and the preset second black border area is located at the left and right edges of the display screen.
[0135] For each pixel, the difference between the brightness value of the pixel in the current frame image and the brightness value of the pixel in the preset first black border image is used to obtain the second brightness difference value of the pixel.
[0136] S702: Subtract the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset second black border image to obtain the third brightness difference value of the pixel.
[0137] After the processor determines the reference image, for each pixel, the brightness value corresponding to the pixel in the current frame image is subtracted from the brightness value corresponding to the pixel in the preset second black border image to obtain the third brightness difference value of the pixel.
[0138] It should be noted that the execution order of steps S701 and S702 can be as follows: step S701 can be executed first, followed by step S702; step S702 can be executed first, followed by step S701; or steps S701 and S702 can be executed simultaneously. This embodiment does not limit the execution order of steps S701 and S702, and can be set according to actual circumstances.
[0139] S703: Determine whether there is a second image pixel in the preset first black border area whose second brightness difference does not belong to the preset second brightness threshold range; if there is a second image pixel in the preset first black border area, then execute step S704; if there is no second image pixel in the preset first black border area, then execute step S707.
[0140] After obtaining the second brightness difference, the processor determines whether there are second image pixels in the preset first black border area whose second brightness difference does not belong to the preset second brightness threshold range, so as to determine whether there are top and bottom black borders in the current frame image.
[0141] It should be noted that the preset second brightness threshold range can be [-3, 3], [-5, 5], [-7, 7], etc. This application embodiment does not limit the preset second brightness threshold range, and it can be set according to the actual situation.
[0142] S704: Determine whether there is a third image pixel in the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range; if there is a third image pixel in the preset second black border area, then execute step S705; if there is no third image pixel in the preset second black border area, then execute step S706.
[0143] If the processor determines that there are second image pixels within the preset first black border area, it means that there are no top and bottom black borders in the current frame image. It is also necessary to determine whether there are left and right black borders in the current frame image, and to determine whether there are third image pixels within the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range.
[0144] S705: Generate detection results for areas without black borders.
[0145] If the processor determines that there are third-image pixels within the preset second black border area, it means that there are no left or right black borders in the current frame image, and then generates a detection result indicating that there are no black border areas.
[0146] S706: Generate detection results based on the relationship between the number of third-image pixels outside the preset second black border area and the preset image number threshold.
[0147] If the processor determines that there are no third-image pixels within the preset second black border area, it still cannot determine whether there are left and right black borders in the current frame image. It needs to generate a detection result based on the relationship between the number of third-image pixels outside the preset second black border area and the preset number threshold.
[0148] S707: Generate detection results based on the relationship between the number of second-image pixels outside the preset first black border area and the preset image number threshold.
[0149] If the processor determines that there are no second-image pixels within the preset first black border area, it still cannot determine whether there are top and bottom black borders in the current frame image. It needs to generate a detection result based on the relationship between the number of second-image pixels outside the preset first black border area and the preset number threshold.
[0150] The display device provided in this embodiment obtains a second brightness difference and a third brightness difference for the pixels by subtracting the brightness values corresponding to the pixels in the current frame image from the brightness values corresponding to the pixels in the preset first black border image and the preset second black border image, respectively. Then, it generates a detection result based on whether there are second screen pixels in the preset first black border area whose second brightness difference does not belong to the preset second brightness threshold range, and whether there are third screen pixels in the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range, making the detection result more accurate.
[0151] Furthermore, based on the above embodiments, this application embodiment describes how the processor generates detection results based on the relationship between the number of third-image pixels outside the preset second black border area and the preset image number threshold. Figure 8 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 4 The processor in the display device is configured to perform the following steps:
[0152] S801: Set the preset second black border area as the target black border area.
[0153] If the processor determines that there are no third-image pixels within the preset second black border area, but still cannot determine whether there are left and right black borders in the current frame image, it will first use the preset second black border area as the target black border area.
[0154] S802: Determine whether the number of third-view pixels outside the target black border area reaches or exceeds the preset number of pixels threshold; if the number of third-view pixels outside the target black border area reaches or exceeds the preset number of pixels threshold, proceed to step S803; if the number of third-view pixels outside the target black border area does not reach or exceeds the preset number of pixels threshold, proceed to step S804.
[0155] After the processor sets the preset second black border area as the target black border area, it determines whether the number of third-frame pixels outside the target black border area reaches or exceeds the preset frame number threshold in order to determine whether there are left and right black borders in the current frame image.
[0156] S803: Generate detection results for areas with black borders.
[0157] If the processor determines that the number of third-frame pixels outside the target black border area reaches or exceeds the preset frame number threshold, it indicates that there are left and right black borders in the current frame image, and then generates a detection result indicating the presence of a black border area.
[0158] S804: Generate detection results for areas without black borders.
[0159] If the processor determines that the number of third-frame pixels outside the target black border area does not reach the preset frame number threshold, it means that there are no left or right black borders in the current frame image, and the current frame image may be a black image. In this case, a detection result indicating that there are no black border areas is generated.
[0160] The display device provided in this embodiment generates a detection result indicating the presence of a black border area when the number of third-view pixels outside the target black border area reaches or exceeds a preset number of pixels threshold; and generates a detection result indicating the absence of a black border area when the number of third-view pixels outside the target black border area does not reach or exceed the preset number of pixels threshold, thus making the detection result more accurate.
[0161] Furthermore, based on the above embodiments, this application embodiment describes the situation where the processor generates detection results according to the relationship between the number of second screen pixels outside the preset first black border area and the preset screen number threshold. Figure 9 The flowchart provided in this application illustrates the process of detecting black borders in the current frame image. Figure 5 The processor in the display device is configured to perform the following steps:
[0162] S901: Set the preset first black border area as the target black border area.
[0163] If the processor determines that there are no second-image pixels within the preset first black border area, but still cannot determine whether there are top and bottom black borders in the current frame image, it will first use the preset first black border area as the target black border area.
[0164] S902: Determine whether the number of pixels in the second frame outside the target black border area reaches or exceeds the preset frame number threshold; if the number of pixels in the second frame outside the target black border area reaches or exceeds the preset frame number threshold, then execute step S903; if the number of pixels in the second frame outside the target black border area does not reach or exceeds the preset frame number threshold, then execute step S904.
[0165] After the processor sets the preset first black border area as the target black border area, it determines whether the number of second frame pixels outside the target black border area reaches or exceeds the preset frame number threshold in order to determine whether there are top and bottom black borders in the current frame image.
[0166] S903: Generate detection results for areas with black borders.
[0167] If the processor determines that the number of second-frame pixels outside the target black border area reaches or exceeds the preset frame number threshold, it indicates that there are top and bottom black borders in the current frame image, and then generates a detection result indicating the presence of a black border area.
[0168] S904: Generate detection results for areas without black borders.
[0169] If the processor determines that the number of pixels in the second frame outside the target black border area does not reach the preset frame number threshold, it means that there are no top and bottom black borders in the current frame image, and the current frame image may be a black image. In this case, a detection result indicating that there is no black border area is generated.
[0170] The display device provided in this embodiment generates a detection result indicating the presence of a black border area when the number of second-screen pixels outside the target black border area reaches or exceeds a preset screen number threshold; and generates a detection result indicating the absence of a black border area when the number of second-screen pixels outside the target black border area does not reach or exceed the preset screen number threshold, thus making the detection result more accurate.
[0171] Furthermore, based on the above embodiments, this application embodiment describes the situation where the processor determines whether there are pixels with non-zero gray values in the target black border area before setting the gray values of pixels in the target black border area to zero.
[0172] To save energy and ensure that the black borders of the displayed image are black, after the processor determines that the detection result indicates the existence of a black border area, before setting the grayscale value of the pixels in the target black border area to zero, it is necessary to determine whether there are pixels with non-zero grayscale values in the target black border area.
[0173] If there are no pixels with non-zero grayscale values within the target black border area, it means that the black border of the displayed image is black. There is no need to set the grayscale values of the pixels within the target black border area to zero, which can save energy.
[0174] If there are pixels with non-zero grayscale values within the target black border area, then setting the grayscale values of the pixels within the target black border area to zero will ensure that the black border of the displayed image is black.
[0175] It should be noted that if a pixel includes multiple sub-pixels, it is necessary to determine whether there are sub-pixels with non-zero grayscale values within the target black border region. If there are sub-pixels with non-zero grayscale values within the target black border region, then the grayscale values of the sub-pixels within the target black border region are set to zero.
[0176] The display device provided in this embodiment, after determining that the detection result indicates the existence of a black border area, sets the gray value of the pixels in the black border area to zero if there are pixels with a non-zero gray value in the black border area, making the detection of whether the black border is displayed as black more accurate and ensuring that the black border of the displayed image is black.
[0177] This application also provides an image processing method, the steps of which may include:
[0178] Get the current frame image from the video to be displayed.
[0179] A preset black border detection method is used to detect black borders in the current frame image, and the detection results are obtained.
[0180] If the detection result indicates the presence of a black border area, the grayscale value of the pixels within the target black border area is set to zero to obtain the image to be displayed.
[0181] If the detection result indicates that there is no black border area, then the grayscale value of the current frame image will not be modified, and the current frame image will be used as the image to be displayed.
[0182] Display the image to be displayed.
[0183] For specific implementation steps and technical effects, please refer to the above embodiments; this application will not repeat them here.
[0184] Figure 10 This is a schematic diagram illustrating the structure of an embodiment of the image processing apparatus provided in this application; the apparatus can be integrated into the display device in the above method embodiments, or it can be implemented through the display device in the above method embodiments. Figure 10 As shown, the image processing apparatus 1000 includes:
[0185] The acquisition module 1001 is used to acquire the current frame image in the video to be displayed.
[0186] Processing module 1002 is used for:
[0187] A preset black border detection method is used to detect black borders in the current frame image, and the detection results are obtained.
[0188] If the detection result indicates the presence of a black border area, the grayscale value of the pixels within the target black border area is set to zero to obtain the image to be displayed.
[0189] If the detection result indicates that there is no black border area, then the grayscale value of the current frame image will not be modified, and the current frame image will be used as the image to be displayed.
[0190] Display module 1003 is used to display the image to be displayed.
[0191] Furthermore, the processing module 1002 is specifically used for:
[0192] Determine the reference image corresponding to the current frame image;
[0193] Based on the brightness values of the pixels in the current frame image and the brightness values of the pixels in the reference image, black border detection is performed on the current frame image to obtain the detection result.
[0194] Furthermore, the processing module 1002 is specifically used to use a preset number of images in the video to be displayed that are adjacent to the current frame image as the reference image.
[0195] Furthermore, the processing module 1002 is specifically used for:
[0196] The first brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the reference image.
[0197] Determine whether there are first image pixels in the preset first black border area and the preset second black border area whose first brightness difference does not fall within the preset first brightness threshold range; the preset first black border area is located at the top and bottom edges of the display screen, and the preset second black border area is located at the left and right edges of the display screen;
[0198] If a first image pixel exists in the preset first black border area and the preset second black border area, a detection result indicating that no black border area exists is generated.
[0199] If there are no first image pixels in the preset first black border area or the preset second black border area, then the black border area in which there are no first image pixels is taken as the target black border area.
[0200] The detection result is generated based on the relationship between the number of first-image pixels outside the target black border area and a preset image number threshold.
[0201] Furthermore, the processing module 1002 is specifically used for:
[0202] Determine whether the number of pixels in the first frame outside the target black border area reaches or exceeds a preset frame number threshold.
[0203] If the number of first-image pixels outside the target black border area reaches or exceeds a preset image number threshold, a detection result indicating the presence of a black border area is generated.
[0204] If the number of pixels in the first frame outside the target black border area does not reach a preset frame number threshold, a detection result indicating that there is no black border area is generated.
[0205] Furthermore, the processing module 1002 is specifically used for:
[0206] The preset first black-bordered image and the preset second black-bordered image are used as the reference images;
[0207] Wherein, the brightness value of the pixels in the preset first black border area of the preset first black border image is zero, and the brightness value of the pixels in the preset second black border area of the preset second black border image is zero; the preset first black border area is located at the upper and lower edges of the display screen, and the preset second black border area is located at the left and right edges of the display screen.
[0208] Furthermore, the processing module 1002 is specifically used for:
[0209] The second brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset first black border image.
[0210] The third brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset second black border image.
[0211] Determine whether there are second image pixels within the preset first black border area whose second brightness difference does not fall within the preset second brightness threshold range;
[0212] If there are second image pixels in the preset first black border area, then determine whether there are third image pixels in the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range.
[0213] If a third image pixel exists within the preset second black border area, a detection result indicating that no black border area exists is generated.
[0214] If there are no third-image pixels within the preset second black border area, a detection result is generated based on the relationship between the number of third-image pixels outside the preset second black border area and the preset image number threshold.
[0215] If there are no second image pixels within the preset first black border area, a detection result is generated based on the relationship between the number of second image pixels outside the preset first black border area and the preset image number threshold.
[0216] Furthermore, the processing module 1002 is specifically used for:
[0217] Set the preset second black border area as the target black border area;
[0218] Determine whether the number of third-view pixels outside the target black border area reaches or exceeds a preset screen number threshold;
[0219] If the number of third-view pixels outside the target black border area reaches or exceeds a preset screen number threshold, a detection result indicating the presence of a black border area is generated.
[0220] If the number of third-view pixels outside the target black border area does not reach the preset number of view pixels threshold, a detection result indicating that there is no black border area is generated.
[0221] Furthermore, the processing module 1002 is specifically used for:
[0222] Set the preset first black border area as the target black border area;
[0223] Determine whether the number of pixels in the second frame outside the target black border area reaches or exceeds a preset frame number threshold.
[0224] If the number of second-image pixels outside the target black border area reaches or exceeds a preset image number threshold, a detection result indicating the presence of a black border area is generated.
[0225] If the number of pixels in the second frame outside the target black border area does not reach the preset frame number threshold, a detection result indicating that there is no black border area is generated.
[0226] Furthermore, the processing module 1002 is also used for:
[0227] Determine whether there are any pixels with non-zero grayscale values within the target black border area;
[0228] If there are pixels with non-zero grayscale values within the target black border area, then the grayscale values of the pixels within the target black border area are set to zero.
[0229] The image processing apparatus provided in this embodiment is used to execute the technical solutions in any of the foregoing embodiments. Its implementation principle and technical effects are similar, and will not be described again here.
[0230] This application also provides a readable storage medium storing a computer program thereon, which, when executed by a processor, implements the technical solutions provided in any of the foregoing embodiments.
[0231] This application also provides a computer program product, including a computer program, which, when executed by a processor, is used to implement the technical solutions provided in any of the foregoing embodiments.
[0232] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.
[0233] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0234] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of embodiments suitable for specific application considerations.
Claims
1. A display device, characterized in that, The display device includes: The display screen and the processor, wherein the processor is configured to: Get the current frame image from the video to be displayed; Use the preset first black border image and the preset second black border image as reference images; Wherein, the brightness value of the pixels in the preset first black border area of the preset first black border image is zero, and the brightness value of the pixels in the preset second black border area of the preset second black border image is zero; the preset first black border area is located at the upper and lower edges of the display screen, and the preset second black border area is located at the left and right edges of the display screen; The second brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset first black border image. The third brightness difference value of the pixel is obtained by subtracting the brightness value of the pixel in the current frame image from the brightness value of the pixel in the preset second black border image. Determine whether there are second image pixels within the preset first black border area whose second brightness difference does not fall within the preset second brightness threshold range; If there are second image pixels in the preset first black border area, then determine whether there are third image pixels in the preset second black border area whose third brightness difference does not belong to the preset second brightness threshold range. If a third image pixel exists within the preset second black border area, a detection result indicating that no black border area exists is generated. If there are no third-image pixels within the preset second black border area, a detection result is generated based on the relationship between the number of third-image pixels outside the preset second black border area and the preset image number threshold. If there are no second image pixels within the preset first black border area, a detection result is generated based on the relationship between the number of second image pixels outside the preset first black border area and the preset image number threshold. The detection results are used to indicate whether a black border area exists or not. If the detection result indicates the presence of a black border area, then the grayscale value of the pixels within the target black border area is set to zero to obtain the image to be displayed. If the detection result indicates that there is no black border area, then the grayscale value of the current frame image will not be modified, and the current frame image will be used as the image to be displayed. The display screen is configured to display the image to be displayed.
2. The display device according to claim 1, characterized in that, When the processor generates a detection result based on the relationship between the number of pixels in the third frame outside the preset second black border area and a preset frame number threshold, it is specifically used for: Set the preset second black border area as the target black border area; Determine whether the number of third-view pixels outside the target black border area reaches or exceeds a preset screen number threshold; If the number of third-view pixels outside the target black border area reaches or exceeds a preset screen number threshold, a detection result indicating the presence of a black border area is generated. If the number of third-view pixels outside the target black border area does not reach the preset number of view pixels threshold, a detection result indicating that there is no black border area is generated.
3. The display device according to claim 1, characterized in that, When the processor generates a detection result based on the relationship between the number of pixels in the second frame outside the preset first black border area and a preset frame number threshold, it is specifically used for: Set the preset first black border area as the target black border area; Determine whether the number of pixels in the second frame outside the target black border area reaches or exceeds a preset frame number threshold. If the number of second-image pixels outside the target black border area reaches or exceeds a preset image number threshold, a detection result indicating the presence of a black border area is generated. If the number of pixels in the second frame outside the target black border area does not reach the preset frame number threshold, a detection result indicating that there is no black border area is generated.
4. The display device according to claim 2, characterized in that, Before setting the grayscale value of pixels within the existing target black border region to zero, the processor is further configured to: Determine whether there are any pixels with non-zero grayscale values within the target black border area; Accordingly, when the processor is used to set the grayscale value of pixels within the existing target black border area to zero, it specifically performs the following: If there are pixels with non-zero grayscale values within the target black border area, then the grayscale values of the pixels within the target black border area are set to zero.