Display device and screen mirror image display method
By processing the received image in the processor of the display device, the grayscale of the initial background content is converted into the target grayscale, which solves the problem of horizontal stripe interference in the black background area in vertical screen projection and achieves a high-quality projection display effect.
Patent Information
- Application Number
- PCT/CN2025/077237
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-05-30
- Filing Date
- 2025-02-13
- Publication Date
- 2025-12-04
AI Technical Summary
When a mobile phone projects its screen vertically to a display device using the Miracast protocol, horizontal lines appear in the black background area, causing interference. Traditional processing methods can affect the image quality and brightness of the display device, resulting in a poor user experience.
The received image is processed by the processor of the display device, and the grayscale of the pixels of the initial background content is converted into the target grayscale to ensure that the grayscale of the target background content is consistent, eliminate horizontal stripe interference, and at the same time, not affect the display effect of the target display content.
It effectively eliminates horizontal stripe interference in black background areas, ensuring the display clarity and brightness of the display device, improving the user experience, and does not affect the target display content.
Smart Images

Figure CN2025077237_04122025_PF_FP_ABST
Abstract
Description
Display devices and methods for displaying projected images
[0001] Cross-reference of related applications
[0002] This application claims priority to Chinese patent applications filed on May 30, 2024, application number 202410688606.2 and 202410688632.5, the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application relates to the field of display technology. More specifically, it relates to display devices and methods for displaying projected images. Background Technology
[0004] A mobile phone can project its screen content onto a display device such as a smart TV. Typically, mobile phones can project in portrait or landscape mode. When a mobile phone projects in portrait mode to a display device using the Miracast protocol, taking a smart TV as an example, signal interference exists in the black background area of the video signal sent from the phone to the smart TV's portrait display transport stream (TS), causing horizontal stripes to appear on the black background area of the smart TV display.
[0005] Currently, to reduce the impact of the aforementioned horizontal stripe interference on users, the traditional approach is to reduce the overall display quality, contrast, and brightness of each frame to weaken the visual effect of the horizontal stripes in the black background area of vertical screen projection. However, this approach affects the content displayed on the phone screen, resulting in poor image quality and insufficient brightness after projection. Summary of the Invention
[0006] According to some embodiments of this application, a display device is provided, which may include: a display screen configured to display images; a memory configured to store computer programs; and at least one processor connected to the display screen and the memory, the at least one processor being configured to execute the computer program to cause the display device to perform: receiving an image sent by a projection device; the image may include: target display content and initial background content; the initial background content may be used to match the size of the image with the size of the display screen; processing the image to obtain a processed image; the processed image may include: the target display content and target background content; the grayscale of the pixels of the target background content may be a target grayscale; and the processed image may be displayed on the display screen.
[0007] According to some embodiments of this application, a method for displaying a projected image on a display device is provided. The method may include: receiving an image sent by the projecting device; the image may include: target display content and initial background content; the initial background content may be used to match the size of the image with the display screen; processing the image to obtain a processed image; the processed image may include: the target display content and target background content; the grayscale of the pixels of the target background content may be a target grayscale; and the processed image may be displayed on the display screen of the display device. Attached Figure Description
[0008] Figure 1 is a schematic diagram of an application scenario for a display device;
[0009] Figure 2 is a schematic diagram of vertical screen mirroring from a mobile phone;
[0010] Figure 3 is a schematic diagram of screen mirroring in landscape mode on a mobile phone;
[0011] Figure 4 is a schematic diagram of the structure of a display device according to some embodiments of this application;
[0012] Figure 5 is a schematic diagram of the structure of another display device provided according to some embodiments of this application;
[0013] Figure 6 is a flowchart illustrating a screen projection image display method according to some embodiments of this application;
[0014] Figure 7 is a schematic diagram of a target frame image provided according to some embodiments of this application;
[0015] Figure 8 is a flowchart illustrating another method for displaying projected images according to some embodiments of this application;
[0016] Figure 9 is a flowchart illustrating another method for displaying projected images according to some embodiments of this application;
[0017] Figure 10 is a schematic diagram showing that the boundary of a target area does not coincide with the boundary of a backlight zone according to some embodiments of this application;
[0018] Figure 11 is a schematic diagram showing that the boundary of a target area coincides with the boundary of a backlight partition according to some embodiments of this application;
[0019] Figure 12 is a schematic diagram showing that one of the boundaries of a target area coincides with the boundary of a backlight zone according to some embodiments of this application;
[0020] Figure 13 is a flowchart illustrating another method for displaying projected images according to some embodiments of this application;
[0021] Figure 14 is a flowchart illustrating another method for displaying projected images according to some embodiments of this application. Detailed Implementation
[0022] To make the objectives, implementation methods, and advantages of this application clearer, some implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of some embodiments of this application. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.
[0023] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0024] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.
[0025] The display device provided in this application can have various implementation forms, such as a television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc.
[0026] Figure 1 illustrates an application scenario of a display device. As shown in Figure 1, the screen sharing device 100 can screen-share its own screen content to the display device 200 for display. Taking a mobile phone as the screen sharing device 100 and a television as the display device 200, the mobile phone can screen-share the content displayed on its screen onto the television for display.
[0027] Currently, Android phones primarily rely on the Miracast protocol (a wireless screen mirroring protocol) to project their screens to other display devices. These phones can project in portrait or landscape mode. For example, Figure 2 illustrates portrait screen mirroring, and Figure 3 illustrates landscape screen mirroring.
[0028] However, when an Android phone projects its screen to a display device in portrait mode using the Miracast protocol, the video signal sent from the phone to the display device in the portrait display transmission stream contains signal interference (not an ideal 0 grayscale) in the black background area. This causes the black background area displayed after the display device decodes the video signal to exhibit horizontal stripe interference, as shown in Figure 2.
[0029] Taking a backlight-based display device as an example, in the vertical screen display TS video signal sent from the mobile phone to the display device, signal interference in the black background area will cause the liquid crystal driving voltage at the signal interference position in the black background area of the display device to be inconsistent with the ideal value of 0 gray level voltage. Therefore, the flip angle of the liquid crystal molecules deviates from the expected value, resulting in differences in light transmission. Consequently, the black background area will exhibit horizontal stripe interference, and this horizontal stripe interference is more obvious when viewing the display device in a dark environment and at a wide viewing angle.
[0030] To address the horizontal stripe interference in the aforementioned screen projection scenarios, traditional methods include: after receiving the projection, the display device reduces all grayscale values between 0 and 7 in each frame to 0 grayscale for display, thus making the horizontal stripes in the black background area appear as a uniform color with the black background. In some other traditional methods, display devices also reduce the visual effect of the horizontal stripes in the black background area of vertical screen projection by lowering the overall display quality, contrast, and brightness of each frame when receiving the projection.
[0031] However, the aforementioned traditional processing methods all affect the content displayed on the mobile phone screen in the display device, such as resulting in poor image quality and insufficient brightness.
[0032] Based on this, some embodiments of this application propose a method that can eliminate interference only in the black background area without affecting the target display content of the projection device, i.e., a subsequent projection image display method. This method ensures that when the projection device projects the target display content to the display device, the display device can meet the clarity, brightness, and other requirements of the target display content, thus improving the user experience.
[0033] The display device may include a display screen and a processor, among other things. The display screen can be used for displaying images. It should be understood that this application does not limit the type of display screen.
[0034] In some embodiments, the display screen may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.
[0035] In some embodiments, the display device may include one or more displays.
[0036] The aforementioned processor can be connected to the display screen of the display device. The execution entity of the screen projection image display method provided in this application can, for example, be this processor. It should be understood that this application does not limit the type of processor.
[0037] In some embodiments, the processor may be any component with processing capabilities in the display device.
[0038] In some embodiments, the display device may include one or more processors, wherein when multiple processors are included, the corresponding functions can be achieved through cooperation between the processors.
[0039] Furthermore, it should be understood that this application does not limit the display technology used by the display device to achieve the display. For example, the display device can be a display device that displays images based on direct-view technology, or it can be a display device based on backlight display technology.
[0040] Taking a display device based on direct-view technology as an example, Figure 4 is a schematic diagram of the structure of a display device according to some embodiments of this application. As shown in Figure 4, the display device 400 may include: a processor 401 and a display screen 402.
[0041] In some embodiments, the display device 400 may further include a memory (not shown in FIG4) configured to store a computer program that the processor may execute to control the operation of the display device 400 and respond to user operations.
[0042] In some embodiments, the processor 401 may be configured to execute the computer program to enable the display device 400, for example, to acquire an image to be displayed and convert it into a format suitable for the display screen 402. Then, the processor 401 may be configured to execute the computer program to enable the display device 400, for example, to control the display screen 402 to display an image via a driving circuit or the like (not shown in FIG. 4).
[0043] Taking a display device based on backlight display technology as an example, Figure 5 is a schematic diagram of another display device provided according to some embodiments of this application. As shown in Figure 5, the display device 500 may include: an image quality processing module 501, an image display control module 502, a display screen 503, a backlight control module 504, and a backlight panel 505.
[0044] In some embodiments, the image quality processing module 501 can be used to acquire image data and backlight data of the image to be displayed. The image quality processing module 501 can output the image data to the image display control module 502, so that the image display control module 502 can illuminate the display screen 503 according to the image data. The image quality processing module 501 can also output the backlight data to the backlight control module 504, so that the backlight control module 504 can illuminate the backlight panel 505 according to the backlight data.
[0045] In some embodiments, the image display control module 502 may be, for example, a timing controller (TCON), and the backlight control module 504 may be, for example, a backlight controller (BCON). The image quality processing module 501 may house the chassis of the display device. This chassis may be, for example, a system-on-a-chip (SOC). In some embodiments, the processor of the display device may be, for example, the image quality processing module 502, and the memory of the display device may be, for example, the memory within the image quality processing module 501, or a memory connected to the image quality processing module 501. In some embodiments, the image quality processing module 501 can control the operation of the display device 500 and respond to user operations by executing a computer program stored in the memory.
[0046] Based on any of the foregoing embodiments of the display device (that is, the display device can be a display device based on direct display technology, a display device based on backlight technology, or other types of display devices, etc., which are not limited in this application), Figure 6 is a schematic flowchart of a screen projection image display method according to some embodiments of this application. This method is used in any of the foregoing embodiments of the display device, and the processor of the display device can execute a computer program stored in its memory to cause the display device to implement the method. As shown in Figure 6, the method may include, but is not limited to, the following steps:
[0047] S101, Receive images sent by the projection device.
[0048] The screen projection device involved in any embodiment of this application can be any electronic device capable of screen projection in the related technologies, such as a mobile phone, tablet computer, or laptop computer. This application does not limit the type of screen projection device.
[0049] In some embodiments, the image described above may be any frame from a video stream. For example, the image may be any frame from the TS video signal that the projection device sends to the display device via the Miracast projection protocol.
[0050] The aforementioned image may include: target display content and initial background content. The initial background content can be used to match the image size to the display screen. Taking Figure 2 as an example, the portion of the frame image displayed by the display device 200 that is identical to the content displayed by the projection device 100 can be the target display content of that frame image. Taking Figure 2 as an example, the black background outside the target display content in that frame image can be the initial background content of that frame image.
[0051] It should be understood that the target display content can be the same as or different from the content currently displayed on the projection device. For example, the target display content can refer to the content currently displayed on the projection device. Alternatively, for example, the projection device can display other content and run the target application in the background, projecting the interface content of the target application onto the display device; in this case, the target display content can be the interface content of the target application. In other words, the target display content can be different from the content currently displayed on the projection device.
[0052] In some embodiments of this application, the manner in which the projection device sends the aforementioned image and the display device receives the aforementioned image may be related to the projection protocol used between the projection device and the display device. For example, the projection device and the display device may use the Miracast projection protocol. The aforementioned image may be sent by the projection device to the processor of the display device via the Miracast projection protocol, and the processor of the display device may obtain the image based on the Miracast projection protocol.
[0053] S102. Process the image to obtain the processed image.
[0054] The processed image may include: the aforementioned target display content, and the target background content. The grayscale of the pixels in the target background content can be the target grayscale.
[0055] In some embodiments, the target grayscale may be, for example, the grayscale 0 corresponding to black. Alternatively, the target grayscale may also include, for example, the grayscale corresponding to at least one other color close to black, and this application does not limit this.
[0056] In some embodiments of this application, the target grayscale may be pre-stored in the processor of the display device, or pre-stored in a memory connected to the processor. Alternatively, the display device may also determine the target grayscale based on the user configuration in response to a user's configuration operation for the projected image display scene of the display device.
[0057] As one possible approach, the display device can convert the grayscale of pixels within a target area of the image to a target grayscale to obtain the processed image. The target area can be the region containing the initial background content mentioned above.
[0058] In some embodiments of this application, the display device may, for example, convert the grayscale of each pixel within a target area to a target grayscale to obtain a processed image. In some embodiments of this application, the display device may not adjust the grayscale of the pixels corresponding to the target display content. In some embodiments, the display device may first determine whether there are pixels within the target area whose grayscale is not the target grayscale. If so, the display device may convert the grayscale of the pixel whose grayscale is not the target grayscale to the target grayscale.
[0059] As another possible implementation, the display device could first extract a sub-image corresponding to the target display content from the aforementioned image. Then, the display device could stitch this sub-image corresponding to the target display content with the sub-image corresponding to the target background content to obtain the processed image. Here, the grayscale of each pixel in the sub-image corresponding to the target background content can be the target grayscale.
[0060] S103. Display the processed image on the screen.
[0061] In some embodiments of this application, the display device displays the processed image through a display screen. This can be achieved by referring to any image display method in the related technology, such as the image display logic of the display device based on direct display technology or the display device based on backlight display technology described in the foregoing embodiments, which will not be repeated here.
[0062] In some embodiments of this application, during the process of displaying a projected image, the display device can process the image from the projection device to convert the initial background content in the image into target background content. The grayscale of the pixels in the target background content can be the target grayscale. Then, the display device can display the processed image including the target display content and the target background content. This method ensures that when the display device displays a projected image, the grayscale of the target background content (excluding the target display content) can be the target grayscale. This eliminates horizontal stripe interference in non-target display content while ensuring that the display effect of the target display content is not affected, improving the accuracy of the projected image display and thus enhancing the user experience.
[0063] It should be understood that this application does not limit the application scenarios of the above-described screen projection image display method. For example, the display device may only execute the screen projection image display method provided in this application when the screen projection device is used for portrait screen projection. For example, in some embodiments, before processing the image to obtain the processed image, the processor may also determine whether the screen projection mode of the screen projection device is portrait screen projection. If it is determined that the screen projection mode of the screen projection device is portrait screen projection, the display device can process the image to obtain the processed image.
[0064] In some embodiments, the display device may determine whether the projection method of the projection device is portrait projection based on the projection protocol between the display device and the projection device. Alternatively, the display device may determine whether the projection method of the projection device is portrait projection by referring to any related art method for determining whether the projection method of the projection device is portrait projection.
[0065] In some embodiments, the display device may also process the image to obtain a processed image when it determines that the projection mode of the projection device is landscape projection, and display the projection image based on the processed image.
[0066] In some embodiments, the display device may also perform image processing to obtain a processed image and display the projected image based on the processed image in the scenario of projected image display without determining whether the projection method of the projection device is portrait projection.
[0067] In some embodiments, before processing the image to obtain the processed image, the display device may, for example, determine whether the projection protocol with the projection device is the Miracast protocol. For example, in response to the projection protocol with the projection device being the Miracast protocol, the display device may perform subsequent image processing to obtain the processed image, and then perform the operation of displaying the projected image based on the processed image.
[0068] Taking the example of a display device converting the grayscale of pixels within a target area in an image to a target grayscale to obtain a processed image, as one possible implementation, the display device can also determine the target area before converting the grayscale of pixels within the target area in the image to the target grayscale to obtain a processed image.
[0069] For example, in response to the image being a target frame image, the display device can determine the target area where the initial background content in the target frame image is located based on the image data of the target frame image.
[0070] The aforementioned image data may include the grayscale of the pixels in the target frame image.
[0071] Taking the sending of a transport stream video signal from a projection device to a display device as an example, the target frame mentioned above can be, for example, the first frame of the transport stream video signal. That is to say, when the display device receives the first frame image from the projection device, it can determine the target area where the initial background content in the first frame image is located based on the image data of the first frame image.
[0072] Alternatively, in some embodiments, the target frame image may be periodically determined by the display device. For example, still taking the example of the projection device sending a transport stream video signal to the display device, the display device can periodically determine images from the transport stream video signal as target frame images, and periodically update the target area based on the target frame images. Alternatively, the display device may also respond to a user-triggered update of the target area operation, using the image selected by the user as the target frame image.
[0073] The following provides a detailed explanation of how a display device determines the target region containing the initial background content in a target frame image based on the image data of that frame:
[0074] In some embodiments, the display device may first identify the boundaries of the initial background content based on the grayscale of the pixels in the target frame image.
[0075] Figure 7 is a schematic diagram of a target frame image according to some embodiments of this application. As shown in Figure 7, the boundaries of the initial background content of the target frame image can be, for example, boundary 1 and boundary 2.
[0076] Taking vertical screen projection as an example, in some embodiments of this application, the display device may first obtain sub-image data from the aforementioned image data. This sub-image data may be image data corresponding to a sub-image of the target frame image. The sub-image may be the left half of the target frame image, or the right half.
[0077] Taking the sub-image as the left half of the target frame image as an example, in some embodiments of this application, the sub-image data may include, for example, the grayscale of each pixel in the left half of the target frame image. Taking the sub-image as the right half of the target frame image as an example, in some embodiments of this application, the sub-image data may include, for example, the grayscale of each pixel in the right half of the target frame image.
[0078] Taking the target frame image shown in Figure 7 as an example, assuming that the sub-image is the left half of the target frame image, the sub-image of the target frame image can be as shown in Figure 7.
[0079] Then, the display device can calculate the average pixel level (APL) value (or average pixel grade) corresponding to the gray levels of the pixels included in the sub-image data, in the target direction, in units of "gray levels of a column of pixels".
[0080] In some embodiments, the target direction may be pre-stored in the processor of the display device, or pre-stored in a memory connected to the processor. As shown in FIG7, taking the sub-image as the left half of the target frame image as an example, the target direction may be, for example, a left-to-right direction.
[0081] In some embodiments of this application, the method by which the display device calculates the APL value corresponding to the gray level of any column of pixels can refer to any related technology for calculating the APL value, and will not be repeated here.
[0082] After determining the APL value corresponding to the grayscale of a column of pixels, the display device can determine whether the APL value of the grayscale of that column of pixels satisfies the boundary APL value condition. If the APL value of the grayscale of that column of pixels satisfies the boundary APL value condition, the display device can determine the first boundary of the initial background content based on the position of that column of pixels in the target frame image.
[0083] In some embodiments, the aforementioned boundary APL value condition may be, for example, pre-stored in the processor of the display device, or pre-stored in a memory connected to the processor.
[0084] In some embodiments of this application, the boundary APL value condition may include, for example, that the APL value corresponding to the grayscale of the column of pixels is less than a preset APL value (indicating that the area where the column of pixels is located is a region closer to black), and the APL value corresponding to the grayscale of at least one column of pixels following the column along the target direction is greater than or equal to the preset APL value (indicating that the area where at least one column of pixels following the column is located is a brighter region). If the APL value corresponding to the grayscale of the column of pixels satisfies the boundary APL value condition, that is, the APL value corresponding to the grayscale of the column of pixels is less than the preset APL value, and the APL value corresponding to the grayscale of at least one column of pixels following the column along the target direction is greater than or equal to the preset APL value.
[0085] Alternatively, in other embodiments, the above-mentioned boundary APL value condition may also include, for example, that "the APL value corresponding to the gray level of the pixel in this column, and the APL value corresponding to the gray level of at least one column of pixels preceding the column along the target direction" are both less than a preset APL value, and the APL value corresponding to the gray level of at least one column of pixels following the column along the target direction is greater than or equal to the preset APL value.
[0086] In some embodiments, if the APL value corresponding to the gray level of the column of pixels does not meet the boundary APL value condition, the display device may continue to determine whether the APL value corresponding to the gray level of the next column of pixels along the target direction meets the boundary APL value condition, until it is determined that the APL value corresponding to the gray level of a column of pixels meets the boundary APL value condition.
[0087] In some embodiments of this application, the display device may, for example, use the position of the column of pixels in the target frame image as the first boundary of the initial background content. Alternatively, in some embodiments, the display device may also use the position before the column of pixels as the first boundary of the initial background content, making the target area occupied by the initial background content in the image smaller, and thus the area outside the target area larger, which ensures that the area outside the target area can completely include the target display content.
[0088] After determining the first boundary, the display device can determine the second boundary of the initial background content based on the first boundary.
[0089] In some embodiments, the display device may, for example, determine a position symmetrical to the position of the first boundary, with the vertical center line of the image as the axis of symmetry, as the second boundary of the initial background content. Referring again to Figure 7, the axis of symmetry and the first boundary (boundary 1) and the second boundary (boundary 2) can be as shown in Figure 7.
[0090] By determining the second boundary using the first boundary, the display device does not need to perform the step of determining the boundary of the initial background content based on image data multiple times. This reduces the amount of data processing required by the display device in determining the target area, thereby improving the efficiency of determining the target area.
[0091] Alternatively, in other embodiments, the display device may determine the first boundary based on the left half of the image and the second boundary based on the right half of the image. In some embodiments of this application, the specific implementation of the display device determining the second boundary based on the right half of the image can be referred to the methods described in the foregoing embodiments, and will not be repeated here.
[0092] After determining the boundaries of the initial background content, the display device can use the area between the boundaries of the initial background content and the boundaries of the target frame image as the target area.
[0093] Taking Figure 7 as an example again, the boundary of the target frame image, and the target region between the boundary of the initial background content and the boundary of the target frame image can be as shown in Figure 7.
[0094] Taking landscape projection as an example, the display device can obtain sub-image data from the image data. This sub-image data can be the image data corresponding to a sub-image of the target frame image, and it can be either the upper or lower half of the target frame image. Then, based on the grayscale of the pixels included in this sub-image data, the display device can calculate the APL value corresponding to the grayscale of that row of pixels, sequentially along the target direction (e.g., from bottom to top, or from top to bottom), using a row of pixels as the unit. Then, the display device can determine the target area where the initial background content is located in the target frame image, referring to the method described above for determining the first and second boundaries of the initial background content; this will not be elaborated further here.
[0095] In some embodiments, the display device may receive the aforementioned image, or it may receive subsequent frame images of the target frame image. In some embodiments, before converting the grayscale of pixels in the target region of the image to the target grayscale to obtain the processed image, the display device may, for example, respond to the fact that the image is a subsequent frame image of the target frame image, use the target region where the initial background content of the target frame image is located as the target region where the initial background content of the subsequent frame image is located.
[0096] In other words, after determining the target area containing the initial background content in the target frame image based on the image data of the target frame image, the display device can lock the target area. For subsequent frames of the target frame image, the target area can be directly used to convert the grayscale of the pixels within that target area in the subsequent frames. Therefore, through the above method, the display device does not need to repeatedly determine the target area, reducing the amount of data processing and improving the efficiency of projected image display.
[0097] In some embodiments of this application, the display device may, for example, store the position of the first boundary and the position of the second boundary of the initial background content, and by using the position of the first boundary and the position of the second boundary of the initial background content in the subsequent frame image as the position of the first boundary and the position of the second boundary of the initial background content in the subsequent frame image, realize that the target area where the initial background content in the target frame image is located is the target area where the initial background content in the subsequent frame image is located.
[0098] Taking a television as the display device and a mobile phone as the projection device as an example, Figure 8 is a flowchart illustrating another projection image display method provided according to some embodiments of this application. As shown in Figure 8, the display device can respond to the user's operation of turning on the screen sharing function of the television and start the projection recognition program (S801). For example, after receiving the projection signal from the mobile phone, the display device can start the projection mode recognition program to determine whether the mobile phone is projecting in portrait mode (S802). If the mobile phone is projecting in landscape mode, the display device can display the projection image in the landscape projection scenario based on any of the projection image display methods in the landscape projection scenario in the related technology (S803).
[0099] If the phone screen is projected in portrait mode, the display device can activate a boundary recognition algorithm to identify the boundary between the black screen area (the target area where the initial background content is located) and the image area (the area where the target display content is located) (S804). This boundary can be represented, for example, by y1 and y2 coordinates. The coordinate system containing these y1 and y2 coordinates can be, for example, a coordinate system with the lower left corner of the image as the origin (or the center point of the image as the origin, etc.), with the horizontal direction of the image as the x-axis and the vertical direction of the image as the y-axis; this application does not limit this.
[0100] The specific implementation of the boundary recognition algorithm described above can be as shown in Figure 8. The display device can take the first frame image in the video signal transmitted from the mobile phone as the target frame image. Based on the left half of the first frame image, the APL value of each column is calculated from left to right based on the image data (S805). Then, it can be determined whether the APL value corresponding to each column is less than the APL threshold (S806). If so, it means that the area where the pixel in that column is located is still the aforementioned black screen area. The display device can then continue to determine whether the APL value of the next column of pixels is less than the APL threshold, that is, return to the execution steps S805-S806. If not, it is determined that the area where the pixel in that column is located is the aforementioned image area. Through the above method, the display device can identify the left boundary line (y1 coordinate); then, the right boundary line (y2 coordinate) can be obtained symmetrically (refer to the aforementioned embodiment, which will not be repeated here) (S807).
[0101] Using the y1 / y2 coordinates, the entire image can be divided into three areas (left black screen area, middle image area, and right black screen area). Then, the display device can, for example, perform screen locking (that is, store the y1 / y2 coordinates so that subsequent frame images continue to use the determined boundary line positions). The display device can convert the grayscale of pixels in the left and right black screen areas to 0 grayscale (black screen), while the middle image area can remain unprocessed to achieve a display effect that does not affect the target content displayed on the projected screen (S808).
[0102] Then, in some embodiments, the display device may continue to monitor whether the mobile phone enters landscape mode (S809). If so, the display device may control the display device to display the projected image in the landscape projection scenario based on any related technology's method for displaying projected images in a landscape projection scenario (S810). If not, the display device may return to step S808.
[0103] In some embodiments, the display device can detect whether the mobile phone exits landscape display and enters portrait display (S811). If the display device detects that the mobile phone exits landscape display and enters portrait display, it can continue to use the previously determined boundary line position and refer to the screen projection image display method described in any embodiment of this application to perform screen projection image display in the portrait screen projection scenario (S812). If not, the display device can return to step S810.
[0104] In some embodiments, the display device can monitor whether the mobile phone has ended screen mirroring or whether the screen mirroring signal has been lost (S813). If the display device determines that the mobile phone has ended screen mirroring or that the screen mirroring signal has been lost, it can end the screen mirroring image display program (S814); otherwise, the display device can continue to execute the screen mirroring image display of the corresponding screen mirroring scenario according to the screen mirroring method. As shown in Figure 8, the mobile phone is in a portrait screen mirroring scenario, so the process returns to step S812.
[0105] In this embodiment, the screen projection image display method provided in this application, by improving the display device at the software program level, avoids the horizontal stripe phenomenon in the black background area of the screen projection, thus not affecting the image quality of the target display content and improving the user's screen projection experience when projecting the target content from the projection device to the display device. Furthermore, this method does not require the display device to add additional hardware peripherals, increasing the applicability of the screen projection image display method. In addition, the screen projection image display method provided in this application can be applied to any related screen projection scenario, screen projection application, and display device, exhibiting high versatility.
[0106] Taking a backlight-based display device as an example, the backlight panel of this display device can be divided into multiple backlight zones. The structure of this display device can be seen, for example, with reference to Figure 5. Taking this display device as an example, Figure 9 is a flowchart illustrating another method for projecting an image according to some embodiments of this application. As shown in Figure 9, the method may include, but is not limited to, the following steps:
[0107] S201, Receive images sent by the projection device.
[0108] As mentioned above, taking a backlight-based display device as an example, the processor of the aforementioned display device can be the image processing module. In this embodiment, the image processing module can execute a stored computer program to cause the display device to perform the above-described method. In some embodiments of this application, the image can refer to the image received by the display device from the projection device described in any of the foregoing embodiments. For example, the image may include: target display content and initial background content. Furthermore, the initial background content can be used to match the image with the size of the display screen.
[0109] S202. Through the backlight control module, turn off the backlight of the first backlight zone and control the second backlight zone to display the target content.
[0110] The first backlight zone can be any backlight zone other than the second backlight zone. Taking Figure 2 as an example, the first backlight zone is a backlight zone on the backlight panel that can be used to display the backlight zone corresponding to the black background area in the image.
[0111] In some embodiments of this application, the display device can send the backlight data of the image to the backlight control module. Based on this backlight data, the backlight control module can control the backlights of the second backlight zone on the backlight panel to display the target content.
[0112] In some embodiments of this application, the display device may first determine the first backlight zone and the second backlight zone, and then, through the backlight control module, turn off the backlight of the first backlight zone and control the second backlight zone to display the target display content.
[0113] In this embodiment, after receiving an image sent by the projection device, the display device can, through the backlight control module, turn off the backlight of the first backlight zone on the backlight panel and display the target content in the image through the second backlight zone. By turning off the backlight of the first backlight zone, the display device does not display the initial background content in the image, making the initial background content pure black, eliminating interference in the black background area, and not affecting the target display content of the projection device, thus improving the user experience.
[0114] As one possible implementation, the display device can first determine the first backlight partition and then execute step S202. For example, before turning off the backlight of the first backlight partition through the backlight control module, the display device can also determine the first backlight partition based on the image data of the target frame image in response to the image being a target frame image.
[0115] The target frame image and the image data of the target frame image can refer to the target frame image and the image data of the target frame image described in any of the foregoing embodiments, and will not be repeated here.
[0116] In some embodiments, the display device may first determine the target area where the initial background content in the target frame image is located based on the image data of the target frame image. Then, the display device may determine the first backlight zone based on the target area.
[0117] In some embodiments of this application, the specific implementation of the display device determining the target area where the initial background content of the target frame image is located based on the image data of the target frame image can refer to the method for determining the target area where the initial background content of the target frame image is located based on the image data of the target frame image described in the foregoing embodiments, which will not be repeated here.
[0118] The boundary of the aforementioned target area may coincide with the boundary of the backlight partition, or it may not coincide with the boundary of the backlight partition (that is, the boundary of the target area may be within a certain backlight partition used for displaying the target content and the initial background content). Figure 10 is a schematic diagram of a target area boundary not coinciding with the boundary of the backlight partition according to some embodiments of this application. As shown in Figure 10, the boundary 1 and boundary 2 of the target area do not coincide with the boundary of the backlight partition. Figure 11 is a schematic diagram of a target area boundary coinciding with the boundary of the backlight partition according to some embodiments of this application. As shown in Figure 11, the boundary 1 and boundary 2 of the target area coincide with the boundary of the backlight partition. Figure 12 is a schematic diagram of one of the boundaries of a target area coinciding with the boundary of the backlight partition according to some embodiments of this application. As shown in Figure 12, the boundary 1 of the target area coincides with the boundary of the backlight partition, while the boundary 2 does not coincide with the boundary of the backlight partition.
[0119] In some embodiments, the display device may, for example, respond to the boundary of the target area coinciding with the boundary of the backlight partition, designate the backlight partition used to display the initial background content in the target area as the first backlight partition.
[0120] In some embodiments, as shown in FIG11, if the boundary 1 and boundary 2 of the target area coincide with the boundary of the backlight partition, the display device may use the backlight partition to the left of boundary 1 and the backlight partition to the right of boundary 2 as the first backlight partition.
[0121] By using the above method, there are no backlights in the first backlight zone used for displaying the target content. This ensures that when the display device turns off the backlight of the first backlight zone through the backlight control module to avoid interference from the horizontal stripes in the background area, it will not affect the display of the target content.
[0122] In some embodiments, if the boundary of the target area does not coincide with the boundary of the backlight partition (either both boundaries of the target area and the boundary of the backlight partition do not coincide, or one boundary of the target area does not coincide with the boundary of the backlight partition, as shown in Figure 10 or Figure 12), the display device may first use the "backlight partition that coincides with the boundary of the target area" as a reference backlight partition. Then, the display device may determine the aforementioned first backlight partition based on the reference backlight partition. The first backlight partition does not include the aforementioned reference backlight partition.
[0123] As one possible implementation, the display device could, for example, use the backlight partitions other than the aforementioned reference backlight partition from the "backlight partitions for displaying the initial background content within the target area" as the first backlight partition. This method ensures that when the display device turns off the backlight of the first backlight partition, it does not turn off the backlight of the reference backlight partition. Because the reference backlight partition coincides with the boundary of the target area, meaning that some target display content needs to be displayed based on the backlight of the reference backlight partition, not turning off the backlight of the reference backlight partition ensures that while eliminating the horizontal stripe interference in the initial background content, it does not affect the display of the target display content.
[0124] In some embodiments, taking FIG10 as an example, the display device may, for example, use the backlight partition on the left side of boundary 1 (excluding the backlight partition overlapping with boundary 1) and the backlight partition on the right side of boundary 2 (excluding the backlight partition overlapping with boundary 2) as the aforementioned first backlight partition. Taking FIG12 as an example, the display device may, for example, use the backlight partition on the left side of boundary 1 and the backlight partition on the right side of boundary 2 (excluding the backlight partition overlapping with boundary 2) as the aforementioned first backlight partition.
[0125] As another possible implementation, the display device can also process the image data of the image area corresponding to the reference backlight partition in the above image to further eliminate the horizontal stripe interference phenomenon present in the initial background content.
[0126] For example, in response to the boundary of the target area not coinciding with the boundary of the backlight partition, the display device may use the overlapping area between the aforementioned "reference backlight partition corresponding image area" and the aforementioned target area as a grayscale processing area. The display device can convert the grayscale of the pixels in this grayscale processing area in the aforementioned image to the target grayscale to obtain the processed image. The display device may choose not to process the target display content in the reference backlight partition corresponding image area.
[0127] The display device can turn off the backlight of the aforementioned first backlight partition (the backlight partition other than the aforementioned reference backlight partition in the aforementioned "backlight partition for displaying the initial background content in the target area") and display the processed image through the second backlight partition other than the first backlight partition.
[0128] In some embodiments, taking FIG10 as an example, the grayscale processing area 1 obtained by the reference backlight partition 1 that coincides with boundary 1, the reference backlight partition 2 that coincides with boundary 2, the grayscale processing area 1 obtained by the overlapping area of the image area corresponding to the reference backlight partition 1 and the target area, and the grayscale processing area 2 obtained by the overlapping area of the image area corresponding to the reference backlight partition 2 and the target area can be as shown in FIG10.
[0129] By converting the grayscale of the pixels in the overlapping area between the "reference backlight partition image area" and the target area to the target grayscale, the grayscale of all content in the image other than the target display content can be the target grayscale. This results in the display effect of the overlapping area between the "reference backlight partition image area" and the target area being the target grayscale, thus avoiding horizontal stripe interference. Furthermore, by turning off the backlight of the first backlight partition, the initial background content is kept in black, further preventing horizontal stripe interference in the projection scenario.
[0130] In some embodiments, the display device may also receive subsequent frame images of the target frame image. As a possible implementation, in response to the image being a subsequent frame image of the target frame image, the display device may, through a backlight control module, turn off the backlight of a first backlight zone determined based on the target frame image, and control a second backlight zone to display the target display content included in the subsequent frame image.
[0131] In other words, after turning off the backlight of the first backlight zone, the display device can keep the backlight of that first backlight zone off during the projection display of subsequent frame images, so that the projection image display of subsequent frame images will not have horizontal stripe interference. Using this method, the display of subsequent frame images of the target frame image can directly keep the backlight of the first backlight zone off, eliminating the need for the display device to repeatedly determine the first backlight zone, reducing data processing load and improving the efficiency of projection image display.
[0132] Taking a direct-lit multi-zone backlit TV as the display device based on the aforementioned backlight technology and a mobile phone as the screen-casting device as an example, Figure 13 is a flowchart illustrating another screen-casting image display method provided according to some embodiments of this application. As shown in Figure 13, the display device can respond to the user's operation of turning on the screen-casting function of the TV through the image quality processing module, and start the screen-casting recognition program (S1301). For example, after receiving the screen-casting signal from the mobile phone, the display device can start the screen-casting mode recognition program through the image quality processing module to determine whether the mobile phone is casting in portrait mode (S1302). If the mobile phone is casting in landscape mode, the display device can display the screen-casting image in the landscape mode based on any screen-casting image display method in the landscape mode of any related technology (S1303).
[0133] If the phone screen is projected in portrait mode, the display device can activate a boundary recognition algorithm through the image quality processing module to identify the boundary between the black screen area (the target area where the initial background content is located) and the image area (the area where the target display content is located) (S1304). This boundary can be represented, for example, by y1 and y2 coordinates. The coordinate system containing these y1 and y2 coordinates can be, for example, a coordinate system with the lower left corner of the image as the origin (or the center point of the image as the origin, etc.), with the horizontal direction of the image as the x-axis and the vertical direction of the image as the y-axis. This application does not limit this.
[0134] The specific implementation of the boundary recognition algorithm described above can be illustrated as shown in Figure 13. The display device, through its image quality processing module, can use the first frame image from the video signal transmitted from the mobile phone as the target frame image. Based on the left half of the first frame image, the APL value of each column is calculated from left to right based on the image data (S1305). Then, it can be determined whether the APL value corresponding to each column is less than the APL threshold (S1306). If so, it means that the area where the pixel in that column is located is still the aforementioned black screen area. The display device, through its image quality processing module, can continue to determine whether the APL value of the next column of pixels is less than the APL threshold, i.e., return to step S1305. If not, it is determined that the area where the pixel in that column is located is the aforementioned image area. Through the above method, the display device, through its image quality processing module, can identify the left boundary line (y1 coordinate); the right boundary line (y2 coordinate) can be obtained symmetrically (refer to the aforementioned embodiment, which will not be repeated here) (S1307).
[0135] Using the y1 / y2 coordinates, the entire image can be divided into three areas (left black screen area, middle image area, and right black screen area). Then, the display device, through the image quality processing module, can, for example, turn off the backlight of the first backlight partition corresponding to the left and right black screen areas (both of which belong to the target area), and use the aforementioned second backlight partition to display the middle image area, so as to achieve the display effect of the target display content without affecting the mobile phone screen projection (S1308). In some embodiments, before turning off the backlight of the first backlight partition, the display device, through the image quality processing module, can also first determine that the boundary of the target area coincides with the boundary of the backlight partition.
[0136] Then, the display device can continue to monitor whether the mobile phone has entered landscape mode (S1309) through the image quality processing module. If yes, the display device can control the display device to display the projected image in the landscape projection scenario based on any of the related technologies (S1310). If no, the display device can return to step S1308.
[0137] In some embodiments, the display device can detect whether the mobile phone exits landscape display and enters portrait display (S1311). If the display device detects through the image quality processing module that the mobile phone has exited landscape display and entered portrait display, it can continue to control the backlight of the first backlight zone to be turned off (S1312), and perform the projection image display of the portrait projection scene with reference to the projection image display method described in any embodiment of the present application.
[0138] In some embodiments, the display device can monitor whether the mobile phone has ended screen mirroring or whether the screen mirroring signal has been lost (S1313). If the display device determines through the image quality processing module that the mobile phone has ended screen mirroring or that the screen mirroring signal has been lost, it can end the screen mirroring image display program (S1314); otherwise, the display device can continue to execute the screen mirroring image display of the corresponding screen mirroring scene according to the screen mirroring method. As shown in Figure 13, the mobile phone is in a portrait screen mirroring scene, so the process returns to step S1312.
[0139] In some embodiments of this application, the screen projection image display method provided herein allows the display device, through its image quality processing module, to precisely disable the backlight corresponding to the left and right black screen areas in the vertical screen projection mode via a direct-lit multi-zone backlight control module. The backlight corresponding to the target display content does not require processing, thus avoiding horizontal stripes in the black background areas and improving the screen projection image display effect and the user experience. Furthermore, this method eliminates the need for additional hardware peripherals in the display device, expanding its applicability.
[0140] Taking the aforementioned backlight-based display device as a direct-lit multi-zone backlight TV and the screen-casting device as a mobile phone as an example, Figure 14 is a flowchart illustrating another screen-casting image display method provided according to some embodiments of this application. As shown in Figure 14, the display device, through its image quality processing module, can respond to the user's operation of turning on the screen-casting function of the TV and initiate a screen-casting recognition program (S1401). For example, after receiving a screen-casting signal from a mobile phone, the display device, through its image quality processing module, can initiate a screen-casting mode recognition program to determine whether the mobile phone is casting in portrait mode (S1402). If the mobile phone is casting in landscape mode, the display device, through its image quality processing module, can display the screen-casting image in the landscape mode based on any screen-casting image display method in the landscape mode of any related technology (S1403).
[0141] If the phone screen is projected in portrait mode, the display device can activate a boundary recognition algorithm through the image quality processing module to identify the boundary between the black screen area (the target area where the initial background content is located) and the image area (the area where the target display content is located) (S1404). This boundary can be represented by y1 and y2 coordinates, for example. The coordinate system containing these y1 and y2 coordinates can be, for example, a coordinate system with the lower left corner of the image as the origin (or the center point of the image as the origin, etc.), with the horizontal direction of the image as the x-axis and the vertical direction of the image as the y-axis; this application does not limit this. The specific implementation of the boundary recognition algorithm can refer to the aforementioned embodiment, i.e., steps S1305-S1307 in Figure 13 (corresponding to steps S1405-S1407 in Figure 14), and will not be repeated here. Using these y1 / y2 coordinates, the entire image can be divided into three areas (left black screen area, middle image area, and right black screen area).
[0142] Then, the display device can first determine, for example, whether the boundary of the target area coincides with the boundary of the backlight partition through the image quality processing module (S1408). If it is determined that the boundary of the target area coincides with the boundary of the backlight partition, the backlight of the first backlight partition (i.e., the "backlight partition used to display the initial background content") corresponding to the left black screen area and the right black screen area (both the left black screen area and the right black screen area belong to the target area) can be turned off, and the aforementioned second backlight partition can be used to display the middle image area, so as to achieve the display effect of the target display content without affecting the mobile phone screen projection (S1412).
[0143] In some embodiments, if it is determined that the boundary of the target area coincides with the boundary of the backlight partition, the display device may use the backlight partition used to display the initial background content as the first backlight partition (S1409), and then execute step S1412.
[0144] If the boundary of the target area does not coincide with the boundary of the backlight partition, the display device, through the image quality processing module, can also use the "backlight partition that coincides with the boundary of the target area" as a reference backlight partition, and use the backlight partition other than the reference backlight partition in the "backlight partition used to display the initial background content in the target area" as the first backlight partition (S1410). The display device, through the image quality processing module, can convert the grayscale of the pixels in the overlapping area (i.e., the grayscale processing area) between the image area corresponding to the reference backlight partition and the target area to the target grayscale to obtain the processed image. The display device, through the image quality processing module, can choose not to process the target display content in the image area corresponding to the reference backlight partition (S1411). Then, the display device, through the image quality processing module, can turn off the backlight of the first backlight partition (the backlight partition other than the reference backlight partition in the "backlight partition used to display the initial background content in the target area"), and display the intermediate image area (the processed image) through the second backlight partition other than the first backlight partition, i.e., step S1412.
[0145] In some embodiments of this application, the display device can continue to monitor whether the mobile phone has entered landscape mode (S1413) through the image quality processing module. If yes, the display device can control the display device to display the projected image in the landscape projection scenario based on any of the related technologies (S1414). If no, the display device can return to step S1412.
[0146] In some embodiments of this application, the display device can detect whether the mobile phone exits landscape display and enters portrait display (S1415). If the display device detects through the image quality processing module that the mobile phone has exited landscape display and entered portrait display, it can continue to control the backlight of the first backlight zone to be turned off, and perform the projection image display of the portrait projection scene according to any embodiment of the projection image display method provided in this application (S1416). If the display device detects that the mobile phone has not exited landscape display, it can return to step S1414.
[0147] In some embodiments of this application, the display device can monitor whether the mobile phone has ended screen casting or whether the screen casting signal has been lost (S1417). If the display device determines through the image quality processing module that the mobile phone has ended screen casting or that the screen casting signal has been lost, it can terminate the screen casting image display program (S1418). If the display device determines that the mobile phone has not ended screen casting or that the screen casting signal has been lost, it continues to execute the screen casting image display of the corresponding screen casting scene according to the screen casting method. As shown in Figure 14, where the mobile phone is in a portrait screen casting scene, the process returns to step S1415.
[0148] In this embodiment, by using the overlapping area between the "reference backlight partition corresponding image area" and the target area as the grayscale processing area, and converting the grayscale of the pixels in the grayscale processing area to the target grayscale, the grayscale of the content other than the target display content in the image is all the target grayscale. This makes the content corresponding to the overlapping area between the "reference backlight partition corresponding image area" and the target area the display effect corresponding to the target grayscale, thus avoiding horizontal stripe interference. Furthermore, by turning off the backlight of the first backlight partition, the initial background content is kept in black, further avoiding the existence of horizontal stripe interference in the projection scenario.
[0149] Based on the above embodiments, this application provides a display device, which may include: a display screen, a memory, and a processor connected to the display screen and the memory, wherein the display screen is configured to display images; the memory is configured to store computer programs; and the processor is configured to execute the computer programs to cause the display device to perform: receiving images sent by a projection device; wherein the image may include: target display content and initial background content; the initial background content can be used to match the size of the image with the size of the display screen; and processing the image to obtain a processed image. The processed image may include: the target display content and target background content; the grayscale of the pixels of the target background content can be a target grayscale; and the processed image can be displayed on the display screen.
[0150] In some possible implementations, when the processor performs the processing of the image to obtain the processed image, it may be further configured to execute the computer program to cause the display device to perform: converting the grayscale of pixels in a target area of the image to the target grayscale to obtain the processed image; wherein the target area may be the area where the initial background content is located.
[0151] In some possible implementations, before converting the grayscale of pixels in the target region of the image to the target grayscale to obtain the processed image, the processor may also be configured to execute the computer program to cause the display device to perform: in response to the image being a target frame image, determining the target region where the initial background content in the target frame image is located based on the image data of the target frame image; wherein the image data may include: the grayscale of pixels in the target frame image.
[0152] In some possible implementations, when the processor executes the image data based on the target frame image to determine the target region where the initial background content in the target frame image is located, it may be further configured to execute the computer program to cause the display device to perform: identifying the boundary of the initial background content based on the grayscale of the pixels of the target frame image; and taking the region between the boundary of the initial background content and the boundary of the target frame image as the target region.
[0153] In some possible implementations, the projection device uses portrait projection. When the processor executes the grayscale analysis of the pixels in the target frame image to identify the boundary of the initial background content, it can be further configured to execute the computer program to cause the display device to perform the following: It can obtain sub-image data from the image data; the sub-image data can be image data corresponding to a sub-image of the target frame image; it can calculate the average image level (APL) value corresponding to the grayscale of the pixels included in the sub-image data, sequentially using a column of pixels as units along the target direction; it can determine the first boundary of the initial background content based on the position of the column of pixels in the target frame image, in response to the APL value corresponding to the grayscale of the column of pixels satisfying the boundary APL value condition; it can determine the second boundary of the initial background content based on the first boundary; wherein, the sub-image can be the left half of the target frame image or the right half of the target frame image.
[0154] In some possible implementations, before converting the grayscale of pixels in the target region of the image to the target grayscale to obtain the processed image, the processor may also be configured to execute the computer program to cause the display device to perform: in response to the image being a subsequent frame image of the target frame image, to use the target region where the initial background content in the target frame image is located as the target region where the initial background content in the subsequent frame image is located.
[0155] In some possible implementations, before processing the image to obtain the processed image, the processor may also be configured to execute the computer program to cause the display device to perform: determining that the projection mode of the projection device is portrait projection.
[0156] In some possible implementations, the display device is a backlight-based display device, which may further include: a backlight control module and a backlight panel; the backlight panel is divided into multiple backlight zones; after receiving the image sent by the projection device, the processor may be configured to execute the computer program to cause the display device to perform: turning off the backlight of the first backlight zone through the backlight control module, and controlling the second backlight zone to display the target display content; the first backlight zone is a backlight zone other than the second backlight zone.
[0157] In some possible implementations, before the backlight of the first backlight zone is turned off by the backlight control module, the processor may also be configured to execute the computer program to cause the display device to perform: determining the first backlight zone based on image data of the target frame image in response to the image being a target frame image.
[0158] In some possible implementations, when executing the image data based on the target frame image to determine the first backlight partition, the processor may further be configured to execute the computer program to cause the display device to: determine a target area in the target frame image where the initial background content is located based on the image data of the target frame image; and determine the first backlight partition based on the target area.
[0159] In some possible implementations, when performing the determination of the first backlight partition based on the target area, the processor may further be configured to execute the computer program to cause the display device to: in response to the boundary of the target area coinciding with the boundary of the backlight partition, designate the backlight partition used to display initial background content within the target area as the first backlight partition.
[0160] In some possible implementations, the image data may include: grayscale values of pixels; when executing the image data based on the target frame image to determine the target region where the initial background content in the target frame image is located, the processor may be further configured to execute the computer program to cause the display device to perform: identifying the boundary of the initial background content based on the grayscale values of the pixels of the target frame image; and using the region between the boundary of the initial background content and the boundary of the target frame image as the target region.
[0161] In some possible implementations, the projection device uses portrait projection. When performing the step of identifying the boundary of the initial background content based on the grayscale of the pixels in the target frame image, the processor can be further configured to execute the computer program to cause the display device to perform: obtaining sub-image data from the image data; the sub-image data can be image data corresponding to a sub-image of the target frame image; the sub-image can be the left half or the right half of the target frame image; calculating the average image level (APL) value corresponding to the grayscale of the pixels included in the sub-image data, sequentially in the target direction using a column of pixels as the unit; determining the first boundary of the initial background content based on the position of the column of pixels in the target frame image in response to the APL value corresponding to the grayscale of the column of pixels satisfying the boundary APL value condition; and determining the second boundary of the initial background content based on the first boundary.
[0162] In some possible implementations, when the backlight of the first backlight zone is turned off via the backlight control module, the processor may be further configured to execute the computer program to cause the display device to: turn off the backlight of the first backlight zone determined based on the target frame image via the backlight control module in response to the image being a subsequent frame image of the target frame image, and control the second backlight zone to display the target display content included in the subsequent frame image.
[0163] Based on the above embodiments, this application also provides another display device, which may include: a memory, an image processing module, a backlight control module, a display screen, and a backlight panel; the backlight panel may be divided into multiple backlight zones; the memory may be configured to store a computer program; the image processing module may be configured to execute the computer program to cause the display device to perform: receiving an image sent by a projection device; wherein the image may include: target display content, and initial background content; the initial background content may be used to match the size of the image with the size of the display screen; the backlight control module may be used to turn off the backlight of a first backlight zone and control a second backlight zone to display the target display content; the first backlight zone may be a backlight zone other than the second backlight zone.
[0164] In one possible implementation, before the backlight of the first backlight zone is turned off by the backlight control module, the image quality processing module may also be configured to execute the computer program to cause the display device to perform: determining the first backlight zone based on image data of the target frame image in response to the image being a target frame image.
[0165] In one possible implementation, when executing the image data based on the target frame image to determine the first backlight partition, the image quality processing module may be further configured to execute the computer program to cause the display device to: determine the target area where the initial background content in the target frame image is located based on the image data of the target frame image; and determine the first backlight partition based on the target area.
[0166] In one possible implementation, when performing the determination of the first backlight partition based on the target area, the image quality processing module may be further configured to execute the computer program to cause the display device to perform: in response to the boundary of the target area coinciding with the boundary of the backlight partition, the backlight partition used to display the initial background content in the target area may be used as the first backlight partition.
[0167] In one possible implementation, the image data may include: grayscale values of pixels. When executing the image data based on the target frame image to determine the target area where the initial background content is located in the target frame image, the image quality processing module may be further configured to execute the computer program to cause the display device to perform: based on the grayscale values of the pixels in the target frame image, the boundary of the initial background content can be identified; the area between the boundary of the initial background content and the boundary of the target frame image can be used as the target area.
[0168] In one possible implementation, the projection device uses portrait projection. When performing the step of identifying the boundary of the initial background content based on the grayscale of the pixels in the target frame image, the image quality processing module can be further configured to execute the computer program to cause the display device to perform: obtaining sub-image data from the image data; the sub-image data can be image data corresponding to a sub-image of the target frame image; calculating the average image level (APL) value corresponding to the grayscale of the pixels included in the sub-image data, sequentially in the target direction using a column of pixels as units; determining the first boundary of the initial background content based on the position of the column of pixels in the target frame image, in response to the APL value corresponding to the grayscale of the column of pixels satisfying the boundary APL value condition; and determining the second boundary of the initial background content based on the first boundary; wherein the sub-image can be the left half of the target frame image or the right half of the target frame image.
[0169] In one possible implementation, when the backlight of the first backlight zone is turned off via the backlight control module, the image quality processing module may be further configured to execute the computer program to cause the display device to: respond to the image being a subsequent frame image of the target frame image, turn off the backlight of the first backlight zone determined based on the target frame image via the backlight control module, and control the second backlight zone to display the target display content included in the subsequent frame image.
[0170] The display device provided in this application embodiment can execute the screen projection image display method in the above method embodiment. Its implementation principle and technical effect are similar, and will not be repeated here. It should be noted that the above division of modules is only illustrative, and this application does not limit the division of modules or the naming of modules.
[0171] Based on the above embodiments, this application also provides a computer-readable non-volatile storage medium, which may include various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a disk, or an optical disk. Specifically, the computer-readable non-volatile storage medium stores program instructions (or computer programs) that are used in the methods described in the above embodiments.
[0172] Based on the above embodiments, this application also provides a computer program product, which may include a computer program stored in a readable non-volatile storage medium. At least one control module (or processor) of the display device can read the computer program from the storage medium, and the at least one control module (or processor) executes the computer program to cause the display device to implement the screen projection image display method provided in the various embodiments described above.
[0173] Finally, it should be noted that the above embodiments are only used to illustrate the solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding solutions to deviate from the scope of the solutions of the embodiments of this application.
[0174] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion of the above embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.
Claims
1. A display device, comprising: a display screen configured to display an image; a memory configured to store a computer program; a processor connected to the display screen and the memory, and configured to execute the computer program to cause the display device to perform: receiving an image sent by a casting device; the image comprising: target display content, and initial background content; the initial background content being used to match the image with a size of the display screen; processing the image to obtain a processed image; the processed image comprising: the target display content, and target background content; a gray scale of a pixel point of the target background content being a target gray scale; displaying the processed image through the display screen.
2. The display device of claim 1, when performing the processing of the image to obtain a processed image, the processor is further configured to execute the computer program to cause the display device to perform: converting a gray scale of a pixel point in a target region in the image to the target gray scale to obtain the processed image; the target region being a region where the initial background content is located.
3. The display device of claim 2, before performing the converting of the gray scale of the pixel point in the target region in the image to the target gray scale to obtain the processed image, the processor is further configured to execute the computer program to cause the display device to perform: in response to the image being a target frame image, determining, based on image data of the target frame image, the target region in the target frame image where the initial background content is located, wherein, the image data comprising: a gray scale of a pixel point of the target frame image.
4. The display device of claim 3, when performing the determining of the target region in the target frame image where the initial background content is located based on the image data of the target frame image, the processor is further configured to execute the computer program to cause the display device to perform: identifying a boundary of the initial background content based on the gray scale of the pixel point of the target frame image; regarding a region between the boundary of the initial background content and a boundary of the target frame image as the target region.
5. The display device of claim 4, when performing the identifying of the boundary of the initial background content based on the gray scale of the pixel point of the target frame image, the casting device being in a vertical screen casting mode, the processor is further configured to execute the computer program to cause the display device to perform: obtaining sub-image data from the image data; the sub-image data being image data corresponding to a sub-image of the target frame image; the sub-image being a left half image or a right half image of the target frame image; based on the gray scale of the pixel point included in the sub-image data, calculating an average picture level (APL) value corresponding to a gray scale of a column of pixel points in a target direction in sequence with the gray scale of the column of pixel points as a unit; in response to the APL value corresponding to the gray scale of the column of pixel points satisfying a boundary APL value condition, determining a first boundary of the initial background content based on a position of the column of pixel points in the target frame image; determining a second boundary of the initial background content based on the first boundary.
6. The display device of any one of claims 3-5, wherein before the processor is configured to execute the computer program to cause the display device to perform the converting the gray scale of the pixel points in the target region in the image to the target gray scale to obtain the processed image, the processor is further configured to execute the computer program to cause the display device to perform: in response to the image being a subsequent frame image of the target frame image, taking the target region in which the initial background content in the target frame image is located as a target region in which initial background content in the subsequent frame image is located.
7. The display device of any one of claims 1-5, wherein before the processor is configured to execute the computer program to cause the display device to perform the processing the image to obtain the processed image, the processor is further configured to execute the computer program to cause the display device to perform: determining that the screen projection manner of the screen projection device is a vertical screen projection. a backlight control module, and a backlight plate; the backlight plate is divided into a plurality of backlight partitions; 8. The display device of claim 1, the display device being a display device based on backlight technology, the display device further comprising: after the processor is configured to execute the computer program to cause the display device to perform the receiving the image sent by the screen projection device, the processor is further configured to execute the computer program to cause the display device to perform: controlling, by the backlight control module, the backlight of a first backlight partition to be turned off and the second backlight partition to display the target display content; the first backlight partition is a backlight partition other than the second backlight partition.
9. The display device of claim 8, wherein before the processor is configured to execute the computer program to cause the display device to perform the controlling, by the backlight control module, the backlight of a first backlight partition to be turned off, the processor is further configured to execute the computer program to cause the display device to perform: in response to the image being a target frame image, determining the first backlight partition based on image data of the target frame image.
10. The display device of claim 9, wherein when the processor is configured to execute the computer program to cause the display device to perform the determining the first backlight partition based on the image data of the target frame image, the processor is further configured to execute the computer program to cause the display device to perform: determining a target region in which the initial background content in the target frame image is located based on the image data of the target frame image; and determining the first backlight partition based on the target region.
11. The display device of claim 10, wherein when the processor is configured to execute the computer program to cause the display device to perform the determining the first backlight partition based on the target region, the processor is further configured to execute the computer program to cause the display device to perform: in response to a boundary of the target region coinciding with a boundary of the backlight partition, taking a backlight partition used to display the initial background content in the target region as the first backlight partition. a gray scale of the pixel points; when the processor is configured to execute the computer program to cause the display device to perform the determining the target region in which the initial background content in the target frame image is located based on the image data of the target frame image, the processor is further configured to execute the computer program to cause the display device to perform: identifying a boundary of the initial background content based on the gray scale of the pixel points of the target frame image; and taking a region between the boundary of the initial background content and a boundary of the target frame image as the target region.
13. The display device of claim 12, wherein the screen projection manner of the screen projection device is a vertical screen projection. 12. The display device of claim 10 or 11, the image data comprising: In the execution of the step of identifying the boundary of the initial background content based on the gray scale of the pixel points of the target frame image, the processor is further configured to execute the computer program to cause the display device to perform: obtaining sub-image data from the image data; the sub-image data is image data corresponding to a sub-image of the target frame image; the sub-image is a left half image or a right half image of the target frame image; calculating, based on the gray scale of the pixel points included in the sub-image data, an average picture level (APL) value corresponding to the gray scale of a column of pixel points in a target direction in sequence with the gray scale of the column of pixel points as a unit; in response to the APL value corresponding to the gray scale of the column of pixel points satisfying a boundary APL value condition, determining a first boundary of the initial background content based on the position of the column of pixel points in the target frame image; determining a second boundary of the initial background content based on the first boundary.
14. The display device of any one of claims 9-11, in the execution of the step of turning off the backlight of the first backlight partition by the backlight control module, the processor is further configured to execute the computer program to cause the display device to perform: in response to the image being a subsequent frame image of the target frame image, turning off the backlight of the first backlight partition determined based on the target frame image by the backlight control module, and controlling a second backlight partition to display the target display content included in the subsequent frame image.
15. A method for displaying a projection image of a display device, the method comprising: receiving an image sent by a projection device; the image comprising: target display content, and initial background content; the initial background content being used to match the image with the size of the display screen; processing the image to obtain a processed image; the processed image comprising: the target display content, and target background content; the gray scale of the pixel points of the target background content being a target gray scale; displaying the processed image on a display screen of the display device.
Citation Information
Patent Citations
Television picture display method and device, and television
CN104202646A
Screen projection picture processing method and related device
CN117440194A
Display
CN201440318U
Screen-projection data processing method and display device
WO2022161401A1