Dynamic arbitrary boundary gain

Abstract

The electronic device may include a display panel and a processing circuit. The display panel may display frames of image data having static boundaries that remain the same over multiple frames and dynamic boundaries that change between a first frame and a second frame. The processing circuit may apply a set of static gain values ​​from a static gain map to pixels to reduce or eliminate aliasing image artifacts along the static boundaries. The processing circuit may also apply a set of dynamic gain values ​​from a dynamic gain map to pixels to reduce or eliminate aliasing image artifacts along the dynamic boundaries.

Description

[Background technology]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Provisional Application No. 63 / 404,091, entitled "DYNAMIC ARBITRARY BORDER GAIN," filed September 6, 2022, the disclosure of which is incorporated by reference in its entirety for all purposes.

[0002] FIELD OF THE DISCLOSURE This disclosure relates generally to display systems and devices, and more particularly to displaying images having dynamic display areas with arbitrary boundaries.

[0003] Electronic devices often use electronic displays to provide visual representations of information by displaying one or more images. Such electronic devices may include computers, mobile phones, portable media devices, tablets, televisions, virtual reality headsets, vehicle dashboards, and the like. To display an image, an electronic display can control light emission from display pixels based on image data that indicates target characteristics of the image. For example, the image data can indicate target luminance of particular color components, such as green, blue, and / or red components, at various pixels in the image.

[0004] Electronic displays may enable the perception of various colors within an image by mixing (e.g., averaging) color components. For example, blending green, blue, and red components at various luminance levels may enable the perception of a range of colors from black to white. To facilitate control of the luminance of the color components, each display pixel in an electronic display may include one or more subpixels, each subpixel controlling the luminance of one color component. For example, a display pixel may include a red subpixel, a blue subpixel, and / or a green subpixel. To improve image quality around the edges of an electronic display—particularly along the rounded edges of an electronic display—image processing circuitry may apply a set of gain values ​​(e.g., gain values ​​applied to each subpixel color type) to each pixel within a particular display region of a frame of image data so that the pixel illuminates the image as needed to facilitate display. The gain value set may prevent or reduce aliasing along rounded boundaries. In many cases, the gain value set may be predetermined or known. For example, the gain value set may be determined during manufacturing of a display having a rounded border display region. Thus, the set of gain values ​​may be static. Summary of the Invention

[0005] To display an image in a dynamic display area with arbitrary boundaries that vary from image frame to image frame, the image processing circuitry can apply a dynamic gain value set to prevent or reduce aliasing along any boundaries of the dynamic display area. Indeed, there may be many use cases in which an image may have elements with arbitrary boundaries relative to other elements. As an example, some user interface elements may dynamically expand, contract, separate, or move over a series of image frames. To ensure that the boundaries of these elements appear sharp and clean, a dynamic gain value set may be applied to regions of the image data that include the boundaries. The dynamic gain value set may be associated with a dynamic gain value map that can change from image frame to image frame based on the position of the dynamic display boundary.

[0006] In some cases, the dynamic gain value set of the dynamic gain map may be applied in addition to or independently of the static gain value set associated with a static gain map for static arbitrary boundaries (e.g., fixed boundaries of an electronic display). These may also be referred to as a primary gain map (e.g., static gain map) and a secondary gain map (e.g., dynamic gain map) of gain value sets applied to pixels displaying image data within various display regions for arbitrary boundary gain (ABG) correction. ABG correction may prevent or reduce image artifacts along arbitrary shaped boundaries (e.g., rounded boundaries, angled boundaries) such that the gain values ​​applied to each pixel provide an anti-aliasing effect along the boundary. For example, a group of pixels may form a display region that displays at least some image data. In some cases, the display region may encompass a portion of a display having non-linear boundaries (e.g., having rounded edges).

[0007] A primary gain map (e.g., a static gain map) may include a set of gain values ​​to apply to pixels (e.g., sub-pixels of pixels) in image data whose boundaries do not change between frames of image data. By way of example, a primary gain map (e.g., a static gain map) may provide a set of gain values ​​for adjusting the boundaries of an electronic display. A secondary gain map (e.g., a dynamic gain map) may include a set of gain values ​​to apply to pixels in a display region that change, the boundaries of which change between frames of image data. The changes may include the width and / or height of the display region, the presence of the display region (e.g., being present in the next frame but not the previous frame), the position of the display region on the display (e.g., along the x-axis and / or y-axis), etc. The set of gain values ​​in the secondary gain map may be dynamic, e.g., changing with each frame of image data based on changes to the dynamic display region. As described in detail herein, the systems and methods described herein can facilitate providing sharp edges along rounded boundaries of a display region. In other cases, there may be a single gain map that includes both static and dynamic sets of gain values. Additionally or alternatively, there may be multiple different dynamic gain maps with sets of gain values ​​corresponding to different image elements with different dynamic boundaries. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0009] [Figure 2] FIG. 2 is a perspective view of a notebook computer representing one embodiment of the electronic device of FIG. 1.

[0010] [Figure 3] 2 is a front view of a handheld device representing another embodiment of the electronic device of FIG. 1.

[0011] [Figure 4]1. FIG. 4 is a front view of another handheld device representing another embodiment of the electronic device of FIG.

[0012] [Figure 5] 2 is a front view of a desktop computer representing another embodiment of the electronic device of FIG. 1.

[0013] [Figure 6] 2A and 2B are front and side views of a wearable electronic device representing another embodiment of the electronic device of FIG. 1.

[0014] [Figure 7] 2 is a schematic diagram of static and / or dynamic display areas on a display of the electronic device of FIG. 1 according to an embodiment of the present disclosure.

[0015] [Figure 8] 1A-1C are schematic diagrams of primary and / or secondary gain maps applied to a display area according to an embodiment of the present disclosure.

[0016] [Figure 9] 2 is a schematic diagram of display pixels within the boundaries of a display area, according to an embodiment of the present disclosure.

[0017] [Figure 10] FIG. 10 is a block diagram of a display pipeline for processing and implementing primary and / or secondary gain maps, according to an embodiment of the present disclosure.

[0018] [Figure 11] FIG. 10 is a flow diagram of a process for operating a display pipeline to apply a primary gain map and / or a secondary gain map, according to an embodiment of the present disclosure.

[0019] [Figure 12] FIG. 10 is a flow diagram of a process for decompressing a compressed version of a primary gain map and / or a secondary gain map according to an embodiment of the present disclosure.

[0020] [Figure 13] FIG. 10 is a flow diagram of a process for applying a primary and / or secondary gain map according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0021] When introducing elements of various embodiments of the present disclosure, the articles “a,” “an,” and “the” are intended to mean that there are one or more elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements. Furthermore, it should be understood that references to “one embodiment,” “an embodiment,” or “some embodiments” of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that incorporate the recited features. The use of the terms “approximately” or “near” should be understood to mean including proximity to a target (e.g., a design, value, amount), including within any appropriate or predictable tolerance of error (e.g., within 0.1% of a target, within 1% of a target, within 5% of a target, within 10% of a target, within 25% of a target, etc.). As used herein, “active area” refers to a portion of a frame of image data undergoing processing. Thus, when applying arbitrary boundary gain (ABG) to a frame of image data, the portion of the frame that utilizes the arbitrary boundary gain technique may be an active region. As described herein, the display region may be included in the active region. ABG techniques applied to the active region may facilitate displaying image data in the display region without fringing or other image artifacts along the boundaries of elements of the display region.

[0022] As described above, an electronic device may include a display that presents a visual representation of information, for example, as an image within one or more image frames. To display an image, the electronic display may control light emission from its display pixels based on image data that indicates target characteristics of the image. For example, the image data may indicate a target luminance (e.g., brightness) of a particular color component of a portion of the image (e.g., an image pixel), which, when integrated by the human eye, may result in the perception of a range of different colors. Generally, each display pixel in an electronic display may correspond to an image pixel in an image to be displayed. In other words, the display pixel and the image pixel may correspond to a pixel location. To facilitate displaying an image, a display pixel may include one or more subpixels that each control the luminance of one color component of the pixel location. For example, a display pixel may include a red subpixel that controls the luminance of the red component, a green subpixel that controls the luminance of the green component, and / or a blue subpixel that controls the luminance of the blue component.

[0023] Additionally, in some cases, the display regions containing the subpixels may vary in one or more characteristics, such as shape and / or size. For example, a first display region may have elements with four straight boundaries connected at approximately 90-degree angles, while a second display region may have elements with non-linear boundaries. For example, the second display region may have four straight boundaries connected by four rounded (e.g., curved) boundaries. As previously described, a gain map may include a set of gain values ​​for subpixels of a pixel of image data. By way of example, any border gain correction may involve a set of gain values ​​applied at the subpixels to reduce or eliminate image artifacts that might otherwise occur at the boundaries of display regions of various shapes.

[0024] To compensate for static boundaries of any shape, the gain map may be static, such that the same set of gain values ​​applied in the active region is applied to each subpixel. By way of example, a static gain map may contain gain values ​​to resolve image artifacts that would otherwise occur at known or predetermined non-linear boundaries of the display. However, a display may include multiple display regions, and the display regions may change between frames of image data, such that a static set of gain values ​​may not resolve image artifacts at the boundaries of the changing display regions. Accordingly, the present disclosure provides techniques for improving the perceived image quality of electronic displays by processing image data using, for example, a dynamic set of gain values ​​based on a dynamic display region for a frame of image data.

[0025] Turning first to FIG. 1 , an electronic device 10 according to one embodiment of the present disclosure may include, among other things, one or more processor(s) 12, memory 14, non-volatile storage 16, display 18, input structure 22, input / output (I / O) interface 24, network interface 26, power supply 28, and transceiver 30. The various functional blocks illustrated in FIG. 1 may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that FIG. 1 is merely one example of a particular implementation and is intended to illustrate the types of components that may be present in electronic device 10.

[0026] By way of example, electronic device 10 may represent a block diagram of a notebook computer as shown in FIG. 2 , a handheld device as shown in FIG. 3 , a handheld device as shown in FIG. 4 , a desktop computer as shown in FIG. 5 , a wearable electronic device as shown in FIG. 6 , or a similar device. Note that processor(s) 12 and other related items of FIG. 1 may generally be referred to herein as “data processing circuitry.” Such data processing circuitry may be implemented, in whole or in part, as software, hardware, or any combination thereof. Furthermore, processor(s) 12 and other related items of FIG. 1 may be a single self-contained processing module or may be incorporated, in whole or in part, within any of the other elements within electronic device 10.

[0027] In the electronic device 10 of FIG. 1 , the processor(s) 12 are operatively coupled to the memory 14 and the nonvolatile storage 16 to execute various algorithms or instructions. For example, algorithms for implementing static and / or dynamic gain maps may be stored in the memory 14 and / or the nonvolatile storage 16. Such algorithms or instructions executed by the processor(s) 12 may be stored in any suitable article of manufacture, including one or more tangible computer-readable media. The tangible computer-readable media may individually or collectively include the memory 14 and / or the nonvolatile storage 16 for storing the algorithms or instructions. The memory 14 and the nonvolatile storage 16 may include any suitable article of manufacture for storing data and executable instructions, such as random access memory, read-only memory, rewritable flash memory, hard drives, and optical disks. Furthermore, programs (e.g., operating systems) encoded on such computer program products may also include instructions executable by the processor(s) 12 to enable the electronic device 10 to provide various functions.

[0028] In particular embodiments, display 18 may be a liquid crystal display (LCD), which may enable displaying images generated on electronic device 10. In some embodiments, display 18 may include a touchscreen, which may facilitate user interaction with the user interface of electronic device 10. Furthermore, it should be understood that in some embodiments, display 18 may include one or more light-emitting diode (LED) displays, organic light-emitting diode (OLED) displays, active-matrix organic light-emitting diode (AMOLED) displays, or some combination of these and / or other display technologies. The display may include display regions that are dynamic or static between display frames of image data.

[0029] An input structure 22 of electronic device 10 may allow a user to interact with electronic device 10 (e.g., increasing or decreasing a volume level by pressing a button). An I / O interface 24, as well as a network interface 26, may allow electronic device 10 to interface with various other electronic devices. Network interface 26 may include, for example, an interface for a personal area network (PAN), such as a BLUETOOTH® network, a wireless local area network (WLAN), such as a local area network (LAN) or an 802.11x WI-FI® network, and / or a third generation (3G) network. rd generation (3G) cellular network, Universal Mobile Telecommunications System (UMTS), fourth generation (4 thWide area networks (WANs) such as 4th generation (4G) cellular networks, long term evolution (LTE) cellular networks, long term evolution licensed-assisted access (LTE-LAA) cellular networks, and fifth generation (5G) cellular networks. th One or more interfaces for a wide area network (WAN), such as a 5G (Next Generation) cellular network and / or a New Radio (NR) cellular network, may be included. In some embodiments, electronic device 10 can communicate over such wireless networks (e.g., Wi-Fi, WiMAX, Mobile WiMAX, 4G, LTE, 5G, etc.) using transceiver 30. Transceiver 30 may include circuitry useful both for wirelessly receiving received signals at a receiver and for wirelessly transmitting transmitted signals (e.g., data signals, wireless data signals, wireless carrier signals, radio frequency signals) at a transmitter. As further shown, electronic device 10 may include a power source 28. Power source 28 may include any suitable power source, such as a rechargeable lithium polymer (Li-poly) battery and / or an alternating current (AC) power converter.

[0030] In certain embodiments, electronic device 10 may take the form of a computer, a portable electronic device, a wearable electronic device, or other type of electronic device. Such computers may generally be portable (e.g., laptops, notebooks, and tablet computers) or generally used in one location (such as traditional desktop computers, workstations, and / or servers). In one embodiment, electronic device 10 in the form of a computer may be a MacBook®, MacBook® Pro, MacBook Air®, iMac®, Mac® mini, or Mac Pro® model available from Apple Inc. of Cupertino, California, USA. By way of example, electronic device 10 in the form of a notebook computer 10A is illustrated in FIG. 2 according to one embodiment of the present disclosure. The depicted notebook computer 10A may include a housing or enclosure 31, a display 18, an input structure 22, and ports for an I / O interface 24. In one embodiment, input structure 22 (e.g., a keyboard and / or touchpad) may be used to interact with computer 10A, such as to launch, control, or operate a graphical user interface (GUI) and / or applications running on computer 10A. For example, the keyboard and / or touchpad may enable a user to navigate a user interface and / or application interface displayed on display 18.

[0031] FIG. 3 shows a front view of handheld device 10B, which represents one embodiment of electronic device 10. Handheld device 10B may represent, for example, a mobile phone, a media player, a personal data organizer, a handheld gaming platform, or any combination of such devices. By way of example, handheld device 10B may be a model of an iPhone® available from Apple Inc. (Cupertino, California). Handheld device 10B may include an enclosure 31 that protects internal components from physical damage and / or shields them from electromagnetic interference. Enclosure 31 may surround display 18, which displays an array of icons 19. By way of example, an application program may be launched when an icon 19 is selected by either input structure 22 or a touch-sensitive component of electronic display 18. I / O interface 24 may be open through enclosure 31 and may include an I / O port for a wired connection for charging and / or content manipulation, using a connector and protocol such as the Lightning connector provided by Apple Inc. (Cupertino, California), Universal Serial Bus (USB), or other similar standard connector and protocol. I / O interface 24 may be associated with wiring and connectors within the radio frequency package of electronic device 10.

[0032] The input structure 22, in combination with the display 18, may allow a user to control the handheld device 10B. For example, the input structure 22 may start or stop the handheld device 10B, navigate the user interface to a home screen, a user-configurable application screen, and / or activate the voice recognition functionality of the handheld device 10B. Another input structure 22 may adjust the volume or switch between vibrate and ring modes. The input structure 22 may further include a microphone capable of capturing the user's voice for various voice-related functions, and a speaker to enable voice playback and / or some telephony functions. The input structure 22 may further include a headphone input that may provide connection to external speakers and / or headphones.

[0033] 4 shows a front view of another handheld device 10C, which represents another embodiment of electronic device 10. Handheld device 10C may represent, for example, a tablet computer or one of various portable computing devices. By way of example, handheld device 10C may be a tablet-sized embodiment of electronic device 10, which may be, for example, a model of iPad® available from Apple Inc. of Cupertino, California.

[0034] Turning to FIG. 5 , computer 10D may represent another embodiment of electronic device 10 of FIG. 1 . Computer 10D may be any computer, such as a desktop computer, a server, or a notebook computer, but may also be a standalone media player or video gaming machine. By way of example, computer 10D may be an iMac®, MacBook®, or other similar device by Apple Inc. (Cupertino, California). Note that computer 10D may also represent a personal computer (PC) from another manufacturer. A similar enclosure 31 may be provided to protect and house internal components of computer 10D, such as display 18. In certain embodiments, a user of computer 10D may interact with computer 10D using various external input structures 22, such as keyboard 22A or mouse 22B (e.g., input structures 22), that can be connected to computer 10D.

[0035] Similarly, FIG. 6 illustrates a wearable electronic device 10E, which represents another embodiment of the electronic device 10 of FIG. 1 that may be configured to operate using the techniques described herein. By way of example, the wearable electronic device 10E may include a wristband 23 and may be an Apple Watch® by Apple Inc. (Cupertino, California). However, in other embodiments, the wearable electronic device 10E may include any wearable electronic device, such as a wearable movement monitoring device (e.g., a pedometer, an accelerometer, a heart rate monitor) or other device by another manufacturer. The display 18 of the wearable electronic device 10E may include a touchscreen display 18 (e.g., an LCD, an LED display, an OLED display, an active matrix organic light-emitting diode (AMOLED) display, etc.) as well as an input structure 22 that allows a user to interact with the user interface of the wearable electronic device 10E.

[0036] With the above in mind, FIG. 7 is a schematic diagram of display regions 50 (e.g., active areas) on display 18 of the electronic device of FIG. 1. While the depicted embodiment shows four display regions 50, which represent a particular embodiment, the techniques described herein may be applied to one or more display regions 50 in one or more frames. In the illustrated embodiment, display 18 includes a first display region 50A, a second display region 50B, a third display region 50C, and a fourth display region 50D displayed during a single frame. In general, display regions 50 may include areas or elements with rounded borders and / or non-linear regions that can benefit from any border gain to reduce image artifacts along the edges. Here, display regions 50 have rounded borders.

[0037] As previously described, the set of gain values ​​may be applied to pixels along a rounded boundary of the display area 50. That is, the active area can include the display area 50 for applying any border gain. As previously described, the active area includes a portion of a frame of image data undergoing processing, substantially a frame boundary. By way of example, the processing may include applying the set of gain values ​​to pixels for any border gain correction. Data applied to pixels located outside the active area may be copied from the input to the output (e.g., no additional gain is applied before driving the pixels). Generally, the display area 50 may include dimensions that approximately correspond to the size of the display 18 or a portion of the display 18. In some examples, such as in the case of a rounded boundary, any border gain of the active area may generally include gain applied to a portion of the display, which portion may be larger than another portion of the display area 50 having a rounded boundary. For example, the xy definition of the active area in an xy coordinate system may be rectangular to encompass the rounded boundary of the display area 50 for applying any border mask around the rounded boundary.

[0038] Specifically, an image data source may generate image data corresponding to a rectangular image. The display pipeline may adjust the rectangular image frame of image data for display on a non-rectilinear display region 50, for example, by applying a black mask to pixels outside of the display region 50. However, in some instances, applying the black mask may result in perceptible visual artifacts, such as color fringing along the boundaries of the display region 50 and / or aliasing along rounded boundaries of the display region 50.

[0039] Thus, a set of gain values ​​(e.g., for any gain) in the gain map may be applied to pixels of one or more display areas 50 along the rounded boundaries for any boundary gain correction. Generally, as previously described, the active area includes a portion of a frame of image data that undergoes processing. Pixels located outside the active area may output image data that is the same or nearly the same as the input image data, but that has not undergone processing related to any boundary gain correction.

[0040] As described herein, and in some embodiments, two independently encoded maps, such as a primary gain map (e.g., a static gain map) and / or a secondary gain map (e.g., a dynamic gain map), may provide a set of gain values ​​for a frame. The primary gain map may take any suitable shape with respect to the electronic display 18. For example, when the electronic display 18 includes rounded edges, the primary gain map may include edge gain along the boundaries of the display area 50A and / or along the boundaries of the display 18, where the edge gain may be statically configured and applied to the entire display area 50A. Thus, the set of gain values ​​applied to each pixel in the primary gain map is static for each pixel between frames of image data. Meanwhile, the secondary gain map may include a set of gain values ​​that change between frames of image data to compensate for dynamic boundaries. The set of gain values ​​of the secondary gain map may be dynamically configured and / or reconfigured on a frame-by-frame basis, may be generally enabled or disabled (e.g., as display area 50 may appear or disappear between frames), and / or the position and / or size of the map may change (e.g., in response to changing display area 50 between frames).

[0041] By applying such gain values ​​of the set of gain values, pixels adjacent to the rounded border of display area 50 may be dimmed or otherwise adjusted (e.g., luminance may be altered) to reduce the likelihood of producing perceptible aliasing along the rounded border when the image is displayed. In additional or alternative embodiments, display area 50 may include a rectangular border. As described herein, in addition to the gain values ​​derived from the gain map, separate fixed gain values ​​along the rectangular edge of display area 50 for the primary map and the rectangular edge of the secondary map may be specified via a set of registers with independent gains for each sub-pixel color and / or rectangular edge of display area 50.

[0042] Although the illustrated embodiment shows first display region 50A encompassing the largest portion of display 18, first display region 50A may take any other suitable shape. Indeed, first display region 50A may occupy only a portion of the electronic display and, in other examples, may not overlap with other display regions 50 (e.g., display regions associated with dynamic gain maps). By way of example, first display region 50A may have static boundaries that are fixed (e.g., based on the physical edges of electronic display 18) and do not change from frame to frame. Other display regions 50 (e.g., 50B, 50C, 50D) may encompass areas of display 18 different from first display region 50A, which may or may not overlap with display region 50A. By way of example, these other display regions 50 (e.g., 50B, 50C, 50D) may have dynamic boundaries that change from frame to frame. Thus, these changing display areas 50 (e.g., 50B, 50C, 50D) may be referred to as dynamic display areas 50 that may change in size, width, length, position, etc. Dynamic display areas 50 may additionally or alternatively appear or disappear from one frame to another (e.g., the presence of different display areas 50 may vary from frame to frame). Furthermore, the dynamic boundaries of dynamic display areas 50 may have shapes that change from frame to frame.

[0043] As an example, animations that may require precise arbitrary boundaries within electronic display 18 may use dynamic display area 50, which may have expanding or contracting boundaries. By using dynamic display area 50 to apply a boundary gain to the changing boundaries during animation, the boundaries can be precise and clean, avoiding image artifacts (e.g., color fringing) that may otherwise appear.

[0044] As discussed in more detail with respect to FIG. 8 , by way of example, a primary gain map may include a set of gain values ​​to be applied to pixels of first display region 50A (e.g., the boundaries of first display region 50A). Meanwhile, a secondary gain map (e.g., a dynamic gain map) may include a set of gain values ​​to be applied to pixels of dynamic display regions 50 (e.g., 50B, 50C, 50D). Because the boundaries of these dynamic display regions 50 (e.g., 50B, 50C, 50D) may change from frame to frame, the secondary gain map(s) may include sets of gain values ​​for one or more dynamic display regions 50 (e.g., 50B, 50C, 50D) that change accordingly from frame to frame. This may enable animations with precise boundaries of any shape (e.g., rounded, curved, jagged, straight) to appear on display 18. In fact, the sets of gain values ​​in the secondary gain map may be dynamic, changing with each frame of image data, for example, based on changes to dynamic display regions 50B-50D. The systems and methods described herein may facilitate providing sharp edges along any (e.g., rounded, curved, jagged, straight) boundary within display area 50. Indeed, in some cases, one or more dynamic display areas 50 may appear along the edge of the display, facilitating sharp animation near or with the edge of the display.

[0045] For illustrative purposes, Figure 8 is a schematic diagram of primary gain maps 52 and / or secondary gain maps 54 applied to various display regions 50 of electronic device 10. While the current embodiment shows display 18 for five frames 55 of image data, which represents a particular embodiment, the systems and methods described herein may include primary gain maps 52 and / or secondary gain maps 54 to apply any gain along or within the boundaries of one or more display regions 50 within one or more frames 55. While the representation of Figure 8 shows image data for display on a handheld device, the image data may be formatted for any other suitable display (e.g., a circular display, a display of any shape).

[0046] As shown, a first frame 55A (frame X) includes a first display region 50A. As previously described, the first display region 50A may include image data that does not change from frame to frame; therefore, application of a primary gain map 52 (denoted by the dashed box) may provide gain values ​​to be applied to pixels within the first display region 50A. The primary gain map 52 may take any suitable shape (e.g., rectilinear, rectangular, or any other shape) and may encompass all or part of the image frame to completely surround the static boundary of the electronic display 18. Meanwhile, a second frame 55B (frame X+1), a third frame 55C (frame X+2), a fourth frame 55C (frame X+3), and a fifth frame 55E (frame X+4) include changing display regions 50, such as the second display region 50B and the third display region 50C, between successive frames 55A. These frames 55B-55E also include portions of the display 18 having image data that remains the same or substantially the same between successive frames. Thus, frames 55B-55E include the first display region 50A in addition to the changing display regions 50B and 50C. The second display region 50B and the third display region 50C change between frames 55 and are therefore dynamic. Thus, application of a secondary gain map 54 (indicated by the dotted box) can provide gain values ​​to be applied to pixels along the boundaries of these dynamic display regions 50B and 50C. The secondary gain map 54 may be smaller than or the same size as the primary gain map 52. In some cases, there may be multiple secondary gain maps 54 for different dynamic display regions 50 (e.g., one for 50B, one for 50C, and one for 50D; one for 50B and 50C, and one for 50D).

[0047] As shown, the second display region 50B, located at the top of the display 18 in the second frame 55B through the fifth frame 55E, may include a region with rounded edges and change to become more rectangular as the frames progress. The second display region 50B also appears in the second frame 55B. For example, the second display region 50B first appears in the second frame 55B, and then increases in width (e.g., along the x-axis of the x-y coordinate system) and / or decreases in height (e.g., along the y-axis of the x-y coordinate system) from the second frame 55B through the fifth frame 55E as the frames progress. Similarly, the third display region 50C first appears in the second frame 55B, increases in height along the y-axis, and moves along the display 18 to become more centered on the display 18. Thus, the secondary gain map 54 may be applied to dynamic display regions 50B, 50C having display region characteristics that change as frames 55 progress, including size (e.g., width and / or height of display region 50), presence of display region 50 (e.g., presence on a subsequent frame but absence on a previous frame), position of display region 50 on display 18 (e.g., movement in the negative x-axis direction and / or positive y-axis direction), etc. The secondary gain map 54 may be updated with each frame 55 based at least in part on changes to dynamic display regions 50B, 50C. That is, the set of gain values ​​in the secondary gain map 54 may be updated for each frame 55 to continue to provide smooth edges at the boundaries of dynamic display regions 50B, 50C. The set of gain values ​​in the secondary gain map 54 may be programmed at any suitable rate (e.g., frame by frame) by processing circuitry of the electronic device (e.g., a GPU, a display pipeline, an application processor, metadata for frames of image data).

[0048] FIG. 9 is a schematic diagram of display pixels 66 within the boundaries of a second display region 50B, which can be located anywhere on the display 18 and can vary display region characteristics (e.g., dimensions) within different frames 55. As previously mentioned, the boundaries of the display region 50 may be rounded, and the display 18 may include multiple display regions 50 that remain static or change between frames 55 of image data. The gain map techniques described herein with respect to rounded boundaries may be applied to display regions 50 that are static, dynamic, or both between frames 55. Furthermore, it should be understood that the illustrated display pixels 66, including subpixels, are intended for illustrative purposes only and are not limiting. In other words, display pixels 66 within other electronic displays 18 may be implemented with different subpixel layouts. Furthermore, although the following description describes a second display region 50B, the techniques described herein may be applied to any dynamic display region 50 (e.g., 50B-50D, etc.). In some embodiments, the techniques may be applied to a static display area 50, such as the first display area 50A described above.

[0049] In the illustrated embodiment, the display pixels 66 are organized into rows and columns. For example, a first display pixel row includes a first display pixel 66A, a second display pixel 66B, a third display pixel 66C, etc. Additionally, a third display pixel row includes a fourth display pixel 66D, a fifth display pixel 66E, a sixth display pixel 66F, etc. As noted above, the display pixels 66 may include one or more subpixels that each control the luminance of a corresponding color component. In the illustrated embodiment, the display pixels 66 include a red subpixel 68, a green subpixel 70, and a blue subpixel 72. Additionally, in the particular illustrated embodiment, display pixels 66 that are entirely contained within the non-linear display region each include two subpixels, e.g., a green subpixel 70 and alternating red subpixels 68 or blue subpixels 72 (e.g., in a red, green, blue (RGB) display).

[0050] Some display pixels 66 along the rounded boundary 130 may include fewer subpixels in the non-linear second display region 50B. In the illustrated embodiment, such display pixels 66 may each include one subpixel, e.g., alternating red subpixels 68 or blue subpixels 72. For example, due to the rounded boundary at the top left of the display 18 in the second display region 50B, a first display pixel 66A may include only blue subpixels 72, a second display pixel 66B may include only red subpixels 68, a third display pixel 66C may include only blue subpixels 72, and so on.

[0051] In either case, each display pixel 66 may correspond to a pixel location and therefore an image pixel received from image data source 38. For the illustrated embodiment, each display pixel 66 may correspond to an image pixel.

[0052] To display an image frame, the luminance of each display pixel 66 can be controlled based at least in part on image pixel image data corresponding to the image pixel at that pixel location. However, in some examples, the shape of the image frame can differ from the shape of the display area 50 of the electronic display 18. For example, as described above, the image frame may be rectangular, while the display area 50 of the image frame is non-linear with rounded boundaries. Furthermore, the border gain may change with each frame 55 due to the dynamic nature of the second display area 50B. In such cases, one or more image pixels may correspond to pixel locations outside the display area 50 (e.g., along and / or outside the rounded boundaries). For example, a first image pixel in a rectangular image frame may correspond to a pixel location 73 outside the non-linear second display area 50. In other words, a display pixel 66 need not be implemented in the electronic display 18 at a pixel location corresponding to an image pixel.

[0053] Therefore, to facilitate displaying an image frame on a second display region 50B having a different shape, the image frame can be adjusted before display by, for example, applying a black mask. However, as described above, the display pixels 66 can rely on color blending to enable the perception of different color ranges. In other words, simply ignoring image pixels corresponding to pixel locations outside the display region can, in some instances, result in perceptible aliasing (e.g., a staircase pattern) at display pixels 66 along rounded boundaries 130 because there are no adjacent display pixels 66 with which the display pixels 66 would otherwise blend. Furthermore, perceptible color fringing can occur at display pixels 66 along straight boundaries 64 because there are no adjacent display pixels 66 with which the display pixels 66 would otherwise blend. To improve image quality, as described above, the image pixel image data can be processed based on gain values ​​associated with the corresponding pixel locations.

[0054] The gain values ​​may be provided by a primary gain map 52 and / or a secondary gain map 54 for a static or dynamic display region 50 within a frame 55, respectively. Additionally, the primary gain map 52 and / or the secondary gain map 54 may be in an uncompressed format that explicitly associates (e.g., maps) each pixel location to a set of gain values. Thus, one or more gain values ​​associated with each pixel location, and therefore each sub-pixel location within the pixel location, may be included in the uncompressed gain map.

[0055] 10 is a block diagram of a portion 34 of electronic device 10 including a display pipeline 36 for processing primary gain map 52 and / or secondary gain map 54 to implement gain values ​​from primary gain map 52 and / or secondary gain map 54. In some embodiments, display pipeline 36 may be implemented by circuitry within electronic device 10, circuitry within display 18, or both. For example, display pipeline 36 may be included in a core complex of processor(s) 12, image processing circuitry, a timing controller (TCON) within display 18, etc.

[0056] As shown, portion 34 of electronic device 10 may also include an image data source 38, a display driver 40, a controller 42, and an external memory 44. In some embodiments, controller 42 may control the operation of display pipeline 36, image data source 38, and / or display driver 40. To facilitate controlling the operation, controller 42 may include a controller processor 51 and a controller memory 53. In some embodiments, controller processor 51 may execute instructions stored in controller memory 53. Thus, in some embodiments, controller processor 51 may be integrated with processor(s) 12, image processing circuitry, a timing controller within display 18, and / or may be a separate processing module. Additionally, in some embodiments, controller memory 53 may be included in local memory 14, main memory storage 16, external memory 44, internal memory 46 of display pipeline 36, and / or a separate tangible, non-transitory computer-readable medium.

[0057] In the illustrated embodiment, display pipeline 36 is communicatively coupled to image data source 38. In this manner, display pipeline 36 may receive image data for images to be displayed on display 18 from image data source 38, for example, in source (e.g., red, green, blue (RGB)) format and / or as rectangular images. In some embodiments, image data source 38 may be included in processor(s) 12, image processing circuitry, or both.

[0058] As described above, the display pipeline 36 may process image data received from an image data source 38. To process the image data, the display pipeline 36 may include one or more applicable image data processing blocks 37. For example, in the depicted embodiment, the image data processing block 37 includes a sub-pixel layout resampler (SPLR) block 56 that provides display pixel image data (e.g., display-format image data) by filtering (e.g., interpolating or sub-sampling) image pixel image data (e.g., source-format image data). In some embodiments, the image data processing block 37 may additionally or alternatively include an ambient adaptive pixel (AAP) block, a dynamic pixel backlight (DPB) block, a white point correction (WPC) block, a sub-pixel layout compensation (SPLC) block, a burn-in compensation (BIC) block, a panel response correction (PRC) block, a dithering block, a sub-pixel uniformity compensation (SPUC) block, a content frame dependent duration (CDFD) block, an ambient light sensing (ALS) block, etc.

[0059] As described in more detail below, the display pipeline 36 may process image data received from the image data source 38 based at least in part on data stored in the external memory 44 and / or the internal memory 46. The display pipeline 36 may access the primary gain map 52 and / or the secondary gain map 54 stored in the external memory 44 and / or the internal memory 46. The primary gain map 52 and / or the secondary gain map 54 may be stored in a compressed format (e.g., a compressed version) in a respective memory (e.g., random access memory (RAM)). As described with respect to FIG. 12 , a decompressor processing a decompression algorithm may decompress the compressed gain map to retrieve a gain value of the set of gain values ​​to be applied to each pixel of the display area 50.

[0060] In general, storing data in external memory 44 versus internal memory 46 may result in cost and / or processing efficiency tradeoffs associated with various implementations. For example, due to physical size constraints, increasing the storage capacity of external memory 44 may be more cost-effective than increasing the storage capacity of internal memory 46. As such, the storage capacity of external memory 44 may be greater than the storage capacity of internal memory 46.

[0061] Additionally, access to the external memory 44 and the internal memory 46 may differ. For example, the internal memory 46 may be dedicated for use by the display pipeline 36. In other words, data stored in the internal memory 46 may be more easily accessible by the display pipeline 36, for example, with reduced latency, which may facilitate improving the processing efficiency of the display pipeline 36. In comparison, because the external memory 44 is external to the display pipeline 36, the display pipeline 36 may access the external memory 44 via a direct memory access (DMA) channel 58. However, to provide data access in this manner, the direct memory access channel 58 may be implemented with increased bandwidth, which increases the cost associated with the implementation. Furthermore, if the external memory 44 is shared with other components, this may affect data access latency and, therefore, the processing efficiency of the display pipeline 36.

[0062] After processing, display pipeline 36 may output the processed image data, such as display pixel image data and / or a set of gain values, to display driver 40 for implementation (e.g., driving pixels with the image data and gain values). Based at least in part on the processed image data and the set of gain values ​​from the gain map, display driver 40 may apply analog electrical signals to display pixels of electronic display 18 to display images within one or more image frames 55. In this manner, display pipeline 36 may operate to facilitate providing a visual representation of information on electronic display 18 while preventing or reducing image artifacts in various display regions.

[0063] 11 is a flow diagram of a process 80 for operating the display pipeline 36 to apply the primary gain map 52 and / or the secondary gain map 54. Any suitable device(s) (e.g., controller) that can control the electronic device 10, components of the electronic device 10, or both, such as the processor(s) 12, the display pipeline 36, the display pipeline controller 51, etc., may perform the process 80. Similarly, any suitable device(s) that can control the electronic device 10 may perform the process 100 described with respect to FIG. 12 and the process 150 described with respect to FIG. 13. In some embodiments, the processes 80, 100, and 150 may be implemented by using the processor(s) 12 to execute instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 14 or storage device 16 of the electronic device 10. In additional or alternative embodiments, processes 80, 100, and 150 may be performed, at least in part, by one or more software components, such as an operating system of electronic device 10, one or more software applications of electronic device 10, etc. Although processes 80, 100, and 150 are described using processor(s) 12, this disclosure contemplates using any other suitable device, such as display pipeline 36 or the device(s) described above. Furthermore, while processes 80, 100, and 150 are described using a particular order of steps, this disclosure contemplates that the described steps may be performed in an order different from that illustrated, and that certain described steps may be skipped or not performed at all.

[0064] Process 80 includes processor(s) 12 (e.g., or display pipeline 36) receiving image pixel image data (process block 82), for example, from image data source 38 of FIG. 10 . Specifically, processor(s) 12 may receive, on a pixel-by-pixel basis, image pixel image data from image data source 38 indicating target luminances for color components of points (e.g., image pixels) within an image. In some embodiments, the image pixel image data may correspond to a rectangular image. Additionally, in some embodiments, the image pixel image data may be in a source format. For example, if the source format is an RGB format, the image pixel image data may indicate a target luminance for a red component, a target luminance for a blue component, and a target luminance for a green component at a corresponding pixel location.

[0065] Processor(s) 12 may process the image pixel image data (process block 84) to determine display pixel image data, which is image data to be displayed on display 18 in one or more display areas 50, indicating target luminances of color components at display pixels of electronic display 18. Specifically, to determine the display pixel image data, processor(s) 12 may convert the image data from a source format to a display format. In some embodiments, processor(s) 12 may determine the display format based at least in part on the layout of sub-pixels within electronic display 18.

[0066] Further, processing the image pixel image data may include applying the gains of the value sets of primary gain map 52 and / or secondary gain map 54 at each pixel corresponding to the image data, as discussed with respect to Figure 13. As previously mentioned, the image pixel image data may be dynamic, and the boundaries of the display area may change with each frame 55, and therefore, the secondary gain map 54 for each frame may correspondingly change. After determining the display pixel image data, which includes applying the gain value sets to the pixels of the display area 50, the processor(s) 12 may output the display pixel image data to, for example, display driver 40, for driving the pixels accordingly (process block 86).

[0067] 12 is a flow diagram of a process 100 for decompressing compressed versions of the primary gain map 52 and / or the secondary gain map 54. Typically, the primary gain map 52 and / or the secondary gain map 54 are stored in a compressed format (e.g., a compressed version) in a respective memory, such as a RAM, as shown (block 102). In some cases, the gain maps may be stored separately and / or in a dedicated RAM. To occupy less space, the primary gain map 52 and the secondary gain map 54 may be compressed into three segments, including a run map, a position map, and a gain map. However, any other suitable form of compression may be used, or no compression may be used at all.

[0068] A primary gain map 52 corresponding to a static display region having boundaries that remain fixed may not change from frame to frame, and the same set of gain values ​​may be stored in RAM 102 for the primary gain map 52. In contrast, a secondary gain map(s) 54 corresponding to one or more dynamic display region(s) having boundaries that may change may change from frame to frame, and different sets of gain values ​​may be stored in RAM 102 for the secondary gain map(s) 54 at different times. For example, the secondary gain map(s) 54 may change when a particular animation is occurring from frame to frame. The secondary gain map 54 may be updated, for example, based on image data (e.g., based on whether boundaries below or above a threshold, such as gray level 0 (GO) exist in the image data), based on metadata associated with the image data, or by direct adjustment of the secondary gain map 54 in memory by image processing circuitry (e.g., a GPU, display pipeline, application processor). For example, a certain animation sequence may have a particular sequence of gain value sets for the secondary gain map 54. Updates to the set of gain values ​​in secondary gain map 54 may change from frame to frame to accommodate changes in the image data being processed for display on display 18. As an example, the boundaries of a dark area to allow for under-display sensors or dialog boxes that appear on the screen may expand or contract over the course of several frames. However, both static and changing boundaries can be sharp and accurate using primary gain map 52 and secondary gain map(s) 54.

[0069] Although the boundaries of a dynamic display area 50 (e.g., 50B, 50C, or 50D in FIG. 7) may change from frame to frame, the boundaries of that dynamic display area 50 may also remain the same for several frames. However, the boundaries of a dynamic display area 50 (e.g., 50B, 50C, or 50D in FIG. 7) are not consistently the same as the boundaries of static display area 50A may be.

[0070] The gain map (e.g., primary gain map 52 and / or secondary gain map 54) may be decompressed to obtain a set of gain values ​​from the gain map (block 104), as shown. The gain map may provide a gain for a particular pixel location in a sub-pixel of a pixel. The set of gain values ​​may include three gain values ​​for a sub-pixel location, such as a red gain, a green gain, and a blue gain for a red sub-pixel, a green sub-pixel, and a blue sub-pixel, respectively (block 106).

[0071] In general, a run map may contain the size of the current run of either a coded row or an uncoded row. A coded row may refer to a row of gains in the gain map that includes gains for red, green, and blue subpixel (redGain, greenGain, blueGain) triples (or, in the case of some high-resolution and / or high dynamic range (HDR) panels with subsampled pixels, gains for red, green subpixel (redGain, greenGain) pairs). The gains may have any suitable bit depth. Using gains provided as values ​​between 0 and 1 in 8-bit depth as an example, a coded row may represent a row in which not all of the pixels are 1. A uncoded row may refer to a row of red, green, and blue subpixel (redGain, greenGain, blueGain) triples (or, in the case of some high-resolution panels with subsampled pixels, (redGain, greenGain) pairs) that all have gain values ​​equal to 1. A gain triple may specify that the pixel corresponding to the gain should not be modified. Other gain values ​​may modify corresponding pixels. All three segments of compressed data (e.g., run map, position map, and gain map) may start on a byte boundary. That is, each segment may be byte-aligned at the end of the segment. In one example, in decompressed form, each gain map may provide a set of gain values. The maps may provide three gains for each input pixel of the image affected by the maps, corresponding to red, green, and blue components, respectively. Runs may alternate between coded and uncoded rows. Whether the first row is coded is specified by a programmable bit start run register. Any suitable bit depth (e.g., 6 bits, 7 bits, 8 bits, 9 bits, 10 bits, 11 bits, 12 bits, 13 bits, 14 bits, 15 bits, 16 bits) may be used as gain values ​​in the gain maps.

[0072] Additionally, programmable registers may specify an offset position and size of the area of ​​pixels affected by primary gain map 52 and / or secondary gain map 54, respectively. The offset position may be relative to the start of display area 50 (e.g., within the active area), and the size of the area of ​​pixels affected by the gain map may include pixels located substantially entirely (e.g., completely) within that display area 50 or pixels located around that display area 50.

[0073] In addition to the gains derived from each stored compression map, separate fixed gains along the straight edges of the display region 50 for the primary gain map 52 and / or along the edges of the designated region for the dynamic secondary gain map 54 may be specified through a set of registers, with the gains being independent for each sub-pixel color (e.g., red, green, and / or blue) and / or for each edge of the display region 50. For high-resolution panels with subsampled pixels, pixels along the left and right edges have either a red component or a blue component. As a result, the other gain value may be ignored for these pixels. For each edge, start and end pixel locations may also be specified. These positions are relative to the start coordinates of the area encompassing the display region 50 for the primary gain map 52 and the start coordinates of the designated region for the dynamic secondary gain map 54, and may be contained within the dimensions of the display region 50 for the primary gain map 52 and the region for the dynamic secondary gain map 54, respectively. When specified or preset, the edge gains may override or be applied along with the map gains. These settings may be preset by programming through registers.

[0074] The edge gains and decompression map gains may be combined. In some embodiments, for any given pixel location, only one of the primary or dynamic secondary gain maps may hold a gain value not equal to one, except that both maps may contain a gain value of zero. Thus, a priority may be programmed to favor the gain from primary gain map 52 or dynamic secondary gain map 54. For example, a priority may be used when the decompression map gain for any component or its corresponding edge gain is a non-zero gain in the gain map with the selected priority. This can ensure that appropriate anti-aliasing is applied when the boundaries of the dynamic and static display regions are close to or overlap one another (e.g., when the dynamic display region moves near or expands to reach the outer edges of an electronic display, such as a rounded edge of an electronic display).

[0075] FIG. 13 is a flow diagram of a process 150 for applying primary gain map 52 and / or secondary gain map 54. In particular, process 150 extends process 80 described with respect to FIG. 11. Process 150 includes processing circuitry (e.g., image processing circuitry such as display pipeline 36, processor(s) 12, graphics processing unit (GPU), etc.) receiving image data to be displayed on display 18 (process block 152). For example, the image data may include image pixel image data indicating target luminance at pixel locations for a frame, as described with respect to FIG. 11. The processing circuitry may determine dynamic boundaries associated with the image data (process block 154). That is, the processing circuitry may determine whether display region 50 is changing and whether it is dynamic with respect to a first frame 55 and / or subsequent frames 55 of image data. In some cases, the processing circuitry may analyze each of the frames 55 individually and compare each frame 55 with previous and / or subsequent frames 55 to determine changes within the frames 55, such as by target luminance at pixel locations within successive frames 55. Additionally or alternatively, the secondary gain map 54 may be updated, for example, based on the image data (e.g., based on whether boundaries below or above a threshold, such as gray level 0 (GO), exist within the image data), based on metadata associated with the image data, or by direct adjustment of the secondary gain map 54 in memory by the image processing circuitry (e.g., GPU, display pipeline). For example, an animation sequence may have a particular sequence of gain value sets in the secondary gain map 54 for a particular display region 50. The updates to the gain value sets in the secondary gain map 54 may vary from frame to frame to correspond to changes in the image data being processed for display on the display 18.

[0076] The processing circuitry may apply a static primary gain map 52 to pixels within a static display region 50 (e.g., static display region 50A) (process block 156). The processing circuitry may apply static gain to rounded boundaries of the display region that remain constant between frames 55. By way of example, such a static display region 50 may include a rounded boundary edge of the display 18. The processing circuitry may also apply a dynamic secondary gain map 54 to the dynamic display region 50 (process block 158). Specifically, as described above, the processing circuitry may decompress a stored compressed gain map from RAM and then derive the gain at each pixel location of the rounded boundary. The processing circuitry may store different sets of gain values ​​in the secondary gain map(s) 54 for different image frames. Thus, the secondary gain map(s) 54 may apply gain to changing boundaries within the dynamic display region 50. Although the flowchart of FIG. 13 shows blocks 156 and 158 as separate operations, the set of gain values ​​in the primary gain map 52 and the set of gain values ​​in the secondary gain map(s) 54 can be combined and applied to the image data in one operation.

[0077] The processing circuitry may display the image data on the display (process block 160). By applying appropriate gain values, the processing circuitry may remove or reduce any image artifacts or aliasing along the boundaries of the display area 50 in each frame. In this manner, the display 18 may provide a seamless viewing experience using the gain map techniques described herein.

[0078] The techniques presented and claimed herein refer to and apply tangible objects and actual examples of a practical nature that demonstrably improve the art, and are therefore not abstract, intangible, or purely theoretical. Furthermore, to the extent any claim appended hereto contains one or more elements designated as "means for [performing] _____ [function]" or "steps for _____ [function]," it is intended that such elements be construed in accordance with 35 U.S.C. 112(f). However, for claims containing elements recited in other ways, it is intended that such elements not be construed under 35 U.S.C. 112(f).

[0079] It is well understood that use of personally identifiable information should comply with generally recognized privacy policies and practices that meet or exceed industry or government requirements for maintaining user privacy. In particular, personally identifiable information data should be managed and handled in a manner that minimizes the risk of unintended or unauthorized access or use, and the nature of authorized use should be clearly indicated to users.

Claims

1. 1. An electronic device comprising: a display panel configured to display the plurality of frames of image data having a static boundary that remains the same across the plurality of frames and a dynamic boundary that changes between a first frame and a second frame of the plurality of frames of image data; a processing circuit, the processing circuit comprising: applying a first set of gain values ​​from a static gain map to a first portion of pixels of the first frame associated with the static boundary to reduce or eliminate aliasing image artifacts along the static boundary in the first frame; applying a second set of gain values ​​from a dynamic gain map to a second portion of pixels of the first frame associated with the dynamic boundary in the first frame to reduce or eliminate aliasing image artifacts along the dynamic boundary in the first frame; applying the first set of gain values ​​from the static gain map to the first portion of pixels of the second frame associated with the static boundary to reduce or eliminate aliasing image artifacts along the static boundary in the second frame; and applying a third set of gain values ​​from the dynamic gain map in the second frame to a third portion of pixels of the second frame associated with the dynamic boundary to reduce or eliminate aliasing image artifacts along the dynamic boundary in the second frame.

2. The electronic device of claim 1 , wherein the static boundary, the dynamic boundary, or both, comprise a rounded boundary.

3. 2. The electronic device of claim 1, wherein the processing circuitry is configured to determine a static display area of ​​the display panel that includes the static boundary, the static display area remaining the same between the first frame and the second frame of the plurality of frames of image data.

4. 2. The electronic device of claim 1, wherein the processing circuitry is configured to determine a dynamic display area of ​​the display panel that includes the dynamic boundary, the dynamic display area changing between the first frame and the second frame of the plurality of frames of image data.

5. The electronic device of claim 4 , wherein the dynamic display area includes dynamic characteristics between successive frames of the plurality of frames of image data.

6. The electronic device of claim 5 , wherein the characteristics include a position of the dynamic display area, a position of the dynamic boundary within the dynamic display area, a dimension of the dynamic display area, the existence of the dynamic display area, or any combination thereof.

7. the processing circuitry is configured to determine a static display area of ​​the display panel that includes the static boundary; the static display area remains the same between the first frame and the second frame of the plurality of frames of image data; the static display area includes a first portion of the display panel; the dynamic display area includes a second portion of the display panel that is larger than the first portion of the display panel; The electronic device according to claim 4 .

8. The electronic device of claim 1 , wherein the dynamic gain map is less than or equal to the static gain map.

9. a first area of ​​dedicated memory for storing a compressed version of said static gain map; a second area of ​​dedicated memory for storing a compressed version of said dynamic gain map; The electronic device of claim 1 , comprising:

10. The electronic device of claim 1 , wherein the dynamic gain map indicates offset positions of the areas of the pixels associated with the dynamic gain map.

11. The electronic device of claim 1 , wherein the dynamic gain map indicates a size of the area of ​​the pixel associated with the dynamic gain map.

12. 12. The electronic device of claim 11, wherein the processing circuitry is configured to determine a dynamic display region of the display panel that includes the dynamic boundary, the dynamic display region changing between the first frame and the second frame of the plurality of frames of image data, and the size of the area including pixels that are located entirely within the dynamic display region.

13. The electronic device of claim 1 , wherein the set of gain values ​​of the static gain map and the dynamic gain map are 1 along rectangular edges of the static and dynamic boundaries.

14. 1. A method comprising: receiving a plurality of frames of image data for display on a display panel; determining a dynamic display region including a dynamic boundary that changes between a first frame and a second frame of the plurality of frames of image data; determining a gain for pixels of the display panel associated with the dynamic boundary based at least in part on a dynamic gain map that provides different gains among the plurality of frames within the dynamic display region; applying the gain from the dynamic gain map to the pixels to reduce or eliminate aliasing image artifacts along the dynamic boundary; displaying the plurality of frames of image data on the display panel; A method comprising:

15. The method of claim 14 , wherein the dynamic display area is determined to change location, size, presence, or any combination thereof between the one or more frames.

16. determining a second dynamic display area distinct from the dynamic display area, the second dynamic display area including a second dynamic boundary that changes between the first frame and the second frame of the plurality of frames of image data; determining a gain for pixels of the display panel associated with the second dynamic boundary based at least in part on the dynamic gain map, the dynamic gain map also providing different gains among the plurality of frames within the second dynamic display region; applying the gain from the dynamic gain to the pixel to reduce or eliminate aliasing image artifacts along the second dynamic boundary; 15. The method of claim 14, comprising:

17. determining a static display area including a static boundary that does not change between the first frame and the second frame of the plurality of frames of image data; determining a gain for pixels of the display panel associated with the static boundary based at least in part on a static gain map that provides the same gain between the first frame and the second frame of the plurality of frames of image data; applying the gain from the static gain map to the pixel to reduce or eliminate aliasing image artifacts along the static boundary; 16. The method of claim 15, comprising:

18. 20. The method of claim 17, wherein the dynamic gain map, the static gain map, or both are compressed and stored in compressed form in one or more memories, and the method includes decompressing the dynamic gain map, the static gain map, or both to obtain the gains of the pixels associated with the dynamic boundary, or the gains of the pixels associated with the static boundary, or both.

19. An image processing circuit, receiving a plurality of frames of image data for display on a display panel; decompressing a dynamic gain map corresponding to a dynamic display area of ​​the display panel that includes a dynamic boundary that changes between a first frame and a second frame of the plurality of frames of image data; determining a gain for pixels of the display panel based at least in part on the dynamic gain map, the dynamic gain map providing a different gain between the first frame and the second frame of the plurality of frames of image data; applying the gain from the dynamic gain map to the pixels to reduce or eliminate aliasing image artifacts along the dynamic boundaries; an image processing circuit configured to display the plurality of frames of image data.

20. The image processing circuit decompressing a static gain map corresponding to a static display area of ​​the display panel that includes a static boundary that does not change between the first frame and the second frame of the plurality of frames of image data, the dynamic gain map and the static gain map being stored in compressed form in different memories; determining a gain for the pixels in the static display area of ​​the display panel based at least in part on the static gain map, the static gain map providing the same gain between the first frame and the second frame of the plurality of frames of image data; applying the gain from the static gain map to the pixel to reduce or eliminate aliasing image artifacts along the static boundary; 20. The image processing circuit of claim 19 configured to display one or more frames of the image data.

21. 1. An electronic device comprising: an electronic display configured to display image data; a first memory configured to store a first gain map configured to be applied to a static boundary of the image data; a second memory configured to store a second gain map configured to be applied to a dynamic boundary of the image data; an image processing circuit configured to apply the first gain map to the static boundaries of the image data and to apply the second gain map to the dynamic boundaries of the image data; An electronic device comprising:

22. 22. The electronic device of claim 21, wherein the static boundaries correspond to physical boundaries of the electronic display.

23. The electronic device of claim 22 , wherein the dynamic boundary corresponds to a user interface element within the static boundary.

24. 23. The electronic device of claim 22, wherein the dynamic boundary corresponds to a user interface element that changes from one frame to another.

25. 1. A method comprising: receiving image data for a first frame having a region with a boundary having at least one non-linear edge; applying a set of gain values ​​from a gain map to a first pixel of the image data along the boundary to provide anti-aliasing along the boundary; receiving image data for the second frame having the region with the boundary, the boundary having a position that changed between the first frame and the second frame; applying a new set of gain values ​​from the gain map to a second pixel of the image data along the boundary to provide anti-aliasing along the boundary; A method comprising:

26. 26. The method of claim 25, further comprising updating the gain map to include the new set of gain values ​​based on the image data of the second frame.

Images