Dynamic arbitrary boundary gain

Abstract

The invention provides an electronic device. The electronic device may include a display panel and a processing circuit. The display panel may display a frame of image data having a static boundary that remains the same across a plurality of frames and a dynamic boundary that changes between a first frame and a second frame. The processing circuitry may apply a set of static gain values from the static gain map to pixels to reduce or eliminate aliasing image artifacts along the static boundary. The processing circuitry may also apply a set of altered gain values from the dynamic gain map to pixels to reduce or eliminate aliasing image artifacts along the dynamic boundary.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Application No. 63 / 404,091, filed on September 6, 2022, entitled “DYNAMIC ARBITRARY BORDER GAIN,” the disclosure of which is incorporated by reference in its entirety for all purposes. Background Art

[0003] The present disclosure relates generally to display systems and devices, and more particularly to displaying images having dynamic display areas with arbitrary boundaries.

[0004] Electronic devices often use electronic displays to provide visual representations of information by displaying one or more images. Such electronic devices may include computers, mobile phones, portable media devices, tablet computers, televisions, virtual reality headsets, vehicle dashboards, etc. To display an image, the electronic display may control light emission from pixels of the display based on image data indicating target characteristics of the image. For example, the image data may indicate target brightness of specific color components, such as green, blue, and / or red components, at various pixels in the image.

[0005] An electronic display can enable the perception of various colors in an image by mixing (e.g., averaging) color components. For example, mixing a green component, a blue component, and a red component at various brightness levels can enable the perception of a range of colors from black to white. To facilitate controlling the brightness of the color components, each display pixel in the electronic display may include one or more sub-pixels, each sub-pixel controlling the brightness of one color component. For example, a display pixel may include a red sub-pixel, a blue sub-pixel, and / or a green sub-pixel. In order to enhance the image quality around the edge of the electronic display (particularly along the rounded edge of the electronic display), the image processing circuit may apply a gain value set (e.g., a gain value to be applied to each sub-pixel color type) to each pixel in a specific display area of ​​a frame of image data, so that the pixel is illuminated as needed and facilitates display of the image. The gain value set can prevent or reduce aliasing along the rounded border. Typically, the gain value set can be predetermined or known a priori. For example, the gain value set can be determined during the manufacture of a display having a rounded border display area. In this way, the gain value set can be static. Summary of the invention

[0006] In order to display an image using a dynamic display area with arbitrary boundaries that are different between image frames, an image processing circuit may apply a dynamic gain value set to prevent or reduce aliasing along the arbitrary boundaries of the dynamic display area. In fact, there may be many use cases in which an image may have elements with arbitrary boundaries relative to other elements. By way of example, some user interface elements may be dynamically expanded, contracted, separated or moved on a series of image frames. In order to ensure that the boundaries of these elements appear clear and clean, a dynamic gain value set may be applied to the region of the image data including the boundaries. A dynamic gain value set may be associated with a dynamic gain value map, which may change between image frames and image frames based on the position of the boundaries of the dynamic display.

[0007] In some cases, a set of dynamic gain values ​​of a dynamic gain map may be applied in addition to or independently of a set of static gain values ​​associated with a static gain map for a static arbitrary boundary (e.g., a fixed boundary of an electronic display). These may also be referred to as primary gain maps (e.g., static gain maps) and secondary gain maps (e.g., dynamic gain maps) of gain value sets applied to arbitrary boundary gain (ABG) corrections for pixels displaying image data in various display regions. ABG corrections may prevent or reduce image artifacts along arbitrary shaped boundaries (e.g., rounded boundaries, angled boundaries) such that the gain values ​​applied to the corresponding pixels provide an anti-aliasing effect along the boundaries. For example, a group of pixels may form a display region displaying at least some image data. In some cases, the display region may encompass a portion of a display having a non-straight boundary (e.g., may have rounded edges).

[0008] A primary gain map (e.g., a static gain map) may include a set of gain values ​​for gain values ​​applied to pixels (e.g., sub-pixels of pixels) where the boundaries in the image data do not change between frames of the image data. By way of example, a primary gain map (e.g., a static gain map) may provide a set of gain values ​​to adjust the boundaries of an electronic display. A secondary gain map (e.g., a dynamic gain map) may include a set of gain values ​​for gain values ​​applied to pixels of a display area that changes, where the boundaries change between frames of the image data. These changes may include the width and / or height of the display area, the presence of the display area (e.g., present on a subsequent frame but not on a previous frame), the location of the display area on the display (e.g., along the x-axis and / or y-axis), etc. The set of gain values ​​of the secondary gain map may be dynamic and change with each frame of the image data, for example, based on changes to the dynamic display area. As will be discussed in detail herein, the systems and methods described herein may facilitate providing sharp edges along rounded boundaries of the display area. In other cases, there may be a single gain map that includes both a static set of gain values ​​and a dynamic set of gain values. Additionally or alternatively, there may be a plurality of different dynamic gain maps having sets of gain values ​​corresponding to different image elements having different dynamic boundaries. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a block diagram of an electronic device according to one embodiment of the present disclosure;

[0010] Figure 2 Yes means Figure 1 A perspective view of a notebook computer as one embodiment of the electronic device;

[0011] Figure 3 Yes means Figure 1 A front view of a handheld device of another embodiment of the electronic device;

[0012] Figure 4 Yes means Figure 1 A front view of another handheld device of another embodiment of the electronic device;

[0013] Figure 5 Yes means Figure 1 A front view of a desktop computer of another embodiment of the electronic device;

[0014] Figure 6 Yes means Figure 1 A front view and a side view of a wearable electronic device of another embodiment of the electronic device;

[0015] Figure 7 According to the embodiments of the present disclosure Figure 1A graphical representation of a static display area and / or a dynamic display area on a display of an electronic device;

[0016] Figure 8 is a graphical representation of a primary gain map and / or a secondary gain map applied to a display area according to an embodiment of the present disclosure;

[0017] Fig. 9 is a diagrammatic representation of a display pixel in a boundary of a display area according to an embodiment of the present disclosure;

[0018] Fig.10 is a block diagram of a display pipeline for processing and implementing a primary gain map and / or a secondary gain map according to an embodiment of the present disclosure;

[0019] Fig.11 is a flow chart of a process for operating a display pipeline to apply a primary gain map and / or a secondary gain map according to an embodiment of the present disclosure;

[0020] Fig.12 is a flow chart of a process for decompressing a compressed version of a primary gain map and / or a secondary gain map according to an embodiment of the present disclosure; and

[0021] Fig.13 is a flow chart of a process for applying a primary gain map and / or a secondary gain map according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] When introducing the elements of various embodiments of the present disclosure, the articles "one", "an" and "the" are intended to mean one or more elements present in the elements. The terms "including", "comprising" and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. In addition, it should be understood that reference to "one embodiment", "embodiment" or "some embodiments" of the present disclosure is not intended to be interpreted as excluding the existence of additional embodiments that also combine the cited features. The use of the term "approximately" or "close to" should be understood to mean including close to a target (e.g., design, value, amount), such as within the limits of any suitable or conceivable error (e.g., within 0.1% of the target, within 1% of the target, within 5% of the target, within 10% of the target, within 25% of the target, etc.). As used herein, "active area" refers to a portion of an image data frame that undergoes processing. Thus, when an arbitrary boundary gain (ABG) is applied to an image data frame, the portion of the frame that utilizes an arbitrary boundary gain technique can be an active area. As will be discussed herein, a display area can be included in an active area. The ABG technique applied to the active area may facilitate displaying image data in the display area without fringing or other image artifacts along boundaries of elements of the display area.

[0023] As previously mentioned, electronic devices may include displays that present visual representations of information as, for example, images in one or more image frames. To display an image, an electronic display may control light emission from its display pixels based on image data indicating target characteristics of the image. For example, the image data may indicate a target brightness (e.g., brightness) of a particular color component in a portion of an image (e.g., an image pixel), which, when integrated by the human eye, may produce a perception of a range of different colors. Typically, each display pixel in an electronic display may correspond to an image pixel in an image to be displayed. In other words, a display pixel and an image pixel may correspond to a pixel position. To facilitate displaying an image, a display pixel may include one or more sub-pixels, each of which controls the brightness of a color component at a pixel position. For example, a display pixel may include a red sub-pixel that controls the brightness of a red component, a green sub-pixel that controls the brightness of a green component, and / or a blue sub-pixel that controls the brightness of a blue component.

[0024] In addition, in some cases, the display areas including sub-pixels may vary in one or more characteristics (such as shape and / or size). For example, a first display area may have elements with four straight boundaries connected at approximately ninety degree angles. On the other hand, a second display area may have elements with non-straight boundaries. For example, the second display area may have four straight boundaries connected with four rounded (e.g., curved) boundaries. As previously mentioned, the gain map may include a set of gain values ​​for sub-pixels of pixels of image data. By way of example, any boundary gain correction may involve a set of gain values ​​applied to sub-pixels to reduce or eliminate image artifacts that may otherwise be generated at the boundaries of display areas of various shapes.

[0025] To compensate for static boundaries of arbitrary shapes, the gain map can be static so that the same set of gain values ​​applied at the active area is applied at the corresponding sub-pixels. By way of example, a static gain map may include gain values ​​to account for image artifacts that would otherwise appear at known or predetermined non-straight boundaries of a display. However, a display may include multiple display areas, and these display areas may change between image data frames, such that the static gain value set may not account for image artifacts at the boundaries of the changing display areas. Therefore, the present disclosure provides techniques for improving the perceived image quality of an electronic display, for example, by processing image data using a dynamic gain value set based on a dynamic display area of ​​an image data frame.

[0026] First go to Figure 1, an electronic device 10 according to an embodiment of the present disclosure may include, among other things, one or more processors 12, a memory 14, a non-volatile storage device 16, a display 18, an input structure 22, an input / output (I / O) interface 24, a network interface 26, a power supply 28, and a transceiver 30. Figure 1 The various functional blocks shown in the may include hardware elements (including circuits), software elements (including computer codes stored on computer-readable media), or a combination of both hardware elements and software elements. It should be noted that Figure 1 It is merely one example of a particular implementation and is intended to illustrate the types of components that may be present in electronic device 10 .

[0027] By way of example, the electronic device 10 may represent Figure 2 The laptop shown in Figure 3 The handheld device shown in Figure 4 The handheld device shown in Figure 5 The desktop computer shown in Figure 6 A block diagram of a wearable electronic device or similar device is shown in FIG. It should be noted that Figure 1 The processor 12 and other related items in the system may be generally referred to herein as "data processing circuitry". Such data processing circuitry may be embodied in whole or in part as software, hardware, or any combination thereof. Figure 1 The other related items in the electronic device 10 may be a single independent processing module, or may be fully or partially integrated into any one of the other elements in the electronic device 10.

[0028] exist Figure 1 In the electronic device 10, the processor 12 may be operably coupled to the memory 14 and the non-volatile storage device 16 to execute various algorithms or instructions. For example, algorithms for implementing static and / or dynamic gain maps may be stored in the memory 14 and / or the non-volatile storage device 16. Such algorithms or instructions executed by the processor 12 may be stored in any suitable article including one or more tangible computer-readable media. The tangible computer-readable medium may include the memory 14 and / or the non-volatile storage device 16, individually or collectively, to store the algorithms or instructions. The memory 14 and the non-volatile storage device 16 may include any suitable article for storing data and executable instructions, such as random access memory, read-only memory, rewritable flash memory, hard drive, and optical disk. In addition, the program encoded on such a computer program product (e.g., an operating system) may also include instructions that can be executed by the processor 12 to enable the electronic device 10 to provide various functions.

[0029] In some embodiments, display 18 may be a liquid crystal display (LCD) that can display images generated on electronic device 10. In some embodiments, display 18 may include a touch screen that can facilitate user interaction with a user interface of electronic device 10. In addition, it should be understood that in some embodiments, display 18 may include one or more light emitting diode (LED) displays, organic light emitting diode (OLED) displays, active matrix organic light emitting diode (AMOLED) displays, or some combination of these and / or other display technologies. The display may include display areas that are dynamic or static between displaying frames of image data.

[0030] The input structures 22 of the electronic device 10 may enable a user to interact with the electronic device 10 (e.g., press a button to increase or decrease a volume level). As with the network interface 26, the I / O interface 24 may enable the electronic device 10 to interact with various other electronic devices. The network interface 26 may, for example, include one or more interfaces for a personal area network (PAN) such as a Network, Local Area Network (LAN) or Wireless Local Area Network (WLAN) such as 802.11x networks, and / or wide area networks (WANs) such as 3rd generation (3G) cellular networks, Universal Mobile Telecommunications System (UMTS), 4th generation (4G) cellular networks, Long Term Evolution (LET), cellular network, Long Term Evolution Licensed Assisted Access (LTE-LAA) cellular network, 5th Generation (5G) cellular network, and / or New Radio (NR) cellular network. In some embodiments, electronic device 10 may use transceiver 30 to communicate with the user via the aforementioned wireless network (e.g., move 4G, 5G, etc.) for communication. The transceiver 30 may include circuitry for both wirelessly receiving a receive signal at a receiver and wirelessly transmitting a transmit signal (e.g., a data signal, a wireless data signal, a wireless carrier signal, a radio frequency signal) from a transmitter. As further shown, the electronic device 10 may include a power supply 28. The power supply 28 may include any suitable power source, such as a rechargeable lithium polymer (Li-poly) battery and / or an alternating current (AC) power converter.

[0031] In some embodiments, the electronic device 10 may take the form of a computer, a portable electronic device, a wearable electronic device, or other type of electronic device. Such computers may be computers that are generally portable (such as laptops, notebook computers, and tablet computers), or computers that are generally used in one location (such as desktop computers, workstations, and / or servers). In some embodiments, the electronic device 10 in the form of a computer may be a computer available from Apple Inc. of Cupertino, California. Pro, MacBook mini or Mac By way of example, according to one embodiment of the present disclosure, in Figure 2 1 shows an electronic device 10 in the form of a laptop computer 10A. The depicted laptop computer 10A may include a housing or casing 31, a display 18, input structures 22, and ports of an I / O interface 24. In one embodiment, the input structures 22 (such as a keyboard and / or a touchpad) may be used to interact with the computer 10A, such as to launch, control, or operate a graphical user interface (GUI) or an application running on the computer 10A. For example, the keyboard and / or touchpad may allow a user to navigate a user interface and / or application interface displayed on the display 18.

[0032] Figure 3 A front view of a handheld device 10B is depicted, which represents one embodiment of an electronic device 10. The handheld device 10B may represent, for example, a portable telephone, a media player, a personal data organizer, a handheld gaming platform, or any combination of such devices. By way of example, the handheld device 10B may be a portable device available from Apple Inc. (Cupertino, California). model. The handheld device 10B may include a housing 31 to protect the internal components from physical damage and / or to shield the internal components from electromagnetic interference. The housing 31 may surround a display 18 that displays an array of icons 19. By way of example, when an icon 19 is selected through an input structure 22 or a touch sensing component of the electronic display 18, an application may be launched. The I / O interface 24 may be opened through the housing 31 and may include, for example, an I / O port for a hardwired connection for charging and / or content manipulation using a standard connector and protocol such as a Lightning connector provided by Apple Inc. of Cupertino, California, a universal serial bus (USB), or other similar connectors and protocols. The I / O interface 24 may be associated with wiring and connectors within a radio frequency package of the electronic device 10.

[0033] The input structures 22 in conjunction with the display 18 may allow the user to control the handheld device 10B. For example, the input structures 22 may activate or deactivate the handheld device 10B, navigate the user interface to a home screen, a user-configurable application screen, and / or activate a voice recognition feature of the handheld device 10B. Other input structures 22 may provide volume control, or may switch between a vibration and ring mode. The input structures 22 may also include a microphone for capturing the user's voice for various voice-related features, and a speaker that may enable audio playback and / or certain telephone functions. The input structures 22 may also include a headphone input that may provide a connection to an external speaker and / or headphones.

[0034] Figure 4 A front view of another handheld device 10C is depicted, which represents another embodiment of the electronic device 10. The handheld device 10C may represent, for example, a tablet computer, or one of a variety of portable computing devices. For example, the handheld device 10C may be a tablet-sized embodiment of the electronic device 10, specifically, may be, for example, a tablet-sized embodiment available from Apple Inc. (Cupertino, California). Type handheld device.

[0035] See also Figure 5 , the computer 10D can represent Figure 1 Computer 10D may be any computer, such as a desktop computer, a server, or a laptop computer, but may also be a stand-alone media player or video game console. By way of example, computer 10D may be a computer from Apple Inc. of Cupertino, California. or other similar devices. It should be noted that the computer 10D may also represent a personal computer (PC) of another manufacturer. A similar housing 31 may be provided to protect and surround the internal components of the computer 10D, such as the display 18. In some embodiments, a user of the computer 10D may interact with the computer 10D using various peripheral input structures 22 such as a keyboard 22A or a mouse 22B (e.g., input structures 22) that may be connected to the computer 10D.

[0036] Similarly, Figure 6 Depicted Figure 1 Another embodiment of the electronic device 10 of the present invention is a wearable electronic device 10E that can be configured to operate using the techniques described herein. By way of example, the wearable electronic device 10E that can include the wristband 23 can be an Apple device of Apple, Inc. of Cupertino, California. However, in other embodiments, the wearable electronic device 10E may include any wearable electronic device, such as, for example, a wearable motion monitoring device (e.g., a pedometer, an accelerometer, a heart rate monitor), or other devices from another manufacturer. The display 18 of the wearable electronic device 10E may include a touch screen display 18 (e.g., an LCD, an LED display, an OLED display, an active matrix organic light emitting diode (AMOLED) display, etc.) and an input structure 22, which may allow a user to interact with the user interface of the wearable electronic device 10E.

[0037] In view of the above, Figure 7 yes Figure 1Schematic diagram of a display area 50 (e.g., an active area) on a display 18 of an electronic device of FIG. Although the depicted embodiment shows four display areas 50 representing a particular embodiment, the techniques described herein may be applied to one or more display areas 50 in one or more frames. In the depicted embodiment, the display 18 includes a first display area 50A, a second display area 50B, a third display area 50C, and a fourth display area 50D displayed during a single frame. Typically, the display area 50 may include areas or elements with rounded borders and / or non-straight areas that may benefit from arbitrary border gains to reduce image artifacts along their edges. Here, the display area 50 has a rounded border.

[0038] As previously discussed, a set of gain values ​​may be applied to pixels along the rounded boundary of the display area 50. That is, the active area may include the display area 50 for applying arbitrary boundary gains. As previously mentioned, the active area includes a portion of the image data frame undergoing processing, effectively including the frame boundary. By way of example, the processing may include applying the set of gain values ​​to the pixels for arbitrary boundary gain correction. The data applied to the pixels outside the active area may be copied from the input to the output (e.g., no additional gain is applied before driving the pixel). Typically, the display area 50 may include a size that roughly corresponds to the size of the display 18 or a portion of the display 18. In some cases, such as for a rounded boundary, the arbitrary boundary gain of the active area may generally include a gain to be applied to a portion of the display, and the portion may be larger than another portion having a rounded boundary of the display area 50. For example, the xy definition of the active area in the xy coordinate system may be rectangular to enclose the rounded boundary of the display area 50, thereby applying an arbitrary boundary mask around the rounded boundary.

[0039] Specifically, the image data source may generate image data corresponding to a rectangular image. The display pipeline may adjust the rectangular image frame of the image data for display on the non-rectilinear display area 50, for example, by applying a black mask at pixels outside the display area 50. However, in some cases, applying a black mask may result in perceptible visual artifacts, such as color fringing along the border of the display area 50 and / or aliasing along the rounded border of the display area 50.

[0040] Thus, a set of gain values ​​(e.g., for arbitrary gains) of the gain map may be applied to pixels of one or more display regions 50 along the rounded border for arbitrary border gain correction. Typically, and as previously mentioned, the active region includes a portion of the image data frame that undergoes processing. Pixels located outside the active region may output image data that is the same or substantially the same as the input image data, such that the image data has not undergone processing associated with arbitrary border gain correction.

[0041] As will be discussed herein, and in some embodiments, two independently decoded maps, such as a primary gain map (e.g., a static gain map) and / or a secondary gain map (e.g., a dynamic gain map), may provide a set of gain values ​​for a frame. The primary gain map may take any suitable shape associated with the electronic display 18. For example, when the electronic display 18 includes rounded edges, the primary gain map may include edge gains along the borders of the display area 50A and / or along the borders of the display 18, where these edge gains are statically configured and may be applied to the entire display area 50A. Thus, for each pixel between frames of image data, the set of gain values ​​applied to the corresponding pixel of the primary gain map is static. On the other hand, the secondary gain map may include a set of gain values ​​that change between frames of image data to correct for dynamic boundaries. The set of gain values ​​of the secondary gain map is dynamically configured and / or reconfigured on a per-frame basis, typically enabled or disabled (e.g., so that the display area 50 may appear or disappear between frames), and / or the position and / or size of the map may change (e.g., corresponding to changing the display area 50 between frames).

[0042] By applying such gain values ​​from the gain value set, pixels adjacent to the rounded border of the display area 50 can be darkened or otherwise adjusted (e.g., changed in brightness) to reduce the likelihood of perceptible aliasing along the rounded border when the image is displayed. In additional or alternative embodiments, the display area 50 can include a rectangular border. As will be discussed herein, in addition to the gain values ​​derived from the gain map, separate fixed gain values ​​along the rectangular edges of the display area 50 for the primary image and the rectangular edges of the secondary image can be specified by a register set having independent gains for each sub-pixel color and / or each rectangular edge of the display area 50.

[0043] In the depicted embodiment, the first display area 50A may include the largest portion of the display 18, but the first display area 50A may take any other suitable shape. In fact, in other examples, the first display area 50A may only occupy a portion of the electronic display and may not overlap with other display areas 50 (e.g., those associated with the dynamic gain map). By way of example, the first display area 50A may have a static boundary that is fixed (e.g., based on the physical edge of the electronic display 18) and does not change between frames. Other display areas 50 (e.g., 50B, 50C, 50D) may cover areas of the display 18 that are different from the first display area 50A, which may overlap or not overlap with the display area 50A. By way of example, these other display areas 50 (e.g., 50B, 50C, 50D) may have dynamic boundaries that change between frames. In this way, these changed display areas 50 (e.g., 50B, 50C, 50D) may be referred to as dynamic display areas 50 that can change in size, width, length, position, etc. Additionally or alternatively, dynamic display area 50 may appear or disappear from one frame to another (eg, the presence of different display areas 50 may vary from frame to frame). Furthermore, the dynamic boundaries of dynamic display area 50 may have a shape that changes from frame to frame.

[0044] By way of example, an animation that may require precise arbitrary borders within the electronic display 18 may use a dynamic display region 50 that may have growing or shrinking borders. By using a dynamic display region 50 to apply border gain to the changing borders in the animation, these borders may be precise and clean, avoiding image artifacts (e.g., color fringing) that may otherwise appear.

[0045] As about Figure 8Discussed in more detail, and by way of example, a primary gain map may include a set of gain values ​​to be applied to pixels of a first display area 50A (e.g., the borders of the first display area 50A). On the other hand, a secondary gain map (e.g., a dynamic gain map) may include a set of gain values ​​to be applied to pixels of dynamic display areas 50 (e.g., 50B, 50C, 50D). Since the borders of these dynamic display areas 50 (e.g., 50B, 50C, 50D) may change from frame to frame, the secondary gain map may include a set of gain values ​​for one or more dynamic display areas 50 (e.g., 50B, 50C, 50D) that change accordingly from frame to frame. This may allow animations with precise borders of arbitrary shapes (e.g., rounded, curved, jagged, straight) to appear on the display 18. In fact, the set of gain values ​​of the secondary gain map may be dynamic and change with each frame of image data, for example, based on changes to the dynamic display areas 50B to 50D. The systems and methods described herein may facilitate providing sharp edges along any (e.g., rounded, curved, jagged, straight) borders in display region 50. Indeed, in some cases, one or more dynamic display regions 50 may appear along the edge of a display and may also facilitate sharp animations near or along the edge of the display.

[0046] For illustration, Figure 8 is a diagrammatic representation of a primary gain map 52 and / or secondary gain map 54 applied to various display regions 50 of an electronic device 10. Although the current embodiment shows a display 18 for five frames 55 of image data representing a particular embodiment, the systems and methods described herein may include primary gain maps 52 and / or secondary gain maps 54 for applying arbitrary gains along the boundaries of or within one or more display regions 50 in one or more frames 55. Figure 8 The schematic diagram of exemplifies image data for display on a handheld device, but the image data may be formatted for any other suitable display (eg, a circular display, an arbitrarily shaped display).

[0047] As shown, the first frame 55A (frame X) includes the first display area 50A. As previously mentioned, the first display area 50A may include image data that does not change between frames, and as such, application of the primary gain map 52 (indicated by the dashed box) may provide gain values ​​to be applied to pixels in the first display area 50A. The primary gain map 52 may take any suitable shape (e.g., may be rectilinear, may be rectangular, may take any shape), and may encompass all or part of the image frame to completely surround the static boundaries of the electronic display 18. On the other hand, the second frame 55B (frame X+1), the third frame 55C (frame X+2), the fourth frame 55C (frame X+3), and the fifth frame 55E (frame X+4) include display areas 50 that change between consecutive frames 55, such as the second display area 50B and the third display area 50C. These frames 55B to 55E also include a portion of the display 18 having image data that remains the same or substantially the same between consecutive frames. Thus, frames 55B to 55E also include the first display area 50A in addition to the changed display areas 50B, 50C. The second display area 50B and the third display area 50C change between frames 55 and are thus dynamic. Therefore, the application of the secondary gain map 54 (indicated by the dotted box) can provide gain values ​​to be applied to pixels along the boundaries of these dynamic display areas 50B, 50C. The secondary gain map 54 may be smaller than the primary gain map 52 or the same size as the primary gain map. In some cases, there may be multiple secondary gain maps 54 for different dynamic display areas 50 (e.g., a secondary gain map for 50B, a secondary gain map for 50C, a secondary gain map for 50D; a secondary gain map for 50B and 50C, a secondary gain map for 50D).

[0048] As shown, the second display area 50B set at the top portion of the display 18 in the second frame 55B to the fifth frame 55E may include an area with rounded edges, and is an area that changes by becoming more rectangular as the frame advances. In addition, the second display area 50B appears on the second frame 55B. For example, the second display area 50B first appears on the second frame 55B, and then increases in width (e.g., along the x-axis in the xy coordinate system) and / or decreases in height (e.g., along the y-axis in the xy coordinate system) between the second frame 55B and the fifth frame 55E as the frame 55 advances. Similarly, the third display area 50C first appears on the second frame 55B and increases in height along the y-axis, and moves along the display 18 to become more centered on the display 18. As such, the secondary gain map 54 may be applied to dynamic display regions 50B, 50C having display region characteristics that change as the frame 55 progresses, where these characteristics include size (e.g., width and / or height of the display region 50), presence of the display region 50 (e.g., present on subsequent frames but not on previous frames), location of the display region 50 on the display 18 (e.g., moving in the negative x-axis direction and / or the positive y-axis direction), etc. The secondary gain map 54 may be updated with each frame 55 based at least in part on changes to the dynamic display regions 50B, 50C. That is, the set of gain values ​​of the secondary gain map 54 may be updated for each frame 55 to continue to provide smooth edges at the boundaries of the dynamic display regions 50B, 50C. The set of gain values ​​of the secondary gain map 54 may be programmed by processing circuitry of the electronic device (e.g., a GPU, a display pipeline, an application processor, metadata of an image data frame) at any suitable rate (e.g., on a frame-by-frame basis).

[0049] Fig. 9 1 is a diagrammatic table of display pixels 66 in the border of the second display area 50B, which can be located anywhere on the display 18 and change the display area characteristics (e.g., size) in different frames 55. As previously discussed, the border of the display area 50 can be rounded and the display 18 can include multiple display areas 50 that remain static or change between image data frames 55. The gain map technology described herein with respect to the rounded border can be applied to display areas 50 that are static, dynamic, or both between frames 55. In addition, it should be understood that the display pixels 66 depicted, including sub-pixels, are intended to be illustrative only and not limiting. In other words, the display pixels 66 in other electronic displays 18 can be implemented using a changing sub-pixel layout. In addition, although the following description describes the second display area 50B, the techniques described herein can be applied to any dynamic display area 50 (e.g., 50B to 50D, etc.). In some embodiments, these techniques can be applied to static display areas 50, such as the first display area 50A discussed previously.

[0050] In the depicted embodiment, the display pixel 66 is organized in rows and columns. For example, the first display pixel row includes the first display pixel 66A, the second display pixel 66B, the third display pixel 66C, etc. In addition, the third display pixel row includes the fourth display pixel 66D, the fifth display pixel 66E, the sixth display pixel 66F, etc. As described above, the display pixel 66 may include one or more sub-pixels, and the one or more sub-pixels each control the brightness of the corresponding color component. In the depicted embodiment, the display pixel 66 includes a red sub-pixel 68, a green sub-pixel 70, and a blue sub-pixel 72. In addition, in a specific depicted embodiment, the display pixel 66 completely contained in the non-linear display area each includes two sub-pixels, for example, a green sub-pixel 70 and alternately a red sub-pixel 68 or a blue sub-pixel 72 (for example, in a red, green, blue (RGB) display).

[0051] Some display pixels 66 along the rounded boundary 130 may include fewer sub-pixels in the non-linear second display area 50B. In the depicted embodiment, such display pixels 66 may each include one sub-pixel, such as alternating red sub-pixel 68 or blue sub-pixel 72. For example, due to the upper left rounded boundary of the display 18 of the second display area 50B, the first display pixel 66A may include only the blue sub-pixel 72, the second display pixel 66B may include only the red sub-pixel 68, and the third display pixel 66C may include only the blue sub-pixel 72, and so on.

[0052] In any case, each display pixel 66 may correspond to a pixel location, and therefore, to an image pixel received from the image data source 38. With respect to the depicted embodiment, each display pixel 66 may correspond to an image pixel.

[0053] To display the image frame, the brightness of each display pixel 66 may be controlled based at least in part on the image pixel image data corresponding to the image pixel at the pixel location. However, in some cases, the shape of the image frame may be different from the shape of the display area 50 of the electronic display 18. For example, as previously mentioned, the image frame may be rectangular, while the display area 50 for the image frame is non-rectangular with a rounded boundary. In addition, due to the dynamic characteristics of the second display area 50B, the boundary gain may change with each frame 55. In such cases, one or more image pixels may correspond to a pixel location outside the display area 50 (e.g., along the rounded boundary and / or outside the rounded boundary). For example, a first image pixel in a rectangular image frame may correspond to a pixel location 73 outside the non-rectangular second display area 50. In other words, the display pixel 66 may not be implemented at a pixel location corresponding to an image pixel in the electronic display 18.

[0054] Therefore, to facilitate displaying the image frame on the second display area 50B having a different shape, the image frame may be adjusted prior to display, for example by applying a black mask. However, as described above, the display pixel 66 may rely on color mixing to enable a range of different colors to be perceived. In other words, in some cases, simply ignoring image pixels corresponding to pixel positions outside the display area may result in perceptible aliasing (e.g., a staircase pattern) at the display pixel 66 along the rounded boundary 130 because the adjacent display pixel 66 that would otherwise mix the display pixel 66 does not exist. In addition, due to the absence of the adjacent display pixel 66 that would otherwise mix the display pixel 66, perceptible color fringing may occur at the display pixel 66 along the straight boundary 64. In order to improve image quality, as described above, the image pixel image data may be processed based on the gain value associated with the corresponding pixel position.

[0055] The gain values ​​may be provided by the primary gain map 52 and / or the secondary gain map 54, respectively, to the static or dynamic display area 50 in the frame 55. Furthermore, the primary gain map 52 and / or the secondary gain map 54 may be in an uncompressed format that explicitly associates (e.g., maps) each pixel position to a set of gain values. Thus, one or more gain values ​​associated with each pixel position, and thus each sub-pixel position at those pixel positions, may be retained in the uncompressed gain map.

[0056] Fig.10 is a block diagram of a portion 34 of an electronic device 10 including a display pipeline 36 for processing a primary gain map 52 and / or a secondary gain map 54 to implement gain values ​​from the primary gain map 52 and / or the secondary gain map 54. In some embodiments, the display pipeline 36 may be implemented by circuitry in the electronic device 10, circuitry in the display 18, or both. For example, the display pipeline 36 may be included in a core complex of the processor 12, image processing circuitry, a timing controller (TCON) in the display 18, and the like.

[0057] As depicted, portion 34 of electronic device 10 may also include image data source 38, display driver 40, controller 42, and external memory 44. In some embodiments, controller 42 may control the operation of display pipeline 36, image data source 38, and / or display driver 40. To facilitate control operations, controller 42 may include controller processor 51 and controller memory 53. In some embodiments, controller processor 51 may execute instructions stored in controller memory 53. Thus, in some embodiments, controller processor 51 may be integrated with processor 12, image processing circuitry, timing controller in display 18, and / or be a separate processing module. Additionally, in some embodiments, controller memory 53 may be included in local memory 14, main memory storage device 16, external memory 44, internal memory 46 of display pipeline 36, and / or a separate tangible, non-transitory computer-readable medium.

[0058] In the depicted embodiment, the display pipeline 36 is communicatively coupled to an image data source 38. As such, the display pipeline 36 may receive image data for an image to be displayed on the display 18 from the image data source 38, for example, in a source (e.g., red, green, blue (RGB)) format and / or as a rectangular image. In some embodiments, the image data source 38 may be integrated with the processor 12, the image processing circuitry, or both.

[0059] As described above, the display pipeline 36 can process image data received from the image data source 38. To process the image data, the display pipeline 36 may include one or more applicable image data processing blocks 37. For example, in the depicted embodiment, the image processing block 37 includes a sub-pixel layout resampler (SPLR) block 56, which provides display pixel image data (e.g., image data in a display format) by filtering (e.g., interpolating or sub-sampling) image pixel image data (e.g., image data in a source format). In some embodiments, the image data processing block 37 may additionally or alternatively include an ambient adaptive pixel (AAP) block, a dynamic pixel backlight (DPB) block, a white point correction (WPC) block, a sub-pixel layout compensation (SPLC) block, an aging compensation (BIC) block, a panel response correction (PRC) block, a dither block, a sub-pixel uniformity compensation (SPUC) block, a content frame dependent duration (CDFD) block, an ambient light sensing (ALS) block, and the like.

[0060] As will be described in more detail below, the display pipeline 36 may process image data received from the image data source 38 based at least in part on data stored in the external memory 44 and / or the internal memory 46. However, the display pipeline 36 may access the primary gain map 52 and / or the secondary gain map 54 stored in the external memory 44 and / or the internal memory 46. The primary gain map 52 and / or the secondary gain map 54 may be stored in a compressed format (e.g., a compressed version) within a corresponding memory (e.g., a random access memory (RAM)). As will be described with respect to Fig.12 As discussed, a decompressor processing a decompression algorithm may decompress the compressed gain map to retrieve a gain value from a set of gain values ​​to be applied to each pixel of the display area 50 .

[0061] In general, storing data in external memory 44 relative to internal memory 46 may present various implementation-related cost and / or processing efficiency trade-offs. For example, due to physical sizing limitations, increasing the storage capacity of external memory 44 may be more cost-effective than increasing the storage capacity of internal memory 46. As such, the storage capacity of external memory 44 may be greater than the storage capacity of internal memory 46.

[0062] In addition, access to the external memory 44 and the internal memory 46 may be different. For example, the internal memory 46 may be dedicated to the display pipeline 36. In other words, data stored in the internal memory 46 may be more easily accessed by the display pipeline 36 (e.g., with reduced latency), which may facilitate improved processing efficiency of the display pipeline 36. In contrast, the display pipeline 36 may access the external memory 44 via a direct memory access (DMA) channel 58 because the external memory 44 is external to the display pipeline 36. However, in order to provide data access in this manner, the direct memory access channel 58 may be implemented with increased bandwidth, which increases the cost associated with a specific implementation. In addition, when the external memory 44 is shared with other components, data access latency may be affected, and therefore the processing efficiency of the display pipeline 36 may be affected.

[0063] After processing, the display pipeline 36 may output processed image data (such as display pixel image data and / or a set of gain values) to the display driver 40 for implementation (e.g., driving the pixels using the image data and the gain values). Based at least in part on the processed image data and the set of gain values ​​from the gain map, the display driver 40 may apply analog electrical signals to the display pixels of the electronic display 18 to display an image in one or more image frames 55. In this way, the display pipeline 36 may operate to facilitate providing a visual representation of information on the electronic display 18 while also preventing or reducing image artifacts in various display areas.

[0064] Fig.118 is a flow chart of a process 80 for operating the display pipeline 36 to apply the primary gain map 52 and / or the secondary gain map 54. Any suitable device (e.g., a controller) that can control the electronic device 10, components of the electronic device 10, or both (such as the processor 12, the display pipeline 36, the display pipeline controller 51, etc.) can perform the process 80. Similarly, any suitable device that can control the electronic device 10 can perform the process 100 (such as the process described in connection with FIG. 1). Fig.12 discussed) and process 150 (as will be discussed with respect to Fig.13 100 and 150. In some embodiments, processes 80, 100 and 150 may be implemented by using a processor 12 to execute instructions stored in a tangible non-transitory computer-readable medium such as a memory 14 or storage device 16 of an electronic device 10. In additional or alternative embodiments, processes 80, 100 and 150 may be performed at least in part by one or more software components such as an operating system of the electronic device 10, one or more software applications of the electronic device 10, etc. Although processes 80, 100 and 150 are described using a processor 12, the present disclosure contemplates the use of any other suitable device, such as a display pipeline 36 or the device mentioned above. However, although processes 80, 100 and 150 are described using a particular order of steps, the present disclosure contemplates that the described steps may be performed in an order different from the order shown, and that some of the described steps may be skipped or not performed at all.

[0065] Process 80 includes processor 12 (e.g., or display pipeline 36), for example, from Fig.10 The processor 12 may receive (process block 82) image pixel image data from the image data source 38. Specifically, the processor 12 may receive image pixel image data pixel by pixel from the image data source 38, the image pixel image data indicating a target brightness of a color component at a point (e.g., an image pixel) in the image. In some embodiments, the image pixel image data may correspond to a rectangular image. Additionally, in some embodiments, the image pixel image data may be in a source format. For example, when the source format is an RGB format, the image pixel image data may indicate a target brightness of a red component, a target brightness of a blue component, and a target brightness of a green component at a corresponding pixel position.

[0066] Processor 12 may process (process block 84) the image pixel image data to determine display pixel image data, which is image data to be displayed on display 18 in one or more display areas 50 and may indicate target brightness of color components at display pixels of electronic display 18. Specifically, to determine the display pixel image data, processor 12 may convert the image data from a source format to a display format. In some embodiments, processor 12 may determine the display format based at least in part on the layout of sub-pixels in electronic display 18.

[0067] Furthermore, processing the image pixel image data may include applying a gain from the set of values ​​of the primary gain map 52 and / or the secondary gain map 54 at respective pixels corresponding to the image data, such as applying the gain from the set of values ​​of the primary gain map 52 and / or the secondary gain map 54 to the respective pixels corresponding to the image data. Fig.13 As previously mentioned, the image pixel image data may be dynamic and the boundaries of the display region may change with each frame 55, and as such, the secondary gain map 54 for each frame may also change accordingly. After determining the display pixel image data (which includes applying the set of gain values ​​to the pixels of the display region 50), the processor 12 may output (process block 86) the display pixel image data to, for example, the display driver 40 to drive the pixels accordingly.

[0068] Fig.12 1 is a flow chart of a process 100 for decompressing a compressed version of a primary gain map 52 and / or a secondary gain map 54. Typically, the primary gain map 52 and / or the secondary gain map 54 are stored in a corresponding memory (such as a RAM) in a compressed format (e.g., a compressed version) (block 102), as shown. In some cases, the gain maps may be stored separately and / or in a dedicated RAM. In order to occupy less space, the primary gain map 52 and the secondary gain map 54 may be compressed into three segments including a run map, a position map, and a gain map. However, any other suitable form of compression may be used, or compression may not be used entirely.

[0069] A primary gain map 52 corresponding to a static display region having a border that remains fixed may not change from frame to frame, and the same set of gain values ​​may be stored in RAM 102 for the primary gain map 52. In contrast, a secondary gain map 54 corresponding to one or more dynamic display regions having changeable borders may change from frame to frame, and different sets of gain values ​​may be stored in RAM 102 at different times for the secondary gain map 54. For example, the secondary gain map 54 may change as a particular animation appears from frame to frame. For example, the secondary gain map 54 may be updated based on the image data (e.g., based on whether there is a border below or above a threshold value (such as gray level 0 (G0)) within the image data), based on metadata associated with the image data, or by directly adjusting the secondary gain map 54 in memory by an image processing circuit (e.g., GPU, display pipeline, application processor). For example, certain animation sequences may have a particular order of secondary gain map 54 gain value sets. Updates to the secondary gain map 54 gain value set may change from frame to frame to correspond to changes in the image data being processed for display on the display 18. By way of example, the boundaries of a dark area used to enable a sensor below the display or a dialog box that appears on the screen may grow or shrink over the course of several frames. However, using the primary gain map 52 and the secondary gain map 54, both static boundaries and changing boundaries can be clear and precise.

[0070] Although the dynamic display area 50 (e.g. Figure 7 50B, 50C, or 50D) may change from frame to frame, but the boundaries of the dynamic display region 50 may also remain the same for a certain number of frames. Figure 7 The boundaries of the static display area 50B, 50C or 50D) are not always the same as those of the static display area 50A.

[0071] The gain map (e.g., primary gain map 52 and / or secondary gain map 54) may be decompressed (block 104), as shown, to obtain a set of gain values ​​from the gain map. The gain map may provide gains for specific pixel locations at sub-pixels of a pixel. The set of gain values ​​may include three gain values ​​for the sub-pixel location (block 106), such as a red gain, a green gain, and a blue gain for a red sub-pixel, a green sub-pixel, and a blue sub-pixel, respectively.

[0072] Typically, the run map may include the size of the current run of a decoded row or an undecoded row. A decoded row may refer to a row of gains in a gain map, which includes a gain (redGain, greenGain, blueGain) triple for red subpixels, green subpixels, and blue subpixels (or a gain (redGain, greenGain) pair for red subpixels, green subpixels in the case of certain high-resolution and / or high dynamic range (HDR) panels with subsampled pixels). The gain may have any suitable bit depth. By way of example, using gains provided as values ​​between 0 and 1 in 8-bit depth, a decoded row may represent a row in which not all pixels are gained to 1. An undecoded row may refer to a row of red subpixels, green subpixels, and blue subpixels (redGain, greenGain, blueGain) triples (or (redGain, greenGain) pairs in the case of certain high-resolution panels with subsampled pixels) having gain values ​​all equal to 1. A characteristic gain triple may specify that the pixel corresponding to the gain should not be modified. Other gain values ​​may modify the corresponding pixel. All three segments of compressed data (e.g., run graph, position graph, and gain graph) may start at byte boundaries. That is, each segment may be a byte aligned at the end of the segment. In one example, in decompressed form, each gain graph may provide a set of gain values. The graph may provide three gains corresponding to red, green, and blue components for each input pixel of the image affected by the graph. Runs may alternate between decoded rows and undecoded rows. Whether the first row is decoded is specified by a programmable bit start run register. Any suitable bit depth (e.g., 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16) may be used as gain values ​​in the gain graph.

[0073] Additionally, programmable registers may specify offset positions and sizes of regions of pixels affected by primary gain map 52 and / or secondary gain map 54, respectively. The offset positions may be relative to the beginning of display area 50 (e.g., in an active area), and the sizes of the regions of pixels affected by the gain maps may include pixels disposed substantially entirely (e.g., completely) within or around such display area 50.

[0074] In addition to the gains derived from each stored compression map, separate fixed gains along straight or straight edges of the display area 50 for the primary gain map 52 and / or the edges of the specified area for the dynamic secondary gain map 54 may be specified by a set of registers, where these gains are independent for each sub-pixel color (e.g., for red, green and / or blue) and / or for each edge of the display area 50. In the case of a high-resolution panel with subsampled pixels, the pixels along the left and right edges will have a red or blue component. Therefore, for these pixels, other gain values ​​may be ignored. For each edge, the starting and ending pixel positions may also be specified. These positions are relative to the starting coordinates of the zone covering the display area 50 for the primary gain map 52 and the starting coordinates of the specified area for the dynamic secondary gain map 54, and may be included in the size of the display area 50 for the primary gain map 52 and the area for the dynamic secondary gain map 54, respectively. Where specified or preset, the edge gain may override the map gain or be applied in conjunction with the map gain. These settings may be preset by programming via registers.

[0075] Edge gains and decompression map gains may be combined. In some embodiments, for any given pixel location, only one of the primary gain map or the dynamic secondary gain map may maintain a gain value that is not equal to 1, except that both maps may contain a gain value of 0. In this way, priorities may be programmed to prioritize gains from the primary gain map 52 or the dynamic secondary gain map 54. For example, the priority may be used when the decompression map gain of any component or its corresponding edge gain is a non-zero gain in the gain map with a selected priority. This ensures that appropriate anti-aliasing is applied when the boundaries of the dynamic display area are close to or overlap the boundaries of the static area (e.g., when the dynamic display area moves close to or extends to reach the outer edge of the electronic display (such as the rounded edge of the electronic display)).

[0076] Fig.13 1 is a flow chart of a process 150 for applying the primary gain map 52 and / or the secondary gain map 54. Specifically, the process 150 is described with respect to Fig.11 Process 150 includes processing circuitry (e.g., image processing circuitry, such as display pipeline 36, processor 12, graphics processing unit (GPU)) receiving (process block 152) image data to be displayed on display 18. For example, the image data may include image pixel image data indicating a target brightness at a pixel location for a frame, such as with respect to Fig.11The processing circuitry may determine (process block 154) dynamic boundaries associated with the image data. That is, the processing circuitry may determine whether the display region 50 is changing and is dynamic relative to the initial frame 55 and / or subsequent frames 55 of the image data. In some cases, the processing circuitry may analyze each of the frames 55 individually and compare each frame 55 to the previous and / or subsequent frames 55 to determine changes in the frames 55, such as by target brightness at pixel locations in consecutive frames 55. Additionally or alternatively, the secondary gain map 54 may be updated based on the image data (e.g., based on whether there is a boundary below or above a threshold value, such as gray level 0 (G0) within the image data), based on metadata associated with the image data, or by directly adjusting the secondary gain map 54 in memory by the image processing circuitry (e.g., GPU, display pipeline). For example, certain animation sequences may have a specific order of secondary gain map 54 gain value sets for a particular display region 50. Updates to the set of gain values ​​of secondary gain map 54 may vary from frame to frame to correspond to changes in the image data being processed for display on display 18 .

[0077] The processing circuitry may apply (processing block 156) a static primary gain map 52 to pixels in a static display area 50 (e.g., static display area 50A). The processing circuitry may apply static gains to rounded boundaries of the display area that remain constant between frames 55. By way of example, such a static display area 50 may include rounded boundary edges of the display 18. The processing circuitry may also apply (processing block 158) a dynamic secondary gain map 54 to the dynamic display area 50. Specifically, and as previously discussed, the processing circuitry may decompress a stored compressed gain map from RAM and then derive a gain at each pixel position for the rounded boundary. The processing circuitry may store different sets of gain values ​​into the secondary gain map 54 for different image frames. In this way, the secondary gain map 54 may apply gains to changing boundaries in the dynamic display area 50. Although Fig.13 The flowchart of exemplifies blocks 156 and 158 as separate operations, but the set of gain values ​​of the primary gain map 52 and the set of gain values ​​of the secondary gain map 54 may be combined in one operation and applied to the image data.

[0078] The processing circuitry may display (process block 160) the image data on the display. By applying appropriate gain values, the processing circuitry may remove or reduce any image artifacts or aliasing along the borders of display area 50 at each frame. In this manner, display 18 may provide a seamless viewing experience using the gain map techniques described herein.

[0079] The technology presented and claimed herein is cited and applied to specific examples of a physical and practical nature that significantly improves the art and is therefore not abstract, intangible, or purely theoretical. In addition, if any claim appended at the end of this specification contains one or more elements designated as "means for [performing] [the function] ..." or "steps for [performing] [the function] ...", it is intended that such elements should be interpreted in accordance with 35 U.S.C. 112(f). However, for any claim containing elements designated in any other manner, it is intended that such elements should not be interpreted in accordance with 35 U.S.C. 112(f).

[0080] It is understood that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of the authorized use should be clearly stated to users.

Claims

1. An electronic device, comprising: a display panel configured to display a plurality of frames of image data having static boundaries that remain the same across the plurality of frames and dynamic boundaries that change between a first frame and a second frame in the plurality of frames of image data; as well as A processing circuit, the processing circuit being configured to: applying a first set of gain values ​​from a static gain map to a first portion of pixels of the first frame associated with the static boundary to reduce or eliminate aliasing image artifacts along the static boundary in the first frame; applying a second set of gain values ​​from the motion gain map to a second portion of pixels of the first frame associated with the motion boundary in the first frame to reduce or eliminate aliasing image artifacts along the motion boundary in the first frame; applying the first set of gain values ​​from the static gain map to a first portion of pixels of the second frame associated with the static boundary to reduce or eliminate aliasing image artifacts along the static boundary in the second frame; as well as A third set of gain values ​​from the dynamic gain map is applied to a third portion of pixels of the second frame associated with the dynamic boundary in the second frame to reduce or eliminate aliasing image artifacts along the dynamic boundary in the second frame. 2 . The electronic device of claim 1 , wherein the static border, the dynamic border, or both comprise rounded-corner borders.

3. An electronic device according to claim 1, wherein the processing circuit is configured to determine a static display area of ​​the display panel including the static border, wherein the static display area remains the same between the first frame and the second frame of the multiple image data frames.

4. The electronic device of claim 1, wherein the processing circuit is configured to determine a dynamic display area of ​​the display panel including the dynamic boundary, wherein the dynamic display area changes between the first frame and the second frame of the plurality of image data frames. 5 . The electronic device of claim 4 , wherein the dynamic display area comprises dynamic characteristics between consecutive frames of the plurality of image data frames.

6. The electronic device of claim 5, wherein the characteristics include a location of the dynamic display area, a location of the dynamic boundary within the dynamic display area, a size of the dynamic display area, the existence of the dynamic display area, or any combination thereof.

7. The electronic device according to claim 4, wherein: The processing circuit is configured to determine a static display area of ​​the display panel including the static boundary; The static display area remains the same between the first frame and the second frame of the plurality of image data frames; The static display area includes a first portion of the display panel; The dynamic display area includes a second portion of the display panel that is larger than the first portion of the display panel.

8. The electronic device of claim 1, wherein the dynamic gain map is equal to or smaller than the static gain map.

9. The electronic device according to claim 1, comprising: a first dedicated memory area storing a compressed version of the static gain map; as well as A second dedicated memory area stores a compressed version of the dynamic gain map.

10. The electronic device of claim 1, wherein the dynamic gain map indicates offset positions of a region of pixels associated with the dynamic gain map.

11. The electronic device of claim 1, wherein the dynamic gain map indicates a size of a region of pixels associated with the dynamic gain map.

12. An electronic device according to claim 11, wherein the processing circuit is configured to determine a dynamic display area of ​​the display panel including the dynamic boundary, wherein the dynamic display area changes between the first frame and the second frame of the multiple image data frames, and wherein the size of the area includes pixels completely set within the dynamic display area.

13. The electronic device of claim 1, wherein the values ​​in the gain value sets of the static gain map and the dynamic gain map are unity along rectangular edges of the static boundary and the dynamic boundary.

14. A method comprising: receiving a plurality of image data frames to be displayed on a display panel; determining a dynamic display region including a dynamic boundary that changes between a first frame and a second frame of the plurality of image data frames; determining a gain for pixels of the display panel associated with the dynamic boundary based at least in part on a dynamic gain map providing different gains between the plurality of frames within the dynamic display region; applying the gain from the dynamic gain map to the pixel to reduce or eliminate aliasing image artifacts along the dynamic boundary; as well as The plurality of image data frames are displayed on the display panel.

15. The method of claim 14, wherein the dynamic display area is determined to change in position, size, presence, or any combination thereof between one or more frames.

16. The method according to claim 14, comprising: determining a second dynamic display region separate from the dynamic display region, wherein the second dynamic display region includes a second dynamic boundary that changes between the first frame and the second frame of the plurality of image data frames; determining a gain for pixels of the display panel associated with the second dynamic boundary based at least in part on the dynamic gain map, wherein the dynamic gain map also provides different gains between the plurality of frames within the second dynamic display region; and The gain from the self-dynamic gain is applied to the pixel to reduce or eliminate aliasing image artifacts along the second dynamic boundary.

17. The method according to claim 15, comprising: determining a static display area including a static boundary that does not change between the first frame and the second frame in the plurality of image data frames; determining a gain for pixels of the display panel associated with the static boundary based at least in part on a static gain map that provides a same gain between the first frame and the second frame of the plurality of frames of image data; as well as The gains from the static gain map are applied to the pixels to reduce or eliminate aliasing image artifacts along the static boundaries.

18. A method according to claim 17, wherein the dynamic gain map, the static gain map, or both are compressed and stored in compressed form in one or more memories, and wherein the method includes decompressing the dynamic gain map, the static gain map, or both to obtain the gain for pixels associated with the dynamic boundary or the gain for pixels associated with the static boundary, or both.

19. An image processing circuit, configured to: receiving a plurality of image data frames to be displayed on a display panel; decompressing a dynamic gain map corresponding to a dynamic display region of the display panel, the dynamic display region comprising a dynamic boundary that changes between a first frame and a second frame of the plurality of image data frames; determining gains for pixels of the display panel based at least in part on the dynamic gain map, wherein the dynamic gain map provides different gains between the first frame and the second frame of the plurality of frames of image data; applying the gain from the dynamic gain map to the pixel to reduce or eliminate aliasing image artifacts along the dynamic boundary; as well as The plurality of frames of image data are displayed.

20. The image processing circuit according to claim 19, wherein the image processing circuit is configured to: decompressing a static gain map corresponding to a static display region of the display panel, the static display region including a static boundary that does not change between the first frame and the second frame of the plurality of image data frames, wherein the dynamic gain map and the static gain map are stored in different memories in a compressed format; determining a gain for the pixels of the static display area of ​​the display panel based at least in part on the static gain map, the static gain map providing a same gain between the first frame and the second frame of the plurality of frames of image data; applying the gain from the static gain map to the pixel to reduce or eliminate aliased image artifacts along the static boundary; as well as The one or more frames of image data are displayed.

21. An electronic device comprising: an electronic display configured to display image data; a first memory configured to store a first gain map, the first gain map configured to be applied to a static boundary of the image data; a second memory configured to store a second gain map, the second gain map configured to be applied to a dynamic boundary of the image data; as well as Image processing circuitry is configured to apply the first gain map to the static boundaries of the image data and to apply the second gain map to the dynamic boundaries of the image data.

22. The electronic device of claim 21, wherein the static boundary corresponds to a physical boundary of the electronic display.

23. The electronic device of claim 22, wherein the dynamic boundary corresponds to a user interface element within the static boundary.

24. The electronic device of claim 22, wherein the dynamic border corresponds to a user interface element that changes from one frame to another.

25. A method comprising: receiving image data of a first frame having a region with a border, the border having at least one non-straight edge; applying a set of gain values ​​from a gain map to a first pixel of the image data along the boundary to provide anti-aliasing along the boundary; receiving image data of a second frame having the region with the border, wherein the border has changed position between the first frame and the second frame; as well as A new set of gain values ​​from the gain map is applied to a second pixel of the image data along the boundary to provide anti-aliasing along the boundary.

26. The method of claim 25, comprising updating the gain map to include the new set of gain values ​​based on image data of the second frame.

Images