Controller and display device including the same

Abstract

A controller and a display device including the controller. A display device is disclosed, the display device including: a display panel having a plurality of pixels, the display panel including a first display area and a second display area, the second display area being arranged to overlap with an optical module; and a controller configured to generate display area information of each of the plurality of pixels and boundary information of pixels arranged in a boundary area located within a predetermined range from a boundary between the first display area and the second display area, change an image displayed in at least one of the first display area and the second display area based on the display area information and the boundary information when determining that the optical module is operated, and perform control so that the changed image is displayed on the display panel.

Description

Technical Field

[0001] The present disclosure relates to a controller and a display device including the controller. Background Art

[0002] An electronic module such as a camera module or a sensor module may be placed or installed in the display device. In the case where an electronic module such as a camera module or a sensor module is placed or installed in the display device, a camera hole may be formed in the display device, and the camera module may be disposed in the camera hole.

[0003] The camera hole may be provided in a display area of ​​the display device in which an image is displayed. In this case, the image is not displayed in the area formed with the camera hole, so that the image displayed on the display device is interrupted, which can be recognized by the user.

[0004] In addition, the camera hole may be provided in a bezel area of ​​the display device, in which case the bezel area is increased. Summary of the invention

[0005] Accordingly, the present disclosure is directed to a controller capable of preventing problems due to limitations and disadvantages of the related art described above and a display device including the same.

[0006] An object of the present disclosure is to provide a controller capable of performing control so that an image is displayed even in a region set to overlap with a camera, and a display device including the controller.

[0007] Another object of the present disclosure is to provide a controller capable of efficiently controlling information on pixels provided in a region provided to overlap a camera and a display device including the same.

[0008] Another object of the present disclosure is to provide a controller capable of controlling an image displayed in a region disposed to overlap a camera and a display device including the same.

[0009] Another object of the present disclosure is to provide a controller capable of preventing interference from occurring due to light generated from a display panel when a camera is operated, and a display device including the same.

[0010] According to one aspect of the present invention, the above purpose and other purposes can be achieved by a display device, which includes: a display panel having a plurality of pixels, the display panel including a first display area and a second display area, the second display area being arranged to overlap with an optical module; and a controller, the controller being configured to generate display area information for each of the plurality of pixels and boundary information for pixels arranged in a boundary area within a predetermined range from a boundary between the first display area and the second display area, change an image displayed in at least one of the first display area and the second display area based on the display area information and the boundary information when determining that the optical module is operated, and perform control so that the changed image is displayed on the display panel.

[0011] According to another aspect of the present disclosure, a controller is provided, which includes: a display area information generating unit, which is configured to generate display area information of each of a plurality of pixels based on shape information of a second display area, wherein the resolution of the second display area is lower than that of the first display area; a boundary information generating unit, which is configured to generate boundary information of pixels arranged in a boundary area within a predetermined range from a boundary between the first display area and the second display area based on the shape information of the second display area; an optical operation determining unit, which is configured to determine whether an optical module is operated; an image processing unit, which is configured to change an image displayed in at least one of the first display area and the second display area based on the display area information and the boundary information when determining that the optical module is operated; and a control unit, which is configured to perform control so that the changed image is displayed on the display panel. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other objects, features and other advantages of the present disclosure will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0013] Figure 1 is a view schematically showing a configuration of a display device according to an embodiment of the present disclosure;

[0014] Figure 2 It is schematically shown Figure 1 A plan view of a display panel;

[0015] Figure 3 It shows the settings in Figure 2 an enlarged view of pixels in area A;

[0016] Figure 4is a view showing the configuration of a memory and a controller;

[0017] Figure 5A is a view illustrating a start point and a vertical length and direction information of a second display area when the second display area has a U-shape;

[0018] Figure 5B is a view illustrating a start point and a vertical length and direction information of a second display area when the second display area has a circular shape;

[0019] Figure 6 is a view illustrating left boundary information and right boundary information;

[0020] Figure 7 is a view showing an example of a second display area having a U-shape;

[0021] Figure 8 It shows Figure 7 A view showing an example of shape information of a second display area shown in FIG.

[0022] Fig. 9 is a view illustrating boundary pixels;

[0023] Fig.10 is a view showing an example of display area information of each of a plurality of sub-pixels;

[0024] Fig.11 is a view showing an example of a boundary area and boundary information of each of a plurality of pixels;

[0025] Fig.12 is a diagram showing an example of a kernel;

[0026] Fig.13 It shows Figure 4 A view of an example of a configuration of an image processing unit;

[0027] Fig.14 is a view showing an example of a plurality of first boundary regions and a plurality of second boundary regions;

[0028] Fig.15 is a view showing an example of changing an image by an image processing unit;

[0029] Fig.16 is a view showing another example of a plurality of first boundary regions and a plurality of second boundary regions; and

[0030] Fig.17 is a view showing another example of changing an image by an image processing unit. DETAILED DESCRIPTION

[0031] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0032] Figure 1 is a view schematically showing a configuration of a display device 100 according to an embodiment of the present disclosure, Figure 2 It is schematically shown Figure 1 A plan view of the display panel, and Figure 3 It shows the settings in Figure 2 A magnified view of pixels in area A.

[0033] Reference Figures 1 to 3 , the display device 100 according to an embodiment of the present disclosure includes a display panel 110 , an optical module 120 , a panel driving unit 130 , an optical driving unit 140 , a controller 150 , and a memory 160 .

[0034] The display panel 110 includes a plurality of pixels and displays a color image. The display panel 110 may be implemented using an organic light emitting display panel, a liquid crystal display panel, a plasma display panel, a quantum dot light emitting display panel, or an electrophoretic display panel.

[0035] The display panel 110 may be divided into a display area DA where pixels are formed to display an image and a non-display area NDA where no image is displayed.

[0036] The non-display area NDA may be provided to surround the display area DA. A panel driving unit 130 supplying various kinds of signals to a plurality of signal lines in the display area DA and a link unit (not shown) configured to connect the panel driving unit 130 and the plurality of signal lines to each other may be formed in the non-display area NDA.

[0037] In the display area DA, a plurality of pixels are arranged to display an image. Figure 2 As shown in FIG, the display area DA includes a first display area DA1 and a second display area DA2.

[0038] The first display area DA1 is an area that does not overlap with the area CA in which the optical module 120 is disposed, and displays an image regardless of the operation of the optical module 120. The first display area DA1 may be formed to have a large size.

[0039] A plurality of first pixels P1, each of which includes at least two first sub-pixels SP1, may be disposed in the first display area DA1. Each of the plurality of first pixels P1 may include a light-emitting pixel. Specifically, each of the at least two first sub-pixels SP1 included in each first pixel P1 may be a light-emitting sub-pixel including a light-emitting device that emits light of a predetermined color. Each first pixel P1 may include at least two of a red sub-pixel configured to emit red light, a green sub-pixel configured to emit green light, and a blue sub-pixel configured to emit blue light. As an example, one of the first pixels P1 may include a red sub-pixel and a green sub-pixel, and an adjacent one of the first pixels P1 may include a blue sub-pixel and a green sub-pixel. As another example, each first pixel P1 may include a red sub-pixel, a green sub-pixel, and a blue sub-pixel.

[0040] The second display area DA2 overlaps with the area CA in which the optical module 120 is disposed, and an image to be displayed in the second display area DA2 may be determined according to whether the optical module 120 is operated. Specifically, when the optical module 120 is not operated, the second display area DA2 may display an image together with the first display area DA1. On the other hand, when the optical module 120 is operated, the second display area DA2 may not display an image or may display a black image. At this time, an image may be displayed in the first display area DA1.

[0041] The size, position, and shape of the second display area DA2 may be determined in consideration of the optical module 120. The second display area DA2 may be disposed at a position corresponding to the optical module 120. In addition, the second display area DA2 may be disposed to have a size including the area CA in which the optical module 120 is disposed.

[0042] A plurality of second pixels P2, each including at least two second sub-pixels SP2, may be disposed in the second display area DA2. In the second display area DA2, unlike the first display area DA1, the plurality of second pixels P2 may include light-emitting pixels and non-light-emitting pixels. Each light-emitting pixel may be a region including a light-emitting device for emitting light, and each non-light-emitting pixel may be a region that does not include a light-emitting device and transmits external light. That is, unlike the first display area DA1, a region that does not include a light-emitting device and transmits external light may be disposed in the second display area DA2.

[0043] Each of the at least two second sub-pixels SP2 included in each luminescent pixel among the second pixel P2 may be a luminescent sub-pixel including a light-emitting device that emits light of a predetermined color. Each luminescent pixel among the second pixel P2 may include at least two of a red sub-pixel configured to emit red light, a green sub-pixel configured to emit green light, and a blue sub-pixel configured to emit blue light. As an example, one of the luminescent pixels among the second pixel P2 may include a red sub-pixel and a green sub-pixel, and an adjacent one of the luminescent pixels among the second pixel P2 may include a blue sub-pixel and a green sub-pixel. As another example, each luminescent pixel among the second pixel P2 may include a red sub-pixel, a green sub-pixel, and a blue sub-pixel.

[0044] Each of the at least two second sub-pixels SP2 included in each non-light emitting pixel among the second pixels P2 may be a non-light emitting sub-pixel that includes a non-light emitting device and transmits external light.

[0045] As a result, the number of light-emitting sub-pixels disposed in the unit pixel area UPA of the second display area DA2 may be smaller than the number of light-emitting sub-pixels disposed in the unit pixel area UPA of the first display area DA1. Figure 3 As shown in , 4 light emitting sub-pixels may be disposed in the unit pixel area UPA of the second display area DA2 , and 16 light emitting sub-pixels may be disposed in the unit pixel area UPA of the first display area DA1 .

[0046] The transmittance of the second display area DA2 may be changed according to the number of light-emitting sub-pixels arranged in its unit pixel area UPA. In the case where the number of light-emitting sub-pixels arranged in the unit pixel area UPA increases, the brightness and resolution of the second display area DA2 may increase, while the transmittance of the second display area DA2 may decrease. On the other hand, in the case where the number of light-emitting sub-pixels arranged in the unit pixel area UPA decreases, the brightness and resolution of the second display area DA2 may decrease, while the transmittance of the second display area DA2 may increase. In the display panel 110 according to an embodiment of the present disclosure, the number of light-emitting sub-pixels may be determined in consideration of the brightness, resolution, and transmittance of the second display area DA2.

[0047] The transmittance and resolution of the first display area DA1 and the second display area DA2 described above may be different from each other. The first display area DA1 may have a first transmittance, and the second display area DA2 may have a second transmittance higher than the first transmittance. In addition, the first display area DA1 may have a first resolution, and the second display area DA2 may have a second resolution lower than the first resolution.

[0048] The optical module 120 may be disposed at the rear surface of the display panel 110. The optical module 120 may be disposed to overlap with the display area DA (especially the second display area DA2) of the display panel 110. The optical module 120 may include all components configured to use external light input through the display panel 110. For example, the optical module 120 may be a camera. However, the present disclosure is not limited thereto. The optical module 120 may be an ambient light sensor or a fingerprint sensor.

[0049] The panel driving unit 130 controls driving of the display panel 110 based on a control signal received from the controller 150. To this end, the panel driving unit 130 includes a gate driving unit and a data driving unit.

[0050] The gate driving unit generates a gate signal for driving a gate line of the display panel 110 in response to a gate control signal received from the controller 150. The gate driving unit supplies the generated gate signal to subpixels SP1 and SP2 of pixels P1 and P2 included in the display panel 110 via the gate line.

[0051] The data driving unit receives a data control signal and an image data signal from the controller 150. The data driving unit converts the digital image data signal into an analog image data signal in response to the data control signal received from the controller 150. The data driving unit supplies the converted image data signal to the sub-pixels SP1 and SP2 of the pixels P1 and P2 included in the display panel 110 via the data lines.

[0052] The optical driving unit 140 controls driving of the optical module 120 based on a control signal received from the controller 150 .

[0053] The memory 160 stores shape information of the second display area DA2. The shape information of the second display area DA2 includes position information indicating a start point of a boundary of the second display area, vertical length information of the second display area, and line-based direction information and width information.

[0054] The controller 150 uses the shape information of the second display area DA2 stored in the memory 160 to change the image displayed in at least one of the first display area DA1 and the second display area DA2 of the display panel 110. Specifically, the controller 150 may generate display area information and boundary information of each of a plurality of pixels using the shape information of the second display area DA2. The controller 150 may change the image displayed on the display panel 110 using at least one of the display area information and the boundary information of each of the plurality of pixels, and may perform control so that the corrected image is displayed on the display panel 110.

[0055] In the following, reference will be made to Figures 4 to 12 The shape information of the second display area DA2 stored in the memory 160 and the information generated by the controller 150 are described in more detail.

[0056] Figure 4 is a view showing the configuration of a memory and a controller. Figure 5A is a view illustrating a start point and a vertical length and direction information of a second display area when the second display area has a U-shape, Figure 5B is a view illustrating a start point and a vertical length and direction information of a second display area when the second display area has a circular shape, and Figure 6 is a view illustrating left boundary information and right boundary information. Figure 7 is a view showing an example of a second display area having a U-shape, and Figure 8 It shows Figure 7 FIG. 4 is a view showing an example of shape information of the second display area. Fig. 9 is a view illustrating an edge region, and Fig.10 is a view showing an example of display area information of each of a plurality of sub-pixels. Fig.11 is a view showing an example of a boundary area and boundary information of each of a plurality of pixels, and Fig.12 is a view showing an example of a kernel.

[0057] Reference Figures 4 to 12 The memory 160 stores the shape information of the second display area DA2. The controller 150 changes an image displayed in at least one of the first display area DA1 and the second display area DA2 of the display panel 110 using the shape information of the second display area DA2 stored in the memory 160.

[0058] The shape information of the second display area DA2 may include position information of the starting point, vertical length information of the second display area DA2, left boundary information related to the left boundary located on the left side of the center axis C based on the second display area DA2, and right boundary information related to the right boundary located on the right side of the center axis C based on the second display area DA2.

[0059] The position information of the starting point may include an X-axis coordinate value and a Y-axis coordinate value at a specific point of the boundary of the second display area DA2. According to the shape of the second display area DA2, one or more starting points may be included.

[0060] As an example, Figure 5AAs shown in , the second display area DA2 may have a U-shape. In the case where the second display area DA2 has a U-shape, a plurality of starting points may be set. The starting points may include a first starting point S1 located on the left side of the central axis C and a second starting point S2 located on the right side of the central axis C.

[0061] The position information of the first starting point S1 may include an X-axis value notch_s1x of the first starting point S1 and a Y-axis value notch_sy of the first starting point S1. The position information of the second starting point S2 may include an X-axis value notch_s2x of the second starting point S2 and a Y-axis value notch_sy of the second starting point S2. The Y-axis value of the first starting point S1 and the Y-axis value of the second starting point S2 may be the same as each other, and the X-axis value of the first starting point S1 and the X-axis value of the second starting point S2 may be different from each other. However, the present disclosure is not limited thereto. Both the Y-axis value and the X-axis value of the first starting point S1 and the second starting point S2 may be different from each other.

[0062] As another example, Figure 5B As shown in , the second display area DA2 may have a circular shape. In the case where the second display area DA2 has a circular shape, a single starting point may be set. The starting point may include a third starting point S3 located at the center axis C. The position information of the third starting point S3 may include an X-axis value circle_sx of the third starting point S3 and a Y-axis value circle_sy of the third starting point S3.

[0063] The vertical length information of the second display area DA2 may include the vertical length of the shape of the second display area DA2. The vertical length of the shape of the second display area DA2 may correspond to the difference between the minimum Y-axis value and the maximum Y-axis value among the coordinate values ​​of the plurality of points constituting the boundary of the second display area DA2. At this time, the Y-axis value of the starting point may be the minimum Y-axis value or the maximum Y-axis value.

[0064] As an example, in Figure 5A In the case where the second display area DA2 has a U-shape as shown in , the vertical length information of the second display area DA2 may include a maximum value notch_hei among vertical lengths between a plurality of points constituting the boundary of the second display area DA2 and the first starting point S1.

[0065] As another example, in Figure 5B In the case where the second display area DA2 has a circular shape as shown in , the vertical length information of the second display area DA2 may include a maximum value circle_hei among vertical lengths between a plurality of points constituting the boundary of the second display area DA2 and the third starting point S3.

[0066] The left boundary information, which is information about the left boundary located on the left side based on the central axis C of the second display area DA2, includes direction information and width information of each of a plurality of lines set within a vertical length from a starting point.

[0067] The left boundary information may include the direction information and width information of each of the first line to the nth line at the starting point. At this time, n may correspond to the vertical length of the second display area DA2. For example, the vertical length of the second display area DA2 may be 20, in which case the left boundary information may include the direction information and width information of each of the first line to the 20th line at the starting point.

[0068] The direction information included in the left boundary information may indicate a direction in which the left boundary located on the left side based on the central axis C of the second display area DA2 moves from the first line to the n-th line.

[0069] Specifically, in the case where the distance between the central axis C and the left boundary set at the previous line is equal to or less than the distance between the central axis C and the left boundary set at the relevant line, the direction information included in the left boundary information may have a first direction value. That is, in the case where the left boundary is parallel to the central axis C or becomes away from the central axis C, the direction information included in the left boundary information may have a first direction value.

[0070] For example, in Figure 5A In the case where the left boundary is parallel to the central axis C as shown in , the direction information included in the left boundary information may have a first direction value of 0. Alternatively, in the case where Figure 5B In the case where the left boundary shown in becomes distant from the central axis C, the direction information included in the left boundary information may have a first direction value of 0.

[0071] In the case where the distance between the central axis C and the left boundary set at the previous line is greater than the distance between the central axis C and the left boundary set at the relevant line, the direction information included in the left boundary information may have a second direction value. That is, in the case where the left boundary becomes close to the central axis C, the direction information included in the left boundary information may have a second direction value.

[0072] For example, in Figure 5A and Figure 5B In the case where the left boundary shown in becomes close to the central axis C, the direction information included in the left boundary information may have a second direction value of 1.

[0073] The width information included in the left boundary information may include the width of the left boundary at each of the first line to the nth line. At this time, the width may correspond to the number of pixels or sub-pixels set in the relevant line. The width of the left boundary at each of the first line to the nth line may be sequentially stored as the width information included in the left boundary information.

[0074] The right boundary information, which is information about the right boundary located on the right side based on the central axis C of the second display area DA2, includes direction information and width information of each of a plurality of lines set within a vertical length from a starting point.

[0075] The right boundary information may include direction information and width information of each of the first to n-th lines where the starting point is located. At this time, n may correspond to the vertical length of the second display area DA2.

[0076] The direction information included in the right boundary information may indicate a direction in which the right boundary located on the right side based on the central axis C of the second display area DA2 moves from the first line to the n-th line.

[0077] Specifically, in the case where the distance between the central axis C and the right boundary set at the previous line is equal to or less than the distance between the central axis C and the right boundary set at the relevant line, the direction information included in the right boundary information may have a first direction value. That is, in the case where the right boundary is parallel to the central axis C or becomes away from the central axis C, the direction information included in the right boundary information may have a first direction value.

[0078] For example, in Figure 5A In the case where the right boundary shown in FIG. 1 is parallel to the central axis C, the direction information included in the right boundary information may have a first direction value of 0. Alternatively, in the case where Figure 5B In the case where the right boundary shown in becomes away from the central axis C, the direction information included in the right boundary information may have a first direction value of 0.

[0079] In the case where the distance between the central axis C and the right boundary set at the previous line is greater than the distance between the central axis C and the right boundary set at the relevant line, the direction information included in the right boundary information may have a second direction value. That is, in the case where the right boundary becomes close to the central axis C, the direction information included in the right boundary information may have a second direction value.

[0080] For example, in Figure 5A and Figure 5B In the case where the right boundary shown in becomes close to the central axis C, the direction information included in the right boundary information may have a second direction value of 1.

[0081] The width information included in the right boundary information may include the width of the right boundary at each of the first line to the nth line. At this time, the width may correspond to the number of pixels or sub-pixels set in the relevant line. The width of the right boundary at each of the first line to the nth line may be sequentially stored as the width information included in the right boundary information.

[0082] Figure 5A and Figure 5B It is illustrated that the first direction value is 0 and the second direction value is 1. However, the present disclosure is not limited thereto. In another embodiment, the first direction value may be 1 and the second direction value may be 0.

[0083] The left and right boundary information can be Figure 6 While the structure shown in is stored in the memory 160, for example, the left boundary information and the right boundary information of each of the six lines can be stored as 8 bytes.

[0084] The direction information of each of the three consecutive lines can be stored as 1 byte. For example, in 1 byte among 8 bytes, the direction information line1 ld of the left boundary at the first line, the direction information line1 rd of the right boundary at the first line, the direction information line2 ld of the left boundary at the second line, the direction information line2 rd of the right boundary at the second line, the direction information line3 ld of the left boundary at the third line, and the direction information line3 rd of the right boundary at the third line can each be stored in sequence as 1 bit.

[0085] The width information of each of the three consecutive lines can be stored in 3 bytes. For example, in 3 bytes among the 8 bytes, the width information of the left border at the first line, the width information of the right border at the first line, the width information of the left border at the second line, the width information of the right border at the second line, the width information of the left border at the third line, and the width information of the right border at the third line can each be stored in 4 bits in sequence.

[0086] The direction information of each of the three lines after the previously stored line can be stored by 1 byte. For example, in 1 byte among 8 bytes, the direction information line4 1d of the left boundary at the fourth line, the direction information line4 rd of the right boundary at the fourth line, the direction information line5 1d of the left boundary at the fifth line, the direction information line5 rd of the right boundary at the fifth line, the direction information line6 1d of the left boundary at the sixth line, and the direction information line6 rd of the right boundary at the sixth line can each be stored by 1 bit.

[0087] The width information of each of the three lines after the previously stored line may be stored in 3 bytes. For example, in 3 bytes among the 8 bytes, the width information of the left border at the fourth line, the width information of the right border at the fourth line, the width information of the left border at the fifth line, the width information of the right border at the fifth line, the width information of the left border at the sixth line, and the width information of the right border at the sixth line may each be stored in 4 bits.

[0088] In the following, reference will be made to Figure 7 and Figure 8 Specific examples of the left boundary information and the right boundary information are described.

[0089] The second display area DA2 may have a U-shape, such as Figure 7 In this case, the starting point may include a first starting point S1 located on the left side of the central axis C and a second starting point S2 located on the right side of the central axis C.

[0090] Figure 7 The shape information of the second display area DA2 shown in FIG. 4 may include direction information and width information of each of the first to n-th lines where the starting points S1 and S2 are located.

[0091] Since the left boundary at the first line line1 where the starting points S1 and S2 are located becomes close to the center axis C, the direction information of the left boundary at the first line line1 may have a second direction value, for example, 1. In addition, since the right boundary at the first line line1 becomes close to the center axis C, the direction information of the right boundary at the first line line1 may have a second direction value, for example, 1.

[0092] The width information of the left border at the first line line1 may indicate a horizontal distance between a leftmost border pixel of the first line line1 and a leftmost border pixel of a second line line2 located next to the first line line1. Since the horizontal distance between the leftmost border pixel of the first line line1 and the leftmost border pixel of the second line line2 corresponds to six pixels, the width information of the left border at the first line line1 may be 6.

[0093] The width information of the right boundary at the first line line1 may indicate a horizontal distance between the rightmost boundary pixel of the first line line1 and the rightmost boundary pixel of the second line line2 located next to the first line line1. Since the horizontal distance between the rightmost boundary pixel of the first line line1 and the rightmost boundary pixel of the second line line2 corresponds to five pixels, the width information of the right boundary at the first line line1 may be 5.

[0094] Based on the width information and direction information of the first line line1, it can be seen that the leftmost boundary pixel of the second line line2 is set at a position of the second line line2 that is six pixels shifted from the leftmost boundary pixel of the first line line1 toward the center axis C. In addition, it can be seen that the rightmost boundary pixel of the second line line2 is set at a position of the second line line2 that is five pixels shifted from the rightmost boundary pixel of the first line line1 toward the center axis C.

[0095] Since the left boundary at the second line line2 becomes close to the center axis C, the direction information of the left boundary at the second line line2 may have a second direction value of, for example, 1. In addition, since the right boundary at the second line line2 becomes close to the center axis C, the direction information of the right boundary at the second line line2 may have a second direction value of, for example, 1.

[0096] The width information of the left border at the second line line2 may indicate a horizontal distance between the leftmost border pixel of the second line line2 and the leftmost border pixel of the third line line3 located next to the second line line2. Since the horizontal distance between the leftmost border pixel of the second line line2 and the leftmost border pixel of the third line line3 corresponds to four pixels, the width information of the left border at the second line line2 may be 4.

[0097] The width information of the right boundary at the second line line2 may indicate a horizontal distance between the rightmost boundary pixel of the second line line2 and the rightmost boundary pixel of the third line line3 located next to the second line line2. Since the horizontal distance between the rightmost boundary pixel of the second line line2 and the rightmost boundary pixel of the third line line3 corresponds to three pixels, the width information of the right boundary at the second line line2 may be 3.

[0098] Based on the width information and direction information of the second line line2, it can be seen that the leftmost boundary pixel of the third line line3 is set at a position of the third line line3 that is moved four pixels from the leftmost boundary pixel of the second line line2 toward the center axis C. In addition, it can be seen that the rightmost boundary pixel of the third line line3 is set at a position of the third line line3 that is moved three pixels from the rightmost boundary pixel of the second line line2 toward the center axis C.

[0099] The direction information and width information of each of the third line line3 to the sixth line line6 may be set in the same manner as the direction information and width information described above. In an embodiment, when the distance between the boundary at the relevant line and the central axis C is equal to the distance between the boundary at the next line and the central axis C, the width information may be set to 0. For example, Figure 7 As shown in , the distance between the leftmost boundary pixel of the sixth line line6 and the central axis C may be equal to the distance between the leftmost boundary pixel of the seventh line line7 and the central axis C. In this case, since the horizontal distance between the leftmost boundary pixel of the seventh line line7 and the leftmost boundary pixel of the sixth line line6 is 0, the width information of the left boundary at the sixth line line6 may be set to 0.

[0100] The display device 100 according to the embodiment of the present disclosure may sequentially store the direction information and width information of each of the first to n-th lines in the order of lines in the memory 160. Since the direction information and width information of each of the first to n-th lines are sequentially stored in the order of lines, the display device 100 according to the embodiment of the present disclosure can easily acquire the boundary of the second display area based on only the position information and vertical length information of the starting point of the second display area and the direction information and width information of the lines.

[0101] Therefore, the display device 100 according to the embodiment of the present disclosure can minimize the amount of information stored in the memory 160, thereby using a small-capacity memory 160. In addition, the display device 100 according to the embodiment of the present disclosure can obtain the boundary of the second display area DA2 through simple calculation, thereby reducing the amount of calculation in the process of independently controlling the first display area DA1 and the second display area DA2.

[0102] In addition, in the display device 100 according to the embodiment of the present disclosure, it is sufficient to change only the shape information of the second display area DA2 stored in the memory 160, whereby the shape of the second display area DA2 can be easily changed.

[0103] Return to reference Figure 4 , the controller 150 generates display area information and boundary information using the shape information of the second display area DA2 stored in the memory 160. The controller 150 may correct an image displayed in at least one of the first display area DA1 and the second display area DA2 of the display panel 110 using the display area information and the boundary information, and may perform control so that the corrected image is displayed on the display panel 110.

[0104] To this end, the controller 150 may include a line counting unit 310 , a boundary pixel extraction unit 330 , a display area information generation unit 340 , a boundary information generation unit 350 , an image processing unit 360 , and a control unit 370 .

[0105] The line counting unit 310 may count line values ​​from the first line of the display panel 110 in which the plurality of pixels P are arranged one by one, and may provide the counted line values ​​to the boundary pixel extraction unit 330. The line counting unit 310 may determine whether the counted line values ​​correspond to the first line where the starting point is located using the position information of the starting point stored in the memory 160. When the line counting unit 310 determines that the counted line values ​​correspond to the first line where the starting point is located, the boundary pixel extraction unit 330 may retrieve the shape information of the second display area DA2 from the memory 160.

[0106] The boundary pixel extraction unit 330 may extract the leftmost boundary pixel and the rightmost boundary pixel from the relevant line using the position information of the starting point, the line-based direction information, and the width information stored in the memory 160. Here, the relevant line may be a line corresponding to the line value provided by the line counting unit 310. The leftmost boundary pixel may be a pixel disposed at the leftmost side of the relevant line among the second pixels P2 disposed in the second display area DA2. The rightmost boundary pixel may be a pixel disposed at the rightmost side of the relevant line among the second pixels P2 disposed in the second display area DA2.

[0107] The boundary pixel extraction unit 330 may extract the leftmost boundary pixel and the rightmost boundary pixel of each of the first line to the nth line where the starting point is located in the order of lines. The boundary pixel extraction unit 330 may extract the leftmost boundary pixel and the rightmost boundary pixel of the relevant line using the leftmost boundary pixel and the rightmost boundary pixel of the previous line, the direction information of the previous line, and the width information of the previous line.

[0108] Specifically, the line value corresponding to the first line where the starting point is located from the line counting unit 310 may be input to the boundary pixel extraction unit 330. Fig. 9 As shown in FIG. 1 , the boundary pixel extraction unit 330 may extract the leftmost boundary pixel BP1 and the rightmost boundary pixel BP2 of the first line using the position information of the starting point.

[0109] At this time, in the case where the second display area DA2 has a U-shape, the pixel disposed at a position corresponding to the first starting point S1 may be the leftmost boundary pixel BP1, and the pixel disposed at a position corresponding to the second starting point S2 may be the rightmost boundary pixel BP2. In addition, in the case where the second display area DA2 has a circular shape, Fig. 9Unlike what is shown in FIG. 1 , the pixels disposed at the position corresponding to the starting point may be the leftmost boundary pixel BP1 and the rightmost boundary pixel BP2.

[0110] The line value corresponding to the second line disposed next to the first line from the line counting unit 310 may be input to the boundary pixel extraction unit 330. The boundary pixel extraction unit 330 may extract the leftmost boundary pixel BP3 and the rightmost boundary pixel BP4 of the second line using the leftmost boundary pixel BP1 and the rightmost boundary pixel BP2 of the first line, the direction information of the first line, and the width information of the first line.

[0111] In the case where the direction information of the left boundary of the first line has the first direction value, the leftmost boundary pixel BP3 of the second line may be a pixel disposed at a position of the second line moved from the leftmost boundary pixel BP1 of the first line in a direction opposite to the central axis C by a number corresponding to the width information of the left boundary of the first line. The Y-axis value of the leftmost boundary pixel BP3 of the second line may have a value higher by 1 than the Y-axis value of the leftmost boundary pixel BP1 of the first line, and the X-axis value of the leftmost boundary pixel BP3 of the second line may have a value obtained by subtracting a value corresponding to the width information of the left boundary of the first line from the X-axis value of the leftmost boundary pixel BP1 of the first line.

[0112] In the case where the direction information of the left boundary of the first line has the second direction value, the leftmost boundary pixel BP3 of the second line may be a pixel disposed at a position of the second line moved from the leftmost boundary pixel BP1 of the first line toward the central axis C by a number corresponding to the width information of the left boundary of the first line. The Y-axis value of the leftmost boundary pixel BP3 of the second line may have a value higher by 1 than the Y-axis value of the leftmost boundary pixel BP1 of the first line, and the X-axis value of the leftmost boundary pixel BP3 of the second line may have a value obtained by adding a value corresponding to the width information of the left boundary of the first line to the X-axis value of the leftmost boundary pixel BP1 of the first line.

[0113] In addition, in the case where the direction information of the right boundary of the first line has the first direction value, the rightmost boundary pixel BP4 of the second line may be a pixel disposed at a position of the second line moved from the rightmost boundary pixel BP2 of the first line in the direction opposite to the central axis C by the number corresponding to the width information of the right boundary of the first line. The Y-axis value of the rightmost boundary pixel BP4 of the second line may have a value higher by 1 than the Y-axis value of the rightmost boundary pixel BP2 of the first line, and the X-axis value of the rightmost boundary pixel BP4 of the second line may have a value obtained by adding the value corresponding to the width information of the right boundary of the first line to the X-axis value of the rightmost boundary pixel BP2 of the first line. In the case where the direction information of the right boundary of the first line has the second direction value, the rightmost boundary pixel BP4 of the second line may be a pixel disposed at a position of the second line moved from the rightmost boundary pixel BP2 of the first line toward the central axis C by the number corresponding to the width information of the right boundary of the first line. The Y-axis value of the rightmost boundary pixel BP4 of the second line may have a value that is 1 higher than the Y-axis value of the rightmost boundary pixel BP2 of the first line, and the X-axis value of the rightmost boundary pixel BP4 of the second line may have a value obtained by subtracting a value corresponding to the width information of the right boundary of the first line from the X-axis value of the rightmost boundary pixel BP2 of the first line.

[0114] As described above, the boundary pixel extraction unit 330 may extract the leftmost boundary pixel and the rightmost boundary pixel of each of the first to nth lines.

[0115] The display area information generating unit 340 may generate display area information of each of the plurality of pixels P using the leftmost boundary pixel and the rightmost boundary pixel of each line.

[0116] The display area information generation unit 340 may decide the leftmost boundary pixel, the rightmost boundary pixel, and the pixel disposed between the leftmost boundary pixel and the rightmost boundary pixel among the pixels disposed in the relevant line as the second pixel P2 disposed in the second display area DA2. The display area information generation unit 340 may decide the pixels other than the leftmost boundary pixel, the rightmost boundary pixel, and the pixel disposed between the leftmost boundary pixel and the rightmost boundary pixel among the pixels disposed in the relevant line as the first pixel P1 disposed in the first display area DA1.

[0117] The display area information generating unit 340 may set the display area information of each first sub-pixel SP1 included in the first pixel P1 to the first display area value. For example, the first display area value may be 0, such as Fig.10 as shown in .

[0118] The display area information generating unit 340 may set the display area information of each second sub-pixel SP2 included in the second pixel P2 to the second display area value or the third display area value. The display area information generating unit 340 may generate the display area information in a state where the second pixel P2 disposed in the second display area DA2 is divided into an emitting pixel and a non-emitting pixel.

[0119] In the case where the second pixel P2 is a light-emitting pixel, the display area information generating unit 340 may set the display area information of each second sub-pixel SP2 included in the light-emitting pixel to the second display area value. For example, the second display area value may be 1, such as Fig.10 as shown in .

[0120] In addition, when the second pixel P2 is a non-luminescent pixel, the display area information generating unit 340 may set the display area information of each second sub-pixel SP2 included in the non-luminescent pixel to the third display area value. For example, the third display area value may be 2, such as Fig.10 as shown in .

[0121] Fig.10 It is illustrated that the second display area DA2 is divided into luminous pixels and non-luminous pixels in units of pixels. However, the present disclosure is not limited to this. The second display area DA2 can be divided into luminous sub-pixels and non-luminous sub-pixels in units of sub-pixels. Specifically, the plurality of second sub-pixels SP2 included in one second pixel P2 can all be luminous sub-pixels or non-luminous sub-pixels. Alternatively, some of the plurality of second sub-pixels SP2 included in one second pixel P2 can be luminous sub-pixels, and other second sub-pixels SP2 of the plurality of second sub-pixels SP2 can be non-luminous sub-pixels.

[0122] The boundary information generating unit 350 may generate boundary information of pixels disposed in the boundary area BA located within a predetermined range from the boundary B between the first display area DA1 and the second display area DA2 using the leftmost boundary pixel and the rightmost boundary pixel of each line.

[0123] like Fig.11As shown in , the border area BA may include a plurality of first border areas BA1 arranged in the first display area DA1. For example, the first border area BA1 may include a 1-1 border area BA1-1 arranged adjacent to the border B in the first display area DA1, a 1-2 border area BA1-2 arranged adjacent to the 1-1 border area BA1-1 in the first display area DA1, and a 1-3 border area BA1-3 arranged adjacent to the 1-2 border area BA1-2 in the first display area DA1. At this time, the distance between the 1-2 border area BA1-2 and the border B may be greater than the distance between the 1-1 border area BA1-1 and the border B, and the distance between the 1-3 border area BA1-3 and the border B may be greater than the distance between the 1-2 border area BA1-2 and the border B.

[0124] Fig.11 It is shown that the first display area DA1 includes three boundary areas BA1-1, BA1-2 and BA1-3. However, the present disclosure is not limited thereto. The first display area DA1 may include two boundary areas, or may include one boundary area. Alternatively, the first display area DA1 may include four or more boundary areas.

[0125] like Fig.11 As shown in , the border area BA may include a plurality of second border areas BA2 arranged in the second display area DA2. For example, the second border area BA2 may include a 2-1 border area BA2-1 arranged in the second display area DA2 to be adjacent to the border B, a 2-2 border area BA2-2 arranged in the second display area DA2 to be adjacent to the 2-1 border area BA2-1, and a 2-3 border area BA2-3 arranged in the second display area DA2 to be adjacent to the 2-2 border area BA2-2. At this time, the distance between the 2-2 border area BA2-2 and the border B may be greater than the distance between the 2-1 border area BA2-1 and the border B, and the distance between the 2-3 border area BA2-3 and the border B may be greater than the distance between the 2-2 border area BA2-2 and the border B.

[0126] Fig.11 It is shown that the second display area DA2 includes three boundary areas BA2-1, BA2-2 and BA2-3. However, the present disclosure is not limited thereto. The second display area DA2 may include two boundary areas, or may include one boundary area. Alternatively, the second display area DA2 may include four or more boundary areas.

[0127] The boundary information generating unit 350 may generate boundary information of each pixel disposed in the boundary area BA using a kernel K consisting of m rows and m columns (m is a natural number greater than 2). Fig.11 and Fig.12 As shown in , the kernel K will be described as consisting of seven rows and seven columns. However, the present disclosure is not limited thereto. The size of the kernel K may vary.

[0128] Reference Fig.11 and Fig.12 , the boundary information generation unit 350 may set each of the plurality of pixels P at the center of the kernel K. The boundary information generation unit 350 may determine the boundary value of the pixel CP set at the center of the kernel K based on the position in the kernel K where the boundary pixel is set. Here, the boundary pixels, which are pixels set adjacent to the first display area DA1 in the second display area DA2, may include the leftmost boundary pixel and the rightmost boundary pixel of each line. In addition, the boundary pixels may include pixels set between the leftmost boundary pixel and the rightmost boundary pixel of each of the first to nth lines.

[0129] The boundary information generating unit 350 may set the pixel CP in the central area of ​​the kernel K, and may confirm the position in the kernel K where the boundary pixel is set.

[0130] In the case where the kernel K consists of seven rows and seven columns, the kernel K may include a central region (0,0) and eight first regions (-1,-1), (0,-1), (1,-1), (1,0), (1,1), (0,1), (-1,1), and (-1,0) disposed adjacent to the central region around the central region. In addition, the kernel K may include 16 second regions (-2,-2), (-1,-2), (0,-2), (1,-2), (2,-2), (2,-1), (2,0), (2,1), (2,2), (1,2), (0,2), (-1,2), (-2,2), (-2,1), (-2,0), and (-2,-1) disposed adjacent to the first region around the first region. In addition, the kernel K may include 24 third regions (-3, -3), (-2, -3), (-1, -3), (0, -3), (1, -3), (2, -3), (2, -3), (3, -3), (3, -2), (3, -1), (3, 0), (3, 1), (3, 2), (3, 3), (2, 3), (1, 3), (0, 3), (-1, 3), (-2, 3), (-3, 3), (-3, 2), (-3, 1), (-3, 0), (-3, -1) and (-3, -2).

[0131] The boundary information generating unit 350 may determine whether the pixel CP set in the central area of ​​the kernel K is the first pixel P1 set in the first display area DA1 or the second pixel P2 set in the second display area DA2. In the case where the pixel CP set in the central area of ​​the kernel K is the first pixel P1 and the boundary pixel is set in any one of the 24 third areas of the kernel K, the boundary information generating unit 350 may set a first boundary value for the pixel CP set in the central area of ​​the kernel K. For example, the first boundary value may be 1.

[0132] The boundary information generating unit 350 may set the boundary information of each first pixel P1 disposed in the 1-3 boundary area BA1-3 to have a first boundary value of 1, for example. Fig.11 as shown in .

[0133] In the case where the pixel CP disposed in the central area of ​​the kernel K is the first pixel P1 and the boundary pixel is disposed in any one of the 16 second areas of the kernel K, the boundary information generating unit 350 may set a second boundary value for the pixel CP disposed in the central area of ​​the kernel K. For example, the second boundary value may be 2.

[0134] The boundary information generating unit 350 may set the boundary information of each first pixel P1 disposed in the 1-2 boundary area BA1-2 to have a second boundary value of, for example, 2, such as Fig.11 as shown in .

[0135] In the case where the pixel CP disposed in the central area of ​​the kernel K is the first pixel P1 and the boundary pixel is disposed in any one of the eight first areas of the kernel K, the boundary information generating unit 350 may set a third boundary value for the pixel CP disposed in the central area of ​​the kernel K. For example, the third boundary value may be 3.

[0136] The boundary information generating unit 350 may set the boundary information of each first pixel P1 disposed in the 1-1 boundary area BA1-1 to have a third boundary value of, for example, 3, such as Fig.11 as shown in .

[0137] In addition, when the pixel CP set in the central area of ​​the kernel K is the second pixel P2 and the boundary pixel is set in any one of the 8 first areas of the kernel K, the boundary information generating unit 350 may set a fourth boundary value for the pixel CP set in the central area of ​​the kernel K. For example, the fourth boundary value may be 4.

[0138] The boundary information generating unit 350 may set the boundary information of each second pixel P2 disposed in the 2-1 boundary area BA2-1 to have a fourth boundary value of, for example, 4, such as Fig.11 as shown in .

[0139] In the case where the pixel CP disposed in the central area of ​​the kernel K is the second pixel P2 and the boundary pixel is disposed in any one of the 16 second areas of the kernel K, the boundary information generating unit 350 may set a fifth boundary value for the pixel CP disposed in the central area of ​​the kernel K. For example, the fifth boundary value may be 5.

[0140] The boundary information generating unit 350 may set the boundary information of each second pixel P2 disposed in the 2-2 boundary area BA2-2 to have a fifth boundary value of, for example, 5, such as: Fig.11 as shown in .

[0141] In the case where the pixel CP disposed in the central area of ​​the kernel K is the second pixel P2 and the boundary pixel is disposed in any one of the 24 third areas of the kernel K, the boundary information generating unit 350 may set a sixth boundary value for the pixel P disposed in the central area of ​​the kernel K. For example, the sixth boundary value may be 6.

[0142] The boundary information generating unit 350 may set the boundary information of each second pixel P2 disposed in the 2-3 boundary area BA2-3 to have a sixth boundary value of, for example, 6, such as Fig.11 as shown in .

[0143] As a result, each pixel P disposed in the boundary area BA may have a boundary value that increases or decreases as the distance from the boundary pixel increases. In an embodiment, each first pixel P1 disposed in the first display area DA1 among the pixels P disposed in the boundary area BA may have a boundary value that decreases as the distance from the boundary pixel increases. Each second pixel P2 disposed in the second display area DA2 among the pixels P disposed in the boundary area BA may have a boundary value that increases as the distance from the boundary pixel increases.

[0144] In addition, each of the first pixel P1 and the second pixel P2 disposed in the region other than the boundary region may be set to a seventh boundary value. For example, the seventh boundary value may be zero.

[0145] The image processing unit 360 changes the image displayed on the display panel 110 using the display area information generated by the display area information generating unit 340 and the boundary information generated by the boundary information generating unit 350. The image processing unit 360 may change the image displayed in the boundary area BA, and may perform control so that the corrected image is displayed on the display panel 110.

[0146] In the following, reference will be made to Figures 13 to 17An example of the image processing unit 360 is described in more detail.

[0147] Fig.13 It shows Figure 4 A view of an example of a configuration of an image processing unit, Fig.14 is a view showing an example of a plurality of first boundary regions and a plurality of second boundary regions, and Fig.15 is a view showing an example of correction of an image by an image processing unit. Fig.16 is a view showing another example of a plurality of first boundary regions and a plurality of second boundary regions, and Fig.17 is a view showing another example of correcting an image by the image processing unit.

[0148] Reference Figures 13 to 17 The image processing unit may include an image receiving unit 361 , a region determining unit 362 , an image correcting unit 363 , and an optical operation determining unit 364 .

[0149] The image receiving unit 361 receives image data from an external system. At this time, the received image data may include image data of the first display area DA1 and the second display area DA2.

[0150] The optical operation determination unit 364 determines whether the optical module 120 is operated. When determining that the optical module 120 is operated, the optical operation determination unit 364 may provide optical operation information to the area decision unit 362 so that the image displayed on the display panel is corrected.

[0151] When the optical operation determination unit 364 determines that the optical module 120 is operated, the region decision unit 362 may determine image data of each region.

[0152] like Fig.14 and Fig.16 As shown in FIG, the display panel 110 may include first and second display areas DA1 and DA2 disposed to overlap the optical module 120. In addition, the display panel 110 may include a boundary area BA located within a predetermined range from a boundary B between the first and second display areas DA1 and DA2.

[0153] The border area BA may include a first border area BA1 disposed adjacent to the border B in the first display area DA1 and a second border area BA2 disposed adjacent to the border B in the second display area DA2 .

[0154] like Fig.14 and Fig.16As shown in , a plurality of first border areas BA1 may be provided. For example, the first border area BA1 may include a 1-1 border area BA1-1 provided in the first display area DA1 to be adjacent to the border B, a 1-2 border area BA1-2 provided in the first display area DA1 to be adjacent to the 1-1 border area BA1-1, and a 1-3 border area BA1-3 provided in the first display area DA1 to be adjacent to the 1-2 border area BA1-2.

[0155] like Fig.14 and Fig.16 As shown in the figure, a plurality of second border areas BA2 may be provided. For example, the second border area BA2 may include a 2-1 border area BA2-1 provided in the second display area DA2 to be adjacent to the border B, a 2-2 border area BA2-2 provided in the second display area DA2 to be adjacent to the 2-1 border area BA2-1, and a 2-3 border area BA2-3 provided in the second display area DA2 to be adjacent to the 2-2 border area BA2-2.

[0156] The region determining unit 362 may include a first region determining unit 3621 and a second region determining unit 3622 .

[0157] When the optical operation determination unit 364 determines that the optical module 120 is operated, the first area determination unit 3621 may determine the image data of the second display area DA2 among the received image data. Specifically, the first area determination unit 3621 may determine the image data of the second display area DA2 among the received image data based on the display area information generated by the display area information generation unit 340.

[0158] The first area determining unit 3621 may determine the image data of the pixels P whose respective display area information has a value corresponding to the second display area DA2 as the image data of the second display area DA2. For example, the first area determining unit 3621 may determine the image data of the pixels P whose respective display area information has a second display area value or a third display area value as the image data of the second display area DA2.

[0159] When the optical operation determination unit 364 determines that the optical module 120 is operated, the second area determination unit 3622 may determine the image data of the first boundary area BA1 among the received image data. Specifically, the second area determination unit 3622 may determine the image data of the first boundary area BA1 among the received image data based on the boundary information generated by the boundary information generation unit 350.

[0160] The second area determining unit 3622 may determine the image data of the pixels P whose respective boundary information has a value corresponding to the first boundary area BA1 as the image data of the first boundary area BA1.

[0161] The second area determination unit 3622 may determine the image data of each of the first boundary areas BA1-1, BA1-2, and BA1-3. The second area determination unit 3622 may determine the image data of the first pixel P1 whose respective boundary information has a value corresponding to the 1-1 boundary area BA1-1 as the image data of the 1-1 boundary area BA1-1. For example, the second area determination unit 3622 may determine the image data of the first pixel P1 whose respective boundary information has a third boundary value as the image data of the 1-1 boundary area BA1-1.

[0162] The second region determining unit 3622 may determine the image data of the first pixel P1 whose respective boundary information has a value corresponding to the 1-2 boundary region BA1-2 as the image data of the 1-2 boundary region BA1-2. For example, the second region determining unit 3622 may determine the image data of the first pixel P1 whose respective boundary information has a second boundary value as the image data of the 1-2 boundary region BA1-2.

[0163] The second region determining unit 3622 may determine the image data of the first pixel P1 whose respective boundary information has a value corresponding to the 1-3 boundary region BA1-3 as the image data of the 1-3 boundary region BA1-3. For example, the second region determining unit 3622 may determine the image data of the first pixel P1 whose respective boundary information has a first boundary value as the image data of the 1-3 boundary region BA1-3.

[0164] In addition, the area decision unit 362 may decide image data of an area other than the first boundary area BA1 in the first display area DA1. The area decision unit 362 may decide image data of first pixels P1 whose respective display area information has a value corresponding to the first display area DA1 and whose respective boundary information is 0 as image data of an area other than the first boundary area BA1 in the first display area DA1.

[0165] When the optical operation determination unit 364 determines that the optical module 120 is operated, the image correction unit 363 corrects the received image data. To this end, the image correction unit 363 may include a black image processing unit 3631 and a brightness adjustment unit 3632.

[0166] When the optical operation determination unit 364 determines that the optical module 120 is operated, the black image processing unit 3631 may change the image data of the second display area DA2 determined by the first area decision unit 3621 into black image data. At this time, the black image data may be zero.

[0167] In the display panel 110 according to the embodiment of the present disclosure, when the optical module 120 is operated, black image data may be input to the second pixel P2 disposed in the second display area DA2 to overlap the optical module 120. Therefore, in the display device 100 according to the embodiment of the present disclosure, it is possible to prevent interference from occurring due to light generated from the display panel 110 when the optical module 120 is operated.

[0168] When the optical operation determination unit 364 determines that the optical module 120 is operated, the brightness adjustment unit 3632 adjusts the brightness of the image data of the first boundary area BA1 determined by the second area determination unit 3622 .

[0169] The brightness adjustment unit 3632 may perform adjustment so that the brightness of the image data of the first boundary area BA1 has a value between the brightness of the image data of the area other than the first boundary area BA1 in the first display area DA1 and the brightness of the black image data of the second display area DA2.

[0170] The brightness adjustment unit 3632 may perform adjustment so that the image data of the area other than the first boundary area BA1 in the first display area DA1 has a first brightness. The brightness adjustment unit 3632 may perform adjustment so that the black image data of the second display area DA2 has a second brightness different from the first brightness. For example, the second brightness may be a black brightness lower than the first brightness.

[0171] In the case where the second display area DA2 has black brightness, the brightness difference between the first display area DA1 and the second display area DA2 is large, and thus the boundary B between the first display area DA1 and the second display area DA2 is clearly visible. At this time, since the boundary B between the first display area DA1 and the second display area DA2 is composed of the boundary between the first pixel P1 and the second pixel P2, the boundary B between the first display area DA1 and the second display area DA2 may have a step shape instead of a curved shape. As a result, the step-shaped boundary B of the image displayed on the display panel 110 may be recognized by the user, which may cause user dissatisfaction.

[0172] In addition, due to the large difference in brightness between the first display area DA1 and the second display area DA2, color blurring may occur at the boundary B between the first display area DA1 and the second display area DA2.

[0173] In the display device 100 according to an embodiment of the present disclosure, the brightness of the first boundary area BA1 located within a predetermined range from the boundary B between the first display area DA1 and the second display area DA2 is adjusted, thereby minimizing the recognition of the step shape at the boundary B between the first display area DA1 and the second display area DA2 and preventing color blur.

[0174] To this end, the brightness adjustment unit 3632 may perform adjustment so that the image data of the first boundary area BA1 has a third brightness which is a value between the first brightness and the second brightness.

[0175] For example, the third brightness may be lower than the first brightness and may be higher than the second brightness.

[0176] In addition, in the case where a plurality of first boundary areas BA1 are provided, the brightness adjustment unit 3632 may adjust the brightness of the image data of each of the plurality of first boundary areas BA1-1, BA1-2, and BA1-3. Fig.15 and Fig.17 As shown in , the brightness adjustment unit 3632 may perform adjustment so that the brightness of the image data of each of the plurality of first boundary areas BA1-1, BA1-2, and BA1-3 gradually decreases as the distance from the second display area DA2 decreases.

[0177] For example, in the case where the second brightness is black brightness, the brightness adjustment unit 3632 may perform adjustment so that the brightness of the image data of each of the plurality of first boundary areas BA1-1, BA1-2, and BA1-3 gradually decreases as the distance from the second display area DA2 decreases.

[0178] In the display device 100 according to the embodiment of the present disclosure, adjustment is performed so that the brightness of each of the plurality of first boundary areas BA1-1, BA1-2, and BA1-3 is gradually reduced or increased, thereby minimizing the brightness difference between the areas. Therefore, in the display device 100 according to the embodiment of the present disclosure, it is possible to minimize the recognition of the step-shaped boundary B between the first display area DA1 and the second display area DA2 having a large brightness difference. In addition, in the display device 100 according to the embodiment of the present disclosure, it is possible to prevent color blurring between the first display area DA1 and the second display area DA2 having a large brightness difference.

[0179] The brightness adjustment unit 3632 may independently adjust the brightness of each of the plurality of first boundary areas BA1.

[0180] In addition, the brightness adjustment unit 3632 may perform adjustment so that the brightness changes according to the direction in which the boundary area BA is set based on the central area of ​​the second display area DA2. For example, the boundary area BA may include a left boundary area A1 set in the left direction D1 based on the central area of ​​the second display area DA2, a right boundary area A2 set in the right direction D2 based on the central area of ​​the second display area DA2, an upper boundary area A3 set in the upward direction D3 based on the central area of ​​the second display area DA2, and a lower boundary area A4 set in the downward direction D4 based on the central area of ​​the second display area DA2.

[0181] like Fig.16 and Fig.17 As shown in the figure, the boundary area BA may also include an upper left boundary area A5 set in the upper left direction D5 based on the center area of ​​the second display area DA2, an upper right boundary area A6 set in the upper right direction D6 based on the center area of ​​the second display area DA2, a lower right boundary area A7 set in the lower right direction D7 based on the center area of ​​the second display area DA2, and a lower left boundary area A8 set in the lower left direction D8 based on the center area of ​​the second display area DA2.

[0182] Hereinafter, for convenience of description, the boundary area BA will be described as including a left boundary area A1, a right boundary area A2, an upper boundary area A3, and a lower boundary area A4. However, the present disclosure is not limited thereto.

[0183] The brightness adjustment unit 3632 may independently adjust the brightness of image data of the pixels P disposed in each of the left boundary area A1 , the right boundary area A2 , the upper boundary area A3 , and the lower boundary area A4 .

[0184] Specifically, the brightness adjustment unit 3632 can perform adjustment so that the brightness value of the image data of each of the left boundary area A1, the right boundary area A2, the upper boundary area A3 and the lower boundary area A4 is between the first brightness of the image data of the area other than the first boundary area BA1 in the first display area DA1 and the second brightness of the image data of the second display area DA2.

[0185] The brightness adjustment unit 3632 may perform adjustment so that the image data of the left border area A1 has a fourth brightness, which is a value between the first brightness and the second brightness. The brightness adjustment unit 3632 may perform adjustment so that the image data of the right border area A2 has a fifth brightness, which is a value between the first brightness and the second brightness. The brightness adjustment unit 3632 may perform adjustment so that the image data of the upper border area A3 has a sixth brightness, which is a value between the first brightness and the second brightness. The brightness adjustment unit 3632 may perform adjustment so that the image data of the lower border area A4 has a seventh brightness, which is a value between the first brightness and the second brightness.

[0186] Although each of the fourth brightness, the fifth brightness, the sixth brightness, and the seventh brightness has a value between the first brightness and the second brightness, they may all have different values, or some may have the same value and some may have different values. That is, the brightness adjustment unit 3632 may independently adjust the brightness of the image data of each of the left boundary area A1, the right boundary area A2, the upper boundary area A3, and the lower boundary area A4.

[0187] More specifically, the brightness change value of each of the left boundary area A1, the right boundary area A2, the upper boundary area A3, and the lower boundary area A4 may be preset. A first brightness change value may be set for the left boundary area A1, a second brightness change value may be set for the right boundary area A2, a third brightness change value may be set for the upper boundary area A3, and a fourth brightness change value may be set for the lower boundary area A4.

[0188] At this time, the first brightness change value, the second brightness change value, the third brightness change value, and the fourth brightness change value may be determined in consideration of the pitch between the pixels P. The first brightness change value may be determined based on the pitch between one pixel P and the adjacent pixel P set in the left direction D1. The second brightness change value may be determined based on the pitch between one pixel P and the adjacent pixel P set in the right direction D2. The third brightness change value may be determined based on the pitch between one pixel P and the adjacent pixel P set in the upward direction D3. The fourth brightness change value may be determined based on the pitch between one pixel P and the adjacent pixel P set in the downward direction D4.

[0189] For example, the brightness change value may be proportional to the pitch between the pixels P. In the case where the pitch between the pixels P is large, the brightness change value may increase. On the other hand, in the case where the pitch between the pixels P is small, the brightness change value may decrease.

[0190] The brightness adjustment unit 3632 may adjust the brightness of the image data of the pixels P disposed in the relevant boundary area BA by reflecting the brightness change value set for the relevant boundary area BA in the image data of the pixels P disposed in the relevant boundary area BA.

[0191] In addition, if Fig.16 and Fig.17 As shown in , each of the left border region A1, the right border region A2, the upper border region A3, and the lower border region A4 may be divided into a plurality of border regions. For example, each of the left border region A1, the right border region A2, the upper border region A3, and the lower border region A4 may include a first border region BA1 disposed adjacent to the border B in the first display region DA1 and a second border region BA2 disposed adjacent to the border B in the second display region DA2. At this time, a plurality of first border regions BA1 may be disposed, and a plurality of second border regions BA2 may also be disposed.

[0192] The brightness adjustment unit 3632 may independently adjust the brightness of each of the plurality of first boundary areas BA1, as previously described. In this case, the brightness change value may include a plurality of values ​​for the plurality of first boundary areas BA1-1, BA1-2, BA1-3.

[0193] For example, each of the left boundary area A1, the right boundary area A2, the upper boundary area A3, and the lower boundary area A4 may include three first boundary areas BA1-1, BA1-2, and BA1-3. At this time, the first brightness change value of the left boundary area A1 may include values ​​for the three first boundary areas BA1-1, BA1-2, and BA1-3, that is, three brightness change values.

[0194] In addition, the brightness adjustment unit 3632 may independently adjust the brightness of each of the plurality of second boundary areas BA2. In this case, the brightness change value may include a plurality of values ​​for the plurality of second boundary areas BA2-1, BA2-2, BA2-3.

[0195] For example, each of the left border area A1, the right border area A2, the upper border area A3 and the lower border area A4 may include three second border areas BA2-1, BA2-2, BA2-3. At this time, the first brightness change value of the left border area A1 may include values ​​for the three first border areas BA1-1, BA1-2, BA1-3 and the three second border areas BA2-1, BA2-2, BA2-3, that is, six brightness change values.

[0196] As a result, the brightness adjustment unit 3632 can set 24 brightness change values ​​for the 24 boundary regions. The brightness adjustment unit 3632 can adjust the brightness of the image data of each of the 24 boundary regions using the set brightness change values.

[0197] The control unit 370 performs control so that the corrected image is displayed on the display panel 110. To this end, the control unit 370 may generate a control signal for controlling the panel driving unit 130. The control unit 370 may generate a data control signal for a data driving unit of the panel driving unit 130 and a gate control signal for a gate driving unit of the panel driving unit 130. The control unit 370 may output the data control signal, the gate control signal, and the image data signal to the panel driving unit 130.

[0198] The control unit 370 may control the operation of the optical module 120. To this end, the control unit 370 may generate a control signal for controlling the optical driving unit 140, and may output the generated control signal to the optical driving unit 140.

[0199] As is apparent from the above description, according to the present disclosure, it is possible to display an image even in an area arranged to overlap with a camera. Therefore, in the present disclosure, it is possible to provide a wide image display surface and prevent the image from being interrupted in an area where the camera is located.

[0200] In addition, according to the present disclosure, the shape information of the area set to overlap with the camera can be stored and the display area information and boundary information of each of the plurality of pixels can be acquired using the shape information. Therefore, in the present disclosure, even if the size, position, etc. of the camera are changed, it is sufficient to change only the shape information of the area set to overlap with the camera stored in the memory, thereby making it possible to easily change the shape of the area set to overlap with the camera.

[0201] In addition, according to the present disclosure, the boundary of the area set to overlap with the camera can be easily obtained based only on the position information and vertical length information of the starting point, the direction information of the line, and the width information of the area set to overlap with the camera. Therefore, in the present disclosure, the amount of information stored in the memory can be minimized, thereby enabling the use of a small-capacity memory.

[0202] In addition, according to the present disclosure, the boundary of the area set to overlap with the camera can be acquired by simple calculation, whereby the amount of calculation is low in the process of independently controlling the general display area and the display area set to overlap with the camera.

[0203] In addition, according to the present disclosure, adjustment is performed so that when the camera is operated, the brightness at the boundary between the general display area and the area set to overlap with the camera is gradually reduced or increased, thereby minimizing the brightness difference between the areas. Therefore, in the present disclosure, color blurring can be prevented between display areas with large brightness differences.

[0204] In addition, according to the present disclosure, it is possible to minimize recognition of a step-shaped boundary between a general display area and an area provided to overlap with a camera.

[0205] It should be noted that the effects of the present disclosure are not limited to the above-mentioned effects, and other unmentioned effects will be clearly understood by those skilled in the art from the above description of the present disclosure.

[0206] Those skilled in the art will appreciate that the present disclosure may be embodied in specific forms other than those set forth herein without departing from the technical concept and essential characteristics of the present disclosure.

[0207] For example, the data driving device according to the present disclosure may be implemented in the form of an IC, and the function of the data driving device may be installed in the IC in the form of a program. In the case where the function of the data driving device according to the present disclosure is implemented as a program, the function of each component included in the data driving device may be implemented as a specific code, and the code for implementing the specific function may be implemented as a single program or a plurality of separate programs.

[0208] Therefore, the above embodiments are therefore to be understood as illustrative in all aspects and not restrictive. The scope of the present disclosure is defined by the appended claims rather than the specific description, and it is intended that all variations or modifications derived from the meaning, scope and equivalent concepts of the claims fall within the scope of the present disclosure.

Claims

1. A display device, comprising: a display panel having a plurality of pixels, the display panel including a first display area and a second display area having a lower resolution than the first display area, the second display area being arranged to overlap with the optical module; as well as a controller configured to change an image displayed in at least one of the first display area and the second display area, Wherein, the controller comprises: a display area information generating unit configured to generate display area information of each of a plurality of pixels in the second display area based on shape information of the second display area, the shape information of the second display area including position information indicating a starting point of a boundary of the second display area, vertical length information of the second display area, and line-based direction information and width information; a boundary information generating unit configured to generate boundary information of pixels set in a boundary area located within a predetermined range from a boundary between the first display area and the second display area based on the shape information of the second display area; an image processing unit including an optical operation determination unit configured to determine whether an optical module is operated, and configured to change an image displayed in at least one of the first display area and the second display area based on the display area information and the boundary information when determining that the optical module is operated; and a control unit configured to perform control so that the changed image is displayed on the display panel, wherein the boundary pixel extraction unit extracts the boundary pixels of each line based on the position information of the starting point, the line-based direction information and the width information, and the boundary information generation unit determines the boundary value of the pixel set at the center of the kernel based on the position of the boundary pixel in the kernel, The kernel includes m rows and m columns, and m is a natural number greater than 2.

2. The display device according to claim 1, wherein: The image processing unit includes a black image processing unit configured to change image data of pixels whose respective display area information has a value corresponding to the second display area into black image data when it is determined that the optical module is operated.

3. The display device according to claim 1, wherein: The border region includes a first border region disposed adjacent to the border in the first display region and a second border region disposed adjacent to the border in the second display region, and The image processing unit further includes a brightness adjustment unit configured to change brightness of image data of pixels whose respective boundary information has a value corresponding to the first display area when it is determined that the optical module is operated.

4. The display device according to claim 3, wherein: The brightness adjustment unit is configured to perform adjustment so that the brightness of the image data of the pixels arranged in the first boundary area has a value between the brightness of the image data of the pixels arranged in an area other than the boundary area in the first display area and the brightness of black image data.

5. The display device according to claim 3, wherein: A plurality of first boundary regions are provided, and The brightness adjustment unit is configured to perform adjustment so that brightness of image data of a pixel disposed in each of the plurality of first boundary areas gradually decreases as a distance from the second display area decreases.

6. The display device according to claim 1, wherein: The boundary area includes an upper boundary area set in an upward direction based on a central area of ​​the second display area, a lower boundary area set in a downward direction based on the central area of ​​the second display area, a left boundary area set in a left direction based on the central area of ​​the second display area, and a right boundary area set in a right direction based on the central area of ​​the second display area, and The brightness adjustment unit independently adjusts brightness of image data of pixels disposed in each of the upper boundary region, the lower boundary region, the left boundary region, and the right boundary region.

7. The display device according to claim 1, wherein: The shape information of the second display area includes left boundary information about a left boundary located on the left side based on a central axis of the second display area and right boundary information about a right boundary located on the right side based on the central axis of the second display area, and Each of the left boundary information and the right boundary information includes direction information and width information of each of a plurality of lines set within a vertical length from the start point.

8. The display device according to claim 1, wherein: The controller performs adjustment so that image data of pixels having the same boundary value have the same brightness.

9. A controller, comprising: a display area information generating unit configured to generate display area information of each of a plurality of pixels in a second display area based on shape information of the second display area, the second display area having a resolution lower than that of the first display area, and the shape information of the second display area including position information indicating a starting point of a boundary of the second display area, vertical length information of the second display area, and line-based direction information and width information; a boundary information generating unit configured to generate boundary information of pixels set in a boundary area located within a predetermined range from a boundary between the first display area and the second display area based on the shape information of the second display area; an image processing unit including an optical operation determination unit configured to determine whether an optical module is operated, the image processing unit configured to change an image displayed in at least one of the first display area and the second display area based on the display area information and the boundary information when determining that the optical module is operated; as well as a control unit configured to perform control so that the changed image is displayed on the display panel, wherein the boundary pixel extraction unit extracts the boundary pixels of each line based on the position information of the starting point, the line-based direction information and the width information, and the boundary information generation unit determines the boundary value of the pixel set at the center of the kernel based on the position of the boundary pixel in the kernel, The kernel includes m rows and m columns, and m is a natural number greater than 2.

10. The controller according to claim 9, wherein: The image processing unit includes an area determination unit configured to determine image data of the first display area and the second display area when determining that the optical module is operated, and The area determination unit includes a first area determination unit configured to determine image data of pixels whose respective display area information among the input image data has a value corresponding to the second display area as image data of the second display area.

11. The controller according to claim 10, wherein: The image processing unit further includes a black image processing unit configured to change image data of pixels provided in the second display area into black image data.

12. The controller according to claim 10, wherein: The border region includes a first border region disposed adjacent to the border in the first display region and a second border region disposed adjacent to the border in the second display region, and The region decision unit further includes a second region decision unit configured to decide image data of pixels whose respective boundary information has a value corresponding to the first boundary region among the input image data as image data of the first boundary region.

13. The controller according to claim 12, wherein: The image processing unit also includes a brightness adjustment unit, which is configured to perform adjustment so that image data of pixels set in an area other than the first boundary area in the first display area have a first brightness, image data of pixels set in the second display area have a second brightness, and image data of pixels set in the first boundary area have a third brightness, which is lower than the first brightness and higher than the second brightness.

14. The controller according to claim 13, wherein: A plurality of first boundary regions are provided, and The brightness adjustment unit performs adjustment so that brightness of image data of a pixel disposed in each of the plurality of first boundary areas gradually decreases as a distance from the second display area decreases.

Images