Electronic device including an image sensor

Abstract

An electronic device includes a color filter array including a plurality of color filters having a first grid pattern, an image sensor including the color filter array, and at least one processor electrically connected to the image sensor. The at least one processor is configured to acquire image data via a unit pixel of a pixel array having a second grid pattern forming a 45-degree angle with respect to the first grid pattern. At least two color filters of the plurality of color filters have different colors, and the at least two color filters of the plurality of color filters correspond to the unit pixel.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an electronic device including an image sensor. BACKGROUND

[0002] Generally, in the case of a mobile terminal, an image sensor such as a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) is employed. Such an image sensor detects a brightness value of light, and thus an image acquired through the image sensor is a black-and-white image, not a color image. Accordingly, a color filter array for red, green, and blue components is provided in each pixel of the image sensor to acquire a color image.

[0003] When the color filter array is provided, each pixel of the image sensor detects red, green, and blue values of light passing through the color filter array. Each pixel acquires only one color value (e.g., red) corresponding to the color filter among a plurality of color values, and thus an image signal processor obtains all color values (e.g., red, green, and blue) of the pixel by interpolating color values from adjacent pixels. SUMMARY

[0004]

Technical Problem

[0005] In a process of acquiring light through a color filter array of an image sensor, there is a crosstalk phenomenon for each wavelength, and thus it can be difficult to distinguish and read a specific wavelength. Although the image sensor divides wavelengths and outputs the wavelengths, an image signal processor can not effectively consider edge information of an image, and can not sufficiently consider a correlation between colors, and thus, when color interpolation is performed, at an edge such as a contour or a boundary line of an object, the object can be interpolated with a color completely different from an original color. A false color error (a phenomenon in which some pixels are obviously discordant with a surrounding environment) or a color distortion (making a color image like a rainbow in a pattern area (e.g., a check pattern image)) can occur.

[0006] In an image sensor having a large number of pixels capable of outputting red, green, and blue values while maintaining a color center, the above-described problem can be minimized. However, a maximum number of individual pixels is required to output color values by minimizing a color error, and thus it can be difficult to output color values while minimizing a color error and maintaining a color center in an image sensor having a smaller number of pixels. In addition, there is a limit to increasing the number of pixels in all mobile terminals at present.

[0007]

Technical Solution

[0008] According to an aspect of the disclosure, an electronic device includes a color filter array including a plurality of color filters having a first grid pattern, an image sensor including the color filter array, and at least one processor electrically connected to the image sensor. The at least one processor is configured to acquire image data via unit pixels in a pixel array having a second grid pattern formed at a 45-degree angle with respect to the first grid pattern. At least two of the plurality of color filters have different colors, and the at least two of the plurality of color filters correspond to the unit pixels.

[0009] According to another embodiment of the disclosure, an electronic device includes a color filter array including a plurality of color filters having a first grid pattern, an image sensor including the color filter array, and at least one processor electrically connected to the image sensor. The at least one processor is configured to acquire image data via unit pixels in a pixel array having a second grid pattern formed at a 45-degree angle with respect to the first grid pattern. Each unit pixel in the pixel array includes (i) a first area corresponding to a quadrangle in each of the plurality of color filters included in the color filter array and (ii) a second area corresponding to an area excluding the first area.

[0010]

Advantages of the disclosure

[0011] According to one or more embodiments disclosed herein, it is possible to address a problem in which resolution can be reduced due to a difference in color phase.

[0012] In addition, according to one or more embodiments, even an image sensor having a lower pixel can improve color reproducibility by minimizing color error or color distortion.

[0013] In addition, according to one or more embodiments, it is possible to improve processing speed and power consumption by omitting some processing performed by an image signal processor.

[0014] Various effects determined directly or indirectly via the disclosure can be provided. BRIEF DESCRIPTION OF DRAWINGS

[0015] The above and other aspects, features, and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0016] Figure 1 A structure for a camera module and an electronic device according to an embodiment is illustrated;

[0017] Figure 2 A configuration of main hardware of an electronic device according to an embodiment is illustrated;

[0018] Figure 3 A path in which light information is acquired in an electronic device according to an embodiment is illustrated;

[0019] Figure 4 Frequency domain capable of representing colors via a color filter array of a Bayer pattern in an image sensor of an electronic device according to an embodiment is shown;

[0020] Figure 5 Color filter array and unit pixel in an electronic device according to an embodiment is shown;

[0021] Figure 6 (a) and (b) of FIG. 1 show unit pixels and frequency representation regions in the case where a photographing resolution of an electronic device is a first resolution according to an embodiment;

[0022] Figure 7a A photographed result image in the case where a photographing resolution of an electronic device is a first resolution according to an embodiment is shown;

[0023] Figure 7b A performance graph in the case where a photographing resolution of an electronic device is a first resolution according to an embodiment is shown;

[0024] Figure 8 (a) and (b) of FIG. 3 show unit pixels and frequency representation regions in the case where a photographing resolution of an electronic device is a second resolution (i.e., four times the first resolution) according to an embodiment;

[0025] Figure 9 A photographed result image in the case where a photographing resolution of an electronic device is a second resolution according to an embodiment is shown;

[0026] Figure 10 (a) and (b) of FIG. 5 show unit pixels and frequency representation regions in the case where a photographing resolution of an electronic device is a third resolution (i.e., one fourth of the first resolution) according to an embodiment;

[0027] Figure 11 A photographed result image in the case where a photographing resolution of an electronic device is a third resolution according to an embodiment is shown;

[0028] Figure 12 Shape and arrangement of a color filter according to an embodiment is shown;

[0029] Figure 13 First color filter array according to an embodiment is shown;

[0030] Figure 14 Second color filter array according to an embodiment is shown;

[0031] Figure 15 Saturation of R, G, and B color values over time in the case where a color filter array in an electronic device is configured as a Bayer pattern according to an embodiment is shown;

[0032] Figure 16 A color filter array according to an embodiment is illustrated;

[0033] Figure 17 Images (a), (b), (c) taken based on one or more embodiments are illustrated;

[0034] Figure 18 An electronic device in a network environment according to one or more embodiments is illustrated; and

[0035] Figure 19 A camera module according to one or more embodiments is illustrated. DETAILED DESCRIPTION

[0036] Hereinafter, one or more embodiments of the disclosure are described with reference to the accompanying drawings. However, it is not intended to limit the disclosure to specific embodiments and should be understood to include various modifications, equivalents, and / or alternatives of the embodiments of the disclosure.

[0037] Figure 1 A structure of a camera module 180 and an electronic device 100 according to an embodiment is illustrated.

[0038] Figure 1 An appearance of a camera module 180 and an electronic device 100 in which the camera module 180 is mounted according to an embodiment is illustrated. Embodiments of Figure 1 have been illustrated and described with respect to a mobile device, particularly a smartphone. However, it will be clearly understood by those skilled in the art that the embodiments can be applied to electronic devices or mobile devices having a camera among various electronic devices.

[0039] Referring to Figure 1 , a display 110 according to an embodiment can be disposed on a front surface of an electronic device 100. In an embodiment, the display 110 can occupy a large portion of the front surface of the electronic device 100. The display 110 and a bezel 190 area surrounding at least a portion of an edge of the display 110 can be disposed on the front surface of the electronic device 100. The display 110 can include a flat area and a curved area extending from the flat area toward a side surface of the electronic device 100. Figure 1 The electronic device 100 illustrated in FIG. 1A is one example, and one or more embodiments are all possible. For example, the display 110 of the electronic device 100 can include only a flat area, without a curved area, or include a curved area only on one edge of its one side, rather than on edges of its opposite sides. In addition, in an embodiment, the curved area can extend to a rear surface of the electronic device, and thus, the electronic device 100 can include an additional flat area.

[0040] In an embodiment, the electronic device 100 can further include a speaker, a receiver, a front camera, a proximity sensor, a home key, and the like. In the electronic device 100 according to an embodiment, the back cover 150 can be integrally provided with the main body of the electronic device. In another embodiment, the back cover 150 can be separated from the main body of the electronic device 100 to have a form capable of replacing a battery. The back cover 150 can be referred to as a battery cover or a rear surface cover.

[0041] In an embodiment, the fingerprint sensor 171 configured to identify a fingerprint of a user can be disposed in the first area 170 of the display 110. The fingerprint sensor 171 can be disposed on a layer under the display 110 and can thus be disposed not to be seen by the user, or to be difficult to be seen by the user. Furthermore, in addition to the fingerprint sensor 171, a sensor for additional user / biometric authentication can be disposed in a partial area of the display 110. In another embodiment, the sensor for user / biometric authentication can be disposed in one area of the bezel 190. For example, an IR sensor for iris authentication can be exposed through one area of the display 110, or through one area of the bezel 190.

[0042] In an embodiment, the front camera 161 can be disposed in the second area 160 of the first surface of the electronic device 100. In an embodiment, the front camera 161 is exposed through one area of the display 110. In another embodiment, the front camera 161 can be exposed through the bezel 190. The electronic device 100 can include one or more front cameras 161. For example, the electronic device 100 can include two front cameras, e.g., a first front camera and a second front camera. In an embodiment, the first front camera and the second front camera can be the same type of camera having the same specifications (e.g., pixels), however, the first front camera and the second front camera can be implemented as cameras having different specifications. The electronic device 100 can support functions related to dual cameras (e.g., three-dimensional (3D) photographing, auto focus, and the like) through the two front cameras. Figure 1 In an embodiment, the front camera 161 is exposed through one area of the display 110. In another embodiment, the front camera 161 can be exposed through the bezel 190. The electronic device 100 can include one or more front cameras 161. For example, the electronic device 100 can include two front cameras, e.g., a first front camera and a second front camera. In an embodiment, the first front camera and the second front camera can be the same type of camera having the same specifications (e.g., pixels), however, the first front camera and the second front camera can be implemented as cameras having different specifications. The electronic device 100 can support functions related to dual cameras (e.g., three-dimensional (3D) photographing, auto focus, and the like) through the two front cameras.

[0043] In an embodiment, in the electronic device 100, various hardware or sensors 163 configured to assist photographing, e.g., a flash, can be additionally disposed. For example, a distance sensor (e.g., a time of flight (TOF) sensor) configured to detect a distance between a subject and the electronic device 100, and the like can also be included. This can apply to both the front camera and the rear camera.

[0044] In an embodiment, at least one physical key can be disposed on a side surface portion of the electronic device 100. For example, a first function key 151 configured to turn on / off the display 110, or turn on / off the power of the electronic device 100 can be disposed on a right edge with reference to the front surface of the electronic device 100. In an embodiment, a second function key 152 configured to control the volume or screen brightness of the electronic device 100 can be disposed on a left edge with reference to the front surface of the electronic device 100. In addition thereto, an additional button or key can be disposed on the front surface or the rear surface of the electronic device 100. For example, a touch button or a physical button mapped to a specific function can be disposed in a lower end region of the bezel 190 of the front surface.

[0045] Figure 1 The electronic device 100 shown in FIG. 1 corresponds to one example, and does not limit the shape of a device to which the technical idea disclosed in the present disclosure is applied. For example, the technical idea of the present disclosure can also be applied to a tablet, a notebook computer, or a foldable electronic device that can be folded in a horizontal direction or a vertical direction by employing a flexible display and a hinge structure. In addition, the technical idea can also be applied to a case where a first camera and a second camera facing the same direction are disposed to face different directions by rotating, folding, deforming, or the like of the device.

[0046] Reference Figure 1 The electronic device 100 according to an embodiment can include a camera module 180. The camera module 180 can include a lens assembly 111, a housing 113, an infrared cut filter 115, an image sensor 120, and an image signal processor 130.

[0047] In an embodiment, the camera module 180 can include a lens barrel configured to mount at least one lens aligned on an optical axis, and the housing 113 configured to mount at least one coil around the outer circumference of the lens barrel about the optical axis.

[0048] In an embodiment, the infrared cut filter 115 can be disposed on the upper surface of the image sensor 120. An image of a subject that has passed through the lens can be partially filtered by the infrared cut filter 115 and then detected by the image sensor 120.

[0049] In an embodiment, the image sensor 120 can be disposed on the upper surface of the printed circuit board. The image sensor 120 can be electrically connected to the image signal processor 130 connected to the printed circuit board 140 through a connector. A flexible printed circuit board (FPCB), a cable, or the like can be used as the connector.

[0050] In an embodiment, the image sensor 120 can be a complementary metal-oxide semiconductor (CMOS) sensor or a charge-coupled device (CCD) sensor. A plurality of individual pixels are integrated in the image sensor 120, and each individual pixel can include a microlens, a color filter, and a photodiode. Each individual pixel is a kind of photodetector and can convert input light into an electrical signal. Generally, the photodetector cannot detect the wavelength of the captured light by itself and cannot determine color information. The photodetector can include a photodiode.

[0051] In an embodiment, light information of a subject incident through the lens assembly 111 can be converted into an electrical signal by the image sensor 120 and input to the image signal processor 130.

[0052] In an embodiment, the camera module 180 can be disposed on the front surface as well as the rear surface of the electronic device 100. In addition, the electronic device 100 can include not only one camera module 180 but also a plurality of camera modules to improve the performance of the camera. For example, the electronic device 100 can further include a front camera 161 for a video call or a selfie. The front camera 161 can support a relatively smaller number of pixels than the rear camera module. The front camera can be smaller than the rear camera module.

[0053] Figure 2 A configuration of main hardware of the electronic device 100 according to an embodiment is illustrated. In the description of the Figure 2 configuration described in Figure 1 , or the description thereof can be omitted.

[0054] Referring to Figure 2 , in an embodiment, the electronic device 100 can include the lens assembly 111, the image sensor 120, the image signal processor 130, the processor 210, the display 110, and the memory 220.

[0055] In an embodiment, the number, arrangement, type, etc. of lenses of the lens assembly 111 can be different from each other depending on whether the lens assembly belongs to a front camera or a rear camera. According to the type of the lens assembly 111, the front camera and the rear camera can have different characteristics (e.g., focal length, maximum magnification, etc.) from each other.

[0056] In an embodiment, in the case where the image signal processor 130 and the image sensor 120 are physically separated, a standard-compliant sensor interface can be present.

[0057] In this embodiment, the image signal processor 130 can perform image processing on the electrically converted image data. The processing in the image signal processor 130 can be divided into pre-ISP (hereinafter referred to as preprocessing) and ISP chain (hereinafter referred to as postprocessing). Image processing before demosaicing can be called preprocessing, and image processing after demosaicing can be called postprocessing. The preprocessing process can include 3A processing, lens shading correction, edge enhancement, dead pixel correction, inflection point correction, etc. 3A can include at least one of automatic white balance (AWB), automatic exposure (AE), and automatic focus (AF). The postprocessing process can include at least one of changing the sensor index value, changing adjustment parameters, and adjusting the aspect ratio. The postprocessing process can include processing image data output from the image sensor 120 or image data output from the scaler. The image signal processor 130 can adjust the contrast, sharpness, saturation, jitter, etc., of the image through the postprocessing. Contrast, sharpness, and saturation adjustment processes can be performed in the YUV color space, and jitter processes can be performed in the red-green-blue (RGB) color space. The image signal processor 130 can send image data obtained after post-processing to the memory 220 (e.g., a display buffer). The display 110 can display the image data stored in the memory 220 (e.g., the display buffer) on the display screen under the control of the processor 210.

[0058] In this embodiment, processor 210 can execute / control various functions supported by electronic device 100. For example, processor 210 can execute code written in a programming language stored in memory 220, thereby enabling it to execute applications and control various hardware. For example, processor 210 can execute applications that support shooting functions stored in memory 220. Additionally, processor 210 can configure and support appropriate shooting modes to execute camera modules (e.g., Figure 1 (camera module 180), and allows the camera module 180 to perform operations desired by the user.

[0059] In one embodiment, executable instructions of processor 210 may be stored in memory 220. Memory 220 can be conceptually understood to include components for temporary data storage (e.g., random access memory (RAM)) and / or components for permanent data storage (e.g., solid-state drive (SSD)). For example, processor 210 may implement software modules in RAM space by calling instructions stored in the SSD. In one or more embodiments, memory 220 may include various types and may adopt an appropriate type depending on the purpose of the device.

[0060] In an embodiment, an application related to the camera module can be stored in the memory 220. For example, a camera application can be stored in the memory 220. The camera application can support various photographing functions such as photo shooting, video shooting, panorama shooting, slow motion shooting, and the like.

[0061] In an embodiment, the processor 210 can display content such as an execution screen of an application executed by the processor 210, or an image and / or a video stored in the memory 220, on the display 110. In addition, the processor 210 can display image data acquired through the camera module 180 on the display 110 in real time.

[0062] Figure 3 A path of acquiring light information in the electronic device 100 according to an embodiment is illustrated.

[0063] In an embodiment, the light information can be provided to the image signal processor 130 or the processor 210 through the color filter array 310, the photodiode 320 (light receiving unit or light receiver), and the data operation unit (data operator) 330. The processor 210 (or the image signal processor 130) can acquire image data including color values.

[0064] In an embodiment, the color filter array 310 can be an array of small color filters that can overlap with each pixel of the image sensor 120 and filter the captured light by wavelength. For example, the color filter array 310 can be a Bayer color filter array configured to provide a filter pattern of 50% green color filter, 25% red color filter, and 25% blue color filter. The image sensor 120 using the Bayer color filter array can obtain information on intensity of light received by the lens assembly 111 and color values based on green, red, and blue wavelengths. Green, red, and blue are merely examples of color values, and the color values are not limited. The color values can be at least one among red, green, blue, yellow, emerald green, white, cyan, and magenta. According to one or more embodiments, the color filter array 310 can include a color filter array of a pattern of red, green, blue, emerald green (RGBE) pattern, cyan, yellow, yellow, magenta (CYYM) pattern, cyan, yellow, green, magenta (CYGM) pattern, or red, green, blue, and white (RGBW) pattern. The image sensor 120 can acquire light information including at least all of the visible light wavelength regions through various example color filter patterns.

[0065] In an embodiment, the photodiode 320 (light receiving unit) can be electrically connected to the color filter array 310. For example, a circuit such as a metal wiring can be configured between the photodiode 320 and the color filter array 310.

[0066] In an embodiment, the photodiodes 320 can include pixels separated by optical or electrical insulation structures to prevent crosstalk between wavelengths. The photodiodes 320 can react to produce electrons and generate an analog signal when light enters thereto.

[0067] In an embodiment, the pixels of the photodiodes 320 can be arranged to correspond to the individual color filters of the color filter array 310. For example, the pixels of the photodiodes 320 can be arranged such that the number and size of the pixels of the photodiodes 320 are the same as the number and size of the individual color filters of the color filter array 310.

[0068] In an embodiment, the size of each pixel of the photodiodes 320 can not be the same as the size of one color filter. Each pixel of the photodiodes 320 can be set to have a size smaller than the size of an individual color filter. Each pixel of the photodiodes 320 can be arranged to be an equally divided size in the individual color filters. For example, each pixel of the photodiodes 320 can be arranged to correspond to one color filter in various shapes, such as 2x2 or 3x3.

[0069] In an embodiment, the data operation unit 330 can perform a data operation such as binning to obtain RGB values. The data operation can be performed before analog-digital conversion (ADC) and can be performed before pre-processing of the image signal processor 130 via a sensor interface. Binning can be divided into analog binning and digital binning. Analog binning can refer to outputting an average value of color values of each individual pixel using an analog circuit. Digital binning can refer to converting color values of a plurality of individual pixels converted into a digital signal into one color value by using a predetermined formula. That is, binning can include averaging adjacent groups of the same color pixels in each frame of original image data.

[0070] Figure 4 A frequency domain in which colors can be represented via the color filter array 310 of the Bayer pattern in the image sensor 120 of the electronic device 100 according to an embodiment is illustrated.

[0071] In an embodiment, the region 410 briefly illustrates a resolution in which green can be represented by using a Nyquist frequency. The region 410 illustrates that a resolution of 1 / 2 of all pixels of the image sensor 120 can be represented in green.

[0072] In an embodiment, the region 420 is a brief representation of a resolution in which red or blue can be represented by using a Nyquist frequency. The region 420 illustrates that a resolution of 1 / 4 of all pixels of the image sensor 120 can be represented in red or blue. As illustrated in the region 420, a range of the resolution in which red or blue can be represented is 1 / 2 of a range of the resolution in which green can be represented.

[0073] In an embodiment, the region 430 is a brief representation of resolution at which the image sensor 120 can output red, green, and blue by using Nyquist frequency reduction of phase shift. The region 430 can have a resolution of 1 / 16 of all pixels of the image sensor 120.

[0074] In the present embodiment, the region 440 can show a region of wasted red and blue pixels. When R, G, and B are output in the region 430 which is narrower than the region 420 in which red and blue can be represented, red and blue can have as much resolution loss as the region 440, and green can have as much resolution loss as the region of the region 410 other than the region 430.

[0075] Figure 5 A color filter array 310 and a unit pixel 510 in the electronic device 100 according to an embodiment are shown.

[0076] In an embodiment, Figure 5 A color filter array 310 which can be implemented as a pattern which is tilted by 45 degrees with respect to a Bayer pattern output from the image sensor 120 is shown.

[0077] The color filter array 310 can include a plurality of color filters having a first grid pattern (solid line). Referring to Figure 5 A pixel array having a second grid pattern (dotted line) which forms a 45-degree angle with respect to the first grid pattern can be defined. Unit pixels 510 of the pixel array can form a 45-degree angle with respect to a single pixel of the color filter array 310. The unit pixels 510 can be effective pixels which are represented in an image.

[0078] In an embodiment, the unit pixels 510 can be a quadrangular region circumscribed with a color representative filter, or a larger quadrangular region. The color representative can be, for example, green of an RGBG filter, yellow of a CYYM filter, or white. Alternatively, the color representative can be any one among red, blue, emerald green, cyan, and magenta according to a pattern of the color filter array.

[0079] In an embodiment, the unit pixels 510 can include a color representative filter. The unit pixels 510 can include at least two among all colors included in the color filter array. For example, the unit pixels 510 can correspond not only to a green filter but also to a portion of a red filter and a portion of a blue filter.

[0080] In an embodiment, when the binning process is performed in the image sensor 120 or the image signal processor 130, the "B" filter (which can also be a color filter) and the "E" filter can have the same color to prevent color phase shift. The "C" filter and the "D" filter can have the same color. For example, the "A" filter can be a green color filter, the "B" filter and the "E" filter can be a red color filter, and the "C" filter and the "D" filter can be a blue color filter. Alternatively, the "A" filter can be a yellow color filter, the "B" filter and the "E" filter can be a cyan color filter, and the "C" filter and the "D" filter can be a magenta color filter. This example is merely an embodiment, and various arrangements of the filters can be made at the level of a person skilled in the art according to the pattern of the color filter array 310.

[0081] In an embodiment, at least one among the A filter to the E filter can be a white color filter. When the color filter array 310 includes a white color filter, the entire visible light region can pass through the color filter array 310, thereby helping to improve sensitivity.

[0082] Figure 6 A unit pixel 610 and a frequency representation region are illustrated in a case where a photographing resolution of the electronic device 100 is a first resolution according to an embodiment. In an embodiment, the first resolution can be 48 Mp (million pixels).

[0083] Reference Figure 6 In an embodiment, the color filter array 310 can include a plurality of color filters having a first grid pattern (solid line) in (a). The plurality of color filters can be implemented in a quadrangular shape.

[0084] In an embodiment, the image signal processor 130 can acquire image data via a pixel array having a second grid pattern (dotted line) formed at an angle of 45 degrees with respect to the first grid pattern.

[0085] In an embodiment, the image sensor 120 can determine a unit pixel 610 in the color filter array 310. The unit pixel 610 can have a quadrangular shape circumscribed with a green color filter of the color filter array 310. The circumscribed quadrangle can be a square. The unit pixel 610 can be repeatedly arranged to correspond to the second grid pattern. The size of the area of the unit pixel 610 can be twice the size of a single green color filter included in the color filter array 310.

[0086] In an embodiment, the unit pixel 610 can include a first region corresponding to a green color filter, a second region defined by the green color filter being in contact with the unit pixel 610 and corresponding to the outside of the first region, a third region, a fourth region, and a fifth region.

[0087] In an embodiment, the unit pixel can include one green color filter area, 1 / 4 area of a red color filter, and 1 / 4 area of a blue color filter. For example, 1 / 4 area of a blue color filter can be provided in each of the second area and the fourth area, and 1 / 4 area of a red color filter can be provided in each of the third area and the fifth area. The opposite case can also be possible. This is only an embodiment, and the areas can be constructed by a cyan color filter, a yellow color filter, and a magenta color filter.

[0088] In an embodiment, the second area and the fourth area can be arranged to face each other with respect to the center of the first area. The third area and the fifth area can be arranged to face each other with respect to the center of the first area.

[0089] In an embodiment, the image sensor 120 can merge 1 / 4 areas corresponding to a red color filter. The image sensor 120 can merge 1 / 4 areas corresponding to a blue color filter. The merging process can be performed by the image signal processor 130.

[0090] In an embodiment, the image sensor 120 can output the merged color values. The image sensor 120 can average the color values of the pixels of the same color in the unit pixel 610 and output the averaged color values. The phase of the merged red color and the phase of the merged blue color can be the same as the phase of the green color. The image sensor 120 can output red, blue, and green without color phase change. The image signal processor 130 can perform image processing on the output image data while omitting the demosaicing process.

[0091] In an embodiment, the number of pixels of the image stored in the memory 220 via the image signal processor 130 can be the same as the number of green color filters. For example, in the case where the number of pixels of the image sensor 120 is 96 Mp, an image having about 48 Mp can be stored in the memory 220.

[0092] In an embodiment, compared to outputting an image of 48 Mp by an image sensor 120 having 48 Mp through a general Bayer pattern color filter array, according to the embodiment described in the disclosure, in the case where the same image of 48 Mp is output by an image sensor 120 having 96 Mp, it can have a frequency representation range of twice the wide area.

[0093] Reference Figure 6 In FIG. 6B, the frequency representation area 621 of the green color can be 1 / 2 of the frequency representation area 625 of all pixels of the image sensor 120. The frequency representation areas 623 of the red and blue colors can be 1 / 4 of the frequency representation area 625 of all pixels of the image sensor 120.

[0094] Figure 7aA photographed result image in a case where the photographing resolution of the electronic device 100 is a first resolution according to an embodiment is shown. In an embodiment, the first resolution is 48Mp.

[0095] In an embodiment, the distribution graph 710 and the distribution graph 715 show a histogram of an image in a case where the image sensor 120 outputs color values in a Bayer pattern and the image signal processor 130 performs demosaicing by bilinear interpolation.

[0096] In an embodiment, the distribution graph 720 and the distribution graph 725 show a histogram value of an image in a case where photographing is performed based on the embodiments of (a) and (b) of Figure 6

[0097] Compared to the distribution graph 710, the distribution graph 720 shows higher RGB values in 128-255. Compared to the distribution graph 715, the distribution graph 725 shows higher RGB values around 192. Thus, it can be seen that color expressiveness and brightness are superior in a case where photographing is performed based on the embodiments of (a) and (b) of Figure 6

[0098] Figure 7b A performance graph in a case where the photographing resolution of the electronic device 100 is a first resolution according to an embodiment is shown. In an embodiment, the first resolution is 48Mp. The performance graph shows a modulation transfer function (MTF) graph that provides both resolution information and contrast information. The horizontal axis of the graph can indicate a frequency, and the vertical axis can indicate an MTF value.

[0099] Referring to Figure 7b , the graph 730 is a performance graph in a case where the image sensor 120 outputs color values in a Bayer pattern and the image signal processor 130 performs demosaicing by bilinear interpolation. The graph 735 is a performance graph in a case where photographing is performed based on the embodiments of (a) and (b) of Figure 6

[0100] In an embodiment, Figure 7b The horizontal axis of the graph shown in

[0101] ​​​In an embodiment, a frequency representation range according to the MTF value is wider in the graph 735 than in the graph 730. For example, when the MTF value is 0.1 (10%), the graph 730 can represent a frequency of about 0.3517 per pixel, and the graph 735 can represent a frequency of about 0.6384 per pixel. In other words, it can be seen that the sharpness of an image can be improved when capturing an image based on the embodiments of (a) and (b) of FIG. 7. Figure 6

[0102] Figure 8 (a) and (b) of FIG. 7 show unit pixels and a frequency representation region according to an embodiment when the photographing resolution of the electronic device 100 is a second resolution (i.e., four times the first resolution). In an embodiment, the second frequency can be 192 Mp.

[0103] Referring to Figure 8 (a) of FIG. 7, in an embodiment, the color filter array 310 can include a plurality of color filters having a first grid pattern (solid line). The plurality of color filters can be implemented in a quadrangular shape.

[0104] In an embodiment, the image signal processor 130 can acquire image data via a pixel arrangement having a second grid pattern (thick solid line) formed at an angle of 45 degrees with respect to the first grid pattern.

[0105] In an embodiment, the image sensor 120 can determine unit pixels 810, 820, and 830 in the color filter array 310. The unit pixel 810 can have a quadrangular shape inscribed in a single color filter. The unit pixels 820 and 830 can be quadrangles other than the unit pixel 810. The unit pixel 810 can be a square.

[0106] The unit pixel 810 can have a quadrangular shape inscribed in a green color filter in the color filter array 310. The unit pixel 850 can have a quadrangular shape inscribed in a red color filter. Alternatively, the unit pixel 810 can have a quadrangular shape inscribed in a blue color filter. The unit pixel 810 can be a square.

[0107] The unit pixels 810, 820, and 830 can be repeatedly arranged to correspond to the second grid pattern. The size of the area of the unit pixel 810 can be 1 / 2 of the size of a single color filter included in the color filter array 310.

[0108] ​In an embodiment, the unit pixel 810 can include an area corresponding to one green color filter. The unit pixel 820 and the unit pixel 830 can include 1 / 2 area corresponding to a green color filter, 1 / 4 area corresponding to a red color filter, and 1 / 4 area corresponding to a blue color filter. This is merely an embodiment, and the area can correspond to a cyan color filter, a yellow color filter, and a magenta color filter.

[0109] In an embodiment, the image sensor 120 can output color values to correspond to a second grid pattern (dotted line) instead of a first grid pattern (solid line) of the color filter array 310. The image sensor 120 can output color values in a Bayer pattern that rotates the color filter array 310 by 45 degrees.

[0110] In an embodiment, the image sensor 120 can output a green color value via the unit pixel 810 inscribed in a single color filter.

[0111] In an embodiment, the image sensor 120 can perform interpolation by the unit pixel 820 using a portion of a blue color filter corresponding to the unit pixel 820. The image sensor 120 can output a blue color value by the unit pixel 820.

[0112] In an embodiment, the image sensor 120 can perform interpolation by the unit pixel 830 using a portion of a red color filter corresponding to the unit pixel 830. The image sensor 120 can output a red color value by the unit pixel 830.

[0113] In an embodiment, the interpolation process can be referred to as a re-Bayer process, and can be performed by the image signal processor 130.

[0114] In an embodiment, the image signal processor 130 can display an image having a pixel number twice that of the image sensor 120 through the display 110. For example, an image sensor 120 having 96Mp can output about 192Mp of image data via a re-Bayer process. The re-Bayer process can be a rearrangement process to construct a Bayer pattern from an arrangement of unit pixels, and thus output color values. The re-Bayer process can be performed by referring to adjacent pixel information to perform interpolation, or by determining an edge portion in an image and weighting color values to perform interpolation.

[0115] In an embodiment, the image signal processor 130 can acquire a green color value by the unit pixel 810. The image signal processor 130 can acquire light information absorbed by a green color filter corresponding to the unit pixel 810 by the unit pixel 810.

[0116] In an embodiment, the image signal processor 130 can acquire a blue value through the unit pixel 820. The image signal processor 130 can acquire an interpolated blue value with reference to adjacent pixel information or information of an edge of an image.

[0117] In an embodiment, the image signal processor 130 can acquire a red value through the unit pixel 830. The image signal processor 130 can acquire an interpolated red value with reference to adjacent pixel information or information of an edge of an image.

[0118] In an embodiment, the image signal processor 130 can acquire a blue value through the unit pixel 840. The image signal processor 130 can acquire a green value with reference to a color value of an adjacent green color filter from the unit pixel 840.

[0119] In an embodiment, the number of pixels of an image stored in the memory 220 by the image signal processor 130 can be twice the number of green color filters. For example, in the case where the number of pixels of the image sensor 120 is 96Mp, an image of about 192Mp can be stored in the memory 220.

[0120] Referring to Figure 8 of (b), the frequency representation area 861 of the green pixel can be 1 / 2 of the frequency representation area 865 of all pixels of the image sensor 120. The frequency representation areas 863 of the red pixel and the blue pixel can be 1 / 4 of the frequency representation area 865 of all pixels of the image sensor 120.

[0121] Figure 9 A photographed result image in the case where the photographing resolution of the electronic device 100 is a second resolution according to an embodiment is illustrated. In an embodiment, the second frequency can be 192Mp.

[0122] In an embodiment, the distribution graph 910 and the distribution graph 915 illustrate histogram values of an image in the case where the image sensor 120 outputs color values in a Bayer pattern and then performs photographing. The Bayer pattern can be implemented through interpolation with reference to adjacent pixel information in a tetrahedron pattern.

[0123] In an embodiment, the distribution graph 920 and the distribution graph 925 illustrate histogram values of an image in the case where photographing is performed based on the embodiment of (a) and (b) of Figure 8 .

[0124] When comparing distribution plot 920 and distribution plot 910, the RGB values ​​of the former can be larger or similar to those of the latter overall. When comparing distribution plot 925 and distribution plot 915, the RGB values ​​of the former can be larger or similar to those of the latter overall.

[0125] Figure 10 (a) and (b) show the unit pixel and frequency representation area according to an embodiment when the shooting resolution of the electronic device 100 is a third resolution (i.e., one-quarter of the first resolution). In an embodiment, the third resolution may be 12Mp.

[0126] In the embodiment, with Figure 6 Compared to (a) and (b), Figure 10 In (a) and (b), the unit pixel 1010 can have an increased area. The area of ​​the unit pixel 1010 is not limited to this and can be further increased, as long as there is no phase change in color.

[0127] refer to Figure 10 In embodiment (a), the color filter array 310 may include a plurality of color filters having a first grid pattern (solid lines). The plurality of color filters may be implemented in a quadrilateral shape.

[0128] In one embodiment, the image signal processor 130 can acquire image data via a pixel arrangement having a second grid pattern (thick solid lines) forming a 45-degree angle with respect to the first grid pattern.

[0129] In one embodiment, the image sensor 120 can determine unit pixels 1010 in the color filter array 310. Unit pixels 1010 can have a quadrilateral shape circumscribed by four individual pixels of the color filter array surrounding a green color filter. Unit pixels 1010 can be repeatedly arranged to correspond to a second grid pattern. The area of ​​a unit pixel 1010 can be eight times the size of a single green color filter included in the color filter array 310. In another embodiment, unit pixels 1010 can include twice the area of ​​a green color filter, four times the area of ​​a blue color filter, and four times the area of ​​a red color filter.

[0130] In an embodiment, unit pixel 1010 may include a first region corresponding to one green filter, a second region corresponding to two red filters, a third region corresponding to two blue filters, and a fourth region defined by the contact between the red and blue filters and unit pixel 1010, and corresponding to the exterior of the first, second, and third regions. The fourth region may correspond to a portion of the green filter.

[0131] In an embodiment, the image sensor 120 can merge regions corresponding to red color filters. The image sensor 120 can merge regions corresponding to blue color filters. The merging process can also be performed by the image signal processor 130.

[0132] In an embodiment, the image sensor 120 can output merged color values. The image sensor 120 can average color values of pixels of the same color among the unit pixels 1010 and output the averaged color values. The phase of the merged red color and the phase of the merged blue color can be the same as the phase of the green color. The image sensor 120 can output red, blue, and green colors without color phase shift. The image signal processor 130 can perform image processing on the output image data while omitting the mosaic process.

[0133] In an embodiment, the number of pixels of an image stored in the memory 220 by the image signal processor 130 can be 1 / 4 of the number of green color filters. For example, in the case where the number of pixels of the image sensor 120 is 96 Mp, an image of about 12 Mp can be stored in the memory 220.

[0134] Reference Figure 10 With reference to (b) of FIG. 11, the frequency representation region 1021 of the green pixel, the red pixel, and the blue pixel can be 1 / 8 of the frequency representation region 1023 of all pixels of the image sensor 120.

[0135] Figure 11 A photographed result image in the case where the photographing resolution of the electronic device 100 is a third resolution according to an embodiment is illustrated. In an embodiment, the third resolution can be 12 Mp.

[0136] In an embodiment, the distribution graph 1100 and the distribution graph 1115 illustrate histogram values of an image in the case where photographing is performed without color phase shift in a tetrahedral pixel structure.

[0137] In an embodiment, the distribution graph 1120 and the distribution graph 1125 illustrate histogram values of an image in the case where photographing is performed based on the embodiment of (a) and (b) of FIG. 11. Figure 10

[0138] When the distribution graph 1120 is compared with the distribution graph 1110, it can be seen that the intensity of the RGB values of the former is similar to that of the latter as a whole. When the distribution graph 1125 is compared with the distribution graph 1115, it can be seen that the intensity of the RGB values of the former is similar to that of the latter as a whole.

[0139] Figure 12 A shape and an arrangement of color filters according to an embodiment are illustrated. Figure 12 The shape and the arrangement of the color filters described in the above-described embodiments can be applied to​Figure 13 to Figure 16 In the following text, Figure 13 , Figure 14 and Figure 16 The embodiments shown illustrate how pixel saturation can be altered by changing the structure and arrangement of color filters.

[0140] In an embodiment, the color filter array 310 (included in the image sensor 120) may include color filters of different sizes. For example, the image sensor 120 may include small pixels with low sensitivity and large pixels with high sensitivity, the small and large pixels having different sensitivities according to their size. Pixels with low sensitivity may perform color saturation later than large pixels with high sensitivity. Small pixels with low sensitivity may be pixels corresponding to quadrilateral color filters, and large pixels with high sensitivity may be pixels corresponding to octagonal color filters. When the color saturation rate is slowed down, the dynamic range (DR) can be widened. With increased DR, the electronic device 100 can acquire images representing a wider range of colors from dark to bright areas.

[0141] In an embodiment, the color filter array 310 may include a first octagonal filter 1211 to a fifth octagonal filter 1215. The color filter array 310 may also include a first quadrilateral filter 1221 to a fourth quadrilateral filter 1224. The first octagonal filters 1211 to 1215, and the first quadrilateral filters 1221 to 1224 may refer to color filters. The color may be RGB, RGBW, CYM, or CYMK.

[0142] In an embodiment, the first octagonal filter 1211 may include a first edge 1231 having a first length, a second edge 1232 having a second length, a third edge 1233 having a first length, a fourth edge 1234 having a second length, a fifth edge 1235 having a first length, a sixth edge 1236 having a second length, a seventh edge 1237 having a first length, and an eighth edge 1238 having a second length. The first length may be the same as the second length. The first length may be longer than the second length. For example, the first length may be about 0.7 μm, and the second length may be about 0.416 μm. Conversely, the first length may be shorter than the second length.

[0143] In an embodiment, the second octagon filter 1212 can share the second edge 1232 with the first octagon filter 1211. The third octagon filter 1213 can share the fourth edge 1234 with the first octagon filter 1211. The fourth octagon filter 1214 can share the sixth edge 1236 with the first octagon filter 1211. The fifth octagon filter 1215 can share the eighth edge 1238 with the first octagon filter 1211. The first quadrangle filter 1221 can share the first edge 1231 with the first octagon filter 1211. The second quadrangle filter 1222 can share the third edge 1233 with the first octagon filter 1211. The third quadrangle filter 1223 can share the fifth edge 1235 with the first octagon filter 1211.

[0144] In an embodiment, the second octagon filter 1212 can be disposed in a diagonal direction (e.g., a second direction) with respect to the first octagon filter 1211. The second octagon filter 1212 can be disposed in contact with the first octagon filter 1211. The diagonal direction (e.g., the second direction) can refer to a direction pointing from a center 1241 of the first octagon filter 1211 to a center 1242 of the second octagon filter 1212.

[0145] In an embodiment, the third octagon filter 1213 can be disposed in a diagonal direction (e.g., a direction opposite to the fourth direction) with respect to the first octagon filter 1211. The third octagon filter 1213 can be disposed in contact with the first octagon filter 1211. The diagonal direction (e.g., the direction opposite to the fourth direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to a center 1243 of the third octagon filter 1213.

[0146] In an embodiment, the fourth octagon filter 1214 can be disposed in a diagonal direction (e.g., a direction opposite to the second direction) with respect to the first octagon filter 1211. The fourth octagon filter 1214 can be disposed in contact with the first octagon filter 1211. The diagonal direction (e.g., the direction opposite to the second direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to a center 1244 of the fourth octagon filter 1214.

[0147] In an embodiment, the fifth octagon filter 1215 can be disposed in a diagonal direction (e.g., a fourth direction) with respect to the first octagon filter 1211. The fifth octagon filter 1215 can be disposed to be in contact with the first octagon filter 1211. The diagonal direction (e.g., the fourth direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to the center 1245 of the fifth octagon filter 1215.

[0148] In an embodiment, the first quadrangle filter 1221 can be disposed in a vertical direction (e.g., a third direction) with respect to the first octagon filter 1211. The first quadrangle filter 1221 can be disposed to be in contact with the first octagon filter 1211. The vertical direction (e.g., the third direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to the center 1251 of the first quadrangle filter 1221.

[0149] In an embodiment, the second quadrangle filter 1222 can be disposed in a horizontal direction (e.g., a first direction) with respect to the first octagon filter 1211. The second quadrangle filter 1222 can be disposed to be in contact with the first octagon filter 1211. The horizontal direction (e.g., the first direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to the center 1252 of the second quadrangle filter 1222.

[0150] In an embodiment, the third quadrangle filter 1223 can be disposed in a vertical direction (e.g., a direction opposite to the third direction) with respect to the first octagon filter 1211. The third quadrangle filter 1223 can be disposed to be in contact with the first octagon filter 1211. The vertical direction (e.g., the direction opposite to the third direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to the center 1253 of the third quadrangle filter 1223.

[0151] In an embodiment, the fourth quadrangle filter 1224 can be disposed in a horizontal direction (e.g., a direction opposite to the first direction) with respect to the first octagon filter 1211. The fourth quadrangle filter 1224 can be disposed to be in contact with the first octagon filter 1211. The horizontal direction (e.g., the direction opposite to the first direction) can refer to a direction pointing from the center 1241 of the first octagon filter 1211 to the center 1254 of the fourth quadrangle filter 1224.

[0152] In an embodiment, a unit pixel 1260 can be constructed in which the center 1242 of the second octagonal filter 1212, the center 1243 of the third octagonal filter 1213, the center 1244 of the fourth octagonal filter 1214, and the center 1245 of the fifth octagonal filter 1215 are connected. The unit pixel 1260 can include the first octagonal filter 1211. The unit pixel 1260 can include 1 / 2 portions of the first to fourth quadrangular filters 1221 to 1224. The unit pixel 1260 can include 1 / 4 portions of the second to fifth octagonal filters 1212 to 1215. The boundary of the unit pixel 1260 can overlap with the center 1251 of the first quadrangular filter 1221, the center 1252 of the second quadrangular filter 1222, the center 1253 of the third quadrangular filter 1223, and the center 1254 of the fourth quadrangular filter 1224.

[0153] In an embodiment, Figure 8 The contents of the above-described embodiments can be applied to the unit pixel 1260. The unit pixel 1260 can be constructed as a quadrangle inscribed in the octagonal filter. For example, the unit pixel 1260 can be defined as a quadrangle constructed by connecting the center point of the first edge 1231, the center point of the second edge 1232, the center point of the third edge 1233, and the center point of the fourth edge 1234.

[0154] In an embodiment, Figure 10 The contents of (a) and (b) of the above-described embodiments can be applied to the unit pixel 1260. The unit pixel 1260 can be constructed as a quadrangle circumscribed with the plurality of quadrangular color filters and the plurality of octagonal color filters.

[0155] In an embodiment, the first octagonal filter 1211, the second octagonal filter 1212, the third octagonal filter 1213, the fourth octagonal filter 1214, and the fifth octagonal filter 1215 can be green color filters. The second quadrangular filter 1222 and the fourth quadrangular filter 1224 can be red color filters. The first quadrangular filter 1221 and the third quadrangular filter 1223 can be blue color filters. This can be applied to Figure 13 .

[0156] In an embodiment, the first octagonal filter 1211, the first quadrangular filter 1221, the second quadrangular filter 1222, the third quadrangular filter 1223, and the fourth quadrangular filter 1224 can be green color filters. The second octagonal filter 1212 and the fourth octagonal filter 1214 can be blue color filters. The third octagonal filter 1213 and the fifth octagonal filter 1215 can be red color filters. This can be applied to Figure 14 .

[0157] In an embodiment, the first octagonal filter 1211, the second quadrangular filter 1222, and the fourth quadrangular filter 1224 can be green color filters. The third quadrangular filter 1223, the third octagonal filter 1213, and the fifth octagonal filter 1215 can be red color filters. The first quadrangular filter 1221, the second octagonal filter 1212, and the fourth octagonal filter 1214 can be blue color filters. This can apply to Figure 16 .

[0158] In an embodiment, by arranging quadrangular color filters between octagonal color filters as shown in FIG. 11B, Figure 12 , the electronic device 100 can acquire a high dynamic range (HDR) image having an extended DR. In other words, at the time of photographing an image, the image can be expressed in a wider range of luminance from dark to bright.

[0159] Figure 13 A color filter array 310 according to an embodiment is illustrated. Figure 12 The description in Figure 13 . The unit pixels 1310 of Figure 13 may correspond to the unit pixels 1260 of Figure 12 . The first row and the first column described in Figure 13 may be at least one edge of the color filter array.

[0160] In an embodiment, the octagonal color filter can be a green color filter. Referring to Figure 13 , the octagonal color filter can be arranged in odd number of rows x odd number of columns, and even number of rows x even number of columns. For example, the octagonal color filter can be arranged in 1x1, 3x5, 4x8, etc.

[0161] In an embodiment, a portion of the quadrangular color filter can be a red color filter. The quadrangular color filter arranged in odd number of rows x even number of columns can be a red color filter. For example, the red color filter can be arranged in 1x2, 1x6, 7x2, etc.

[0162] In an embodiment, a portion of the quadrangular color filter can be a blue color filter. The quadrangular color filter arranged in even number of rows x odd number of columns can be a blue color filter. For example, the blue color filter can be arranged in 2x5, 4x1, 6x3, etc.

[0163] In an embodiment, the unit pixel 1310 can include an octagonal green color filter in the center thereof. The unit pixel 1310 can include a portion of the octagonal green color filter in a diagonal direction (e.g., the second direction, a direction opposite to the second direction, the fourth direction, and a direction opposite to the fourth direction) with respect to the center of the unit pixel 1310. The unit pixel 1310 can include a portion of a quadrangular red color filter in a horizontal direction (e.g., the first direction and a direction opposite to the first direction) with respect to the center of the unit pixel 1310. The unit pixel 1310 can include a portion of a quadrangular blue color filter in a vertical direction (e.g., the third direction and a direction opposite to the third direction) with respect to the center of the unit pixel 1310.

[0164] In an embodiment, the unit pixel 1310 can construct a grid pattern and be repeatedly arranged as shown in Figure 13 . The image sensor 120 can output color values corresponding to the unit pixels 1310. The image signal processor 130 can acquire the color values corresponding to the unit pixels 1310 to perform image processing.

[0165] In an embodiment, the arrangement of the quadrangular color filters between the octagonal color filters as shown in Figure 13 may allow the green color filter having high sensitivity to occupy a region of a plurality of image sensors, thereby increasing the sensitivity of the image sensor 120.

[0166] Figure 14 A color filter array 310 according to an embodiment is illustrated. Figure 12 The description in Figure 14 may be applied to Figure 14 the unit pixels 1410 of Figure 12 . Figure 14 The first row and the first column described in may be at least one edge of the color filter array.

[0167] In an embodiment, the color filters arranged in the odd-numbered rows or the odd-numbered columns can be green color filters. The green color filters can have an octagonal shape or a quadrangular shape. The octagonal green color filters can be arranged in odd-numbered rows × odd-numbered columns. For example, the octagonal green color filters can be arranged in 1 × 3, 3 × 7, 5 × 3, etc. The quadrangular green color filters can be arranged in odd-numbered rows × even-numbered columns, and / or even-numbered rows × odd-numbered columns.

[0168] In an embodiment, the octagonal color filters arranged in the even-numbered rows can be red color filters or blue color filters. The octagonal color filters arranged in the even-numbered rows can be arranged to allow the red color filters and the blue color filters to be arranged alternately and repeatedly one after another. For example, the red color filters can be arranged in 2x3, 2x6, 2x10, and the blue color filters can be arranged in 2x4, 2x8, 2x12. The red color filters and the blue color filters can be arranged in a checkered shape on the color filter array.

[0169] In an embodiment, the unit pixel 1410 can include an octagonal green color filter in the center thereof. The unit pixel 1410 can include a portion of the octagonal green color filter ("G") in a diagonal direction (e.g., the second direction, a direction opposite to the second direction, the fourth direction, and a direction opposite to the fourth direction) with respect to the center of the unit pixel 1410. The unit pixel 1410 can include a portion of the octagonal red color filter ("R") in a horizontal direction (e.g., the first direction and a direction opposite to the first direction) with respect to the center of the unit pixel 1410. The unit pixel 1410 can include a portion of the octagonal blue color filter ("B") in a vertical direction (e.g., the third direction and a direction opposite to the third direction) with respect to the center of the unit pixel 1410.

[0170] In an embodiment, the unit pixel 1410 can construct a grid pattern, and be arranged repeatedly as shown in Figure 14 In an embodiment, the unit pixel 1410 can construct a grid pattern, and be arranged repeatedly as shown in

[0171] Figure 15 is a graph showing saturation of R, G, and B color values with respect to time in a case where the color filter array 310 in the electronic device 100 is constructed as a Bayer pattern according to an embodiment.

[0172] Referring to Figure 15 , the image sensor 120 can receive light information and acquire color values through the color filter array 310. The pixels included in the image sensor 120 can have different color saturations according to the color values. For example, a green color value can be saturated within 4 msec after the pixels receive the light information. A red color value can be saturated within 8.5 msec after the pixels receive the light information. A blue color value can be saturated within 9 msec after the pixels receive the light information.

[0173] In this embodiment, if a predetermined time has elapsed after receiving light information through the color filter, the pixel cannot output a color value. For example, if 4 msec has elapsed after receiving light information through the color filter, the pixel cannot represent a green value. If 8.5 msec has elapsed after receiving light information through the color filter, the pixel cannot represent a red value. If 9 msec has elapsed after receiving light information through the color filter, the pixel cannot represent a blue value.

[0174] In this embodiment, the saturation time for each color can vary depending on the shooting environment. For example, when shooting under red light, the red color can saturate faster than other colors.

[0175] In the embodiments, color distortion may occur when the saturation time for each color is different. For example, in Figure 15 At 5 msec on the timeline, green may already be saturated, while red and blue may not yet be saturated. In the case of shooting skies and forests, color reproducibility is improved when RGB colors are represented, but color reproducibility may decrease when the green color is not fully represented.

[0176] In the embodiments, in the description Figure 14 You can refer to this at the time. Figure 15 The curve graph. In Figure 14 In this context, the quadrilateral green filter is smaller than the octagonal green filter, and therefore may take longer to reach color saturation. Therefore, the image signal processor 130 can perform HDR processing using light that has already passed through the red and blue filters, as well as light that has passed through the unsaturated quadrilateral green filter.

[0177] Figure 16 A color filter array 310 according to an embodiment is shown. Figure 13 The description in can be applied to Figure 16 . Figure 16 The unit pixel 1610 can correspond to Figure 13 The unit pixel is 1360. Figure 16 The first row and first column described herein can be at least one edge of the color filter array.

[0178] In this embodiment, the color filters arranged in odd-numbered rows can be green color filters. The color filters arranged in even-numbered rows can be blue color filters or red color filters.

[0179] In an embodiment, the green filters arranged in odd-numbered rows may include quadrilateral filters and octagonal filters. The octagonal and quadrilateral filters arranged in odd-numbered rows may be arranged alternately and repeatedly. For example, as... Figure 16As shown in FIG. 10, the octagonal color filter and the quadrangular color filter can be repeatedly arranged such that the octagonal color filter is disposed in the first row and the first column, the quadrangular color filter is disposed in the first row and the second column, the octagonal color filter is disposed in the first row and the third column, the quadrangular color filter is disposed in the first row and the fourth column, and so on. Such a pattern can be equally applied to odd-numbered rows such as the third row, the fifth row, the seventh row, and so on.

[0180] In an embodiment, one quadrangular red color filter disposed in an even-numbered row and one octagonal red color filter in contact with the quadrangular red color filter in a horizontal direction (e.g., the first direction) of the red color filter can constitute a first group. One quadrangular blue color filter disposed in an even-numbered row and one octagonal blue color filter in contact with the quadrangular blue color filter in a horizontal direction (e.g., the first direction) of the blue color filter can constitute a second group.

[0181] In an embodiment, the first group and the second group can be alternately and repeatedly arranged one after another. For example, as shown in FIG. 11, the first group and the second group can be arranged in the form of [first group, second group, first group, second group, and so on] in the horizontal direction (e.g., the first direction). The first group and the second group can be arranged in a checkerboard shape on the color filter array. Figure 16

[0182] In an embodiment, the unit pixel 1610 can include an octagonal green color filter in the center thereof. The unit pixel 1610 can include a portion of a red color filter in a diagonal direction (e.g., the fourth direction and a direction opposite to the fourth direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a blue color filter in a diagonal direction (e.g., the second direction and a direction opposite to the second direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a green color filter in a horizontal direction (e.g., the first direction and a direction opposite to the first direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a blue color filter in a vertical direction (e.g., the third direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a red color filter in a vertical direction (e.g., a direction opposite to the third direction).

[0183] In an embodiment, the unit pixel 1610 can constitute a grid pattern and be repeatedly arranged as shown in FIG. 12. Figure 16 As shown in FIG. 12, the unit pixel 1610 can include an octagonal green color filter in the center thereof. The unit pixel 1610 can include a portion of a red color filter in a diagonal direction (e.g., the fourth direction and a direction opposite to the fourth direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a blue color filter in a diagonal direction (e.g., the second direction and a direction opposite to the second direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a green color filter in a horizontal direction (e.g., the first direction and a direction opposite to the first direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a blue color filter in a vertical direction (e.g., the third direction) with respect to the center of the unit pixel 1610. The unit pixel 1610 can include a portion of a red color filter in a vertical direction (e.g., a direction opposite to the third direction).

[0184] In an embodiment, referring to FIG. 13, Figure 16 ​, the image sensor 120 includes both small filters (e.g., quad-shaped filters) and large filters (e.g., octagonal-shaped filters) for each color, relative to green filters, red filters, and blue filters, and thus can represent a wider range of colors from bright parts to dark parts. In other words, according to an embodiment as in Figure 16 , the image signal processor 130 can perform HDR processing.

[0185] Figure 17 Images (a), (b), and (c) taken based on one or more embodiments are shown. Figure 17 (a) of FIG. 1 can be an image taken based on an embodiment of FIG. Figure 16 (a) of FIG. 1 can be an image taken based on an embodiment of FIG. Figure 17 (b) of FIG. 1 can be an image taken based on an embodiment of FIG. Figure 14 (b) of FIG. 1 can be an image taken based on an embodiment of FIG. Figure 17 (c) of FIG. 1 can be an image taken based on a filter array of a Bayer pattern (rather than a filter array including octagonal-shaped filters).

[0186] Referring to Figure 17 , color representation of bright parts and dark parts can be performed more clearly in (a) and (b) than in (c). In (a) of FIG. Figure 17 , color representation of bright parts and dark parts can be performed more clearly in (a) than in (b). For example, under the bright sky in (a) of FIG. Figure 17 , the power transmission tower 1710 and the hair 1720 can be clearly seen. In contrast, under the bright sky in (c) of FIG. Figure 17 , the power transmission tower 1710 and the hair 1720 can not be clearly seen.

[0187] Figure 18 is a block diagram illustrating an electronic device 1801 in a network environment 1800 according to one or more embodiments.

[0188] Referring to Figure 18The electronic device 1801 in the network environment 1800 can communicate with an electronic device 1802 via a first network 1898 (e.g., a short-range wireless communication network), or an electronic device 1804 or a server 1808 via a second network 1899 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 1801 can communicate with the electronic device 1804 via the server 1808. According to an embodiment, the electronic device 1801 can include a processor 1820, a memory 1830, an input module 1850, a sound output module 1855, a display module 1860, an audio module 1870, a sensor module 1876, an interface 1877, a connection terminal 1878, a haptic module 1879, a camera module 1880, a power management module 1888, a battery 1989, a communication module 1890, a subscriber identification module (SIM) 1896, or an antenna module 1897. In some embodiments, at least one (e.g., the connection terminal 1878) of the aforementioned components can be omitted from the electronic device 1801, or one or more other components can be added in the electronic device 1801. In some embodiments, some of the aforementioned components (e.g., the sensor module 1876, the camera module 1880, or the antenna module 1897) can be implemented as a single component (e.g., the display module 1860).

[0189] The processor 1820, for example, can execute software (e.g., a program 1840) to control at least one other component (e.g., a hardware or software component) of the electronic device 1801 coupled with the processor 1820 and can perform various data processing or computation. According to one embodiment, as at least part of the data processing or computation, the processor 1820 can store a command or data received from another component (e.g., the sensor module 1876 or the communication module 1890) in the volatile memory 1832, process the command or the data stored in the volatile memory 1832, and store at least a part of the resulting data in the non-volatile memory 1834. According to an embodiment, the processor 1820 can include a main processor 1821 (e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor 1823 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 1821. For example, when the electronic device 1801 includes the main processor 1821 and the auxiliary processor 1823, the auxiliary processor 1823 can be adapted to consume less power than the main processor 1821, or to be dedicated to a specific function. The auxiliary processor 1823 can be implemented as separate from, or as part of, the main processor 1821.

[0190] The auxiliary processor 1823 (not the main processor 1821) can control at least some of the functions or states related to at least one component (for example, the display module 1860, the sensor module 1876, or the communication module 1890) among the components of the electronic device 1801 while the main processor 1821 is in an inactive (for example, sleep) state, or together with the main processor 1821, control at least some of the functions or states related to at least one component (for example, the display module 1860, the sensor module 1876, or the communication module 1890) among the components of the electronic device 1801 while the main processor 1821 is in an active state (for example, executing an application). According to an embodiment, the auxiliary processor 1823 (for example, an image signal processor or a communication processor) can be implemented as a part of another component (for example, the camera module 1880 or the communication module 1890) functionally related to the auxiliary processor 1823. According to an embodiment, the auxiliary processor 1823 (for example, a neural processing unit) can include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model can be generated through machine learning. For example, such learning can be performed by the electronic device 1801 where the artificial intelligence is executed or via a separate server (for example, the server 1808). The learning algorithm can include, but is not limited to, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model can include multiple artificial neural network layers. The artificial neural network can be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more thereof, but is not limited thereto. The artificial intelligence model can additionally or alternatively include a software structure other than the hardware structure.

[0191] The memory 1830 can store various data used by at least one component (for example, the processor 1820 or the sensor module 1876) of the electronic device 1801. The various data can include, for example, software (for example, a program 1840) and input data or output data with respect thereto. The memory 1830 can include the volatile memory 1832 or the non-volatile memory 1834.

[0192] The program 1840 can be stored in the memory 1830 as software, and can include, for example, an operating system (OS) 1842, middleware 1844, or an application 1846.

[0193] The input module 1850 can receive a command or data to be used by other component (e.g., the processor 1820) of the electronic device 1801, from the outside (e.g., a user) of the electronic device 1801. The input module 1850 can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0194] The sound output module 1855 can output sound signals to the outside of the electronic device 1801. The sound output module 1855 can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as playing multimedia or playing record. The receiver can be used to receive an incoming call. According to an embodiment, the receiver can be implemented as separate from the speaker, or implemented as a part of the speaker.

[0195] The display module 1860 can visually provide information to the outside (e.g., a user) of the electronic device 1801. The display module 1860 can include, for example, a display, a hologram device, or a projector, and a control circuit for controlling a corresponding one of the display, the hologram device, and the projector. According to an embodiment, the display module 1860 can include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.

[0196] The audio module 1870 can convert a sound into an electrical signal and vice versa. According to an embodiment, the audio module 1870 can obtain the sound via the input module 1850, or output the sound via the sound output module 1855 or a headphone of an external electronic device (e.g., an electronic device 1802) directly (e.g., wiredly) or wirelessly coupled with the electronic device 1801.

[0197] The sensor module 1876 can detect an operational state (e.g., power or temperature) of the electronic device 1801 or an environmental state (e.g., a state of a user) external to the electronic device 1801, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 1876 can include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0198] The interface 1877 can support one or more designated protocols to be used for the electronic device 1801 to be coupled with the external electronic device (e.g., the electronic device 1802) directly (e.g., wiredly) or wirelessly. According to an embodiment, the interface 1877 can include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0199] The connection terminal 1878 can include a connector via which the electronic device 1801 can be physically connected with the external electronic device (e.g., the electronic device 1802). According to an embodiment, the connection terminal 1878 can include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).

[0200] The haptic module 1879 can convert electrical signal into mechanical stimulation (e.g., vibration or movement) or electrical stimulus that can be recognized by a user via his tactile sensation or kinesthetic sensation. According to an embodiment, the haptic module 1879 can include, for example, a motor, a piezoelectric element, or an electric stimulator.

[0201] The camera module 1880 can capture still images or moving images. According to an embodiment, the camera module 1880 can include one or more lenses, image sensors, image signal processors, or flashes.

[0202] The power management module 1888 can manage power supplied to the electronic device 1801. According to one embodiment, the power management module 1888 can be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

[0203] The battery 1889 can supply power to at least one component of the electronic device 1801. According to an embodiment, the battery 1889 can include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.

[0204] The communication module 1890 can support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 1801 and an external electronic device (e.g., the electronic device 1802, the electronic device 1804, or the server 1808) and performing communication via the established communication channel. The communication module 1890 can include one or more communication processors that is operable independently from the processor 1820 (e.g., an application processor (AP)) and supports a direct (e.g., wired) communication or a wireless communication. According to an embodiment, the communication module 1890 can include a wireless communication module 1892 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1894 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can form a communication channel for communicating with an external electronic device according to a wired communication scheme or a wireless communication scheme. TMThe communication module 1892 can communicate with external electronic devices via a short-range communication network (such as Wi-Fi Direct or Infrared Data Association (IrDA)) or a second network 1899 (such as a long-range communication network such as a cellular network, 5G network, next-generation communication network, Internet, or computer network (such as a LAN or wide area network (WAN)). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components that are separate from each other (e.g., multiple chips). The wireless communication module 1892 can use user information (e.g., International Mobile Subscriber Identity (IMSI)) stored in the user identification module 1896 to identify and authenticate electronic devices 1801 in the communication network (e.g., a first network 1898 or a second network 1899).

[0205] Wireless communication module 1892 can support 5G networks following 4G networks, as well as next-generation communication technologies (such as new radio (NR) access technologies). NR access technologies can support enhanced mobile broadband (eMBB), massive machine-type communication (mMTC), or ultra-reliable low-latency communication (URLLC). Wireless communication module 1892 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 1892 can support various technologies used to ensure performance in high-frequency bands, such as, for example, beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 1892 can support various requirements specified in electronic device 1801, external electronic device (e.g., electronic device 1804), or network system (e.g., second network 1899). According to an embodiment, the wireless communication module 1892 may support peak data rates (e.g., 20 Gbps or greater) for implementing eMBB, lost coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip) for implementing URLLC.

[0206] The antenna module 1897 can transmit or receive a signal or power to or from an external electronic device (e.g., an external electronic device) of the electronic device 1801. According to an embodiment, the antenna module 1897 can include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 1897 can include a plurality of antennas (e.g., array antennas). In this case, at least one antenna appropriate for a communication scheme used in a communication network, such as the first network 1898 or the second network 1899, can be selected from the plurality of antennas by, for example, the communication module 1890 (e.g., the wireless communication module 1892). Then, the signal or the power can be transmitted or received between the communication module 1890 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element can be additionally formed as part of the antenna module 1897.

[0207] According to one or more embodiments, the antenna module 1897 can form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module can include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., a bottom surface) of the printed circuit board, or adjacent to the first surface, and is capable of supporting a designated high frequency band (e.g., a millimeter wave band), and the plurality of antennas is disposed on a second surface (e.g., a top surface or a side surface) of the printed circuit board, or adjacent to the second surface, and is capable of transmitting or receiving a signal of the designated high frequency band.

[0208] At least some of the above-described components can be coupled mutually, and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).

[0209] According to an embodiment, commands or data can be transmitted or received between the electronic device 1801 and an external electronic device 1804 via the server 1808 coupled with the second network 1899. Each of the electronic devices 1802 or 1804 can be a device of a same type as or different from the electronic device 1801. According to an embodiment, all or some of the operations to be executed at the electronic device 1801 can be executed at one or more of the external electronic devices 1802, 1804, or 1808. For example, if the electronic device 1801 is to perform a function or a service automatically, or in response to a request from a user or another device, the electronic device 1801, instead of, or in addition to, executing the function or the service, can request one or more of the external electronic devices to perform at least part of the function or the service. The external electronic device(s) that receive(s) the request can perform the requested function or service or an additional function or an additional service related to the request, and transfer an outcome of the execution to the electronic device 1801. The electronic device 1801 can provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing technique, a distributed computing technique, a mobile edge computing (MEC) technique, or a client-server computing technique can be used, for example. The electronic device 1801 can use, for example, a distributed computing or a mobile edge computing to provide a super-low latency service. In another embodiment, the external electronic device 1804 can include an Internet of Things (IoT) device. The server 1808 can be an intelligent server using machine learning and / or a neural network. According to an embodiment, the external electronic device 1804 or the server 1808 can be included in the second network 1899. The electronic device 1801 can be applied to intelligent services (e.g., smart home, smart city, smart car, or health care), based on 5G communication technologies or IoT-related technologies.

[0210] The electronic device according to one or more embodiments can be one of various types of electronic devices. The electronic devices can include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the disclosure, the electronic devices are not limited to the aforementioned devices.

[0211] It should be understood that the one or more embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to particular embodiments, but include various changes, equivalents or replacements of the corresponding technical features. In the description of the drawings, similar reference numerals can be used to refer to similar or related elements. It is to be understood that the singular forms “a,” “an,” and “the” include one or more plural forms unless the relevant context clearly dictates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C,” can include any one of the items enumerated together in the corresponding phrase. As used herein, terms such as “1st” and “2nd,” or “first” and “second” can be used to simply distinguish a corresponding component from another, and do not in other ways limit (e.g., in importance or sequence) the component. It is to be understood that if an element (for example, a first element) is “coupled with,” “coupled to,” or “connected with” another element (for example, a second element), it can be directly coupled with, to, or connected with the other element or be coupled with, to, or connected with the other element via a third element.

[0212] As used in connection with one or more embodiments of the present disclosure, the term “module” can include a unit implemented in hardware, software, or firmware, and can interchangeably be used with other terms such as “logic,” “logic block,” “part,” or “circuitry.” A module can be a single integral component, or a minimum unit or a part thereof, adapted to perform one or more functions. For example, according to an embodiment, a module can be implemented in a form of an application-specific integrated circuit (ASIC).

[0213] One or more embodiments set forth herein can be implemented as software (e.g., a program 1840) including one or more instructions that are stored in a storage medium (e.g., an internal memory 1836 or an external memory 1838) that is readable by a machine (e.g., the electronic device 1801). For example, a processor (e.g., the processor 1820) of the machine (e.g., the electronic device 1801) can invoke at least one of the one or more instructions stored in the storage medium, and the machine operates according to the invoked instruction(s). This allows the machine to perform at least one function. The one or more instructions can include a code generated by a compiler or an interpretable code. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. Herein, the term "non-transitory" simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave). However, the term "non-transitory" does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

[0214] According to an embodiment, a method according to one or more embodiments of the disclosure can be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed online via an application store (e.g., PlayStore®). If distributed online, at least part of the computer program product can be temporarily generated or at least temporarily stored in the machine-readable storage medium (e.g., memory of the manufacturer's server, a server of the application store, or a relay server), and then transmitted to the user device (e.g., smart phone). In this case, the manufacturer or the application store can update the server in real time or at regular intervals. TM

[0215] ​According to one or more embodiments, each of the above-described components (e.g., a module or a program) can include a single entity or multiple entities, and some of the multiple entities can be configured in different components. According to one or more embodiments, one or more of the above-described components can be omitted, or one or more other components can be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) can be integrated into a single component. In this case, according to one or more embodiments, the integrated component can still perform one or more functions of each of the plurality of components in the same or similar manner as when each of the plurality of components performs the one or more functions. According to one or more embodiments, operations performed by the module, the program, or another component can be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations can be executed in a different order or omitted, or one or more other operations can be added.

[0216] Figure 19 FIG. 19 is a block diagram 1900 illustrating a camera module 1880 according to one or more embodiments.

[0217] Referring to Figure 19 The camera module 1880 can include a lens assembly 1910, a flash 1920, an image sensor 1930, an image stabilizer 1940, a memory 1950 (e.g., a buffer memory), or an image signal processor 1960. The lens assembly 1910 can collect light emitted or reflected from an object of an image to be photographed. The lens assembly 1910 can include one or more lenses. According to an embodiment, the camera module 1880 can include a plurality of lens assemblies 1910. In this case, the camera module 1880 can form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies 1910 can have the same lens properties (e.g., angle of view, focal length, auto focus, f number, or optical zoom), or at least one lens assembly can have one or more lens properties different from the lens properties of the other lens assemblies. The lens assembly 1910 can include, for example, a wide-angle lens or a telephoto lens.

[0218] The flash 1920 can emit light for intensifying light reflected from an object. According to an embodiment, the flash 1920 can include one or more light emitting diodes (LEDs) (e.g., red green blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or a xenon lamp. The image sensor 1930 can obtain an image corresponding to an object by converting light emitted or reflected from the object and transmitted via the lens assembly 1910 into an electrical signal. According to an embodiment, the image sensor 1930 can include one image sensor selected from among a plurality of image sensors having different attributes (e.g., an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes. Each of the image sensors included in the image sensor 1930 can be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor.

[0219] The image stabilizer 1940 can move the image sensor 1930 or at least one lens included in the lens assembly 1910 in a certain direction or control an operable attribute of the image sensor 1930 (e.g., adjust a readout timing) in response to a movement of the camera module 1880 or the electronic device 1801 including the camera module 1880. This allows at least a portion of a negative effect (e.g., image blur) to be compensated for by a movement on a captured image. According to an embodiment, the image stabilizer 1940 can sense such a movement of the camera module 1880 or the electronic device 1801 using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 1880. According to an embodiment, the image stabilizer 1940 can be implemented as, for example, an optical image stabilizer.

[0220] The memory 1950 can at least temporarily store at least a portion of an image obtained via the image sensor 1930 for a subsequent image processing task. For example, if an image capture is delayed due to a shutter lag or a plurality of images are rapidly captured, an obtained raw image (e.g., a Bayer pattern image, a high-resolution image) can be stored in the memory 1950, and a corresponding copy image (e.g., a low-resolution image) thereof can be previewed via the display module 1860. Thereafter, if a specified condition (e.g., by a user's input or a system command) is satisfied, at least a portion of the raw image stored in the memory 1950 can be obtained and processed (e.g., by the image signal processor 1960). According to an embodiment, the memory 1950 can be configured as at least a portion of the memory 1830 or as a separate memory operating independently of the memory 1830.

[0221] Image signal processor 1960 can perform one or more image processing operations on an image acquired via image sensor 1930 or an image stored in memory 1950. The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image compositing, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, image signal processor 1960 can perform control (e.g., exposure time control or readout timing control) on at least one component included in camera module 1880 (e.g., image sensor 1930). The image processed by image signal processor 1960 can be stored back in memory 1950 for further processing, or the image can be provided to external components outside camera module 1880 (e.g., memory 1830, display module 1860, electronics 1802, electronics 1804, or server 1808). According to an embodiment, the image signal processor 1960 may be configured as at least a part of the processor 1820, or it may be configured as a separate processor operating independently of the processor 1820. If the image signal processor 1960 is configured as a separate processor from the processor 1820, at least one image processed by the image signal processor 1960 may be displayed by the processor 1820 via the display module 1860 either as is or after further processing.

[0222] According to an embodiment, the electronic device 1801 may include a plurality of camera modules 1880 with different attributes or functions. In this case, at least one of the plurality of camera modules 1880 may form, for example, a wide-angle camera, and at least another of the plurality of camera modules 1880 may form a telephoto camera. Similarly, at least one of the plurality of camera modules 1880 may form, for example, a front-facing camera, and at least another of the plurality of camera modules 1880 may form a rear-facing camera.

[0223] According to one or more embodiments, electronic device 100 may include: a color filter array including a plurality of color filters having a first grid pattern, an image sensor 120 including the color filter array, and at least one processor electrically connected to the image sensor 120. The at least one processor may be connected via unit pixels (e.g., ...) having a pixel array having a second grid pattern forming a 45-degree angle with respect to the first grid pattern. Figure 5 Image data is acquired using unit pixels (510). At least two color filters with different colors corresponding to the unit pixels may exist.

[0224] According to an embodiment, the unit pixels of the pixel array (e.g., Figure 6 The unit pixel 610 can have a quadrilateral shape that is external to the first color filter of the color filter array.

[0225] According to an embodiment, the first color filter may be at least one of a green color filter, a yellow color filter, and a white color filter.

[0226] According to an embodiment, a unit pixel (e.g., Figure 6 The unit pixel 610 may include a first region corresponding to the first color filter, a second region, a third region, a fourth region, and a fifth region defined by the contact between the first color filter and the unit pixel and corresponding to the outside of the first region. A portion of the second color filter may correspond to the second and fourth regions. A portion of the third color filter may correspond to the third and fifth regions.

[0227] According to an embodiment, the second and fourth regions can be arranged to face each other with respect to the center of the first region. The third and fifth regions can also be arranged to face each other with respect to the center of the first region.

[0228] According to the embodiment, the center point between the second region and the fourth region, the center point between the third region and the fifth region, and the center point of the first region can coincide with each other.

[0229] According to an embodiment, the colors of the second and third color filters can be different from each other. The corresponding colors of the second and third color filters can be at least one of red, green, blue, yellow, emerald green, white, cyan, and magenta.

[0230] In an embodiment, the unit pixels of the pixel array (e.g., Figure 10 The unit pixel 1010 can have a quadrilateral shape with four individual color filters surrounding the first color filter array.

[0231] In an embodiment, a unit pixel (e.g., Figure 10 The area of ​​a single pixel (1010) can be eight times the size of a single color filter.

[0232] In an embodiment, a unit pixel (e.g., Figure 10 The unit pixel 1010 may include an area four times that of the first color filter, an area twice that of the second color filter, and an area twice that of the third color filter.

[0233] In one or more embodiments, the electronic device 100 may include: a color filter array including a plurality of color filters having a first grid pattern, an image sensor 120 including the color filter array, and at least one processor electrically connected to the image sensor 120. The at least one processor may be connected via unit pixels (e.g., ...) of a pixel array having a second grid pattern forming a 45-degree angle with respect to the first grid pattern. Figure 8unit pixels (e.g., unit pixels 810) of the pixel array to acquire image data. The unit pixels of the pixel array (e.g., unit pixels 810, 820, 830, 840, and 850) can include a first region corresponding to a quadrangle inscribed in each color filter included in the plurality of color filters, and a second region corresponding to a quadrangle excluding the first region. Figure 8 The unit pixels (e.g., unit pixels 810, 820, 830, 840, and 850) of the pixel array can include a first region corresponding to a quadrangle inscribed in each color filter included in the plurality of color filters, and a second region corresponding to a quadrangle excluding the first region.

[0234] In an embodiment, the image sensor 120 can output a first color value through the first region, and output at least one of a second color value and a third color value through the second region. All regions of the visible light can be represented via a combination of the first color to the third color.

[0235] According to an embodiment, the unit pixels (e.g., unit pixels 810) of the pixel array can include a first region corresponding to a quadrangle inscribed in each color filter included in the plurality of color filters, and a second region corresponding to a quadrangle excluding the first region. Figure 8 The area of the unit pixels (e.g., unit pixels 810) can be 1 / 2 of the size of a single color filter.

[0236] According to one or more embodiments, the combination of the color filters can be a combination of a red color filter, a green color filter, and a blue color filter. The combination of the color filters can be a combination of a red color filter, a green color filter, a blue color filter, and a white color filter. The combination of the color filters can be a combination of a cyan color filter, a yellow color filter, and a magenta color filter. The combination of the color filters can be a combination of a cyan color filter, a yellow color filter, a magenta color filter, and a white color filter.

[0237] According to an embodiment, the first grid pattern and the second grid pattern can be a pattern in which a quadrangle is repeated.

[0238] According to one or more embodiments, the electronic device 100 can include a color filter array, an image sensor 120 including the color filter array, and at least one processor electrically connected to the image sensor 120. The color filter array can include a plurality of octagonal color filters and a plurality of quadrangular color filters. The at least one processor can acquire image data via unit pixels (e.g., unit pixels 1260) of a pixel array having a grid pattern, and represent all regions of the visible light via a combination of color filters corresponding to the unit pixels (e.g., unit pixels 1260). Figure 12 Figure 12 The combination of the color filters corresponding to the unit pixels (e.g., unit pixels 1260) can represent all regions of the visible light.

[0239] According to an embodiment, the plurality of octagonal color filters can include a first octagonal filter 1211 having a first size, a second octagonal filter 1212, a third octagonal filter 1213, a fourth octagonal filter 1214, and a fifth octagonal filter 1215. The plurality of quadrangular color filters can include a first quadrangular filter 1221 having a second size, a second quadrangular filter 1222, a third quadrangular filter 1223, and a fourth quadrangular filter 1224.

[0240] ​In an embodiment, the first octagonal filter 1211 can include first, third, fifth, and seventh edges 1231, 1233, 1235, and 1237 having a first length and spaced apart from each other, and second, fourth, sixth, and eighth edges 1232, 1234, 1236, and 1238 having a second length and connected between the first, third, fifth, and seventh edges 1231, 1233, 1235, and 1237, respectively. The second, third, fourth, and fifth octagonal filters 1212, 1213, 1214, and 1215 can be in contact with the second, fourth, sixth, and eighth edges 1232, 1234, 1236, and 1238, respectively.

[0241] The first, second, third, and fourth quadrangular filters 1221, 1222, 1223, and 1224 can be in contact with the first, third, fifth, and seventh edges 1231, 1233, 1235, and 1237, respectively. A unit pixel (e.g., a unit pixel 1260 of the pixel array) of the image sensor 1200 can be defined as a quadrangle configured by connecting the center 1242 of the second octagonal filter 1212, the center 1243 of the third octagonal filter 1213, the center 1244 of the fourth octagonal filter 1214, and the center 1245 of the fifth octagonal filter 1215. Figure 12

[0242] According to an embodiment, the second to fifth octagonal filters 1212, 1213, 1214, and 1215 are first color filters, the first and third quadrangular filters 1221 and 1223 are second color filters, the second and fourth quadrangular filters 1222 and 1224 are third color filters, and the processor 210 can represent all regions of visible light through a combination of the first to third colors.

[0243] In an embodiment, the second and fourth octagonal filters are first color filters, the third and fifth octagonal filters are second color filters, and the first to fourth quadrangular filters are third color filters, and the processor 210 can represent all regions of visible light through a combination of the first to third colors.

[0244] According to an embodiment, the second, fourth, and first quadrangular filters are first color filters, the third, fifth, and third quadrangular filters are second color filters, the second and fourth quadrangular filters are third color filters, and the processor 210 can represent all regions of visible light through a combination of the first to third colors.​

Claims

1. An electronic device comprising: a color filter array including a plurality of color filters having a first grid pattern; an image sensor including the color filter array; and at least one processor electrically connected to the image sensor, wherein the at least one processor is configured to acquire image data via a unit pixel of a pixel array having a second grid pattern that forms a 45-degree angle with respect to the first grid pattern, and wherein at least two color filters of the plurality of color filters have different colors, and the at least two color filters of the plurality of color filters correspond to the unit pixel, wherein each of the unit pixels of the pixel array has a quadrilateral shape circumscribing a first color filter of the plurality of color filters of the color filter array. the plurality of color filters further includes a second color filter, 2.The electronic device of claim 1, wherein, wherein one of the unit pixels corresponds to at least a portion of the second color filter and the first color filter. the first color filter is at least one color filter of a group including a green color filter, a yellow color filter, and a white color filter. 3.The electronic device of claim 1, wherein, 4.The electronic device of claim 1, wherein: each of the unit pixels includes a first region, a second region, a third region, a fourth region, and a fifth region, a portion of a plurality of second color filters corresponds to the second region and the fourth region, and a portion of a plurality of third color filters corresponds to the third region and the fifth region, the first region corresponds to the first color filter, the second region, the third region, the fourth region, and the fifth region are defined by the first color filter being in contact with the unit pixel, and the second region, the third region, the fourth region, and the fifth region correspond to an outside of the first region. 5.The electronic device of claim 4, wherein: the second region and the fourth region are arranged to face each other with respect to a first center point of the first region, and the third region and the fifth region are arranged to face each other with respect to a second center point of the first region. a first center point between the second region and the fourth region, a second center point between the third region and the fifth region, and a third center point of the first region coincide with each other.

6. The electronic device of claim 4, wherein, the plurality of second color filters and the plurality of third color filters are different from each other, and respective colors of the plurality of second color filters and the plurality of third color filters are at least one of red, green, blue, yellow, emerald, white, cyan, and magenta.

7. The electronic device of claim 4, wherein, the unit pixel in the pixel array has a quadrilateral shape circumscribing four individual color filters of the plurality of color filters of the color filter array around a first color filter.

8. The electronic device of claim 4, wherein, an area of the unit pixel is eight times a size of the individual color filter.

9. The electronic device of claim 8, wherein, an area of the unit pixel is twice an area of the first color filter, 10. The electronic device of claim 9, wherein, an area of the unit pixel is four times an area of the plurality of second color filters, and an area of the unit pixel is four times an area of the plurality of third color filters. 11.An electronic device comprising: ​ a color filter array including a plurality of color filters having a first grid pattern; an image sensor including the color filter array; and at least one processor electrically connected to the image sensor, wherein the at least one processor is configured to acquire image data via unit pixels in a pixel array having a second grid pattern that forms a 45-degree angle with respect to the first grid pattern, and wherein each unit pixel in the pixel array includes (i) a first region having a quadrilateral shape circumscribing a first color filter included in the plurality of color filters and (ii) a second region corresponding to a region excluding the first region.

12. The electronic device of claim 11, wherein, the image sensor outputs a first color value through the first region and at least one of a second color value and a third color value through the second region, and a plurality of combinations of the first color, the second color, and the third color represent all regions of visible light.

13. The electronic device of claim 11, wherein, An area of one of the unit pixels is 1 / 2 of a size of each color filter.

14. The electronic device of claim 11, wherein, a combination of the color filters is at least one combination among (i) a combination of a red color filter, a green color filter, and a blue color filter, (ii) a combination of a red color filter, a green color filter, a blue color filter, and a white color filter, (iii) a combination of a cyan color filter, a yellow color filter, and a magenta color filter, or (iv) a combination of a cyan color filter, a yellow color filter, a magenta color filter, and a white color filter.

15. The electronic device of claim 11, wherein, the first grid pattern or the second grid pattern is a pattern in which a quadrilateral is repeated.

Images