Method, image processor unit and computer program for processing image data of an image sensor

Abstract

The present invention discloses a method for processing image data of an image sensor, the image sensor comprising a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, a set of image pixel data comprising phase detection information of the phase detection pixels, and a step of calculating image pixel data for the predefined locations of the phase detection pixels according to either symmetric or asymmetric positioning of each phase detection pixel in a color channel is performed.

Description

[Technical Field]

[0001] The present invention relates to a method for processing image data of an image sensor, the image sensor comprising a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, and a set of image pixel data comprising phase detection information of the phase detection pixels.

[0002] The invention further relates to an image processor unit for processing image data of an image sensor and to a computer program comprising instructions which, when executed by the processing unit, cause the processing unit to process the image data of the image sensor according to the method described above.

[0003] The image sensor comprises a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, the image sensor providing the image pixel data at an input of the image processor unit, the set of image pixel data comprising phase detection information of the phase detection pixels. [Background technology]

[0004] Digital imagers are widely used in everyday products such as smartphones, tablets, notebooks, cameras, cars, and wearables. Many of the imaging systems in these products have an automatic focusing (AF) function to produce clear images / videos. The traditional approach to AF is based on contrast detection: the lens is moved to a position where the scene contrast is highest. Contrast AF is generally slow; therefore, to improve the speed and sometimes the accuracy of focusing, phase detection autofocus (PDAF) technology can be combined with contrast AF.

[0005] A PDAF sensor has so-called phase detection (PD) pixels distributed throughout the sensor area. Phase information derived from the phase detection pixels can be used to determine the focal length, which then drives the lens to move to a position with optimal focus; the process is typically very fast if the phase information is sufficiently accurate. The phase detection pixels are typically distributed periodically in the horizontal and vertical directions throughout the sensor. After extracting the phase information from these pixels, they must be concealed or corrected. Otherwise, they may appear as a mesh of clustered defects across the image. Therefore, to maintain high image quality, it is essential to have a phase detection pixel concealment (PPC) module in the image signal processor.

[0006] N. El-Yamany: “Robust Defect Pixel Detection and Correction for Bayer Imaging Systems,” in: IS&T International Symposium on Electronic Imaging 2017, pp. 46-51, discloses a method for identifying hot pixels, cold pixels, or a mixture of both types of singlets and couplets. If these pixels are not corrected early in the image processing pipeline, demosaicing and filtering operations will diffuse them and make them appear as colored clusters, which is detrimental to image quality. The method operates on raw data coming from a Bayer sensor. A defective pixel is identified if two conditions are met. The first condition checks whether the pixel is significantly different from its same-color neighbors in an S×S Bayer window centered on the pixel. The second condition tests whether the local luminance difference at a pixel is significantly higher (for a hot pixel) or lower (for a cold pixel) than the minimum local luminance difference per color channel when a 3x3 Bayer window is centered on the pixel.

[0007] Detected defective pixels are replaced with robust, detail-preserving estimates, which are determined through the use of directional filters.

[0008] E. Chang: “Kernel-size selection for defect pixel identification and correction”, in: Proc. SPIE 6502, Digital Photography III, 65020J, 20-02-2007 describes a bounding min-max filter with varying kernel size for defect pixel correction.

[0009] S. Wang, S. Yao, O. Faurie, and Z. Shi, "Adaptive defect correction and noise suppression module in the CIS image processing system," in: Proc. SPIE Int. Symposium on Photoelectronic Detection and Imaging, vol. 7384, pp. 73842V-1-6, describe a spatial adaptive noise suppression algorithm that combines defective pixel correction functions for implementation in a CMOS image sensor chip. A center-weighted median filter is provided to correct defective pixels. Random noise is processed separately according to their background detail level.

[0010] A. Tanbakuchi, A. van der Sijde, B. Dillen, A. Theuwissen and W. de Haan: “Adaptive pixel defect correction”, in: Proc. SPIE Sensors and Camera Systems for Scientific, Industrial and Digital Photography Applications IV, vol. 5017, pp. 360-370, 2003, presents a defect correction algorithm that uses raw Bayer image data. When a pixel in an image is found to be defective, neighboring pixels provide the best information to interpolate the defective pixel. Directional derivatives are used to correlate the nearest neighbor to the defect color plane.

[0011] M. Schoberi, J. Seiler, B. Kasper, S. Foessel and A. Kaup: “Sparsity-based detect pixel compensation for arbitrary camera raw images”, in: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1257-1260, 2011, discloses an algorithm for detecting defective pixels and interpolating missing values ​​for the defective pixels. Previously interpolated pixels are reused. Summary of the Invention

[0012] The object of the present invention is to provide an improved method and image processor unit, which provides a robust scheme for phase pixel hiding in imaging sensors in a generic framework, keeps computational complexity low and does not require any tuning or control parameters.

[0013] This object is achieved by a method comprising the features of claim 1, an image processor unit comprising the features of claim 9 and a computer program for processing comprising the features of claim 11. Preferred embodiments are disclosed in the dependent claims.

[0014] It is proposed to perform a step of calculating image pixel data for predefined locations of the phase detection pixels according to either symmetric or asymmetric positioning of the respective phase detection pixels in the color channels.

[0015] This allows for the correction of defective pixels with low computational complexity and without the need for any tuning or control parameters.

[0016] To provide image data at predefined locations of phase detection pixels to complete the image and avoid artifacts at predefined PD pixel locations, image pixel data is calculated for these locations. Raw image data from the image sensor is processed and missing image pixel data at the phase detection pixel locations are determined in two different ways depending on symmetric or asymmetric positioning of each phase detection pixel in each color channel.

[0017] The phase detection pixels can be positioned in one or more color channels in the color filter array of the image sensor, for example, in the B and W channels of an RGBW sensor or in the B channel in a standard Bayer sensor.

[0018] When the phase detection pixel is positioned in a color channel that exhibits symmetry, such as the W channel in an RGBW color channel arrangement, or the R, G, and B channels in a standard Bayer color channel arrangement, the image pixel data for the predefined location of the phase detection pixel is calculated in a first procedure specified for the symmetric color channel arrangement.

[0019] When the arrangement of the color channels is asymmetric, the image pixel data for the predefined positions of the phase detection pixels is calculated according to a second procedure.

[0020] From this it is crucial whether the phase detection pixel is positioned in a color channel that exhibits symmetry or in a color channel that exhibits asymmetry.

[0021] This enables robust phase detection pixel concealment without the need for pre-calibration or prior knowledge of the phase detection pixel behavior. No parameter tuning is required, and the computational complexity can be kept very low. Therefore, the method is suitable for real-time, resource-constrained image signal processing.

[0022] When the phase detection pixel is positioned asymmetrically in the color channel, i.e., the color channel exhibits asymmetry, the image pixel data can preferably be calculated according to adjacent image pixel values ​​of sensor pixels of the same color according to the color assigned to the position of the phase detection pixel.

[0023] Preferably, the image pixel data is calculated as an average value of the nearest neighboring image pixel values ​​of the same-color pixels located around the location of the selected phase detection pixel. For example, when the phase detection pixel is positioned in a color channel that does not exhibit symmetry, such as the R, G, or B channel in an RGBW color filter array pad or the R, G, and B channels in a Quad Bayer color filter array pattern, phase pixel concealment relies only on one step of nearest-neighbor concealment. The image pixel data for the location of the phase detection pixel is calculated as a robust estimate determined from the nearest neighbors of the phase detection pixel location. One possibility for such an estimate is, for example, the alpha-trimmed mean of the same-color pixels in the neighborhood of the pixel being concealed. Another possibility is a weighted average of those same-color neighbors.

[0024] In approved methods for calculating image pixel data for asymmetrically positioned phase-detected pixels, orientation or content-aware concealment can give better image quality than non-orientation correction. Therefore, when interpolating nearest neighbors, the interpolation strategy preferably tries to identify orientation as much as possible or takes into account content in the raw support of the pixel being corrected. An option is to weight the image pixel values ​​of nearest neighbors of the same color pixel.

[0025] To calculate image pixel data for phase detection pixels symmetrically positioned in each color channel, it is preferable to estimate image pixel data for phase detection pixels located in a predetermined area around each selected phase detection pixel selected for calculating associated pixel image data, identify a feature direction at the location of the selected phase detection pixel, and calculate the image pixel data according to interpolated pixel data located adjacent to the selected phase detection pixel in the identified feature direction.

[0026] Therefore, for a color channel exhibiting symmetry, a series of steps are performed to calculate image pixel data for the phase detection pixel location. Specifically, when the phase detection pixel is positioned in a color channel exhibiting symmetry, such as the W channel in an RGBW color filter array or the R, G, and B channels in a standard Bayer color filter array, directional estimation and correction are facilitated due to the symmetry. First, robust estimates are calculated for each of the phase detection pixel locations. Then, directional filtering is performed based on the identified feature directions. Allowed determination of robust estimates for phase detection pixels around the phase detection pixel location improves the quality of the directional filtering. The image pixel data for the phase detection pixel location is then calculated as directional occlusion or non-directional occlusion.

[0027] Preferably, each image pixel value is calculated according to pixel data located in a selected area adjacent to and surrounding the selected phase detection pixel when the feature direction cannot be identified.

[0028] Otherwise, the pixel value at the location of the selected phase detection pixel is calculated by using the neighboring pixel values ​​associated with the same color as the associated color channel assigned to the location of the selected phase detection pixel.

[0029] Preferably, in a first step, a symmetric or asymmetric arrangement of the phase detection pixels in the color channels is determined depending on color channel parameters.

[0030] The state of symmetric or asymmetric arrangement of the phase detection pixels can also be mentioned in advance and therefore known, so no decision step is required.

[0031] The phase-detection pixels can be positioned in the image sensor as clusters of connected pixels. Regardless of the color filter array or the particular arrangement of the phase-detection pixels, the input raw data can be processed in a first step to resolve the phase-detection clusters of pixels into singlets of phase-detection pixels per color channel, or into couplets in the case of larger clusters. The phase-detection clusters of pixels repeat periodically horizontally and vertically across the image sensor.

[0032] For example, it may be preferable to decompose a cluster of phase detection pixels into singlets and / or couplets, especially when the phase detection pixels periodically repeat in the horizontal and / or vertical directions of the image sensor area. For example, this may be done by decomposing a couplet of displaced detection pixels in a color channel (e.g., the B channel) into quadruplets in the same color channel (e.g., the B channel). Quadruplets may be further decomposed into four singlets in the same color channel. Two couplets may be decomposed into four singlets in the same color channel, for example. Many other decompositions of clusters into singlets and / or couplets are possible depending on the decomposition scheme. Each singlet phase detection pixel may have its own neighbors and may be occluded independently of other connected phase detection pixels.

[0033] The invention will now be described by way of example with the aid of the enclosed drawings, in which: [Brief explanation of the drawings]

[0034] [Figure 1] 1 shows exemplary phase detection pixel locations in an RGBW color filter array. [Figure 2] Example of a CMOS RGBW sensor with phase-detection pixels. [Figure 3] 1 is a flow diagram of a method for processing image data from an image sensor.

[0035] FIG. 1 shows a portion of an exemplary phase detection arrangement for RGBW color filter array data. The red (R), green (G), blue (B), and white (W) pixels and pixel locations in the 8×8 array are identified by numbers, and letters in parentheses identify the pixel's respective colors. A complete pattern can consist of blue blocks (1(B), 2(W), 3(B), 4(W); 9(W), 10(B), 11(W), 12(B); 17(B), 18(W), 19(B), 20(W); 25(W), 26(B), 27(W), 28(B)) each formed by a matrix of alternating blue and white pixels shown in a first 4×4 matrix on the upper left side of FIG. 1; green blocks (each formed by a matrix of alternating green and white pixels shown in a second 4×4 matrix on the upper right side of FIG. 1); and red blocks (each formed by a 4×4 matrix of alternating red and white pixels shown in a second 4×4 matrix on the lower right side of FIG. 1). A first line of a complete pattern may be formed by a sequence of alternating blue and green blocks, and an adjacent second line may be formed by a sequence of alternating green and red blocks. Such groups of first and second lines are repeated to form all lines of the pattern, e.g., the height and width of the pattern are determined by the length of the lines.

[0036] The phase detection pixels are identified by the thick frame.

[0037] At the location of the phase detection pixel, the respective assigned color image pixel value is missing, which has the effect of making defects in the image visible, especially after processing the raw sensor data.

[0038] The phase detection pixels arranged in each color channel form couplets. For example, four phase detection pixels in blue channels 1 (B), 10 (B), 19 (B), and 28 (B) form a quadruplet, while a first pair of phase detection pixels in white channels 2 (W) and 9 (W) form a first couplet, and a second pair of phase detection pixels in white channels 20 (W) and 27 (W) form a second couplet in the white channel. The problem then reduces to the concealment of a quadruplet in the blue channel and two couplets in the white channel. The four phase detection pixels in the blue channel (quadruplet) are corrected independently of the other four phase detection pixels in the white channel (two couplets).

[0039] 2 shows an example of a CMOS sensor with green G, red R, and blue B pixels and a pair of phase detection pixels PA, PB. The image sensor includes color sensors on pixels arranged in horizontal and vertical directions, where all colors are arranged in each line in those directions, as described in US 8,531,563 B2.

[0040] The phase detection pixels are located within the repeating 6x6 grid of green image pixel locations used in this exemplary image sensor.

[0041] To conceal image data for the associated color at the location of the phase detection pixel, the method distinguishes between the location of the phase detection pixel in a color channel that exhibits symmetry and the location of the phase detection pixel in a color channel that exhibits asymmetry.

[0042] However, the phase detection pixels can be positioned in one or more color channels in the color filter array, for example, in the B and W channels of an RGBW sensor as shown in FIG. 1, or in the B channel in a standard Bayer sensor.

[0043] In addition, the phase detection pixels can also be positioned as clusters of connected pixels as shown in FIGS.

[0044] Regardless of the particular arrangement of the color filter array and phase detection pixels, it is preferable to decompose the clusters of phase detection pixels that repeat periodically in the horizontal and vertical directions across the image sensor into singlets of phase detection pixels per color channel, or couplets in the case of large clusters.

[0045] For example, the phase detection pixels in the phase detection pixel arrangement shown in FIG. A) can be decomposed into quadruplets in the B channel, which can be further decomposed into four singlets in the B channel, or B) It can be resolved into two couplets in the W channel, which can be further resolved into four singlets in the W channel.

[0046] Each singlet phase detection pixel will have its own neighbors and will be occluded independently of other connected phase detection pixels.

[0047] FIG. 3 illustrates a method for processing image data of an image sensor, which comprises a sensor area of ​​a pixel matrix providing image pixel data, as exemplarily shown in FIGS.

[0048] The method distinguishes between phase detection pixels positioned in color channels that exhibit symmetry and phase detection pixels positioned in color channels that do not exhibit symmetry, i.e., asymmetric color channels.

[0049] The image pixel raw data is processed in step A) by the method of closest neighbors concealment when the phase detection pixel is located in a color channel that does not exhibit symmetry, which is the case for example for the R, G, or B channels in an RGBW color filter array pattern, or for the R, G, and B channels in a Quad Bayer color filter array pattern.

[0050] In step A), a robust estimate is used to conceal the phase-detection pixel. One possibility for such an estimate is, for example, calculating the alpha-trimmed average of pixels of the same color in the neighborhood of the pixel being concealed. Another possibility is a somewhat weighted average of those image pixels directly neighboring the phase-detection pixel that have the same color assigned to its position in the color filter array.

[0051] For example, to conceal a phase detection pixel PA(G) in the green color channel at a location at line 2, column 3 in FIG. 2, the image value for the displayed phase detection pixel is calculated by interpolating the four immediately neighboring image pixel values ​​of the green pixel at locations at line 1, column 4, line 2, column 2, line 3, columns 2 and 3.

[0052] Image quality can be improved by weighting neighboring image pixels of the same color according to their content or direction. This direction or content aware concealment attempts to identify the direction as much as possible or interpolates nearest neighbors using a strategy that takes into account the content in the raw support of the pixel being corrected.

[0053] The method depends on the color channel arrangement in the color filter array, and the path is selected either in step A) or in the sequence of steps B), C), and D) or E).

[0054] When the phase detection pixel is located in a color channel that exhibits symmetry, the upper path starting with step D) of non-directional intermediate concealment is selected. This is the case, for example, for a phase detection pixel located in the W channel in an RGBW color filter array, or in the R, G, and B channels in a standard Bayer color filter array. Symmetry facilitates directional estimation in the correction.

[0055] In step B), non-directional pre-concealment is performed: a robust estimate (pre-concealment) is calculated for each of the phase-detected pixels. All other non-phase-detected pixels are left untouched.

[0056] The purpose of this pre-occlusion, i.e., pre-processing in step B), is to provide a clean estimate of the median of the raw support around the occluded phase-detection pixel, which in turn facilitates robust orientation identification at the location of that phase-detection pixel without being disturbed by the presence of other phase-detection pixels in the raw support.

[0057] Let P_pd_est(x,y) denote a robust estimate of the PD pixel at location (x,y), where x and y are the pixel coordinates of the sensor. The raw support can be defined as an N×N window centered at pixel P(x,y), e.g., N=3 or 5. P_pd_est(x,y) must be robust to the presence of other same-color phase pixels in the raw window centered at P(x,y). Any robust estimate can be used, such as an alpha-trimmed mean (e.g., using a weighting factor alpha=2) of the same-color weighted image pixel values ​​around the PD pixel at location (x,y). The estimate may exclude other phase-detection pixels in the raw window, if necessary.

[0058] In the following step c), directional filtering is performed to identify feature directions. In this step, the goal is to identify feature directions at the location of the occluded phase detection pixel P(x,y). Therefore, directional filtering is performed on the pre-occlusion result. Specifically, at the location of the phase detection pixel, the pixel along with its same-color neighbors is convolved with a set of directional filters. Based on the maximum absolute response of the filter set, the feature direction is identified at the location of the phase detection pixel.

[0059] The number, size, and coefficients of the filters depend on several factors selected from: a) the number of directions that are planned to be identified and supported in the concealment scheme; b) the size of the raw support centered on the phase detection pixel; c) color filter array channel arrangement, and d) The type of filter (gradient-based or other).

[0060] Once the feature direction at each phase detection pixel position P(x,y) has been identified, the phase detection pixel P(x,y) is concealed in step D) by directional concealment along with interpolating image pixels assigned to colors along the identified direction. To reduce or eliminate the possibility of correction artifacts, the directional correction is typically restricted to a small neighborhood of the pixel. This may be, for example, restricted to an N×N window centered on the phase detection pixel P(x,y) to be concealed, e.g., N=3 or 5.

[0061] If the feature direction cannot be identified, e.g., in very smooth regions, a non-directional concealment step E) is performed instead of step D) by replacing the phase detection pixel P(x,y) with its robust estimate, e.g., P_pd_est(x,y). When concealing the phase detection pixel P(x,y) via direct interpolation in step D), if one or more phase detection pixels lie along the identified direction, its robust estimate P_pd_est(x,y) calculated in the pre-concealment step B) should be used to ensure a robust concealment result and achieve better image quality.

[0062] The disclosed method does not require knowledge of the values ​​of the phase detection pixels; only their locations are required. Also, no assumptions about the phase detection pixel behavior are required. This makes the method applicable to phase detection pixel hiding regardless of the type of color filter placed in front of the phase detection pixels and regardless of the accuracy in the color channels of the color channel array.

[0063] The corrected image pixel raw data is then further processed. (Addendum) (Appendix 1) 1. A method for processing image data of an image sensor, the image sensor comprising a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, a set of image pixel data comprising phase detection information for the phase detection pixels, the method comprising: The method is characterized by a step of calculating image pixel data for the predefined locations of the phase detection pixels according to either symmetric or asymmetric positioning of each of the phase detection pixels in each color channel. (Appendix 2) 2. The method of claim 1, wherein the image pixel data for asymmetrically positioned phase detection pixels in the color channel is calculated according to adjacent image pixel values ​​of sensor pixels of the same color, in accordance with a color assigned to the position of the phase detection pixel. (Appendix 3) 3. The method of claim 2, wherein the image pixel data is calculated as an average value of nearest neighbor image pixel values ​​of pixels of the same color located around the position of the selected phase detection pixel. (Appendix 4) a) calculating the image pixel data for symmetrically positioned phase detection pixels in a color channel, the calculation comprising: b) estimating image pixel data for phase detection pixels located in a predetermined area around each selected phase detection pixel selected in step a) for calculating associated pixel image data; and c) identifying feature directions at selected said phase detection pixel locations; d) calculating image pixel values ​​according to interpolated pixel data located adjacent to the selected phase detection pixel in the identified feature direction; The method according to any one of Appendices 1 to 3, wherein the calculation is performed by carrying out the following. (Appendix 5) 5. The method of claim 4, wherein each image pixel value is calculated according to pixel data located in a selected area adjacent to and surrounding the selected phase detection pixel when a feature direction cannot be identified in step c). (Appendix 6) 6. The method of claim 1, wherein the pixel value for the selected phase detection pixel location is calculated by using neighboring pixel values ​​associated with the same color as the associated color channel assigned to the selected phase detection pixel location. (Appendix 7) 7. The method of any one of claims 1 to 6, characterized by a first step of determining a symmetric or asymmetric arrangement of the phase detection pixels in the color channels depending on color channel parameters. (Appendix 8) 7. The method according to any one of claims 1 to 6, wherein a symmetric or asymmetric arrangement state of the phase detection pixels is preset. (Appendix 9) 1. An image processor unit for processing image data of an image sensor, the image sensor comprising a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, the image sensor providing image pixel data at an input of the image processor unit, the set of image pixel data comprising phase detection information of the phase detection pixels, characterized in that the image processor unit is configured for image pixel data calculated for the predefined locations of the phase detection pixels depending on either symmetric or asymmetric positioning of each of the phase detection pixels in a color channel. (Appendix 10) 10. The image processor unit of claim 9, wherein the image processor unit is configured to process image data by performing the steps of any one of claims 1 to 8. (Appendix 11) 9. A computer program comprising instructions which, when executed by a processing unit, cause the processing unit to perform the steps of the method according to any one of claims 1 to 8.

Claims

1. 1. A method for processing image data of an image sensor, the image sensor comprising a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, a set of image pixel data comprising phase detection information for the phase detection pixels, the method comprising: The method is characterized by selecting either a step of calculating image pixel data for the predefined locations of the phase detection pixels designated for a symmetric color channel arrangement when each of the phase detection pixels is positioned in a color channel that exhibits symmetry, or a step of calculating image pixel data for the predefined locations of the phase detection pixels designated for an asymmetric color channel arrangement when each of the phase detection pixels is positioned in a color channel that exhibits asymmetry.

2. 2. The method of claim 1, wherein the image pixel data for asymmetrically positioned phase detection pixels in the color channels is calculated according to adjacent image pixel values ​​of sensor pixels of the same color, according to a color assigned to the position of the phase detection pixel.

3. 3. The method of claim 2, wherein the image pixel data is calculated as an average value of nearest neighboring image pixel values ​​of pixels of the same color located around the position of the selected phase detection pixel.

4. a) calculating the image pixel data for symmetrically positioned phase detection pixels in a color channel, the calculation comprising: b) estimating image pixel data for phase detection pixels located in a predetermined area around each selected phase detection pixel selected in step a) for calculating associated pixel image data; c) identifying feature directions at the selected phase detection pixel locations; d) calculating image pixel values ​​according to interpolated pixel data located adjacent to the selected phase detection pixel in the identified feature direction; The method according to any one of claims 1 to 3, wherein the calculation is performed by:

5. 5. The method of claim 4, wherein each image pixel value is calculated according to the pixel data located in a selected area adjacent to and surrounding the selected phase detection pixel when a feature direction cannot be identified in step c).

6. 6. The method according to claim 1, wherein the pixel value for the location of the selected phase detection pixel is calculated by using neighboring pixel values ​​associated with the same color as the associated color channel assigned to the position of the selected phase detection pixel.

7. Method according to any one of claims 1 to 6, characterized by a first step of determining a symmetric or asymmetric arrangement of the phase detection pixels in a color channel depending on a color channel parameter.

8. The method according to any one of claims 1 to 6, wherein the state of the symmetric or asymmetric arrangement of the phase detection pixels is preset.

9. 1. An image processor unit for processing image data of an image sensor, the image sensor comprising a sensor area of ​​a pixel matrix providing image pixel data, the pixel matrix comprising phase detection pixels at predefined locations, the image sensor providing image pixel data at an input of the image processor unit, the set of image pixel data comprising phase detection information of the phase detection pixels, wherein the image processor unit is configured to select image pixel data calculated for the predefined locations of the phase detection pixels designated for a symmetric color channel arrangement when each of the phase detection pixels is positioned in a color channel exhibiting symmetry, or image pixel data calculated for the predefined locations of the phase detection pixels designated for an asymmetric color channel arrangement when each of the phase detection pixels is positioned in a color channel exhibiting asymmetricity.

10. Image processor unit according to claim 9, characterized in that the image processor unit is arranged to process image data by carrying out the steps according to any one of claims 1 to 8.

11. A computer program comprising instructions which, when executed by a processing unit, cause the processing unit to perform the steps of the method of any one of claims 1 to 8.

Images