Reading method and device of pd pixel in omni-directional phase focusing, medium and terminal

Abstract

A method and device for reading PD pixels in omnidirectional phase focusing, medium and terminal, the method for reading PD pixels in omnidirectional phase focusing comprises: selecting pixel units in a partial region from an image sensor pixel array in a pixel structure unit, wherein the image sensor pixel array comprises a plurality of blocks, and each block comprises a plurality of pixel structures; for the pixel units in the selected partial region, pixel merging reading is performed according to a preset merging mode; and PD data is obtained according to the merging reading result. The above scheme can improve the data processing rate when reading PD pixels in omnidirectional phase focusing.

Description

Technical Field

[0001] This invention relates to the field of image sensor technology, and in particular to a method, apparatus, medium, and terminal for reading PD pixels in omnidirectional phase focusing. Background Technology

[0002] With the increasing demands for focusing, phase detection autofocus (PDAF) has evolved into omnidirectional phase detection autofocus. In omnidirectional phase detection autofocus, all pixel units can be used as phase detection (PD) points for phase focusing. Image sensors capable of omnidirectional phase detection autofocus typically employ a four-pixel (4-cell) structure. Specifically, a four-pixel structure consists of 2×2 pixels of the same color. Each microlens covers one four-pixel structure, and four adjacent four-pixel structures are arranged in RGB order to form a block. Several blocks constitute the pixel array of the image sensor.

[0003] In existing omnidirectional phase focusing systems, phase information of all PD points needs to be output and reported, which results in a slow data processing rate. Summary of the Invention

[0004] The technical problem solved by the embodiments of the present invention is that in the existing omnidirectional phase focusing, it is necessary to output and report the phase information of all PD points, which results in a slow data processing rate.

[0005] To address the aforementioned technical problems, this invention provides a method for reading PD pixels in omnidirectional phase focusing, comprising: selecting pixel units within a portion of an image sensor pixel array, on a pixel structure basis, wherein the image sensor pixel array comprises several blocks, and each block comprises several pixel structures; performing pixel merging and reading on the selected pixel units within the portion of the array according to a preset merging method; and obtaining PD data based on the merging and reading results.

[0006] Optionally, selecting pixel units within a partial region from the image sensor pixel array includes: obtaining a region of interest, and selecting pixel units within a partial region from the image sensor pixel array based on the region of interest, wherein the partial region includes at least the region of interest.

[0007] Optionally, selecting pixel units within a portion of the image sensor pixel array includes: determining a scene type based on image data acquired by the image sensor pixel array; and selecting pixel units within a portion of the image sensor pixel array based on the scene type.

[0008] Optionally, selecting a block within a partial area from the image sensor pixel array based on the scene type includes: determining the area where the target object is located based on the scene type; determining the position of the area where the target object is located in the image sensor pixel array based on the area where the target object is located; determining the partial area based on the position of the area where the target object is located in the image sensor pixel array, and selecting pixel units of the partial area from the image sensor pixel array.

[0009] Optionally, selecting pixel units within a partial region from the image sensor pixel array includes: extracting P rows of pixel units from the image sensor pixel array according to a preset ratio, and using the extracted P rows of pixel units as pixel units within the partial region, where P is a positive integer and less than the total number of rows of pixel units in the image sensor pixel array; or, extracting Q columns of pixel units from the image sensor pixel array according to a preset ratio, and using the extracted Q columns of pixel units as pixel units within the partial region, where Q is a positive integer and less than the total number of columns of pixel units in the image sensor pixel array.

[0010] Optionally, the step of extracting P rows of pixel units from the image sensor pixel array includes: determining the extraction interval based on the relationship between the total number of rows in the image sensor pixel array and P; and extracting P rows of pixel units from the image sensor pixel array at intervals according to the determined extraction interval.

[0011] Optionally, the pixel merging and reading of pixel units within the selected region according to a preset merging method includes at least one of the following: alternating pixel merging and reading in the horizontal and vertical directions; sequentially merging and reading pixel units in the horizontal direction; sequentially merging and reading pixel units in the vertical direction; merging and reading pixel units at horizontal intervals; merging and reading pixel units at vertical intervals; and merging and reading pixel units in a diagonal direction.

[0012] Optionally, the step of alternately merging and reading pixels in the selected region along the horizontal and vertical directions includes: selecting pixels of a specified color channel within the selected region; and merging and reading pixels of the specified color channel within the selected region along the horizontal and vertical directions.

[0013] Optionally, each block includes a four-pixel structure arranged in RGB.

[0014] Optionally, obtaining PD data based on the merged read results includes: using the merged read results as the PD data; or, merging the merged read results once or multiple times, and using the result of the one or more merges as the PD data.

[0015] Optionally, for all pixel units in the pixel array of the image sensor, pixel merging is performed, with the pixel structure as the smallest processing unit, to obtain image data.

[0016] Optionally, the pixel structure consists of 2 n ×2 m It consists of pixels of the same color, where n and m are both natural numbers.

[0017] This invention also provides a device for reading PD pixels in omnidirectional phase focusing, comprising: a selection unit for selecting pixel units within a portion of an image sensor pixel array on a pixel structure basis, wherein the image sensor pixel array includes several blocks, and each block includes several pixel structures; a merging and reading unit for performing pixel merging and reading on the selected portion of the pixel units according to a preset merging method; and a PD data determination unit for obtaining PD data based on the merging and reading results.

[0018] This invention also provides a computer-readable storage medium, which is a non-volatile or non-transient storage medium, storing a computer program thereon. When the computer program is run by a processor, it executes the steps of the PD pixel reading method in any of the above-described omnidirectional phase focusing methods.

[0019] This invention also provides a terminal, including a memory and a processor. The memory stores a computer program that can run on the processor. When the processor runs the computer program, it executes the steps of the PD pixel reading method in any of the above-described omnidirectional phase focusing methods.

[0020] Compared with the prior art, the technical solution of the embodiments of the present invention has the following beneficial effects:

[0021] The PD pixel reading method in omnidirectional phase focusing provided by this invention involves selecting pixel units within a portion of the image sensor pixel array during PD pixel reading. For the selected pixel units within this portion, pixel merging is performed according to a preset merging method, and PD data is obtained based on the merging reading result. The image sensor pixel array includes several blocks, each block containing several pixel structures. Each block can serve as an omnidirectional phase focusing unit. By selecting pixel units within a portion of the image sensor pixel array, the number of pixel units is reduced. Furthermore, pixel merging is performed on the selected pixel units within this portion, and PD data is obtained based on the merging reading result. The number of PDs obtained through merging reading further reduces the data volume, thereby reducing data processing and output time and improving the data processing rate during PD data reading. Attached Figure Description

[0022] Figure 1 This is a flowchart of a method for reading PD pixels in an omnidirectional phase focusing system according to an embodiment of the present invention;

[0023] Figure 2 This is a schematic diagram showing the position of pixel units in a selected area of ​​an image sensor pixel array according to an embodiment of the present invention;

[0024] Figure 3 This is a schematic diagram of the structure of a block in an embodiment of the present invention;

[0025] Figure 4 This is a schematic diagram of pixel merging and reading in an embodiment of the present invention;

[0026] Figure 5 This is a schematic diagram of the structure of a PD pixel reading device in an omnidirectional phase focusing system according to an embodiment of the present invention. Detailed Implementation

[0027] As mentioned above, in omnidirectional phase detection autofocus, all pixels can be used as phase detection (PD) points for phase focusing. Image sensors capable of omnidirectional phase detection autofocus typically employ a four-pixel (4-cell) structure. Specifically, a four-pixel structure consists of 2×2 pixels of the same color. Each microlens covers one four-pixel structure, and four adjacent four-pixel structures are arranged in RGB order to form a block. Several blocks constitute the pixel array of the image sensor. In existing omnidirectional phase detection autofocus systems, the phase information of all PD points needs to be output and reported. This phase information reporting method suffers from a slow data processing speed.

[0028] To address the aforementioned issues, in this embodiment of the invention, the image sensor pixel array comprises several blocks, each block containing several pixel structures. Each block can serve as an omnidirectional phase focusing unit. By selecting pixel units within a portion of the image sensor pixel array, the number of pixel units is reduced. Furthermore, pixel merging and reading are performed on the selected pixel units within the portion of the array. PD data is obtained based on the merging and reading results. The number of PDs obtained through merging and reading can further reduce the data volume, thereby reducing data processing and output time and improving the data processing rate during PD data reading.

[0029] To make the above-mentioned objectives, features and beneficial effects of the embodiments of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0030] This invention provides a method for reading PD pixels in omnidirectional phase focusing, referring to... Figure 1 The present invention provides a flowchart of a method for reading PD pixels in omnidirectional phase focusing, wherein the method may include the following steps:

[0031] Step S11: Select pixel units within a portion of the image sensor pixel array, using pixel structure as the unit.

[0032] In a specific implementation, the image sensor pixel array includes several blocks, each block includes several pixel structures, and each block is an omnidirectional phase focusing unit.

[0033] In some non-limiting embodiments, each pixel structure can be composed of 2 n ×2 m It consists of pixel units of the same color, where n and m are both natural numbers. N is the number of pixel units in the row direction, and m is the number of pixel units in the column direction.

[0034] In practice, n and m can be equal or unequal, and can be configured based on one or more factors such as the type of image sensor, the block division method in the pixel array of the image sensor, and the type of pixel structure included in the block.

[0035] For example, when n = m = 1, the pixel structure consists of 2×2 pixel units of the same color. Examples of other values ​​for n and m are not provided here.

[0036] In specific implementation, regarding step S11, various methods can be used to select pixel units within a certain area from the image sensor. For ease of understanding, examples are given below.

[0037] In some non-limiting embodiments, a region of interest is obtained, and pixel units within a portion of the image sensor pixel array are selected based on the region of interest, wherein the portion of the region includes at least the region of interest.

[0038] The region of interest (ROI) can be determined in several ways. For example, it can be a pre-defined area, such as a specific region within the image sensor's pixel array. This designated area can be any region within the image sensor's pixel array, such as the center, the top-left, top-right, bottom-left, or bottom-right corner, or any other region within the array. These are just a few examples.

[0039] Furthermore, the scene type can be determined based on the image data acquired by the image sensor pixel array, and then the region of interest (ROI) can be determined based on the scene type. Scene types can include animal scenes, plant scenes, portrait scenes, landscape scenes, etc. For example, in an animal scene, the area where the animal is located is the ROI; in a portrait scene, the area where the person is located is the ROI; in a landscape scene, a pre-configured area can be designated as the ROI, or the ROI can be determined based on the brightness of the pixel units represented in the image data. Since the ROI differs in different scenes, that is, the subject to be highlighted differs in different types of scenes, determining the ROI based on the scene type can fully consider the ROI of different scene types, and while taking into account the data processing rate or efficiency during PD pixel reading, it can also achieve a better focusing effect.

[0040] For example, the area of ​​interest in focus is determined based on the focus area command input by the user during the focusing process. The focus area command is used to specify the area of ​​interest in focus. The focus area can also be determined based on the location where the user clicks on the user interface, which can be used to display a preview image.

[0041] It is understandable that other methods can be used to determine the region of interest, which will not be listed here.

[0042] In practice, after determining the region of interest, when selecting pixel units of a portion of the image sensor pixel array based on the region of interest, the pixel units within the region of interest can be used as the pixel units of the selected portion of the region. If there are pixel units of other regions outside the region of interest, the region of interest and its surrounding pixel units adjacent to the region of interest are used together as the pixel units of the selected portion of the region.

[0043] In other non-limiting embodiments, a scene type is determined based on image data acquired by the image sensor pixel array. Based on the scene type, pixel units within a portion of the image sensor pixel array are selected. Scene types may include animal scenes, plant scenes, portrait scenes, landscape scenes, etc.

[0044] Specifically, the region where the target object is located is determined according to the scene type; the position of the region where the target object is located in the image sensor pixel array is determined according to the region where the target object is located; the partial region is determined according to the position of the region where the target object is located in the image sensor pixel array, and pixel units of the partial region are selected from the image sensor pixel array.

[0045] For example, in an animal scene, pixels from a portion of the image sensor's pixel array can be selected as the pixel units for the area where the animal is located. Similarly, in a portrait scene, pixels from a portion of the image sensor's pixel array can be selected as the pixel units for the area where the person is located.

[0046] Since the area of ​​interest differs in different scenarios, that is, the subject to be highlighted differs in different types of scenarios, determining the area of ​​interest based on the scenario type can take into full account the area of ​​interest for different scenario types, and can better balance the focus effect while taking into account the efficiency of PD pixel reading.

[0047] In some other non-limiting embodiments, P rows of pixel units can be extracted from the image sensor pixel array according to a preset ratio, and the extracted P rows of pixel units can be used as pixel units in the partial region, where P is a positive integer and less than the total number of rows of pixel units in the image sensor pixel array.

[0048] For example, when extracting P rows of pixel units, P rows of pixel units can be randomly extracted from the image sensor pixel array.

[0049] For example, according to a set extraction interval, P rows of pixel units are extracted from the pixel array of the image sensor at intervals. The extraction interval can be determined based on the relationship between the total number of rows in the pixel array of the image sensor and P.

[0050] Furthermore, when selecting pixel units from a portion of the image sensor pixel array based on the region of interest (ROI), it can be first determined whether the total number of rows of pixel units in the ROI is greater than or equal to P. If the total number of rows is greater than or equal to P, pixel units within the ROI can be selected. If the total number of rows is less than P, some rows of pixel units can be selected from the ROI, and the remaining rows of pixel units in the remaining P rows are selected from the non-ROI region. The non-ROI region refers to the area in the image sensor pixel array other than the ROI region.

[0051] In some embodiments, the value of P can be related to the pixel structure and the pixel units contained within the pixel structure. If the pixel structure consists of 2 n ×2 m It consists of pixel units of the same color. P and n can be multiples of each other to effectively balance the data processing speed when reading PD data with the focus confirmation effect when based on P rows of pixel units.

[0052] Furthermore, when P and n are integer multiples of each other, the value of n can be used to determine which rows in the image sensor pixel array should be selected as the partial region. The row selection is performed with the pixel structure as the smallest processing unit. For example, P / n rows corresponding to pixel structures are extracted in units of pixel structure, resulting in a total of P rows.

[0053] Reference Figure 2 The present invention provides a schematic diagram of the position of pixel units in a selected region of an image sensor pixel array according to an embodiment of the present invention. Figure 2 The image sensor pixel array is arranged in 16 rows and 16 columns. The pixel array unit can be a 4-cell array, with the pixel structure as the smallest processing unit. A pixel structure can consist of 2×2 pixel units of the same color. (See reference...) Figure 3 This paper presents a schematic diagram of a block structure according to an embodiment of the present invention. A block may include four pixel structures. Taking an RGB Bayer array as an example, the pixel structures are: a red pixel structure (containing pixels R1, R2, R3, and R4), two green pixel structures (one green pixel structure containing Gr1, Gr2, Gr3, and Gr4, and the other green pixel structure containing Gb1, Gb2, Gb3, and Gb4), and a blue pixel structure (containing B1, B2, B3, and B4). Figure 2 The circles in the diagram represent microlenses.

[0054] Combination Figure 2When P=4, rows 2, 3, 10, and 11 can be selected from the image sensor pixel array as the selected partial region's pixel units. It is understood that the above examples are merely illustrative for ease of understanding; in practice, other rows can be selected. Furthermore, when the pixel structure type or the values ​​of n and m are different, the structure of the image sensor pixel array differs, and the final position of the selected partial region's pixel units within the image sensor pixel array differs; these details will not be elaborated upon here.

[0055] Furthermore, to further improve data processing efficiency during PD data reading, pixel units from a specified channel in row P can be selected, and these selected pixel units within the specified channel in row P can be used as the pixel units for the selected partial area. The specified channel can be the green channel. It is understood that the specified channel can also be the blue or red channel.

[0056] In some other non-limiting embodiments, Q columns of pixel units are extracted from the image sensor pixel array according to a preset ratio, and the extracted Q columns of pixel units are used as pixel units in the partial region, where Q is a positive integer and less than the total number of columns of pixel units in the image sensor pixel array.

[0057] When extracting Q columns of pixel units, Q columns of pixel units can be randomly extracted from the image sensor pixel array; alternatively, Q columns of pixel units can be extracted from the image sensor pixel array at set intervals. The extraction interval can be determined based on the relationship between the total number of columns in the image sensor pixel array and Q.

[0058] In some embodiments, the value of P can be related to the pixel structure and the pixel units contained within the pixel structure. If the pixel structure consists of 2 n ×2 m It consists of 4 rows of pixels of the same color, where n is the number of pixels in the row direction and m is the number of pixels in the column direction. Q and m can be multiples of each other to effectively balance the data processing speed during PD data reading with the focus confirmation effect based on the selected Q rows of pixels.

[0059] Furthermore, when Q is an integer multiple of m, the value of m can be used to determine which columns in the image sensor pixel array should be selected as the selected region. The selection of columns is based on the pixel structure as the smallest processing unit. For example, Q / m columns corresponding to pixel structures can be extracted, resulting in a total of Q columns.

[0060] Furthermore, to further improve data processing efficiency during PD data reading, pixel units of a specified channel in row Q can be selected, and these selected pixel units within the specified channel can be used as the pixel units for the selected partial area. The specified channel can be the green channel. It is understood that the specified channel can also be the blue or red channel.

[0061] In practice, each block consists of a four-pixel structure arranged in RGB.

[0062] Step S12: For the pixel units in the selected area, perform pixel merging and reading according to the preset merging method.

[0063] In practice, when performing pixel merging and reading according to a preset merging method, all or part of the pixel units within the selected region can participate in the pixel merging and reading.

[0064] In practice, step S12 can be implemented in various ways, specifically:

[0065] In some embodiments, for pixel units within a selected region, pixel merging and reading are performed alternately in the horizontal and vertical directions.

[0066] Furthermore, pixel units of a specified color channel within the aforementioned region are selected; these pixel units are then alternately merged and read in both horizontal and vertical directions. This approach improves the data processing speed during PD data reading while also ensuring the focusing effect obtained from the merged reading results.

[0067] In other embodiments, pixels are merged and read sequentially in the horizontal direction.

[0068] In some other embodiments, pixels are merged and read sequentially in the vertical direction.

[0069] In some other embodiments, pixels are merged and read at horizontal intervals.

[0070] In some other embodiments, pixels are merged and read at vertical intervals.

[0071] In some other embodiments, pixel merging is performed in a cross-diagonal direction.

[0072] In practice, pixel binning can be performed using one of the binning methods, or two or more of the methods mentioned above. For example, for pixel units within a selected area, pixel binning can be performed sequentially in a horizontal direction, which is the same as the row direction and can also be called the horizontal direction. Alternatively, for pixel units within a selected area, pixel binning can be performed at intervals in a vertical direction, which is the same as the column direction and can also be called the vertical direction. Another example is that for pixel units within a selected area, pixel binning can be performed partially in a horizontal direction and partially in a vertical direction.

[0073] In some embodiments, when at full size, all pixel units can be output and read, and the reading result can be used as PD data.

[0074] Step S13: Obtain PD data based on the merged reading results.

[0075] In some embodiments, the merged read results can be used as PD data.

[0076] In other embodiments, the merged read results can be merged once or multiple times, and the result after one or more mergings can be used as PD data.

[0077] For ease of understanding, the following will be used as an example. Figure 2 The second and third lines shown in the diagram illustrate pixel merging and reading. (Refer to...) Figure 4 A schematic diagram of pixel merging and reading is given. Taking the sequential merging in the horizontal direction as an example, the pixel structure is used as the smallest processing unit for pixel merging and reading. That is, in the first merging, within the same pixel structure, pixel units of the same color within the pixel structure are merged and read. In the second and subsequent pixel merging, one or more pixel structures with the same color can be merged once or multiple times according to the preset merging rules.

[0078] For row 2, perform a pixel merge read on the pixel units in columns 0 and 1, then perform a pixel merge read on the pixel units in columns 2 and 3, and so on, until the pixel units in columns 14 and 15 are read together. The result of this single pixel merge read can be used as the PD data. Furthermore, one or more pixel merge reads can be performed based on the result of the single pixel merge read. Continue referring to... Figure 4 , Figure 4During the secondary pixel merging read, adjacent pixel structures with the same color are merged and read again. It can be understood that during the secondary pixel merging read, all pixel structures with the same color in the second row can also be merged and read.

[0079] It should be noted that the above example is based on horizontal pixel merging and reading. Other specific implementation schemes for pixel merging will not be elaborated here. Please refer to the description in the above embodiment of horizontal pixel merging and reading.

[0080] In some embodiments, the result of pixel merging can be a grayscale value.

[0081] In practical implementation, for all pixel units in the pixel array of the image sensor, pixel structure is used as the smallest processing unit to merge pixels to obtain image data, thereby improving the efficiency of image data processing.

[0082] In some non-limiting embodiments, one or more colored pixel structures that satisfy the preset direction can be merged, using pixel structures as the smallest processing unit. This pixel merging can be performed once or multiple times. When performing multiple pixel merges, subsequent pixel merges can be based on the latest result of the previous merge. For example, a second pixel merge can be performed based on the result of the first merge, a third based on the result of the second merge, and so on, until the preset number of pixel merges is completed, resulting in image data.

[0083] As can be seen from the above, the PD pixel reading method in omnidirectional phase focusing provided by the embodiments of the present invention, when reading PD pixels, selects pixel units in a partial area from the image sensor pixel array, and performs pixel merging reading on the selected pixel units in a preset merging method, and obtains PD data based on the merging reading result. The image sensor pixel array includes several blocks, each block includes several pixel structures, and each block can be used as an omnidirectional phase focusing unit. By selecting pixel units in a partial area from the image sensor pixel array, the number of pixel units is reduced. In addition, the pixel units in the selected partial area are merged and read, and PD data is obtained based on the merging reading result. The number of PDs obtained by merging reading can further reduce the data volume, thereby reducing the data processing and output time and improving the data processing rate when reading PD data.

[0084] This invention also provides a device for reading PD pixels in omnidirectional phase focusing, see reference. Figure 5The present invention provides a schematic diagram of a PD pixel reading device in an omnidirectional phase focusing system, wherein the PD pixel reading device 50 in the omnidirectional phase focusing system may include:

[0085] The selection unit 51 is used to select pixel units within a certain region from the image sensor pixel array in units of pixel structures, wherein the image sensor pixel array includes several blocks, and each block includes several pixel structures.

[0086] The merging and reading unit 52 is used to merge and read pixels in a selected area according to a preset merging method.

[0087] PD data determination unit 53 is used to obtain PD data based on the merged reading results.

[0088] In specific implementation, the specific working process and working principle of the PD pixel reading device 50 in omnidirectional phase focusing can be found in the description of the PD pixel reading method in the above embodiments, and will not be repeated here.

[0089] This invention also provides a computer-readable storage medium, which is a non-volatile or non-transient storage medium, storing a computer program thereon. When the computer program is run by a processor, it executes the steps of the above-described omnidirectional phase focusing PD pixel reading method.

[0090] This invention also provides a terminal, including a memory and a processor. The memory stores a computer program that can run on the processor. When the processor runs the computer program, it executes the steps of the PD pixel reading method in any of the above-described omnidirectional phase focusing methods.

[0091] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in any computer-readable storage medium, which may include ROM, RAM, disk, or optical disk, etc.

[0092] While the present invention has been disclosed above, it is not limited thereto. Any person skilled in the art can make various modifications and alterations without departing from the spirit and scope of the invention; therefore, the scope of protection of the present invention should be determined by the scope defined in the claims.

Claims

1. A method for reading PD pixels in omnidirectional phase focusing, characterized in that, include: Pixel units within a portion of an image sensor pixel array are selected, with pixel structure as the unit. The image sensor pixel array comprises several blocks, and each block comprises several pixel structures. For the selected pixel units within a certain area, pixel merging and reading are performed according to a preset merging method; PD data is obtained based on the merged read results; The pixel merging and reading according to the preset merging method includes: performing pixel merging and reading according to the preset direction, taking the pixel structure as the smallest processing unit; in the first merging, within the same pixel structure, performing pixel merging and reading of pixel units of the same color within the pixel structure; in the second and subsequent pixel merging, performing pixel merging processing once or multiple times on one or more pixel structures with the same color according to the preset merging rules.

2. The method for reading PD pixels in omnidirectional phase focusing as described in claim 1, characterized in that, The step of selecting pixel units within a certain region from the image sensor pixel array includes: Obtain the region of interest in focus, and select pixel units within a portion of the image sensor pixel array based on the region of interest in focus, wherein the portion of the region of interest in focus includes at least the region of interest in focus.

3. The method for reading PD pixels in omnidirectional phase focusing as described in claim 1, characterized in that, The step of selecting pixel units within a certain region from the image sensor pixel array includes: The scene type is determined based on the image data acquired by the pixel array of the image sensor; Based on the scene type, pixel units within a certain region are selected from the image sensor pixel array.

4. The method for reading PD pixels in omnidirectional phase focusing as described in claim 3, characterized in that, The step of selecting a block within a certain region from the image sensor pixel array according to the scene type includes: Determine the area where the target object is located based on the scene type; Based on the region where the target object is located, determine the position of the region in the image sensor pixel array corresponding to the region where the target object is located; Based on the location of the target object in the image sensor pixel array, the partial region is determined, and pixel units of the partial region are selected from the image sensor pixel array.

5. The method for reading PD pixels in omnidirectional phase focusing as described in claim 1, characterized in that, The step of selecting pixel units within a certain region from the image sensor pixel array includes: According to a preset ratio, P rows of pixel units are extracted from the image sensor pixel array, and the extracted P rows of pixel units are used as pixel units in the partial region, where P is a positive integer and less than the total number of rows of pixel units in the image sensor pixel array. Alternatively, according to a preset ratio, Q columns of pixel units are extracted from the image sensor pixel array, and the extracted Q columns of pixel units are used as pixel units in the partial region, where Q is a positive integer and less than the total number of columns of pixel units in the image sensor pixel array.

6. The method for reading PD pixels in omnidirectional phase focusing as described in claim 5, characterized in that, The step of extracting P rows of pixel units from the image sensor pixel array includes: The extraction interval is determined based on the relationship between the total number of rows in the image sensor pixel array and P; P rows of pixel units are extracted from the image sensor pixel array at the determined extraction interval.

7. The method for reading PD pixels in omnidirectional phase focusing as described in any one of claims 1 to 6, characterized in that, The step of merging and reading pixels within a selected region according to a preset merging method includes at least one of the following: For the selected pixel units within a certain area, pixel merging and reading are performed alternately in the horizontal and vertical directions; For the selected pixel units within a certain area, the pixels are sequentially merged and read in the horizontal direction; For the selected pixel units within a certain area, the pixels are sequentially merged and read in the vertical direction; For the selected pixel units within a certain area, pixel merging and reading are performed at horizontal intervals; For the selected pixel units within a certain area, pixel merging and reading are performed at vertical intervals; For the selected pixel units within a certain area, pixel merging and reading are performed in a cross-diagonal direction.

8. The method for reading PD pixels in omnidirectional phase focusing as described in claim 7, characterized in that, The step of performing pixel merging and reading alternately in the horizontal and vertical directions for pixel units within a selected region includes: Select pixel units of a specified color channel within the aforementioned region; The pixel units of the specified color channel within the specified region are alternately merged and read in the horizontal and vertical directions.

9. The method for reading PD pixels in omnidirectional phase focusing as described in claim 1, characterized in that, Each block consists of a four-pixel structure arranged in RGB.

10. The method for reading PD pixels in omnidirectional phase focusing as described in claim 1, characterized in that, The process of obtaining PD data based on the merged read results includes: The merged read result is used as the PD data; Alternatively, the merged reading results can be merged once or multiple times, and the result of one or more merges can be used as the PD data.

11. The method for reading PD pixels in omnidirectional phase focusing as described in any one of claims 1 to 6, characterized in that, Also includes: For all pixel units in the pixel array of the image sensor, pixel merging is performed using the pixel structure as the smallest processing unit to obtain image data.

12. The method for reading PD pixels in omnidirectional phase focusing as described in claim 1, characterized in that, The pixel structure consists of 2 n ×2 m It consists of pixels of the same color, where n and m are both natural numbers.

13. A readout device for PD pixels in omnidirectional phase focusing, characterized in that, include: The selection unit is used to select pixel units within a certain region from the pixel array of the image sensor, on a pixel structure basis. The pixel array of the image sensor includes several blocks, and each block includes several pixel structures. The merge reading unit is used to merge and read pixels within a selected region according to a preset merging method. The PD data determination unit is used to obtain PD data based on the merged reading results. The merging and reading unit is used to perform pixel merging and reading according to a preset direction, with the pixel structure as the smallest processing unit. During the first merging, pixel units of the same color within the same pixel structure are merged and read. During the second and subsequent pixel merging, one or more pixel structures with the same color are merged once or multiple times according to a preset merging rule.

14. A computer-readable storage medium, wherein the computer-readable storage medium is a non-volatile storage medium or a non-transient storage medium, and a computer program is stored thereon, characterized in that, When the computer program is run by the processor, it performs the steps of the method for reading PD pixels in omnidirectional phase focusing as described in any one of claims 1 to 12.

15. A terminal comprising a memory and a processor, wherein the memory stores a computer program capable of running on the processor, characterized in that, When the processor runs the computer program, it performs the steps of the method for reading PD pixels in omnidirectional phase focusing according to any one of claims 1 to 12.

Images