Image sensor, electronic device, detection method and alignment method

By setting an identification area in the band-shaped photosensitive area and analyzing the band-shaped light position using the difference in grayscale values, the problem of difficulty in real-time judgment of the band-shaped light position under a single-row pixel structure is solved, and high-precision alignment is achieved.

CN119729246BActive Publication Date: 2025-06-06HEFEI I TEK OPTOELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510231312.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-02-28
Publication Date
2025-06-06
Estimated Expiration
2045-02-28

AI Technical Summary

Technical Problem

In the prior art, it is difficult to judge the specific position of the strip-shaped light ray in real time with respect to both ends of the photosensitive area of ​​the linear array sensor in a single-row pixel structure, resulting in low alignment accuracy.

Method used

By setting an identification area in the band-shaped photosensitive area, the position information of the band-shaped light is analyzed by using the difference in grayscale values ​​of the identified pixels to realize real-time posture judgment.

Benefits of technology

The rapid and accurate judgment of the position of the strip light rays is achieved under a single-row pixel structure, and the alignment accuracy of the linear array sensor and the spectral line is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119729246B_ABST
    Figure CN119729246B_ABST
Patent Text Reader

Abstract

The present invention discloses an image sensor, an electronic device, a detection method and an alignment method, comprising: a strip-shaped photosensitive area, which is composed of a single-row pixel array or a multi-row pixel array, and the width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light; an identification area, which is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; and used to identify strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result. The present invention can perform gray value analysis on one or more identification pixels corresponding to the intersection of strip-shaped light of different positions when it falls into the identification area, so as to judge the position information of the current strip-shaped light in real time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of machine vision, and in particular relates to an image sensor, an electronic device, a detection method and an alignment method. Background Art

[0002] Linear array sensors are imaging devices widely used in various fields. They mainly capture image information through a series of linearly arranged photosensitive pixels. These photosensitive pixels are usually one-dimensional pixel units that can read image information passing through their field of view in sequence within a specific time. In the use scenarios of linear array sensors, it is sometimes necessary to capture the strip of light that falls into the linear array sensor. For example, linear array sensors used for spectrometers usually make pixels into rectangles, which are longer along the pixel arrangement direction than the vertical pixel arrangement direction, so that it is easier to align the linear array sensor with the spectral line. In order to better align the photosensitive area of ​​the linear array sensor with the spectral line, it is necessary to align the spectral line to be parallel to the length direction of the linear array sensor and in the middle of the linear array sensor. To achieve this goal, it is best to know the horizontal relative position of the spectral line and the linear array sensor in real time during the adjustment process.

[0003] In response to the alignment requirements of the above-mentioned linear array sensor and strip light, the simplest method is to first adjust the strip light to the upper edge of the linear array sensor's photosensitive area, observe that the image grayscale value evenly weakens until it disappears, then adjust it to the lower edge, observe that the image grayscale value evenly weakens until it disappears, and finally adjust the spectral line to the middle of the previous two positions. This adjustment method lacks feedback and has low adjustment accuracy. Another method is to use a multi-row pixel structure, such as 16 rows of pixels. Each time the image is collected, all 16 rows of pixels are read out, and the position of the spectral line can be directly determined. In actual measurement, all rows of pixels are added together to form one row of pixels. The disadvantage of this method is that the circuit is complex and the speed is slow.

[0004] Therefore, in order to achieve the real-time determination of the specific positions of the strip light relative to the two ends of the light-sensitive area of ​​the linear array sensor along the length direction under the premise of a single-row pixel structure, thereby providing a basis for the subsequent alignment of the linear array sensor, the present invention provides an image sensor, an electronic device, a detection method and an alignment method. Summary of the invention

[0005] The purpose of the present invention is to overcome the above problems existing in the prior art and to provide an image sensor, an electronic device, a detection method and an alignment method.

[0006] In order to achieve the above technical objectives and the above technical effects, the present invention is implemented through the following technical solutions:

[0007] An image sensor collects and identifies real-time position information of a strip of light relative to the image sensor to adjust the position of the image sensor so that the strip of light falls into a preset position of the image sensor, comprising:

[0008] The strip-shaped photosensitive area is composed of a single-row pixel array or a plurality of rows of pixel arrays. The width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light. The strip-shaped light is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area.

[0009] The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; it is used to identify the strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result;

[0010] Among them, the recognition pixels in the recognition area are arranged along the length direction of the strip-shaped photosensitive area, and different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, so that the proportion of the strip light falling into the corresponding recognition pixel is calculated according to the grayscale value difference result to obtain the position information of the intersection.

[0011] Furthermore, the location analysis method of the intersection includes:

[0012] Screening the recognition pixels whose grayscale values ​​in the recognition area meet the preset first grayscale range to confirm the recognition pixels that are not exposed to light;

[0013] The edge positions closest to the strip light on all unexposed recognition pixels are analyzed as the positions of the intersections.

[0014] Furthermore, the location analysis method of the intersection includes:

[0015] Screening the recognition pixels whose grayscale values ​​in the recognition area meet the preset second grayscale range to confirm the recognition pixels that are not completely included by the strip light;

[0016] Analyze the average of the adjacent line positions of all the identified pixels that are not completely included by the strip light to take the position of the intersection;

[0017] The near-line position of the recognition pixel is the edge position of the recognition pixel that is closest to the strip-shaped light.

[0018] Further, the identification area includes:

[0019] At least one light-shielding area is used to limit the light-sensing ability of the identification pixels in the corresponding area, so that different identification pixels form pixel light-sensing areas of different sizes along the width direction of the strip-shaped light-sensitive area.

[0020] The present invention also provides an image sensor, which collects and identifies real-time position information of a strip of light relative to the image sensor to adjust the position of the image sensor so that the strip of light falls into a preset position of the image sensor, including:

[0021] The strip-shaped photosensitive area is composed of a single-row pixel array or a plurality of rows of pixel arrays. The width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light. The strip-shaped light is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area.

[0022] The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; it is used to identify the strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result;

[0023] Wherein, the recognition pixels in the recognition area are arranged along the width direction of the strip-shaped photosensitive area.

[0024] Furthermore, it also includes:

[0025] The auxiliary areas are distributed on both sides of the photosensitive area along the width direction of the strip-shaped photosensitive area. The auxiliary areas include a number of auxiliary pixels distributed in sequence along the length direction of the strip-shaped photosensitive area, so that when the light deviates from the recognition area, the strip-shaped light with different positions falls into different auxiliary pixels.

[0026] The present invention also provides an image sensor, which collects and identifies real-time position information of a point light spot in different states relative to the image sensor, so as to adjust the posture of the image sensor so that the point light spot in all states falls into a preset position of the image sensor, including:

[0027] The strip-shaped photosensitive area is composed of a single-row pixel array or a multi-row pixel array. The width of the strip-shaped photosensitive area is greater than the maximum outer diameter of the point-shaped light spot. It is used to collect corresponding image information when the point-shaped light spot in any state falls into a preset position of the strip-shaped photosensitive area.

[0028] The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a number of identification pixels arranged at different positions; it is used to identify the point-shaped light spots in different states, so that when the point-shaped light spots in all states fall into the identification area, they intersect with one or more of the identification pixels, thereby forming a gray value difference between the identification pixels corresponding to the intersection and the adjacent identification pixels, so as to confirm the posture information of the corresponding area of ​​the point-shaped light spots in all states according to the gray value difference result;

[0029] Among them, the corresponding area of ​​the set of point-like light spots in all states is a strip-shaped area; the recognition pixels in the recognition area are arranged along the length direction or width direction of the strip-shaped photosensitive area. When arranged along the length direction of the strip-shaped photosensitive area, different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, so that the proportion of the strip-shaped area falling in the corresponding recognition pixels is calculated according to the grayscale value difference results to analyze and obtain the position of the intersection.

[0030] The present invention also provides an electronic device, comprising: the above-mentioned image sensor and a processor.

[0031] The present invention also provides an image sensor detection method, which uses the above-mentioned image sensor for detection, and the detection method includes:

[0032] Adjust the image sensor posture so that the strip of light falls within the recognition area;

[0033] Counting the grayscale values ​​of all the recognition pixels in the recognition area to screen out the recognition pixels that have grayscale value differences with adjacent recognition pixels in the recognition area;

[0034] The position information of the intersection corresponding to the selected identification pixels is analyzed to confirm the position information of the strip light.

[0035] The present invention also provides an image sensor alignment method, which uses the above detection method to achieve image sensor alignment, including:

[0036] Obtain the position information of the strip light in the current state to obtain the position information of the intersection of the strip light and the recognition area;

[0037] The strip-shaped light-sensitive area and the recognition area are adjusted synchronously so that the strip-shaped light is located at a preset position of the strip-shaped light-sensitive area.

[0038] The beneficial effects of the present invention are:

[0039] (1) The present invention sets up an additional independent recognition area on the basis of the strip-shaped photosensitive area. When strip-shaped light of different postures falls into the recognition area, the grayscale value of one or more recognition pixels corresponding to the intersection thereof can be analyzed, and the position information of the intersection can be obtained quickly and accurately, so that the posture information of the current strip-shaped light can be determined in real time.

[0040] (2) The photosensitive area of ​​the image sensor in the present invention does not need to adopt a multi-row pixel structure. Even if a single-row pixel structure is adopted, it can still be combined with the recognition area to determine in real time the specific position of the strip light relative to the two ends of the photosensitive area along the length direction, thereby providing a basis for subsequent alignment.

[0041] (3) Regardless of whether the recognition pixels in the recognition area of ​​the present invention are arranged along the length direction or the width direction of the strip-shaped photosensitive area, the position information of the strip-shaped light can be efficiently analyzed based on the grayscale value difference results.

[0042] (4) The present invention has a wide range of applicable scenarios. It can effectively detect the real-time posture information of strip light in any posture state and any strip light width that meets the conditions for collecting strip light-sensitive areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0044] Figure 1 is a schematic diagram of five pixel structures in Embodiment 1 of the present invention;

[0045] Figure 2 yes Figure 1 Schematic diagram of the pixel structure of 1a and the corresponding pixel gray value distribution diagram;

[0046] Figure 3 It is a schematic diagram of six pixel structures in the derived scene in implementation 1 of the present invention;

[0047] Figure 4 yes Figure 3 Schematic diagram of the pixel structure of 2a and the corresponding pixel gray value distribution diagram;

[0048] Figure 5 Schematic diagram of three pixel structures in Embodiment 2 of the present invention;

[0049] Figure 6 is a schematic diagram of auxiliary area distribution in Example 2 of the present invention;

[0050] Figure 7 It is a schematic flow chart of the detection method in the present invention;

[0051] Figure 8 It is a schematic diagram of the alignment method flow in the present invention. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Example 1

[0053] This embodiment first provides an image sensor, which collects and identifies real-time position information of a strip of light relative to the image sensor to adjust the position of the image sensor so that the strip of light falls into a preset position of the image sensor, including:

[0054] The strip-shaped photosensitive area is composed of a single-row pixel array or a multi-row pixel array. The width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light, and is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area; the single-row pixel array is composed of multiple photosensitive pixels arranged along the length direction of the strip-shaped photosensitive area, and the multi-row pixel array is composed of multiple single-row pixel arrays.

[0055] The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; it is used to identify the strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result;

[0056] Among them, the recognition pixels in the recognition area are arranged along the length direction of the strip-shaped photosensitive area, and different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, so that the proportion of the strip light falling into the corresponding recognition pixel is calculated according to the grayscale value difference result to obtain the position information of the intersection.

[0057] In order to be able to understand in real time the specific position where the light falls on the image sensor, an identification area is introduced based on the strip-shaped photosensitive area of ​​the traditional image sensor. The length direction of the strip-shaped photosensitive area is the arrangement direction of the corresponding photosensitive pixels. In order to better collect and align the light, the photosensitive pixels can usually be made into a rectangle, and the long side of the photosensitive pixels corresponds to the width direction of the photosensitive area. At this time, through the identification area set in advance, the position where the light intersects with the strip can be found in the identification area, so that the position of the light strip relative to the left and right sides of the strip-shaped photosensitive area can be determined.

[0058] Since the recognition area includes a number of recognition pixels, no matter how the recognition pixels are placed, as long as the position of the strip light changes, the intersection of the strip light and the recognition pixel will change, and by utilizing the grayscale value difference between the recognition pixel corresponding to the strip light and the adjacent recognition pixel at this time, the specific position of the corresponding intersection can be quickly analyzed to obtain the position information of the strip light relative to the recognition area, so as to quickly and accurately determine the position of the strip light relative to the left and right sides of the photosensitive area.

[0059] In order to quickly and accurately analyze the specific position of the corresponding intersection, the position information and pixel size of each recognition pixel in the recognition area are known, that is, the placement position and detailed contour information of all recognition pixels are known in advance, so that the corresponding recognition position can be quickly fed back according to the real-time detection status of the light.

[0060] As a preferred embodiment of the present invention, in order to improve the accuracy of the detection results, the number of identification areas is two, and they are respectively distributed in the extended areas at both ends of the strip-shaped photosensitive area along the length direction. By increasing the distance between the two identification areas, the impact of the detection error of a single identification area can be reduced to a certain extent, and a straight line can be constructed through the specific position of the intersection of the two identification areas, which is the position information of the current strip light relative to the image sensor.

[0061] like Figure 1 As shown, there are five pixel structures in Example 1. The long strip of wireframes horizontally distributed in the middle of the figure is a strip of light. At this time, only two identification areas are distributed at both ends of the strip-shaped photosensitive area along the length direction as an example. Other situations where the identification areas are distributed inside or around the strip-shaped photosensitive area are not described here. Figure 1 1a shows a symmetrical distribution structure, that is, two recognition areas are symmetrically distributed at both ends of the strip-shaped photosensitive area along the length direction; Figure 1 1b shows a quasi-centrally symmetrical distribution structure, that is, the two recognition areas are centrally symmetrical with the strip-shaped photosensitive area as the center, and are distributed at both ends of the strip-shaped photosensitive area along the length direction; Figure 1 1d shows a translation distribution structure, that is, one recognition area is translated along the length direction of the strip-shaped photosensitive area to form another recognition area; it can be seen that Figure 1 Middle 1a, Figure 1 Middle 1b, Figure 1 The recognition areas in 1d are all in a step-like shape, that is, the pixel sizes of different recognition pixels along the width direction of the strip-shaped photosensitive area increase or decrease in sequence. Figure 1 1c in Fig. 1 shows a random distribution structure, that is, the pixel sizes of different recognition pixels along the width direction of the strip-shaped photosensitive area vary randomly, as long as different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area. Figure 1 Figure 1e shows a combined distribution structure, that is, the pixel sizes of different recognition pixels in one recognition area along the width direction of the strip-shaped photosensitive area increase or decrease in sequence, and the pixel sizes of different recognition pixels in another recognition area along the width direction of the strip-shaped photosensitive area change randomly.

[0062] like Figure 2 As shown, Figure 1In the pixel structure diagram of 1a and the corresponding pixel grayscale value distribution diagram, the pixel structure diagram is shown above the arrow, and the corresponding pixel grayscale value distribution diagram is shown below the arrow. Taking this as an example, it can be seen that since different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, and the edge positions of each recognition pixel can be known in advance, when the strip light falls into the recognition area with different postures, it will intersect with one or more recognition pixels in the recognition area. At this time, according to the grayscale value distribution results of all recognition pixels obtained by statistics, it can be seen that the grayscale values ​​corresponding to the recognition pixels that have no strip light falling into them, that is, they are not photosensitive, usually tend to zero, that is, they meet the first grayscale range; while the grayscale values ​​corresponding to the recognition pixels that the strip light falls completely into correspond to the grayscale values ​​corresponding to the current strip light intensity, that is, they meet the third grayscale range; and the grayscale values ​​corresponding to the recognition pixels that are not completely fallen into by the strip light are in the second grayscale range, thereby forming a grayscale value difference between the first grayscale range and the third grayscale range. Finally, according to the edge position of the identified pixel corresponding to the second grayscale range, the specific position of the strip light relative to the two ends of the strip light-sensitive area in the length direction can be quickly analyzed. Figure 1 Taking the pixel structure of 1a as an example, the edge position of the recognition pixel can be regarded as the highest point position of each stepped recognition pixel in the figure, that is, the position of the end point of each recognition pixel close to the middle position of the strip-shaped photosensitive area.

[0063] In order to quickly analyze the position information of the current strip light, when the width of the strip light is narrow, that is, when it meets the preset first threshold range, the position of the intersection can be obtained by using the first analysis method, which specifically includes:

[0064] Screening the recognition pixels whose grayscale values ​​in the recognition area meet the preset first grayscale range to confirm the recognition pixels that are not exposed to light;

[0065] The edge positions closest to the strip light on all unexposed recognition pixels are analyzed as the positions of the intersections.

[0066] The grayscale value of the unexposed recognition pixels will approach zero. Even if there are certain environmental influences or dark current, the analysis can be performed by setting the preset first grayscale range to screen out all the unexposed recognition pixels, and then you can refer to Figure 1 In the pixel structure of 1a, the highest point is picked out, which is the position closest to the current strip light, that is, the edge position closest to the strip light on all the un-light-sensitive recognition pixels is analyzed.

[0067] This method does not need to calculate and process the relevant identification pixels in the second grayscale range, but only needs to consider the identification pixels that meet the preset first grayscale range. Even when the strip light itself has a certain grayscale value difference in the length direction, the first grayscale range that is significantly smaller than the normal grayscale value can be used to quickly lock the non-light-sensitive identification pixels, thereby ensuring the detection and identification accuracy and efficiency.

[0068] In order to further handle more complex usage scenarios, when the width of the strip light is wider, that is, when it meets the preset second threshold range, the position of the intersection can be obtained by using a second analysis method, specifically including:

[0069] Screening the recognition pixels whose grayscale values ​​in the recognition area meet the preset second grayscale range to confirm the recognition pixels that are not completely included by the strip light;

[0070] Analyze the average of the adjacent line positions of all the identified pixels that are not completely included by the strip light to take the position of the intersection;

[0071] The near-line position of the recognition pixel is the edge position of the recognition pixel that is closest to the strip-shaped light.

[0072] The core of this method is to analyze the proximal line positions of all identified pixels that are not completely covered by the strip light, and then calculate the average value to serve as the center line position of the strip light, thereby effectively solving the error caused by single position measurement when the strip light is wide.

[0073] As a specific embodiment of the present invention, the identification pixels used for light sensing in the identification area can be as follows: Figure 1 Directly construct the formation, or Figure 3 Indirect construction, Figure 3 To implement the six pixel structure diagrams in the derived scenario in 1, the identification areas include:

[0074] At least one light-shielding area is used to limit the light-sensing ability of the identification pixels in the corresponding area, so that different identification pixels form pixel light-sensing areas of different sizes along the width direction of the strip-shaped light-sensitive area.

[0075] and Figure 1 The difference is, Figure 3 At least one shading area is used to indirectly form a similar Figure 1 The pixel structure in the figure, the shaded area is the shading area, and the long strip of wire frame distributed horizontally in the middle of the figure is a strip of light. It can be seen that the two recognition areas can be distributed not only at the two ends of the strip-shaped photosensitive area along the length direction, but also on the same side, and when distributed on the same side, they can be combined into one, that is, only one shading area is used as a whole to achieve the effect of two recognition areas. Other situations in which the recognition areas are distributed inside or around the strip-shaped photosensitive area will not be described here. Among them, Figure 3 Middle 2a, Figure 3 Middle 2b, Figure 3 2c shows a symmetrical distribution structure, that is, the two recognition areas are symmetrically distributed at both ends of the strip-shaped photosensitive area along the length direction, and the edge of the light-shielding area can be a straight line, an arc, or a step shape; Figure 3 Medium 2d, Figure 3 2e, Figure 3 In 2f, a same-side distribution structure is given, that is, the two recognition areas are symmetrically distributed at the same end of the strip-shaped photosensitive area along the length direction. Whether directly using recognition pixels of different pixel sizes or indirectly forming recognition pixels of different pixel sizes through the occlusion area, the basic logic is the same. Therefore, in Figure 1 Based on Figure 3 The structures in the recognition area except the light-shielded area are Figure 1 The direct structure of the pixel can be identified in the extended design, and it can also be used in Figure 3 Based on reference Figure 1 Identify the pixel structure in the identification area, Figure 3 The structure of the middle shading area is designed with reverse complementarity.

[0076] like Figure 4 As shown, Figure 3 2a pixel structure diagram and the corresponding pixel gray value distribution diagram, the arrow above is the pixel structure diagram, the arrow below is the corresponding pixel gray value distribution diagram, for details, please refer to the above Figure 2 The principle explanation in has the same technical principle.

[0077] As a specific embodiment of the present invention, the recognition pixels in the recognition area are integrated with the photosensitive pixels in the strip-shaped photosensitive area, and a light-shielding area is formed by a light-shielding member.

[0078] from Figure 3 It can be seen that in order to reduce processing costs, it is entirely possible to add a shading member to form a shading area based on the strip-shaped photosensitive area, thereby achieving the same technical effect. Example 2

[0079] The present invention also provides an image sensor, which collects and identifies real-time position information of a strip of light relative to the image sensor to adjust the position of the image sensor so that the strip of light falls into a preset position of the image sensor, including:

[0080] The strip-shaped photosensitive area is composed of a single-row pixel array or a plurality of rows of pixel arrays. The width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light. The strip-shaped light is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area.

[0081] The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; it is used to identify the strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result;

[0082] Wherein, the recognition pixels in the recognition area are arranged along the width direction of the strip-shaped photosensitive area.

[0083] Different from Example 1, the recognition pixels in the recognition area in Example 2 are arranged along the width direction of the strip-shaped photosensitive area, so that the strip-shaped light at different positions along the width direction of the strip-shaped photosensitive area can be photosensitized and recognized. With reference to Example 1, it can be known that it is only necessary to exclude the corresponding recognition pixels that meet the first grayscale range, and then the recognition pixels where the strip-shaped light falls can be counted, and then the average value of the corresponding positions of all the recognition pixels where the strip-shaped light falls can be calculated, which can be used as the intersection position of the current strip-shaped light and the recognition area.

[0084] like Figure 5 As shown, there are three pixel structures in Example 2. The long strip of wireframes horizontally distributed in the middle of the figure is a strip of light. At this time, only two identification areas are distributed at both ends of the strip-shaped photosensitive area along the length direction as an example. Other situations where the identification areas are distributed inside or around the strip-shaped photosensitive area are not described here. Figure 5 3a shows a symmetrical distribution structure, that is, two recognition areas are symmetrically distributed at both ends of the strip-shaped photosensitive area along the length direction; Figure 5 3b shows a quasi-centrally symmetrical distribution structure, that is, the two recognition areas are centrally symmetrical with the strip-shaped photosensitive area as the center, and are distributed at both ends of the strip-shaped photosensitive area along the length direction. Figure 5 In 3a, the pixels of each recognition are arranged differently. Figure 5 There is a certain misalignment among the identified pixels in 3b; Figure 5 Figure 3c shows an internal distribution structure, that is, two recognition areas are distributed inside the strip-shaped photosensitive area. At this time, the two recognition areas can not only realize the posture detection of the strip light, but also can be used in subsequent measurements after the sensor is aligned. During measurement, the same acquisition effect of a single long pixel is achieved by summing up the recognition pixels in the illustrated recognition area.

[0085] In summary, Figure 1 , Figure 3 , Figure 5Different types of recognition region structures are given. In actual use, you can choose to combine two different recognition region structures of the same type, or you can choose to combine two different types of recognition region structures. You can choose according to actual needs when using, and I will not go into details here.

[0086] As can be seen from the above, usually only two identification areas of any type need to be selected to be distributed along the strip-shaped photosensitive area, or in the extended areas at both ends of the strip-shaped photosensitive area along the length direction. However, sometimes there is a strip of light that does not fall into the identification area, that is, the deviation is large. At this time, it can also include:

[0087] The auxiliary areas are distributed on both sides of the photosensitive area along the width direction of the strip-shaped photosensitive area. The auxiliary areas include a number of auxiliary pixels distributed in sequence along the length direction of the strip-shaped photosensitive area, so that when the light deviates from the recognition area, the strip-shaped light with different positions falls into different auxiliary pixels.

[0088] At this time, if Figure 6 The diagram is a schematic diagram of the auxiliary area distribution in Example 2. Figure 5 The recognition principle of 3a is the same. Through the grayscale value of each auxiliary pixel in the auxiliary area, the intersection position of the strip light and the auxiliary area can be analyzed, so as to perform auxiliary adjustment.

[0089] Of course, even if there is no auxiliary area, since the recognition area is distributed along the strip-shaped photosensitive area, or in the extended areas at both ends of the strip-shaped photosensitive area along the length direction, when the strip-shaped light does not fall into the recognition area, the grayscale value of each photosensitive pixel in the strip-shaped photosensitive area can be counted until the grayscale value of each photosensitive pixel meets the preset threshold range, so that the strip-shaped light can fall into the recognition area again. Example 3

[0090] In addition to performing position recognition on the strip light through Embodiment 1 and Embodiment 2 to adjust the image sensor, the present invention can also be applied to the field of point laser triangulation ranging. The specific principle of point laser triangulation ranging is:

[0091] The laser emits a beam of laser to illuminate the surface of the object to be measured. The reflected light from the surface of the object to be measured is received by the linear array sensor. The reflected light from the surface of the object to be measured at different distances will be imaged at different positions on the linear array sensor to form corresponding point-shaped light spots. By calculating according to the trigonometric formula, the distance of the object to be measured can be deduced.

[0092] Since the reflected light from the surface of the measured object at different distances will be imaged at different positions on the linear array sensor to form corresponding point-shaped light spots, by changing the distance of the measured object in turn, different positions of the linear array sensor can receive point-shaped light spots in different states, and the collection of point-shaped light spots in all states corresponds to a strip area.

[0093] Therefore, in principle, a collection of point-shaped light spots in different states is used to be equivalent to the strip-shaped light in Embodiment 1 and Embodiment 2. Specifically, subsequent detection is achieved by sequentially changing the distance of the object to be detected, as follows:

[0094] The present invention also provides an image sensor, which collects and identifies real-time position information of a point light spot in different states relative to the image sensor, so as to adjust the posture of the image sensor so that the point light spot in all states falls into a preset position of the image sensor, including:

[0095] The strip-shaped photosensitive area is composed of a single-row pixel array or a multi-row pixel array. The width of the strip-shaped photosensitive area is greater than the maximum outer diameter of the point-shaped light spot. It is used to collect corresponding image information when the point-shaped light spot in any state falls into a preset position of the strip-shaped photosensitive area.

[0096] The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a number of identification pixels arranged at different positions; it is used to identify the point-shaped light spots in different states, so that when the point-shaped light spots in all states fall into the identification area, they intersect with one or more of the identification pixels, thereby forming a gray value difference between the identification pixels corresponding to the intersection and the adjacent identification pixels, so as to confirm the posture information of the corresponding area of ​​the point-shaped light spots in all states according to the gray value difference result;

[0097] Among them, the corresponding area of ​​the set of point-like light spots in all states is a strip-shaped area; the recognition pixels in the recognition area are arranged along the length direction or width direction of the strip-shaped photosensitive area. When arranged along the length direction of the strip-shaped photosensitive area, different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, so that the proportion of the strip-shaped area falling in the corresponding recognition pixels is calculated according to the grayscale value difference results to analyze and obtain the position of the intersection.

[0098] From the above, it can be seen that by successively changing the distance of the object to be measured to obtain point-like light spots in different states, and by superimposing the grayscale values ​​corresponding to the point-like light spots in different states of all recognition pixels in the recognition area, it can be equivalent to the detection principle in Example 1 and Example 2, and the position of the intersection of the corresponding area of ​​the set of point-like light spots in all states and the recognition area is calculated according to the grayscale value difference results. Example 4

[0099] The second aspect of the present invention further provides an electronic device, comprising: the above-mentioned image sensor and a processor, wherein the processor is used to perform statistics and analysis on the grayscale values ​​in the identification area and the strip-shaped photosensitive area in the embodiments 1-3. Example 5

[0100] like Figure 7As shown, the third aspect of the present invention further provides an image sensor detection method, the detection method comprising:

[0101] An image sensor structure is set up to include a strip-shaped photosensitive area and a recognition area; wherein the strip-shaped photosensitive area is composed of a single-row pixel array or a multi-row pixel array, and the width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light, and is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area; the recognition area is distributed inside or around the strip-shaped photosensitive area, and is composed of a plurality of recognition pixels arranged at different positions.

[0102] The image sensor posture is adjusted so that the strip light falls into the recognition area and intersects with one or more recognition pixels.

[0103] The grayscale values ​​of all the recognition pixels in the recognition area are counted to screen out the recognition pixels in the recognition area that have grayscale value differences with adjacent recognition pixels.

[0104] The position information of the intersection corresponding to the selected identification pixels is analyzed to confirm the position information of the strip light.

[0105] The recognition pixels in the recognition area are arranged along the length direction or the width direction of the strip-shaped photosensitive area. When arranged along the length direction of the strip-shaped photosensitive area, different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area.

[0106] When the recognition pixels in the recognition area are arranged along the length direction of the strip-shaped photosensitive area, the specific principles of the detection method can be implemented with reference to Example 1. When the recognition pixels in the recognition area are arranged along the width direction of the strip-shaped photosensitive area, the specific principles of the detection method can be implemented with reference to Example 2, which will not be repeated here. Example 6

[0107] like Figure 8 As shown, the fourth aspect of the present invention further provides an image sensor alignment method, which uses the above detection method to achieve image sensor alignment, including:

[0108] Obtain the position information of the strip light in the current state to obtain the position information of the intersection of the strip light and the recognition area;

[0109] The strip-shaped light-sensitive area and the recognition area are adjusted synchronously so that the strip-shaped light is located at a preset position of the strip-shaped light-sensitive area. Example 7

[0110] A fifth aspect of the present invention further provides a computer-readable storage medium, comprising a computer program, which implements the above-mentioned detection method when executed by a processor.

[0111] In practical applications, the computer-readable storage medium may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory RAM, a read-only memory ROM, an erasable programmable read-only memory EPROM or flash memory, an optical fiber, a portable compact disk read-only memory CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device.

[0112] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0113] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0114] Computer program code for performing the operation of the present application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network LAN or a wide area network WAN, or can be connected to an external computer, for example, using an Internet service provider to connect through the Internet.

[0115] In the description of this specification, the description with reference to the terms "one embodiment", "example", "specific example", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0116] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, and these changes and improvements all fall within the scope of the present invention to be protected.

Claims

1. An image sensor that collects and identifies real-time position information of a strip of light relative to the image sensor to adjust the position of the image sensor so that the strip of light falls into a preset position of the image sensor, characterized in that: include: The strip-shaped photosensitive area is composed of a single-row pixel array or a plurality of rows of pixel arrays. The width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light. The strip-shaped light is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area. The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; it is used to identify the strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result; Among them, the recognition pixels in the recognition area are arranged along the length direction of the strip-shaped photosensitive area, and different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, so that the proportion of the strip light falling into the corresponding recognition pixel is calculated according to the grayscale value difference result to analyze and obtain the position of the intersection.

2. An image sensor according to claim 1, characterized in that: The location analysis methods for intersections include: Screening the recognition pixels whose grayscale values ​​in the recognition area meet the preset first grayscale range to confirm the recognition pixels that are not exposed to light; The edge positions closest to the strip light on all unexposed recognition pixels are analyzed as the positions of the intersections.

3. The image sensor according to claim 1, characterized in that: The location analysis methods for intersections include: Screening the recognition pixels whose grayscale values ​​in the recognition area meet the preset second grayscale range to confirm the recognition pixels that are not completely included by the strip light; Analyze the average of the adjacent line positions of all the identified pixels that are not completely included by the strip light to take the position of the intersection; The near-line position of the recognition pixel is the edge position of the recognition pixel that is closest to the strip-shaped light.

4. An image sensor according to any one of claims 1 to 3, characterized in that: Identification areas include: At least one light-shielding area is used to limit the light-sensing ability of the identification pixels in the corresponding area, so that different identification pixels form pixel light-sensing areas of different sizes along the width direction of the strip-shaped light-sensitive area.

5. An image sensor that collects and identifies real-time position information of a strip of light relative to the image sensor to adjust the position of the image sensor so that the strip of light falls into a preset position of the image sensor, characterized in that: include: The strip-shaped photosensitive area is composed of a single-row pixel array or a plurality of rows of pixel arrays. The width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light. The strip-shaped light is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area. The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a plurality of identification pixels arranged at different positions; it is used to identify the strip-shaped light of different positions, so that when the strip-shaped light of different positions falls into the identification area, it intersects with one or more identification pixels, thereby forming a gray value difference between the identification pixel corresponding to the intersection and the adjacent identification pixel, so as to confirm the position information of the current strip-shaped light according to the gray value difference result; Wherein, the recognition pixels in the recognition area are arranged along the width direction of the strip-shaped photosensitive area.

6. The image sensor according to claim 5, characterized in that: Also includes: The auxiliary areas are distributed on both sides of the photosensitive area along the width direction of the strip-shaped photosensitive area. The auxiliary areas include a number of auxiliary pixels distributed in sequence along the length direction of the strip-shaped photosensitive area, so that when the light deviates from the recognition area, the strip-shaped light with different positions falls into different auxiliary pixels.

7. An image sensor that collects and identifies real-time position information of a point light spot in different states relative to the image sensor to adjust the image sensor posture so that the point light spot in all states falls into a preset position of the image sensor, characterized in that: include: The strip-shaped photosensitive area is composed of a single-row pixel array or a multi-row pixel array. The width of the strip-shaped photosensitive area is greater than the maximum outer diameter of the point-shaped light spot. It is used to collect corresponding image information when the point-shaped light spot in any state falls into a preset position of the strip-shaped photosensitive area. The identification area is distributed inside or around the strip-shaped photosensitive area and is composed of a number of identification pixels arranged at different positions; it is used to identify the point-shaped light spots in different states, so that when the point-shaped light spots in all states fall into the identification area, they intersect with one or more of the identification pixels, thereby forming a gray value difference between the identification pixels corresponding to the intersection and the adjacent identification pixels, so as to confirm the posture information of the corresponding area of ​​the point-shaped light spots in all states according to the gray value difference result; Among them, the corresponding area of ​​the set of point-like light spots in all states is a strip-shaped area; the recognition pixels in the recognition area are arranged along the length direction or width direction of the strip-shaped photosensitive area. When arranged along the length direction of the strip-shaped photosensitive area, different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area, so that the proportion of the strip-shaped area falling in the corresponding recognition pixels is calculated according to the grayscale value difference results to analyze and obtain the position of the intersection.

8. An electronic device, characterized in that: include: An image sensor and a processor as claimed in any one of claims 1 to 7.

9. An image sensor detection method, characterized in that: Detection methods include: The image sensor structure is set to include a strip-shaped photosensitive area and a recognition area; wherein the strip-shaped photosensitive area is composed of a single-row pixel array or a plurality of rows of pixel arrays, the width of the strip-shaped photosensitive area is greater than the width of the strip-shaped light, and is used to collect corresponding image information when the strip-shaped light falls into a preset position of the strip-shaped photosensitive area; the recognition area is distributed inside or around the strip-shaped photosensitive area, and is composed of a plurality of recognition pixels arranged at different positions; Adjusting the image sensor posture so that the strip of light falls into the recognition area and intersects with one or more recognition pixels; Counting the grayscale values ​​of all the recognition pixels in the recognition area to screen out the recognition pixels that have grayscale value differences with adjacent recognition pixels in the recognition area; Analyze the position information of the intersection corresponding to the selected identification pixels to confirm the position information of the strip light; The recognition pixels in the recognition area are arranged along the length direction or the width direction of the strip-shaped photosensitive area. When arranged along the length direction of the strip-shaped photosensitive area, different recognition pixels have different pixel sizes along the width direction of the strip-shaped photosensitive area.

10. An image sensor alignment method, using the detection method according to claim 9 to achieve image sensor alignment, characterized in that: include: Obtain the position information of the strip light in the current state to obtain the position information of the intersection of the strip light and the recognition area; The strip-shaped light-sensitive area and the recognition area are adjusted synchronously so that the strip-shaped light is located at a preset position of the strip-shaped light-sensitive area.

Citation Information

Patent Citations

  • Image recognition method and device, electronic equipment and computer equipment

    CN112395915A

  • Image inspection device, image inspection method, and image inspection program

    US20060067569A1