Imaging system and imaging apparatus

Abstract

The utility model aims to provide an imaging system and an imaging device. The imaging system comprises a spectroscope which can divide a light beam input into the spectroscope into a plurality of light beams in different output directions and output the light beams; the plurality of imaging assemblies correspondingly receive the light beams in each output direction and output electric signals, and each imaging assembly comprises a lens correspondingly receiving the light beams in each output direction; the photosensitive element correspondingly receives the light beams output by the lens and converts the light beams into electric signals, and the output direction of the electric signals output by the photosensitive element is configured to point to the image processor; wherein the image distance of the imaging assembly is defined as the distance from the optical center of the lens to the photosensitive element, and the focal length of the lens is defined as the distance from the optical center of the lens to the focus of light gathering when parallel light enters; the plurality of imaging assemblies at least comprise a first imaging assembly corresponding to a first depth of field and a second imaging assembly corresponding to a second depth of field, and the values of the first depth of field and the second depth of field are different.

Description

TECHNICAL FIELD

[0001] The present application relates to an imaging system and an imaging device. BACKGROUND

[0002] For those skilled in the art, cameras are divided into fixed focus cameras and zoom cameras according to optical zoom capabilities.

[0003] Zoom cameras can ensure the sharpness of the photographed object by, for example, lens structure changes, lens and photosensitive element distance. Because of the above factors, there are great advantages in imaging quality and imaging distance, and they are widely used in professional shooting instruments. However, the disadvantages are the complexity of lens structure and process, and the relatively high cost.

[0004] Fixed focus cameras have a fixed lens and photosensitive element distance, so they have a fixed shooting area and shooting distance, which is represented by the depth of field parameter. The depth of field parameter reflects the range of a camera that can be clearly imaged. The smaller the focal length, the farther the focusing distance, and the larger the corresponding depth of field parameter. Fixed focus cameras, due to the fixed depth of field parameter, can generally only be used for single scene shooting purposes, and are relatively single in functionality.

[0005] The visible light cameras used by stereo vision cameras usually use fixed focus cameras. The reason is that the specific internal and external parameters of the camera need to be determined in the calibration process before depth calculation and image registration, and the zoom process of the zoom camera will change the two, making calibration difficult and the results less robust. Fixed focus cameras lack flexibility in zooming and focusing, and the depth of field range is relatively limited, which greatly limits the applicable scenarios. Existing binocular stereo cameras are usually designed for indoor use, so the depth of field is usually small, and the use is relatively single.

[0006] Referring to existing commercial cameras, the inventors found that the gemini2 RGB camera of OBI medium light uses 1080P resolution to show a fuzzy picture that is not in focus within 40cm, and similarly, the realsense D435 camera of Intel uses 1080P resolution to also show a fuzzy picture that is not in focus within 30cm, which limits the use of the two cameras at close range, and in long distance use, the gemini2 camera shoots a calibration board with a cell size of 20mm at 2m, and the picture appears jagged due to the short focal length. The single RGB camera of a commercial camera is limited by the structural conditions, the depth of field is limited, and the application scenarios are also limited.

[0007] Therefore, there is a need in the art for a new imaging system and imaging device to solve one or a combination of the above problems. CONTENT OF THE INVENTION

[0008] The purpose of the present application is to overcome the defect that the limited depth of field range of the fixed-focus camera leads to a great limitation of the applicable scene on the basis of simple calibration and good robustness of the calibration result of the fixed-focus camera.

[0009] According to the first aspect of the present application, an imaging system comprises: a beam splitter capable of splitting a light beam input into the beam splitter into a plurality of light beam outputs in different output directions; a plurality of imaging assemblies corresponding to receive a light beam in each output direction and output an electrical signal, each imaging assembly comprising: a lens corresponding to receive a light beam in each output direction; a photosensitive element corresponding to receive a light beam output by the lens and convert it into an electrical signal, the output direction of the electrical signal output by the photosensitive element being configured to point to an image processor; wherein the image distance of the imaging assembly is defined as the distance from the optical center of the lens to the photosensitive element, and the focal length of the lens is defined as the distance from the optical center of the lens to the focus point of light convergence when parallel light is incident; for the plurality of imaging assemblies, at least a first imaging assembly corresponding to a first depth of field, a second imaging assembly corresponding to a second depth of field, the values of the first depth of field and the second depth of field being different; optionally, the image distance of each imaging assembly is a fixed value, and the focal length of each lens is a fixed value.

[0010] In one or more embodiments of the imaging system, the plurality of imaging assemblies are configured to have uniform optical axes; the image distance of each imaging assembly is a fixed value, and the focal length of each lens is a fixed value; the fixed values of the focal lengths of the lenses included in different imaging assemblies are different; optionally, the first imaging assembly includes a first lens, the focal length of the first lens is a first lens focal length, the second imaging assembly includes a second lens, the focal length of the second lens is a second lens focal length, and the fixed values of the first lens focal length and the second lens focal length are different.

[0011] In one or more embodiments of the imaging system, the plurality of imaging assemblies are configured to have uniform optical axes; the image distance of each imaging assembly is a fixed value, and the focal length of each lens is a fixed value; the fixed values of the focal lengths of the lenses included in different imaging assemblies are different; optionally, the first imaging assembly includes a first lens, the focal length of the first lens is a first lens focal length, the second imaging assembly includes a second lens, the focal length of the second lens is a second lens focal length, and the fixed values of the first lens focal length and the second lens focal length are different.

[0012] In one or more embodiments of the imaging system, one or more of the beam splitters are included; optionally, the imaging system includes a plurality of beam splitters arranged in sequence along the same direction, the number of the beam splitters is N, the number of the plurality of imaging assemblies corresponding to the beam splitters is N+1, N is a positive integer greater than or equal to 2; further optionally, the imaging system includes two beam splitters, and three imaging assemblies are correspondingly arranged.

[0013] In one or more embodiments of the imaging system, the beam splitter is a cuboid, and the long side of the cuboid corresponds to the connection between the light-in surface and the light-out surface of the beam splitter; or the beam splitter is a cube.

[0014] In one or more embodiments of the imaging system, the beam splitter has a beam splitting surface, and the beam splitting surface has a semi-transparent and semi-reflective film; optionally, the semi-transparent and semi-reflective film is a visible light coating film with a beam splitting ratio of transmission:reflection = 50%:50%; optionally, the reflected light output by the beam splitter corresponds to a first optical axis, and the transmitted light output by the beam splitter corresponds to a second optical axis, and the first optical axis is perpendicular to the second optical axis.

[0015] In one or more embodiments of the imaging system, the lens focal length of the lens is a constant value of 0.1mm to 300mm; optionally, the lens focal length of the lens is a constant value of 1mm to 150mm; more optionally, the lens focal length of the lens is a constant value of 1mm to 50mm; further optionally, the lens focal length of the lens is a constant value of 1mm to 20mm; still further optionally, the lens focal length of the lens is a constant value of 1mm to 16mm; yet further optionally, the lens focal length of the lens is a constant value of 1mm to 5mm.

[0016] In one or more embodiments of the imaging system, the photosensitive element is a CCD element or a CMOS element; the imaging assembly is configured as an integrated camera; optionally, the integrated camera is an RGB camera; optionally, the lens of the integrated camera has a light shield.

[0017] In one or more embodiments of the imaging system, a heat dissipation member is further included, and is in fluid communication with the beam splitter and / or the plurality of imaging assemblies.

[0018] According to a second aspect of the present application, an imaging device has the imaging system as described in the first aspect, and the imaging device includes an indoor monitoring system or a stereo vision industrial camera.

[0019] According to a third aspect of the present application, an imaging method uses the imaging system as described in the first aspect, and the imaging method includes:

[0020] Multiple imaging components output multiple images corresponding to different depths of field to the image processor, and the image processor fuses the multiple images corresponding to different depths of field to output a fused image;

[0021] Optionally, a first image is output to the image processor via a first imaging component corresponding to a first depth of field;

[0022] The second image is output to the image processor via the second imaging component corresponding to the second depth of field;

[0023] The image processing device fuses the first image and the second image to output a fused image.

[0024] The beneficial effects of the above embodiments include, but are not limited to:

[0025] By configuring the optical path and electrical signal flow of the beam splitter, multiple imaging components, and image processor, images with different depths of field provided by different imaging components can be fused in the image processor. This achieves the advantages of simple calibration and robust calibration results using fixed-focus cameras, while overcoming the limitation of fixed-focus cameras in terms of limited depth of field range, which greatly restricts their applicable scenarios. Attached Figure Description

[0026] The above and other features, properties and advantages of this application will become more apparent from the following description taken in conjunction with the accompanying drawings and embodiments, wherein:

[0027] Figure 1 This is a schematic diagram of the structure of an imaging system according to one embodiment.

[0028] Figure 2 This is a schematic diagram of the imaging system according to another embodiment.

[0029] Figure 3 This is a schematic diagram of the structure of a beam splitter in an imaging system according to one embodiment.

[0030] Figure 4 This is a schematic flowchart of an imaging method according to one embodiment.

[0031] Figure label:

[0032] 100-Imaging System

[0033] 1- Beam splitter, 101- First beam splitter, 102- Second beam splitter, 11- Beam splitting surface, 110- Semi-transparent and semi-reflective coating

[0034] 2-Imaging component, 201-First imaging component, 202-Second imaging component, 203-Third imaging component

[0035] 21-Shot, 211-First Shot, 212-Second Shot, 213-Third Shot

[0036] 22-Photosensitive element, 221-First photosensitive element, 222-Second photosensitive element, 223-Third photosensitive element

[0037] 200 - Beam, 2001 - First beam, 2002 - Second beam, 2003 - Third beam, 2004 - Fourth beam, 2011 - First optical axis, 2012 - Second optical axis

[0038] 3-Image Processor

[0039] 4-Heat dissipation components. Detailed Implementation

[0040] The following discloses various implementations or embodiments of the described subject matter. To simplify the disclosure, specific examples of elements and arrangements are described below. These are merely examples and are not intended to limit the scope of protection of the invention. For instance, a first feature formed above or on a second feature, as described later in the specification, can include implementations where the first and second features are formed in a direct connection, or implementations where an additional feature is formed between the first and second features, thus the first and second features may not be directly connected. Furthermore, reference numerals and / or letters may be repeated in different examples in these disclosures. This repetition is for brevity and clarity and does not in itself indicate a relationship between the various implementations and / or structures to be discussed. Further, when the first element is described in connection with or combined with a second element, the description includes implementations where the first and second elements are directly connected or combined with each other, as well as implementations where one or more other intervening elements are added to indirectly connect or combine the first and second elements with each other.

[0041] It is understood that the following flowcharts are used to illustrate the steps performed by the cultivation method according to embodiments of this application. It should be understood that, depending on the actual situation, the preceding or following steps may not necessarily be performed precisely in order. Other steps may be added to these processes, or one or more steps may be removed from them.

[0042] refer to Figures 1 to 3 As shown, the imaging system 100 includes a beam splitter 1 and multiple imaging components 2.

[0043] Beam splitter 1 can split the input beam into multiple beams with different output directions. Multiple imaging components 2 receive the beams in each output direction and output electrical signals.

[0044] It can be understood that the number of beam splitters 1 can be one or more, and the number of imaging components 2 can be at least two.

[0045] For exampleFigure 1 As shown, a single beam splitter 1 splits the beam 200 into a first beam 2001 and a second beam 2002. The first beam 2001 is received by the first imaging component 201, and the second beam 2002 is received by the second imaging component 202.

[0046] For example Figure 2 As shown, there are two beam splitters 1, distributed along the X direction. The first beam splitter 101 splits the beam 200 into a first beam 2001 and a second beam 2002. The first beam 2001 is received by the first imaging component 201, and the second beam 2002 is received by the second beam splitter 102 and split into a third beam 2003 and a fourth beam 2004. The third beam 2003 is received by the second imaging component 202, and the fourth beam 2004 is received by the third imaging component 203.

[0047] It can be understood that the number of beam splitters 1 can be more. That is, in some embodiments, the imaging system 100 includes multiple beam splitters 1, which are arranged sequentially in the same direction. The number of beam splitters 1 is N, and the number of multiple imaging components 2 is N+1, where N is a positive integer greater than or equal to 2.

[0048] refer to Figure 3 As shown, the specific structure of the beam splitter 1 can be a cuboid, with the long side of the cuboid connecting the light-incident surface and the light-exit surface of the beam splitter 1; this avoids obstructing the camera's field of view. Alternatively, the beam splitter 1 can also be a cube, and neither is a limitation.

[0049] refer to Figures 1 to 3 As shown, the specific structure for beam splitting using the beam splitter 1 can be as follows: the beam splitter 1 has a beam splitting surface 11, and the beam splitting surface 11 has a semi-transparent and semi-reflective coating 110; optionally, the semi-transparent and semi-reflective coating 110 is a visible light coating with a beam splitting ratio of transmission:reflection = 50%:50%; optionally, the reflected light output by the beam splitter 1 corresponds to the first optical axis 2011, and the transmitted light output corresponds to the second optical axis 2012, with the first optical axis 2011 and the second optical axis 2012 being perpendicular, for example... Figure 1 As shown, the first beam 2001 is reflected light, and its corresponding first optical axis 2011 is along the Y direction. The second beam 2002 is transmitted light, and its corresponding second optical axis 2012 is along the X direction. The X direction is perpendicular to the Y direction. This design makes the fused image clearer. By using a semi-reflective beam splitter, the optical axes of cameras with different focal lengths are unified, greatly reducing the baseline length of the two cameras, improving registration accuracy, and ensuring the quality of the final fused image output by the system. It can be understood that the ratio of transmission to reflection can be adjusted according to the needs of the scene, and is not limited to the aforementioned 50%:50%. Furthermore, the beam splitting structure is not limited to having a semi-reflective coating on the beam splitting surface; other beam splitting structures are also possible.

[0050] Each imaging component 2 includes: a lens 21, which receives a light beam in each output direction; and a photosensitive element 22, which receives the light beam output by the lens 21 and converts it into an electrical signal. The output direction of the electrical signal output by the photosensitive element 22 is configured to point to the image processor 3.

[0051] The image distance of the imaging component 2 is defined as the distance from the optical center of the lens 21 to the photosensitive element 22, and the focal length of the lens is defined as the distance from the optical center of the lens to the focal point where the light converges when parallel light is incident.

[0052] For multiple imaging components 2, at least a first imaging component 201 corresponding to a first depth of field and a second imaging component 202 corresponding to a second depth of field are included, and the values ​​of the first depth of field and the second depth of field are different.

[0053] The reason for defining image distance and lens focal length is that, in this field, focal length is generally interpreted as a measure of the convergence or divergence of light in an optical system, referring to the distance from the center of the lens to the focal point where light converges. Image distance, on the other hand, is the distance from the optical center of the lens to the imaging plane such as the film, CCD, or CMOS. Therefore, to clearly define the corresponding meanings of image distance and lens focal length, "lens focal length" and "image distance" are defined in this application. Optionally, the image distance of each imaging component 2 is a fixed value, and the lens focal length of each lens 21 is a fixed value.

[0054] It can be understood that lens 21, also known as an optical lens, can include a single lens or a combination of multiple lenses. Each lens 21 has a fixed focal length, generally referred to as a fixed-focus lens. The opposite concept is a zoom lens, which is a camera lens that can change its focal length within a certain range to obtain different field of view angles, image sizes, and scene ranges. For example, optical zoom changes the focal point by moving internal lens elements, thus changing the focal length and the angle of view, thereby magnifying or reducing the image. The fixed image distance of each imaging component 2 and the fixed focal length of each lens 21 mean that the image distance and lens focal length are constant, but different imaging components 2 have different fixed values ​​for their image distance and lens focal length. Specific examples can be found later.

[0055] The photosensitive element 22, also known as an image sensor, utilizes the photoelectric conversion function of an optoelectronic device. It converts the light image on the photosensitive surface into an electrical signal proportional to the light image. Compared to photosensitive elements with "point" light sources such as photodiodes and phototransistors, the photosensitive element is a functional device that divides the light image on its light-receiving surface into many small units and converts them into usable electrical signals. In some embodiments, the photosensitive element 22 can be a CCD (Charge-Coupled Device) element; another is a CMOS (Complementary Metal-Oxide Semiconductor) device. A CCD is made of a highly sensitive semiconductor material and consists of many photosensitive units, typically measured in megapixels. When the CCD surface is illuminated, each photosensitive unit reflects a charge onto the component, converting light into charge; the signals generated by all the photosensitive units are added together to form a complete image. This is then converted into a digital signal, compressed, and stored in the camera's internal flash memory or built-in hard drive. CMOS mainly utilizes semiconductors made of silicon and germanium, allowing N-type (negative) and P-type (positive) semiconductors to coexist on the CMOS. The current generated by these two complementary effects can be recorded and interpreted into images by the processing chip.

[0056] In some embodiments, the imaging component 2 is configured as an integrated camera, such as an RGB camera. In some embodiments, the lens 21 of the integrated camera has a lens hood to reduce the impact of prism reflection on image quality.

[0057] For multiple imaging components 2, including at least a first imaging component 201 corresponding to a first depth of field and a second imaging component 202 corresponding to a second depth of field, the values ​​of the first depth of field and the second depth of field are different. As introduced above, the meaning of depth of field here refers to the range of distances including the front and back of the subject that can be captured in a clear image at the front edge of the lens. That is, after focusing, the distance of the clear image presented within the range before and after the focus is completed is called the depth of field. Since the depth of field of the first imaging component 201 and the second imaging component 202 are different, the first image provided by the first imaging component 201 to the image processor 3 and the second image output by the second imaging component 202 to the image processor 3 are different. The image processor 3 can fuse the first image and the second image to output a fused image.

[0058] The specific fusion process can be as follows: For example, camera intrinsic parameter calibration can be performed using MATLAB software, and distortion correction can be achieved using distortion coefficients; simple preprocessing of the image can be performed, the perspective transformation matrix can be calculated, and the images from the two cameras can be registered; pixel-level image fusion can be performed on the registered images from the two cameras, and the final fused image can be output. The advantage of this approach is that by acquiring image data with different focus distances and field of view from various sensors and then performing fusion processing, it is possible to retain a larger range of images captured at a smaller focal length, and to fuse images from different focal lengths to obtain an image with a large depth of field and a wide field of view at the same moment.

[0059] It is understood that the image processor 3 is not limited to a specific processor. For example, in some cases, the image processor 3 can have a distributed structure, such as including processors located at the imaging system end and the back-end cloud, with the image fusion processing described above being implemented by the imaging system end and / or the back-end cloud. Furthermore, in embodiments employing a distributed structure, the specific execution terminal for each step can be adjusted according to actual conditions, and the specific implementation scheme of each step on a particular terminal should not limit the scope of protection of this application.

[0060] In some embodiments, multiple imaging components 2 are configured with unified optical axes, also known as optical axis alignment, meaning that the optical axes at different positions of the lens are in the same direction. A calibration method to achieve a unified optical axis structure can be to use a fixing device to synchronously move the lens and sensor in the X and Y directions, applying the principle of optical path reversibility to adjust from the direction of light incidence, so that the images of each lens group completely overlap, completing the calibration, achieving optical axis unification, and a baseline close to zero. This reduces the difficulty of image algorithm registration and improves the quality of the final fused image.

[0061] In some embodiments, the image distance of each imaging component 2 is a fixed value, and the focal length of each lens 21 is a fixed value; the fixed values ​​of the focal lengths of the lenses 21 included in different imaging components 2 are different. Specifically, the structure that achieves different values ​​for the first depth of field and the second depth of field can be that the first imaging component 201 includes a first lens 211 with a focal length equal to the first lens focal length, and the second imaging component 202 includes a second lens 212 with a focal length equal to the second lens focal length. The fixed values ​​of the first lens focal length and the second lens focal length are different, which makes it easy to set the image distance and easy to assemble the imaging system. At the same time, it can achieve the fusion of telephoto and short-focal lengths to obtain a larger field of view.

[0062] In other embodiments, the image distance of each imaging component 2 is a fixed value, and the focal length of each lens 21 is a fixed value; the fixed focal lengths of the lenses 21 included in different imaging components 2 are the same, but the fixed image distances are different. Specifically, the structure that achieves different values ​​for the first depth of field and the second depth of field can be as follows: the first imaging component 201 includes a first lens 211 and a first photosensitive element 221, the distance from the optical center of the first lens 211 to the first photosensitive element 221 is the first image distance, and the focal length of the first lens 211 is the first lens focal length; the second imaging component 202 includes a second lens 212 and a second photosensitive element 222, the distance from the optical center of the second lens 212 to the second photosensitive element 221 is the second image distance, and the focal length of the second lens 212 is the second lens focal length; the fixed values ​​for the first lens focal length and the second lens focal length are the same, but the fixed values ​​for the first image distance and the second image distance are different. This allows the same lens 21 to be used for different imaging components 2, resulting in lower material costs. At the same time, images with similar field of view can be fused, leading to less resolution loss during the registration process and higher clarity in the fused image.

[0063] In some embodiments, the focal length of lens 21 can be a fixed value of 0.1mm to 300mm; optionally, the focal length of lens 21 can be a fixed value of 1mm to 150mm; more preferably, the focal length of lens 21 can be a fixed value of 1mm to 50mm; further preferably, the focal length of lens 21 can be a fixed value of 1mm to 20mm; even more preferably, the focal length of lens 21 can be a fixed value of 1mm to 16mm; and still more preferably, the focal length of lens 21 can be a fixed value of 1mm to 5mm.

[0064] In some embodiments, the focal length of lens 21 can be as follows: Figure 1 As shown, the two imaging components have focal lengths of 1.94mm and 4mm for the first lens and 3mm and 200mm for the second lens, respectively; or focal lengths of 135mm and 200mm for the first lens and 200mm for the second lens. Alternatively, they could be... Figure 2 As shown, the focal lengths of the first lens, the second lens, and the third lens 213 of the third imaging component 203 are 1.94mm, 4mm, and 16mm, respectively; or the focal lengths of the first lens, the second lens, and the third lens are 3mm, 50mm, and 210mm, respectively; or the focal lengths of the first lens, the second lens, and the third lens are 85mm, 135mm, and 300mm, respectively. That is, the focal length of the lens 21 in each imaging component is different, and there is no limitation on the specific range of the focal length or the difference in focal length between different lenses.

[0065] refer to Figure 1 ,Figure 2 As shown, in some embodiments, the imaging system 100 further includes a heat sink 4, which is fluidly connected to the beam splitter 1 and / or multiple imaging components 2, to prevent the imaging system 100 from overheating and further improve the imaging quality. The specific structure of the heat sink 4 can be a fan, a thermally conductive material component, or a water-cooled / air-cooled heat exchanger, heat pipe, or other common heat dissipation structures, and is not limited thereto.

[0066] This application also provides an imaging device having the imaging system 100 described in the above embodiments. The imaging device includes an indoor monitoring system and a stereo vision industrial camera. Specific examples of different imaging devices are described below.

[0067] Example 1

[0068] The imaging device is an indoor monitoring system, which includes an imaging system 100 such as Figure 1 As shown, the system includes a beam splitter 1, two imaging components 2, namely a first imaging component 201 and a second imaging component 202, and an image processor 3. The beam splitter 1 is a 28×20×20mm cuboid prism, elongated along the light-incident and exit surfaces to ensure it does not obstruct the camera's field of view. The prism contains a standard 50:50 visible light coating in the middle, which splits the incident light beam 200 into two beams with directions in the same X direction as the light beam 200 and the Y direction perpendicular to the light beam 200, namely the first beam 2001 and the second beam 2002.

[0069] The first lens 211 has a focal length of 1.94mm, and the second lens 212 has a focal length of 4mm. Both the first and second image sensors 221 and 222 are CMOS sensors. The first imaging assembly 201 and the second imaging assembly 202 are configured as a first camera and a second camera, respectively, both being GRB cameras. The first imaging assembly 201 is located at the first beam 2001, and the second imaging assembly 202 is located at the second beam 2002. A corresponding light shield can be provided on the camera mounting surface to reduce the impact of prism reflections on image quality. The indoor monitoring system is equipped with a corresponding heat sink 4, for example, to conduct heat from the camera processing board to the metal base via a thermally conductive material. The image processor 3 performs fusion processing on the image data acquired by the first and second image sensors 221 and 222. A semi-reflective beam splitter unifies the optical axes of cameras with different focal lengths, greatly reducing the baseline length of the two cameras, improving registration accuracy, and ensuring the final image quality of the system.

[0070] Example 2

[0071] The imaging device is an industrial camera, which includes an imaging system 100 such as Figure 2As shown, the system includes a first beam splitter 101, a second beam splitter 102, three imaging components 2, the first imaging component 201 having a first lens 211 and a first photosensitive element 221, the second imaging component 202 having a second lens 212 and a second photosensitive element 222, the third imaging component 203 having a third lens 213 and a third photosensitive element 223, and an image processor 3. The first beam splitter 101 and the second beam splitter 102 are both 28×20×20mm cuboid prisms, elongated along the light entry and exit surfaces. The prisms contain a standard 50:50 visible light coating in the middle, which can split the incident light beam into two beams. Beam splitter 1 splits the incident light beam into two beams, one in the same direction as the incident light and the other perpendicular to it. First beam splitter 101 splits beam 200 into a first beam 2001 and a second beam 2002. First beam 2001 is received by first imaging component 201, and second beam 2002 is received by second beam splitter 102, splitting into a third beam 2003 and a fourth beam 2004. Third beam 2003 is received by second imaging component 202, and fourth beam 2004 is received by third imaging component 203. The focal length of first lens 211 is configured to be 1.05mm, the focal length of second lens 212 is configured to be 4mm, and the focal length of third lens 213 is configured to be 12mm. First photosensitive element 221, second photosensitive element 222, and third photosensitive element 223 are all CMOS sensors. Image processor 3 acquires image data collected by the first photosensitive element 221, the second photosensitive element 222, and the third photosensitive element 223 respectively, namely, the first image corresponding to the first depth of field, the second image corresponding to the second depth of field, and the third image corresponding to the third depth of field. The first depth of field, the second depth of field, and the third depth of field are different, and fusion processing is performed.

[0072] Example 3

[0073] The imaging device is an industrial camera. Compared with Embodiment 2, the difference lies in that the first lens 211, the second lens 212, and the third lens 213 are the same, and the focal length of each lens is 4mm. However, the first image distance of the first imaging component 201, the second image distance of the second imaging component 202, and the third image distance of the third imaging component are all different, thereby achieving different depths of field. The image processor 3 acquires the image data collected by the first photosensitive element 221, the second photosensitive element 222, and the third photosensitive element 223, respectively, which are the first image corresponding to the first depth of field, the second image corresponding to the second depth of field, and the third image corresponding to the third depth of field. The first depth of field, the second depth of field, and the third depth of field are different and are fused together.

[0074] As described above, this application also provides an imaging method using the imaging system 100 as described in the above embodiments, the imaging method comprising:

[0075] Multiple imaging components output multiple images corresponding to different depths of field to the image processor. The image processor then fuses these multiple images to output a fused image. Examples of multiple imaging components can be two, three, or even more. Figure 1 , Figure 2 The number of imaging components shown is limited.

[0076] Optionally, the imaging method includes:

[0077] S101. Output the first image to the image processor through the first imaging component 201 corresponding to the first depth of field;

[0078] S102. Output a second image to the image processor via the second imaging component 202 corresponding to the second depth of field;

[0079] S200. The image processing device fuses the first image and the second image and outputs a fused image.

[0080] In summary, the imaging system and imaging device described in the above embodiments have the following beneficial effects, including but not limited to: by configuring the optical structure of the beam splitter-multiple imaging components-image processor optical path and electrical signal flow, images with different depths of field provided by different imaging components can be fused in the image processor. This achieves the advantages of using a fixed-focus camera, which has simple calibration and good robustness of calibration results, while overcoming the shortcomings of the limited depth of field range of fixed-focus cameras, which greatly limits the applicable scenarios.

[0081] While this application discloses preferred embodiments as described above, it is not intended to limit the scope of this application. Any changes and modifications can be made by those skilled in the art without departing from the spirit and scope of this application. Therefore, any modifications, equivalent changes, and alterations made to the above embodiments based on the technical essence of this application without departing from the content of the technical solution of this application shall fall within the protection scope defined by the claims of this application.

Claims

1. An imaging system (100), characterized in that, include: The beam splitter (1) is capable of splitting the beam input to the beam splitter (1) into multiple beams with different output directions; Multiple imaging components (2) are provided, each corresponding to receive a beam of light from each output direction and outputting an electrical signal. Each imaging component (2) includes: Lens (21), lens (21) is used to receive the beam of light in each output direction; The photosensitive element (22) receives the light beam output from the lens (21) and converts it into an electrical signal. The output direction of the electrical signal output by the photosensitive element (22) is configured to point to the image processor (3). The image distance of the imaging component (2) is defined as the distance from the optical center of the lens (21) to the photosensitive element (22), and the focal length of the lens is defined as the distance from the optical center of the lens to the focal point where the light converges when parallel light is incident. For the plurality of imaging components (2), at least a first imaging component (201) corresponding to a first depth of field and a second imaging component (202) corresponding to a second depth of field are included, and the values ​​of the first depth of field and the second depth of field are different; Optionally, the image distance of each imaging component (2) is a fixed value, and the focal length of each lens (21) is a fixed value.

2. The imaging system (100) as claimed in claim 1, characterized in that, The plurality of imaging components (2) are configured to have a unified optical axis; the image distance of each imaging component (2) is a fixed value, and the focal length of each lens (21) is a fixed value; Different imaging components (2) include lenses (21) with different fixed focal lengths; Optionally, the first imaging component (201) includes a first lens (211) with a focal length of the first lens (211) being the first lens focal length, and the second imaging component (202) includes a second lens (212) with a focal length of the second lens (212) being the second lens focal length, wherein the fixed values ​​of the first lens focal length and the second lens focal length are different.

3. The imaging system (100) as claimed in claim 1, characterized in that, The plurality of imaging components (2) are configured to have a unified optical axis; the image distance of each imaging component (2) is a fixed value, and the focal length of each lens (21) is a fixed value; Different imaging components (2) include lenses (21) with the same focal length but different fixed image distance values; Optionally, the first imaging component (201) includes a first lens (211) and a first photosensitive element (221), wherein the distance from the optical center of the first lens (211) to the first photosensitive element (221) is a first image distance, and the focal length of the first lens (211) is a first lens focal length. The second imaging assembly (202) includes a second lens (212) and a second photosensitive element (222). The distance from the optical center of the second lens (212) to the second photosensitive element (222) is the second image distance, and the focal length of the second lens (212) is the second lens focal length. The fixed values ​​for the focal length of the first lens and the focal length of the second lens are the same, while the fixed values ​​for the first image distance and the second image distance are different.

4. The imaging system (100) as claimed in claim 1, characterized in that, Includes one or more of the aforementioned beam splitters (1); Optionally, the imaging system (100) includes a plurality of beam splitters (1), which are arranged sequentially in the same direction. The number of beam splitters (1) is N, and the number of the plurality of imaging components (2) is N+1, where N is a positive integer greater than or equal to 2. Further optionally, the imaging system (100) includes two beam splitters (1), and the two beam splitters (1) are respectively provided with three imaging components (2).

5. The imaging system (100) as claimed in claim 1, characterized in that, The beam splitter (1) is a cuboid, and the long side of the cuboid connects the light-incident surface and the light-outcident surface of the beam splitter (1); or the beam splitter (1) is a cube.

6. The imaging system (100) as claimed in claim 1, characterized in that, The beam splitter (1) has a beam splitting surface (11), and the beam splitting surface (11) has a semi-transparent and semi-reflective film (110); Optionally, the semi-transparent and semi-reflective film (110) is a visible light coating with a spectral splitting ratio of 50% to 50% for transmission and reflection. Optionally, the reflected light output by the beam splitter (1) corresponds to the first optical axis (2011), and the transmitted light output corresponds to the second optical axis (2012), wherein the first optical axis (2011) and the second optical axis (2012) are perpendicular.

7. The imaging system (100) as claimed in claim 1, characterized in that, The focal length of lens (21) is a fixed value ranging from 0.1mm to 300mm; Optionally, the focal length of the lens (21) is a fixed value of 1mm to 150mm; Alternatively, the focal length of the lens (21) is a fixed value of 1 mm to 50 mm; Further optionally, the focal length of the lens (21) is a fixed value of 1mm-20mm; Alternatively, the focal length of the lens (21) is a fixed value of 1mm-16mm; Alternatively, the focal length of the lens (21) is a fixed value of 1mm-5mm.

8. The imaging system (100) as claimed in claim 1, characterized in that, The photosensitive element (22) is a CCD element or a CMOS element; The imaging component (2) is configured as an integrated camera; Optionally, the integrated camera is an RGB camera; Optionally, the lens (21) of the integrated camera has a lens hood.

9. The imaging system (100) as claimed in claim 1, characterized in that, It also includes a heat sink (4) that is fluidly connected to the beam splitter (1) and / or multiple imaging components (2).

10. An imaging device, characterized in that, The imaging system (100) as described in any one of claims 1-9 includes an indoor monitoring system and a stereo vision industrial camera.

Images