All-optical imaging system and method for all-optical imaging of an object region

CN116324584BActive Publication Date: 2026-10-30KLENS GMBH
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202180064695.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-09-22
Filing Date
2021-09-21
Publication Date
2026-10-30
Estimated Expiration
2041-09-21

Smart Images

  • Figure CN116324584B_ABST
    Figure CN116324584B_ABST
Patent Text Reader

Abstract

The invention relates to an imaging system (1) comprising a plurality of imaging devices arranged successively in the direction of an optical axis (2), wherein a first imaging device (3) is provided for generating a real intermediate image of an object in an intermediate image plane (6), a second imaging device (4) is provided for generating at least one virtual mirror image of the real intermediate image, the mirror image being arranged in the intermediate image plane offset from the real intermediate image, and a third imaging device (5) is provided for jointly imaging the real intermediate image and the virtual mirror image as a real image on an image reception plane (7) to be arranged at an axial distance from the intermediate image plane. The imaging system comprises an optical filter device (8) by means of which the imaging of the real intermediate image and / or the imaging of at least one of the virtual mirror images can be filtered separately from one another. The invention also relates to a plenoptic imaging method, a computer program product for implementing the method and a data processing device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to an all-light imaging system, particularly an imaging system for a camera, comprising a plurality of imaging devices arranged sequentially along an optical axis, the plurality of imaging devices comprising: a first imaging device for generating a real intermediate image of an object in an intermediate image plane; a second imaging device for generating at least one virtual mirror image of the real intermediate image, the mirror image being disposed offset from the real intermediate image in the intermediate image plane; and a third imaging device for imaging the real intermediate image and the virtual mirror image together into a real image on an image receiving surface to be disposed at an axial distance from the intermediate image plane.

[0002] The present invention also relates to a method for all-optical imaging, a computer program product for implementing the method, and a data carrier signal for transmitting the computer program product. Background Technology

[0003] Such an imaging system is known from WO2014 / 124982A1. In combination with a camera that generates digital image data, such an imaging system allows the generation of image data sets that, in addition to two-dimensional image information, also contain information relating to the depth of image points in object space. When reproducing an image electronically using such a data set, the additional depth information can, for example, be used to clarify the image for different object field depths. Summary of the Invention

[0004] The purpose of this invention is to provide additional functions for all-optical imaging systems.

[0005] According to the present invention, the objective is achieved in the following manner: the imaging system includes an optical filtering device by means of which the imaging of a real intermediate image and / or the imaging of at least one of the virtual mirror images can be filtered separately from each other, the optical filtering device being disposed in the intermediate image plane or directly in front of or behind the intermediate image plane in the direction of the optical axis and / or directly in front of the image receiving plane.

[0006] With the all-light imaging system according to the invention, it becomes possible to simultaneously generate and perhaps record multiple images, which are filtered and perhaps unfiltered, through a single recording, and to obtain information about the depth of the image.

[0007] Therefore, the cost of achieving different images and obtaining image depth information is significantly reduced. Furthermore, it enables the generation and recording of differently filtered images at short time intervals, making it even possible to create such video recordings.

[0008] It has proven particularly advantageous that information from each image obtained through different filters is correlated with information about the image depth. In this way, characteristics of objects imaged by the imaging system that can be detected by means of filtering can be determined based on the distance between these objects and the imaging system.

[0009] In one embodiment of the invention, the imaging system includes an image receiving surface and a processing unit for processing a real image received by means of the image receiving surface. Preferably, the image receiving surface has at least one image recording sensor, or is configured with at least one image recording sensor. In a preferred embodiment of the invention, the image receiving surface is configured with a single image recording sensor. The image recording sensor is preferably a CCD sensor or a CMOS sensor.

[0010] Preferably, the processing device for processing the recorded images is configured as a data processing device, particularly a computer, which is specifically designed to process data read from the image recording sensor. In one embodiment of the invention, the data processing device is housed in the camera housing, the camera preferably being part of or configured to be used with the imaging system.

[0011] In one embodiment of the invention, the processing apparatus is configured to determine, with reference to the optical axis direction, the position of an object segment imaged by at least some of the image points in the image. Advantageously, in this manner, the aforementioned information regarding image depth can be obtained. The position determination is preferably specified such that the position can be determined in the optical axis direction, particularly at least in terms of relative relationships. Furthermore, it is conceivable that the processing apparatus is arranged such that the position can be determined as the distance between the object region point and the imaging system at the recording time.

[0012] Suitably, the processing apparatus is configured to determine the position and, for this purpose, ascertain the extent to which identical object segments, particularly identical object points, are presented in a staggered manner in the imaging of the real intermediate image and in the imaging of at least one of the various virtual intermediate images and / or in the imaging of at least two different virtual mirror images. The staggered presentation of object segments in each image and thus the different reproductions arise in such a way that each different image describes the object from a different perspective, and the object segments change their relative positions to each other due to parallax based on the different perspectives.

[0013] In one embodiment of the invention, the filtering device is disposed in front of the image receiving device, preferably directly in front of the image receiving device. Preferably, a holding device is provided, on which the filtering device can be detachably disposed in front of the image receiving device. This holding device is preferably constructed on the objective lens housing of the imaging system and / or on the camera housing. Preferably, the holding device is provided with an adjustment mechanism for adjusting, in particular calibrating, the position of the filtering device within the holding device. This adjustment is used to position the filter so that the beams forming different images always pass through the filter precisely. The holding device may include at least one calibration device, such as an adjusting screw or the like, by means of which the position of the filtering device or the position of at least some filters within the filtering device can be changed. The calibration device may be used for adjustment in the direction of the optical axis, for adjustment in a direction perpendicular to the optical axis, and / or for rotation, for example, rotation about the optical axis or rotation in a direction perpendicular to the optical axis.

[0014] In another embodiment of the invention, the filtering device is disposed in a position in the imaging system where the imaging of the real intermediate image and the imaging of the virtual mirror image are spatially separated from each other and, in particular, do not overlap.

[0015] In one embodiment of the present invention, the filtering device is disposed in the first imaging device, or is part of the first imaging device. Alternatively, the filtering device may be disposed in the intermediate image plane, or directly in front of or behind the intermediate image plane along the optical axis.

[0016] Preferably, the filtering device has at least two optical filters. Preferably, at least two of the optical filters differ in their filtration characteristics. The filtering device may include at least one of the following filters: a polarizing filter, an ultraviolet blocking filter, a color filter, an infrared blocking filter, a neutral density filter, a slit filter, an interference filter, a Bayer filter, a complementary color filter, and / or a fluorescent filter. Even when using multiple filters of the same type, the optical filters may differ in their respective filtration characteristics. For example, polarizing filters may differ in their orientation, interference filters may differ in their respective wavelength-related transmittance, the slit filters may differ in their respective spectral range isolation, neutral density filters may differ in their neutral density, and / or complementary color filters may differ in their respective color-specific wavelength-related transmittance.

[0017] Especially when using different neutral density filters, preferably with different neutral densities from one another, it becomes possible to create HDR (High Dynamic Range) imaging from a single record. In particular, it is also possible to create video in HDR.

[0018] Furthermore, it becomes possible to mimic, and in particular calculate, the effect of at least one filter when processing images with different filters, especially through interpolation of the images recorded with different filters. For example, an orange-filtered image can be made from images with red and green filters.

[0019] In a particularly preferred embodiment of the invention, the filtering device has a carrier, preferably a carrier frame, and optical filters—preferably detachable—that can be disposed in different filtering positions within the carrier. The carrier may be constructed of two transparent glass plates, with the filters disposed between them. Alternatively, it is conceivable that the carrier may be constructed of a plastic frame, with the filter insertion positions located on the plastic frame within the filtering positions.

[0020] Preferably, the filtering device has N×N, preferably 3×3, 5×5, or 7×7 filtering positions arranged in a matrix structure. Preferably, the matrix arrangement extends in a direction perpendicular to the optical axis of the imaging system when arranged in the imaging system.

[0021] It goes without saying that at least one filtering position in the filtering device can remain unfiltered in order to achieve unfiltered imaging of the real intermediate image and / or unfiltered imaging of at least one of the mirror images.

[0022] In a particularly preferred embodiment of the invention, at least two of the optical filters have the same filtering characteristics. Advantageously, the positions mentioned in the optical axis direction can then be determined particularly easily by means of imaging with the same filters, and thus information about the image depth can be obtained.

[0023] Similarly, at least two of the filtering positions can remain idle, and information about the image depth can be determined by means of the unfiltered image.

[0024] In a particularly preferred embodiment of the invention, at least two optical filters having the same filtering characteristics are disposed in external filtering positions of the matrix arrangement, and / or at least two of the external filtering positions remain unused. Particularly preferably, optical filters having the same filtering characteristics are disposed in external filtering positions opposite each other, particularly diagonally opposite each other, and / or the aforementioned external filtering positions remain unfiltered. Advantageously, information regarding image depth can be determined particularly well in this arrangement, which consists of correspondingly filtered or unfiltered images at the external filtering positions, because a greater parallax is generated in each image based on a larger difference in viewing angles.

[0025] In another embodiment of the invention, the processing device is configured to determine the position in the optical axis direction from the differently filtered images in the image. The processing device may be configured to match the different image points to each other, for example by means of comparison of intensity, color, and / or brightness and by means of perhaps identifiable imaged contours, and to determine the position as described above.

[0026] In a particularly preferred embodiment of the invention, the processing device is configured to correlate information about corresponding image points from different imaging sources, such as color, intensity, and / or brightness, with the position of the corresponding image points along the optical axis. This advantageously enables the matching of information, which can be determined through filtering, perhaps different filtering methods, with position, particularly describing the distance to the imaging system.

[0027] Preferably, the filtering device, especially the aforementioned carrier, is equipped with a mark, preferably an automatically readable mark. The mark may contain information about the characteristics of the filter and the characteristics of the corresponding filtering location, and / or contain a code by which information can be retrieved from a database—perhaps via the Internet.

[0028] The mark may be formed by an optically readable code, preferably a barcode, a QR code, or the like, or by a mechanical code, which may be set on the aforementioned carrier frame, for example.

[0029] Alternatively, it is conceivable that the mark is positioned on the filtering device such that, when a record is made by means of an imaging device, the mark is optically displayed on the real image. The mark may be formed on at least one of the filters, or by a suitable optical element provided with the mark, positioned in one of the filtering locations.

[0030] Preferably, the imaging system has a reading device for reading the markers. The processing device may be configured to retrieve information about the characteristics of the filter and the characteristics of the corresponding filter location from a database and / or process it while processing the real image.

[0031] In another embodiment of the invention, the imaging system has a replacement device for automatically changing optical filters. Automatic replacement can be achieved by replacing some or more of the optical filters and / or the aforementioned carrier. For filter replacement, a filter magazine containing multiple different filters can be provided, and the filters can be automatically removed from the magazine for use in the carrier and reinserted for storage. For replacing the entire carrier, a filter wheel can be provided, holding multiple wheel frames, preferably differently prepared with optical filters, and positioned on the imaging system such that a corresponding additional support frame functions within the imaging system.

[0032] In one embodiment of the invention, the second imaging device has at least one mirror, preferably multiple mirrors, and / or at least one prism, preferably multiple prisms, for generating an image on a receiving surface. The one or more mirrors and / or the one or more prisms are arranged in the second imaging device such that multiple images of an object region can be generated on the receiving surface. For this purpose, various different arrangements of the mirrors and / or prisms are possible in principle. It has proven particularly advantageous to arrange the second imaging device such that multiple mirrors are provided, and these multiple mirrors are arranged such that different light beams entering through the entrance opening pass through the second imaging device according to their respective optical paths without reflection; or are reflected, perhaps multiple times, on one or more of the reflecting surfaces, and then they exit the second imaging device.

[0033] In a particularly preferred embodiment of the invention, the second imaging device comprises a kaleidoscope. Suitably, such a kaleidoscope includes at least one pair of flat reflective surfaces, wherein the reflective surfaces are arranged facing each other and spaced apart. At least a portion, preferably all, of the optical path extends through the space between the reflective surfaces. Preferably, the reflective surfaces are arranged parallel to each other. The kaleidoscope may have two or more pairs of mirrors. These pairs of mirrors can form a tube that is polygonal in cross-section, preferably rectangular. Alternatively, the kaleidoscope can be constructed from a cylindrical glass rod that is polygonal in cross-section, the glass rod having multiple side surfaces and reflective end faces for beam entry and exit. The glass rod preferably has an isosceles triangular, rectangular, especially square, regular pentagonal, hexagonal, heptagonal, or octagonal shape in cross-section.

[0034] Suitablely, the mirrors and / or prisms are configured such that different images describe the object region in a manner recorded from different perspectives.

[0035] In a preferred embodiment of the invention, the first imaging device includes at least one light-incident lens, preferably multiple light-incident lenses. Preferably, the second imaging device is configured such that light beams incident into the second imaging device are split according to their directions, thus detecting the object region from slightly different perspectives, but still describing the same object region.

[0036] Preferably, the first imaging device is configured such that it images the object region on the intermediate image plane at the end of the second imaging device facing the first imaging device.

[0037] Ideally, the light-emitting lens system is configured such that the sharp plane of the light-emitting lens system is the same as the input plane of the second imaging device—especially the kaleidoscope.

[0038] Various embodiments of the imaging apparatus are described in WO2014 / 124982A1. The contents of WO2014 / 124982A1 are incorporated herein by reference. Specifically, the text from paragraph 1 on page 7 to paragraph 2 on page 11 is referenced. Figures 1-3 There, suitable imaging devices are described, and how these imaging devices work is explained.

[0039] In one embodiment of the present invention, the second imaging device is disposed on the side of the first imaging device facing the image receiving surface.

[0040] Suitablely, the first, second and third imaging devices are arranged sequentially in the optical axis direction, and preferably, the second imaging device is arranged between the first and third imaging devices.

[0041] In another embodiment of the invention, the imaging system, and in particular the imaging devices, are configured such that the space of objects that can be imaged by means of the imaging system is positioned in front of the first imaging device when viewed from the image receiving surface in the optical axis direction. In particular, the imaging system, and in particular the imaging devices, are configured such that the space of objects that can be imaged is positioned on the side of the first imaging device opposite to the second imaging device.

[0042] In a particularly preferred embodiment of the invention, the imaging system constitutes an objective lens for a camera. Preferably, the objective lens includes a housing in which the imaging system is disposed. The objective lens preferably has a fixing device for mechanically securing it to the camera housing, such as an objective lens thread or an objective lens bayonet mount. Additionally, means for electrical or electronic connection to the camera housing and / or for transmitting data with the camera housing may be provided.

[0043] As mentioned at the beginning, the present invention relates to a method for all-optical imaging of an object region, particularly by means of a camera, wherein the object region is imaged by a plurality of imaging devices arranged sequentially along the optical axis, the plurality of imaging devices comprising: a first imaging device for generating a real intermediate image of the object in an intermediate image plane; a second imaging device for generating at least one virtual mirror image of the real intermediate image, the mirror image being offset from the real intermediate image in the intermediate image plane; and a third imaging device for imaging the real intermediate image and the virtual mirror image together into a real image on an image receiving surface to be positioned at an axial distance from the intermediate image plane. The method is characterized in that the imaging of the real intermediate image and / or the imaging of at least one of the virtual mirror images are filtered separately from each other, and the filtering is implemented directly in front of or behind the intermediate image plane and / or directly in front of the image receiving surface in the intermediate image plane or along the optical axis.

[0044] Suitablely, the position of an object region point in the direction of the optical axis is determined, the object region point being imaged through at least some of the image points of the image.

[0045] In one embodiment of the invention, the position is determined by ascertaining the extent to which identical object segments, particularly identical object points, are staggered from each other in the imaging of a real intermediate image and in the imaging of at least one virtual intermediate image among various virtual intermediate images and / or in the imaging of at least two different virtual mirror images.

[0046] In a particularly preferred embodiment of the invention, the location is determined solely from images in the real image, either unfiltered or filtered with optical filters having the same filtering characteristics. Alternatively or supplementing this, the location is determined from images in the real image filtered with optical filters having different filtering characteristics.

[0047] In one aspect of the invention, in different imaging processes, at least some image points are associated with points in an object region that are imaged by these image points, and by means of said association, the positions of the points in the object region along the optical axis are determined at least in a relative relationship to each other. The association may include image analysis of different imaging processes, wherein different image points are assigned to corresponding points in the object region that are imaged by these image points.

[0048] The present invention also relates to a processing method for processing a recorded real image. In this processing method, separately filtered imaging of a real intermediate image and / or separately filtered imaging of at least one of the virtual mirror images are processed according to corresponding filters, and / or the position of an object region point imaged by at least some image points of the image in the optical axis direction is determined from the image.

[0049] It is appropriate to determine the location in such a way as to ascertain the extent to which the same object segments, in particular the same object points, are presented offset from each other in the imaging of the real intermediate image and in the imaging of at least one of the virtual intermediate images and / or in the imaging of at least two different virtual mirror images.

[0050] In one embodiment of the processing method, when processing images with different filters, the filtering effect is simulated, in particular calculated, for example, by interpolation.

[0051] The present invention also relates to a computer program product comprising instructions that, when executed by a computer, cause the computer to perform at least some steps of a method for panoptic imaging of an object region and / or at least some steps of a method for processing a real image.

[0052] In particular, the computer program product includes instructions that, when executed by a computer, cause the computer to perform at least one of the method steps mentioned below: - To generate a real image by means of an imaging device and / or while performing an imaging method; - The imaging of separately filtered real intermediate images and / or the imaging of separately filtered at least one virtual mirror image among the virtual mirror images are processed according to the corresponding filters. - From separately filtered imaging of real intermediate images and / or separately filtered imaging of at least one virtual mirror image, perhaps from multiple images filtered differently, determine the position of an object region point imaged by at least some image points in the optical axis direction. - From separately filtered imaging of real intermediate images and / or separately filtered imaging of at least one virtual mirror image, determine the position of an object region point imaged by at least some image points in the optical axis direction, wherein the position is in object space, which is located in front of the first imaging device and / or on the side of the first imaging device away from the second imaging device when viewed in the optical axis direction toward the image receiving surface.

[0053] Suitablely, the computer program product is configured to automatically induce image generation for recording real images, wherein the program runs on a computer, and the computing mechanism enables the computer to induce the recording, preferably based on an electrical and / or electronic connection between the computer and the imaging system or based on a computer-to-imaging system implementation.

[0054] In order to determine the mentioned locations, the computer program product is configured in one embodiment of the invention to ascertain the extent to which identical object segments, particularly identical object points, are presented offset from each other in the imaging of real intermediate images and in the imaging of at least one virtual intermediate image among various virtual intermediate images and / or in the imaging of at least two different virtual mirror images.

[0055] In one embodiment of the invention, the computer program product is configured to configure information about filters used accordingly for imaging, for processing separately filtered imaging, the imaging of the real intermediate image and the imaging of the at least one virtual mirror image. The computer program may be configured to automatically retrieve information from a database—perhaps via the Internet—as explained above.

[0056] Preferably, the computer program product can be directly loaded into the internal memory of a digital computer and includes a software portion, wherein when the computer program product is run on a computer, particularly on an imaging system, the method steps can be executed.

[0057] Suitablely, the computer program product is a computer program stored on a data carrier, preferably RAM, ROM, CD or the like, or in a device, especially a personal computer, a device with a built-in processor, a computer built into a device, a smartphone, a computer of an image recording apparatus, especially a camera and / or video recorder, or a signal sequence describing data suitable for transmission via a computer network, especially the Internet.

[0058] The present invention also relates to a data processing apparatus comprising devices for implementing the method. The data processing apparatus is preferably configured using a computer.

[0059] In one embodiment of the invention, the device is part of the aforementioned imaging system. Preferably, the device is part of a camera, particularly a camera and / or video recorder, which includes the imaging system and / or is configured to be equipped with the imaging system.

[0060] In a particularly preferred embodiment of the invention, the data processing device is used to operate a camera, especially a camcorder and / or video camera, when making image recordings by means of a camera.

[0061] Ideally, the data processing device is part of the imaging system, especially the camera, and is there, for example, constituted by a processor and memory, which the processor can access.

[0062] The present invention also relates to a camera, particularly a camera and / or video camera, which includes the aforementioned imaging system and the data processing device mentioned. Attached Figure Description

[0063] The invention will now be explained in more detail with the aid of embodiments and accompanying drawings relating to these embodiments. The drawings are as follows: Figure 1 An imaging system according to the present invention is shown; Figure 2 Another imaging system according to the invention is shown; Figure 3 Display by Figure 1 or Figure 2 One of the optical paths in an imaging system; Figure 4 Display by Figure 1 or Figure 2 Other optical paths in one of the imaging systems; Figure 5 Display by Figure 1 or Figure 2 One of the filtering devices in the imaging system; Figure 6 This illustration shows a camera equipped with an imaging system; and Figure 7 Displaying images recorded by means of the imaging system according to the present invention. Detailed Implementation

[0064] exist Figure 1 The diagram schematically illustrates how all-optical image recording can be produced using imaging system 1 in accordance with the present invention. This imaging system 1, in addition to the incident lens group 3 and the exit lens group 5, also includes a mirror box 4 with multiple mirrors 19, such as... Figure 3As shown, the reflector is rectangular in cross-section within the reflector box 4. The reflector box 4 forms a kaleidoscope. The object region reflects the object 23, and beams 22 originating from this object region are incident on the incident lens group 3 and guided by the incident lens group 3 into the interior of the reflector box 4. Some of the beams 22 pass through the reflector box 4 all the way to the exit lens group 5 without encountering one of the reflectors 19, while other beams are reflected only once on one of the reflectors 19 before encountering the exit lens group 5. Other beams are reflected multiple times on the reflectors 19 within the reflector box 4, and the reflection can occur not only on the reflectors 19 that are opposite each other but also on the reflectors 19 that are adjacent to each other (see...). Figure 3 and Figure 4 The exiting lens group 5 is configured such that the light beam 22 exiting from the reflector box 4 is guided to the receiving surface 7, which is formed by a sensor, especially a CCD sensor or a CMOS sensor.

[0065] The incident lens group 3, the reflecting mirror box 4 and its reflecting mirror 19, and the exit lens group 5 are arranged such that nine images of the object region are formed on the receiving surface 7, which are generated side by side in a 3×3 matrix. Each image is generated such that it reflects the object region from nine different perspectives originating from the incident lens group 4.

[0066] The imaging system 1 is equipped with a filter device 8, such as Figure 1 and Figure 2 As shown, the filtering device can be set in different positions in the imaging system 1. Figure 1 The display shows that the filter device 8 is directly positioned in front of the receiving surface 7. According to... Figure 2 In the arrangement structure, the filter device 8 is set in the intermediate image plane.

[0067] The filter device 8 may include two glass plates as carriers, with a filter placed between them. Alternatively, a plastic frame may be used as a carrier.

[0068] Figure 5 As shown, the filtering device 8 has a carrier 18 with nine filtering positions 9-17 for accommodating optical filters. These filtering positions can be left unoccupied as needed, or they can be occupied by optical filters, perhaps different optical filters. Each filtering position 9-17 is configured such that the corresponding beam of each of the various images formed on the aforementioned 3×3 matrix passes through that filtering position.

[0069] Therefore, it is possible to simultaneously create multiple unfiltered and filtered and / or differently filtered images of an object region in a single real image, using a single record, which encounters the receiving surface 7. Furthermore, based on different viewing angles, each image is recorded from these viewing angles, making it possible to determine the position of points in the object region (reproduced by individual image points of the image) along the optical axis, allowing the determination of the position of the imaged object region points relative to each other's reference optical axes. That is, information about the image depth can be obtained.

[0070] Information regarding the mentioned locations can be relatively easily determined from images that are either filtered or unfiltered in the same manner. Therefore, in a variation of the invention for determining locations, at least two of the filtered locations 9-17 are occupied by filters with the same optical properties, or at least two of the filtered locations are left empty, and the locations are determined by means of images that are either filtered or unfiltered in the same manner.

[0071] The imaging device 1 may include a computer 20, which is adapted to read data from the sensor forming the image receiving surface 7 and to store the read data. The computer 20 may, for example, be mounted on the objective lens of the imaging system 1, or as... Figure 6 The schematic diagram shows a camera housing 26 that works in conjunction with the imaging system 1. The stored data, perhaps transmitted via computer 20 or other data processing device, is configured by means of a computer program 21 running thereon to process differently filtered images from the stored images. The computer program 21 is configured such that each image can be equipped with a corresponding filtering characteristic corresponding to a filter in the filtering device that has already filtered the corresponding image. For this purpose, different data or data sets (suitable for filters set for the filtering device 8) can be stored in a database 24 in the computer program 21, allowing the computer program 21 to automatically locate the appropriate data or data sets when properly configured.

[0072] If the filter is replaceable on the support frame of the filter device 8, for example, it can be replaced manually, then the computer program 21 can select a suitable data set for the corresponding filter position according to the selected arrangement. Then, the computer program 21 can automatically evaluate the image recording using the data set relating to the optical filter.

[0073] Additionally, one or more prefabricated filter units 8 can be installed, with different filters fixedly positioned among them. Such filter units 8 can be installed in... Figure 6The symbol 25, shown schematically, indicates which filters occupy the filter positions. It can be specified that the computer program 21 automatically retrieves appropriate data sets from the database to process image recording using this symbol. Reading the symbol 25 of the filtering device 8 can be automated. For example, a code, such as a barcode, can be set on the carrier frame, which is automatically read by a corresponding reading device 27, which can be mounted on the camera housing, during image recording.

[0074] Alternatively, it is conceivable to store the code in the image, for example in at least one of the images, such that the code is automatically identified by computer program 21 when analyzing the image recording data, and computer 20 loads the appropriate data set by means of the identified flag.

[0075] Furthermore, it can be specified that the mark is illuminated in a region of the receiving surface 7 when an image record is being made, and this region is not used to make the image record, but can be invoked when reading the receiving surface 7.

[0076] In the first example, in pressing Figure 5 In the filtration device 8, filtration positions 9, 11, 15, 17 and the central filtration position 13 do not have filters. Neutral density filters of different neutral densities are installed at the remaining filtration positions 10, 12, 14, and 16.

[0077] In image recording, by means of imaging generated by a beam, which is received at filtered positions at the corners and center of the receiving surface 7, the aforementioned positions can be determined to ascertain image depth, and further, enhanced contrast is achieved in the image recording by means of unfiltered and differently filtered imaging. Suitable image processing, which is known per se, can be used for this purpose, and in the case of such image processing, enhanced contrast is determined from records with different exposures (so-called "exposure order").

[0078] It goes without saying that alternative locations, such as only two of the filter positions 9-17, can remain unfiltered and the remaining filter positions can be occupied by filters of different neutral densities in order to achieve a larger or wider contrast resolution.

[0079] Furthermore, it can be specified that all filtration locations 9-17 are equipped with neutral density filters, but unlike the previous example, two or more filters of the same neutral density are set, and the mentioned locations are identified by means of imaging produced by filters of the same neutral density.

[0080] Due to the large parallax (which exists when the viewing angles that produce the image are separated as far as possible from each other), it is advantageous to leave two or more of the external filtering positions 9, 10, 11, 12, 14, 15, 16, and 17 in the filtering device 8 empty or to have filters of the same neutral density in order to determine their positions. Filtering positions 9, 11, 15, and 17, which constitute the corner positions in the filtering device 8, are particularly well-suited.

[0081] In another embodiment, instead of the aforementioned neutral density filter, other types of optical filters, such as polarizing filters, color filters, complementary color filters, or fluorescence filters, are provided for the filtering device 8. Thus, filters with different filtration intensities or effects can be provided in the filtering device 8, and as explained above with respect to the neutral density filter, improved filtration resolution can be achieved through imaging with different filtration methods, and in this case, information about the mentioned locations may be obtained.

[0082] In another embodiment, different types of optical filters are provided in the filtering device. For example, different neutral density filters can be provided at filtering positions 9-11, different ultraviolet filters can be provided at filtering positions 12-14, and different color filters can be provided at filtering positions 15-17. In this way, not only can different levels of the same filtering effect be recorded in a single image record, but multiple different filtering effects can also be recorded.

[0083] In another variation, the location is determined by at least two optically filtered images, or by at least one unfiltered image and at least one filtered image. For this purpose, it is preferable to perform image analysis on some or at least two of the images to identify image points from the different filtered images that represent the same points or areas of the imaged object within the object region. This information is needed, as explained above, to determine any misalignment in the rendering.

[0084] Figure 7 An exemplary representation of an object region is shown in one form where the images are recorded on a receiving surface 7 by means of an imaging system 1, which is further equipped with a filtering device 8. In this embodiment, filtering positions 15 and 17 are not equipped with filters, and the other filtering positions are equipped with neutral density filters of different neutral densities. As explained above, each image encounters the receiving surface 7 in a 3×3 matrix.

Claims

1. An all-optical imaging system (1), the imaging system comprising a plurality of imaging devices (3-5) sequentially arranged along an optical axis (2), the plurality of imaging devices comprising: The first imaging device (3) is used to generate a real intermediate image of an object in the intermediate image plane; A second imaging device (4) for generating at least one virtual mirror image of a real intermediate image, the mirror image being disposed offset from the real intermediate image in an intermediate image plane (6); and a third imaging device (5) for imaging the real intermediate image and the virtual mirror image together into a real image on an image receiving surface (7) to be disposed at an axial distance from the intermediate image plane (6), the imaging system including an optical filtering device (8) by means of which the imaging of the real intermediate image and / or the imaging of at least one virtual mirror image among the virtual mirror images can be filtered separately from each other; characterized in that the optical filtering device (8) is disposed in the intermediate image plane (6) or directly in front of or behind the intermediate image plane (6) in the direction of the optical axis (2) and / or directly in front of the image receiving surface (7).

2. The imaging system according to claim 1, characterized in that, The imaging system (1) includes a processing device for processing a real image received by means of an image receiving surface (7), the processing device being configured to determine, with reference to the optical axis direction, the position of an object segment imaged by at least some of the image points of the image.

3. The imaging system according to claim 2, characterized in that, The processing device is configured to determine the position and, for this purpose, ascertain the extent to which the same object segments are presented offset from each other in the imaging of the real intermediate image and in the imaging of at least one virtual intermediate image among the various virtual intermediate images and / or in the imaging of at least two different virtual mirror images.

4. The imaging system according to claim 3, characterized in that, The same object segment refers to the same object point.

5. The imaging system according to any one of claims 1 to 4, characterized in that, The optical filtering device (8) is disposed in the first imaging device (3) or is part of the first imaging device (3).

6. The imaging system according to any one of claims 1 to 4, characterized in that, The imaging system is used in a camera.

7. The imaging system according to any one of claims 1 to 4, characterized in that, The optical filtering device (8) has at least two optical filters (9-17).

8. The imaging system according to claim 7, characterized in that, At least two of the optical filters (9-17) differ in their filtration characteristics.

9. The imaging system according to claim 7, characterized in that, The optical filtering device (8) has a carrier (18), and each optical filter (9-17) can be set in different filtering positions in the carrier.

10. The imaging system according to claim 7, characterized in that, The optical filtering device (8) has a carrier (18), and each optical filter (9-17) can be detachably set in different filtering positions in the carrier.

11. The imaging system according to any one of claims 1 to 4, characterized in that... A holding device for holding the optical filter device (8).

12. The imaging system according to claim 11, characterized in that, The holding device has an adjustment device for adjusting the position of the optical filter device in the holding device.

13. The imaging system according to claim 11, characterized in that, The holding device has an adjustment device for calibrating the position of the optical filter device in the holding device.

14. The imaging system according to any one of claims 1 to 4, characterized in that, The optical filtering device (8) has N×N filtering positions arranged in a matrix structure.

15. The imaging system according to any one of claims 1 to 4, characterized in that, The optical filter device (8) has filter positions arranged in a matrix of 3×3, 5×5 or 7×7.

16. The imaging system according to claim 14, characterized in that, The matrix arrangement extends in a direction perpendicular to the optical axis of the imaging system (1).

17. The imaging system according to claim 7, characterized in that, At least two of the optical filters (9-17) have the same filtration characteristics.

18. The imaging system according to claim 14, characterized in that, At least two of the optical filters (9-17) have the same filtration characteristics, and the at least two optical filters with the same filtration characteristics are arranged in a filtration position outside the matrix arrangement structure.

19. The imaging system according to claim 14, characterized in that, At least two of the optical filters (9-17) have the same filtration characteristics, and the at least two optical filters with the same filtration characteristics are arranged in the external filtration positions opposite each other in the matrix arrangement structure.

20. The imaging system according to claim 14, characterized in that, At least two of the optical filters (9-17) have the same filtration characteristics, and the at least two optical filters with the same filtration characteristics are arranged in the outer filtration positions that are diagonally opposite each other in the matrix arrangement structure.

21. The imaging system according to any one of claims 1 to 4, characterized in that, The second imaging device (4) for generating a virtual mirror image has one or more mirrors.

22. The imaging system according to claim 21, characterized in that, The second imaging device (4) constitutes a kaleidoscope.

23. The imaging system according to claim 7, characterized in that, The optical filter device (8) has a mark (19) by means of which the characteristics of each optical filter (9-17) and / or the arrangement of each optical filter (9-17) in the optical filter device (8) can be identified and / or invoked.

24. The imaging system according to claim 23, characterized in that, The mark (19) is a mark that can be read automatically.

25. The imaging system according to claim 23, characterized in that, With the aid of the aforementioned markers, the characteristics of each optical filter (9-17) and / or the arrangement of each optical filter (9-17) in the optical filtering device (8) can be retrieved from the database (24).

26. A method for all-optical imaging of an object region, wherein, The object region is imaged by a plurality of imaging devices (3-5) arranged sequentially in the direction of the optical axis (2), the plurality of imaging devices (3-5) comprising: a first imaging device (3) for generating a real intermediate image of the object in an intermediate image plane; a second imaging device (4) for generating at least one virtual mirror image of the real intermediate image, the mirror image being arranged offset from the real intermediate image in the intermediate image plane (6); and a third imaging device (5) for imaging the real intermediate image and the virtual mirror image together into a real image on an image receiving surface (7) to be arranged at an axial distance from the intermediate image plane (6), wherein the imaging of the real intermediate image and / or the imaging of at least one virtual mirror image among the virtual mirror images are filtered separately from each other; characterized in that the filtering is implemented in the intermediate image plane (6) or directly in front of or behind the intermediate image plane (6) and / or directly in front of the image receiving surface (7) in the direction of the optical axis (2).

27. The method according to claim 26, characterized in that, The method is implemented using a camera.

28. The method according to claim 26 or 27, characterized in that, The position of an object region point along the optical axis is determined, the object region point being imaged through at least some of the image points in the image.

29. The method according to claim 28, characterized in that, The location is determined by ascertaining the extent to which the same object segments are presented offset from each other in the imaging of a real intermediate image and in the imaging of at least one virtual intermediate image among the various virtual intermediate images and / or in the imaging of at least two different virtual mirror images.

30. The method according to claim 29, characterized in that, The same object segment refers to the same object point.

31. The method according to claim 28, characterized in that, The location is determined solely from images in the real image, either unfiltered or filtered with optical filters (9-17) having the same filtering characteristics.

32. The method according to claim 28, characterized in that, The location is determined only from images in the real image filtered with optical filters (9-17) having different filtering characteristics.

33. The method according to claim 28, characterized in that, In different imaging processes, at least some image points are associated with points in the object region that are imaged by these image points, and by means of said association, the positions of the points in the object region in the direction of the optical axis (2) are determined at least in relative relation to each other.

34. A computer program product comprising instructions that, when executed by a computer, cause the computer to perform the method according to any one of claims 26 to 33.

35. A computer program product comprising instructions that, when executed by a computer, cause the computer to determine, from imaging produced by means of an imaging system according to any one of claims 1 to 25 and / or by means of a method according to any one of claims 26 to 33, the position of an object region point imaged by at least some image points in the optical axis direction.

36. A computer program product comprising instructions that, when executed by a computer, cause the computer to process, by means of an imaging system according to any one of claims 1 to 25 and / or by means of a method according to any one of claims 26 to 33, separately filtered imaging of real intermediate images and / or separately filtered imaging of at least one of virtual mirror images, according to a corresponding filter.

37. The computer program product according to any one of claims 34 to 36, characterized in that, The computer program product is a computer program stored on a data carrier or in a device.

38. A data processing apparatus comprising means for implementing the method according to any one of claims 26 to 33.

39. The data processing device according to claim 38, characterized in that, The data processing device is part of the imaging system and / or part of the camera.

Citation Information

Patent Citations

  • Plenoptic imaging device

    WO2014124982A1