Target and / or observation device with image overlay

Abstract

Target and / or observation device (2) with image overlay, with a first channel (4) with a first optic (6) which defines a first optical axis (8) and to which a first image sensor (10) is assigned for capturing a first image, with a second channel (14) with a second optic (16) which defines a second optical axis (18) and to which a second image sensor (20) is assigned for capturing a second image, wherein at least one optic (6 or 16) is assigned a motorized focusing device (12 or 22), with a control device (24) for controlling the motorized focusing device (12 or 22), wherein the first optical axis (8) and the second optical axis (18) are arranged perpendicular to each other and spaced apart from each other in the direction of the axis, with an image processing device (26) which is in signal transmission connection with the image sensors (10, 20) and is designed and programmed in such a way that a superimposed image is displayed on a display device (28) in which the second image is superimposed on the first image, wherein the control device (24) is in data transmission connection with the image processing device (26) such that the Image processing device (26) is supplied with at least one focus position signal which represents the focus position of at least one optic (6, 16), wherein the image processing device (26) is designed and programmed such that the image superposition of the second image with the first image is influenced depending on the focus position signal in order to perform parallax compensation.

Description

[0001] The invention relates to a targeting and / or observation device with image overlay.

[0002] Corresponding targeting or observation devices, hereinafter also referred to simply as devices, are generally known. They comprise a first channel with a first optical element that defines a first optical axis and to which a first image sensor is assigned for capturing a first image. Furthermore, the known devices comprise a second channel with a second optical element that defines a second optical axis and to which a second image sensor is assigned for capturing a second image. The first and second optical axes are arranged perpendicular to each other. At least one optical element is assigned a motorized focusing device.

[0003] Due to the distance between the optical axes perpendicular to their axis direction, parallax occurs in the known devices, which impairs the use of the device, especially when the device is a aiming device, for example for a handgun.

[0004] For example, it is known in rangefinder cameras, where parallax occurs between an optical viewfinder and the recording optics, to perform parallax compensation by moving a viewfinder frame in the optical viewfinder depending on the focus position of the recording optics.

[0005] US patent 7 307 793 B2 discloses a night vision device in which a sensor detects the focus position of a mechanically focusable optic and parallax compensation is performed depending on the detected focus position.

[0006] A similar facility is also known through US 8 072 469 B2.

[0007] From EP 2 938 061 A1 and US 7116491 B1, an observation device with image superposition is known in which the visible image of a first channel is superimposed with the infrared image of a second channel by an image processing device while performing parallax compensation.

[0008] The invention is based on the objective of providing an observation and / or targeting device with image superposition that is improved with regard to parallax compensation.

[0009] This problem is solved by the invention specified in claim 1.

[0010] The invention relates to an observation and / or aiming device with a first channel and a second channel, wherein at least one optical element is associated with a motorized focusing device. A control device is provided for controlling the motorized focusing device.

[0011] To generate a superimposed image, an image processing device is provided which is in signal transmission connection with the image sensors and is designed and programmed in such a way that a superimposed image is displayed on a display device in which the second image is superimposed on the first image.

[0012] According to the invention, the control device is in data transmission connection with the image processing device in such a way that at least one focus position signal is supplied to the image processing device, which represents the focus position of at least one optic, wherein the image processing device is designed and programmed in such a way that the image superposition of the second image with the first image is influenced depending on the focus position signal in order to perform a parallax compensation.

[0013] According to the invention, the focus position of at least one optical element is derived from the corresponding control signal of the control device and used to determine the parallax applicable to this focus position of the optical element and thus to this set distance. In this way, sensors for detecting the focus position are unnecessary, so that parallax compensation can be implemented in a particularly simple manner.

[0014] Depending on the specific requirements and circumstances, the two channels for detecting radiation can be configured to cover spectral ranges that vary within wide limits. An advantageous embodiment of the invention provides that the first channel is configured for detecting radiation in the visible wavelength range and the second channel for detecting infrared radiation, such that a thermal image generated by the second channel is superimposed on a natural image generated by the first channel.

[0015] Another advantageous embodiment of the invention provides that the image processing device is connected to a memory in a data transmission connection, in which a conversion table is stored in which the focus position of at least one optic is converted into a corresponding parallax value, or the image processing device is designed and programmed such that, according to a predetermined algorithm, the focus position of at least one optic is converted into a corresponding parallax value, wherein the image processing device is designed and programmed such that the image superposition for parallax compensation is influenced depending on the parallax value corresponding to the respective focus position. In this embodiment, the parallax corresponding to a focus position, and thus to a distance set on the optic, is stored in a lookup table or is calculated using a formula.

[0016] A particularly advantageous embodiment of the invention provides that at least one optic is assigned a temperature measuring device which is in data transmission connection with the image processing device, wherein the image processing device is in data transmission connection with a memory in which a conversion table is stored in which, for the purpose of determining a temperature-dependent parallax profile, the temperature of at least one optic is converted into an associated parallax value, or the image processing device is designed and programmed such that the measured temperature is converted into an associated parallax value according to a predetermined algorithm, wherein the image processing device is designed and programmed such that the image superposition for the purpose of parallax compensation is influenced depending on the parallax value corresponding to the respective temperature.In this embodiment, a lookup table records how the parallax changes with temperature variations. By measuring the temperature of the optics, it is possible to determine how the parallax has changed relative to a reference temperature. The temperature-dependent change in parallax can then be taken into account during parallax compensation in the image processing device. A particular advantage of this embodiment is that athermal correction of the optics used is unnecessary for parallax compensation. Therefore, less complex optics can be used in the device according to the invention, optics whose design does not require athermal correction. Instead, digital athermalization is performed in the image processing device according to the invention.

[0017] According to the invention, conversion tables can be used to translate a focus position or temperature of at least one optical system into a corresponding parallax value. Alternatively, the respective parallax value can also be calculated using a previously established and specified formula.

[0018] Another advantageous embodiment of the invention provides that the image processing device is designed and programmed to superimpose a target marker onto the overlay image.

[0019] Another exceptionally advantageous embodiment of the invention provides that the image processing device is designed and programmed to determine whether the target mark is located above a focused object, and that, depending on the result of this determination, the image processing device preferably modifies a feature of the target mark. This embodiment provides additional functionality by determining whether the target mark is located above a focused object and, accordingly, performing parallax compensation for the set distance.If it is determined that the target mark is located above an out-of-focus object, the color of the target mark can, for example, be changed to indicate to the user that parallax correction has not been performed, or has not been fully performed, with respect to the object targeted by the target mark, and that the image superimposition may therefore be affected by parallax. In this way, the aiming accuracy of a targeting device according to the invention is improved. Instead of changing the color or another feature of the displayed target mark, the result can also be indicated in this embodiment in another way, for example by an acoustic or other visual signal.

[0020] Another advantageous embodiment of the invention provides that the control device is designed and programmed in such a way that the focusing of the second optics is tracked following the focusing of the first optics.

[0021] The design of the display device on which the superimposed image is shown can be selected within wide limits according to the respective requirements. An advantageous embodiment of the invention provides that an eyepiece is associated with the display device.

[0022] In principle, in the aforementioned embodiment, the aiming and / or observation device can be monocular. An advantageous further development of the invention provides that the aiming and / or observation device is binocular.

[0023] In principle, according to the invention, one optical element can be assigned a motorized focusing device, while the other optical element is designed as a fixed-focus optical element. An advantageous embodiment of the invention provides that the first optical element is assigned a first focusing device and the second optical element is assigned a second focusing device.

[0024] Another advantageous embodiment of the invention provides that the aiming and / or observation device is designed as a reflex sight.

[0025] The optical axes of the first optics and the second optics can be arranged parallel to each other or aligned so that they intersect at a predetermined distance in front of the device, for example at 100 m.

[0026] The invention is explained in more detail below with reference to an exemplary embodiment and the accompanying, highly schematic and partially block-diagram-like drawing. All features described, illustrated in the drawing, and claimed in the patent claims, considered individually as well as in any technically meaningful combination with one another, constitute the subject matter of the invention, irrespective of their compilation in the patent claims and their cross-references, and irrespective of their specific description or representation in the drawing.

[0027] It shows: Fig. 1 schematic and block diagram-like an embodiment of a device according to the invention, Fig. 2 a schematic drawing of the facility according to Fig. 1 when capturing a scene with depth-staggered object planes, Fig. 3A to 3D a schematic drawing to illustrate the functioning of the invention and Fig. Figures 4A to 4D show a further schematic drawing to further illustrate the functionality of the invention.

[0028] In Fig. Figure 1 is a highly schematic and block-diagram-like embodiment of a targeting and / or observation device 2 according to the invention with image superimposition, which in this embodiment is designed as a combined targeting and observation device and is hereinafter also referred to as device 2.

[0029] The device 2 has a first channel 4 with a first optic 6, which defines a first optical axis 8 and to which a first image sensor 10 for capturing a first image and a first motorized focusing device 12 are assigned.

[0030] The device 2 further includes a second channel 14 with a second optic 16, which defines a second optical axis 18 and to which a second image sensor 20 for capturing a second image and, in this embodiment, a second motorized focusing device 22 are assigned.

[0031] In the illustrated embodiment, the first channel 4 is designed to detect radiation in the visible wavelength range and the second channel 14 is designed to detect infrared radiation, such that a thermal image generated by the second channel 14 is superimposed on a natural image generated by the first channel 4.

[0032] A control device 24 is provided for controlling the motorized focusing devices 12, 22. The design of corresponding motorized focusing devices, which are also referred to as "focus-by-wire" devices and in which optical elements of an optic are moved relative to each other by motors for focusing, is generally known to those skilled in the art and is therefore not explained in detail here.

[0033] Due to the design, the first optical axis 8 and the second optical axis 18 are spaced apart perpendicular to the axis direction and, in this embodiment, are arranged parallel to each other.

[0034] The device 2 further comprises an image processing device 26, which is in signal transmission connection with the image sensors 10, 20 and is designed and programmed such that a superimposed image is displayed on a display device 28, in which the second image is superimposed on the first image. The display device 28 can, for example, be a display that is viewed by means of an eyepiece (monocularly or binocularly, depending on the respective requirements and circumstances).

[0035] The image processing unit 26 is designed and programmed to overlay a target marker onto the superimposed image.

[0036] The design and function of corresponding targeting and / or observation devices are generally known to those skilled in the art and are therefore only described in more detail here to the extent necessary to explain the invention.

[0037] The control unit 24 and the image processing unit 26 can be implemented according to the respective requirements by a combination of hardware in the form of electronic components and software.

[0038] According to the invention, the control device 24 is in a data transmission connection with the image processing device 26 such that at least one focus position signal is supplied to the image processing device 26, representing the focus position of at least one optic 6 or 16. The image processing device 26 is designed and programmed such that the image superposition of the second image with the first image is influenced depending on the focus position signal in order to perform parallax compensation.

[0039] In the illustrated embodiment, the image processing unit 26 is in data transmission communication with a memory 30, in which a lookup table is stored that converts the focus position of at least one optic 6 or 16 into a corresponding parallax value. The image processing unit 26 is designed and programmed such that the image superposition for parallax correction is influenced depending on the parallax value corresponding to the respective focus position.

[0040] In the illustrated embodiment, the first optic 6 is focused by a user of the device 2 by actuating the first motorized focusing device 12 and the corresponding focus position (controlled by the control device 24) is followed at the second optic 16.

[0041] The invention functions as follows: When using device 2, the user focuses the natural image generated by the first optic 6 onto an object in the scene captured by device 2 by operating the first motorized focusing device 12. The focus of the second optic 16 is adjusted accordingly, and the resulting focus position is transmitted to the image processing device 26.

[0042] The image processing unit 26 determines the parallax at the corresponding distance by accessing the conversion table stored in memory 30. The image processing unit 26 then controls the overlay of the natural image provided by the first channel 4 with the thermal image provided by the second channel 14, such that the resulting overlay image is parallax-corrected for the respective focus position of the optics 6 and 16, and thus for the object plane on which the optics 6 and 16 are focused. This improves the display of the overlay image, which is particularly important when the unit 2 is used as a targeting device, for example, for a handgun.

[0043] To further improve the parallax compensation carried out according to the invention, a temperature measuring device 32 is assigned to at least one optic 6 or 16. The image processing device is in data transmission communication with the temperature measuring device 32 and the memory 30, in which a conversion table is stored. This table converts the temperature of the optics 6, 16 into a corresponding parallax value to determine a temperature-dependent parallax profile. The image processing device 26 is designed and programmed such that the image superimposition for parallax compensation is influenced depending on the parallax change value corresponding to the respective temperature.

[0044] In this way, a temperature-dependent change in parallax can be taken into account when generating the overlay image depending on the detected temperature, thus further improving the accuracy of the parallax compensation.

[0045] A particular advantage of this embodiment is that athermal correction can be omitted in the design of the optics 6, 16 without negatively impacting the accuracy of the parallax compensation. Accordingly, significantly simpler and more cost-effective optics can be used. Instead, the athermalization of the optics 6, 16, which is necessary or desirable for achieving the most accurate parallax compensation possible, is performed digitally according to the invention.

[0046] Using the target marker displayed in the overlay image, an object can be targeted in the scene captured by device 2 and represented by the overlay image, for example, if device 2 is used as a targeting device for a handgun.

[0047] In the illustrated embodiment, the image processing device is designed and programmed to determine whether the target marker is located above a focused object, and depending on the result of this determination, the image processing device modifies a feature of the target marker. For example, if the determination shows that the target marker is located above a focused object and the overlay image is thus parallax-corrected with respect to the object plane in which the object is located, the color of a target marker that is normally displayed in red, for example, can be changed to green.Conversely, for example, the color of a target marker that is normally displayed in green can be changed to red if the target marker is located over an unfocused object in the overlay image, and therefore the overlay image is not parallax-corrected with respect to the object plane in which the object is located. This improves aiming accuracy when targeting an object.

[0048] However, the user of device 2 can also be notified in any other way whether the target marker is above a focused object, for example by another optical or acoustic signal.

[0049] Depending on the specific requirements and intended use, the device 2 according to the invention can be configured in different ways. For example, and in particular, the device according to the invention can be designed as a reflex sight.

[0050] Fig. Figure 2 shows in a schematic representation the channels 4, 14 of the facility 2, where the facility 2 captures a scene which, in staggered depths, comprises a first object level 34, a second object level 36 and a third object level 38.

[0051] Fig. 3A to Fig. 3D images show various configurations of parallax compensation.

[0052] Fig. 3A shows a constellation without parallax compensation, in which, due to the parallax between channels 4, 14, the images of object planes 34, 36 and 38 taken by channels 4, 14 are superimposed with parallax.

[0053] Fig. Figure 3B shows a configuration in which optics 6 and 16 are focused on the object plane 34, and accordingly, parallax correction for the object plane 34 is performed by using an image generated by the second channel 14 (in Fig. 3 symbolized by a frame 40) compared to an image generated by the first channel 4 (in Fig. 3 (symbolized by a frame 42) is shifted. For the objects lying in the object plane 34, the overlay image generated by the image processing unit 26 is parallax corrected.

[0054] Fig. 3C and Fig. The 3D images show configurations in which optics 6 and 16 are focused on object planes 36 and 38, respectively, and the superimposed image is parallax-corrected for each object plane. It is evident that parallax correction for different object planes requires different shifts of images 40 and 42 relative to each other.

[0055] It is further evident that, according to the laws of optics, simultaneous parallax correction for all object planes 34, 36 and 38 is not possible. According to the invention, parallax correction is performed for the object plane on which the optics 6, 16 are focused.

[0056] Fig. 4A to Fig. 4D corresponds Fig. 3A to Fig. 3D, where a blur is indicated graphically, which results from the generation of the image of the second channel 14 when the second lens is a high-aperture lens with a correspondingly shallow depth of field. The reference for focusing and aiming at an object using device 2 is the image generated by the first channel 4.

Claims

[1] Target and / or observation device (2) with image overlay, with a first channel (4) with a first optic (6) which defines a first optical axis (8) and to which a first image sensor (10) is assigned for capturing a first image, with a second channel (14) with a second optic (16) which defines a second optical axis (18) and to which a second image sensor (20) is assigned for capturing a second image, wherein at least one optic (6 or 16) is assigned a motorized focusing device (12 or 22), with a control device (24) for controlling the motorized focusing device (12 or 22), wherein the first optical axis (8) and the second optical axis (18) are arranged perpendicular to each other and spaced apart from each other in the direction of the axis, with an image processing device (26) which is in signal transmission connection with the image sensors (10, 20) and is designed and programmed in such a way that a superimposed image is displayed on a display device (28) in which the second image is superimposed on the first image, wherein the control device (24) is in data transmission connection with the image processing device (26) such that the Image processing device (26) is supplied with at least one focus position signal which represents the focus position of at least one optic (6, 16), wherein the image processing device (26) is designed and programmed such that the image superposition of the second image with the first image is influenced depending on the focus position signal in order to perform parallax compensation. [2] Targeting and / or observation device according to claim 1, wherein the first channel (4) is configured for detecting radiation in the visible wavelength range and the second optical channel (14) is configured for detecting infrared radiation, such that a thermal image generated by the second channel (14) is superimposed on a natural image generated by the first channel (4). [3] Target and / or observation device according to one of the preceding claims, wherein the image processing device (26) is in data transmission connection with a memory (30) in which a conversion table is stored in which the focus position of at least one optic (6, 16) is converted into an associated parallax value, or the image processing device (26) is designed and programmed such that, according to a predetermined algorithm, the focus position of at least one optic (6, 16) is converted into an associated parallax value, wherein the image processing device (26) is designed and programmed such that the image superposition for performing parallax compensation is influenced depending on the parallax value belonging to the respective focus position. [4] Target and / or observation device according to one of the preceding claims, wherein at least one optic (6, 16) is associated with a temperature measuring device (32) which is in data transmission connection with the image processing device (26), wherein the image processing device (26) is in data transmission connection with a memory (30) in which a conversion table is stored in which, for the purpose of determining a temperature-dependent parallax profile, the respective temperature of at least one optic (6, 16) is converted into an associated parallax value, or the image processing device (26) is designed and programmed such that the measured temperature is converted into an associated parallax value according to a predetermined algorithm, wherein the image processing device (26) is designed and programmed such thatthat the image overlay for parallax correction is influenced depending on the parallax value corresponding to the respective temperature. [5] Target and / or observation device according to one of the preceding claims, wherein the image processing device (26) is designed and programmed to display a target mark in the superimposed image. [6] Targeting and / or observation device according to claim 5, wherein the image processing device (26) is designed and programmed such that it determines whether the target mark is located over a focused object, wherein the image processing device (26) preferably changes at least one feature of the target mark depending on the result of the determination. [7] Target and / or observation device according to any of the preceding claims, characterized by, that the control device (24) is designed and programmed such that the focusing of the second optics (16) follows the focusing of the first optics (6). [8] Targeting and / or observation device according to one of the preceding claims, wherein the display device (28) is associated with an eyepiece. [9] Targeting and / or observation device according to any of the preceding claims, wherein the targeting and / or observation device is binocular. [10] Targeting and / or observation device according to one of the preceding claims, wherein a first focusing device (12) is associated with the first optic (6) and a second focusing device (22) is associated with the second optic (16). [11] A targeting and / or observation device according to one of the preceding claims, wherein the targeting and / or observation device (2) is designed as a reflex sight.

Images