Visual system for generating an enhanced and segmented image of an environment scene
The vision system enhances peripheral vision and resolution by segmenting the environment scene into multiple image segments with varying magnifications, addressing the limitations of existing night vision devices.
Patent Information
- Application Number
- DE102023101884
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-01-26
- Publication Date
- 2026-02-19
- Estimated Expiration
- 2043-01-26
AI Technical Summary
Existing night vision devices, such as image intensifier goggles, limit peripheral vision and reduce image resolution, making it difficult to maintain spatial orientation and detect obstacles in low-light conditions.
A vision system with an input-side optical module that segments the environment scene into multiple image segments with varying magnifications, using optical elements like lenses, mirrors, or prisms to enhance peripheral vision and resolution without increasing system weight or complexity.
Provides a wide field of view with high-resolution image segments, improving detectability of details and maintaining spatial orientation by adapting to user needs, while being lightweight and robust.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
TECHNICAL AREA
[0001] The invention relates to a vision system for generating an enhanced and segmented image of the surrounding scene, wherein the different image segments of the surrounding image have different image scales. BACKGROUND
[0002] German patent DE 34 30 695 C2 describes a visual device, in particular a thermal imaging device, in which a first field of view in the same image field is superimposed by means of an afocal lens with a magnification other than one, and a second field of view in the same direction but with a different field of view size, but the same image field size, and wherein the smaller field of view has a larger effective entrance pupil than the larger field of view.
[0003] The publication EP 2 569 595 B1 describes a surveying instrument and in particular a surveying instrument that is equipped with at least one camera and a display for showing image information.
[0004] Publication US 2009 / 0251482 A1 describes an image processing device, an image processing unit, a display control method, a program and a storage medium, preferably configured to display multiple images on a single screen.
[0005] The natural night vision of the human eye limits its use in aviation. To maintain the operational value of an aircraft as much as possible at night, the pilot must use special technical aids, such as image intensifier glasses (BIV glasses).
[0006] This device resembles theater glasses and is attached to the helmet in front of the eyes. The BiV goggles utilize an electronically controlled light amplification system (photomultiplier). The residual light, which is usually still present even on dark nights, is amplified by a factor of 100,000 or more. The core component of this passive night vision device is an image intensifier that amplifies the residual light within the human eye's field of vision and projects it into a green image via two eyepieces (monochromatic / binocular). The current technical limit for the third generation is 0.5 millilux of residual light. This means that approximately 70% of all nights can be used for low-level night flying with the BiV goggles.
[0007] The advantage of BIV goggles is that in a low-level flight profile under low light conditions, obstacles can be seen that would no longer be visible to the naked eye.
[0008] However, these advantages are countered by the following disadvantages and limitations:
[0009] The glasses limit the field of vision to approximately 40 to 45°, meaning there is a significant loss of peripheral vision and thus a considerable impairment of spatial orientation. Within this small field of vision, the wearer of the vision-enhancing glasses can see everything clearly using eye movements. If they want to see beyond this, they must adjust the glasses by moving their head. This is strenuous, requires specific training, and only poorly, if at all, replaces the normal / familiar field of vision. This limited peripheral field of vision of approximately 40° leads to a significant loss of spatial orientation and thus a considerable impairment.
[0010] Converting weak light to visible light, or even more visible light, leads to an optical degradation of the generated image. Due to the device's optical resolution, visual acuity is reduced. Overhead power lines, for example, can only be seen very rarely or very late with the BiV goggles, making them dangerous obstacles. In precipitation, the image becomes very grainy. Roughly speaking, visual acuity is reduced to approximately 45% when flying with BiV goggles. Increasing the field of view, for example with a wide-angle lens, is impossible due to the limited resolution of the microchannel plates used in image intensifiers.
[0011] Devices are already known from the prior art that aim to circumvent the limitations of a restricted field of view of BIV glasses:
[0012] Document EP 1857854 A1, for example, discloses a modular panoramic night vision device that expands the field of view by using multiple image intensifier tubes. However, this device has the disadvantage of being very heavy and complex.
[0013] The prior art includes BiV glasses in which an ambient scene is projected onto the image intensifier via a lens system. To increase the field of view, the scene is projected onto the image intensifier input at a lower magnification. Since a larger portion of the subject is captured, but the image intensifier's resolving power is limited, the overall resolving power of the system deteriorates. While the field of view could be increased without loss of resolving power by using a larger image intensifier, this leads to additional problems regarding the system's size, weight, and cost.
[0014] Therefore, a robust image intensifier system is needed that provides the BIV user with enhanced peripheral vision while offering a high-resolution field of view. Since the system is mounted on the user's head, its weight and size must be kept to a minimum.
[0015] Therefore, an objective of the present invention is to modify an existing vision system with an image intensifier in such a way that the user is provided with an overview image of the surrounding scene at the output of the image intensifier, in which relevant detailed information of the surrounding scene is also recognizable. The modified vision system should preferably be lightweight and as robust as possible.
[0016] According to the invention, the problem is solved by a system according to a vision system according to claim 1. OVERVIEW
[0017] The following summarizes various aspects of this revelation to provide a basic understanding of these aspects and their associated benefits. Further aspects and technical details are addressed in the subsequent chapter, "Detailed Description."
[0018] One aspect concerns a vision system for amplifying and segmenting an image of an environment scene, comprising: an image intensifier that amplifies a segmented image of the environment scene arriving at an input of the image intensifier and provides an amplified and segmented image of the environment scene to an observer at an output of the image intensifier; and an input-side optical module comprising at least two optical imaging means that generate the segmented image of the environment scene and map it to the input of the image intensifier. A first optical imaging means of the at least two optical imaging means generates a first image segment of the environment scene with a first image scale, and a second optical imaging means of the at least two optical imaging means generates a second image segment of the environment scene with a second image scale.
[0019] Such a vision system generates a light-enhanced image of the surrounding scene, which is segmented and can therefore be adapted to the user's specific needs. For example, one imaging element can generate an image segment with a magnification of 1, while the other element generates a different image segment with a magnification of less than 1. The resulting segmented image of the surroundings, which is then amplified by the image intensifier, provides the user with both an enlarged field of view and an image segment of the surrounding scene with relatively higher resolution. This has the advantage of increasing the user's peripheral vision without sacrificing image resolution in any specific part of the scene. This circumvents the limited resolution of the image intensifier.The optical module, which includes the imaging elements, is particularly easy to install on the input side of existing image intensifier systems. Furthermore, this aspect of the viewing system is a purely optical, passive system that is extremely robust. Additional image intensifier tubes are not required, thus keeping the system's weight and complexity low.
[0020] In another embodiment, the first image segment can be the central area of the surrounding scene. This has the advantage that the vision system is particularly well adapted to the capabilities of the human eye. The central area of the surrounding scene is then displayed at a higher resolution and thus coincides with the area of sharpest vision of the human eye.
[0021] According to another embodiment, the first image segment can depict a magnified view of an area of the surrounding scene. The magnified image of a section of the surrounding scene has the advantage that the resulting first image segment at the output of the image intensifier has a higher resolution. The detectability of details is thus increased despite the limited resolving power of the image intensifier.
[0022] In another embodiment, the second image segment can be a peripheral area of the surrounding scene. This has the advantage that the user gains a wide field of view of the surrounding scene and a better overview of the environment.
[0023] In one embodiment, the second image segment can depict a reduced view of an area of the surrounding scene. This further increases the field of view of the environment.
[0024] In one embodiment, the first and second optical imaging means can be arranged such that the second image segment surrounds the first image segment. This embodiment offers the user a larger overview area across the entire peripheral region.
[0025] In one embodiment, the input-side optical module can include a third optical imaging means that generates a third image segment of the surrounding scene with a third magnification. The advantage of this embodiment is that different areas of interest within the surrounding scene can be displayed with different magnifications and resolutions. Furthermore, a finer subdivision into more than two areas allows for a step-by-step transition between the magnification levels.
[0026] According to one embodiment, the third imaging scale can correspond to the second imaging scale.
[0027] In a further embodiment, the second and third optical imaging means can be arranged such that the second and third image segments each depict a peripheral view of the surrounding scene. This allows the peripheral field of view of the vision system to be increased even further.
[0028] In one embodiment, the second and third image segments can at least partially enclose the first image segment.
[0029] In one embodiment, the image scale within the image segments can be variable. This allows the enhanced and segmented image of the surrounding scene to be more precisely adapted to the user's current needs.
[0030] In one embodiment, the first optical imaging means and the second optical imaging means of the at least two optical imaging means can each be one of the following: a lens system, a mirror system or a prism system, wherein at least one optical imaging means of the at least two optical imaging means is a lens system or a mirror system.
[0031] The advantage of this embodiment is that the adjustment of resolution and field of view is achieved passively by an optical module, which, unlike an electronic solution, would also be suitable for critical applications. This embodiment is particularly simple and robust and requires no modification of the image intensifier tube itself. A one-to-one image is generated from the detector (input) of the image intensifier to the phosphor screen (output).
[0032] In one embodiment, the third optical imaging means can be one of the following: a lens system, a mirror system or a prism system, wherein at least one of the at least two optical imaging means is a lens system or a mirror system.
[0033] In one embodiment, the at least two optical imaging means can have apertures. This makes image segmentation easy to implement.
[0034] In one embodiment, an output-side optical module can be arranged between the output of the image intensifier and the observer.
[0035] The advantage of such an output-side optical module is a further adaptation of the amplified and segmented image of the surrounding scene at the output of the image amplifier to the needs of the user.
[0036] In one embodiment, the output optical module can comprise at least two output optical imaging means that project the first image segment and the second image segment of the amplified and segmented image of the surrounding scene onto a display device, each with correspondingly different image scales, and wherein each of the at least two output optical imaging means can be one of the following: a lens system, a mirror system or a prism system, wherein at least one output optical imaging means of the at least two output optical imaging means is a lens system or a mirror system.
[0037] This has the advantage that the image scale of the image segments can be better adapted to the respective operating conditions and the individual needs of the user, such as the specific characteristics of their eyes. The user's visual perception is further improved.
[0038] In one embodiment, the output optical module may further comprise a third output optical imaging means which projects the third image segment of the amplified and segmented image of the surrounding scene onto the display device at a different image scale, and wherein the third output optical imaging means may be one of the following: a lens system, a mirror system or a prism system, wherein at least one of the at least two output optical imaging means is a lens system or a mirror system.
[0039] In one embodiment, the output optical module can have a standard eyepiece. By using adapted eyepieces, the field of view can be adjusted to the user's needs, depending on the application, e.g., to achieve partial overlap with the external view.
[0040] In one embodiment, the output optical module can have a wide-angle eyepiece. This allows the user a large field of view of the amplified and segmented image of the surrounding scene.
[0041] According to one embodiment, the output-side optical module can have a fiber optic system, wherein fiber optics of the fiber optic system are arranged such that the first image segment, the second image segment and optionally the third image segment of the amplified and segmented image of the surrounding scene are displayed at different image scales on a display device located on an output side of the fiber optic system.
[0042] In this embodiment, a bundle of optical fibers is used to create a point-to-point image of individual pixels. By varying the optical fibers, any desired image with a variable scale can be achieved. The amplified and segmented image of the surrounding scene can be further refined by such a fiber optic system and adapted to the user's needs or a specific application of the vision system.
[0043] In one embodiment, the distances between the optical fibers on an input side of the optical fiber system can be homogeneous, and the distances between the optical fibers on the output side can be inhomogeneous, such that on the output side, the distances between the optical fibers in the second image segment are larger than the distances between the optical fibers in the first image segment, and, wherein the distances between the optical fibers in the second segment on the input side are smaller than on the output side, and, the distances between the optical fibers in the first segment on the input side are larger than on the output side.
[0044] The advantage of this embodiment of the output-side optical module is that the first image segment of the amplified and segmented image of the surrounding scene is further magnified.
[0045] In one embodiment, the number of optical fibers in the second image segment of the amplified and segmented image of the environment scene can be higher than the number of optical fibers in the first image segment and optionally higher than the number of optical fibers in the third image segment of the amplified and segmented image of the environment scene, and, wherein on the input side, the distances between the optical fibers in the first image segment are smaller than in the second image segment, and on the output side, the distances between the optical fibers in the first image segment are larger than in the second image segment, and wherein the distances between the optical fibers in the second segment are larger on the input side than on the output side, and, the distances between the optical fibers in the first segment are smaller on the input side than on the output side.
[0046] This embodiment of the output-side optical module has the advantage that the first image segment is further magnified while simultaneously improving resolution.
[0047] In one embodiment, the vision system can include an eye tracker and a motorized shifting unit with which the vision system can be shifted relative to the user's eye.
[0048] This embodiment has the advantage that the optics in the input and / or output optical module of the vision system are shifted horizontally and vertically by a motor as soon as the pupils approach the edge of the central field of vision, in order to enlarge the area of sharp vision, e.g., by ±12°. Furthermore, this allows the glasses to automatically adjust to the individual wearer. Replacing the glasses would thus be easy. It is also possible to draw the user's attention to objects of interest in the image. The area of sharp vision (image segment with a magnification greater than one) is then shifted in the direction of this object. LIST OF FIGURES
[0049] The present invention is described in detail below with reference to the accompanying drawings: Fig. Figure 1 shows a first example of an initial image according to the present invention, which has two image segments with different image scales. Fig. Figure 2 shows a second example of an initial image according to the present invention, which is vertically divided into three image segments, wherein the image segments have two different image scales. Fig. Figure 3 shows a first embodiment of the vision system according to the present invention, wherein the input-side optical module is realized by lens systems. Fig. Figure 4a shows a second embodiment of the vision system according to the present invention, wherein the input-side optical module is realized by mirror systems. Fig. 4b is a side view of a possible embodiment of a mirror system, which in the second embodiment of the in Fig. The vision system shown in 4a can be used. Fig. Figure 4c shows another possible embodiment of a mirror system, which in the second embodiment of the one described in Fig. The vision system shown in 4a can be used. Fig. Figure 5 shows a third embodiment of the vision system according to the present invention, wherein the input-side optical module is realized by prism systems. Fig. Figure 6a shows a fourth embodiment of the vision system according to the present invention, wherein the vision system further comprises an output-side optical module having a normal eyepiece. Fig. Figure 6b shows a fifth embodiment of the vision system according to the present invention, wherein the vision system further comprises an output optical module having a wide-angle eyepiece. Fig. Figure 7a shows a sixth embodiment of the vision system according to the present invention, wherein the vision system further comprises an output-side optical module which is a fiber optic system. Fig. Figure 7b shows a possible realization of the fiber optic system, which in the sixth embodiment of the in Fig. The vision system shown in 7a can be used. Fig. Figure 7c shows another possible realization of the fiber optic system, which in the sixth embodiment of the in Fig. The vision system shown in 7a can be used. DETAILED DESCRIPTION
[0050] Fig. Figure 1 shows a first example of an input image 100, which is generated by an input-side optical module of a vision system according to the present invention and is produced at an input of an image intensifier. The input image 100 consists of two image segments with different image scales and is therefore hereinafter also referred to as a segmented image of the surrounding scene. The image intensifier amplifies the input image 100 and thus produces an amplified, or residual light-enhanced, and segmented image of the surrounding scene at the output of the image intensifier. The image intensifier only performs residual light amplification, so that the image segments are also preserved in the output image of the image intensifier.
[0051] In the example from Fig. In Figure 1, the input image 100 comprises two image segments, 101 and 102, which have different image scales. The field of view is divided into an inner and outer area; that is, image segment 101 surrounds image segment 102. In this example of the input image 100, the two image segments 101 and 102 are separated by a dividing line 103. The dividing line can be implemented, for example, digitally, by a corresponding engraving in the imaging elements, or by a line applied to the imaging elements by the input-side or output-side optical module. However, a dividing line between the different image segments is not strictly necessary and merely serves to improve the distinguishability of the different image segments.
[0052] The magnification ratio defines the relationship between the image size of an optical representation of an object and its actual object size. A magnification ratio greater than 1 is called magnification; a ratio less than 1 is called reduction.
[0053] Each image segment is generated at the input of an image intensifier by corresponding optical imaging elements. These optical imaging elements project a specific section of the surrounding scene onto the input of the image intensifier at different magnifications, thus generating the input image 100. In input image 100, for example, a specific section of the surrounding scene is projected in image segment 101 at a first magnification, while another section of the surrounding scene is projected in image segment 102 at a second magnification, with image segment 102 being enlarged relative to image segment 101. Image segment 101 offers a wide field of view of the surroundings, thus providing the user of the vision system with an improved overview. By having an enlarged image section reach the input of the image intensifier as image segment 102, the limited resolution of the image intensifier is overcome.After residual light amplification, image segment 102 has a higher resolution than an image segment that would be amplified by the image intensifier at a magnification of one or less. This improves the detectability of details for a specific section of the environment. Dangerous obstacles, such as those located in the user's flight path, become visible to the user earlier.
[0054] The field of view characterizes the size of the area that can be observed simultaneously by the viewing system. The larger the field of view, the more convenient it is to observe objects—it is not necessary to constantly move the device to view the required portion of the area. The field of view is inversely proportional to magnification—magnifying the image leads to a reduction in the field of view.
[0055] Resolution, or image resolution, is the ability of the visual system to distinguish two closely spaced points or lines. The higher the resolution value in lines per millimeter and the lower the value in angular units, the higher the resolution. The higher the resolution, the clearer the image appears to the user.
[0056] The image resolution of current BiV devices is three to four times lower than that of a light-adapted, normally sighted human eye. For example, using a third-generation BiV device, a telephone pole with a diameter of 30 cm is barely perceptible from a distance of 300 m, whereas the same pole can be optically resolved with the naked eye during the day from a distance of approximately 1000 m. Cables extending from such poles are also problematic, as they are extremely difficult to resolve with BiV devices and can pose a particular issue for helicopters flying at low altitudes.
[0057] Enlarging image segment 102 counteracts the limited image resolution of the BiV device and provides the user with an image segment of increased resolution.
[0058] The input image 100 can also contain more than two image segments. Furthermore, it is possible to divide the field of view not only into an indoor and outdoor area, but also horizontally and / or vertically. The image segments can be arranged differently depending on requirements and application. Preferably, the image segment with a magnification greater than one is positioned centrally in the input image. The central area of the surrounding scene is thus rendered at a higher resolution and therefore coincides with the area of sharpest vision of the eye. The enhanced and segmented image of the surrounding scene 100 is thus particularly well adapted to the characteristics of the eye. If the captured image of the surrounding scene is divided into several image segments, a stepped transition can, for example, be implemented.
[0059] Fig. Figure 2 shows a second example of an input image 200, or a segmented image of the surrounding scene, generated by an input-side optical module of the vision system according to the present invention. In this example, the input image 200 is vertically divided into three image segments: a central image segment 201, a left image segment 202, and a right image segment 203. The image scales between the central image segment 201 and the left image segment 202 and the right image segment 203 are different. The image scales of the left image segment 202 and the right image segment 203 can be the same or also different.For example, the central image segment 201 can depict a section of the surrounding scene at a first image scale, while the left and right image segments 202 and 203 each depict a corresponding section of the surrounding scene at a second image scale, with image segment 201 being enlarged relative to image segments 202 and 203. In this example, the image segments are separated from each other by two superimposed dividing lines 204 and 205.
[0060] Fig. Figure 3 shows a first embodiment of the vision system 300 according to the present invention, wherein the input-side optical module 301 is realized by three lens systems 302, 303, 304.
[0061] According to the invention, a vision system comprises an input-side optical module 301 and an image intensifier 305, wherein the input-side optical module 301 is arranged at the input of the image intensifier 305. The segmented image of the surrounding scene generated by the input-side optical module 301 is projected at the input of the image intensifier 305, i.e., the detector, and amplified by the image intensifier 305. The image intensifier 305 is, for example, a residual light amplifier or image converter that converts invisible or weak light into visible or more visible light. The image intensifier 305 thus generates an amplified and segmented image of the surrounding scene at the output 306 of the image intensifier 305. The user of the vision system 300 does not see a real image, as through glasses or a lens, but rather a display device.a display located at output 306 of the image amplifier 305, on which the amplified and segmented image of the surrounding scene is displayed or provided.
[0062] According to this embodiment, the input-side optical module 301 comprises three optical imaging means 302, 303, 304, each configured as an optical lens system. It should be noted that the optical lens systems consist of several individual elements, which advantageously reduce aberrations. According to this embodiment of the vision system 300, the lens system 303 is centrally located in the input-side optical module 301 and is configured such that it generates an image segment in the segmented image of the surrounding scene with a magnification greater than one. The lens systems 302 and 304 are arranged in the input-side optical module 301 such that they each generate an image segment that depicts a peripheral view of the surrounding scene, with the magnification of the image segments being less than one.The focal length of the central lens system 303 is therefore longer than that of the peripheral lens systems 302 and 304. The images from the lens systems 302, 303, and 304 are projected onto corresponding central and peripheral sections of the detector. Image segmentation can be achieved by means of apertures arranged on the lens systems 302, 303, and 304.
[0063] It should be noted that the vision system 300 is not limited to three optical imaging means or lens systems. Embodiments of the vision system are conceivable in which the input-side optical module comprises only two optical imaging means or more than three optical imaging means, each imaging means imaging a corresponding image segment at the input of the image intensifier 305. The image scales of the image segments can be freely selected.
[0064] Fig. Figure 4a shows a second embodiment of the vision system 400 according to the present invention, wherein the input-side optical module 401 is realized by mirror systems 402, 403, 404.
[0065] This embodiment of the vision system 400 is based on the first embodiment of the vision system according to Fig. 3. To avoid chromatic aberrations, the optical imaging elements of the input-side optical module 401 are implemented as mirror systems. These mirror systems generate a segmented image of the surrounding scene at the input of the image intensifier 405. The image intensifier 405 amplifies this segmented image and provides an amplified and segmented image of the surrounding scene at the output 406 of the image intensifier 405. Image segmentation can also be achieved using apertures.
[0066] Fig. 4b is a side view of a possible design of a mirror system made of Fig. 4a. The mirror system consists of at least two mirrors, where mirror 407 is a plane mirror and mirror 408 is a concave mirror.
[0067] Fig. Figure 4c shows another possible implementation of the input-side optical module using mirror systems 411 and 412. In this embodiment, only a portion of the field of view is imaged by mirror systems 411 and 412. Two peripheral sections of the surrounding scene are imaged via two mirrored ring surfaces 413 and 414 at the input of the image intensifier (not shown). The outer or peripheral sections are thus imaged as reduced-size image segments in the segmented image of the surrounding scene. The central area 415 directly images a central section of the surrounding scene as a central image segment with a magnification of one at the input of the image intensifier. Accordingly, the central image segment has a higher resolution in the amplified and segmented image of the surrounding scene than the peripheral image segments.
[0068] Fig. Figure 5 shows a third embodiment of the vision system 500 according to the present invention, wherein the optical imaging means of the input-side optical module 501 are realized by prism systems 502, 503, 504.
[0069] This embodiment of the vision system 500 is based on the first or second embodiment of the vision system according to Fig. 3 or Fig. 4. By means of corresponding prism systems 502, 503, 504, the field of view is widened and a segmented image of the surrounding scene is generated on the input of the image intensifier 505 by means of apertures. If the prism systems are combined with other optical imaging devices such as lens systems or mirror systems (this is not shown in Fig. (as shown in Figure 5), the image segments in the segmented image of the surrounding scene can be generated with different image scales. The image amplifier 505 amplifies the segmented image of the surrounding scene and provides an amplified and segmented image of the surrounding scene at the output 506 of the image amplifier 505.
[0070] The deviation of the main viewing direction relative to the image on the input or detector of the image intensifier 505 can be avoided by an additional optical element (mirror or prism) in order to achieve the same alignment of the detector with the viewing direction.
[0071] It should be noted that other embodiments of the vision system are possible, in which the input-side optical module can also consist of a combination of lens system, mirror system and / or prism system. For example, in Fig. 4. The centrally arranged mirror system can be replaced by a lens system. The advantages of the different types of imaging devices can thus be freely combined.
[0072] Fig. Figure 6a shows a fourth embodiment of the vision system 600 according to the present invention, wherein the vision system comprises an output optical module 601 in addition to the input-side optical module (not shown).
[0073] In this embodiment of the vision system, the output-side optical module 601 is implemented as a standard eyepiece 602. The output-side optical module 601 is arranged at the output 603 of the image intensifier 604. The user 605 views the amplified and segmented image of the surrounding scene displayed at the output 603 of the image intensifier 604 through the output-side optical module 601, i.e., the standard eyepiece 602.
[0074] Fig. Figure 6b shows a fifth embodiment of the vision system 610 according to the present invention, wherein the output-side optical module 611 is implemented as a wide-angle eyepiece 612. The wide-angle eyepiece 612 is arranged at the output 613 of the image intensifier 614. The user 615 views the amplified and segmented image of the surrounding scene displayed at the output 613 of the image intensifier 614 through the wide-angle eyepiece 612.
[0075] By using adapted eyepieces (normal eyepiece or wide-angle eyepiece), the field of view can be adjusted to the user's needs, depending on the application, e.g. to achieve overlap with the outside view in certain areas.
[0076] Fig. Figure 7a shows a sixth embodiment of the vision system 700 according to the present invention, wherein the vision system 700 comprises an output-side optical module implemented as a fiber optic system 701. Here, a point-to-point imaging of individual pixels from the output 702 of the image intensifier 703 to the display device 704 is carried out by means of fiber optic bundles.
[0077] The fiber optic system has an input side 705 and an output side 706. The optical fibers of the fiber optic system 701 are arranged such that each image segment of the amplified and segmented image of the surrounding scene is projected onto the display device 704 at different image scales.
[0078] Fig. Figure 7b shows a possible implementation of the 710 fiber optic system. Fig. 7a. In this embodiment of the fiber optic system 710, the fibers are arranged such that they are homogeneously distributed on the input side 711 of the fiber optic system 710, i.e., with equal spacing between the fibers, and inhomogeneously distributed on the output side 712 of the fiber optic system 710. For example, if the amplified and segmented image of the surrounding scene, which is projected onto the output of the image intensifier or the input side 711 of the fiber optic system 710, has two image segments 713, 714, wherein the first image segment 713 is projected with a first image scale and the second image segment 714 with a second image scale, then the fibers on the output side 712 of the fiber optic system 710 can be arranged such that the spacing 715 of the fibers in the second image segment 714, which projects the pixels of the second image segment 714 of the amplified and segmented image of the surrounding scene onto the output side 712, is equal to the distance between the fibers in the second image segment 714.The display device is smaller than the distances 716 of the optical fibers in the first image segment 713, which map the pixels of the first image segment 713 of the amplified and segmented image of the surrounding scene to output side 712 or the display device. The distances between the optical fibers 717 in the second image segment 714 on the input side 711 of the optical fiber system 710 are greater than the distances 715 between the optical fibers in the second image segment 714 on the output side 712 of the optical fiber system 710, and the distances 718 between the optical fibers in the first image segment 713 on the input side 711 of the optical fiber system 710 are smaller than the distances 716 between the optical fibers in the first image segment 713 on the output side 712 of the optical fiber system 710. As a result, the first image segment 713 is displayed enlarged on the display device, while the second image segment 714 is displayed reduced in size on the display device.
[0079] The amplified and segmented image of the surrounding scene can further include a third image segment 719 or more than three image segments. Depending on the application, the optical fibers of the third image segment 719 or of the further image segments can correspond to the design of the optical fibers in the first image segment 713 or in the second image segment 714.
[0080] Fig. Figure 7c shows another possible implementation of the 720 fiber optic system. Fig. 7. In this embodiment of the fiber optic system 720, the optical fibers are arranged such that they are inhomogeneously distributed on both the input side 721 and the output side 722 of the fiber optic system 720, with the number of optical fibers in one image segment differing from the number of optical fibers in at least one other image segment. Using the example of the two image segments 723 and 724 in the amplified and segmented image of the environment scene, which is generated at the output of the image amplifier and at the input side 723 of the fiber optic system 720, respectively, this implementation of the fiber optic system 720 would look like this: The first image segment 723 has a higher total number of optical fibers than the second image segment 724. On the input side 721 of the optical fiber system 720, the distances 728 of the optical fibers in the first image segment 723 are smaller than the distances 727 of the optical fibers in the second image segment 724. On the output side 722 of the optical fiber system 720, the distances 726 of the optical fibers in the first image segment 723 are larger than the distances 725 of the optical fibers in the second image segment 724, wherein the distances 727 of the optical fibers in the second image segment 724 on the input side 721 are larger than the distances 725 of the optical fibers in the second image segment 724 on the output side 722, and wherein the distances 728 of the optical fibers in the first image segment 723 on the input side 721 are smaller than the distances 726 of the optical fibers in the first image segment 723 on the output side 722. Homepage 722.The first image segment 723 is displayed enlarged on the output side 722 of the fiber optic system 720, whereby the higher number of fiber optics in the first image segment 723 simultaneously improves the resolution on the output side.
[0081] The amplified and segmented image of the surrounding scene can further include a third image segment 729 or more than three image segments. Depending on the application, the optical fibers of the third image segment 729 or of the further image segments can correspond to the design of the optical fibers in the first image segment 723 or in the second image segment 724.
[0082] In a seventh embodiment of the vision system according to the present invention, the vision system further comprises an output-side optical module, wherein the output-side optical module is implemented by lens systems, mirror systems, and / or prism systems. In this case, the output-side optical module is based on the embodiments of the input-side optical module described in the Fig. 3, Fig. 4a to 4c and Fig. 5. The output optical module can also comprise a combination of lens systems, mirror systems, and / or prism systems. The input and output optical modules can be of the same design in this case, but this is not required and depends on the requirements of the vision system.
[0083] The vision system can also include eye trackers that analyze the user's eye movements and monitor pupil position. If the pupils approach the edge of the central field of vision, the optics in the input and / or output module of the vision system are shifted horizontally and vertically by motors to increase the area of sharp vision, for example, by ±12°. The glasses could also automatically adjust to the wearer, making replacement easy. Furthermore, the system can alert the user to objects of interest within the image. The area of sharp vision (image segment with a magnification greater than one) is then shifted towards that object. Additionally, symbols of varying sizes, such as arrows or circles, can be superimposed on the amplified and segmented image of the surrounding scene to indicate the respective magnification.
Claims
[1] Vision system (300) for amplifying and segmenting an image (100) of an environment scene, comprising the following: an image amplifier (305) which amplifies a segmented image of the surrounding scene incident on an input of the image amplifier and provides an amplified and segmented image of the surrounding scene to an observer at an output of the image amplifier; and an input-side optical module (301) comprising at least two optical imaging means (302, 303, 304) that generate the segmented image of the surrounding scene and map it to the input of the image intensifier, wherein a first optical imaging means of the at least two optical imaging means generates a first image segment (102) of the surrounding scene with a first image scale, and, wherein a second optical imaging means of the at least two optical imaging means generates a second image segment (101) of the surrounding scene with a second image scale. [2] Vision system (300) according to claim 1, wherein the first image segment (102) is the central area of the surrounding scene. [3] Vision system (300) according to claim 1 or 2, wherein the first image segment (102) depicts an enlarged view of an area of the surrounding scene. [4] Vision system (300) according to one of the preceding claims, wherein the second image segment (101) is a peripheral area of the surrounding scene. [5] Viewing system (300) according to one of the preceding claims, wherein the second image segment depicts a reduced view of an area of the surrounding scene. [6] Vision system (300) according to one of the preceding claims, wherein the first and the second optical imaging means (302, 303, 304) are arranged such that the second image segment (101) surrounds the first image segment (102). [7] Vision system (300) according to one of the preceding claims, wherein the input-side optical module (301) comprises a third optical imaging means (302, 303, 304) that produces a third image segment (201, 202, 203) of the surrounding scene with a third image scale. [8] Viewing system (300) according to claim 7, wherein the third imaging scale corresponds to the second imaging scale. [9] Vision system according to claim 7 or 8, wherein the second and third optical imaging means (302, 303, 304) are arranged such that the second image segment (202, 203) and the third image segment (202, 203) each provide a peripheral view of the surrounding scene. [10] Vision system (300) according to one of claims 7 to 9, wherein the second and third image segment (202, 203) at least partially enclose the first image segment (201). [11] Viewing system (300) according to one of the preceding claims, wherein an image scale within the image segments (201, 202, 203) can be variable. [12] Vision system (300) according to one of the preceding claims, wherein the first optical imaging means (302, 303, 304) and the second optical imaging means (302, 303, 304) of the at least two optical imaging means are each one of the following: a lens system (302, 303, 304), a mirror system (402, 403, 404) or a prism system (502, 503, 504), wherein at least one optical imaging means of the at least two optical imaging means is a lens system or a mirror system. [13] Vision system (300) according to one of claims 7 to 10, wherein the third optical imaging means is one of the following: a lens system (302, 303, 304), a mirror system (402, 403, 404) or a prism system (502, 503, 504), wherein at least one optical imaging means of the at least two optical imaging means is a lens system or a mirror system. [14] Vision system (300) according to one of the preceding claims, wherein the at least two optical imaging means have apertures [15] Vision system (300) according to one of the preceding claims, wherein an output-side optical module (601) is arranged between the output of the image intensifier (305) and the observer. [16] Vision system (600) according to claim 15, wherein the output optical module comprises at least two output optical imaging means which project the first image segment and the second image segment of the amplified and segmented image of the surrounding scene onto a display device, each with correspondingly different image scales, and wherein each of the at least two output optical imaging means is one of the following: a lens system, a mirror system or a prism system, wherein at least one output optical imaging means of the at least two output optical imaging means is a lens system or a mirror system. [17] Vision system (600) according to claim 16, wherein the output optical module further comprises a third output optical imaging means which projects the third image segment of the amplified and segmented image of the surrounding scene onto the display device at a different image scale, and wherein the third output optical imaging means is one of the following: a lens system, a mirror system or a prism system, wherein at least one output optical imaging means of the at least two output optical imaging means is a lens system or a mirror system. [18] Vision system (600) according to claim 15, wherein the output optical module (601) comprises a normal eyepiece (602). [19] Vision system (610) according to claim 15, wherein the output optical module (611) has a wide-angle eyepiece (612). [20] Vision system (700) according to claim 15, wherein the output-side optical module comprises a fiber optic system (701) and fiber optics of the fiber optic system are arranged such that the first image segment, the second image segment and optionally the third image segment of the amplified and segmented image of the surrounding scene are displayed with different image scales on a display device arranged on an output side of the fiber optic system. [21] Vision system (700) according to claim 20, wherein the distances of the optical fibers on an input side (711) of the optical fiber system (710) are homogeneous, and the distances of the optical fibers on the output side (712) are inhomogeneous, such that on the output side the distances of the optical fibers in the second image segment (714) are smaller than the distances of the optical fibers in the first image segment (713), and, wherein the distances of the optical fibers in the second image segment on the input side are larger than on the output side, and, the distances of the optical fibers in the first image segment on the input side are smaller than on the output side. [22] Vision system (700) according to claim 20, wherein the number of optical fibers in the first image segment (723) of the amplified and segmented image of the environment scene is greater than the number of optical fibers in the second image segment (724) and optionally greater than the number of optical fibers in the third image segment (729) of the amplified and segmented image of the environment scene, and, wherein on the input side (721) the distances (728) of the optical fibers in the first image segment (723) are smaller than in the second image segment (724) and on the output side (722) the distances (726) of the optical fibers in the first image segment (723) are greater than in the second image segment (724), and wherein the distances (727) of the optical fibers in the second image segment (724) on the input side (721) are greater than on the output side (722), and, distances (728) of the optical fibers in the first image segment (723) on the input side (721) are smaller than on the starting page (722). [23] Vision system (300, 600, 700) according to one of the preceding claims, comprising an eye tracker and a motorized displacement unit with which the vision system can be moved in relation to the user's eye.
Citation Information
Patent Citations
Display device
DE3430695A1
Surveying instrument
EP2569595B1
Image processing apparatus, display control method, program, and storage medium
US20090251482A1