Head mounted visualization unit and visualization system

By designing a head-mounted visualization unit with the first and second optical channels, and using a liquid crystal layer and a mirror or a waveguide to superimpose additional information in a bright environment, the problem of difficulty in improving the visibility of the superimposed information in a bright environment in the prior art is solved, and efficient stereoscopic image display is achieved.

CN115398312BActive Publication Date: 2025-05-06CARL ZEISS MEDITEC AG
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202180018244.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-11-24
Filing Date
2021-03-01
Publication Date
2025-05-06
Estimated Expiration
2041-03-01

AI Technical Summary

Technical Problem

In the prior art, when displaying three-dimensional image data using a head-mounted visualization unit, it is difficult to improve the visibility of superimposed information in a bright environment while maintaining a stereoscopic image impression.

Method used

A head-mounted visualization unit is designed, and its optical system includes first and second optical channels, transmitting first and second polarized light, respectively. Visibility of the information is enhanced by arranging the polarizer and optical attenuator in the first optical channel, additional information is superimposed into the channel using a liquid crystal layer and a mirror or a waveguide.

Benefits of technology

It realizes improving the visibility of additional information in a bright environment while maintaining a stereoscopic image impression, improving the use effect of the head-mounted visualization unit.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115398312B_ABST
    Figure CN115398312B_ABST
Patent Text Reader

Abstract

A visualization system for observing a surgical site (OP site) in a surgical environment is proposed. The visualization system has a head-mounted visualization unit with an optical system that is at least partially transparent. The optical system has a first optical channel and a second optical channel. The first optical channel is assigned to the first eye of the user of the head-mounted visualization unit, and the second optical channel is assigned to the second eye of the user. The first optical channel substantially transmits optical radiation of a first polarization and substantially does not transmit optical radiation of a second polarization, where the first polarization is substantially orthogonal to the second polarization. The second optical channel substantially transmits optical radiation of the second polarization and substantially does not transmit optical radiation of the first polarization. At least a polarizer and a light attenuator are arranged in the first optical channel, and the light attenuator is arranged downstream of the polarizer in the direction towards the first eye of the user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a head-mounted visualization unit and a visualization system comprising such a head-mounted visualization unit. Background Art

[0002] Surgical operating microscopes are used in microsurgery. With a surgical operating microscope, the physician can observe the surgical area, also known as the surgical operating site (OP site), at a higher magnification. In addition to magnification, a stereoscopic impression of the OP site is also crucial for the success of the surgical procedure. Analog surgical operating microscopes with stereo optics and observation through eyepieces are often used in microsurgery.

[0003] As an alternative or in addition, modern surgical operating microscopes sometimes provide the possibility to capture digital three-dimensional images of the OP site. The obtained three-dimensional image data can then be displayed on a screen, in particular a 3D monitor or a head-mounted display (HMD). An HMD suitable for use in a surgical environment may also be referred to as a surgical head-mounted display.

[0004] For example, in a 3D monitor, a first image with a first polarization can be displayed, and at the same time a second image with a second polarization can be displayed, wherein the first polarization is substantially orthogonal to the second polarization. When using a head-mounted visualization unit that transmits only light of the first polarization to a first eye and only light of the second polarization to a second eye, a viewer of the 3D monitor has a stereoscopic image impression.

[0005] Furthermore, it is often desirable to provide the surgeon with additional information optically, which can be perceived even when the surgeon is not looking at the screen. For this purpose, DE 10 2017 123894 B3, for example, proposes a head-mounted visualization unit, in particular a head-mounted display device (HMD), which comprises a glass and a device for generating an image on the glass.

[0006] When an HMD is used to display three-dimensional image data, different images can be superimposed into two beam paths directed to the user's respective eyes, so that a stereoscopic image impression can be produced in this way. For example, US 2019 / 0339528 A1 discloses an HMD in the form of an augmented reality HMD (AR HMD), also known as a mixed reality display. AR HMD is understood to be an HMD in which the user can see both the superimposed image data and the natural environment. Before the image can be superimposed into the beam path of the corresponding eye, a partial area of ​​the user's natural field of view of the HMD is darkened in a targeted manner to improve the visibility of the superimposed image in a bright environment.

[0007] It has been shown that 3D monitors are preferred for presenting three-dimensional image data due to their higher resolution and shorter latency compared to displays of the three-dimensional image data. At the same time, however, it is desirable to darken parts of the user's natural field of view of a head-mounted visualization unit in order to block interfering light sources or to increase the visibility of superimposed additional information. Summary of the invention

[0008] Starting from this point, the object of the present invention is to specify an improved head-mounted visualization unit and an improved visualization system.

[0009] This object is achieved by the subject matter described below. Advantageous improvements for achieving this object are described in detail below.

[0010] A visualization system for viewing a surgical site (OP site) in a surgical environment is proposed, the visualization system having:

[0011] Head-mounted visualization unit,

[0012] The head-mounted visualization unit has an optical system that is at least partially light-transmissive,

[0013] wherein the optical system has a first optical channel and a second optical channel, the first optical channel being assigned to a first eye of a user of the head-mounted visualization unit and the second optical channel being assigned to a second eye of the user,

[0014] wherein the first optical channel is substantially transmissive to optical radiation of a first polarization and substantially opaque to optical radiation of a second polarization, wherein the first polarization is substantially orthogonal to the second polarization,

[0015] wherein the second optical channel is substantially transmissive to optical radiation of the second polarization and substantially opaque to optical radiation of the first polarization,

[0016] Wherein, at least a polarizer and an optical attenuator are arranged in the first optical channel, and

[0017] wherein the light attenuator is arranged downstream of the polarizer in a direction towards the first eye of the user, and

[0018] A screen, wherein the screen is configured to present a first image of the OP site having the first polarization and a second image of the OP site having the second polarization so as to stereoscopically generate a sample image.

[0019] Preferably, the polariser comprises a linear polarisation filter.

[0020] Preferably, the polarizer comprises a λ / 4 plate, wherein the λ / 4 plate is arranged upstream of the linear polarization filter in a direction towards the first eye of the user.

[0021] Preferably, the light attenuator comprises a controllable liquid crystal layer.

[0022] Preferably, the liquid crystal layer comprises one or more individually controllable liquid crystal pixels.

[0023] Preferably, the optical attenuator has a linear output polarization filter and a linear input polarization filter.

[0024] Preferably, the input linear polarization filter of the optical attenuator is identical to the linear polarization filter of the polarizer.

[0025] Preferably, the liquid crystal layer is arranged to superimpose additional information into the first channel.

[0026] Preferably, the head-mounted visualization unit has a display device for displaying additional information in the first channel.

[0027] Preferably, a reflector is provided in order to superimpose the additional information displayed by the display device into the first channel, wherein the reflector is arranged downstream of the light attenuator in a direction towards the first eye of the user.

[0028] Preferably, a waveguide is provided in order to superimpose the additional information displayed by the display device into the first channel, wherein the waveguide is arranged downstream of the light attenuator in a direction towards the first eye of the user.

[0029] Preferably, the first polarization and the second polarization are circular polarizations.

[0030] Preferably, the screen is arranged to emit light of different polarisations row by row.

[0031] Preferably, the visualization system has a surgical microscope or an endoscope, wherein the surgical microscope or the endoscope has an image recording device for stereoscopically recording the sample image.

[0032] A head-mounted visualization unit is proposed, which has an optical system that is at least light-transmissive. The optical system has a first optical channel and a second optical channel, the first optical channel being assigned to a first eye of a user of the head-mounted visualization unit and the second optical channel being assigned to a second eye of the user. The first optical channel substantially transmits optical radiation of a first polarization and substantially does not transmit optical radiation of a second polarization, wherein the first polarization is substantially orthogonal to the second polarization. The second optical channel substantially transmits optical radiation of the second polarization and substantially does not transmit optical radiation of the first polarization. At least a polarizer and a light attenuator are arranged in the first optical channel. Here, the light attenuator is arranged downstream of the polarizer in a direction toward the first eye of the user.

[0033] The transmittance for different polarizations can enable a user of the head-mounted visualization unit to perceive an image with the corresponding polarization using the left eye or the right eye, so that a stereoscopic impression can be obtained. The orthogonal polarizations can be linear polarizations (e.g. horizontal polarization and vertical polarization) or circular polarizations (e.g. left circular polarization and right circular polarization). The arrangement of the optical attenuator downstream of the polarizer makes it possible to block part of the natural field of view without affecting the channel separation required for stereoscopic perception.

[0034] In particular, the head-mounted visualization unit may be suitable for use during surgical procedures. In this context, the head-mounted visualization unit may also be referred to as a surgical HMD. In particular, the head-mounted visualization unit may be designed in such a way that the head-mounted visualization unit may be easily sterilized after the surgical procedure. Furthermore, the proposed head-mounted visualization unit may be made lighter, since the need to generate stereoscopic images in the head-mounted visualization unit itself is eliminated. Therefore, the energy consumption of the head-mounted visualization unit may be lower compared to known head-mounted visualization units, and therefore a head-mounted visualization unit with the same battery capacity but which may be used longer during surgery or is lighter may be provided.

[0035] In one exemplary embodiment, the polarizer has a linear polarization filter. For example, the polarization filter can be arranged to transmit only vertically polarized light.

[0036] According to another configuration, the polarizer includes a λ / 4 plate, wherein the λ / 4 plate is arranged upstream of the linear polarization filter in a direction toward the first eye of the user. Depending on the orientation of the fast optical axis of the λ / 4 plate relative to the arrangement of the subsequent linear polarization filter, the polarizer can be arranged to transmit left circularly polarized or right circularly polarized light, wherein the light downstream of the linear polarization filter has linear polarization.

[0037] The light attenuator may have a controllable liquid crystal layer. The liquid crystal layer may include one or more controllable liquid crystal pixels. In this way, the effect of different points of the liquid crystal layer on the incident light may be influenced.

[0038] The optical attenuator may have an output linear polarization filter and an input linear polarization filter. In an exemplary embodiment, the input polarization filter of the optical attenuator may be the same as the linear polarization filter of the polarizer. In this way, optical elements of the optical system may be omitted if necessary. This may allow the head mounted visualization unit to be made lighter and may be more cost effective to produce.

[0039] The liquid crystal layer may be arranged to superimpose additional information into the first channel. For example, the liquid crystal pixels may be controlled differently to display additional parameters to a user of the head mounted visualization unit.

[0040] In the embodiment of the head-mounted visualization unit, a display device is provided, with which additional information can be displayed in the first channel.

[0041] The head-mounted visualization unit may comprise a reflector for superimposing additional information displayed by the display device into the first channel, wherein the reflector is arranged downstream of the light attenuator in a direction towards the first eye of the user.

[0042] It is also envisaged that a waveguide is provided in order to superimpose additional information displayed by the display device into the first channel, wherein the waveguide is arranged downstream of the light attenuator in the direction towards the first eye of the user. As a result, the light attenuator makes it easier to perceive the displayed additional information, in particular in a very bright environment.

[0043] Furthermore, a visualization system having a head-mounted visualization unit as described above and a screen is proposed, wherein the screen is arranged to present a first image having a first polarization and a second image having a second polarization to stereoscopically reproduce a sample image. For example, a screen that emits light of different polarizations line by line may be used.

[0044] In one configuration, the visualization system has a surgical microscope or an endoscope, wherein the surgical microscope or the endoscope has an image recording device for stereoscopically recording images of the sample. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Various aspects of the present invention will now be explained in more detail with reference to the accompanying drawings, in which:

[0046] Figure 1 A visualization system is shown;

[0047] Figure 2 A head mounted visualization unit is shown;

[0048] Figure 3 The optical system is shown;

[0049] Figure 4 The optical system is shown;

[0050] Figure 5 The optical system is shown;

[0051] Figure 6 The optical system is shown; and

[0052] Figure 7 The optical system is shown. DETAILED DESCRIPTION

[0053] Figure 1A visualization system 1000 is shown, which includes a surgical microscope 1004, with which three-dimensional image data of an OP site (not shown here) can be recorded. The surgical microscope 1004 is connected to a control device 1005. The control device 1005 can receive the three-dimensional image data from the surgical microscope 1004 and display it, for example, on a 3D monitor 1003. With the help of a head-mounted visualization unit 1001, the surgeon 1002 can stereoscopically perceive the image displayed on the 3D monitor 1003. The head-mounted visualization unit can be arranged to exchange additional information with the control device 1005. If necessary, this additional information can be additionally displayed to the surgeon 1002.

[0054] Figure 2 Further details of the visualization unit 1001 are shown as an example. In particular, the visualization unit 1001 may have a partially light-transmissive optical system 2000. A first channel may be assigned to a first eye of a user 1002 of the head-mounted visualization unit, and a second channel may be assigned to the other eye of the user 1002.

[0055] Figure 2 By way of example, two variants are shown with which additional information can be superimposed into the respective channels. For example, it is conceivable to superimpose an image from a display device 2021 into one channel via a partially transparent mirror 2022. However, it is also possible to use a display device 2011, a mirror 2012 and a waveguide 2013 to superimpose additional information into an optical channel.

[0056] Figure 3 The elements of the head mounted visualization unit are shown in more detail. The head mounted visualization unit has a first optical channel 3100 assigned to a first eye of the user 1002 and a second optical channel 3200 assigned to a second eye of the user 1002. The screen 1003 can present an image having a first polarization and a second polarization. For example, the first polarization can be as shown in FIG. Figure 3 The vertical polarization indicated by the upward pointing arrow in Figure 3Horizontal polarization indicated by a circle in the figure. The head-mounted visualization unit has a polarizer 3110 in the first optical channel 3100 and an optical attenuator 3120 between the polarizer 3110 and the glasses of the user 1002. The polarizer 3110 includes a linear polarization filter 3111 that allows only vertically polarized light to pass through. The optical attenuator 3120 has an input polarization filter 3121 and an output polarization filter 3123. A liquid crystal layer 3122 is arranged between the input polarization filter 3121 and the output polarization filter 3123, and the liquid crystal layer has a plurality of individually controllable liquid crystal pixels (not shown). The liquid crystal layer 3122 rotates the vertical polarization, with the result that a linear combination of vertical polarization and horizontal polarization is presented downstream of the liquid crystal layer. In this case, the degree of rotation can be changed by appropriately controlling the liquid crystal layer 3122. The output polarization filter 3123 ensures that only vertically polarized light is transmitted. Accordingly, the liquid crystal layer 3122 causes light attenuation in combination with the input polarization filter 3121 and the output polarization filter 3123.

[0057] Likewise, the second optical channel 3200 includes a polarizer 3210 having a linear polarization filter 3211 and an optical attenuator 3220 having an input polarization filter 3221, a liquid crystal layer 3222, and an output polarization filter 3223. Unlike the first channel 3100, the second channel 3200 transmits only horizontally polarized light. Therefore, channel separation occurs, thereby allowing the user of the head-mounted visualization unit to stereoscopically perceive the image displayed by the screen 1003.

[0058] Figure 4 Another partially transparent optical system is shown with a first channel 4100 and a second channel 4200. The first channel has a polarizer 4110 and an optical attenuator 4120 arranged after the polarizer. Therefore, the linear polarization filter 4111 of the polarizer 4110 is the same as the input polarization filter of the optical attenuator 4120. The optical attenuator 4120 further has a liquid crystal layer 4122 and an output polarization filter 4123.

[0059] The channel 4100 thus substantially transmits vertically polarized light. The optical system further has a second channel 4200, which has a polarizer 4210 and an optical attenuator 4220. The linear polarization filter 4211 of the polarizer 4210 is thus identical to the input polarization filter of the optical attenuator 4220. The optical attenuator 4220 additionally has a liquid crystal layer 4222 and an output polarization filter 4223. Unlike the first channel 4100, the second channel 4200 only substantially transmits horizontally polarized light.

[0060] and Figure 3 Compared with the optical system, Figure 4 The optical system makes it possible to omit linear polarization filters in both the first channel and the second channel.

[0061] Figure 5 Another optical system is shown, which is suitable for a 3D monitor for generating images with left and right circular polarization. The use of circular polarization offers the user of a head-mounted visualization unit the advantage that the separation of the images assigned to the left and right channels in each case can remain clear even when the head is tilted.

[0062] according to Figure 5 The optical system has a first channel 5100 and a second channel 5200. A polarizer 5110 and a light attenuator 5120 are arranged in the first channel 5100. The polarizer includes a linear polarization filter 5111 and a λ / 4 plate 5112. The linear polarization filter 5111 is arranged between the λ / 4 plate 5112 and the eyes of the user 1002 of the head-mounted visualization unit. The polarizer 5110 transmits only right circularly polarized light, which means that vertically polarized light exists downstream of the polarizer 5110. The light before reaching the light attenuator 5120 is attenuated by means of an input polarizer 5121, a liquid crystal layer 5122 and an output polarization filter 5123.

[0063] Likewise, the second channel 5200 has a polarizer 5210 and an optical attenuator 5220. The polarizer 5210 includes a λ / 4 plate 5212 and has a linear polarization filter 5211 arranged between the λ / 4 plate 5212 and the eye of the user 1002 of the head-mounted visualization unit. The polarizer 5210 has the following effect: only left circular light can pass through the polarizer 5210 and appear as horizontally polarized light downstream of the polarizer 5210. The horizontally polarized light is then attenuated by the input polarization filter 5221, the liquid crystal layer 5222, and the output polarization filter 5223.

[0064] Figure 6 Another example of a head mounted visualization unit that can be used with circular polarization is shown. The optical system of the head mounted visualization unit also has a first channel 6100 and a second channel 6200.

[0065] The polarizer 6110 of the first channel 6100 shares the same λ / 4 plate 6112 / 6212 with the polarizer 6210 of the second channel 6200. In addition, the input polarization filter of the optical attenuator 6120 is the same as the linear polarization filter 6111 of the polarizer 6110, and the input polarization filter 6211 of the optical attenuator 6220 is the same as the linear polarization filter 6211 of the polarizer 6210. Since the optical attenuators 6120 and 6220 are arranged differently with respect to the fast optical axis of the λ / 4 plates 6112 / 6212, only the right circular light is allowed to pass through in the first channel 6100 and only the left circular light is allowed to pass through in the second channel 6200.

[0066] Figure 7 Further details of the head-mounted visualization unit are shown.

[0067] Figure 4 The input polarization filter of the optical attenuator 4120 is the same as the linear polarization filter 4111 of the polarizer 4110. Figure 7 In an exemplary embodiment of the present invention, the input polarization filter 7111 of the optical attenuator 7120 is the same as the linear polarization filter of the polarizer 7110 and the input polarization filter of the optical attenuator 7220 is the same as the linear polarization filter 7211 of the polarizer 7210. The optical attenuator 7120 of the first channel 7100 is the same as the optical attenuator 7220 of the second channel. Since the arrangements of the λ / 4 plates 7112 and 7212 relative to the linear polarization filters 7111 / 7211 are different, the right circularly polarized light incident on the λ / 4 plate 7112 in the first channel 7100 is allowed to pass through, and the left circularly polarized light incident on the λ / 4 plate 7212 in the second channel 7200 is allowed to pass through. Accordingly, according to Figure 7 The optical system also allows channel separation, with the result that a user of the head-mounted visualization unit can stereoscopically perceive the three-dimensional image data displayed on the screen.

Claims

1. A visualization system (1000) for viewing a surgical site (OP site) in a surgical environment, the visualization system having: A head mounted visualization unit (1001), The head-mounted visualization unit has an optical system (2000) that is at least partially light-transmissive, in, The optical system (2000) has a first optical channel (3100) and a second optical channel (3200), the first optical channel being assigned to a first eye of a user (1002) of the head-mounted visualization unit (1001), and the second optical channel being assigned to a second eye of the user (1002), wherein the first optical channel (3100) substantially transmits optical radiation of a first polarization and substantially does not transmit optical radiation of a second polarization, wherein the first polarization is substantially orthogonal to the second polarization, wherein the second optical channel (3200) substantially transmits optical radiation of the second polarization and substantially does not transmit optical radiation of the first polarization, Wherein, at least a polarizer (3110) and an optical attenuator (3120) are arranged in the first optical channel (3100), and wherein the optical attenuator (3120) is arranged downstream of the polarizer (3110) in a direction toward the first eye of the user (1002), Wherein, the head-mounted visualization unit can be configured to exchange additional information with the control unit, and a screen (1003), wherein the screen (1003) is configured to present a first image of the OP portion having the first polarization and a second image of the OP portion having the second polarization so as to generate a sample image stereoscopically.

2. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 1, in, The polarizer (3110) includes a linear polarization filter (3111).

3. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 2, in, The polarizer (5110) includes a λ / 4 plate (5112), Wherein, the λ / 4 plate (5112) is arranged upstream of the linear polarization filter (5111) in a direction toward the first eye of the user.

4. A visualization system (1000) for observing an OP site in a surgical environment according to any one of claims 1 to 3, in, The optical attenuator (3120) includes a controllable liquid crystal layer (3122).

5. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 4, in, The liquid crystal layer (3122) includes one or more individually controllable liquid crystal pixels.

6. A visualization system (1000) for observing an OP site in a surgical environment according to any one of claims 1 to 3, in, The optical attenuator (3120) has a linear output polarization filter (3123) and a linear input polarization filter (3121).

7. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 6, in, The input linear polarization filter (4111) of the optical attenuator (4120) is the same as the linear polarization filter (4111) of the polarizer (4110).

8. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 5, in, The liquid crystal layer (3122) is configured to superimpose additional information into the first optical channel (3100).

9. A visualization system (1000) for observing an OP site in a surgical environment according to any one of claims 1 to 3, in, The head-mounted visualization unit (1001) has a display device (2021) for displaying additional information in the first optical channel (3100).

10. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 9, in, A reflector (2022) is provided so as to superimpose the additional information displayed by the display device (2021) into the first optical channel (3100), Wherein, the reflector (2022) is arranged downstream of the light attenuator (3120) in a direction toward the first eye of the user (1002).

11. The visualization system (1000) for observing an OP site in a surgical environment as claimed in claim 9, in, A waveguide (2013) is provided so as to superimpose the additional information displayed by the display device (2011) into the first optical channel (3100), Wherein, the waveguide (2013) is arranged downstream of the optical attenuator (3120) in a direction toward the first eye of the user.

12. The visualization system (1000) for observing an OP site in a surgical environment according to any one of claims 1 to 3, in, The first polarization and the second polarization are circular polarizations.

13. The visualization system (1000) for observing an OP site in a surgical environment according to any one of claims 1 to 3, in, The screen (1003) is arranged to emit light of different polarizations row by row.

14. The visualization system (1000) for observing an OP site in a surgical environment according to any one of claims 1 to 3, The visualization system has a surgical microscope (1004) or an endoscope, in, The surgical microscope (1004) or endoscope has an image recording device for stereoscopically recording the sample image.

Citation Information

Patent Citations

  • Disc for an HMD and HMD with at least one disc

    DE102017123894B3

  • Wearable image manipulation and control system with high resolution micro-displays and dynamic opacity augmentation in augmented reality glasses

    US20190339528A1

  • Polarized dynamic real-time stereo microscopic imaging apparatus and method

    CN106772981A

  • Method and system for display device with integrated polarizer

    CN110300905A

  • Polarization type dual-purpose 3D glasses

    CN203324583U