Head-Mountable Display Device and Method for Displaying Images Received from a Microscope - Patent application

Abstract

SOLUTION: A head-mountable display device for displaying an image received from a microscope comprises a first display configured to display a first image of a part of an object, the first image received from a microscope. Further, the head-mountable display device comprises a first optical arrangement located in front of the first display. The first optical arrangement comprises at least one lens. Additionally, the head-mountable display device comprises a mounting structure configured to fasten the first display to the head of a user. The head-mountable display device is configured to allow a direct line of sight from a first eye of the user to the object in a field of view of the user outside of the first display while the user is watching the first display through the first optical arrangement, if the mounting structure is fastened to the head of a user. An angle between a display direction and the direct line of sight is less than 50° and the display direction is orthogonal to the first display.EFFECT: Direct interaction with an environment becomes easier.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] Embodiments relate to displaying microscopic images on a head-mountable display, and in particular to a head-mountable display device and method for displaying images received from a microscope. [Background technology]

[0002] Microsurgery often requires a magnified, stereoscopic view of the surgical field without distortion. Digital stereo microscopes can provide such a view of the surgical field. Images can be viewed through the microscope's eyepieces or can be displayed on an external screen or by a head-mounted display. Summary of the Invention [Means for solving the problem]

[0003] One embodiment relates to a head-mountable display device for displaying an image received from a microscope. The head-mountable display device includes a first display configured to display a first image of a portion of an object received from the microscope. The head-mountable display device further includes a first optical device located in front of the first display and including at least one lens. In addition, the head-mountable display device includes a mounting structure configured to secure the first display to a user's head. The head-mountable display device is configured to enable a direct line of sight from the user's first eye to an object in the user's field of view outside the first display while the user views the first display through the first optical device when the mounting structure is secured to the user's head. The angle between the viewing direction and the direct line of sight is less than 50°, and the viewing direction is orthogonal to the first display.

[0004] By allowing a user a direct line of sight to objects while using a head-mountable display device, it becomes easier for the user to interact with their immediate environment (e.g., other people or tools) compared to display devices that completely or nearly completely obstruct the user's view.

[0005] Another embodiment relates to a head-mountable display device for displaying an image received from a microscope. The head-mountable display device includes a first display configured to display a first image of a portion of an object received from the microscope. The head-mountable display device further includes a mounting structure configured to secure the first display to a user's head. The mounting structure includes a nosepiece configured to align the first display with a first eye of the user. The mounting structure is further configured such that less than 40% of the weight of the head-mountable display device rests on the user's nose via the nosepiece.

[0006] The nosepiece can enable stable alignment of the display relative to the user's eyes. In this way, misalignment and movement of the display relative to the user's eyes can be significantly reduced or even completely avoided. Meanwhile, the mounting structure allows a major portion of the weight of the head-mountable display device to be supported on the user's head rather than the nose. In this way, high wearing comfort can be enabled.

[0007] Another embodiment relates to a head-mountable display device for displaying an image received from a microscope. The head-mountable display device includes a first display configured to display a first image of a portion of an object received from the microscope. The head-mountable display device further includes a mounting structure configured to secure the first display to a user's head. Additionally, the head-mountable display device includes a first optical device positioned in front of the first display. The first optical device includes three lenses. At least one of the three lenses is an aspherical lens.

[0008] By using at least three lenses between the display and the user's eyes, good optical performance can be achieved in terms of magnification and aberration. By using at least one aspherical lens, the size and weight of the optical device can be significantly reduced compared to systems using only spherical lenses. Therefore, a head-mountable display device can be provided that is small, lightweight, and has good optical performance.

[0009] Some examples of apparatus and / or methods are now described, by way of example only, and with reference to the accompanying drawings, in which: [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram of a head-mountable display device. [Figure 2] FIG. 1 is a schematic diagram of another head-mountable display device with two displays. [Figure 3] FIG. 10 is a schematic diagram of another head-mountable display device that allows for adjustment of interpupillary distance. [Figure 4a] FIG. 2 is a schematic diagram of another head-mountable display device in a first state. [Figure 4b] FIG. 4b is a schematic diagram of the head-mountable display device of FIG. 4a in a second state. [Figure 5a]FIG. 10 is a side view of another head-mountable display device. [Figure 5b] FIG. 5b is a front view of the head-mountable display device of FIG. 5a. [Figure 5c] FIG. 10 is a side view of another head-mountable display device. [Figure 5d] FIG. 5c is a side view of the head-mountable display device of FIG. [Figure 5e] FIG. 5c is a side view of the head-mountable display device of FIG. [Figure 5f] FIG. 10 is a side view of another head-mountable display device. [Figure 5g] FIG. 5c is a side view of the head-mountable display device of FIG. 5f. [Figure 5h] FIG. 5c is a side view of the head-mountable display device of FIG. 5f. [Figure 6] FIG. 1 is a diagram of a user's view. [Figure 7] FIG. 10 is a schematic diagram of another head-mountable display device and microscope system. [Figure 8] FIG. 1 is a schematic diagram of a head-mountable display device having a nosepiece. [Figure 9] 1 is a schematic diagram of a head-mountable display device having an optical arrangement with at least three lenses. [Figure 10] FIG. 1 is a schematic diagram of an optical arrangement for a head-mountable display device. [Figure 11] 1 is a flowchart of a method for displaying an image received from a microscope. DETAILED DESCRIPTION OF THE INVENTION

[0011] Various examples will now be described more fully with reference to the accompanying drawings, in which several examples are shown and in which line thicknesses and layer and / or region thicknesses may be exaggerated for clarity.

[0012] 1 illustrates a head-mountable display device for displaying an image received from a microscope, according to one embodiment. The head-mountable display device 100 includes a first display 10 configured to display a first image of a portion of an object 14, the first image being received from a microscope 12. The head-mountable display device 100 further includes a first optical device 30 positioned in front of the first display 10. The first optical device 30 includes at least one lens 32. Additionally, the head-mountable display device 100 includes a mounting structure 20 configured to secure the first display 10 to a user's head. The head-mountable display device 100 is configured to enable a direct line of sight 16 from the user's first eye to an object 14 in the user's field of view outside the first display 10 while the user is viewing the first display 10 through the first optical device when the mounting structure 20 is secured to the user's head. The viewing angle between the viewing direction 18 and the direct line of sight is less than 50° (or less than 45° or less than 40°), and the viewing direction 18 is perpendicular to the first display 10 .

[0013] The head-mountable display device 100 can enable a direct line of sight 16 to the object 14 due to, for example, the size and / or geometry of the first display 10, the first optical device 30, and / or the position and / or distance of the first optical device 30 relative to the user's eyes. By using the first display 10 and / or the first optical device 30 described below, the size of the display and optical device can be kept small and / or the distance to the eyes can be kept large, thereby enabling a direct line of sight at a viewing angle of, for example, less than 50°. In this way, the user can have an unobstructed view of objects in the periphery outside the first display 10 while viewing the first image on the display. For example, a brain surgeon can view a magnified image of a surgical site on the display while having a direct line of sight outside the display to the patient's body or head and / or to tools in their hands or near the patient's head. In this way, the surgeon can have much better control and / or understanding of their environment compared to when their peripheral view is obstructed.

[0014] For example, the direct line of sight 16 may be a straight line between the user's eye (e.g., the pupil of the user's eye) and the object 14, without any opaque or non-transparent structures therebetween, or without any structures therebetween at all. The user's field of view may be unobstructed outside the first display 10 and / or the first optical device 30. When the user views the image on the first display 10 through the first optical device 30, the user may still be able to view their environment at a viewing angle greater than 50° (or greater than 45°, or greater than 40°). For example, the viewing angle is measured between the viewing direction 18 and the direct line of sight 16. The viewing direction 18 may be perpendicular to the front surface of the first display 10. For example, the viewing direction 18 may be perpendicular to the front surface of the first display 10 at the center of the first display 10. Head-mountable display device 100 can be configured to allow a direct line of sight 16 from the user's first eye to an object 14 in the user's field of view outside first display 10, while display direction 18 is aligned with the user's first eye. For example, head-mountable display device 100 may be configured to allow a direct line of sight 16 over a field of at least 180° (or at least 160° or at least 140°) around first display 10. Head-mountable display device 100 may also be configured to allow a direct line of sight 16 at least below first display 10.

[0015] The mounting structure 20 is configured to secure, fasten, affix, and / or mount the first display 10 to the user's head. The mounting structure 20 may include various structural features to enable secure and stable mounting of the head-mountable display device 100 on the user's head. For example, the mounting structure 20 may include a headband, a head strap, an adjustable frame, and / or a head suspension arrangement configured to distribute the weight of the head-mountable display device 10 across the user's head. The mounting structure 20 may be configured to carry the weight (e.g., the entire weight) of the first display 10. The mounting structure 20 may be configured so that less than 40% (or less than 50%, less than 30%, or less than 20%) of the weight of the head-mountable display device rests on the user's nose, or so that the weight of the head-mountable display device does not rest on the user's nose (e.g., through a nosepiece). By reducing the weight on the user's nose, the wearing comfort of the head-mountable display device 10 can be significantly improved, while still ensuring stability and / or alignment of the head-mountable display device 10 with respect to the eyes. For example, the mounting structure 20 may include an alignment piece (e.g., a nosepiece) configured to control the alignment of the head-mountable display device 10 with respect to the user's head when secured to the user's head. For example, controlling the alignment of the head-mountable display device 10 with respect to the user's eyes via the nosepiece can improve stability and / or reduce misalignment due to movement. The mounting structure 20 may also be configured to allow adjustment of the position of the first display 10 with respect to the user's interpupillary distance. In this manner, the alignment of the first display 10 and the first optical device 30 with respect to the user's eyes can be improved.

[0016] The first optical device 30 may include an optical element (e.g., at least one lens) to magnify the image on the first display 10 for the user. The first optical device 30 may be attached (e.g., glued) to the front of the first display 10. For example, the viewing direction of the first display 10 may be parallel to the optical axis of the first optical device 30. At least one lens of the first optical device 30 may be an aspherical lens. An aspherical lens can reduce size and weight compared to a spherical lens. For example, the first optical device 30 may include at least three lenses. Three lenses can enable good optical performance in terms of magnification and aberration. For example, the first optical device 30 may include at least three aspherical lenses. Three lenses can enable good optical performance in terms of magnification and aberration, while aspherical lenses can reduce size and weight compared to spherical lenses. Additionally or alternatively, the first optical device 30 may be configured to allow adjustment of its diopter. In this way, the user may be able to adapt the device to their individual eye.

[0017] For example, the head-mountable display device 100 may be configured to allow a direct line of sight 16 from the user's first eye to an object 14 in the user's field of view outside the first optical device 30 while the user is viewing the first display 10 through the first optical device 30 when the mounting structure 20 is secured to the user's head. The observation angle between the optical axis of the first optical device 30 and the direct line of sight may be less than 50° (or less than 45° or less than 40°). For example, an observation angle of less than 50° may be measured between the optical axis of the first optical device 30 and the direct line of sight 16.

[0018] The head-mountable display device 100 may further include a second display 40 configured to display a second image of a portion of the object. The second image may be received from a microscope. The first image and / or the second image may be part of a live stream of images from the microscope. The second display 40 may be attached to the mounting structure 20 in the same or similar manner as the first display 10. The second display 40 may be positioned relative to the first display 10 such that a user can view the first display 10 with a first eye and the second display 40 with a second eye. The mounting structure 20 may be configured to secure the second display 40 to the user's head. The first image and / or the second image may be transmitted to the head-mountable display device 100 via a wired or wireless connection.

[0019] The first display 10 and / or the second display 40 may be an LCD display (liquid crystal display), a TFT display (thin film transistor display), or an OLED display (organic light emitting diode display). The display diagonal of the first display 10 and / or the second display 40 may be at least 0.5 inches (or at least 0.6 inches) and / or at most 1 inch (or at most 0.8 inches).

[0020] The use of two independent displays allows the distance between the displays to be adjusted. For example, the mounting structure 20 may be configured to allow adjustment of the distance of the first display 10 relative to the second display 40. In this way, the user can adjust the distance between the two displays to the user's individual interpupillary distance.

[0021] Instead of a second display, a first portion of first display 10 may be configured to display a first image and a second portion of first display 10 to display a second image of a portion of an object. For example, first display 10 may be configured to operate in a split-screen mode, with a first portion of the display showing an image for a first eye of a user and a second portion of the display showing an image for a second eye of the user. Using a single display can reduce the number of components of head-mountable display device 100.

[0022] Regardless of whether two displays or a single display is used, the first image and the second image can be configured to enable stereoscopic viewing, where a user can get a three-dimensional impression of an object or portion of an object when simultaneously viewing the first image with a first eye and the second image with a second eye.

[0023] The object 14 may be a human body, a part of a human body (e.g., a head or chest), a surgical site, or a microelectronic device (e.g., a semiconductor chip). The user may be a surgeon or any other person who requires a magnified image of the object.

[0024] For example, the same object shown on the display may be visible in the peripheral view. For example, the first image may show a portion of the surface of the object, and the surface of the object or another portion of the surface of the object may be within the user's field of view outside the display. For example, the first image may show a portion of the surface of a human brain during surgery, and the surface of the human brain may also be visible to the user in the peripheral view.

[0025] The peripheral view may not be limited to directions outward and downward from head-mountable display device 100. It may also be possible (e.g., with some limitations) to look in upward and inward directions (e.g., toward the nose). For example, this may be possible by positioning the display coaxially with the line of sight of the eyes. Even if the peripheral view performance is not ideal in these additional directions, it may still provide the user with the opportunity to interact with their environment.

[0026] The head-mountable display device 100 may also be referred to as a digital viewer or digital eyepiece. The head-mountable display device 100 may be a device that can be supported on a user's head and has a display for showing images, videos, and / or live streams to the user. The head-mountable display device 100 may include various additional optional components, such as an energy storage device (e.g., one or more power banks) and / or a receiver (e.g., one or more wireless image receivers). For example, the energy storage device may provide a power supply for the first display 10 and / or may be attachable to the wearing structure 20 of the head-mountable display device 100 or may be attachable to a part of the user other than the head (e.g., via a waistband or armband). The receiver may be a wired or wireless receiver. For example, the head-mountable display device 100 may be configured to receive images wirelessly. The receiver may be configured to receive images displayed by the first display 10. Head-mountable display device 100 can be configured so that a weight of up to 600 g (or up to 700 g, or up to 500 g, or up to 400 g) rests on the user's head while using head-mountable display device 100. The total weight of head-mountable display device 100 may be greater, with the remaining weight (e.g., due to the energy storage device and / or receiver) being carried by other parts of the user's body (e.g., via a waistband or armband).

[0027] For example, the latency of the head-mountable display device may be up to 70 ms (or up to 90 ms, up to 60 ms, or up to 50 ms). The latency may be the time between receiving an image at the receiver of head-mountable display device 100 and displaying the image on the first and / or second display. By using high-speed electrical components for the receiver and / or display and / or additional image processing components, head-mountable display device 100 may be able to display a live or real-time image or video stream of at least a portion of object 14.

[0028] The head-mountable display device 100 may be usable with various types of microscopes. The head-mountable display device 100 may be connectable to any microscope using a suitable interface. For example, the microscope 12 may be a digital stereo microscope or a digital microscope with only one camera for visualizing an object in 2D (e.g., the image from only one camera may be duplicated and this unique image may be provided to both displays or to only one channel if only one display is implemented). The microscope is not part of the head-mountable display device 100.

[0029] Further details and aspects of head-mountable display device 100 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 2-11). Head-mountable display device 100 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0030] FIG. 2 shows a schematic diagram of a head-mountable display device 200 with two displays according to one embodiment. The head-mountable display device 200 can be implemented similarly to the implementation described in connection with FIG. 1. The first display 10 and the second display 40 can be attached to a mounting structure 20. The second display 40 can be positioned relative to the first display 10 so that a user can view the first display 10 with a first eye and the second display 40 with a second eye. The first optical device 30 is mounted in front of the first display 10, and the second optical device 50 is mounted in front of the second display 40. The first optical device 30 and the second optical device 50 can comprise one or more optical elements (e.g., lenses). The second optical device 50 can be implemented similarly or equally to the first optical device 30 in terms of the number and type of lenses.

[0031] Further details and aspects of head-mountable display device 200 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIG. 1 or FIGS. 3-11). Head-mountable display device 200 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0032] FIG. 3 illustrates a head-mountable display device 300 that allows for interpupillary distance adjustment according to one embodiment. The head-mountable display device 300 can be implemented similarly to the implementation described in connection with FIG. 2. Additionally, the mounting structure 20 is configured to allow for adjustment of the distance of the first display 10 relative to the second display 40. In this manner, a user can adjust the distance between the two displays to their individual interpupillary distance. Furthermore, the first optical device 30 can be configured to allow for adjustment of its diopter. For example, the distance between one or more optical elements (e.g., lenses) and the display may be adjustable. In this manner, a user may be able to adapt the device to their individual eye.

[0033] Further details and aspects of head-mountable display device 300 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-2 or 4a-11). Head-mountable display device 300 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0034] 4a and 4b illustrate a head-mountable display device 400 according to one embodiment. The head-mountable display device 400 can be implemented similarly to the implementations described in connection with FIG. 1, FIG. 2, or FIG. 3. Additionally, the head-mountable display device 400 is configured to enable at least partial removal of the first display 10 from the user's field of view. For example, the first display 10 may be manually or automatically rotatable or slidable so as to be at least partially out of the user's view. For example, the mounting structure 20 may be configured to automatically remove the first display 10 in response to an identified event (e.g., upon receiving a control signal resulting from user or automatic event detection). FIG. 4a illustrates the head-mountable display device 400 in a first state (e.g., normal use). In the first state, the display direction of the first display 10 and / or the optical axis of the first optical device 30 can be aligned with the user's eye. For example, the optical axis of the first optical device 30 passes through the pupil of the user's eye in the first state. FIG. 4b shows the head-mountable display device 400 in a second state (e.g., a detached state). In the second state, the user can have a direct and / or unobstructed line of sight to an object in the center of the user's field of view. In the second state, the first display 10 and the first optical device 30 are positioned such that the viewing direction of the first display 10 and / or the optical axis of the first optical device 30 are not aligned with the user's eyes. In the second state, the optical axis of the first optical device 30, for example, does not extend to the user's eyes. The mounting structure 20 may include a hinge 28 configured to at least partially remove the first display 10 from the user's field of view, as shown in FIGS. 4a and 4b. The first display 10 can be mechanically connected to the hinge 28. Alternatively or additionally, the mounting structure 20 may include a sliding mechanism configured to at least partially remove the first display 10 from the user's field of view. The first display 10 may be mechanically connected to the sliding mechanism.

[0035] 4a and 4b show an example of a viewer (head-mountable display device) that may include a mechanism for moving the optics out of the user's view. This movement may be accomplished automatically and / or manually and may allow for a change from a digital view to a direct view.

[0036] Further details and aspects of head-mountable display device 400 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-3 or 5a-11). Head-mountable display device 400 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0037] 5a and 5b illustrate a head-mountable display device 500 according to one embodiment. The head-mountable display device 500 can be implemented similarly to the implementation described in connection with FIG. 1. The head-mountable display device 500 enables a direct line of sight from the user's first eye to objects within the user's field of view outside the first display 10 and the first optical device 30 while the user views the first display 10 through the first optical device 30 when the mounting structure 20 is secured to the user's head. The observation angle 17 between the viewing direction 18 and the direct line of sight 16 is at least 43°. Furthermore, the head-mountable display device 500 is configured to enable a direct line of sight 16 over a field of at least 180° around the first display 10.

[0038] Further details and aspects of head-mountable display device 500 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-4b or 5c-11). Head-mountable display device 500 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0039] FIG. 5c illustrates a side view of a head-mountable display device 550 according to one embodiment. The head-mountable display device 550 may be implemented similarly to the implementation described in connection with FIG. 1. The head-mountable display device 550 is configured to be tilted relative to a reference plane 552 of the head-mountable display device 550. In FIG. 5c, the viewing direction 18 of the display and / or the optical axis of the optical device are parallel to the reference plane 552. In FIG. 5d, the viewing direction 18 of the display and / or the optical axis of the optical device are tilted −5° below the reference plane 552. In FIG. 5e, the viewing direction 18 of the display and / or the optical axis of the optical device are tilted +5° above the reference plane 552. For example, the head-mountable display device 550 may be configured to be tilted at least + / −10° and / or at most + / −20° relative to the reference plane 552 of the head-mountable display device 550. The head-mountable display device 550 may include a tilt adjuster 554 for manual adjustment of tilt, positioned between the user's eyes on the side of the display opposite the optical device.

[0040] Further details and aspects of head-mountable display device 550 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-5b or 5f-11). Head-mountable display device 550 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0041] FIG. 5f illustrates a side view of a head-mountable display device 590 according to one embodiment. The head-mountable display device 590 may be implemented similarly to the implementation described in connection with FIG. 1. The head-mountable display device 590 is configured to allow adjustment of the distance between the optical device and the user's eye. In FIG. 5f, a distance offset 596 relative to a reference distance 592 between the optical device and the user's eye is 0. In FIG. 5g, a distance offset 596 relative to a reference distance 592 between the optical device and the user's eye is +6 mm. In FIG. 5h, a distance offset 596 relative to a reference distance 592 between the optical device and the user's eye is −6 mm. For example, the head-mountable display device 590 may be configured to allow adjustment of the offset distance 596 of at least + / −10 mm and / or at most + / −15 mm relative to the reference distance 592. The head-mountable display device 590 may include a distance adjuster 594 for manual adjustment of the distance. The distance adjuster 594 may be placed between the user's eyes, on the side of the display opposite the optical device.

[0042] The head-mountable display device 590 may further include a tilt adjuster 554 for manual adjustment of tilt, as described in connection with Figures 5c-5e. For example, the tilt adjuster 554 and the distance adjuster 594 may be rotatable about a mutual axis, but the tilt and distance may be independently adjustable. The distance adjuster 594 may be disposed between the tilt adjuster 554 and the display.

[0043] Further details and aspects of head-mountable display device 590 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-5e or 6-11). Head-mountable display device 590 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0044] Figure 6 is an example of a possible user view for one of the head-mountable display devices described above or below. Figure 6 shows an example of a left channel image 610 on a first display 10, a right channel image 620 on a second display 40, and a peripheral view 630 of an unobstructed surgical site on a human brain.

[0045] FIG. 7 illustrates a head-mountable display device 700 and a microscope system 790 according to one embodiment. The head-mountable display device 700 may be implemented similarly to the implementations described in connection with FIGS. 1, 2, 3, 4a, 4b, 5a, and / or 5b. The head-mountable display device 700 includes a power bank 710 and a wireless image receiver 720 for the first display 10 and a power bank 710 and a wireless image receiver 720 for the second display 40. Alternatively, the first display 10 and the second display 40 may be powered by a common power bank 710 and / or may have images received by a common wireless image receiver 720. The microscope system 790 may include a digital microscope 792 with one or more cameras controlled by one or more camera controllers 794, which in turn include one or more wireless image transmitters 796.

[0046] Further details and aspects of head-mountable display device 700 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-6 or 8-11). Head-mountable display device 700 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0047] 8 illustrates a head-mountable display device for displaying an image received from a microscope, according to one embodiment. The head-mountable display device 800 includes a first display 10 configured to display a first image of a portion of an object, the first image being received from the microscope. The head-mountable display device 800 further includes a mounting structure 20 configured to secure the first display 10 to a user's head. The mounting structure 20 includes a nosepiece 25 configured to align the first display 10 with the user's first eye. The mounting structure 20 is further configured such that less than 40% (or less than 50%, less than 30%, or less than 20%) of the weight of the head-mountable display device rests on the user's nose via the nosepiece 25.

[0048] Nosepiece 25 can be configured (e.g., can include such a geometric shape) to contact the user's nose at least one point to the left of the nose and at least one point to the right of the nose when mounting structure 20 is secured to the user's head. In this way, movement of head-mountable display device 800 to the right or left relative to the nose can be significantly reduced or avoided when the user moves their head.

[0049] For example, the head-mountable display device 800 is configured to place a weight of up to 250g (or up to 200g, or up to 150g, or up to 100g) on ​​the user's nose while the head-mountable display device 800 is in use.

[0050] For example, while a user is using the head-mountable display device, at least 10% (or at least 20% or at least 30%) of the weight of the head-mountable display device may rest on the user's nose through nosepiece 25. In this way, stable alignment can be ensured.

[0051] Further details and aspects of head-mountable display device 800 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-7 or 9-11). Head-mountable display device 800 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0052] 9 shows a head-mountable display device for displaying an image received from a microscope. The head-mountable display device 900 includes a first display 10 configured to display a first image of a portion of an object, the first image being received from the microscope. The head-mountable display device 900 further includes a mounting structure 20 configured to secure the first display to a user's head. Additionally, the head-mountable display device 900 includes a first optical device 30 located in front of the first display 10. The first optical device 30 includes three lenses 32, 34, and 36. At least one of the three lenses 32, 34, and 36 is an aspherical lens.

[0053] By using at least three lenses between the display and the user's eye, good optical performance can be achieved in terms of magnification and aberrations. By using at least one aspherical lens, the size and weight of the optical system can be significantly reduced compared to systems using only spherical lenses.

[0054] For example, the first optical device 30 includes a first lens 32, a second lens 34, and a third lens 36. The first lens 32 may be the closest of the three lenses to the first display 10. The second lens 34 may be located between the first lens 32 and the third lens 36. The first optical device 30 may include exactly three lenses, or may include more than three lenses. The three lenses may be glass lenses or may be made of other suitable materials.

[0055] The aspherical lens of the three lenses can be the first, second, or third lens. For example, the second lens 34 can be an aspherical lens, and the first lens 32 and the third lens can be spherical lenses. Alternatively, all three lenses can be aspherical lenses. In this way, the size and weight of the first optical device 30 can be kept small.

[0056] For example, each of the three lenses may have a first surface and a second surface. The surfaces of the three lenses may represent or form a series of surfaces. For example, the first surface of the first aspherical lens may be a first spherical surface, the second surface of the first aspherical lens may be a first aspherical surface, the first surface of the second aspherical lens may be a second spherical surface, the second surface of the second aspherical lens may be a second aspherical surface, the first surface of the third aspherical lens may be a third spherical surface, and the second surface of the third aspherical lens may be a third aspherical surface. The series of surfaces may include a first spherical surface, followed by a first aspherical surface, followed by a second spherical surface, followed by a second aspherical surface, followed by a third spherical surface, followed by a third aspherical surface. For example, the series of surfaces does not include a diffractive surface. The optical path through optical device 30 may not include any diffractive surfaces.

[0057] For example, each lens of three lenses includes a different glass material. Three different glass materials can be used for the three lenses. For example, the first lens can include or consist of a first glass material, the second lens can include or consist of a second glass material, and the third lens can include or consist of a third glass material. For example, the first glass material, the second glass material, and the third glass material are three different glass materials.

[0058] For example, the first lens 32 may be a positive lens and / or an aspherical lens. The focal length of the first lens 32 may be at most 25 mm (or at most 20 mm or at most 30 mm) and / or at least 15 mm (or at least 10 mm or at least 20 mm).

[0059] For example, the second lens 34 may be a negative lens and / or an aspheric lens. The focal length of the second lens 34 may be at most −15 mm (or at most −20 mm or at most −13 mm) and / or at least −5 mm (or at least −10 mm or at least −3 mm).

[0060] For example, the third lens 36 may be a positive lens and / or an aspherical lens. The focal length of the third lens 36 may be at most 20 mm (or at most 25 mm or at most 17 mm) and / or at least 10 mm (or at least 13 mm or at least 7 mm).

[0061] By using one or more of the above parameters, a desired viewing angle, overall size, weight and / or exit pupil size can be obtained.

[0062] For example, one or more of the three aspherical lenses may be freeform lenses, which may further reduce size and weight, but may increase costs.

[0063] The total weight of the three lenses (e.g., the first lens 32, the second lens 34, and the third lens 36) may be up to 30 g (or up to 25 g, up to 20 g, or up to 35 g). The diameter of each of the three lenses (e.g., the first lens 32, the second lens 34, and the third lens 36) may be up to 25 mm (or up to 20 mm, or up to 30 mm). The total focal length of the first optical device 30 may be up to 30 mm (or up to 35 mm, or up to 25 mm) and / or at least 15 mm (or at least 10 mm, or at least 20 mm). The total optimal distance between the first display 10 and the user's eyes created by the first optical device 30 may be up to 60 mm (or up to 70 mm, up to 55 mm, or up to 50 mm). By implementing the first optical device 30 using one or more of the mentioned parameters, the size and / or weight of the first optical device 30 and the head-mountable display device 900 can be kept small.

[0064] The display diagonal of the first display 10 may be at least 0.5 inches (or at least 0.6 inches) and / or at most 1 inch (or at most 0.8 inches). In this way, a sufficiently large image can be displayed while keeping the weight low.

[0065] The head-mountable display device 900 may include a second display and second optical arrangement, as described in connection with some other examples.

[0066] Further details and aspects of head-mountable display device 900 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-8 or 10-11). Head-mountable display device 900 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0067] FIG. 10 illustrates an optical apparatus 1000 for a head-mountable display device according to one embodiment. The optical apparatus 1000 can be implemented similarly to the first optical apparatus implementation described in connection with FIG. 1 and / or FIG. 9. The optical apparatus 1000 includes three aspheric lenses. The first lens 32 is a positive lens, the second lens 34 is a negative lens, and the third lens 36 is a positive lens. The total focal length of the optical apparatus 1000 is at most 30 mm and at least 15 mm. The focal length of the first lens 32 is at most 25 mm and at least 15 mm, the focal length of the second lens 34 is at most −15 mm and at least −5 mm, and the focal length of the third lens 36 is at most 20 mm and at least 10 mm. The total weight of the three lenses 32, 34, and 36 is at most 30 g. The diameter of each of the three lenses 32, 34, 36 is at most 25 mm. The total optimal distance between the first display 10 and the user's eyes created by the optical device 1000 is at most 60 mm.

[0068] The optical device 1000 shown in FIG. 10 can be used as the first optical device and / or the second optical device of one of the head-mountable display devices described above or below.

[0069] Further details and aspects of optical device 1000 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-9 or 11). Optical device 1000 may include one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0070] FIG. 11 shows a flowchart of a method for displaying an image received from a microscope, according to one embodiment. Method 1100 includes receiving a first image of a portion of an object from the microscope (1110) and displaying the first image on a first display of a head-mountable display device secured to a user's head by a mounting structure of the head-mountable display device (1120). The head-mountable display device is configured to enable a direct line of sight from the user's first eye to an object within the user's field of view outside the first display while the user views the first display through a first optical device when the head-mountable display device is secured to the user's head by the mounting structure. Furthermore, the angle between the viewing direction and the direct line of sight is less than 50°. Additionally, the viewing direction is orthogonal to the first display, and the first optical device is located in front of the first display and includes at least one lens.

[0071] Further details and aspects of method 1100 are described in relation to the proposed concept and / or one or more examples described above or below (e.g., FIGS. 1-10). Method 1100 may comprise one or more additional optional features corresponding to one or more aspects of the proposed concept and / or one or more aspects of one or more examples described above or below.

[0072] Some embodiments relate to a head-mounted device for live digital visualization of images from a digital microscope and / or a head-mounted digital viewer or digital eyepiece according to one of the examples described above. Compared to systems that completely surround the user and obscure the user's peripheral view with goggles, the proposed system allows, for example, an unobstructed peripheral view. Furthermore, compared to systems with heavy digital viewers, the proposed system can improve stability and maintain alignment of each eye in front of each channel. The digital viewer may have two separate channels, one for each eye. Each channel may comprise one or more optical elements and a display (see, for example, FIG. 2).

[0073] The optics may be used to magnify the view of the display, allowing for stereoscopic viewing of the image transmitted by the digital microscope. The optics may be designed to be lightweight (e.g., to avoid head / muscle pain from the device being worn on the head), compact, and may allow an unobstructed peripheral view for the user (e.g., to allow the surgeon to see tools, hands, and assistants as needed, for example), as shown in FIG.

[0074] The mechanism can be designed to be lightweight, compact, and ergonomic to allow for an unobstructed peripheral view. Cables for image transmission and power supply can be handled by the mechanism. The digital viewer can be powered and can receive images wirelessly. For example, the digital viewer can use a power bank and an image transmission dongle.

[0075] The digital viewer may be worn on the user's head or body, and may be positioned, for example, by a resting portion placed on the nose to align the two optical channels with both eyes. The geometry of the digital viewer is based on the central portion of many eyeglasses, and together with a head strap, can provide the necessary stability of the display module for each eye. This resting concept (e.g., orientation controlled on the nose and fixation by a strap on the head) overcomes the drawbacks of pure goggles or pure head-mounted solutions.

[0076] The entire viewer can be held in place by a strap around the head or an adjustable frame. Mechanisms can be designed to fit individual head geometries through one or more adjustment options and may include mechanisms for moving the optics out of the user's view.

[0077] The proposed head-mountable display device may allow for independent adaptation of two digital channels to accommodate diopter misalignment and interpupillary distance, simultaneous live display of microscopic and peripheral views, change from digital to direct view, positioning of the digital viewer using a combination of rest pads on the nose and stripes on the head, and / or wireless connectivity and mobile power support.

[0078] For example, to obtain a stereoscopic impression using a visual microscope, both visual channels must be adjusted so that the exit pupils of the individual eyepieces are aligned with the pupils of the human eye. This can be achieved by adjusting the interpupillary distance (IPD). Compared to a pure visual microscope, the optical system of a digital viewer can provide images outside its designed exit pupil. The best position for the human eye may be the central axis of the individual eyepieces. If the eyes are not positioned in an ideal lateral position, the optical performance of the system may be impaired even if the IPDs are correctly adjusted. This can result in various aberrations in the image, to the point where the ability to generate a stereoscopic impression is lost. The proposed optical system design can prevent this risk through various measures (e.g., the number and shape of lenses).

[0079] The optical design with three aspherical lenses can be selected to optimize the size and weight of the optical module. For example, an infinity element can be used to comfortably view the display at the desired magnification in a compact manner with the possibility of using diopter adjustment and glasses. For example, three lenses can be used that result in a total length (distance to the eye) of less than 60 mm.

[0080] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0081] While some aspects have been described in the context of an apparatus, it will be apparent that these aspects also represent a description of a corresponding method, where a block or apparatus corresponds to a step or feature of a step, and similarly, aspects described in the context of a step also represent a description of a corresponding block or item or feature of a corresponding apparatus. [Explanation of symbols]

[0082] 10 First Display 12. Microscope 14 Object 16 Direct line of sight 17 Observation angle 18 Display direction 20 Mounting structure 25 Nosepiece 28 Hinge 30 First optical device 32 First Lens 34 Second Lens 36 The Third Lens 40 Second Display 50 Second optical device 100 Head-mountable display device 200 Head-Mountable Display Device 300 Head-Mountable Display Device 310 Interpupillary distance adjustment 320 Diopter Adjustment 400 Head-Mountable Display Device 500 Head-Mountable Display Device 550 Head-Mountable Display Device 552 Reference plane 554 Tilt Adjuster 590 Head-Mountable Display Device 592 Reference Distance 594 Distance Adjuster 596 Distance Offset 610 Left Channel 620 Right Channel 630 Unobstructed Peripheral View 700 Head-Mountable Display Device 702 Supply Unit 710 Energy Storage Devices 720 Wireless Image Receiver 790 Microscope System 792 Digital Microscope 794 Camera Controller 796 Wireless Image Transmitter 800 Head-Mountable Display Device 900 Head-Mountable Display Device 1000 optical equipment 1100 Method for displaying images received from a microscope 1110 Receive the first image 1120 Display the first image

Claims

1. A head-mountable display device (100, 200, 300, 400, 500, 550, 590, 700) for displaying an image received from a microscope (12), said head-mountable display device comprising: a first display (10) configured to display a first image of a portion of an object (14) received from the microscope (12); a first optical device (30) located in front of the first display (10) and comprising at least one lens (32); a mounting structure (20) configured to secure the first display (10) to a user's head; Equipped with the head-mountable display device is configured to enable a direct line of sight (16) from the user's first eye to the object (14) in the user's field of view outside the first display (10) while the user is viewing the first display (10) through the first optical device (30) when the mounting structure (20) is secured to the user's head, an angle between a viewing direction (18) and the direct line of sight (16) is less than 50°, the viewing direction (18) is perpendicular to the first display (10), and the head-mountable display device is configured to enable the direct line of sight (16) over a field of at least 180° around the first display (10); the direct line of sight (16) is a straight line between the first eye of the user and the object (14) without any structure therebetween; The first optical device (30) comprises at least three lenses; each of the three lenses comprising a different glass material; Head-mountable display device.

2. The first optical device (30) comprises at least three aspherical lenses. The head-mountable display device of claim 1 .

3. A head-mountable display device (100, 200, 300, 400, 500, 550, 590, 700) for displaying an image received from a microscope (12), said head-mountable display device comprising: a first display (10) configured to display a first image of a portion of an object (14) received from the microscope (12); a first optical device (30) located in front of the first display (10) and comprising at least one lens (32); a mounting structure (20) configured to secure the first display (10) to a user's head; a tilt mechanism located on a side of the first display (10) opposite to the side of the first optical device (30) for tilting the head-mountable display device relative to a reference plane (552) of the head-mountable display device; Equipped with the head-mountable display device is configured to enable a direct line of sight (16) from the user's first eye to the object (14) in the user's field of view outside the first display (10) while the user is viewing the first display (10) through the first optical device (30) when the mounting structure (20) is secured to the user's head, an angle between a viewing direction (18) and the direct line of sight (16) is less than 50°, the viewing direction (18) is perpendicular to the first display (10), and the head-mountable display device is configured to enable the direct line of sight (16) over a field of at least 180° around the first display (10); The direct line of sight (16) is a straight line between the first eye of the user and the object (14) without any structure therebetween. Head-mountable display device.

4. The first optical device (30) is configured to allow adjustment of its diopter. A head-mountable display device according to any one of claims 1 to 3.

5. the head-mountable display device is configured to receive the image wirelessly; A head-mountable display device according to any one of claims 1 to 4.

6. the head-mountable display device a second display (40) configured to display a second image of the portion of the object received from the microscope; The mounting structure (20) is further configured to secure the second display (40) to the head of the user. A head-mountable display device according to any one of claims 1 to 5.

7. The mounting structure (20) is further configured to allow adjustment of the distance of the first display (10) relative to the second display (40).

7. The head-mountable display device of claim 6.

8. a first portion of the first display (10) configured to display the first image; a second portion of the first display (10) configured to display a second image of the portion of the object received from the microscope; A head-mountable display device according to any one of claims 1 to 5.

9. the first image and the second image are configured to enable stereoscopic viewing. A head-mountable display device according to any one of claims 6 to 8.

10. the mounting structure (20) comprising an alignment component configured to control alignment of the head-mountable display device relative to the user when secured to the head of the user; A head-mountable display device according to any one of claims 1 to 9.

11. the alignment component being a nosepiece (25) configured to align the first display (10) with the first eye of the user; The head-mountable display device of claim 10.

12. The mounting structure (20) is configured so that less than 40% of the weight of the head-mountable display device rests on the user's nose. A head-mountable display device according to any one of claims 1 to 11.

13. The mounting structure (20) is configured to support the weight of the first display (10). A head-mountable display device according to any one of claims 1 to 12.

14. The wearing structure (20) comprises a headband. A head-mountable display device according to any one of claims 1 to 13.

15. the head-mountable display device further comprising an energy storage device (710) configured to provide a power source for the first display (10); A head-mountable display device according to any one of claims 1 to 14.

16. the energy storage device (710) is attachable to a part of the user excluding the head; 16. The head-mountable display device of claim 15.

17. The mounting structure (20) is further configured to allow the first display (10) to be at least partially removed from the user's field of view. A head-mountable display device according to any one of claims 1 to 16.

18. The mounting structure (20) is configured to automatically detach the first display (10) in response to an identified event.

18. The head-mountable display device of claim 17.

19. The mounting structure (20) further comprises a hinge (28) configured to at least partially remove the first display (10) from the user's field of view, the first display (10) being mechanically connected to the hinge (28). A head-mountable display device according to claim 17 or 18.

20. the mounting structure (20) is configured to allow adjustment of the position of the first display (10) relative to the interpupillary distance of the user; A head-mountable display device according to any one of claims 1 to 19.

21. the head-mountable display device is configured to enable the direct line of sight (16) while the display direction is aligned with the first eye. A head-mountable display device according to any one of claims 1 to 20.

22. A head-mountable display device (900) for displaying an image received from a microscope, said head-mountable display device comprising: a first display (10) configured to display a first image of a portion of the object received from the microscope; a mounting structure (20) configured to secure the first display (10) to a user's head; a first optical device (30) located in front of the first display (10); The first optical device (30) includes three lenses including a first aspherical lens (32), a second aspherical lens (34), and a third aspherical lens (36), the first aspherical lens (32) being the closest of the three lenses to the first display (10), the second aspherical lens (34) being disposed between the first aspherical lens (32) and the third aspherical lens (36), each of the three lenses including a first surface and a second surface, and the three lenses including a first aspherical lens (32), a second aspherical lens (34), and a third aspherical lens (36). the surfaces of the three lenses represent a series of surfaces including a first spherical surface followed by a first aspherical surface followed by a second spherical surface followed by a second aspherical surface followed by a third spherical surface followed by a third aspherical surface, the focal length of the first lens (32) being at most 25 mm and at least 15 mm, the focal length of the second lens (34) being at most -15 mm and at least -5 mm, and the focal length of the third lens (36) being at most 20 mm and at least 10 mm; Head-mountable display device.

23. the set of surfaces does not include a diffractive surface; 23. The head-mountable display device of claim 22.

24. each of the three lenses comprising a different glass material; 24. A head-mountable display device according to claim 22 or 23.

25. The total focal length of the first optical device (30) is at most 30 mm and at least 15 mm.

25. A head-mountable display device according to any one of claims 22 to 24.

26. The first lens (32) is at least one of a positive lens.

26. A head-mountable display device according to any one of claims 22 to 25.

27. The second lens (34) is at least one of a negative lens.

27. A head-mountable display device according to any one of claims 22 to 26.

28. The third lens (36) is at least one of a positive lens.

28. A head-mountable display device according to any one of claims 22 to 27.

29. The total weight of the three lenses (32, 34, 36) is a maximum of 30 g.

29. A head-mountable display device according to any one of claims 22 to 28.

30. The diameter of each of the three lenses (32, 34, 36) is a maximum of 25 mm.

30. A head-mountable display device according to any one of claims 22 to 29.

31. the total optimal distance between the first display (10) and the user's eyes caused by the first optical device (30) is at most 60 mm; A head-mountable display device according to any one of claims 22 to 30.

32. The display diagonal of the first display (10) is at least 0.5 inches and at most 1 inch; A head-mountable display device according to any one of claims 1 to 31.

33. 1. A method (1100) for displaying an image received from a microscope, the method comprising: receiving 1110 a first image of a portion of an object from a microscope; displaying (1120) the first image on a first display (10) of a head-mountable display device fixed to a user's head by a mounting structure of the head-mountable display device; the head-mountable display device is configured to enable a direct line of sight (16) from a first eye of the user to an object in the user's field of view outside the first display (10) while the user is viewing the first display (10) through a first optical device (30) when the head-mountable display device is secured to the user's head by a mounting structure, wherein an angle between a viewing direction and the direct line of sight (16) is less than 50°, and the viewing direction is perpendicular to the first display (10), the first optical device (30) is located in front of the first display (10) and comprises at least one lens; the head-mountable display device is configured to enable the direct line of sight (16) over a field of at least 180° around the first display (10); the direct line of sight (16) is a straight line between the first eye of the user and the object (14) without any structure therebetween; The first optical device (30) comprises at least three lenses; each of the three lenses comprising a different glass material; method.

34. 1. A method (1100) for displaying an image received from a microscope, the method comprising: receiving 1110 a first image of a portion of an object from a microscope; displaying (1120) the first image on a first display (10) of a head-mountable display device fixed to a user's head by a mounting structure of the head-mountable display device; the head-mountable display device is configured to enable a direct line of sight (16) from a first eye of the user to an object in the user's field of view outside the first display (10) while the user is viewing the first display (10) through a first optical device (30) when the head-mountable display device is secured to the user's head by a mounting structure, wherein an angle between a viewing direction and the direct line of sight (16) is less than 50°, and the viewing direction is perpendicular to the first display (10), the first optical device (30) is located in front of the first display (10) and comprises at least one lens; the head-mountable display device is configured to enable the direct line of sight (16) over a field of at least 180° around the first display (10); the direct line of sight (16) is a straight line between the first eye of the user and the object (14) without any structure therebetween; the head-mountable display device is configured to tilt the head-mountable display device relative to a reference plane (552) of the head-mountable display device. method.

Images