Image correction, display, and visualization using augmented reality and virtual reality eyewear.
The display system enhances AR experiences by integrating virtual content with the real world through a head-mounted display that adjusts image characteristics based on user attention and focus, addressing the challenge of seamless AR integration.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- MAGIC LEAP INC
- Filing Date
- 2024-08-09
- Publication Date
- 2026-06-01
AI Technical Summary
Existing augmented reality (AR) technologies face challenges in providing a comfortable, natural, and rich presentation of virtual image elements among real-world image elements, as they often fail to seamlessly integrate virtual content with the user's environment.
A display system that projects light onto a user's eyes, featuring a head-mounted display with a transparent portion to view the environment, equipped with environmental sensors and a processing electronic device that alters the perception of real or virtual objects based on user attention, focus, and intent, modifying image content such as contrast, opacity, and location.
Enhances the integration of virtual content with the real world by adjusting image characteristics like contrast, opacity, and location, providing a more immersive and less distracting AR experience.
Smart Images

Figure 0007868106000001 
Figure 0007868106000002 
Figure 0007868106000003
Abstract
Description
[Technical Field]
[0001] (Claiming priority) This application claims priority under 35 U.S.C. 119(e) to U.S. Provisional Application No. 62 / 366,599 filed July 25, 2016, U.S. Provisional Application No. 62 / 396,071 filed September 16, 2016, and U.S. Provisional Application No. 62 / 440,332 filed December 29, 2016. The full disclosure of each of these priority documents is incorporated herein by reference.
[0002] (References provided) This application is, By reference, the entirety of U.S. Provisional Application No. 62 / 366,555 filed on 25 July 2016, U.S. Provisional Application No. 62 / 352,539 filed on 20 July 2016, U.S. Provisional Application No. 62 / 333,734 filed on 9 May 2016, U.S. Application No. 14 / 212,961 filed on 14 March 2014, U.S. Application No. 14 / 331,218 filed on 14 July 2014, U.S. Application No. 15 / 072,290 filed on 16 March 2016, and U.S. Provisional Application No. 62 / 294,147 filed on 11 February 2016 are incorporated herein by reference.
[0003] This disclosure relates to a display system, and more specifically, to an augmented reality display system. [Background technology]
[0004] Modern computing and display technologies are driving the development of systems for so-called "virtual reality" or "augmented reality" experiences, where digitally reproduced images or parts thereof are presented to the user in a manner that appears to be real, or can be perceived as such. Virtual reality or "VR" scenarios typically involve the presentation of digital or virtual image information without transparency to other real-world visual inputs, while augmented reality or "AR" scenarios typically involve the presentation of digital or virtual image information as an extension to the visualization of the real world around the user. Mixed reality or "MR" scenarios are a type of AR scenario that typically involves virtual objects integrated into and responding to the natural world. For example, in an MR scenario, AR image content may appear blocked by or perceive as interacting with objects in the real world in a different way.
[0005] Referring to Figure 1A, Augmented Reality Scene 1 is depicted, and the user of AR technology sees a real-world park-like setting 1100 featuring people, trees, buildings in the background, and a concrete platform 1120. In addition to these items, the user of AR technology also perceives "virtual content" such as a robotic figure 1110 standing on the real-world platform 1120 and a flying cartoon-like avatar character 1130 that looks like an anthropomorphic bumblebee, even though these elements 1130, 1110 do not exist in the real world. The human visual perception system is complex, and producing AR technology that facilitates a comfortable, natural, and rich presentation of virtual image elements among other virtual or real-world image elements is difficult.
[0006] The systems and methods disclosed herein address various challenges related to AR or VR technologies. [Overview of the project] [Means for solving the problem]
[0007] This disclosure provides various embodiments of a display system. Such embodiments include, but are not limited to, the following embodiments.
[0008] 1. A display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes and display augmented reality image content within the user's field of view at different divergent amounts as if projected from different distances from the user's eyes, and at least a portion of the display is transparent so that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes and provides a view of that portion of the environment in front of the user, and the head-mounted display is positioned in front of the user's eyes when the user wears the head-mounted display, One or more environmental sensors configured to sense the user's surroundings, A processing electronic device that communicates with a display and one or more environmental sensors, It detects situations accompanied by increased user attention, At least partially, it alters the user's perception of real or virtual objects within the user's field of view based on increased focus perception. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 2. The display system according to Embodiment 1, wherein the processing electronic device is configured to modify the user's perception of virtual objects within the user's field of view by modifying image content that includes objects. 3. The display system according to Embodiment 1 or 2, wherein the processing electronic device is configured to modify the user perception of an object by moving the object from a first location to a second location. 4. The display system according to Embodiment 3, wherein the first location is a peripheral area and the second location is a central area, or the first location is a central area and the second location is a peripheral area. 5. A display system according to any of Examples 2-4, wherein modifying the image content includes modifying at least one of the contrast, opacity, color, color saturation, color balance, size, brightness, border, or sharpness of the image content that includes an object. 6. A display system according to any of Examples 1-5, further configured to provide alerts to the user. 7. The display system according to Example 6, wherein the alert is a visual or auditory alert. 8. One or more environmental sensors comprising a depth sensor, a pair of binocular world cameras, a geolocation sensor, a proximity sensor, or GPS, as described in any of Examples 1-7. 9. A display system according to any of Examples 1-8, further comprising one or more user sensors configured to sense a user, wherein the processing electronic device communicates with the one or more user sensors. 10. The display system according to Embodiment 9, comprising one or more user sensors and one or more cameras. 11. A head-mounted display system according to any of Examples 1-10, comprising a waveguide having a diffractive optical element configured to output light by extracting light from the waveguide, wherein the waveguide is one of a stack of waveguides, and different waveguides in the stack of waveguides are configured to output light with different wavefront divergences. 12. The display system according to any one of Examples 1-11, wherein the processing electronic equipment is further configured to determine the user's intent to a situation and, at least in part, modify the user's perception of real or virtual objects within the user's field of view based on the determined intent. 13. The display system according to any of Examples 1-12, wherein the processing electronic equipment is further configured to determine the user's intent to a situation and to modify the user's perception of real or virtual objects within the user's field of view, at least in part, based on the perception of increased focus. 14. The display system according to any one of Examples 1-13, comprising a sensor configured to detect a wireless signal. 15. A display system according to any one of Examples 1-14, comprising a sensor configured to detect Bluetooth® signals from an automobile. 16. The situation involving increased user attention is the display system according to any of Examples 1-15, which includes driving an automated vehicle. 17. The display system according to Embodiment 16, wherein the processing electronic device is configured, at least in part, to modify the user's perception of real or virtual objects within the user's field of view based on one or more data records relating to the user, the one or more data records including the user's driving records. 18. A display system according to any of Examples 1-17, wherein the processing electronic device is configured to alter the user's perception of real or virtual objects within the user's field of view by altering the background. 19. The display system according to Example 18, wherein modifying the background increases the homogeneity of the background and thereby reduces visible features within the background. 20. The display system according to Example 19, wherein increasing the homogeneity of the background includes washing out or painting over features within the background. 21. A display system according to any of Examples 18-20, wherein the processing electronic equipment is configured to modify the background by increasing the intensity of light in the background so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 22. A display system according to any of Examples 1-21, wherein the processing electronics are configured to increase the light intensity so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 23. A display system according to any of Examples 1-22, which modifies the user's perception of objects within the user's field of view, including highlighting objects. 24. Highlighting an object includes superimposing a partially transparent color over the object, as described in Example 23. 25. A display system according to any of Examples 1-24, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 26. A display system according to any one of Examples 1-25, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 27. The display system according to Embodiment 25, wherein one or more light sources are configured to direct light into one or more waveguides. 28. The display system according to any one of Examples 25-27, wherein the light source comprises a fiber scanning projector. 29. The display system according to any one of Examples 1-28, wherein the one or more environmental sensors comprises one or more outward-facing image acquisition systems configured to form an image of the environment. 30. The display system according to Examples 1-29, wherein the environmental sensor comprises one or more outward-facing cameras. 31. A display system according to any of Examples 1-30, comprising one or more environmental sensors and a distance measuring system. 32. The distance measuring system is the display system according to Embodiment 31, comprising a laser rangefinder. 33. The display system according to any one of Examples 1-32, further comprising an eye-tracking system configured to track the position and / or movement of the user's eyes. 34. The display system according to any one of Examples 1-33, further comprising one or more inward-facing image acquisition systems configured to form an image of the user's eye. 35. The display system according to any one of Examples 1-34, wherein the head-mounted display system is configured to process image content presented in at least a first portion of the user's field of view differently from image content presented in a second portion of the user's field of view. 36. The display system according to any one of Examples 1 to 35, wherein the head-mounted display system is configured to process image content presented in at least a portion of the peripheral region of the user's field of view differently from image content presented in the central region of the user's field of view. 37. A display system according to any of Examples 1-37, wherein modifying the user perception includes augmenting or de-emphasizing. 38. The display system according to Example 37, wherein the enhancement provided by the processing electronic device includes enlarging the image content. 39. The display system according to any of Examples 37-38, wherein the enhancement or de-enhancement provided by the processing electronic device includes modifying brightness. 40. The enhancement provided by the processing electronic device includes increasing brightness, as described in any of Examples 37-39, for the display system. 41. The display system according to any one of Examples 37-40, wherein the de-emphasis provided by the processing electronic device includes reducing brightness. 42. The display system according to any one of Examples 37-41, wherein the de-emphasis provided by the processing electronic device includes increasing brightness. 43. The display system according to any of Examples 37-42, wherein the enhancement or de-enhancement provided by the processing electronic device includes modifying the contrast. 44. The enhancement provided by the processing electronic device includes increasing contrast, as described in any of Examples 37-43, for the display system. 45. A display system according to any one of Examples 37-44, wherein the de-enhancement provided by the processing electronic device includes reducing contrast. 46. The display system according to any of Examples 37-45, wherein the enhancement or deenhancement provided by the processing electronic device includes modifying color saturation. 47. The enhancement provided by the processing electronic device includes increasing color saturation, as described in any of Examples 37-46, for the display system. 48. A display system according to any one of Examples 37-47, wherein the de-enhancement provided by the processing electronic device includes reducing color saturation. 49. The display system according to any of Examples 37-48, wherein the enhancement or de-enhancement provided by the processing electronic device includes modifying sharpness. 50. The display system according to any of Examples 37-49, wherein the enhancement provided by the processing electronic device includes increasing clarity. 51. A display system according to any one of Examples 37-50, wherein the de-enhancement provided by the processing electronic device includes reducing sharpness. 52. The display system according to any of Examples 37-51, wherein the enhancement or de-enhancement provided by the processing electronic device includes altering the opacity. 53. The enhancement provided by the processing electronic device includes increasing opacity, as described in any of Examples 37-52, for the display system. 54. A display system according to any one of Examples 37-53, wherein the de-emphasis provided by the processing electronic device includes reducing opacity. 55. A display system according to any one of Examples 37-54, wherein the de-emphasis provided by the processing electronic device includes increasing opacity. 56. Enhancement is a display system according to any of Examples 37-55, comprising edge enhancement features. 57. A display system according to any of Examples 37-56, wherein the enhancement or de-enhancement provided by the processing electronic device includes shifting the color balance.
[0009] 1. A display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display being transparent so as to transmit light from a portion of the environment in front of the user and the head-mounted display to the user's eyes and provide a view of that portion of the environment in front of the user and the head-mounted display, and positioned in front of the user's eyes when the user wears the head-mounted display system, One or more outward-facing cameras configured to image objects in the user's environment, One or more eye-tracking sensors configured to determine where the user's eyes are looking, A processing electronic device that communicates with the display, the outward-facing camera, and the eye-tracking sensor, and controls the presentation of image content on the display, Display the image content within the user's field of view, Determine the object that the eye is pointing at, To perform at least one of the following: enhance the rendering of the object the eye is pointing to, or de-emphasize one or more features surrounding the object the eye is pointing to. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 2. The display system according to Example 1, wherein the processing electronic equipment is configured to display objects on the display and enhance the rendering of the objects. 3. The display system according to Embodiment 1 or 2, wherein the processing electronic device is configured to display on the display one or more features surrounding an object, and to de-emphasize the one or more features surrounding an object to which the eye is directed, as rendered on the display. 4. The display system according to any one of Examples 1-3, wherein the one or more features surrounding an object are real features in the environment in front of the user and the head-mounted display system, and the processing electronics are configured to de-emphasize the one or more real features surrounding the object that the eye is directed at. 5. The display system according to Embodiment 4, wherein the processing electronic equipment is configured to de-emphasize one or more real features surrounding an object directed at by the eye by increasing the intensity of light directed into the eye, so that one or more real features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 6. A display system according to any one of Examples 1-4, wherein the processing electronics are configured to increase the intensity of light projected into the eye so that features in the environment in front of the user and the head-mounted display are less noticeable to the user. 7. The display system according to any one of Examples 1-6, wherein the de-emphasis includes, or exceeds, a reduction in the brightness, visibility, sharpness, or contrast of the view of the environment through the transparent portion, or a modification of the colors of the environment through the transparent portion. 8. The display system according to any one of Examples 1-7, wherein the processing electronic equipment is configured to increase the intensity of light projected into the eye so that features in the environment in front of the user and the head-mounted display are less noticeable to the user, other than by displaying an image on the display. 9. The de-emphasis includes increasing opacity and attenuating the view of the environment through the transparent portion, as described in any of Examples 1-8. 10. The display system according to any one of Examples 1-9, wherein the de-emphasis includes, other than displaying an image on the display, a reduction in brightness, visibility, sharpness, or contrast of the view of the environment through the transparent portion, or a modification of the colors of the environment through the transparent portion, or more. 11. The display system according to any one of Examples 1-10, wherein the de-emphasis includes increasing opacity and attenuating the view of the environment through the transparent portion, other than by displaying the image on the display. 12. A display system according to any of Examples 1-11, wherein the processing electronic device is configured to alter the user's perception of real or virtual objects within the user's field of view by altering the background. 13. The display system according to Example 12, wherein modifying the background increases the homogeneity of the background and thereby reduces visible features within the background. 14. The display system according to Example 13, which includes increasing the homogeneity of the background by washing out or painting over features within the background. 15. A display system according to any of Examples 12-14, wherein the processing electronics are configured to modify the background by increasing the intensity of light in the background so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 16. A display system according to any one of Examples 1-15, wherein the processing electronic equipment is configured to enhance the rendering of image content displayed by the display. 17. A display system according to any one of Examples 1-16, wherein the processing electronic device is configured to de-enhance the rendering of image content displayed by the display. 18. A display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and a portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display, Display the image content within the user's field of view, To perform at least one of the following: enhancing the rendering of image content displayed by the display or de-enhancing the rendering of image content. It is configured in such a way, Such enhancement includes, or exceeds, one of the following: an increase in contrast, color saturation, brightness, edge visibility, opacity, or sharpness; highlights; or alteration of the color or color balance of the rendered image content relative to other image content displayed by the display. Such de-emphasis includes, or exceeds, one of the following: a reduction in contrast, color saturation, brightness, edge visibility, opacity, or sharpness, or an alteration of the color or color balance of the rendered image content relative to other image content displayed by the display. Processing electronic equipment and A head-mounted display system equipped with the following features. 19. The display system according to Embodiment 18, wherein the processing electronic equipment is configured to enhance the rendering of image content displayed by the display. 20. The display system according to Example 18 or 19, wherein the processing electronic device is configured to de-enhance the rendering of the image content displayed by the display. 21. A display system according to any one of Examples 18-20, wherein the processing electronic equipment is configured to enhance the rendering of the image content displayed by the display with respect to the surrounding image content displayed by the display. 22. A display system according to any one of Examples 18-21, wherein the processing electronic device is configured to de-enhance the rendering of the image content displayed by a display surrounded by the de-enhanced image content. 23. A display system according to any of Examples 18-22, further comprising one or more outward-facing cameras configured to image objects in the user's environment. 24. A display system according to any of Examples 18-23, further comprising one or more eye-tracking sensors configured to determine the location of the user's eyes. 25. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more outward-facing cameras configured to image objects in the user's environment, A processing electronic device that communicates with the display and the outward-facing camera, Display the image content within the user's field of view, By applying object recognition to images received from one or more outward-facing cameras, one or more objects in the user's environment can be recognized. Based on the object recognition, at least one of the following is performed: augmentation of rendering of the image content displayed by the display or de-enhancement of rendering of the image content. It is configured in such a way, Such enhancement includes, or exceeds, one of the following: an increase in contrast, color saturation, brightness, edge visibility, opacity, sharpness, highlights, or alteration of the color or color balance of the rendered image content. Such de-emphasis includes, or exceeds, a reduction in contrast, color saturation, brightness, edge visibility, opacity, or sharpness, or alteration of the color or color balance of the rendered image content. Processing electronic equipment and A head-mounted display system equipped with the following features. 26. The display system according to Embodiment 25, wherein one or more outward-facing cameras are arranged on the frame. 27. The display system according to Example 25 or 26, wherein the processing electronic equipment is configured to enhance the rendering of the image content displayed by the display. 28. A display system according to any of Examples 25-27, wherein the processing electronic device is configured to de-enhance the rendering of image content displayed by the display. 29. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more outward-facing cameras configured to image objects in the user's environment, A processing electronic device that communicates with the display and the outward-facing camera, Display the image content within the user's field of view, By applying object recognition to images received from one or more outward-facing cameras, one or more objects in the user's environment can be recognized. Based on the object recognition, at least a portion of the view of the environment in front of the user's eyes through the transparent portion is de-emphasized. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 30. The display system according to Example 29, wherein the de-emphasis includes, or exceeds, a reduction in the brightness, visibility, sharpness, or contrast of the view of the environment through the transparent portion, or a modification of the color of the environment through the transparent portion. 31. The display system according to Example 29 or 30, wherein the de-emphasis includes increasing opacity and attenuating the view of the environment through the transparent portion. 32. The display system according to any of Examples 29-31, wherein the de-emphasis includes, other than displaying an image on the display, a reduction in brightness, visibility, sharpness, or contrast of the view of the environment through the transparent portion, or a modification of the colors of the environment through the transparent portion, or more. 33. The display system according to any one of Examples 29-32, wherein the de-emphasis includes increasing opacity and attenuating the view of the environment through the transparent portion, other than by displaying the image on the display. 34. A display system according to any of Examples 29-33, wherein the processing electronic device is configured to alter the user's perception of real or virtual objects within the user's field of view by altering the background. 35. The display system according to Example 34, wherein modifying the background increases the homogeneity of the background and thereby reduces visible features within the background. 36. The display system according to Example 35, wherein increasing the homogeneity of the background includes washing out or painting over features within the background. 37. A display system according to any of Examples 29-36, wherein the processing electronics are configured to modify the background by increasing the intensity of light in the background so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 38. A display system according to any of Examples 29-37, wherein the processing electronics are configured to increase the light intensity so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 39. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, One or more outward-facing sensors to sense the user's environment, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with one or more storage systems, including a display and a data recording system relating to the user, Display the image content within the user's field of view, Based on the output from one or more outward-facing sensors and the one or more data recordings relating to the user, the user's perception of real or virtual objects within the user's field of view is modified. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 40. The display system according to Embodiment 39, wherein the one or more outward-facing sensors comprises one or more outward-facing cameras positioned on a frame. 41. The display system according to Embodiment 39 or 40, wherein one or more outward-facing cameras are configured to image objects in the user's environment, and the processing electronics are configured to recognize one or more objects in the user's environment by applying object recognition to images received from one or more outward-facing cameras, and to modify the user's perception of real or virtual objects in the user's field of view based on the object recognition. 42. The display system according to any one of Examples 39-41, wherein the processing electronic device is configured to sense a situation involving user attention, determine the user's intent to the situation, and at least in part, modify the user's perception of real or virtual objects within the user's field of view based on the user's intent. 43. Modifying the user perception of real or virtual objects within the user's field of view includes performing at least one of enhancing or de-enhancing the user perception of real or virtual objects within the user's field of view, as described in any of Examples 39-42. 44. The display system according to any one of Examples 39-43, wherein the one or more outward-facing cameras are configured to image objects in the user's environment, and the processing electronics are configured to recognize one or more objects in the user's environment by applying object recognition to images received from the one or more outward-facing cameras, and based on the object recognition, perform at least one of enhancing or de-enhancing the user's perception of real or virtual objects in the user's field of view. 45. The display system according to any of Examples 39-44, wherein the data recording includes user driving records. 46. The display system according to any of the embodiments of 45, wherein the data recording includes whether or not the user committed a driving violation. 47. The display system according to either Example 45 or 46, wherein the data recording includes at least one of the user's age and whether the user is a teenage driver. 48. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more outward-facing cameras configured to image objects in the user's environment, A processing electronic device that communicates with the display and the outward-facing camera, Display the image content within the user's field of view, By applying object recognition to images received from one or more outward-facing cameras, one or more objects in the user's environment can be recognized. Based on the object recognition, highlight at least a portion of the view of the environment in front of the user's eyes through the transparent portion. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 49. A head-mounted display system according to Example 48, in which highlighting an object includes superimposing a partially transparent color over the object. 50. The head-mounted display system according to Embodiment 48 or 49, wherein highlighting an object includes highlighting an object by means other than displaying an image from one or more outward-facing cameras.
[0010] 51. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. An outward-facing camera configured to image objects in the user's environment, A processing electronic device that communicates with the display and the outward-facing camera and controls the presentation of image content on the display, The user determines that the vehicle is in operation, Enhances objects within the user's field of view. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 52. The display system according to Embodiment 51, wherein augmenting an object within the user's field of view includes moving the image content of the object from a first location to a second location within the user's field of view. 53. The display system according to Example 51 or 52, wherein enhancing objects within the user's field of view includes, without enhancement, altering the perceived color of an object relative to its original color. 54. A display system according to any of Examples 51-53, wherein enhancing objects within the user's field of view includes, or exceeds, an increase in the contrast, color saturation, brightness, edge visibility, opacity, or sharpness of the displayed image content. 55. A display system according to any of Examples 51-54, wherein enhancing objects within the user's field of view includes highlighting objects by superimposing a partially transparent color over them. 56. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A database configured to contain one or more user records, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display and the database, configured to reduce the amount of image content displayed based on one or more user records, A head-mounted display system equipped with the following features. 57. The display system according to Example 56, wherein one or more user records include at least one of the following: driving records, accident records, corrective action records, academic records, criminal records, or arrest records. 58. One or more user records, including the user's age, in the display system as described in Example 56 or 57. 59. A display system according to any of Examples 56-58, which includes selectively enabling user access to displayed image content, thereby reducing the amount of image content displayed based on one or more user records. 60. A display system according to any of Examples 56-59, which reduces the amount of image content displayed based on one or more user records, including not displaying any image content. 61. A display system according to any of Examples 56-59, which reduces the amount of image content displayed based on one or more user records, including substantially not displaying any image content. 62. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display, At least partially, the system determines that a user is in close proximity to the vehicle based on an established communication link with the vehicle's processor. Based on the established communication link, reduce the amount of image content displayed. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 63. The head-mounted display system according to Embodiment 62, wherein determining that a user is in close proximity to a vehicle includes transmitting and / or receiving at least one of a radio frequency signal or an infrared signal. 64. Determining that a user is in close proximity to a vehicle includes at least one of transmitting and / or receiving a radio frequency signal, as described in Embodiment 62, of the head-mounted display system. 65. A head-mounted display system according to Embodiment 62, wherein determining that a user is in close proximity to a vehicle includes at least one of transmitting and / or receiving a radio signal. 66. Determining that a user is in close proximity to a vehicle includes at least one of transmitting and / or receiving a Bluetooth® signal, as described in Embodiment 62. 67. A head-mounted display system according to either Example 62 or 66, which includes reducing the amount of image content displayed based on an established communication link, or not displaying any image content. 68. A head-mounted display system according to either Example 62 or 66, which includes reducing the amount of image content displayed based on an established communication link, or substantially not displaying any image content. 69. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A frame configured to be supported above the user's head, A head-mounted display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and the portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. An outward-facing camera configured to image objects in the user's environment, An environmental sensor configured to identify the position of one or more objects, A processing electronic device that communicates with the display, the outward-facing camera, and the environmental sensor, The user determines whether the vehicle is in operation. Determine at least one of the following: the risk of the vehicle colliding with an object, and the risk of the object colliding with the vehicle. Based on the identified risk, the amount of image content displayed will be reduced. A processing electronic device configured as follows, A head-mounted display system equipped with the following features. 70. A head-mounted display system according to Example 69, wherein determining collision risk includes determining the rate at which an object and a vehicle are approaching based on the position of one or more of an object identified by an environmental sensor. 71. The head-mounted display system according to Embodiment 69 or 70, wherein the environmental sensor, configured to identify the position of one or more of the objects, comprises at least one of a laser rangefinder, LiDAR, radar rangefinder, or ultrasonic ranging device. 72. A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, A display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent, such that the transparent portion transmits light from the user and a portion of the environment in front of the head-mounted display to the user's eyes, providing a view of the user and a portion of the environment in front of the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display system. An outward-facing camera configured to image objects in the user's environment, A processing electronic device that communicates with the display and the outward-facing camera and controls the presentation of image content on the display, The user determines that the vehicle is in operation, The image content is displayed in the user's field of view at different divergent amounts, as if projected from different distances from the user's eyes. Based on the user's determination that the vehicle is in operation, the amount of image content displayed is reduced. A processing electronic device configured as follows, A head-mounted display system equipped with the following features.
[0011] Any of the above embodiments may include any one or more of the features described below, and may produce any of the following embodiments. 73. The display system according to any one of Examples 1-72, wherein the processing electronic device may be configured to modify the user's perception of virtual objects within the user's field of view by modifying image content that includes objects. 74. The display system according to Example 73, wherein modifying the image content includes modifying at least one of the contrast, opacity, color, color saturation, color balance, size, brightness, border, or sharpness of the image content that includes an object. 75. A display system according to any of Examples 1-74, wherein the processing electronic device may be configured to alter the user perception of an object by moving the object from a first location to a second location. 76. The display system according to Example 75, wherein the first location is a peripheral area and the second location is a central area, or the first location is a central area and the second location is a peripheral area. 77. A display system according to any of Examples 1-76, further configured to provide alerts to the user. 78. The display system according to Example 77, wherein the alert is a visual or auditory alert. 79. A display system according to any of Examples 1-78, further comprising one or more environmental sensors. 80. The display system according to any of Examples 1-79, comprising one or more environmental sensors: a depth sensor, a pair of binocular world cameras, a geolocation sensor, a proximity sensor, or GPS. 81. A display system according to any of Examples 1-79, further comprising one or more user sensors. 82. A display system according to any of Examples 1-81, comprising one or more user sensors and one or more cameras. 83. A head-mounted display system according to any one of Examples 1-82, comprising a waveguide having a diffractive optical element configured to output light by extracting light from the waveguide, wherein the waveguide is one of a stack of waveguides, and different waveguides in the stack of waveguides are configured to output light with different wavefront divergences. 84. The display system according to any one of Examples 1-83, wherein the processing electronic equipment is further configured to determine the user's intent to a situation and, at least in part, modify the user's perception of real or virtual objects within the user's field of view based on the determined user intent. 85. The display system according to any one of Examples 1-84, wherein the processing electronic equipment is further configured to determine the user's intent to a situation and to modify the user's perception of real or virtual objects within the user's field of view, at least in part, based on the perception of increased focus. 86. A display system according to any one of Examples 1-85, comprising a sensor configured to detect a wireless signal. 87. A display system according to any one of Examples 1-86, comprising a sensor configured to detect Bluetooth® signals from an automobile. 88. The display system according to any one of Examples 1-87, wherein the processing electronic device is configured to determine whether the user is driving an automated vehicle. 89. The display system according to any of Examples 1-88, wherein the processing electronic device is configured, at least in part, to modify the user's perception of real or virtual objects within the user's field of view based on one or more data records relating to the user, the one or more data records including the user's driving records. 90. The display system according to Examples 1-89, wherein the processing electronic equipment is configured to modify the background. 91. The display system according to Example 90, wherein modifying the background increases the homogeneity of the background and thereby reduces visible features within the background. 92. The display system according to Example 91, wherein increasing the homogeneity of the background includes washing out or painting over the background. 93. A display system according to any one of Examples 1-92, wherein the processing electronics are configured to modify the background by increasing the intensity of light in the background so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 94. A display system according to any one of Examples 1-93, wherein the processing electronics are configured to increase the light intensity so that features in the environment in front of the user and the head-mounted display are less conspicuous to the user. 95. A display system according to any of Examples 1-94, wherein the processing electronic device is configured to modify the user's perception of objects within the user's field of view by highlighting the objects. 96. A display system according to Example 95 in which highlighting an object includes superimposing a partially transparent color over the object. 97. A display system according to any one of Examples 1-96, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 98. The display system according to Embodiment 97, wherein one or more light sources are configured to direct light into one or more waveguides. 99. The display system according to either embodiment 97 or 98, wherein one or more light sources include a fiber scanning projector. 100. A display system according to any one of Examples 1-99, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 101. A display system according to any of Examples 1-100, further comprising one or more sensors configured to monitor the environment. 102. The display system according to Embodiment 101, comprising one or more outward-facing image acquisition systems configured to image the environment, wherein the one or more sensors are configured to image the environment. 103. The display system according to Embodiment 102, comprising one or more outward-facing image acquisition systems configured to image the environment, each comprising one or more outward-facing cameras. 104. A display system according to any of Examples 101-103, comprising one or more sensors in a distance measuring system. 105. The distance measuring system is a display system according to Embodiment 104, comprising a laser rangefinder. 106. A display system according to any of Examples 1-105, further comprising an eye-tracking system configured to track the position and / or movement of the user's eyes. 107. A display system according to any one of Examples 1-106, further comprising one or more inward-facing image acquisition systems configured to form an image of the user's eye. 108. A display system according to any one of Examples 1-107, wherein the head-mounted display system is configured to process image content presented in at least a first portion of the user's field of view differently from image content presented in a second portion of the user's field of view. 109. The display system according to any one of Examples 1-108, wherein the head-mounted display system is configured to process image content presented in at least a portion of the peripheral region of the user's field of view differently from image content presented in the central region of the user's field of view. 110. A display system according to any of Examples 1-109, wherein the enhancement provided by the processing electronic device includes enlarging the image content. 111. The display system according to any one of Examples 1-110, wherein the enhancement or de-enhancement provided by the processing electronic device includes altering brightness. 112. The enhancement provided by the processing electronic device includes increasing brightness, as described in any of Examples 1-111. 113. A display system according to any one of Examples 1-112, wherein the de-emphasis provided by the processing electronic device includes reducing brightness. 114. A display system according to any of Examples 1-113, wherein the de-emphasis provided by the processing electronic device includes increasing brightness. 115. The display system according to any of Examples 1-114, wherein the enhancement or de-enhancement provided by the processing electronic device includes altering the contrast. 116. The enhancement provided by the processing electronic device includes increasing contrast, as described in any of Examples 1-115. 117. A display system according to any one of Examples 1-116, wherein the de-enhancement provided by the processing electronic device includes reducing contrast. 118. The display system according to any of Examples 1-117, wherein the enhancement or deenhancement provided by the processing electronic device includes modifying color saturation. 119. The enhancement provided by the processing electronic device includes increasing color saturation, as described in any of Examples 1-118. 120. A display system according to any of Examples 1-119, wherein the de-enhancement provided by the processing electronic device includes reducing color saturation. 121. The display system according to any of Examples 1-120, wherein the enhancement or de-enhancement provided by the processing electronic device includes modifying sharpness. 122. The enhancement provided by the processing electronic device includes increasing clarity, as described in any of Examples 1-121 of the display system. 123. A display system according to any one of Examples 1-122, wherein the de-enhancement provided by the processing electronic device includes reducing sharpness. 124. The display system according to any of Examples 1-123, wherein the enhancement or de-enhancement provided by the processing electronic device includes altering the opacity. 125. The enhancement provided by the processing electronic device includes increasing opacity, as described in any of Examples 1-124, of the display system. 126. A display system according to any one of Examples 1-125, wherein the de-emphasis provided by the processing electronic device includes reducing opacity. 127. A display system according to any of Examples 1-126, wherein the de-emphasis provided by the processing electronic device includes increasing opacity. 128. Enhancement is a display system according to any of Examples 1-127, comprising edge enhancement features. 129. A display system according to any of Examples 1-128, wherein the enhancement or de-enhancement provided by the processing electronic device includes shifting the color balance.
[0012] Additional embodiments are provided below. Example Set IA 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central area of the user's field of vision, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to present enhanced image content in the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 2. The system according to Example 1, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 3. The system according to Embodiment 1 or 2, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 4. The system according to Embodiment 3, wherein one or more light sources are configured to direct light into one or more waveguides. 5. The light source is a system according to any one of Examples 2-4, comprising a fiber scanning projector. 6. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 7. The system according to Embodiment 6, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 8. The system according to Embodiment 7, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 9. One or more sensors comprising a distance measuring device, as described in any of Examples 6-8. 10. The distance measuring system is the system according to Example 9, comprising a laser rangefinder. 11. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 12. The system according to Embodiment 1 or 11, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 13. The head-mounted display system according to any of the above embodiments, configured to process image content presented in at least a portion of the peripheral region of the user's field of view differently from image content presented in the central region of the user's field of view. 14. The head-mounted display system according to Embodiment 13, configured to process image content differently by magnifying image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 15. The head-mounted display system according to any one of Examples 13-14, configured to process image content differently by increasing the brightness of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 16. The head-mounted display system according to any one of Examples 13-15, configured to process image content differently by increasing the contrast of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 17. The head-mounted display system according to any one of Examples 13-16, configured to process image content differently by increasing the color saturation of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 18. The head-mounted display system according to any one of Examples 13-17, configured to process image content differently by sharpening image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 19. The system according to Example 18, wherein the sharpening includes edge enhancement features in image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 20. The head-mounted display system according to any one of Examples 13-19, configured to process image content differently by shifting the color balance of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 21. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central and peripheral areas of the user's field of view, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising the above, wherein the head-mounted display system is configured to present de-enhanced image content in the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 22. The system according to Example 21, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 23. The system according to Example 21 or 22, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 24. The system according to Example 23, wherein the one or more light sources are configured to direct light into the one or more waveguides. 25. The light source is a system according to any one of Examples 22-24, comprising a fiber scanning projector. 26. The system according to any of Examples 21-25, further comprising one or more sensors configured to monitor the environment. 27. The system according to Embodiment 26, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 28. The system according to Embodiment 27, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 29. One or more sensors comprising a distance measuring device, as described in any of Examples 26-28. 30. The distance measuring device is the system according to Example 29, comprising a laser rangefinder. 31. The system according to any one of Examples 21-30, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 32. The system according to Examples 21-31, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 33. The head-mounted display system according to any one of Examples 21-32, configured to process image content presented in at least a portion of the central region of the user's field of view differently from image content presented in the peripheral region of the user's field of view. 34. The head-mounted display system according to Embodiment 33, configured to process image content differently by blurring image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 35. The head-mounted display system according to any one of Examples 33-34, configured to process image content differently by darkening or attenuating image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 36. The head-mounted display system according to any one of Examples 33-35, configured to process image content differently by reducing the contrast of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 37. The head-mounted display system according to any one of Examples 33-36, configured to process image content differently by reducing the color saturation of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 38. The head-mounted display system according to any one of Examples 33-37, configured to process image content differently by reducing the clarity of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 39. The system according to Example 38, wherein reducing sharpness includes de-enhancing the edges of features in image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 40. The head-mounted display system according to any one of Examples 33-39, configured to process image content differently by shifting the color balance of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 41. The head-mounted display system according to any one of Examples 33-40, configured to process image content differently by shrinking image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 42. The magnification is at least partially based on the resolution of the eye, as described in Example 14. 43. The system according to Example 34, wherein the blurring includes blurring the image content presented in at least a portion of the central area of the user's field of view using the same color. 44. The system according to Embodiment 44, wherein the same color has a high contrast color compared to the color in the image content presented in the peripheral area of the user's field of view. 45. The system according to either of Examples 1-20 or 42, wherein the system is configured to provide an alert to the user indicating that the presented image has been enhanced. 46. The system according to any of Examples 21-41 or any of Examples 43-44, configured to provide an alert to the user indicating that the presented image has been de-emphasized. 47. The alert is a visual alert, as described in either Example 45 or 46 of the system. 48. The system according to either Example 45 or 46, wherein the alert is an audible alert. 49. The system according to any of the above embodiments, wherein the head-mounted display system is configured to construct a 3D representation of at least that portion of the environment in front of the user, and to interpret the representation of at least that portion of the environment, the portion of the environment including a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient. 50. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides. 51. The system according to Example 50, comprising one or more light sources configured to direct light into one or more waveguides, wherein the waveguides are configured to direct light into the user's eye. 52. The system according to any one of Examples 50-51, wherein one or more light sources include a fiber scanning projector. 53. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 54. The system according to Embodiment 53, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 55. The system according to Embodiment 54, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 56. The system according to any of the above embodiments, further comprising a distance measuring device. 57. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 58. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 61. The system according to Example 60, wherein the first image modality is MRI scanning. 62. The system according to any one of Examples 60-61, wherein the second image modality is ultrasound. 63. The system according to any one of Examples 60-62, wherein the first image modality is X-ray scanning. 64. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 65. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 66. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 67. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 68. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user so as to be overlaid on the area of the human body to be dissected. 69. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 68. 70. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 71. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 72. The system according to Embodiment 71, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 73. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 74. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 76. The system according to Example 75, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 77. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 78. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 79. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 80. The user's medical parameters, including vital signs, are as described in Example 79 of the system. 81. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 82. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 83. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 84. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 85. The system according to Example 16, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 86. The system according to Example 16, wherein increasing the contrast includes adding black, gray, white, or other colors to at least one color of the image content. 87. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 88. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 89. The system according to Example 88, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 90. The system according to Example 88 or 89, wherein the head-mounted display is configured to align combined images of the first and second image modalities across the patient's actual anatomical structure.
[0013] Example Set IB 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central area of the user's field of vision, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising the above, wherein the head-mounted display system is configured to present enhanced image content in the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 2. The system according to Example 1, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 3. The system according to Embodiment 1 or 2, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 4. The system according to Embodiment 3, wherein one or more light sources are configured to direct light into one or more waveguides. 5. The light source is a system according to any one of Examples 2-4, comprising a fiber scanning projector. 6. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 7. The system according to Embodiment 6, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 8. The system according to Embodiment 7, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 9. One or more sensors comprising a distance measuring device, as described in any of Examples 6-8. 10. The distance measuring device is the system according to Example 9, comprising a laser rangefinder. 11. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 12. The system according to Embodiment 1 or 11, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 13. The head-mounted display system is configured to process image content presented in at least a portion of the central region of the user's field of view differently from image content presented in the peripheral region of the user's field of view, as described in any of the above embodiments. 14. The head-mounted display system according to Embodiment 13, configured to process image content differently by enlarging image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 15. The head-mounted display system according to any one of Examples 13-14, configured to process image content differently by increasing the brightness of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 16. The head-mounted display system according to any one of Examples 13-15, configured to process image content differently by increasing the contrast of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 17. The head-mounted display system according to any one of Examples 13-16, configured to process image content differently by increasing the color saturation of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 18. The head-mounted display system according to any one of Examples 13-17, configured to process image content differently by sharpening image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 19. The system according to Example 18, wherein the sharpening includes edge enhancement features in image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 20. The head-mounted display system according to any one of Examples 13-19, configured to process image content differently by shifting the color balance of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. 21. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central and peripheral areas of the user's field of view, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising the above, wherein the head-mounted display system is configured to present de-enhanced image content in the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 22. The system according to Example 21, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 23. The system according to Example 21 or 22, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 24. The system according to Example 23, wherein the one or more light sources are configured to direct light into the one or more waveguides. 25. The light source is a system according to any one of Examples 22-24, comprising a fiber scanning projector. 26. The system according to any of Examples 21-25, further comprising one or more sensors configured to monitor the environment. 27. The system according to Embodiment 26, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 28. The system according to Embodiment 27, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 29. One or more sensors comprising a distance measuring device, as described in any of Examples 26-28. 30. The distance measuring device is the system according to Example 29, comprising a laser rangefinder. 31. The system according to any one of Examples 21-30, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 32. The system according to Examples 21-31, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 33. The head-mounted display system according to any one of Examples 21-32, configured to process image content presented in at least a portion of the peripheral region of the user's field of view differently from image content presented in the central region of the user's field of view. 34. The head-mounted display system according to Embodiment 33, configured to process image content differently by blurring image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 35. The head-mounted display system according to any one of Examples 33-34, configured to process image content differently by darkening or attenuating image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 36. The head-mounted display system according to any one of Examples 33-35, configured to process image content differently by reducing the contrast of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 37. The head-mounted display system according to any one of Examples 33-36, configured to process image content differently by reducing the color saturation of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 38. The head-mounted display system according to any one of Examples 33-37, configured to process image content differently by reducing the clarity of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 39. The system according to Example 38, wherein reducing sharpness includes enhancing and de-enhancing the edges of features in image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 40. The head-mounted display system according to any one of Examples 33-39, configured to process image content differently by shifting the color balance of image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 41. The head-mounted display system according to any one of Examples 33-40, configured to process image content differently by shrinking image content presented in at least a portion of the peripheral region of the user's field of view compared to image content presented in the central region of the user's field of view. 42. The magnification is at least partially based on the resolution of the eye, as described in Example 14. 43. The system according to Example 34, wherein the blurring includes blurring the image content presented in at least a portion of the peripheral area of the user's field of view using the same color. 44. The system according to Embodiment 44, wherein the same color is a high-contrast color compared to the color in the image content presented in the central region of the user's field of view. 45. The system according to either of Examples 1-20 or 42, wherein the system is configured to provide an alert to the user indicating that the presented image has been enhanced. 46. The system according to any of Examples 21-41 or any of Examples 43-44, configured to provide an alert to the user indicating that the presented image has been de-emphasized. 47. The alert is a visual alert, as described in either Example 45 or 46 of the system. 48. The system according to either Example 45 or 46, wherein the alert is an audible alert. 49. The system according to any of the above embodiments, wherein the head-mounted display system is configured to construct a 3D representation of at least that portion of the environment in front of the user, and to interpret the representation of at least that portion of the environment, the portion of the environment including a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient. 50. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides. 51. The system according to Example 50, comprising one or more light sources configured to direct light into one or more waveguides, wherein the waveguides are configured to direct light into the user's eye. 52. The system according to any one of Examples 50-51, wherein one or more light sources include a fiber scanning projector. 53. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 54. The system according to Embodiment 53, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 55. The system according to Embodiment 54, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 56. The system according to any of the above embodiments, further comprising a distance measuring device. 57. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 58. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 61. The system according to Example 60, wherein the first image modality is MRI scanning. 62. The system according to any one of Examples 60-61, wherein the second image modality is ultrasound. 63. The system according to any one of Examples 60-61, wherein the first image modality is X-ray scanning. 64. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 65. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 66. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 67. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 68. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user so as to be overlaid on the area of the human body to be dissected. 69. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 68. 70. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 71. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 72. The system according to Embodiment 71, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 73. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 74. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 76. The system according to Embodiment 76, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 77. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 78. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 79. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 80. The user's medical parameters, including vital signs, are as described in Example 79 of the system. 81. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 82. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 83. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 84. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 85. The system according to Example 16, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 86. The system according to Example 16, wherein increasing the contrast includes adding black, gray, white, or other colors to at least one color of the image content. 87. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 88. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 89. The system according to Example 88, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 90. The system according to Example 88 or 89, wherein the head-mounted display is configured to align combined images of the first and second image modalities across the patient's actual anatomical structure.
[0014] Example Set IIA 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content to the user on multiple depth planes, wherein at least a portion of the display comprises one or more waveguides, the one or more waveguides being transparent so as to transmit light from a portion of the user's frontal environment to the user's eyes and provide a view of that portion of the user's frontal environment, and positioned in front of the user's eyes when the user wears the head-mounted display system, the central region of the user's eye's field of vision corresponds to the central region in the user's frontal environment, and the peripheral region of the user's eye's field of vision corresponds to the peripheral region in the user's frontal environment, An outward-facing image acquisition device configured to form an image of at least that portion of the environment directly in front of the user, One or more sensors configured to measure the distance to an object in at least that portion of the environment in front of the user, One or more input devices configured to receive input from the user, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising: a head-mounted display system configured to select an object in the environment corresponding to a peripheral area of the user's field of view based on input received by one or more input devices; one or more sensors configured to measure the distance to the object after selection; an outward-facing image-capturing device configured to acquire an image of the object; and a display configured to present an augmented image of the object on a determined depth plane based on the distance measured by one or more sensors configured to measure the distance; the augmented image is enhanced compared to the rest of the field of view; and the augmented image is presented at a location within the peripheral area of the user's field of view. 2. The system according to Example 1, further comprising one or more light sources configured to direct light into a person's eye and form an image within the eye. 3. The system according to Embodiment 2, wherein the one or more light sources are configured to direct light into the one or more waveguides. 4. The system according to Embodiment 2 or 3, wherein one or more light sources include a fiber scanning projector. 5. The system according to Embodiment 1, wherein the depth plane comprises a first far-depth plane and a second near-depth plane, the first far-depth plane being further from the user's eyes than the second near-depth plane when the head-mounted display is worn by the user. 6. The enhanced image is presented on the depth plane, as in the system of Example 5. 7. The system according to Embodiment 5 or 6, wherein the display comprises optical elements having refractive power such that light projected into the eye diverges to present image content from the second near-depth plane. 8. The system according to Example 7, wherein the optical element having refractive power comprises a lens. 9. The system according to Example 7 or 8, wherein the optical element having refractive power comprises a diffractive optical element. 10. The system according to Embodiment 1, wherein the head-mounted display system is configured to present the enhanced image content to a location in the peripheral area of the user's field of view corresponding to a location in the peripheral area of the environment in which the object is located. 11. The system according to Embodiment 1, wherein the head-mounted display system is configured to move the enhanced image content to a location in the peripheral area of the user's field of view that does not correspond to the peripheral area in the environment in which the object is located. 12. The system according to Embodiment 1, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 13. The system according to Embodiment 12, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 14. One or more sensors comprising a distance measuring device, as described in any of the Examples of 1. 15. The distance measuring device is the system according to Example 14, comprising a laser rangefinder. 16. The system according to Embodiment 1, wherein the one or more input devices configured to receive input from the user include an inward-facing eye-tracking camera positioned to image the user's eyes and track their movement. 17. The system according to any of the above embodiments, wherein presenting the enhanced image involves processing the image of the object differently from the image of the object in the user's field of view. 18. Processing the image differently includes enlarging the image of the object compared to other parts of the user's field of view in which the image of the object is formed, as described in Example 17. 19. The system according to any of Examples 17-18, wherein processing the image differently includes increasing the brightness in the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 20. The system according to any of Examples 17-19, wherein processing the image differently includes increasing the contrast of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 21. The system according to any of Examples 17-20, wherein processing the image differently includes increasing the color saturation of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 22. The system according to any one of Examples 17-21, wherein processing the image differently includes sharpening the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 23. The system according to Example 22, wherein the sharpening includes edge enhancement features of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 24. The system according to any of Examples 17-23, wherein processing the image differently includes shifting the color balance of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 25. The system according to any of the above embodiments, wherein the other portion of the field of view comprises the other portion of the peripheral region of the field of view. 26. The system according to any of the above embodiments, wherein the other portion of the field of view comprises at least a portion of the central region of the field of view. 27. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content to the user on multiple depth planes, wherein at least a portion of the display comprises one or more waveguides, the one or more waveguides being transparent so as to transmit light from a portion of the user's frontal environment to the user's eyes and provide a view of that portion of the user's frontal environment, and positioned in front of the user's eyes when the user wears the head-mounted display system, the central region of the user's eye's field of vision corresponds to the central region in the user's frontal environment, and the peripheral region of the user's eye's field of vision corresponds to the peripheral region in the user's frontal environment, An outward-facing image acquisition device configured to form an image of at least that portion of the environment in front of the user, One or more sensors configured to measure the distance to an object in at least that portion of the environment in front of the user, One or more input devices configured to receive input from the user, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising: a head-mounted display system configured to select an object in the environment corresponding to a peripheral area of the user's field of view based on input received by one or more input devices; one or more sensors configured to measure the distance to the object after selection; an outward-facing image-capturing device configured to acquire an image of the object; a display configured to present the image of the object on a depth plane determined based on the distance measured by one or more sensors configured to measure the distance; the image of the object being presented at a location within the peripheral area of the user's field of view; and a display configured to de-enhance images formed in other parts of the field of view compared to the image of the object. 28. The system according to Example 27, further comprising one or more light sources configured to direct light into a person's eye and form an image within the eye. 29. The system according to Example 28, wherein the one or more light sources are configured to direct light into the one or more waveguides. 30. The system according to Example 28 or 29, wherein one or more light sources include a fiber scanning projector. 31. The system according to Embodiment 27, wherein the depth plane comprises a first far-depth plane and a second near-depth plane, the first far-depth plane being further from the user's eyes than the second near-depth plane when the head-mounted display is worn by the user. 32. The system according to Example 31, wherein an image of the object is presented on the depth plane. 33. The system according to Example 31 or 32, wherein the display comprises optical elements having refractive power such that light projected into the eye diverges to present image content from the second near-depth plane. 34. The system according to Example 33, wherein the optical element having refractive power comprises a lens. 35. The system according to Example 33 or 34, wherein the optical element having refractive power comprises a diffractive optical element. 36. The system according to Embodiment 27, wherein the head-mounted display system is configured to present an image of the object to a location in the peripheral area of the user's field of view corresponding to a location in the peripheral area within the environment in which the object is located. 37. The system according to Embodiment 27, wherein the head-mounted display system is configured to move an image of an object to a location in the peripheral area of the user's field of view that does not correspond to the peripheral area in the environment in which the object is located. 38. The system according to Embodiment 27, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 39. The system according to Embodiment 38, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 40. The system according to any of Embodiment 27, wherein one or more sensors are equipped with a distance measuring device. 41. The distance measuring device is the system according to Example 40, comprising a laser rangefinder. 42. The system according to Embodiment 27, wherein the one or more input devices configured to receive input from the user include an inward-facing eye-tracking camera positioned to image the user's eyes and track their movement. 43. The head-mounted display system according to any one of Examples 27-42, wherein the head-mounted display system is configured to process images formed in other parts of the user's field of view, other than where the image of the object is formed, in a manner different from the image of the object. 44. The head-mounted display system according to Embodiment 43, wherein the head-mounted display system is configured to process images differently by shrinking or reducing the size of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 45. The head-mounted display system according to any one of embodiments 43-44, wherein the system is configured to process images differently by darkening or attenuating images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 46. The head-mounted display system according to any one of embodiments 43-45, wherein the system is configured to process images differently by reducing the contrast of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 47. The head-mounted display system according to any one of Examples 43-46, wherein the system is configured to process images differently by reducing the color saturation of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to the image of the object. 48. The head-mounted display system according to any one of Examples 43-47, configured to process images differently by reducing the clarity of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 49. The system according to Embodiment 48, wherein reducing the sharpness includes de-enhancing the edges of features in the image that are formed in other parts of the user's field of view other than where the image of the object is formed, compared to the image of the object. 50. The system according to Example 48 or 49, wherein reducing the sharpness includes blurring an image formed in other parts of the user's field of view other than where the image of the object is formed, compared to the image of the object. 51. The head-mounted display system according to any one of Examples 48-50, configured to process images differently by shifting the color balance of images formed in other parts of the user's field of view, other than where the image of the object is formed, compared to an image of the object. 52. The system according to any of Examples 27-51, wherein the other portion of the field of view comprises the other portion of the peripheral region of the field of view. 53. The system according to any one of Examples 27-52, wherein the other portion of the field of view comprises at least a portion of the central region of the field of view. 54. The enhanced image is presented on the near-depth plane, according to the system of Example 5. 55. The system according to Example 5 or 54, wherein the display comprises optical elements having refractive power such that the light projected into the eye diverges to present the image content from the first depth plane. 56. The magnification is at least partially based on the resolution of the eye, as described in Example 18. 57. The system according to Example 31, wherein an image of the object is presented on the near-depth plane. 58. The system according to Example 31 or 57, wherein the display comprises optical elements having refractive power such that the light projected into the eye diverges to present the image content from the first depth plane. 59. The system according to Example 50, wherein the blurring includes blurring the image formed in other parts of the user's field of view using the same color. 60. The system according to Example 59, wherein the same color has a high contrast color compared to the color in the image of the object. 61. The system according to any of Examples 1-26 or any of Examples 54-56, configured to provide an alert to the user indicating that the presented image has been enhanced. 62. The system according to any of Examples 27-53 or any of Examples 57-60, configured to provide an alert to the user indicating that the presented image has been de-emphasized. 63. The alert is a visual alert, as described in either Example 61 or 62 of the system. 64. The system according to either Example 61 or 62, wherein the alert is an audible alert. 65. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 66. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides. 67. The system according to Embodiment 66, comprising one or more light sources configured to direct light into one or more waveguides, wherein the waveguides are configured to direct light into the user's eye. 68. The system according to any one of Examples 66-67, wherein one or more light sources include a fiber scanning projector. 69. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 70. The system according to Embodiment 69, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 71. The system according to Embodiment 70, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 72. The system according to any of the above embodiments, further comprising a distance measuring device. 73. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 74. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 76. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 77. The system according to Example 76, wherein the first image modality is MRI scanning. 78. The system according to any one of Examples 76-77, wherein the second image modality is ultrasound. 79. The system according to any one of Examples 76-78, wherein the first image modality is X-ray scanning. 80. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 81. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 82. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 83. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 84. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 85. The apparent location of the virtual severance guideline appears to be related to the position of the patient's body part, as described in Example 84. 86. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 87. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 88. The system according to Embodiment 87, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 89. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 90. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 91. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 92. The system according to Example 91, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 93. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 94. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 95. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 96. The user's medical parameters, including vital signs, are as described in Example 95. 97. The system according to any of the above embodiments, wherein a head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 98. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 99. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 100. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 101. The system according to Example 20, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 102. The system according to Example 20, wherein increasing contrast includes adding black, gray, white, or other colors to at least one color of the image content. 103. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 104. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 105. The system according to Example 104, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 106. The system according to Example 104 or 105, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the actual anatomical structure of the patient.
[0015] Example Set IIB 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content to the user on multiple depth planes, wherein at least a portion of the display comprises one or more waveguides, the one or more waveguides being transparent so as to transmit light from a portion of the user's frontal environment to the user's eyes and provide a view of that portion of the user's frontal environment, and positioned in front of the user's eyes when the user wears the head-mounted display system, the central region of the user's eye's field of vision corresponds to the central region in the user's frontal environment, and the peripheral region of the user's eye's field of vision corresponds to the peripheral region in the user's frontal environment, An outward-facing image acquisition device configured to form an image of at least that portion of the environment directly in front of the user, One or more sensors configured to measure the distance to an object within at least that portion of the user's frontal environment, One or more input devices configured to receive an input from the user, A processing electronic device that communicates with the display and controls the presentation of image content on the display, Comprising, the head-mounted display system is configured to select an object within the environment corresponding to the central region of the user's field of view based on an input received by the one or more input devices, the one or more sensors are configured to measure the distance to the object after the selection, the outward-facing image capture device is configured to acquire an image of the object, the display is configured to present an enhanced image of the object on a determined depth plane based on the distance measured by the one or more sensors configured to measure the distance, the enhanced image is enhanced as compared to other parts of the field of view, and the enhanced image is presented at a location within the central region of the user's field of view, a head-mounted display system. 2. The system according to embodiment 1, further comprising one or more light sources configured to direct light into the eyes of a person and form an image within the eyes. 3. The system according to embodiment 2, wherein the one or more light sources are configured to direct light into the one or more waveguides. 4. The system according to embodiment 2 or 3, wherein the one or more light sources comprise a fiber scanning projector. 5. The system according to embodiment 1, wherein the depth plane comprises a first far depth plane and a second near depth plane, and the first far depth plane is farther from the user's eyes than the second near depth plane when the head-mounted display is worn by the user. 6. The system according to embodiment 5, wherein the enhanced image is presented on the far depth plane. 7. The display is the system according to embodiment 5 or 6, comprising an optical element having a refractive power such that light projected into the eye diverges to present image content from the second near-depth plane. 8. The system according to embodiment 7, wherein the optical element having a refractive power comprises a lens. 9. The system according to embodiment 7 or 8, wherein the optical element having a refractive power comprises a diffractive optical element. 10. The head-mounted display system is the system according to embodiment 1, configured to present the enhanced image content at a location within a central region of the user's field of view corresponding to a location within a central region of the environment where the object is located. 11. The head-mounted display system is the system according to embodiment 1, configured to move the enhanced image content to a location within a central region of the user's field of view that does not correspond to a central region of the environment where the object is located. 12. The system according to embodiment 1, wherein the one or more sensors comprise one or more outward-facing image capture devices configured to image the environment. 13. The system according to embodiment 12, wherein the one or more outward-facing image capture devices configured to image the environment comprise one or more outward-facing cameras. 14. The system according to any of embodiment 1, wherein the one or more sensors comprise a distance measurement device. 15. The system according to embodiment 14, wherein the distance measurement device comprises a laser rangefinder. 16. The system according to embodiment 1, wherein the one or more input devices configured to receive input from the user comprise an inward-facing eye tracking camera arranged to image the user's eyes and track their movement. 17. Presenting the enhanced image comprises processing the image of the object differently compared to other portions of the user's field of view where the image of the object is formed, in any of the前述 systems. 18. Processing the image differently includes enlarging the image of the object compared to other parts of the user's field of view in which the image of the object is formed, as described in Example 17. 19. The system according to any of Examples 17-18, wherein processing the image differently includes increasing the brightness in the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 20. The system according to any of Examples 17-19, wherein processing the image differently includes increasing the contrast of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 21. The system according to any of Examples 17-20, wherein processing the image differently includes increasing the color saturation of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 22. The system according to any one of Examples 17-21, wherein processing the image differently includes sharpening the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 23. The system according to Example 22, wherein the sharpening includes edge enhancement features of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 24. The system according to any of Examples 17-23, wherein processing the image differently includes shifting the color balance of the image of the object compared to other parts of the user's field of view in which the image of the object is formed. 25. The system according to any of the above embodiments, wherein the other portion of the field of view comprises the other portion of the central region of the field of view. 26. The system according to any of the above embodiments, wherein the other portion of the field of view comprises at least a portion of the peripheral region of the field of view. 27. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content to the user on multiple depth planes, wherein at least a portion of the display comprises one or more waveguides, the one or more waveguides being transparent so as to transmit light from a portion of the user's frontal environment to the user's eyes and provide a view of that portion of the user's frontal environment, and positioned in front of the user's eyes when the user wears the head-mounted display system, the central region of the user's eye's field of vision corresponds to the central region in the user's frontal environment, and the peripheral region of the user's eye's field of vision corresponds to the peripheral region in the user's frontal environment, An outward-facing image acquisition device configured to form an image of at least that portion of the environment in front of the user, One or more sensors configured to measure the distance to an object in at least that portion of the environment in front of the user, One or more input devices configured to receive input from the user, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising: a head-mounted display system configured to select an object in the environment corresponding to the central region of the user's field of view based on input received by one or more input devices; one or more sensors configured to measure the distance to the object after selection; an outward-facing image-capturing device configured to acquire an image of the object; a display configured to present the image of the object on a depth plane determined based on the distance measured by one or more sensors configured to measure the distance; the image of the object being presented at a location within the central region of the user's field of view; and a display configured to de-enhance images formed in other parts of the field of view compared to the image of the object. 28. The system according to Example 27, further comprising one or more light sources configured to direct light into a person's eye and form an image within the eye. 29. The system according to Example 28, wherein the one or more light sources are configured to direct light into the one or more waveguides. 30. The system according to Example 28 or 29, wherein one or more light sources include a fiber scanning projector. 31. The system according to Embodiment 27, wherein the depth plane comprises a first far-depth plane and a second near-depth plane, the first far-depth plane being further from the user's eyes than the second near-depth plane when the head-mounted display is worn by the user. 32. The system according to Example 31, wherein an image of the object is presented on the depth plane. 33. The system according to Example 31 or 32, wherein the display comprises optical elements having refractive power such that light projected into the eye diverges to present image content from the second near-depth plane. 34. The system according to Example 33, wherein the optical element having refractive power comprises a lens. 35. The system according to Example 33 or 34, wherein the optical element having refractive power comprises a diffractive optical element. 36. The system according to Embodiment 27, wherein the head-mounted display system is configured to present an image of the object at a location in the central region of the user's field of view corresponding to a location in the central region of the environment in which the object is located. 37. The system according to Embodiment 27, wherein the head-mounted display system is configured to move the image of the object to a location within the central area of the user's field of view that does not correspond to the central area of the environment in which the object is located. 38. The system according to Embodiment 27, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 39. The system according to Embodiment 38, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 40. The system according to any of Embodiment 27, wherein one or more sensors are equipped with a distance measuring device. 41. The distance measuring device is the system according to Example 40, comprising a laser rangefinder. 42. The system according to Embodiment 27, wherein the one or more input devices configured to receive input from the user include an inward-facing eye-tracking camera positioned to image the user's eyes and track their movement. 43. The head-mounted display system according to any one of Examples 27-42, wherein the head-mounted display system is configured to process images formed in other parts of the user's field of view, other than where the image of the object is formed, in a manner different from the image of the object. 44. The head-mounted display system according to Embodiment 43, wherein the head-mounted display system is configured to process images differently by shrinking or reducing the size of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 45. The head-mounted display system according to any one of embodiments 43-44, wherein the system is configured to process images differently by darkening or attenuating images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 46. The head-mounted display system according to any one of embodiments 43-45, wherein the system is configured to process images differently by reducing the contrast of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 47. The head-mounted display system according to any one of Examples 43-46, wherein the system is configured to process images differently by reducing the color saturation of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to the image of the object. 48. The head-mounted display system according to any one of Examples 43-47, configured to process images differently by reducing the clarity of images formed in other parts of the user's field of view other than where the image of the object is formed, compared to an image of the object. 49. The system according to Embodiment 48, wherein reducing the sharpness includes de-enhancing the edges of features in the image that are formed in other parts of the user's field of view other than where the image of the object is formed, compared to the image of the object. 50. The system according to Example 48 or 49, wherein reducing the sharpness includes blurring an image formed in other parts of the user's field of view other than where the image of the object is formed, compared to the image of the object. 51. The head-mounted display system according to any one of Examples 48-50, configured to process images differently by shifting the color balance of images formed in other parts of the user's field of view, other than where the image of the object is formed, compared to an image of the object. 52. The system according to any of Examples 27-51, wherein the other portion of the field of view comprises the other portion of the central region of the field of view. 53. The system according to any one of Examples 27-52, wherein the other portion of the field of view comprises at least a portion of the peripheral region of the field of view. 54. The enhanced image is presented on the near-depth plane, according to the system of Example 5. 55. The system according to Example 5 or 54, wherein the display comprises optical elements having refractive power such that the light projected into the eye diverges to present the image content from the first depth plane. 56. The magnification is at least partially based on the resolution of the eye, as described in Example 18. 57. The system according to Example 31, wherein an image of the object is presented on the near-depth plane. 58. The system according to Example 31 or 57, wherein the display comprises optical elements having refractive power such that the light projected into the eye diverges to present the image content from the first depth plane. 59. The system according to Example 50, wherein the blurring includes blurring the image formed in other parts of the user's field of view using the same color. 60. The system according to Example 59, wherein the same color has a high contrast color compared to the color in the image of the object. 61. The system according to any of Examples 1-26 or any of Examples 54-56, configured to provide an alert to the user indicating that the presented image has been enhanced. 62. The system according to any of Examples 27-53 or any of Examples 57-60, configured to provide an alert to the user indicating that the presented image has been de-emphasized. 63. The alert is the system according to either of Examples 61 or 62, which is a visual alert. 64. The alert is the system according to either of Examples 61 or 62, which is an auditory alert. 65. The head-mounted display system is configured to construct a 3D representation of at least that portion of the environment in front of the user and interpret the representation of at least that portion of the environment, where the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient. The system according to any of the foregoing examples. 66. At least that portion of the display, which is transparent and disposed at a location in front of the user's eyes, includes one or more light pipes. The system according to any of the foregoing examples. 67. The system according to Example 66, comprising one or more light sources configured to direct light into the one or more light pipes, and the light pipes are configured to direct the light into the user's eyes. 68. The system according to any of Examples 66-67, wherein the one or more light sources comprise a fiber optic scanning projector. 69. The system according to any of the foregoing examples, further comprising one or more sensors configured to monitor the environment. 70. The system according to Example 69, wherein the one or more sensors comprise one or more outward-facing image capture devices configured to image the environment. 71. The system according to Example 70, wherein the one or more outward-facing image capture devices configured to image the environment comprise one or more outward-facing cameras. 72. The system according to any of the foregoing examples, further comprising a distance measurement device. 73. The system according to any of the foregoing examples, further comprising an eye tracking device configured to track the position and / or movement of the user's eyes. 74. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 76. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 77. The system according to Example 76, wherein the first image modality is MRI scanning. 78. The system according to any one of Examples 76-77, wherein the second image modality is ultrasound. 79. The system according to any one of Examples 76-78, wherein the first image modality is X-ray scanning. 80. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 81. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 82. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 83. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 84. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 85. The apparent location of the virtual severance guideline appears to be related to the position of the patient's body part, as described in Example 84. 86. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 87. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 88. The system according to Embodiment 87, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 89. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 90. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 91. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 92. The system according to Example 91, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 93. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 94. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 95. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 96. The user's medical parameters, including vital signs, are as described in Example 95. 97. The system according to any of the above embodiments, wherein a head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 98. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 99. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 100. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 101. The system according to Example 20, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 102. The system according to Example 20, wherein increasing contrast includes adding black, gray, white, or other colors to at least one color of the image content. 103. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 104. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 105. The system according to Example 104, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 106. The system according to Example 104 or 105, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the actual anatomical structure of the patient.
[0016] Example Set III 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content to the user on multiple depth planes, wherein at least a portion of the display comprises one or more waveguides, the one or more waveguides being transparent so as to transmit light from a portion of the user's frontal environment to the user's eyes and provide a view of that portion of the user's frontal environment, and positioned in front of the user's eyes when the user wears the head-mounted display system, the central region of the user's eye's field of vision corresponds to the central region in the user's frontal environment, and the peripheral region of the user's eye's field of vision corresponds to the peripheral region in the user's frontal environment, An outward-facing image acquisition device configured to form an image of at least that portion of the environment in front of the user, One or more input devices configured to receive input from the user, A processing electronic device that communicates with the display and controls the presentation of image content on the display, Equipped with, The depth plane comprises a first depth plane and a second depth plane, and the distance to the object corresponds to the first depth plane from the second depth plane when the head-mounted display is worn by the user. The head-mounted display system is configured to select an object in the user's field of view based on input received by one or more input devices, the outward-facing image acquisition device is configured to acquire an image of the object, and the display is configured to present the image of the object at the second depth. A flat-head mounted display system. 2. The system according to Embodiment 1, wherein the one or more input devices configured to receive input from the user include an inward-facing eye-tracking camera positioned to image the user's eyes and track their movement. 3. The system according to any of the above embodiments, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 4. The system according to Embodiment 3, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 5. The system according to any of the above embodiments, further comprising one or more sensors configured to measure the distance to an object in at least that portion of the environment in front of the user. 6. The system according to Embodiment 5, wherein one or more sensors are configured to measure the distance to the object after the object has been selected. 7. One or more sensors are included in the distance measuring device, as described in any of Examples 5-6. 8. The distance measuring device is the system according to Example 7, comprising a laser rangefinder. 9. The system according to any of the above embodiments, wherein the first depth plane comprises a far depth plane, and the second depth plane comprises a near depth plane, and the far depth plane is further from the user's eyes than the near depth plane when the head-mounted display is worn by the user. 10. The system according to any one of Examples 1-8, wherein the first depth plane comprises a near-depth plane, and the second depth plane comprises a far-depth plane, the far-depth plane being further from the user's eyes than the near-depth plane when the head-mounted display is worn by the user. 11. The system according to any of the above embodiments, wherein the display is configured to present additional image content on the second depth plane. 12. The additional image is the selected object, as in the system described in Example 11. 13. The image of the object presented in the second depth plane is magnified, as described in any of the above embodiments of the system. 14. The system according to any of the above embodiments, wherein the image of the object presented in the second depth plane is not enlarged. 15. The image of the object presented in the second depth plane is reduced in size, according to the system of Example 15. 16. The system according to any of the above embodiments, wherein the one or more input devices configured to receive input from the user include a head posture sensor. 17. The system according to Embodiment 16, wherein the head posture sensor comprises an accelerometer or an IMU. 18. The head-mounted display system is configured to present an image of the object within the central region, as described in any of the above embodiments. 19. The head-mounted display system is configured to present an image of the object within the surrounding area, as described in any of the above embodiments. 20. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, as described in any of the preceding embodiments. 21. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides. 22. The system according to Example 21, comprising one or more light sources configured to direct light into one or more waveguides, wherein the waveguides are configured to direct light into the user's eye. 23. The system according to any one of Examples 21-22, wherein the one or more light sources include a fiber scanning projector. 24. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 25. The system according to Embodiment 24, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 26. The system according to Embodiment 25, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 27. The system according to any of the above embodiments, further comprising a distance measuring device. 28. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 29. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 30. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 31. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 32. The system according to Example 31, wherein the first image modality is MRI scanning. 33. The system according to any one of Examples 31-32, wherein the second image modality is ultrasound. 34. The first image modality is a system according to any one of Examples 31-33, comprising X-ray scanning. 35. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 36. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 37. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 38. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 39. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user so as to be overlaid on the area of the human body to be dissected. 40. The apparent location of the virtual severance guideline appears to be related to the position of the patient's body part, as described in Example 39. 41. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 42. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 43. The system according to Embodiment 42, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 46. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 47. The system according to Embodiment 46, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 48. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 49. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 50. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 51. The user's medical parameters, including vital signs, are as described in Example 50 of the system. 52. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 54. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 55. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 56. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 57. The system according to Example 56, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 58. The system according to Example 56 or 57, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the actual anatomical structure of the patient.
[0017] Example Set IV 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central area of the user's field of vision, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to present image content to the user's field of view, which is at least partially enhanced based on ambient lighting conditions. 2. The system according to Example 1, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 3. The system according to Embodiment 1 or 2, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 4. The system according to Embodiment 3, wherein one or more light sources are configured to direct light into one or more waveguides. 5. The light source is a system according to any one of Examples 2-4, comprising a fiber scanning projector. 6. One or more capture devices: The system according to any of Examples 1-5, comprising one or more image capture devices. 7. One or more image capturing devices, comprising one or more cameras, in the system described in Example 6. 8. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-5. 9. The system according to Example 8, comprising one or more light sensors, or one or more illuminometers. 10. One or more capture devices configured to measure ambient brightness, as described in any of the above embodiments of the system. 11. The system according to any of the above embodiments, further comprising a distance measuring device. 12. The distance measuring device is the system according to Example 11, comprising a laser rangefinder. 13. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 14. The system according to any one of Examples 1-13, further comprising one or more inward-facing image capturing devices configured to form an image of the user's eye. 15. The head-mounted display system is configured, at least partially, to enlarge image content based on ambient lighting conditions, as described in any of the above embodiments. 16. The magnification is at least partially based on the resolution of the eye, as described in Example 15. 17. The head-mounted display system is configured, at least in part, to increase the brightness in image content based on ambient lighting conditions, as described in any of the above embodiments. 18. The head-mounted display system is configured, at least in part, to increase the contrast in image content based on ambient lighting conditions, as described in any of the above embodiments. 19. The head-mounted display system is configured, at least in part, to increase color saturation in image content based on ambient lighting conditions, as described in any of the above embodiments. 20. The head-mounted display system is configured, at least partially, to sharpen image content based on ambient lighting conditions, as described in any of the above embodiments. 21. The system according to Example 20, wherein sharpening includes, at least in part, adding edge enhancement features to the image content based on the ambient lighting conditions. 22. The head-mounted display system is configured, at least partially, to shift the color balance of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 23. The system is configured to provide an alert to the user and to indicate that the image content has been enhanced, as described in any of the above embodiments. 24. The alert is a visual alert, as described in Example 23. 25. The alert is an audible alert, as described in Example 23. 26. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central area of the user's field of vision, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to present image content to the user's field of view, which is at least partially de-emphasized based on ambient lighting conditions. 27. The system according to Example 26, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 28. The system according to Example 26 or 27, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 29. The system according to Example 28, wherein the one or more light sources are configured to direct light into the one or more waveguides. 30. The light source is a system according to any one of Examples 27-29, comprising a fiber scanning projector. 31. One or more capture devices, or the system according to any of Examples 26-30, comprising one or more image capture devices. 32. One or more image capturing devices, comprising one or more cameras, in the system according to Example 31. 33. One or more capture devices comprising one or more optical sensors, as described in any of Examples 26-30. 34. The system according to Example 33, comprising one or more light sensors, or one or more illuminometers. 35. One or more capture devices configured to measure ambient brightness, as described in any of Examples 26-34 of the system. 36. The system according to any of Examples 26-35, further comprising a distance measuring device. 37. The distance measuring device is the system according to Embodiment 36, comprising a laser rangefinder. 38. The system according to any of Examples 26-37, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 39. The system according to any of Examples 26-38, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 40. The head-mounted display system is configured, at least in part, to reduce the size of the image content based on the lighting conditions of the environment, as described in any of Examples 26-39. 41. The size reduction is at least partially based on the resolution of the eye, as described in Example 40. 42. The head-mounted display system is configured, at least partially, to darken or attenuate image content based on ambient lighting conditions, as described in any of Examples 26-41. 43. The head-mounted display system is configured, at least in part, to reduce the contrast in image content based on ambient lighting conditions, as described in any of Examples 26-42. 44. The head-mounted display system is configured, at least in part, to reduce color saturation in the image content based on ambient lighting conditions, as described in any of Examples 26-43. 45. The head-mounted display system is configured, at least in part, to reduce the clarity of the image content based on ambient lighting conditions, as described in any of Examples 26-44. 46. The system according to Example 45, wherein reducing sharpness includes, at least in part, enhancing or de-enhancing the edges of features within the image content based on ambient lighting conditions. 47. The head-mounted display system is configured, at least in part, to shift the color balance of the image content based on the lighting conditions of the environment, as described in any of Examples 26-46. 48. The head-mounted display system is configured, at least partially, to blur image content based on ambient lighting conditions, as described in any of Examples 26-47. 49. The blurring system according to Example 48, wherein the blurring includes blurring the image content using the same color. 50. The system according to any of Examples 26-49, configured to provide an alert to the user indicating that the image content has been de-emphasized. 51. The alert is a visual alert, as described in Example 50. 52. The alert is an audible alert, as described in Example 50 of the system. 53. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 54. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides. 55. The system according to Embodiment 54, comprising one or more light sources configured to direct light into one or more waveguides, wherein the waveguides are configured to direct light into the user's eye. 56. The system according to any one of Examples 54-55, wherein one or more light sources include a fiber scanning projector. 57. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 58. The system according to Embodiment 57, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 59. The system according to Embodiment 58, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 60. The system according to any of the above embodiments, further comprising a distance measuring device. 61. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 62. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 63. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 64. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 65. The system according to Example 64, wherein the first image modality is MRI scanning. 66. The system according to any one of Examples 64-65, wherein the second image modality is ultrasound. 67. The first image modality is a system according to any one of Examples 64-66, comprising X-ray scanning. 68. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 69. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 70. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 71. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 72. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user so as to be overlaid on the area of the human body to be dissected. 73. The apparent location of the virtual severance guideline appears to be related to the position of the patient's body part, as described in Example 72. 74. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 76. The system according to Embodiment 75, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 77. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 78. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 79. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 80. The system according to Embodiment 79, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 81. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 82. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 83. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 84. The user's medical parameters, including vital signs, are as described in Example 83 of the system. 85. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 86. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 87. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 88. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 89. The system according to Example 18, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 90. The system according to Example 18, wherein increasing contrast includes adding black, gray, white, or other colors to at least one color of the image content. 91. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 92. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 93. The system according to Example 92, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 94. The system according to Example 92 or 93, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the patient's actual anatomical structure.
[0018] Example Set IVA 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central area of the user's field of vision, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to project light to the user's eye location so as to present image content, which is at least partially enhanced based on ambient lighting conditions, to a portion of the central area of the user's field of vision. 2. Under photopic illumination conditions, the image content is enhanced inversely based on the density of the light locations projected by the cones, as described in Example 1. 3. The ambient light illumination conditions are luminance of 10 cd / m². 2 ~10 8 cd / m 2 The system according to Example 2, having the following characteristics. 4. Under scotopic illumination conditions, the image content is enhanced inversely based on the density of the light location onto which the rod is projected, as described in Example 1. 5. The ambient scotopic illumination conditions are luminance 10 -3.5 cd / m 2 ~10 -6 cd / m 2 The system according to Example 4, having the following characteristics. 6. The system according to embodiment 1, wherein under low light illumination conditions, the image content is enhanced at least partially based on the time spent under low light illumination conditions. 7. The low light illumination conditions of the environment have a luminance of 10 -3 cd / m 2 ~10 0.5 cd / m 2 The system according to embodiment 6. 8. The system according to embodiment 6 or 7, wherein the system is configured to determine whether cones or rods are dominant in the user's eye at least partially based on the time spent under low light illumination conditions. 9. The system according to any one of embodiments 6-8, wherein the image content is enhanced inversely proportional to the density of the projected light locations of the cones when the cones are dominant in the user's eye. 10. The system according to any one of embodiments 6-8, wherein the image content is enhanced inversely proportional to the density of the projected light locations of the rods of the user's eye when the rods are dominant in the user's eye. 11. The system according to any of the foregoing embodiments, comprising a timer or clock for monitoring the time spent under the illumination conditions. 12. The system according to any of the foregoing embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image in the eye. 13. The system according to any of the foregoing embodiments, wherein at least the portion of the display that is transparent and disposed in front of the user's eye is configured to project light to the user, and comprises one or more light guide tubes. 14. The system according to embodiment 13, wherein the one or more light sources are configured to direct light into the one or more light guide tubes. 15. The system according to any of embodiments 12-14, wherein the light source comprises a fiber optic scanning projector. 16. The system according to any of embodiments 1-15, wherein the one or more capture devices comprise one or more image capture devices. 17. One or more image capturing devices, comprising one or more cameras, in the system described in Example 16. 18. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-15. 19. The system according to Example 18, comprising one or more light sensors, or one or more illuminometers. 20. One or more capture devices are configured to measure the brightness of the environment, as described in any of the above embodiments of the system. 21. One or more capture devices comprising a detector array having an array of pixels, wherein the detector array is configured to integrate light levels across pixels and capture illumination conditions, as described in any of the above embodiments. 22. The system according to any of the above embodiments, comprising one or more inward-facing cameras configured to detect pupil size and capture lighting conditions, wherein one or more capture devices are included. 23. The system according to any of the above embodiments, further comprising a distance measuring device. 24. The distance measuring device is the system according to Example 23, comprising a laser rangefinder. 25. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 26. The system according to any one of Examples 1-25, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 27. The head-mounted display system is configured, at least partially, to enlarge image content based on ambient lighting conditions, as described in any of the above embodiments. 28. The magnification is at least partially based on the resolution of the eye, as described in Example 27. 29. The head-mounted display system is configured, at least in part, to increase the brightness in image content based on ambient lighting conditions, as described in any of the above embodiments. 30. The head-mounted display system is configured, at least in part, to increase the contrast in image content based on ambient lighting conditions, as described in any of the above embodiments. 31. The head-mounted display system according to Example 30, wherein the head-mounted display system is configured, at least in part, to increase contrast based on the contrast sensitivity of the eye. 32. The head-mounted display system is configured, at least in part, to increase color saturation in image content based on ambient lighting conditions, as described in any of the above embodiments. 33. The head-mounted display system is configured, at least in part, to enhance image content based on ambient lighting conditions, as described in any of the above embodiments. 34. The system according to Example 33, wherein sharpening includes, at least in part, adding edge enhancement features to the image content based on the ambient lighting conditions. 35. The head-mounted display system is configured, at least in part, to shift the color balance of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 36. The system is configured to provide an alert to the user and to indicate that the image content has been enhanced, as described in any of the above embodiments. 37. The alert is a visual alert, as described in Example 36. 38. The system according to Example 36, wherein the alert is an audible alert. 39. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 40. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 41. The system according to Embodiment 40, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 42. The system according to Embodiment 41, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 43. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 46. The system according to Example 45, wherein the first image modality is MRI scanning. 47. The system according to any one of Examples 45-46, wherein the second image modality is ultrasound. 48. The first image modality is a system according to any one of Examples 45-47, comprising X-ray scanning. 49. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 50. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 51. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 52. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 54. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 53. 55. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 56. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 57. The system according to Embodiment 56, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 58. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 61. The system according to Example 60, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 62. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 63. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 64. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor medical parameters and provide alerts based on the medical parameters. 65. Medical parameters, including vital signs, are as described in Example 64. 66. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 67. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 68. The system according to Example 21, wherein the detector array comprises outward-facing cameras configured to image the environment. 69. The head-mounted display system is configured to project light to the location of the user's eyes so as to present image content in a portion of the central region of the user's field of view, with enhanced image content presented in a portion of the peripheral region. 70. The head-mounted display system is configured to project light to the location of the user's eyes so as to present image content in a portion of the central region of the user's field of view, with the image content being augmented for image content presented in another portion of the central region. 71. The system according to any of the embodiments described above, wherein the system is configured, at least in part, to determine how to present image content in the user's eyes based on the temporal aspects of the ambient lighting conditions. 72. The system according to any of the above embodiments, wherein the display is configured to project light into the user's eye at different divergent amounts so as to present the image content as if it originated from different depths. 73. The system according to Example 30, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 74. The system according to Example 30, wherein increasing contrast includes adding black, gray, white, or other colors to at least one color of the image content. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 76. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 77. The system according to Example 76, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 78. The system according to Example 76 or 77, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the actual anatomical structure of the patient.
[0019] Example Set IVB 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, the display is configured to project light into the user's eyes to present image content in the peripheral area of the user's field of view, and at least a portion of the display is transparent so as to transmit light from a portion of the environment in front of the user to the user's eyes and provide a view of that portion of the environment in front of the user, and the display is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to project light to the user's eye location to present image content, which is at least partially enhanced based on ambient lighting conditions, to a portion of the peripheral area of the user's field of view. 2. Under photopic illumination conditions, the image content is enhanced inversely based on the density of the light locations projected by the cones, as described in Example 1. 3. The ambient light illumination conditions are luminance of 10 cd / m². 2 ~10 8 cd / m 2 The system according to Example 2, having the following characteristics. 4. Under scotopic illumination conditions, the image content is enhanced inversely based on the density of the light location onto which the rod is projected, as described in Example 1. 5. The ambient scotopic illumination conditions are luminance 10 -3.5 cd / m 2 ~10 -6 cd / m 2 The system according to Example 4, having the following characteristics. 6. The system according to Example 1, wherein, under crepuscular illumination conditions, the image content is enhanced, at least partially, based on the time spent under crepuscular illumination conditions. 7. The ambient light conditions for twilight vision are luminance 10 -3 cd / m 2 ~10 0.5 cd / m 2 The system according to Example 6, having the following characteristics. 8. The system according to Example 6 or 7, wherein the system is configured, at least in part, to determine whether cones or rods are dominant in the user's eye based on the time spent under twilight illumination conditions. 9. The system according to any of Examples 6-8, wherein the image content is enhanced inversely based on the density of light locations projected by cones when cones are dominant in the user's eye. 10. The system according to any of Examples 6-8, wherein the image content is augmented inversely based on the density of the projected light locations of the rods in the user's eye when the rods are dominant in the user's eye. 11. The system according to any of the above embodiments, comprising a timer or clock for monitoring the time spent under lighting conditions. 12. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 13. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 14. The system according to Embodiment 13, wherein the one or more light sources are configured to direct light into the one or more waveguides. 15. The light source is a system according to any one of Examples 12-14, comprising a fiber scanning projector. 16. One or more capture devices: The system according to any of Examples 1-15, comprising one or more image capture devices. 17. One or more image capturing devices, comprising one or more cameras, in the system described in Example 16. 18. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-15. 19. The system according to Example 18, comprising one or more light sensors, or one or more illuminometers. 20. One or more capture devices are configured to measure the brightness of the environment, as described in any of the above embodiments of the system. 21. One or more capture devices comprising a detector array having an array of pixels, wherein the detector array is configured to integrate light levels across pixels and capture illumination conditions, as described in any of the above embodiments. 22. The system according to any of the above embodiments, comprising one or more inward-facing cameras configured to detect pupil size and capture lighting conditions, wherein one or more capture devices are included. 23. The system according to any of the above embodiments, further comprising a distance measuring device. 24. The distance measuring device is the system according to Example 23, comprising a laser rangefinder. 25. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 26. The system according to any one of Examples 1-25, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 27. The head-mounted display system is configured, at least partially, to enlarge image content based on ambient lighting conditions, as described in any of the above embodiments. 28. The magnification is at least partially based on the resolution of the eye, as described in Example 27. 29. The head-mounted display system is configured, at least in part, to increase the brightness in image content based on ambient lighting conditions, as described in any of the above embodiments. 30. The head-mounted display system is configured, at least in part, to increase the contrast in image content based on ambient lighting conditions, as described in any of the above embodiments. 31. The head-mounted display system according to Example 30, wherein the head-mounted display system is configured, at least in part, to increase contrast based on the contrast sensitivity of the eye. 32. The head-mounted display system is configured, at least in part, to increase color saturation in image content based on ambient lighting conditions, as described in any of the above embodiments. 33. The head-mounted display system is configured, at least in part, to enhance image content based on ambient lighting conditions, as described in any of the above embodiments. 34. The system according to Example 33, wherein sharpening includes, at least in part, adding edge enhancement features to the image content based on the ambient lighting conditions. 35. The head-mounted display system is configured, at least in part, to shift the color balance of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 36. The system is configured to provide an alert to the user and to indicate that the image content has been enhanced, as described in any of the above embodiments. 37. The alert is a visual alert, as described in Example 36. 38. The system according to Example 36, wherein the alert is an audible alert. 39. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 40. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 41. The system according to Embodiment 40, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 42. The system according to Embodiment 41, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 43. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 46. The system according to Example 45, wherein the first image modality is MRI scanning. 47. The system according to any one of Examples 45-46, wherein the second image modality is ultrasound. 48. The first image modality is a system according to any one of Examples 45-47, comprising X-ray scanning. 49. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 50. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 51. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 52. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 54. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 53. 55. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 56. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 57. The system according to Embodiment 56, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 58. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 61. The system according to Example 60, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 62. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 63. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 64. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor medical parameters and provide alerts based on the medical parameters. 65. Medical parameters, including vital signs, are as described in Example 64. 66. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 67. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 68. The system according to Example 21, wherein the detector array comprises outward-facing cameras configured to image the environment. 69. The head-mounted display system is configured to project light to the location of the user's eyes so as to present image content in a peripheral area of the user's field of view, with enhanced image content presented in a portion of the central area. 70. The head-mounted display system is configured to project light to the location of the user's eyes so as to present image content to a portion of the peripheral region of the user's field of view, with enhanced image content to be presented to another portion of the peripheral region of the user's field of view, as described in any of the above embodiments. 71. The system according to any of the above embodiments, wherein the system is configured, at least in part, to determine how to present image content in the user's eyes based on the temporal aspects of the ambient lighting conditions. 72. The system according to any of the above embodiments, wherein the display is configured to project light into the user's eye at different divergent amounts so as to present the image content as if it originated from different depths. 73. The system according to Example 30, wherein increasing the contrast includes adjusting the brightness or darkness of at least one color in the image content. 74. The system according to Example 30, wherein increasing contrast includes adding black, gray, white, or other colors to at least one color of the image content. 75. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 76. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 77. The system according to Example 76, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 78. The system according to Example 76 or 77, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the actual anatomical structure of the patient.
[0020] Example Set IVC 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent so that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes and provides a view of that portion of the environment in front of the user, and the display is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, The head-mounted display system is configured, at least partially, to present image content from a first portion of the user's field of view to a second portion of the user's field of view based on ambient lighting conditions, wherein, under ambient lighting conditions, the second portion corresponds to the location of the user's eyes, which have higher visual acuity than the first portion. 2. The system according to Example 1, wherein, under photopic illumination conditions, the second part corresponds to the location of the user's eye having a higher density of cones than the first part. 3. The ambient light illumination conditions are luminance of 10 cd / m². 2 ~10 8 cd / m 2 The system according to Example 2, having the following characteristics. 4. The system according to Example 2 or 3, wherein the first part consists of a portion within the peripheral region, and the second part consists of a portion within the central region. 5. The system according to Example 2 or 3, wherein the first part consists of a portion within the central region, and the second part consists of another portion within the central region. 6. The system according to Example 2 or 3, wherein the first part consists of a portion within the peripheral region, and the second part consists of another portion within the peripheral region. 7. The system according to Example 1, wherein, under scotopic illumination conditions, the second part corresponds to the location of the user's eye, having a higher density of rods than the first part. 8. The ambient scotopic illumination conditions are luminance 10 -3.5 cd / m 2 ~10 -6 cd / m 2 The system according to Example 7, having the following characteristics. 9. The system according to Example 7 or 8, wherein the first part consists of a portion within the central region, and the second part consists of a region within the peripheral region. 10. The system according to Example 7 or 8, wherein the first part consists of a portion within the peripheral region, and the second part consists of another region within the peripheral region. 11. The system according to Embodiment 1, wherein, under crepuscular illumination conditions, the system is configured to present image content from a first part to a second part, at least partially, based on the time spent under crepuscular illumination conditions. 12. The ambient light conditions are luminance 10 -3 cd / m 2 ~10 0.5 cd / m 2 The system described in Example 11, having the following characteristics. 13. The system according to Example 11 or 12, wherein the system is configured, at least in part, to determine whether cones or rods are dominant in the user's eye based on the time spent under twilight illumination conditions. 14. The system according to any of Examples 11-13, wherein the second part corresponds to a location in the user's eye having a higher density of cones than the first part, when cones are dominant in the user's eye. 15. The system according to Example 14, wherein the first part consists of a portion within the peripheral region, and the second part consists of a portion within the central region. 16. The system according to Example 14, wherein the first part consists of a portion within the central region, and the second part consists of another portion within the central region. 17. The system according to Example 14, wherein the first part consists of a portion within the peripheral region, and the second part consists of another portion within the peripheral region. 18. The system according to any of Examples 11-13, wherein the second part corresponds to a location in the user's eye having a higher density of rods than the first part, when rods are dominant in the user's eye. 19. The system according to Example 18, wherein the first part consists of a portion within the central region and the second part consists of a portion within the peripheral region. 20. The system according to Example 18, wherein the first part consists of a portion within the peripheral region, and the second part consists of another portion within the peripheral region. 21. The system according to any of the above embodiments, comprising a timer or clock for monitoring the time spent under lighting conditions. 22. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 23. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 24. The system according to Example 23, wherein the one or more light sources are configured to direct light into the one or more waveguides. 25. The light source is a system according to any one of Examples 22-24, comprising a fiber scanning projector. 26. One or more capture devices: The system according to any of Examples 1-25, comprising one or more image capture devices. 27. One or more image capturing devices, comprising one or more cameras, in the system according to Example 26. 28. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-25. 29. The system according to Example 28, comprising one or more light sensors, or one or more illuminometers. 30. One or more capture devices are configured to measure the brightness of the environment, as described in any of the above embodiments of the system. 31. One or more capture devices comprising a detector array having an array of pixels, wherein the detector array is configured to integrate light levels across pixels and capture illumination conditions, as described in any of the above embodiments. 32. The system according to any of the above embodiments, comprising one or more inward-facing cameras configured to detect pupil size and capture lighting conditions, wherein one or more capture devices are included. 33. The system according to any of the above embodiments, further comprising a distance measuring device. 34. The distance measuring device is the system according to Example 33, comprising a laser rangefinder. 35. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 36. The system according to any one of Examples 1-35, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 37. The system according to any of the above embodiments, wherein the system is configured to provide an alert to the user indicating that the image content has been displaced from a first part to a second part. 38. The alert is a visual alert, as described in Example 37. 39. The system described in Example 37, wherein the alert is an audible alert. 40. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 41. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 42. The system according to Embodiment 41, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 43. The system according to Embodiment 42, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 46. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 47. The system according to Example 46, wherein the first image modality is MRI scanning. 48. The system according to any one of Examples 46-47, wherein the second image modality is ultrasound. 49. The first image modality is an X-ray scanning system as described in any of Examples 46-48. 50. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 51. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 52. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 54. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 55. The apparent location of the virtual severance guideline appears to be related to the position of the patient's body part, as described in Example 54. 56. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 57. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 58. The system according to Embodiment 57, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 61. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 62. The system according to Example 61, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 63. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 64. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 65. A head-mounted display configured to monitor medical parameters and provide alerts based on those medical parameters, as described in any of the above embodiments of the system. 66. Medical parameters, including vital signs, are as described in Example 65. 67. The system according to any of the above embodiments, wherein a head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 68. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 69. The system according to Example 31, wherein the detector array comprises outward-facing cameras configured to image the environment. 70. The system according to any of the above embodiments, wherein the system is configured, at least in part, to determine how to present image content in the user's eyes based on the temporal aspects of the ambient lighting conditions. 71. The system according to any of the above embodiments, wherein the display is configured to project light into the user's eye at different divergent amounts so as to present the image content as if it originated from different depths. 72. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 73. The system according to Example 72, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 74. The system according to Example 72 or 73, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the patient's actual anatomical structure.
[0021] Example Set IVD 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, the display is configured to project light into the user's eyes to present image content into the user's field of view, and at least a portion of the display is transparent so that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes and provides a view of that portion of the environment in front of the user, and the display is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, wherein the head-mounted display system is configured, at least partially, to project light to the user's eye location so as to present image content in a portion of the user's field of view based on ambient lighting conditions. 2. Under photopic illumination conditions, the projected light location is based on the density of the projected light location of the cone, as described in Example 1. 3. The ambient light illumination conditions are luminance of 10 cd / m². 2 ~10 8 cd / m 2 The system according to Example 2, having the following characteristics. 4. The system according to any of Examples 2-3, wherein a portion of the user's field of view includes a central region. 5. The projected light location is within a range of 0 to 5 degrees from the fovea, as described in any of Examples 2-4. 6. Under scotopic illumination conditions, the projected light location is based on the density of the projected light location of the rod, as described in Example 1. 7. The ambient scotopic illumination conditions are luminance 10 -3.5 cd / m 2 ~10 -6 cd / m 2 The system according to Example 6, having the following characteristics. 8. The system according to any one of Examples 6-7, wherein a portion of the user's field of view includes a peripheral area. 9. The system according to any of Examples 6-8, wherein the projected light location is within a range of 15-20 degrees offset from the fovea. 10. The system according to any of Examples 6-8, wherein the projected light location is within a range of 25-35 degrees offset from the fovea. 11. Under crepuscular illumination conditions, the projected light location is at least partially based on the time spent under crepuscular illumination conditions, as described in Example 1. 12. The ambient light conditions are luminance 10 -3 cd / m 2 ~10 0.5 cd / m 2 The system described in Example 11, having the following characteristics. 13. The system according to Example 11 or 12, wherein the system is configured, at least in part, to determine whether cones or rods are dominant in the user's eye based on the time spent under twilight illumination conditions. 14. The projected light locations are based on the density of projected light locations of cones when cones are dominant in the user's eye, according to any of the systems described in Examples 11-13. 15. The system according to Example 14, wherein a portion of the user's field of view includes a central region. 16. The system as described in Example 14, wherein the projected light location is within a range of 0 to 5 degrees offset from the fovea. 17. The projected light location is based on the density of the projected light location of the rods in the user's eye, when the rods are dominant in the user's eye, according to any of the systems in Examples 11-13. 18. The system according to Example 17, wherein a portion of the user's field of view includes a peripheral area. 19. The system described in Example 17, wherein the projected light location is within a range of 15-20 degrees offset from the fovea. 20. The system as described in Example 17, wherein the projected light location is within a range of 25 to 35 degrees offset from the fovea. 21. The system according to any of the above embodiments, comprising a timer or clock for monitoring the time spent under lighting conditions. 22. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 23. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 24. The system according to Example 23, wherein the one or more light sources are configured to direct light into the one or more waveguides. 25. The light source is a system according to any one of Examples 22-24, comprising a fiber scanning projector. 26. One or more capture devices: The system according to any of Examples 1-25, comprising one or more image capture devices. 27. One or more image capturing devices, comprising one or more cameras, in the system according to Example 26. 28. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-25. 29. The system according to Example 28, comprising one or more light sensors, or one or more illuminometers. 30. One or more capture devices are configured to measure the brightness of the environment, as described in any of the above embodiments of the system. 31. One or more capture devices comprising a detector array having an array of pixels, wherein the detector array is configured to integrate light levels across pixels and capture illumination conditions, as described in any of the above embodiments. 32. The system according to any of the above embodiments, comprising one or more inward-facing cameras configured to detect pupil size and capture lighting conditions, wherein one or more capture devices are included. 33. The system according to any of the above embodiments, further comprising a distance measuring device. 34. The distance measuring device is the system according to Example 33, comprising a laser rangefinder. 35. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 36. The system according to any one of Examples 1-35, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 37. The system is configured to provide an alert to the user and to indicate that image content has been presented, as described in any of the above embodiments. 38. The alert is a visual alert, as described in Example 37. 39. The system described in Example 37, wherein the alert is an audible alert. 40. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 41. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 42. The system according to Embodiment 41, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 43. The system according to Embodiment 42, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 46. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 47. The system according to Example 46, wherein the first image modality is MRI scanning. 48. The system according to any one of Examples 46-47, wherein the second image modality is ultrasound. 49. The first image modality is an X-ray scanning system as described in any of Examples 46-48. 50. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 51. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 52. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 54. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 55. The apparent location of the virtual severance guideline appears to be related to the position of the patient's body part, as described in Example 54. 56. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 57. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 58. The system according to Embodiment 57, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 61. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 62. The system according to Example 61, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 63. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 64. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 65. A head-mounted display configured to monitor medical parameters and provide alerts based on those medical parameters, as described in any of the above embodiments of the system. 66. Medical parameters, including vital signs, are as described in Example 65. 67. The system according to any of the above embodiments, wherein a head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 68. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 69. The system according to Example 31, wherein the detector array comprises outward-facing cameras configured to image the environment. 70. The system according to any of the above embodiments, wherein the system is configured, at least in part, to determine how to present image content in the user's eyes based on the temporal aspects of the ambient lighting conditions. 71. The head-mounted display system is configured, at least partially, to project light onto the user's eye location to present image content to a portion of the user's field of view, based on the density of projected light locations of photoreceptors, as described in any of the above embodiments. 72. The system according to any of the above embodiments, wherein the display is configured to project light into the user's eye at different divergent amounts so as to present the image content as if it originated from different depths. 73. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 74. The system according to Example 73, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 75. The system according to Example 73 or 74, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the patient's actual anatomical structure.
[0022] Example Set IVE 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes to present image content in the central area of the user's field of vision, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes, providing a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to project light to the user's eye location so as to present image content, which is at least partially de-emphasized based on ambient lighting conditions, to a portion of the central area of the user's field of vision. 2. Under photopic illumination conditions, the image content is de-enhanced based on the density of light locations projected by the cones, as described in Example 1. 3. The ambient light illumination conditions are luminance of 10 cd / m². 2 ~10 8 cd / m 2 The system according to Example 2, having the following characteristics. 4. Under scotopic illumination conditions, the image content is de-enhanced based on the density of the light location projected onto the rod, as described in Example 1. 5. The ambient scotopic illumination conditions are luminance 10 -3.5 cd / m 2 ~10 -6 cd / m 2 The system according to Example 4, having the following characteristics. 6. Under crepuscular illumination conditions, the image content is de-emphasized, at least partially, based on the time spent under crepuscular illumination conditions, according to the system of Example 1. 7. The ambient light conditions for twilight vision are luminance 10 -3 cd / m 2 ~10 0.5 cd / m 2 The system according to Example 6, having the following characteristics. 8. The system according to Example 6 or 7, wherein the system is configured, at least in part, to determine whether cones or rods are dominant in the user's eye based on the time spent under twilight illumination conditions. 9. The system according to any of Examples 6-8, wherein image content is de-enhanced based on the density of light locations projected by cones when cones are dominant in the user's eye. 10. The system according to any of Examples 6-8, wherein the image content is de-enhanced based on the density of the projected light locations of the rods in the user's eye when the rods are dominant in the user's eye. 11. The system according to any of the above embodiments, comprising a timer or clock for monitoring the time spent under lighting conditions. 12. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 13. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 14. The system according to Embodiment 13, wherein the one or more light sources are configured to direct light into the one or more waveguides. 15. The light source is a system according to any one of Examples 12-14, comprising a fiber scanning projector. 16. One or more capture devices: The system according to any of Examples 1-15, comprising one or more image capture devices. 17. One or more image capturing devices, comprising one or more cameras, in the system described in Example 16. 18. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-15. 19. The system according to Example 18, comprising one or more light sensors, or one or more illuminometers. 20. One or more capture devices are configured to measure the brightness of the environment, as described in any of the above embodiments of the system. 21. One or more capture devices comprising a detector array having an array of pixels, wherein the detector array is configured to integrate light levels across pixels and capture illumination conditions, as described in any of the above embodiments. 22. The system according to any of the above embodiments, comprising one or more inward-facing cameras configured to detect pupil size and capture lighting conditions, wherein one or more capture devices are included. 23. The system according to any of the above embodiments, further comprising a distance measuring device. 24. The distance measuring device is the system according to Example 23, comprising a laser rangefinder. 25. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 26. The system according to any one of Examples 1-25, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 27. The head-mounted display system is configured, at least partially, to reduce the size of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 28. The reduction in size is at least partially based on the resolution of the eye, as described in Example 27. 29. The head-mounted display system is configured, at least in part, to reduce the brightness in image content based on ambient lighting conditions, as described in any of the above embodiments. 30. The head-mounted display system is configured, at least in part, to reduce the contrast in image content based on ambient lighting conditions, as described in any of the above embodiments. 31. The head-mounted display system according to Example 30, wherein the head-mounted display system is configured, at least in part, to reduce contrast based on the contrast sensitivity of the eye. 32. The head-mounted display system is configured, at least in part, to reduce color saturation in image content based on ambient lighting conditions, as described in any of the above embodiments. 33. The head-mounted display system is configured, at least in part, to reduce the clarity of image content based on ambient lighting conditions, as described in any of the above embodiments. 34. The system according to Example 33, wherein sharpening includes, at least in part, de-emphasizing the edges of features within the image content based on the lighting conditions of the environment. 35. The head-mounted display system is configured, at least in part, to shift the color balance of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 36. The system according to any of the above embodiments, configured to provide an alert to the user indicating that the image content has been de-emphasized. 37. The alert is a visual alert, as described in Example 36. 38. The system according to Example 36, wherein the alert is an audible alert. 39. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 40. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 41. The system according to Embodiment 40, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 42. The system according to Embodiment 41, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 43. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 46. The system according to Example 45, wherein the first image modality is MRI scanning. 47. The system according to any one of Examples 45-46, wherein the second image modality is ultrasound. 48. The first image modality is a system according to any one of Examples 45-47, comprising X-ray scanning. 49. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 50. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 51. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 52. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 54. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 53. 55. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 56. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 57. The system according to Embodiment 56, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 58. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 61. The system according to Example 60, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 62. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 63. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 64. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor medical parameters and provide alerts based on the medical parameters. 65. Medical parameters, including vital signs, are as described in Example 64. 66. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 67. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 68. The system according to Example 21, wherein the detector array comprises outward-facing cameras configured to image the environment. 69. The head-mounted display system is configured to project light to the location of the user's eyes so that image content is presented in a portion of the central area of the user's field of view, with the image content being de-emphasized from image content presented in a portion of the peripheral area, as described in any of the above embodiments. 70. The head-mounted display system is configured to project light to the location of the user's eyes so as to present image content in a portion of the central region of the user's field of view, which is de-emphasized in relation to image content presented in another portion of the central region. 71. The system according to any of the above embodiments, wherein the system is configured, at least in part, to determine how to present image content in the user's eyes based on the temporal aspects of the ambient lighting conditions. 72. The system according to any of the above embodiments, wherein the display is configured to project light into the user's eye at different divergent amounts so as to present the image content as if it originated from different depths. 73. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 74. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 75. The system according to Example 74, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 76. The system according to Example 74 or 75, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the patient's actual anatomical structure.
[0023] Example Set IVF 1. A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region. A frame configured to be supported above the user's head, A display positioned on a frame, the display is configured to project light into the user's eyes to present image content in the peripheral area of the user's field of view, and at least a portion of the display is transparent so as to transmit light from a portion of the environment in front of the user to the user's eyes and provide a view of that portion of the environment in front of the user, and the display is positioned in front of the user's eyes when the user wears the head-mounted display system. One or more capture devices configured to capture the lighting conditions of the environment, A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display system comprising, configured to project light to the user's eye location so as to present image content, which is at least partially de-emphasized based on ambient lighting conditions, to a portion of the peripheral area of the user's field of view. 2. Under photopic illumination conditions, the image content is de-enhanced based on the density of light locations projected by the cones, as described in Example 1. 3. The ambient light illumination conditions are luminance of 10 cd / m². 2 ~10 8 cd / m 2 The system according to Example 2, having the following characteristics. 4. Under scotopic illumination conditions, the image content is de-enhanced based on the density of the light location projected onto the rod, as described in Example 1. 5. The ambient scotopic illumination conditions are luminance 10 -3.5 cd / m 2 ~10 -6 cd / m 2 The system according to Example 4, having the following characteristics. 6. Under crepuscular illumination conditions, the image content is de-emphasized, at least partially, based on the time spent under crepuscular illumination conditions, according to the system of Example 1. 7. The ambient light conditions for twilight vision are luminance 10 -3 cd / m 2 ~10 0.5 cd / m2 The system according to Example 6, having the following characteristics. 8. The system according to Example 6 or 7, wherein the system is configured, at least in part, to determine whether cones or rods are dominant in the user's eye based on the time spent under twilight illumination conditions. 9. The system according to any of Examples 6-8, wherein image content is de-enhanced based on the density of light locations projected by cones when cones are dominant in the user's eye. 10. The system according to any of Examples 6-8, wherein the image content is de-enhanced based on the density of the projected light locations of the rods in the user's eye when the rods are dominant in the user's eye. 11. The system according to any of the above embodiments, comprising a timer or clock for monitoring the time spent under lighting conditions. 12. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 13. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides configured to project light to the user. 14. The system according to Embodiment 13, wherein the one or more light sources are configured to direct light into the one or more waveguides. 15. The light source is a system according to any one of Examples 12-14, comprising a fiber scanning projector. 16. One or more capture devices: The system according to any of Examples 1-15, comprising one or more image capture devices. 17. One or more image capturing devices, comprising one or more cameras, in the system described in Example 16. 18. One or more capture devices comprising one or more optical sensors, as described in any of Examples 1-15. 19. The system according to Example 18, comprising one or more light sensors, or one or more illuminometers. 20. One or more capture devices are configured to measure the brightness of the environment, as described in any of the above embodiments of the system. 21. One or more capture devices comprising a detector array having an array of pixels, wherein the detector array is configured to integrate light levels across pixels and capture illumination conditions, as described in any of the above embodiments. 22. The system according to any of the above embodiments, comprising one or more inward-facing cameras configured to detect pupil size and capture lighting conditions, wherein one or more capture devices are included. 23. The system according to any of the above embodiments, further comprising a distance measuring device. 24. The distance measuring device is the system according to Example 23, comprising a laser rangefinder. 25. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 26. The system according to any one of Examples 1-25, further comprising one or more inward-facing image-capturing devices configured to image the user's eye. 27. The head-mounted display system is configured, at least partially, to reduce the size of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 28. The reduction in size is at least partially based on the resolution of the eye, as described in Example 27. 29. The head-mounted display system is configured, at least in part, to reduce the brightness in image content based on ambient lighting conditions, as described in any of the above embodiments. 30. The head-mounted display system is configured, at least in part, to reduce the contrast in image content based on ambient lighting conditions, as described in any of the above embodiments. 31. The head-mounted display system according to Example 30, wherein the head-mounted display system is configured, at least in part, to reduce contrast based on the contrast sensitivity of the eye. 32. The head-mounted display system is configured, at least in part, to reduce color saturation in image content based on ambient lighting conditions, as described in any of the above embodiments. 33. The head-mounted display system is configured, at least in part, to reduce the clarity of image content based on ambient lighting conditions, as described in any of the above embodiments. 34. The system according to Example 33, wherein sharpening includes, at least in part, de-emphasizing the edges of features within the image content based on the lighting conditions of the environment. 35. The head-mounted display system is configured, at least in part, to shift the color balance of the image content based on the lighting conditions of the environment, as described in any of the above embodiments. 36. The system according to any of the above embodiments, configured to provide an alert to the user indicating that the image content has been de-emphasized. 37. The alert is a visual alert, as described in Example 36. 38. The system according to Example 36, wherein the alert is an audible alert. 39. The head-mounted display system is configured to construct a 3D representation of at least a portion of the environment in front of the user, and to interpret the representation of at least a portion of the environment, wherein the portion of the environment includes a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient, according to any of the above embodiments. 40. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 41. The system according to Embodiment 40, wherein the one or more sensors comprises one or more outward-facing image capturing devices configured to image the environment. 42. The system according to Embodiment 41, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 43. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 44. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 45. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 46. The system according to Example 45, wherein the first image modality is MRI scanning. 47. The system according to any one of Examples 45-46, wherein the second image modality is ultrasound. 48. The first image modality is a system according to any one of Examples 45-47, comprising X-ray scanning. 49. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 50. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 51. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 52. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 53. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user overlaid on the area of the human body to be dissected. 54. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 53. 55. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 56. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 57. The system according to Embodiment 56, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 58. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 59. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 60. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 61. The system according to Example 60, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 62. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 63. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 64. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor medical parameters and provide alerts based on the medical parameters. 65. Medical parameters, including vital signs, are as described in Example 64. 66. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 67. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 68. The system according to Example 21, wherein the detector array comprises outward-facing cameras configured to image the environment. 69. The head-mounted display system is configured to project light to the location of the user's eyes so that image content is presented in a peripheral area of the user's field of view, with the image content being de-emphasized from the central area. 70. The head-mounted display system is configured to project light to the location of the user's eyes so as to present image content in a portion of the peripheral area of the user's field of view, which is de-emphasized in relation to image content presented in another portion of the peripheral area. 71. The system according to any of the above embodiments, wherein the system is configured, at least in part, to determine how to present image content in the user's eyes based on the temporal aspects of the ambient lighting conditions. 72. The system according to any of the above embodiments, wherein the display is configured to project light into the user's eye at different divergent amounts so as to present the image content as if it originated from different depths. 73. The system according to any of the above embodiments, wherein the head-mounted display is configured to provide a certain degree of opacity at least near the image content to be presented. 74. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 75. The system according to Example 74, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 76. The system according to Example 74 or 75, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the patient's actual anatomical structure.
[0024] Example Set V 1. A head-mounted display system for use in medical procedures and / or diagnostics, configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region, A frame configured to be supported above the user's head, A display positioned on a frame, configured to project light into the user's eyes on multiple depth planes, wherein at least a portion of the display is transparent, such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eyes and provides a view of that portion of the environment in front of the user, and is positioned in front of the user's eyes when the user wears the head-mounted display. A processing electronic device that communicates with the display and controls the presentation of image content on the display, A head-mounted display equipped with the following features. 2. The system according to Embodiment 1, wherein the head-mounted display system is configured to construct a 3D representation of at least that portion of the environment in front of the user, and to interpret the representation of at least that portion of the environment, the portion of the environment including a patient, and the head-mounted display is further configured to distinguish a first structure associated with the patient from a second structure associated with the patient. 3. The system according to any of the above embodiments, wherein at least a portion of the display, which is transparent and positioned in front of the user's eyes, comprises one or more waveguides. 4. The system according to Embodiment 3, comprising one or more light sources configured to direct light into one or more waveguides, wherein the waveguides are configured to direct light into the user's eye. 5. The system according to any one of Examples 3-4, wherein one or more light sources include a fiber scanning projector. 6. The system according to any of the above embodiments, further comprising one or more sensors configured to monitor the environment. 7. The system according to Embodiment 6, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. 8. The system according to Embodiment 7, wherein the one or more outward-facing image capturing devices configured to image the environment comprises one or more outward-facing cameras. 9. The system according to any of the above embodiments, further comprising a distance measuring device. 10. The system according to any of the above embodiments, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. 11. The system according to any of the above embodiments, wherein the head-mounted display is configured to estimate the volume of human tissue within the user's field of view. 12. The system according to any of the above embodiments, wherein the head-mounted display is configured to measure the distance between two objects in the environment. 13. The system according to any of the above embodiments, wherein the head-mounted display is configured to toggle between a first image modality and a second image modality presented on the display. 14. The system according to Example 13, wherein the first image modality is MRI scanning. 15. The system according to any one of Examples 13-14, wherein the second image modality is ultrasound. 16. The first image modality is a system according to any one of Examples 13-15, comprising X-ray scanning. 17. The system according to any of the above embodiments, further comprising an electronic emitter adapted to produce ultrasonic sound waves. 18. The system according to any of the above embodiments, further comprising a sensor adapted to convert ultrasonic sound waves into electrical signals. 19. The head-mounted display is configured to allow the user to place a virtual reference marker on a portion of the environment directly in front of the user's eyes, as described in any of the above embodiments. 20. The system according to any of the above embodiments, wherein the head-mounted display is configured to project images onto the display such that the images appear attached to real-world objects in the environment. 21. The system according to any of the above embodiments, wherein the head-mounted display is configured to display virtual dissection guidelines or to provide access to the portion to be dissected, such that the virtual dissection guidelines appear to the user so as to be overlaid on the area of the human body to be dissected. 22. The apparent location of the virtual transection guideline appears to be related to the position of the patient's body part, as described in Example 21. 23. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit signals and acquire data relating to the position of objects within a portion of the environment in front of the user. 24. The system according to any of the above embodiments, wherein the head-mounted display is configured to use a database of object locations to obtain the location of an object within a portion of the environment in front of the user. 25. The system according to Embodiment 24, wherein the head-mounted display is configured to set a reference point based on a database of object locations and to project an image into the user's eye such that the image appears fixed relative to the reference point. 26. The system according to any of the above embodiments, wherein the head-mounted display is configured to rotate a view of a 3D image of an object about an axis based on user input. 27. The system according to any of the above embodiments, wherein the head-mounted display is configured to translate a view of an image of a 3D object based on user input. 28. The system according to any of the above embodiments, wherein the head-mounted display is configured to display a first slice of a 3D image of an object. 29. The system according to Example 28, wherein the head-mounted display is configured to sequence images through a first slice and a second slice of a 3D image. 30. The system according to any of the above embodiments, wherein the head-mounted display is configured to transmit an image of a portion of the environment in front of the user so that a second user of the head-mounted display can view the image of that portion of the environment being transmitted. 31. The system according to any of the above embodiments, wherein a head-mounted display is configured to alert the user to steps in a medical procedure. 32. The system according to any of the above embodiments, wherein the head-mounted display is configured to monitor the user's medical parameters and provide alerts based on those medical parameters. 33. The user's medical parameters, including vital signs, are as described in Example 32 of the system. 34. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit ultrasound and measure signals resulting from the ultrasound, and the head-mounted display is further configured to form an ultrasound image based on the signals. 35. The system according to any of the above embodiments, wherein the head-mounted display is configured to alert the user to objects and / or events outside the user's field of view. 36. The system according to any of the above embodiments, further comprising one or more light sources configured to direct light into the user's eye and form an image within the eye. 37. The system according to any of the above embodiments, wherein one or more light sources include a fiber scanning projector. 38. The system according to any of the above embodiments, wherein the head-mounted display is configured to emit energy toward the patient and sense the returned energy. 39. The system according to Example 38, wherein the energy is ultrasonic. 40. The head-mounted display is configured to combine a first image modality with a second image modality different from the first image modality, as described in any of the above embodiments. 41. The system according to Example 40, wherein the first and second image modalities each comprise images from MRI, CT, PET, MRA, or CTA scanning. 42. The system according to Example 40 or 41, wherein the head-mounted display is configured to align the combined images of the first and second image modalities across the patient's actual anatomical structure. The present invention provides, for example, the following: (Item 1) A head-mounted display system configured to project light onto a user's eyes and display augmented reality image content within the user's field of view, wherein the head-mounted display system is A frame configured to be supported above the user's head, A head-mounted display positioned on the frame, wherein the display is configured to project light into the user's eyes and display augmented reality image content within the user's field of view at different divergent amounts as if projected from different distances from the user's eyes, and at least a portion of the display is transparent such that the transparent portion transmits light from a portion of the environment in front of the user and the head-mounted display to the user's eyes and provides a view of the portion of the environment in front of the user and the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display device, One or more user sensors configured to detect the user, One or more environmental sensors configured to sense the user's surroundings, A processing electronic device that communicates with the display, the one or more user sensors, and the one or more environmental sensors, wherein the processing electronic device is Detecting situations accompanied by increased user attention, At least in part, modifying the user's perception of real or virtual objects within the user's field of view based on the increased perception of focus. Processing electronic equipment configured to perform A head-mounted display system equipped with the following features. (Item 2) The display system according to item 1, wherein the processing electronic device is configured to modify the user's perception of real or virtual objects within the user's field of view by modifying the image content comprising the objects. (Item 3) The display system described in item 2, wherein modifying the image content includes moving the image content of the object from a first location to a second location. (Item 4) The display system according to item 3, wherein the first location is a peripheral area and the second location is a central area, or the first location is the central area and the second location is the peripheral area. (Item 5) The display system described in item 2, wherein modifying the image content includes modifying at least one of the contrast, opacity, color, color saturation, color balance, size, background, brightness, border, or sharpness of the image content comprising the object. (Item 6) The aforementioned one or more environmental sensors include a depth sensor, a pair of binocular world cameras, a geolocation sensor, a proximity sensor, or GPS, as described in any of items 1-7 of the display system. (Item 7) The aforementioned one or more user sensors are part of a display system according to any one of items 1-6, comprising one or more cameras. (Item 8) The display system according to any one of items 1-7, wherein the processing electronic device is further configured, at least in part, to determine the user's intent to the situation based on the perception of the increased focus and to modify the user's perception of real or virtual objects within the user's field of view. (Item 9) The aforementioned situation involving increased user attention includes driving an automated vehicle, as described in any of items 1-8 of the display system. (Item 10) The display system according to item 9, wherein the environmental sensor comprises a sensor configured to detect a wireless signal. (Item 11) The display system according to item 10, wherein the environmental sensor comprises a sensor configured to detect Bluetooth® signals from an automobile. (Item 12) The display system according to item 9, wherein the processing electronic device is configured, at least in part, to modify the user's perception of real or virtual objects within the user's field of view based on one or more data records relating to the user, the one or more data records including the user's driving records. (Item 13) A head-mounted display system configured to project light onto a user's eye and display augmented reality image content, wherein the user's eye has a field of view having a central region and a peripheral region arranged around the central region, and the head-mounted display system is A frame configured to be supported above the user's head, A head-mounted display positioned on the frame, wherein the display is configured to project light into the user's eyes to present image content in the central region of the user's field of vision, and at least a portion of the display is transparent such that the transparent portion transmits light from a portion of the environment in front of the user and the head-mounted display to the user's eyes, providing a view of the portion of the environment in front of the user and the head-mounted display, and is positioned in front of the user's eyes when the user wears the head-mounted display device. A processing electronic device that communicates with the display and controls the presentation of image content on the display. Equipped with, The head-mounted display system is configured to present enhanced image content in the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. (Item 14) The system according to item 10, further comprising one or more sensors configured to monitor the aforementioned environment. (Item 15) The system according to item 11, wherein the one or more sensors comprises one or more outward-facing image-capturing devices configured to image the environment. (Item 16) One or more sensors are included in the distance measuring device, as described in item 11 or 12. (Item 17) The system according to any one of items 10-13, further comprising an eye-tracking device configured to track the position and / or movement of the user's eyes. (Item 18) The head-mounted display device is configured to process image content presented in at least a portion of the central region of the user's field of view differently from image content presented in the peripheral region of the user's field of view, according to any one of items 10-15. (Item 19) The system according to item 16, wherein the head-mounted display device is configured to process image content differently by enlarging image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. (Item 20) The system according to item 16 or 17, wherein the head-mounted display device is configured to process image content differently by increasing the brightness of image content presented in at least a portion of the central region of the user's field of view compared to image content presented in the peripheral region of the user's field of view. [Brief explanation of the drawing]
[0025] [Figure 1A] Figure 1A illustrates the user's view of augmented reality (AR) through an AR device.
[0026] [Figure 1B] Figure 1B illustrates the field of view and kinetic field of view of a person.
[0027] [Figure 1C] Figures 1C-1 and 1C-2 illustrate the viewpoint of a first person in a portion of a scene, which may include central and peripheral vision locations.
[0028] [Figure 1D] Figure 1D illustrates a cross-section of a human eye.
[0029] [Figure 1E] Figures 1E and 1F illustrate the relative density and resolution of cones and rods in a typical human eye, respectively. [Figure 1F] Figures 1E and 1F illustrate the relative density and resolution of cones and rods in a typical human eye, respectively.
[0030] [Figure 1G] Figure 1G illustrates visual function under different lighting conditions.
[0031] [Figure 2] Figure 2 illustrates an embodiment of a wearable display system.
[0032] [Figure 3] Figure 3 illustrates a conventional display system for simulating a three-dimensional image for the user.
[0033] [Figure 4] Figure 4 illustrates aspects of an approach to simulating a 3D image using multiple depth planes.
[0034] [Figure 5] Figures 5A-5C illustrate the relationship between the radius of curvature and the radius of focus.
[0035] [Figure 6] Figure 6 illustrates an example of a waveguide stack for outputting image information to the user.
[0036] [Figure 7] Figure 7 illustrates an example of an output beam produced by a waveguide.
[0037] [Figure 8] Figure 8 illustrates an embodiment of a stacked waveguide assembly, where each depth plane includes an image formed using multiple different primary colors.
[0038] [Figure 9A] Figure 9A shows a cross-sectional side view of an embodiment of a stacked waveguide set, each including an internally coupled optical element.
[0039] [Figure 9B] Figure 9B shows a perspective view of an embodiment of the multiple stacked waveguides shown in Figure 9A.
[0040] [Figure 9C] Figure 9C shows top and bottom plan views of the embodiment of the multiple stacked waveguides shown in Figures 9A and 9B.
[0041] [Figure 10A] Figure 10A shows a schematic diagram of various components of an augmented reality system equipped with environmental and user sensors.
[0042] [Figure 10B] Figure 10B shows a schematic diagram of another embodiment of various components of an augmented reality system, including environmental and user sensors.
[0043] [Figure 11A] Figure 11A is a flowchart illustrating an example of a method for enhancing the user view of environmental image content.
[0044] [Figure 11B] Figure 11B is a flowchart illustrating another embodiment of a method for enhancing the user view of image content in an environment.
[0045] [Figure 12A] Figure 12A is a flowchart illustrating an example of a method for image correction.
[0046] [Figure 12B] Figure 12B illustrates exemplary uses of some embodiments described herein.
[0047] [Figure 12C] Figure 12C illustrates an example of location-based image correction.
[0048] [Figure 13A] Figure 13A is a block diagram of an embodiment of the wearable system.
[0049] [Figure 13B] Figure 13B is a process flow diagram of an example of how to render virtual content in relation to recognized objects.
[0050] [Figure 13C] Figure 13C is a block diagram of another embodiment of the wearable system.
[0051] [Figure 14] Figure 14 is a flowchart illustrating an example of a method for modifying a user's perception of real or virtual objects within their field of view, at least in part, based on user intent. [Modes for carrying out the invention]
[0052] The eye is a complex organ that collects and senses light reflected and emitted from the environment, providing useful information such as the shape, features, and location of surrounding objects. Improving the ability to perceive objects using the eyes can help in pursuing a wide range of trials. One embodiment in which enhanced vision may be particularly beneficial is for medical professionals such as surgeons when performing medical tasks such as surgical procedures, diagnoses, and / or treatments. Enhanced vision may also be useful for daily tasks that require concentration, such as operating an automobile or other vehicle.
[0053] The view of the world or its surrounding environment held by a person at any given instant is characterized by a central field of vision, which has a central and peripheral region. This field of vision may change as the person moves around, moves their head, or moves their eyes or gaze. Figure 1B shows such a field of vision 1755, including the central and peripheral regions. Figure 1B also shows the kinetic field of vision 1765, which includes a portion of the environment around the person 60 that is perceptible to the person 60, for example, by turning their head or redirecting their gaze. The central portion of the field of vision 1755 of the person 60's eyes may be referred to as the central field of vision 1745. The region within the field of vision 1755 but outside the central field of vision 1745 may be referred to as the peripheral field of vision.
[0054] The central field of view will provide the person with a corresponding view of objects within the central region of the environment view. Similarly, the peripheral field of view will provide the person with a corresponding view of objects within the peripheral region of the environment view. In this case, what is considered central and what is considered peripheral is a function of the direction the person is looking, and therefore of their field of view.
[0055] Figures 1C-1 and 1C-2 illustrate the viewpoint of a first person in a portion of a scene, which may include the central and peripheral fields of view. For example, Figure 1C-1 illustrates an embodiment of what a person sees within their field of view 1755. The field of view 1755 may include objects 1721 and 1722. As shown in Figure 1C-2, the central field of view 1745 includes object 1721, while the other object 1722 shown in Figure 1C-1 is in the peripheral field of view (e.g., the shaded area).
[0056] As shown in Figure 1D, a schematic cross-section of a human eye 1100 is depicted, featuring the cornea 42, iris 44, lens, or "crystalline lens" 46, sclera 48, choroidal layer 50, macula 52, retina 54, and the optic nerve pathway 56 to the brain. The cornea 42 and crystalline lens 46 refract and focus light toward the retina 54. The macula 52 is the center of the retina 54. At the center of the macula 52 is a part of the retina 54 called the "fovea." The retina 54 contains photoreceptor cells known as cones and rods. Near the inner surface of the retina 54 are ganglion cells that receive visual information and transmit it from the cones and rods to the brain. Visual information can include information for forming an image.
[0057] The fovea contains more photoreceptors (approximately 120 cones per diopter) than any other part of the retina. Figure 1E illustrates the relative density of cones and rods in a typical human eye, plotted as a function of angle from the center of the retina (e.g., measured from the optical axis through the lens of the eye to the center of the retina). Figure 1E shows that the relative density of cones is highest at the center of the retina (e.g., the fovea) and decreases dramatically a few degrees away from the center. In contrast, there are virtually no rods in the center, but the density of rods increases dramatically a few degrees away from the center and decreases across the retina.
[0058] Figure 1F shows the relative resolution of cones and rods across the same angular spectrum across the retina. As shown in Figure 1F, similar to cone density, the resolution of cones 1842 is highest at the fovea and decreases as the angle from the fovea increases. Similar to rod density, the resolution of rods 1846 increases first before gradually decreasing.
[0059] Because the fovea is located in the center of the eye, the central field of vision is located on the fovea. Cones are generally involved in color (e.g., L-cones or long-wavelength sensitive cones may be used for red wavelengths, M-cones or medium-wavelength sensitive cones may be used for green wavelengths, and S-cones or short-wavelength sensitive cones may be used for blue wavelengths) and spatial resolution. Rods are not color-sensitive and are generally involved in basic spatial resolution (e.g., for shape and motion detection). Because the fovea contains the highest density of cones, it provides high resolution for objects located within a person's central field of vision. As you move away from the fovea, the cone density decreases, and the resolution for objects located within a person's peripheral field of vision also decreases (e.g., from near peripheral vision to far peripheral vision). Due to the decrease in cone density from the fovea, peripheral vision can generally be associated with inferior image quality compared to that of central vision. However, it may be desirable to be able to focus the eye on an object in the central field of vision (e.g., 1745 in Figure 1B) and also to see objects in the peripheral field of vision.
[0060] Therefore, various embodiments of the display systems described herein can advantageously provide an improved user view of one or more objects within the user's peripheral field of view. For example, one embodiment may allow a user to focus on one object in the user's central field of view and, at the same time, view another object located in the user's peripheral field of view with increased visibility. As an embodiment, in a typical surgical setting, the surgeon focuses on either the patient or a medical image located at a certain distance from the operating table. The surgeon may move their eyes (and / or head) back and forth between the patient and the medical image such that one is in the surgeon's central field of view and the other is in the surgeon's peripheral field of view with lower resolution (or even more possibly, outside the surgeon's field of view). In various embodiments described herein, the display system may present image content to the surgeon so that both the patient and the medical image are visible to the surgeon simultaneously and with sufficient visual acuity (e.g., sufficient resolution). For example, some embodiments may be configured to present an augmented, i.e., moved closer to the patient, a magnified or virtual image of the medical image. Some such embodiments may reduce the time spent shifting attention between the patient and the medical image, thus allowing more time to be spent observing the patient and providing medical attention. The various embodiments described herein may also advantageously provide an improved user view of one or more objects within the user's central field of view. For example, some embodiments may provide a gray background and be configured to de-emphasize the rest of the operating room against the surgical site and / or medical image.
[0061] There are three different types of vision: photopic vision, crepuscular vision, and scotopic vision. Photopic vision, crepuscular vision, and scotopic vision each require relatively bright light (for example, in some instances, 10-10°C). 8 cd / m 2 ), intermediate (for example, in some instances, 10 -3 cd / m 2 ~100.5 cd / m 2 ), and low light (for example, in some instances, 10 -3.5 cd / m 2 ~10 -6 cd / m 2 Visual acuity is the vision of the eye under certain conditions. For example, depending on the ambient light intensity, cones, rods, or both may be activated. Cones and rods may be inversely related as they are activated between different illumination conditions. As shown in Figure 1G, cones are activated under high light conditions, while rods are activated during low light conditions. Therefore, cones are primarily used for photopic vision, and rods are primarily used for scotopic vision. Mesopic vision utilizes both cones and rods. Visual acuity can also be a function of illumination level, since it may depend on the resolution or density of cones and / or rods. Thus, the various embodiments described herein may include one or more capturing devices (e.g., one or more cameras, light sensors, light meters, etc.) that capture illumination conditions and / or at least partially present or modify (e.g., enhance, deenlarge, move, etc.) at least part of the image content based on the illumination conditions.
[0062] As photopic vision transitions to crepuscular vision, rods become more active, but not necessarily by a linear relationship. For example, the relationship may depend on the time spent in a dark environment. The darker the environment, the faster the transition from cone activity to rod activity may occur. The opposite may occur as scotopic vision transitions to crepuscular vision. By monitoring time, luminance levels, and changes in luminance levels, the amount of cones and / or rods being utilized can be determined. Thus, the various embodiments described herein may include one or more timing devices (e.g., one or more clocks or timers) to monitor time and / or at least partially to present or modify (e.g., enhance, deenlarge, move, etc.) at least a portion of the image content based on illumination conditions and / or at least partially on time under illumination conditions.
[0063] While not limited to a medical context, some embodiments described herein may be implemented for medical imaging, display, and visualization. For example, healthcare service professionals face significant demand for their physical and mental capabilities in connection with the medical services they provide. Such professionals may include, for example, physicians, surgeons, nurses, technicians, dentists, ophthalmologists, home healthcare providers, clinicians, and / or other healthcare providers. In many situations, healthcare needs demand rapid response and precise action. Professionals outside a medical context (e.g., athletes, mechanics, and chefs) may also benefit from the various embodiments described herein. Furthermore, those whose occupations and hobbies require the use of their hands while requesting information from multiple locations may also benefit from the methods and systems disclosed herein. In addition, the various embodiments described herein can also be used in daily activities, such as tasks,...
Claims
1. A display system, wherein the display system is A display, wherein the display is configured to project light into the user's eyes and display augmented reality and virtual reality image content in the user's field of view, and at least a portion of the display is transparent, and the transparent portion of the display transmits light from a portion of the environment in front of the user to the user's eyes, and the display is positioned in front of the user's eyes when the user operates the display system to provide a view of the user and the portion of the environment in front of the display, A plurality of sensors, wherein the plurality of sensors include one or more inward-facing sensors configured to sense the user's eye tracking information, and one or more outward-facing sensors configured to capture an image corresponding to at least a portion of the user's field of view, A processing electronic device that communicates with the display and the plurality of sensors, Memory that stores computer-readable instructions and Equipped with, When the computer-readable instruction is executed by the processing electronic device, the processing electronic device will: Based on eye tracking information received from one or more inward-facing sensors, the determination of the existence of a situation involving user attention includes detecting that the frequency of changes in gaze direction between the user's first gaze direction and the user's second gaze direction is greater than or equal to a threshold. Detecting user attention to an object based on an image received from one or more outward-facing sensors, wherein the object is located within the central region of the user's second field of view when the user's gaze is directed toward the second line of sight direction, and the object is located within the peripheral region of the user's first field of view when the user's gaze is directed toward the first line of sight direction, the peripheral region being within the user's field of view but outside the central region of the field of view, Modifying the user's perception of the object in the user's first field of view when the user's gaze is directed toward the first direction of gaze, at least in part, based on detecting the user's attention to the object. Perform an action that includes this, Modifying the user perception of the object in the user's first field of view when the user's gaze is directed toward the first direction of gaze includes generating virtual image content in the user's first field of view when the user's gaze is directed toward the first direction of gaze, such that the user perceives that the object is within the central region of the first field of view but not within the peripheral region of the first field of view, wherein the virtual image content includes virtual image content corresponding to the object, in a display system.
2. The display system according to claim 1, wherein modifying the user perception of the object in the user's first field of view when the user's gaze is directed toward the first gaze direction further includes modifying at least one of the contrast, opacity, color, color saturation, color balance, size, background, brightness, border, or sharpness of the virtual image content.
3. The display system according to claim 1, wherein the plurality of sensors include at least one of a depth sensor, a geolocation sensor, a camera, a proximity sensor, a radio signal sensor, and a Global Positioning System (GPS) sensor.
4. The display system according to claim 1, wherein the operation performed by the processing electronic device includes detecting the number of times the user has glanced at the object based on eye tracking information received from the one or more inward-facing sensors, and detecting user attention to the object if the number exceeds a threshold number.
5. The display system according to claim 4, wherein detecting user attention to the object is based on identifying that the user is attempting to view the object but is having difficulty with accommodation, and identifying that the user is attempting to view the object but is having difficulty with accommodation includes detecting a variation in the user's eye's accommodation based on eye tracking information received from one or more inward-facing sensors.
6. The display system according to claim 4, wherein detecting user attention to the object is based on identifying that the user is attempting to view the object but is having difficulty with accommodation, and identifying that the user is attempting to view the object but is having difficulty with accommodation includes detecting fluctuations in the convergence and divergence movements of the user's eyes based on eye tracking information received from one or more inward-facing sensors.
7. The display system according to claim 1, wherein modifying user perception includes enhancing the virtual image content corresponding to the object, and the enhancement includes one or more of the following: enlarging the virtual image content corresponding to the object, increasing the light intensity or brightness of the virtual image content corresponding to the object, increasing the contrast of the virtual image content corresponding to the object, increasing the color saturation of the virtual image content corresponding to the object, modifying the color or color balance of the virtual image content corresponding to the object, sharpening the virtual image content corresponding to the object, adding a background to the virtual image content corresponding to the object, flipping the virtual image content corresponding to the object, straightening the virtual image content corresponding to the object, or rotating the virtual image content corresponding to the object.
8. The display system according to claim 7, wherein the degree of emphasis of the virtual image content corresponding to the object is based on at least one of the distance of the object in the peripheral region of the first field of view from the fovea of the user's eye, the minimum distance for two-point distinction, and the spatial resolution of the user's eye.
9. The display system according to claim 1, wherein generating the virtual image content includes presenting the virtual image content on a depth plane located in the central region of the first field of view, which is closer to the user than a depth plane in which the object is located in the peripheral region of the first field of view.
10. The display system according to claim 1, wherein generating the virtual image content includes moving the virtual image content to a location corresponding to a projected light location of the user's eye, within a range of 0 to 10 degrees from the center of the fovea of the user's eye.
11. A computer implementation method, wherein the computer implementation method is Based on eye-tracking information received from one or more inward-facing sensors, a processing electronic device determines that a situation involving user attention exists, and determining that a situation involving user attention exists includes detecting that the frequency of changes in the user's gaze direction between the user's first gaze direction and the user's second gaze direction is greater than or equal to a threshold. Based on an image received from one or more outward-facing sensors corresponding to at least a portion of the user's field of view, the processing electronic device detects user attention to an object, wherein the object is located within the central region of the user's second field of view when the user's gaze is directed toward the second line of sight direction, and the object is located within the peripheral region of the user's first field of view when the user's gaze is directed toward the first line of sight direction, the peripheral region being within the user's field of view but outside the central region of the field of view, Modifying the user's perception of the object in the user's first field of view when the user's gaze is directed toward the first direction of gaze, at least in part, based on detecting the user's attention to the object. Includes, A computer implementation method for modifying the user perception of the object in the user's first field of view when the user's gaze is directed toward the first direction of gaze, includes causing a display system to generate and display virtual image content in the user's first field of view when the user's gaze is directed toward the first direction of gaze, such that the user perceives that the object is in the central area of the first field of view but not in the peripheral area of the first field of view, wherein the virtual image content includes virtual image content corresponding to the object.
12. The method according to claim 11, wherein modifying the user perception of the object in the user's first field of view when the user's gaze is directed toward the first gaze direction further includes modifying at least one of the contrast, opacity, color, color saturation, color balance, size, background, brightness, border, or sharpness of the virtual image content.
13. The method according to claim 11, wherein the one or more inward-facing sensors sense the user's eye tracking information, and the detection of whether the frequency of changes in the user's gaze direction is greater than or equal to the threshold is based on the eye tracking information.
14. The method according to claim 11, wherein the one or more outward-facing sensors include imaging the area around the user to acquire the image corresponding to at least a portion of the user's field of view.
15. The method according to claim 13 or 14, wherein the display system comprises a plurality of sensors, the plurality of sensors including at least one of a depth sensor, a geolocation sensor, a camera, a proximity sensor, a radio signal sensor, and a Global Positioning System (GPS) sensor.
16. The method according to claim 11, comprising detecting the number of times the user has glanced at the object based on eye tracking information received from one or more inward-facing sensors, and detecting user attention to the object when the number of glances exceeds a threshold number.
17. The method according to claim 11, wherein detecting the user attention to the object is based on identifying that the user is attempting to view the object but is having difficulty with accommodation, and identifying that the user is attempting to view the object but is having difficulty with accommodation is based on detecting a variation in the user's eye's accommodation based on eye tracking information received from one or more inward-facing sensors.
18. The method according to claim 11, wherein detecting the user's attention to the object is based on identifying that the user is attempting to view the object but is having difficulty with accommodation, and identifying that the user is attempting to view the object but is having difficulty with accommodation is based on detecting fluctuations in the convergence and divergence movements of the user's eyes based on eye tracking information received from one or more inward-facing sensors.
19. The method according to claim 11, wherein modifying user perception includes enhancing the virtual image content corresponding to the object, and the enhancement includes one or more of the following: enlarging the virtual image content corresponding to the object, increasing the light intensity or brightness of the virtual image content corresponding to the object, increasing the contrast of the virtual image content corresponding to the object, increasing the color saturation of the virtual image content corresponding to the object, modifying the color or color balance of the virtual image content corresponding to the object, sharpening the virtual image content corresponding to the object, adding a background to the virtual image content corresponding to the object, flipping the virtual image content corresponding to the object, straightening the virtual image content corresponding to the object, or rotating the virtual image content corresponding to the object.
20. The method according to claim 19, wherein the degree of emphasis of the virtual image content corresponding to the object is based on at least one of the distance of the object in the peripheral region of the first field of view from the fovea of the user's eye, the minimum distance for two-point distinction, and the spatial resolution of the user's eye.
21. The method according to claim 11, wherein causing the display system to generate and display the virtual image content includes presenting the virtual image content on a depth plane located in the central region of the first field of view, which is closer to the user than a depth plane in which the object is located in the peripheral region of the first field of view.
22. The method according to claim 11, wherein causing the display system to generate and display the virtual image content includes moving the virtual image content to a location corresponding to a projected light location of the user's eye within a range of 0 to 10 degrees from the center of the fovea of the user's eye.
23. The display system according to claim 1, wherein detecting that the frequency of changes in the gaze direction between the user's first gaze direction and the user's second gaze direction is greater than or equal to a threshold includes detecting repeated changes in the gaze direction.
24. The method according to claim 11, wherein detecting that the frequency of changes in the user's gaze direction between the user's first gaze direction and the user's second gaze direction is greater than or equal to a threshold includes detecting repeated changes in the gaze direction.