Display device and graphic for calibration

Abstract

Provided is, inter alia, a display device including a projection optical system and an eyepiece optical system that are separated, the display device being capable of calibrating video to be displayed.　The present technology provides a display device comprising: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system to a pupil of the observer; and a graphic for calibration that is disposed at a predetermined position from the projection optical system and that is for calibrating video projected to the observer. The projection optical system has a light source and a light guide unit that guides light from the light source in the direction of the observer.

Description

Display and calibration graphics

[0001] The technology according to the present disclosure (hereinafter also referred to as "the technology") relates to a display device and a calibration graphic.

[0002] 2. Description of the Related Art Conventionally, in a display device that can superimpose a virtual image on a real space and allow an observer to perceive it, a calibration technique has been developed that optimizes the image to suit the observer.

[0003] For example, Patent Document 1 discloses a technology relating to "an information processing device comprising: a recognition unit that recognizes a hand gesture of an observer, which brings a second object closer to a first object so that the positional relationship between the first object and a second object becomes a first positional relationship, based on a sensing result by a sensor unit corresponding to a viewpoint position of the observer; and a correction unit that, when it is determined that a predetermined termination condition is satisfied, corrects an interocular parameter of the observer related to the display of a virtual object by a display unit based on the recognition result of the hand gesture, wherein at least one of the first object and the second object is a virtual object."

[0004] International Publication No. 2019 / 176308

[0005] The information processing device (e.g., eyewear) of Patent Document 1 has both the part that generates the image to be projected and the part that displays the image (e.g., a lens) mounted on the eyewear, so there is no risk of their relative positions changing.

[0006] On the other hand, when the projection optical system and the eyepiece optical system are configured separately, the relative positions of the projection optical system and the eyepiece optical system are not fixed. Therefore, individual differences between devices and between observers can affect the position and size of the displayed image. As a result, calibration of the displayed image is necessary.

[0007] Therefore, a main object of the present technology is to provide a display device or the like that is capable of calibrating a displayed image in a display device in which a projection optical system and an eyepiece optical system are separated.

[0008] The present technology provides a display device including: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the observer's pupil; and a calibration figure that is arranged at a predetermined position from the projection optical system and is used to calibrate an image projected toward the observer, wherein the projection optical system includes: a light source; and a light guiding unit that guides the light from the light source toward the observer. The display device may further include a recognition unit that recognizes the positional relationship between the projection optical system and the eyepiece optical system. The recognition unit may be provided only in the projection optical system. The display device has a calibration mode that calibrates the image for the observer, and in the calibration mode, when the calibration figure is set to a first calibration figure, the display device may display a second calibration figure corresponding to the first calibration figure. The first calibration figure and the second calibration figure may be a rectangle, a circle, a vertical line, a horizontal line, a curved shape, or a shape combining these. The calibration figure may be attachable to and detachable from the projection optical system. The calibration figure may be disposed on a display surface. The display surface may be a display of an electronic device. The calibration mode may be activated when the calibration figure is attached to the projection optical system. The projection optical system may further include a control unit, and the control unit may control at least one of the light source and the light guiding unit based on input from the viewer. The control unit may adjust the position of the image in up, down, left, and right directions. The control unit may adjust the size of the image. The control unit may adjust the focus of the image. The control unit may adjust the rotation of the image. The control unit may adjust the distortion of the image. The display device has a calibration mode that calibrates the image for the viewer, and the projection optical system may further include a memory unit that stores calibration information, which is information acquired in the calibration mode. The eyepiece optical system may be a contact lens type or a glasses type. The projection optical system may be fixed to a hand.The present technology also provides a display device having: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the observer; a storage unit that stores calibration information that is information acquired in a calibration mode for calibrating an image for the observer; and a control unit that calibrates the image based on the calibration information stored in the storage unit. The present technology also provides a display device that includes a projection optical system that projects light toward an observer; and an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the observer, and provides a calibration figure that is fixed at a predetermined position from the projection optical system and is used to calibrate the image.

[0009] According to the present technology, it is possible to calibrate a displayed image even in a display device in which the projection optical system and the eyepiece optical system are separated. Note that the effects described herein are not necessarily limited to these, and may be any of the effects described in this disclosure.

[0010] FIG. 1 is a schematic diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a configuration example of a first calibration figure 31 and a second calibration figure 32 according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a configuration example of a first calibration figure 31 and a second calibration figure 32 according to an embodiment of the present technology. FIG. 1 is a block diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a positional relationship between a projection optical system 1 according to an embodiment of the present technology and a pupil 51 of a viewer. FIG. 1 is a block diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. FIG. 1 is a flow diagram showing a calibration mode in a display device 10 according to an embodiment of the present technology. FIG. 1 is a flow diagram showing a calibration mode in a display device 10 according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a configuration example of an adjustment UI 30 in the calibration mode according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing a configuration example of an adjustment UI 30 in the calibration mode according to an embodiment of the present technology. FIG. 1 is a schematic diagram showing an example configuration of an adjustment UI 30 in a calibration mode according to an embodiment of the present technology. FIG. 2 is a schematic diagram showing an example of a type of adjustment performed in a calibration mode according to an embodiment of the present technology. FIG. 3 is a schematic diagram showing an example of adjustment and control performed in a calibration mode according to an embodiment of the present technology. FIG. 4 is a schematic diagram showing an example configuration of a display device 10 according to an embodiment of the present technology. FIG. 5 is a schematic diagram showing an example configuration of an adjustment UI 30 in a calibration mode according to an embodiment of the present technology. FIG. 6 is a schematic diagram showing an example configuration of a display device 10 according to an embodiment of the present technology.

[0011] Hereinafter, preferred embodiments for implementing the present technology will be described with reference to the drawings. Note that the embodiment described below shows an example of a typical embodiment of the present technology, and does not limit the scope of the present technology. In addition, the present technology can be combined with any of the following examples and their modifications.

[0012] In the following description of the embodiments, configurations may be described using terms including "approximately," such as "approximately parallel" and "approximately perpendicular." For example, "approximately parallel" does not only mean completely parallel, but also means substantially parallel, i.e., including a state where the orientation is deviated from the completely parallel state by, for example, a few percent. The same applies to other terms including "approximately." Furthermore, each figure is a schematic diagram and is not necessarily an accurate depiction. The scale of the drawings has been exaggerated to make the features of the technology easier to understand. Therefore, it should be noted that the scale of the drawings and the scale of the actual device are not necessarily the same.

[0013] Unless otherwise specified, in the drawings, "top" means the top or upper side in the drawing, "bottom" means the bottom or lower side in the drawing, "left" means the left or left side in the drawing, and "right" means the right or right side in the drawing. Furthermore, in the drawings, the same or equivalent elements or members are given the same reference numerals, and redundant explanations will be omitted.

[0014] The description will be given in the following order: 1. First embodiment of the present technology (Example 1 of display device) (1) Overall configuration (2) Calibration figure (3) Projection optical system (4) Storage unit (5) Recognition unit (6) Eyepiece optical system (7) Calibration mode 2. Second embodiment of the present technology (Example 2 of display device) 3. Third embodiment of the present technology (Example 3 of display device) 4. Fourth embodiment of the present technology (Example 4 of display device) 5. Fifth embodiment of the present technology (Example 5 of display device) 6. Sixth embodiment of the present technology (Example of calibration figure)

[0015] [1. First Embodiment of the Present Technology (Example 1 of Display Device)] [(1) Overall Configuration] The present technology provides a display device including: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto a pupil of the observer; and a calibration figure that is arranged at a predetermined position from the projection optical system and is used to calibrate an image projected toward the observer, wherein the projection optical system has a light source and a light guiding unit that guides the light from the light source toward the observer.

[0016] A configuration example of a display device according to an embodiment of the present technology will be described with reference to Fig. 1, Fig. 2, Fig. 3, and Fig. 4. Fig. 1, Fig. 2, Fig. 3, and Fig. 4 are schematic diagrams showing a configuration example of a display device 10 according to an embodiment of the present technology.

[0017] 1, 2, and 3, the display device 10 includes a projection optical system 1 and an eyepiece optical system 2. The projection optical system 1 and the eyepiece optical system 2 are configured to be physically and electrically separated from each other. In addition, in FIGS. 2 and 3, the display device 10 further includes a calibration figure 3.

[0018] The projection optical system 1 projects light toward the observer. The eyepiece optical system 2 projects the light from the projection optical system 1 onto the observer's pupil 51. When the light projected onto the pupil 51 is projected onto the retina 52, photoreceptor cells inside the retina 52 sense the light and convert it into neural signals. These neural signals are sent to the brain via the optic nerve, where the brain interprets the signals and allows us to recognize the scenery and objects we are seeing. In this way, the observer can observe a virtual image 4 generated by AR (Augmented Reality) technology. The virtual image 4 is not limited to a still image, but may also be a video.

[0019] The projection optical system 1 is not attached to the viewer's head, but can be fixed to the viewer's hand 6, for example.

[0020] Head-mounted devices can obstruct the field of view, making it difficult to grasp the surroundings, while hand-mounted devices do not obstruct the field of view, allowing users to perform tasks and movements while remaining aware of their surroundings.

[0021] Many observers are concerned about the weight and wearing comfort of head-mounted devices, but hand-mounted devices are lighter in weight and feel less tiring than head-mounted devices, making them less tiring to wear for long periods of time.

[0022] Furthermore, hand-mounted devices can display images tailored to the task or activity, improving the efficiency of the task or activity. Head-mounted devices require the virtual image to be displayed at all times, making it difficult to hide the virtual image. On the other hand, hand-mounted devices allow the user to easily display or hide the virtual image by simply adjusting the position of the hand.

[0023] Furthermore, when the projection optical system 1 is fixed to the hand 6, the observer's line of sight is restricted because the observer looks at the projection optical system 1 like a wristwatch, which makes it easier for the recognition unit (described later) to detect the positions of the eyepiece optical system 2 and the pupil 51. In this embodiment, the shape of the projection optical system 1 is modeled after a wristwatch, but is not limited to this.

[0024] For example, the projection optical system 1 fixed to the viewer's hand 6 does not have to be in the form of a wristwatch or wristband worn on the hand, but may be in the form of a mobile terminal held in the hand. Fixing includes, for example, wearing and holding.

[0025] The projection optical system 1 may be configured so as not to be fixed to the hand 6. The projection optical system 1 may be installed in a specific location, such as a station, airport, or commercial facility, and used as digital signage. Alternatively, the projection optical system 1 placed on a table in a room may display subtitles synchronized with the television image as the virtual image 4. Alternatively, the projection optical system 1 may be attached to an existing device such as a smartphone or personal computer.

[0026] The eyepiece optical system 2 may take any shape as eyewear, such as glasses, contact lenses, or a head-mounted display.

[0027] Glasses-type devices are easy to put on and take off as needed, and the frames and lenses can be freely customized, making them fashionable. Furthermore, when the positional relationship between the eyepiece and pupil is not uniquely determined, as with glasses-type devices, there are more factors that can cause errors, making calibration more necessary.

[0028] On the other hand, contact lens-type contact lenses are shaped to fit the shape of the eyeball, so there is no risk of the position shifting over time depending on the shape of an individual's face or head, and they can provide a comfortable fit and feel to everyone.

[0029] Furthermore, in the case of contact lenses, they are placed directly on the eyeball, and there is no interference from the frame or lens thickness that occurs with eyeglasses, so light can be projected more directly onto the pupil 51. Furthermore, in the case of contact lenses, the distance between the eyepiece optical system 2 and the pupil 51 is extremely short, so the virtual image 4 is less likely to be lost.

[0030] The operation of the display device 10 will be described with reference to Figures 1, 2, and 3. When the projection optical system 1 fixed to the hand 6 is held up in front of the observer's eye, light from the projection optical system 1 is projected onto the observer's pupil 51. Then, as shown in Figure 1, the display device 10 displays a virtual image 4 around the projection optical system 1.

[0031] In this example, the virtual image 4 is displayed above the projection optical system 1 as seen by the observer. Displaying the virtual image 4 at this position facilitates alignment of the virtual image 4 with the real world, enabling expansion of the functionality of the projection optical system 1. For example, it becomes possible to enlarge a screen mounted on the projection optical system 1 and display it as the virtual image 4, or to display navigation linked to the GPS function mounted on the projection optical system 1 on the virtual image 4.

[0032] The display position of the virtual image 4 is not particularly limited, and for example, the virtual image 4 may be displayed to the left or right or below the projection optical system 1. Alternatively, the virtual image 4 may be displayed superimposed on a screen mounted on the projection optical system 1.

[0033] When the virtual image 4 is displayed above the projection optical system 1, the preferred display position of the virtual image 4 will be described below. It is preferable to display the center of the virtual image 4 below the horizontal line with the ground. If the center of the virtual image 4 is displayed above the horizontal line with the ground (especially at an angle of 25 degrees or more above the horizontal line), the head will bend upward, making it difficult to align the virtual image 4 with the real world.

[0034] The projection optical system 1 is disposed below the horizontal line with respect to the ground. When the virtual image 4 is displayed above the projection optical system 1, it is preferable to display the center of the virtual image 4 in the range from the horizontal line with respect to the ground to the line segment connecting the center of the observer's pupil 51 and the center of the projection optical system 1. Displaying the center of the virtual image 4 at this position makes it easier to align the virtual image 4 with the real world. In particular, it is preferable to display the center of the virtual image 4 in the range from the line segment tilted 15 degrees downward from the horizontal line with the ground to the line segment connecting the center of the observer's pupil 51 and the center of the projection optical system 1. Displaying the center of the virtual image 4 at a position tilted 15 degrees downward from the horizontal line with the ground allows the observer to view the virtual image 4 without strain.

[0035] When the virtual image 4 is displayed below the projection optical system 1, it is preferable to display the center of the virtual image 4 above a line segment tilted 30 degrees downward from the horizontal direction to the ground.

[0036] The projection optical system 1 can display the virtual image 4 in front of the observer's line of sight. For example, when the observer looks at the projection optical system 1, a recognition unit (described later) included in the projection optical system 1 detects the position of the eyepiece optical system 2, the pupil 51, or both. When the observer then moves his or her line of sight, the projection optical system 1 can display the virtual image 4 in front of the observer's line of sight.

[0037] Here, in the state shown in Figure 2, for example, the position of virtual image 4 may deviate from the desired position, making calibration necessary. When the observer wishes to calibrate the displayed image (virtual image 4), display device 10 transitions to calibration mode. When transitioning to calibration mode, second calibration figure 32 is projected from projection optical system 1, as shown in Figure 3. Calibration figure 3 is used to calibrate the displayed image in calibration mode. By the observer calibrating the position of second calibration figure 32, etc., the image can be displayed appropriately.

[0038] The first calibration figure 31 is placed at a predetermined position from the projection optical system 1 and is used to calibrate the image projected to the viewer. The first calibration figure 31 may be placed on the display surface 20 such as a screen as shown in Figures 2 and 3, or may be a marker 311 in the shape of some kind of figure as shown in Figure 4. When placed on the display surface 20, some kind of figure may be drawn on the display surface 20 in advance, or some kind of figure may be temporarily displayed on the display surface 20 of an electronic device such as a smartphone.

[0039] The second calibration figure 32 has a shape corresponding to the shape of the first calibration figure 31, and is projected from the projection optical system 1 in the calibration mode. Since the second calibration figure 32 is a virtual image, it is displayed so as to be superimposed on the first calibration figure 31 in the real world.

[0040] The operation of the display device 10 in the calibration mode will be described. In the display device 10, individual differences between devices (such as manufacturing variations and offset deviations) and individual differences between observers (such as interpupillary distance, physique, and posture) can sometimes prevent the observer from properly viewing the virtual image 4. In such cases, the observer can properly view the virtual image 4 by calibrating the image.

[0041] If calibration is required, the display device 10 transitions to calibration mode. When the display device 10 transitions to calibration mode, a second calibration figure 32 corresponding to the shape of the first calibration figure 31 is displayed. The observer adjusts the positional relationship between the first calibration figure 31 and the second calibration figure 32, thereby calibrating the image. The transition to calibration mode may be performed when the first calibration figure 31 is attached to the projection optical system 1. This simplifies the transition to calibration mode. Alternatively, the transition to calibration mode may be performed at each startup or by an input operation by the observer. Input operations include terminal operations, operations using a virtual image as a user interface, operations on an application, etc.

[0042] The types of calibration include calibration of the vertical and horizontal positions, size, focus, rotation, and distortion, and these calibrations can be performed by the observer making adjustments.

[0043] When the adjustment is complete, the calibration is complete and the calibration mode is terminated. For example, the calibration mode may be terminated when the first calibration figure 31 is removed from the projection optical system 1. This simplifies the termination of the calibration mode. Alternatively, the calibration mode may be terminated automatically upon completion of the calibration, or may be terminated by an input operation by the observer. The input operation may include a terminal operation, an operation using a virtual image as a user interface, an operation on an application, etc.

[0044] The information obtained by the calibration (calibration information) may be stored in a storage unit (described later). The stored calibration information is used the next time the display device 10 is used.

[0045] [(2) Calibration Figure] A configuration example of a display device according to an embodiment of the present technology will be described with reference to Fig. 5 and Fig. 6 in addition to Fig. 2 to Fig. 4. Fig. 5 and Fig. 6 are schematic diagrams showing configuration examples of a first calibration figure 31 and a second calibration figure 32 according to an embodiment of the present technology.

[0046] The first calibration figure 31 may be a marker 311 in the shape of some figure as shown in Fig. 4, or may be placed on a display surface 20 such as a screen as shown in Figs. 2, 3, 5, and 6. When placed on the display surface 20, some figure may be drawn on the display surface 20 in advance, or some figure may be temporarily displayed on the display surface 20 of an electronic device. Examples of electronic devices include smartphones, mobile phones, tablet devices, televisions, and computers.

[0047] The first calibration figure 31 is placed at a predetermined position from the projection optical system 1. The predetermined position includes the distance and angle from the projection optical system 1. For example, the predetermined position may be the position where the observer wants the virtual image 4 to be displayed. By placing the first calibration figure 31 at the position where the observer wants the virtual image 4 to be displayed and performing calibration, the virtual image 4 can be displayed at the desired position.

[0048] The first calibration figure 31 is fixed to the projection optical system 1 by a connecting portion 33, and can be attached to and detached from the projection optical system 1. The connecting portion 33 may be fixed to the projection optical system 1 by inserting, fitting, or clamping. The connecting portion 33 may be rod-shaped, plate-shaped, or holder-shaped, and may have a button or adhesive portion on a part of the connecting portion 33. Electromagnetic force may also be used for fixing.

[0049] The display device 10 has a calibration mode for calibrating the image projected by the projection optical system 1 to the viewer. In the calibration mode, a second calibration figure 32 corresponding to a first calibration figure 31 is displayed. The second calibration figure 32 is displayed by the projection optical system 1. The second calibration figure 32 may have exactly the same shape as the first calibration figure 31, or may have a different shape. If the shapes are different, the second calibration figure 32 may have a shape corresponding to the first calibration figure 31.

[0050] The shape of these calibration figures 3 is not particularly limited, and may be, for example, a rectangle, a circle, vertical lines, horizontal lines, or curved lines, or a combination thereof. It is desirable that the shape of the calibration figure 3 be one that is not too complex and that makes it easy to distinguish rotation, etc., as shown in Figures 5 and 6. In particular, a shape with a rectangle, as shown in Figure 5, makes it easier to recognize distortion in the optical axis direction than a shape with a circle, as shown in Figure 6. Furthermore, the calibration figure 3 may be a shape that resembles a living thing, a plant, food, a character, or the like.

[0051] The color of the calibration figure 3 is not particularly limited, but a color that is easily recognizable by the observer is preferable. The shape and color of the calibration figure 3 may be changeable depending on the observer, the color of the display surface 20, the ambient brightness and environment, etc., and may be linked to the observer's personal information. Furthermore, the calibration figure 3 is not limited to a still image, but may also be a video. When the calibration figure 3 is a video, sound may also be used. In this way, when the calibration figure 3 is a video such as an animation, the entertainment value is improved.

[0052] [(3) Projection Optical System] A configuration example of the projection optical system 1 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. As shown in Fig. 7, the projection optical system 1 includes at least a light source 11 and a light guide unit 12.

[0053] The light source 11 emits light corresponding to the image displayed by the display device 10. The light may be, for example, laser light or a light-emitting diode (LED). In the case of laser light, the display device 10 includes a laser unit (not shown). The laser unit may include red, green, blue, and white laser emitters, a beam splitter that combines these lasers, and the like.

[0054] Laser light has high coherency and a narrow wavelength range, so an optical system can be realized that focuses the spot on the retina even when the distance between the projection optical system 1 and the observer is large. This makes it possible to maintain high resolution. Laser light has the advantages of a high contrast ratio, a wide color gamut, and high resolution.

[0055] In this case, the projection optical system 1 further includes a scanning unit (not shown) that converts the light emitted from the laser unit into an image that can be viewed by an observer. For example, a MEMS (Micro Electro Mechanical Systems) mirror can be used as the scanning unit. The MEMS mirror scans the light from the light source 11 by changing the angle of the mirror using an electric signal. The scanning unit may or may not be included in the light source 11.

[0056] Light guide unit 12 adjusts the emission angle of light from light source 11 and emits the light toward the observer's pupil 51. Examples of components that can be used for light guide unit 12 include a mirror, a half mirror, a polarizer, a lens, a prism, a diffraction grating, and a metamaterial, and these optical members may be used in combination.

[0057] The order in which light is guided is not limited, and light from a scanning unit within light source 11 may be projected onto pupil 51 via light guide unit 12, or light from light source 11 may be scanned by a scanning unit outside light source 11 via light guide unit 12 and projected onto pupil 51.

[0058] The light guide unit 12 includes a tracking mirror 121 whose reflection angle can be controlled. The tracking mirror 121 can direct light from the light source 11 toward the observer's pupil 51. This allows the projection optical system 1 including the light source 11 to reach the observer's pupil 51 even when the projection optical system 1 is spatially separated from the pupil 51 and the eyepiece optical system 2 and the positional relationship between them changes dynamically.

[0059] The tracking mirror 121 can be driven by, for example, a gimbal system or a galvano system. Examples of gimbal-system tracking mirrors that can be used include a gimbal mirror and a MEMS (Micro-Electro-Mechanical Systems) mirror. A gimbal mirror is a mirror that can rotate on two axes. A MEMS mirror is a mirror with a microscopic mechanical structure that can be minutely vibrated and rotated using an electrical signal. This allows the emitted light to be scanned and an image to be formed.

[0060] The galvano-type tracking mirror 121 may be, for example, a galvanometer. A galvanometer is a device that scans emitted light by minutely vibrating a mirror using an electric signal. By controlling the position of the mirror, the direction of the light can be changed, allowing the emitted light to be scanned. The function of the scanning unit described above can also be performed by the tracking mirror 121.

[0061] The light guide unit 12 includes a light-collection position adjustment mechanism 122 (see FIG. 7 ) that can change the light-collection position in the optical axis direction. An example of the operation of the light-collection position adjustment mechanism 122 will be described with reference to FIG. 8 . FIG. 8 is a schematic diagram showing the positional relationship between the projection optical system 1 according to an embodiment of the present technology and the observer's pupil 51. As shown in FIG. 8 , the optical axis direction is the direction along the Z-axis direction in FIG. 8 . The light-collection position adjustment mechanism 122 is composed of optical elements, such as multiple lenses. In this case, the light-collection position in the Z-axis direction is changed by adjusting the distance between the lenses using a control signal from a control unit (described later). As described above, the optical elements may be physically moved, or the refractive index of an optical element such as a liquid crystal lens may be electrically changed.

[0062] 7, the projection optical system 1 further includes a control unit 13. The control unit 13 controls the components of the projection optical system 1, such as the light source 11 and the light guide unit 12, by sending control signals. The control unit 13 may control at least one of the light source 11 and the light guide unit 12. The control unit 13 may also operate in modes other than the calibration mode.

[0063] The control unit 13 may perform control based on the calibration information acquired during calibration. More specifically, the control unit 13 performs control by offsetting the calibration information from the information acquired from the recognition unit (described later). This control may be performed based on input by the observer, including input using an adjustment UI (described later). For example, the control unit 13 can offset the positional relationship between the projection optical system 1 and the eyepiece optical system 2 based on input by the observer by controlling at least one of the light source 11 and the light guide unit 12. In addition, the control unit 13 may perform control based on the startup of the device, the startup of a calibration mode, information in a memory unit (described later), and the like.

[0064] When the control unit 13 controls the light source 11, it controls the light emission of the light source 11 based on input image data. For example, when the light source 11 emits the aforementioned laser light, the control unit 13 controls the emission intensity and timing of the laser. When the light source 11 includes a scanning unit, the control unit 13 may further control the scanning direction and scanning timing of the scanning unit. Even when the scanning unit is included outside the light source 11 (for example, in the light guide unit 12), the control unit 13 performs similar control over the scanning unit.

[0065] When the control unit 13 controls the light guide unit 12, it controls each optical member so that the light emitted from the light source 11 is directed toward the observer's pupil 51. For example, the control unit 13 may control the angle of the optical members or the distance between the optical members, or may control the optical members to be removed from the light path.

[0066] For example, a microcontroller, a driver integrated circuit (IC), a signal generating circuit, etc. can be used as the control unit 13. The control unit 13 may be divided into multiple units depending on the objects to be controlled, or may be controlled collectively by a single control unit.

[0067] [(4) Storage Unit] A configuration example of the storage unit 14 will be described with reference to FIGS. 7 and 9 . FIG. 9 is a block diagram showing a configuration example of the display device 10 according to an embodiment of the present technology. The storage unit 14 mainly stores calibration information acquired during calibration. Examples of the calibration information include the positions of each optical member of the light guiding unit 12 after calibration, the ratio of the display range to the maximum range that the display device 10 can display, and the light projection range of the light source 11 at that time. The calibration information may be stored for each viewer, or the shape and color of the calibration figure 3 that are optimal for each viewer may be stored as the calibration information. The control unit 13 may control at least one of the light source 11 and the light guiding unit 12 based on the calibration information stored in the storage unit 14.

[0068] When the display device 10 is used alone, the storage unit 14 must be included at least in the projection optical system 1 as shown in Fig. 7. Alternatively, as shown in Fig. 9, the display device 10 may have a first storage unit 141 included in the projection optical system 1 and a second storage unit 142 included in another external electronic device, the cloud, or the like. The storage unit 14 may also store information about the display device 10 other than the calibration information.

[0069] (5) Recognition Unit An example of the configuration of the recognition unit 15 will be described with reference to FIGS. 7 and 9. As shown in FIGS. 7 and 9, the recognition unit 15 detects the positional relationship between the projection optical system 1 and the eyepiece optical system 2 or the pupil 51, or both. The positional relationship includes distance, direction, and angle. Since the positional relationship between the projection optical system 1 and the first calibration figure 31 is predetermined, the recognition unit 15 can also detect the positional relationship between the first calibration figure 31 and the eyepiece optical system 2 or the pupil 51, or both. This allows the projection optical system 1 to project light at an appropriate position. The recognition unit 15 is included in at least one of the projection optical system 1 and the eyepiece optical system 2.

[0070] The recognition unit 15 detects this positional relationship using a triangulation method or a ToF (Time of Flight) method. For example, when the recognition unit 15 has a stereo camera, the recognition unit 15 detects this positional relationship using a triangulation method. For example, when the recognition unit 15 has a ToF sensor, the recognition unit 15 detects this positional relationship using a ToF method. The ToF method is a technology for measuring distance using the time of flight of a signal. A signal such as a laser or ultrasound is irradiated onto the target, and the distance to the target is calculated by measuring the time it takes for the reflected signal to return.

[0071] Alternatively, the recognition unit 15 may detect this positional relationship using eye tracking technology based on a video processing method or an infrared method. The video processing method calculates the position of the pupil 51 and the position of the recognized part by detecting, for example, the outline of the pupil 51 and / or a recognized part (described later) arranged in the eyepiece optical system 2 from an image captured by a camera. The infrared method calculates the position of the pupil 51 and the position of the recognized part by detecting, for example, the pupil 51 and / or a recognized part (described later) arranged in the eyepiece optical system 2 from an image captured by an infrared camera.

[0072] (6) Eyepiece Optical System An example of the configuration of the eyepiece optical system 2 will be described with reference to Figures 2 and 3 again. As shown in Figures 2 and 3, the eyepiece optical system 2 can guide only the projection light from the projection optical system 1 to the retina 52 by using the functions of diffraction and focusing with wavelength selectivity and angle selectivity. This allows the observer to view the virtual image 4. In this embodiment, the shape of the eyepiece optical system 2 is that of a contact lens, but is not limited to this.

[0073] It is desirable that the eyepiece optical system 2 include as few electronic circuits and electronic components as possible in terms of weight, portability, etc. In particular, when the eyepiece optical system 2 is a contact lens type, it is desirable that it include as few electronic circuits and electronic components as possible from the viewpoints of the limited area available for arranging components, discomfort when worn, and the prevention of risks such as abnormal heat generation. Typically, the wearable device in a wearable display device has a sensor (corresponding to the recognition unit in the present disclosure) that recognizes the direction in which the viewer is looking. The presence of this sensor makes it possible to detect misalignment of calibration markers in the viewer's field of view when calibrating the display device.

[0074] However, from the above-mentioned viewpoint, it is undesirable for the eyepiece optical system 2 to have this sensor. In the present disclosure, by placing a first calibration figure 31 (corresponding to the above-mentioned calibration mark) at the position where the virtual image 4 is to be displayed, it becomes unnecessary to recognize the first calibration figure 31 from the eyepiece optical system 2. Therefore, even if the sensor (recognition unit 15) is not included in the eyepiece optical system 2 and is provided only in the projection optical system 1, the viewer can perform calibration.

[0075] The eyepiece optical system 2 may include a recognized portion (not shown). The recognized portion may be colored, may have light reflection characteristics different from those of other portions, or may be an RFID (Radio Frequency Identification) tag.

[0076] The presence of this recognized part allows the recognition unit 15 to more easily detect the position of the eyepiece optical system 2. For example, if the recognized part is given a specific color, the recognition unit 15 can identify this color and detect the position of the recognized part.

[0077] (7) Calibration Mode The calibration mode will be described with reference to Figs. 10 to 18. First, the flow of the calibration mode will be described with reference to Figs. 10 and 11. Fig. 10 is a flow diagram showing the calibration mode in the display device 10 according to an embodiment of the present technology. As shown in Fig. 10, when the display device 10 starts the calibration mode, first, in step S1-1, the projection optical system 1 displays a second calibration figure 32 corresponding to the shape of the first calibration figure 31.

[0078] Next, in step S1-2, the observer calibrates the image by adjusting the positional relationship between the first calibration figure 31 and the second calibration figure 32. The main types of calibration include the position in the up / down and left / right directions, size, focus, rotation, and distortion, and these calibrations can be performed by the observer making adjustments. These types of calibrations may be performed simultaneously or sequentially.

[0079] Next, in step S1-3, if it is determined that the adjustment is complete (step S1-3: Yes), in step S1-4, the calibration information acquired in the calibration is stored in the storage unit 14. In step S1-3, if it is not determined that the adjustment is complete (step S1-3: No), calibration is performed again from step S1-2.

[0080] After step S1-4 is completed, the display device 10 ends the calibration mode. Note that step S1-3 and step S1-4 may be performed in reverse order, and step S1-4 may not be performed.

[0081] 11 is a flow diagram showing a calibration mode in the display device 10 according to an embodiment of the present technology. As shown in step S2-1 in FIG. 11, execution of the calibration mode in step S2-2 may be started by attaching the first calibration figure 31 to a predetermined position. The process of step S2-2 includes steps S1-1 to S1-4 in FIG.

[0082] Alternatively, the trigger for starting execution of the calibration mode may be, for example, an input operation by the observer via a touch panel or a button. Furthermore, the trigger for starting execution of the calibration mode may be a gesture or voice input by the observer. In this case, the display device 10 may be provided with a sensor that recognizes the gesture or voice.

[0083] There are various adjustment methods depending on the shapes of the first calibration figure 31 and the second calibration figure 32. When the shapes of the first calibration figure 31 and the second calibration figure 32 are the same, adjustment is made so that the second calibration figure 32 overlaps the first calibration figure 31. When the shapes of the first calibration figure 31 and the second calibration figure 32 are different, adjustment is made so that they correspond correctly based on the correspondence between the shapes of the first calibration figure 31 and the second calibration figure 32. For example, when the second calibration figure 32 has the shape of a portion that is cut out or missing in the first calibration figure 31, adjustment is made so that they fit together.

[0084] During adjustment, the viewer performs the adjustment using a user interface (UI). The adjustment UI 30 will be described with reference to FIGS. 12 to 15. FIGS. 12 to 15 are schematic diagrams showing configuration examples of the adjustment UI 30 in a calibration mode according to an embodiment of the present technology. The adjustment UI 30 may be a physical UI such as a physical button attached to the projection optical system 1, the display surface 20, and the electronic device, or may be an electronic UI 301 displayed on the projection optical system 1 and the display surface 20 (such as a screen and a display of the electronic device).

[0085] The physical button may be the same as a built-in button such as a volume control button, in which case there is no need to provide a new adjustment UI 30. In the physical UI and electronic UI 301, a specific adjustment may be performed by pressing a button twice in succession or by pressing and holding the button.

[0086] Furthermore, because a display device using retinal direct imaging technology like the present technology projects light for a virtual image directly onto the retina, it can be used in situations where it is difficult to see the surroundings or by visually impaired people who have impaired eyesight due to lens abnormalities. In such cases, if the adjustment UI 30 is input by gestures or voice from the observer, adjustments can be easily made without relying on vision. Note that these adjustment UIs 30 may be used in combination.

[0087] In the case of electronic UI 301, buttons (for example, plus button 3011, minus button 3012, arrow button 3013, rotate button 3014, and distort button 3015) and slider 3016 may be displayed as in Fig. 12, or a figure 3017 simulating the second calibration figure may be displayed as in Fig. 13, Fig. 14, and Fig. 15. Also, although the example of electronic UI 301 will be described here, for a UI that can be replaced with physical buttons, similar adjustments can be made with the physical buttons.

[0088] For example, moving the slider 3016 (for size adjustment) in the plus direction enlarges the second calibration figure 32, and moving it in the minus direction reduces the second calibration figure 32. Moving the slider 3016 (for focus adjustment) in the plus direction moves the focal position of the second calibration figure 32 away from the observer in the optical axis direction, and moving it in the minus direction moves the focal position of the second calibration figure 32 toward the observer in the optical axis direction.

[0089] The change in the second calibration graphic 32 caused by moving the slider 3016 in the plus direction and the change in the second calibration graphic 32 caused by moving the slider 3016 in the minus direction may be the opposite of the changes described above. Also, the plus mark on the right end of the slider 3016 may be the plus button 3011, and pressing the plus button 3011 may result in the same change as when the slider 3016 is moved in the plus direction. The same applies to the minus mark.

[0090] When 3013A of the arrow button 3013 is pressed, the second calibration graphic 32 moves in the direction of the arrow (upward in this case). The same applies to 3013B, 3013C, and 3013D of the arrow button 3013. Diagonal arrow buttons may also be provided.

[0091] When 3014A of the rotation button 3014 is pressed, the second calibration figure 32 rotates in the direction of the arrow (clockwise in this case). The same applies to the counterclockwise direction. When 3015A of the distortion button 3015 is pressed, the second calibration figure 32 rotates in the direction of the arrow (negative Yaw direction in FIG. 8 in this case). The same applies to rotation in the positive Yaw direction. Although not shown, a distortion button corresponding to pitch rotation may also be provided. In FIG. 12, arrow marks are drawn on the rotation button 3014 and distortion button 3015, but letters or symbols may also be used. Furthermore, the marks may be drawn near the buttons rather than on them.

[0092] When a figure 3017 simulating the second calibration figure is displayed as shown in FIGS. 13 , 14 , and 15 , the figure can be moved, enlarged, and rotated by a touch operation. For example, when a finger is kept in contact with the display surface and slid as shown in FIG. 14 , the second calibration figure 32 moves in the direction of the slide. When two or more fingertips are placed in contact with the display surface and the fingertips are brought closer to one point as shown in FIG. 15 , the second calibration figure 32 shrinks. Conversely, when the fingertips are moved farther apart, the second calibration figure 32 expands. Furthermore, specific adjustments may be made by operations such as two consecutive taps. In this way, when making adjustments using the figure 3017 simulating the second calibration figure, the observer can make the adjustments more intuitively.

[0093] The adjustment method for each calibration will be described with reference to Fig. 16 . Fig. 16 is a schematic diagram showing an example of the type of adjustment performed in the calibration mode according to an embodiment of the present technology. In this embodiment, when performing any calibration, the observer uses the adjustment UI 30 to perform adjustment so that the second calibration figure 32 overlaps the first calibration figure 31. Calibration information by the observer is sent to the control unit 13, and the control unit 13 controls at least one of the light source 11 and the light guiding unit 12.

[0094] When a positional deviation occurs, the viewer sees the image as shown in Fig. 16A. The ideal display position of the virtual image is the position of first calibration figure 31, but in reality it is displayed at the position of second calibration figure 32. A case where the virtual image 4 is calibrated by controlling the light source 11 will be described with reference to Fig. 17.

[0095] 17 is a schematic diagram showing an example of adjustment and control performed in a calibration mode according to an embodiment of the present technology. As shown in FIG. 17 , the second calibration figure 32 is displayed in advance with a display range 42 that is narrower than the maximum range 41 that the display device 10 can display (for example, 80% of the maximum range). (In this case, for ease of understanding, both the virtual image 4 to be displayed and the second calibration figure 32 are images of dogs.) This creates a 20% adjustment margin 43. The second calibration figure 32 can be moved using this adjustment margin 43, making it appear as if the virtual image 4 has been moved to the correct position. Note that although the adjustment margin is set to 20% of the maximum range here, the range of the adjustment margin can be changed depending on the application of the display device, etc.

[0096] When controlling the tracking mirror 121 of the light guiding unit 12, the position where the first calibration figure 31 and the second calibration figure 32 overlap is set as the reference position, and the angle of the tracking mirror 121 is offset. In this way, the correct angle is reset as the reference position, and thereafter, the virtual image can be displayed at the correct position.

[0097] When a size misalignment occurs, the viewer sees the image shown in FIG. 16B. The ideal size of the virtual image is that of the first calibration figure 31, but in reality, it is displayed at the size of the second calibration figure 32. When this occurs, an adjustment margin 43 is provided in advance, similar to the control of the light source 11 in the case of the positional misalignment described above in FIG. 17. For example, if there is an adjustment margin of 20% for the maximum displayable range 41 of the display device, the second calibration figure 32 can be enlarged or reduced in the range of 0 to 125% of its original size. This adjustment margin 43 can be used to enlarge or reduce the second calibration figure 32, making it appear as if the virtual image 4 has changed to the correct size.

[0098] When the image is out of focus, the observer will see something like that shown in Figure 16C. Ideally, the virtual image would be displayed clearly, but in reality, it is displayed out of focus, as shown by the second calibration figure 32. If this occurs, the focusing position is changed by controlling the optical elements of the focusing position adjustment mechanism 122 of the light guide unit 12. Control of the optical elements includes position control and control of the characteristics of the optical elements. Depending on the combination of optical elements, changing the focusing position may also change the display size of the virtual image, in which case the size deviation is also corrected at the same time.

[0099] When rotational deviation occurs, the viewer sees the image as shown in Fig. 16D. An ideal virtual image is displayed in a state where it is not rotated, like the first calibration figure 31, but in reality it is displayed rotated, like the second calibration figure 32. Rotational deviation occurs when the virtual image undergoes a roll rotation in Fig. 8. Roll rotation refers to the rotation of the virtual image around the optical axis (the Z axis in Fig. 8) as the rotation axis, and a roll rotation in the positive direction is counterclockwise when viewed from the positive Z axis direction.

[0100] When such a rotational deviation occurs, an adjustment margin 43 is provided in advance, similar to the control of the light source 11 for the positional deviation and focus deviation described above. Since it is desirable to rotate the virtual image 4 within a range narrower than the maximum range 41 that the display device can display, an adjustment margin 43 is required for the rotation. By using this adjustment margin 43 to rotate the second calibration figure 32, it is possible to make the virtual image 4 appear as if it has been changed to the correct orientation. Note that when the virtual image 4 rotates, part of the virtual image 4 may extend beyond the maximum range 41.

[0101] When distortion occurs, the viewer sees the image as shown in Figure 16E. An ideal virtual image would be displayed without distortion, as shown in the first calibration figure 31, but in reality, it is displayed distorted, as shown in the second calibration figure 32.

[0102] Distortion occurs when the virtual image undergoes pitch rotation or yaw rotation in Fig. 8. Pitch rotation refers to rotation of the virtual image around an axis (X axis in Fig. 8) perpendicular to the optical axis (Z axis in Fig. 8). Rotation in the positive pitch direction is counterclockwise when viewed from the positive X axis. Yaw rotation refers to rotation of the virtual image around an axis (Y axis in Fig. 8) perpendicular to both the optical axis (Z axis in Fig. 8) and the X axis. Rotation in the positive Yaw direction is counterclockwise when viewed from the positive Y axis.

[0103] If it appears like this, an adjustment allowance 43 is provided in advance, similar to the control of the light source 11 for the positional deviation, focus deviation, and rotation deviation described above. Because distortion of the virtual image 4 can only be corrected within a range narrower than the maximum displayable range 41 of the display device, an adjustment allowance 43 is required to correct the distortion. This adjustment allowance 43 can be used to correct the distortion of the second calibration figure 32, making it appear as if the distortion of the virtual image 4 has disappeared. Note that although the distortion caused by pitch rotation or yaw rotation of the virtual image has been described above, distortion can also occur due to various other factors (such as distortion of optical components and distortion caused by temperature).

[0104] The above description of the display device according to the first embodiment of the present technology can be applied to other embodiments of the present technology unless there is a particular technical contradiction.

[0105] 2. Second Embodiment of the Present Technology (Example 2 of Display Device) When the first calibration figure 31 is arranged on a display surface 20 (display) of an electronic device such as a smartphone 40, the viewer can easily perform calibration even when out and about. This will be described with reference to Fig. 18 and Fig. 19. Fig. 18 is a schematic diagram showing a configuration example of a display device 10 according to an embodiment of the present technology, and Fig. 19 is a schematic diagram showing a configuration example of an adjustment UI 30 in a calibration mode according to an embodiment of the present technology.

[0106] 18 , the first calibration figure 31 is displayed on the display surface 20 of a smartphone 40, which is an example of an electronic device. The smartphone 40 may be fixed to the projection optical system 1 or the observer's hand 6 by a smartphone holder 33, or may be held by the observer with the other hand than the hand 6.

[0107] After the smartphone 40 is fixed, the display device 10 transitions to a calibration mode. The transition to the calibration mode is performed by an input operation by the observer or by connecting the smartphone 40 to the projection optical system 1. The connection may be a wired connection or a wireless connection (such as Bluetooth (registered trademark)). Alternatively, an application for calibrating the display device 10 may be installed on the smartphone 40, and the calibration mode may be activated or adjustments may be performed on the application.

[0108] After switching to the calibration mode, the second calibration figure 32 is projected, and the observer makes adjustments using the adjustment UI 30. In this embodiment, as shown in FIG. 19 , the display of the smartphone 40 can also be used as the electronic UI 301. The display of the smartphone 40 includes a first calibration figure display unit 401 and an electronic UI unit 402. It is preferable that the first calibration figure display unit 401 and the electronic UI unit 402 are adjacent to each other. Because the first calibration figure display unit 401 and the electronic UI unit 402 are close to each other, the observer's line of sight movement during adjustment can be reduced, making adjustments easier.

[0109] After the adjustment is complete, the calibration information may be stored in the memory of the smartphone 40 or in the cloud via an application. In this case, the storage unit 14 is included in the memory of the smartphone 40 or in the cloud. For example, the data stored in the cloud via an application may be linked to personal information such as the application's login ID. In this case, when multiple people use one display device 10, calibration each time the device is worn can be simplified or made unnecessary by calling up each person's calibration information via the application.

[0110] The above description of the display device according to the second embodiment of the present technology can be applied to other embodiments of the present technology unless there is a particular technical contradiction.

[0111] 3. Third Embodiment of the Present Technology (Third Example of Display Device) In the embodiments described above, examples have been described in which the first calibration figure 31 and the second calibration figure 32 have the same shape. In this embodiment, a case in which the first calibration figure 31 and the second calibration figure 32 have different shapes will be described with reference to Fig. 20 . Note that in any of the embodiments, the first calibration figure 31 and the second calibration figure 32 may have the same shape or different shapes.

[0112] Fig. 20 is a schematic diagram showing a configuration example of a display device according to an embodiment of the present technology. In Fig. 20A , the second calibration figure 32 has a shape that is cut out in the first calibration figure 31. In this case, the observer adjusts the second calibration figure 32 so that it fits into the portion cut out in the first calibration figure 31. In Fig. 20B , the second calibration figure 32 has a shape that fits into the portion missing in the first calibration figure 31. In this case, the observer adjusts the second calibration figure 32 so that it fits into the portion missing in the first calibration figure 31. As described above, when the second calibration figure 32 has the shape of the portion cut out or missing in the first calibration figure 31, calibration may be performed by fitting them together, and the second calibration figure 32 may have entertainment value such as a puzzle game or an animation that uses sound.

[0113] The above description of the display device according to the third embodiment of the present technology can be applied to other embodiments of the present technology unless there is a particular technical contradiction.

[0114] 4. Fourth Embodiment of the Present Technology (Example 4 of Display Device) In the embodiments described above, examples have been described in which the eyepiece optical system 2 is a contact lens type. In this embodiment, a case in which the eyepiece optical system 2 is a glasses type will be described with reference to Fig. 21 . Note that in all of the embodiments, the eyepiece optical system 2 can be a head-mounted display type or an eye-band type in addition to the contact lens type and glasses type.

[0115] Fig. 21 is a schematic diagram showing a configuration example of a display device 10 according to an embodiment of the present technology. In Fig. 21, an observer is wearing a spectacle-type eyepiece optical system 2. Spectacle-type eyepieces can be easily attached and detached as needed, and the frames, lenses, etc. can be freely customized, making them highly fashionable. In addition, because hygiene management is easier than with contact lenses, the same spectacle-type eyepiece optical system 2 can be shared and used by multiple observers.

[0116] When the positional relationship between the eyepiece optical system 2 (lens portion of the glasses) and the viewer's eye is not uniquely determined, as in the case of glasses, the factors that cause errors increase, and therefore the need for calibration increases.

[0117] The above description of the display device according to the fourth embodiment of the present technology can be applied to other embodiments of the present technology unless there is a particular technical contradiction.

[0118] [5. Fifth Embodiment of the Present Technology (Fifth Example of Display Device)] The present technology provides a display device including: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto a pupil of the observer; a storage unit that stores calibration information that is information acquired in a calibration mode that calibrates an image for the observer; and a control unit that calibrates the image based on the calibration information stored in the storage unit.

[0119] This embodiment will be described with reference to FIGS. 7 and 9 again. FIGS. 7 and 9 are block diagrams showing an example configuration of a display device 10 according to an embodiment of the present technology. As shown in FIGS. 7 and 9 , the display device 10 includes a storage unit 14. The storage unit 14 stores calibration information obtained by image calibration. Examples of the calibration information include the position of the optical members of the light guiding unit 12 after calibration, the ratio of the display range 42 to the maximum range 41 that the display device can display, and the light projection range of the light source 11 at that time. The calibration information may be stored for each observer, or the shape and color of the calibration figure 3 that are optimal for each observer may be stored as the calibration information. Based on the calibration information stored in the storage unit 14, the control unit 13 calibrates the image. At that time, the control unit 13 may control at least one of the light source 11 and the light guiding unit 12.

[0120] The stored calibration information may be used for calibration the next time the observer uses the display device 10. In this way, once calibration is performed, calibration can be easily performed the next time the display device 10 is used. For example, if the observer's posture when performing calibration is approximately the same as the observer's posture the next time they use the display device 10, calibration can be performed automatically based on the calibration information stored in the storage unit 14. This allows the observer to properly view the virtual image 4 without having to take the time to make adjustments themselves.

[0121] The stored calibration information may be used to determine the initial position of the second calibration figure 32 during calibration the next time the observer uses the display device 10. This facilitates adjustment by the observer even if the observer's posture when performing calibration differs from the observer's posture the next time they use the display device 10. More specifically, because it is thought that the observer's posture habits do not change significantly, determining the initial position of the second calibration figure 32 based on the calibration information can reduce the amount of adjustment required to complete calibration.

[0122] When the display device 10 is used alone, the storage unit 14 must be included in at least the projection optical system 1 as shown in Fig. 7, but may also be included in other external electronic devices, the cloud, etc. as shown in Fig. 9. The storage unit 14 may also store information about the display device 10 other than the calibration information.

[0123] The above description of the display device according to the fifth embodiment of the present technology can be applied to other embodiments of the present technology unless there is a particular technical contradiction.

[0124] [6. Sixth Embodiment of the Present Technology (Example of Calibration Figure)] The present technology provides a calibration figure that is placed at a predetermined position from the projection optical system and is used to calibrate an image in a display device that includes a projection optical system that projects light toward a viewer, and an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the viewer.

[0125] This calibration figure will be described again with reference to FIGS. 2 and 4. FIGS. 2 and 4 are schematic diagrams showing an example of the configuration of the display device 10 according to this embodiment. As shown in FIGS. 2 and 4, the first calibration figure 31 is fixed to the projection optical system 1 via a connecting portion 33. This allows the first calibration figure 31 to be positioned at a predetermined position from the projection optical system 1. In FIG. 4, instead of the first calibration figure 31 being drawn on the display surface 20 or the like as in FIG. 2, the first calibration figure 31 itself exists as a marker 311. When the first calibration figure 31 is the same figure, the area of ​​the display surface 20 can be reduced by an amount obtained by subtracting the area of ​​the first calibration figure 31 from the area of ​​the display surface 20 compared to when the first calibration figure 31 is positioned on the display surface 20. Furthermore, the first calibration figure 31 may be configured to be foldable and portable.

[0126] The above description of the display device according to the sixth embodiment of the present technology can be applied to other embodiments of the present technology unless there is a particular technical contradiction.

[0127] It should be noted that the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible within the scope of the present technology. The specific numerical values, shapes, materials (including compositions), etc. described in each embodiment are merely examples, and the present technology is not limited to these.

[0128] The present technology can also be configured as follows. [1] A display device comprising: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the observer's pupil; and a calibration figure that is arranged at a predetermined position from the projection optical system and is used to calibrate an image projected toward the observer, wherein the projection optical system comprises: a light source; and a light guiding unit that guides the light from the light source toward the observer. [2] The display device according to [1], further comprising a recognition unit that recognizes a positional relationship between the projection optical system and the eyepiece optical system. [3] The display device according to [2], wherein the recognition unit is provided only in the projection optical system. [4] The display device according to any one of [1] to [3], having a calibration mode that calibrates the image for the observer, and in the calibration mode, when the calibration figure is a first calibration figure, displays a second calibration figure that corresponds to the first calibration figure. [5] The display device according to any one of [1] to [4], wherein the calibration figure is a rectangle, a circle, a vertical line, a horizontal line, a curved line, or a shape combining these. [6] The display device according to any one of [1] to [5], wherein the calibration figure is attachable to and detachable from the projection optical system. [7] The display device according to any one of [1] to [6], wherein the calibration figure is arranged on a display surface. [8] The display device according to [7], wherein the display surface is a display of an electronic device. [9] The display device according to any one of [4] to [8], wherein the calibration mode is activated when the calibration figure is attached to the projection optical system.

[10] The display device according to any one of [1] to [9], wherein the projection optical system further includes a control unit, and the control unit controls at least one of the light source and the light guiding unit based on input from the viewer.

[11] The display device according to

[10] , wherein the control unit adjusts the position of the image in the up, down, left, and right directions.

[12] The display device according to

[10] or

[11] , wherein the control unit adjusts the size of the image.

[13] The display device according to any one of

[10] to

[12] , wherein the control unit adjusts the focus of the image.

[14] The display device according to any one of

[10] to

[13] , wherein the control unit adjusts the rotation of the image.

[15] The display device according to any one of

[10] to

[14] , wherein the control unit adjusts the distortion of the image.

[16] The display device according to any one of [1] to

[15] , wherein the display device has a calibration mode for calibrating the image with respect to the viewer, and the projection optical system further includes a storage unit for storing calibration information, which is information acquired in the calibration mode.

[17] The display device according to any one of [1] to

[16] , wherein the eyepiece optical system is a contact lens type or a glasses type.

[18] The display device according to any one of [1] to

[17] , wherein the projection optical system is fixed to a hand.

[19] A display device having: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the observer; a memory unit that stores calibration information that is information acquired in a calibration mode for calibrating an image for the observer; and a control unit that calibrates the image based on the calibration information stored in the memory unit.

[20] A display device having a projection optical system that projects light toward an observer; and an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the observer, wherein a calibration figure is arranged at a predetermined position from the projection optical system and is used to calibrate the image.

[0129] 10 Display device 20 Display surface 1 Projection optical system 11 Light source 12 Light guide unit 121 Tracking mirror 122 Light collection position adjustment mechanism 13 Control unit 14 Memory unit 15 Recognition unit 2 Eyepiece optical system 3 Calibration figure 31 First calibration figure 32 Second calibration figure 33 Connection unit 4 Virtual image 5 Observer's eye 51 Pupil 52 Retina 6 Observer's hand 30 Adjustment UI 301 Electronic UI 3011 Plus button 3012 Minus button 3013 Arrow button 3014 Rotation button 3015 Distortion button 3016 Slider 3017 Figure imitating second calibration figure 40 Smartphone 401 First calibration figure display unit 402 Electronic UI unit

Claims

1. A display device comprising: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the observer; and a calibration figure that is positioned at a predetermined position from the projection optical system and is used to calibrate the image projected toward the observer, wherein the projection optical system has: a light source; and a light guiding section that guides the light from the light source toward the observer.

2. The display device according to claim 1, further comprising a recognition unit that recognizes the positional relationship between the projection optical system and the eyepiece optical system.

3. The display device according to claim 2, wherein the recognition unit is provided only in the projection optical system.

4. The display device according to claim 1, wherein the display device has a calibration mode for calibrating the image for the observer, and in the calibration mode, when the calibration figure is a first calibration figure, a second calibration figure corresponding to the first calibration figure is displayed.

5. The display device according to claim 4, wherein the first calibration figure and the second calibration figure are in the shape of a rectangle, a circle, a vertical line, a horizontal line, a curve, or a combination thereof.

6. The display device according to claim 1, wherein the calibration figure is attachable to and detachable from the projection optical system.

7. The display device according to claim 1, wherein the calibration graphic is disposed on a display surface.

8. The display device according to claim 7, wherein the display surface is a display included in an electronic device.

9. The display device according to claim 4, wherein the calibration mode is activated when the calibration graphic is attached to the projection optical system.

10. The display device according to claim 1, wherein the projection optical system further includes a control unit, and the control unit controls at least one of the light source and the light guide unit based on an input from the viewer.

11. The display device according to claim 10, wherein the control unit adjusts the position of the image in the up / down and left / right directions.

12. The display device according to claim 10, wherein the control unit adjusts the size of the image.

13. The display device according to claim 10, wherein the control unit adjusts the focus of the image.

14. The display device according to claim 10, wherein the control unit adjusts the rotation of the image.

15. The display device according to claim 10, wherein the control unit adjusts distortion of the image.

16. The display device according to claim 1, wherein the display device has a calibration mode for calibrating the image for the observer, and the projection optical system further comprises a memory unit for storing calibration information, which is information acquired in the calibration mode.

17. The display device according to claim 1, wherein the eyepiece optical system is a contact lens type or a pair of glasses type.

18. The display device according to claim 1, wherein the projection optical system is fixed to a hand.

19. A display device having: a projection optical system that projects light toward an observer; an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the pupil of the observer; a memory unit that stores calibration information, which is information obtained in a calibration mode that calibrates an image for the observer; and a control unit that calibrates the image based on the calibration information stored in the memory unit.

20. In a display device comprising a projection optical system that projects light toward an observer, and an eyepiece optical system that is separated from the projection optical system and projects the light from the projection optical system onto the observer's pupil, a calibration figure that is placed at a predetermined position from the projection optical system and is used to calibrate the image.

Images