Vision assistance device
The visual support device addresses misalignment and limited viewing issues by using a wide-angle camera with an enlarged display and control features, ensuring safe and efficient visual recognition for users with impairments.
Patent Information
- Application Number
- PCT/JP2025/023295
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-30
- Filing Date
- 2025-06-27
- Publication Date
- 2026-01-08
AI Technical Summary
Existing visual support devices suffer from misalignment of virtual and real images, limited viewing area, cumbersome operation, high cost due to light-shielding structures, and difficulty in selecting projection areas, which can lead to accidents and inconvenience for users with visual impairments.
A visual support device with a head-mounted configuration featuring a wide-angle camera, display unit, and control device that includes an enlarged area display, black-and-white inversion, recording and zoom functions, and adjustable display dimensions, allowing easy and safe visual recognition.
The device enhances visibility by aligning virtual and real images, enlarging relevant areas, and providing user-friendly operation, reducing the risk of misrecognition and accidents, while being cost-effective and easy to use.
Smart Images

Figure JP2025023295_08012026_PF_FP_ABST
Abstract
Description
Visual Support Devices
[0001] The present invention relates to a visual support device that facilitates visibility by projecting an image captured by a wide-angle camera onto a projection unit as a virtual image. In particular, the present invention relates to a visual support device that allows a specific area to be enlarged and displayed. In the following description, terms such as "front" and "rear" are used. "Front" refers to the front side of the face when the wearer wears the visual support device on their head, "rear" refers to the rear side of the face, "left" refers to the left side of the face when the wearer wears the visual support device on their head, and "right" refers to the right side of the face when the wearer wears the visual support device on their head. Furthermore, visual support encompasses visual impairment support, such as scotopic vision support, visual field support, and visual acuity support. Furthermore, terms such as "first" and "second" that indicate order are used to distinguish between devices with the same name, and the presence or absence of these terms does not affect the interpretation of the rights.
[0002] The first prior art is known as the following visual support technology for low vision (also called amblyopia or low visual acuity). If normal vision is represented as Figure (A), low vision can be categorized into a narrow range of vision (Figures 10(B) and (C)), a state in which the center of the visual field is not visible (Figure 10(D)), a state in which a white haze is present, or a state in which vision is only blurred overall (Figure 10(E)). The first prior art is considered to be used to improve the narrow range of vision, the state in which the center of the visual field is not visible, and the state in which a white haze is present. A head-mounted display that assists the vision of a wearer with low vision, comprising: an imaging means that captures an image in the direction the wearer is looking through a camera lens; and a display means that displays the image captured by the imaging means to the wearer, wherein the camera lens is a wide-angle lens, and the depression angle is set to satisfy the following formula 1, where θ is the depression angle of the optical axis of the camera lens from the horizontal direction when the head-mounted display is worn, α is the angle of view of the camera lens, and β is the allowable tilt angle of the wearer's head (head-mounted display 90-β-α / 2<θ<α / 2... (Formula 1)) (see Patent Document 1).
[0003] The second prior art is a convenient method for projecting an image of a defective retinal area onto a defect projection section that faces the non-defective retinal area when the defective retinal area cannot be seen due to a defect in the retina (see Patent Document 2).
[0004] A third prior art technique is known that detects the wearer's movements and automatically enlarges the text displayed (see Patent Document 3).
[0005] A fourth prior art technique is known in which a real image captured by a camera and a different part of the image are extracted from wide-angle shooting information by operation and then played back and displayed. Extracting and playing back a desired part is very convenient (see Patent Document 4).
[0006] As a fifth prior art, when an image projected on a transmission type projection unit is displayed in black and white inversion, it is known to shield the transmission type projection unit from light (see Patent Document 5).
[0007] Patent No. 7246708 Patent Gazette Patent No. 6989611 Patent Gazette Special Publication No. 2022-502798 Patent No. 4573095 Patent Gazette Patent No. 6544901 Patent Gazette
[0008] In the first prior art, an image captured by a camera is clearly projected as a virtual image onto a head-mounted display configured with a display surface in front of the head, allowing the wearer to view the image together with a see-through real image. This is useful because the virtual image may appear clearly relative to the real image. However, because the camera's optical axis has a depression angle, the see-through real image and the virtual image displayed on the head-mounted display appear misaligned. This will be explained with reference to Figure 10. Figure 10(A) shows a wearer looking up a staircase 10. The solid line represents the real image 12 viewed through the display surface, and the dashed line represents the virtual image 14 displayed on the display surface. For example, if the wearer has stenosis, the field of view is narrow. For example, in Figure 10, the visible range is within the circular frame 16. The square frame 18 represents the display surface on which the projected image is displayed. Therefore, when the wearer wears the visual field support device, the dashed virtual image 14 appears above the real image 12 within the circular frame 16, as shown in Figure 10(B). For example, if the depression angle θ is 9 degrees and the angle of view of the wide-angle lens is 50 degrees, the virtual image 14 projected onto the display surface relative to the real image 12 of the stairs 10 at a distance of one meter appears to float upward by a predetermined length L, specifically, approximately 10 centimeters, as shown in Figure 10(C). This raises concerns that if the wearer mistakes the virtual image 14 for the real image 12, they may step empty-footed or lose their footing, leading to an accident. Specifically, if a person walks in accordance with the virtual image 14, they may step hard to land on the stairs of the virtual image 14 seen above, but because the stairs 10 are virtual images 14, they step empty-footed, potentially leading to an accident. The same applies to descending stairs. In the second prior art, when viewing a portion hidden by the defective projection, the user must inconveniently move the shooting location, and therefore the head. In the third prior art, when an enlarged display is displayed, the viewable area is narrow, making it difficult to locate the desired part. In the fourth conventional technology, it is cumbersome to select the required projection area by operation, and therefore an easily usable visual support device is desired. In the fifth conventional technology, the adoption of a light-shielding structure for the transmission-type projection unit makes it expensive, and therefore a device that is as inexpensive as possible is desired.
[0009] An object of the present invention is to provide a visual support device that can easily support visual recognition without the risk of visual misrecognition.
[0010] In order to achieve the above object, a first aspect of the present invention is configured as follows: A visual support device including a head holder to be worn on the head of a wearer, a wide-angle camera device attached to the head holder, a display unit provided on the head holder for displaying images visible to the wearer, and a control device for controlling the display of images captured by the wide-angle camera device on the display unit, wherein the control device includes an enlarged area display unit that causes the display unit to display a wide-area display unit and an enlarged display unit, and that displays, on the wide-area display unit, an enlarged area unit that represents an enlarged image area to be displayed on the enlarged display unit.
[0011] In order to achieve the above object, a second aspect of the present invention is configured as follows: The control device is the visual support device of the first aspect of the invention, characterized in that it includes a black-and-white inversion display unit for the image.
[0012] A third aspect of the present invention is configured as follows: The control device is the visual support device of the first or second aspect, characterized in that it is provided with a recording unit for recording still images of the video, and at least a zoom-in button or a zoom-out button, and enlarges and displays the still image based on operation of the zoom-in button, or reduces and displays the still image based on operation of the zoom-out button.
[0013] A fourth aspect of the present invention is configured as follows: The visual support device according to the third aspect of the present invention is characterized in that the enlarged or reduced display is performed around the center of the still image.
[0014] A fifth aspect of the present invention is configured as follows: The visual support device according to the first or second aspect of the present invention is characterized in that the control device includes a display unit position control unit that controls the positions of the wide-area display unit and the enlarged display unit.
[0015] A sixth aspect of the present invention is configured as follows: The control device is the visual support device of the first or second aspect of the present invention, characterized in that it includes a character size determination unit that determines the size of characters on the wide-area display unit in the image captured by the wide-angle camera device, and when the character size determination unit determines that the size is equal to or smaller than a predetermined size, it displays the enlarged display unit to enlarge and display a portion of the characters displayed on the wide-area display unit.
[0016] A seventh aspect of the present invention is configured as follows: The visual support device of the first or second aspect of the present invention further includes a display dimension designation unit, and the control device changes the display dimension in the enlarged display unit based on an instruction from the display dimension designation unit.
[0017] An eighth aspect of the present invention is configured as follows: The visual support device of the first or second aspect of the present invention is further provided with a luminance setting unit, and an upper limit of luminance on the display device is set by operating the luminance setting unit.
[0018] A ninth aspect of the present invention is configured as follows: The visual support device according to the first or second aspect of the present invention is characterized in that the display unit includes a projection unit that projects the image and a display surface that displays the image from the projection unit, the projection unit includes a right projection unit and a left projection unit, and the display surface includes a right display surface and a left display surface.
[0019] A tenth aspect of the present invention is configured as follows: The visual support device of the first or second aspect of the present invention, wherein the display unit includes a display device that displays the image, and the display device includes a right display device and a left display device.
[0020] An eleventh aspect of the present invention is configured as follows: The visual support device of the ninth aspect of the invention includes a left / right eye display selection unit that selects the projection from the right projection unit or the left projection unit.
[0021] A twelfth aspect of the present invention is configured as follows: The visual support device of the tenth aspect of the invention includes a left / right eye display selection unit that selects the image to be displayed on the right display device or the left display device.
[0022] A thirteenth aspect of the present invention is configured as follows: A visual support device according to the first or second aspect of the present invention, further comprising an image position setting unit, which displays a reduced image obtained by reducing the image captured in the effective field of view by the wide-angle camera device at a predetermined reduction rate in a predetermined non-field-of-view defect area.
[0023] A fourteenth aspect of the present invention is configured as follows: The visual support device according to the first or second aspect of the present invention includes a strabismus correction unit, which displays a refracted image obtained by refracting the image captured by the wide-angle camera device with a predetermined refractive index.
[0024] In the present invention, a wearer wears a head holder on his or her head. An image is acquired by a wide-angle camera device attached to the head holder, and the image is displayed on a display unit so that the wearer can view it. The image is controlled by a control device and displayed on the display unit in a predetermined format. The predetermined format includes a wide-area display unit and an enlarged display unit. The wide-area display unit displays an enlarged area display unit representing an enlarged image area, and the image in the enlarged area display unit is displayed on the enlarged display unit. As a result, when the wearer wears the head holder on his or her head and points the wide-angle camera device at a position he or she wants to view, the image captured by the wide-angle camera device is displayed on the wide-area display unit of the display unit, and an enlarged area display unit representing the enlarged area is displayed on the wide-area display unit. An image of a region surrounded by the enlarged area displayed on the wide-area display unit is displayed at a predetermined magnification in the enlarged display unit of the display unit. Therefore, by superimposing the region he or she wants to enlarge on the enlarged area unit, the enlarged area unit is enlarged and displayed on the enlarged display unit, which easily improves visibility and advantageously achieves the object of the present invention.
[0025] FIG. 1 is a perspective view of a visual support device according to a first embodiment of the present invention, where (A) is a perspective view from above the front, and (B) is a perspective view from above the rear. FIG. 2 is a visual support device according to the first embodiment of the present invention, where (A) is a plan view, (B) is a front view, (C) is a right side view, and (D) is a front view with a filter shown in phantom. FIG. 3 is a visual support device according to the first embodiment of the present invention, where (A) is a perspective view from above the front showing the relationship between the light guide and the head-mounted device, (B) is a front view of the light guide, (C) is a plan view of the light guide, (D) is a right side view of the light guide, and (E) is an exploded plan view of the light guide. FIG. 4 is a partial view of the visual support device according to the first embodiment of the present invention, where (A) is a cross-sectional view along line AA in FIG. 2B, (B) is a front view of the camera device, (C) is an enlarged cross-sectional view along line BB in FIG. 4B, (D) is an enlarged vertical cross-sectional view of the camera unit, and (E) is a vertical cross-sectional view of the left projection device. FIG. 5 is a block diagram of a control device of the visual support device of Example 1 according to the present invention. FIG. 6 is a right side view of the head of a wearer wearing the visual support device of Example 1 according to the present invention. FIG. 7 is a head cross-sectional view horizontally cut at the eye portion of a wearer wearing the visual support device of Example 1 according to the present invention. FIG. 8 is an explanatory diagram for explaining the zoom function of the visual support device of Example 1 according to the present invention, in which (A) is a projected image at the time of capture, (B) is a projected image in an enlarged state, (C) is a projected image in a state where a still image is scrolled, (D) is a projected image of an enlarged specific portion of (C), (E) is a projected image of the wide-area display section and the enlarged display section, (F) is an example where the enlarged area section is not transparent, (G) is an example where the positions of the wide-area display section and the enlarged display section are swapped, and (H) is a projected image of the tilted wide-area display section and the enlarged display section. FIG. 9 is a flowchart and a functional explanatory diagram for explaining the zoom function of the visual support device of Example 1 according to the present invention. FIG. 10 is an explanatory diagram of the operation of a conventional visual support device. Fig. 11 shows a visual support device according to a second embodiment of the present invention, in which (A) is a plan view showing a cross section of a wearer, (B) is a front view showing a filter with a dashed dotted line, and (C) is a partial cross section taken along line AA in (B). Fig. 12 is a block diagram of a control device of the visual support device according to the second embodiment of the present invention.FIG. 13 is an explanatory diagram of the operation of a control device of a visual support device according to a second embodiment of the present invention, where (A) is an explanatory diagram of video information, (B) is an explanatory diagram of frames, (C) is an explanatory diagram of luminance information, (D) is a frequency graph for explaining luminance analysis, (E) is an explanatory graph for luminance adjustment, and (F) is an operation flowchart of the luminance setting unit. FIG. 14 is an explanatory diagram of a diagonal scrolling device of a visual support device according to a second embodiment of the present invention, where (A) is a plan view of the diagonal scrolling device and (B) is an explanatory diagram of its operation. FIG. 15 is an explanatory diagram for explaining an image position setting unit of a control device of a visual support device according to a second embodiment of the present invention. FIG. 16 is an explanatory diagram for explaining an image position setting unit of a control device of a visual support device according to a second embodiment of the present invention, where (A) is an example of a scene seen by a normal eye, (B) is an example of a scene seen by an eye with a visual field defect, and (C) is an explanatory diagram of the image position setting unit. 17 is an explanatory diagram for explaining the operation of a strabismus correction unit of a control device of a visual support device according to a second embodiment of the present invention, where (A) is an explanatory diagram for a normal case, (B) is an explanatory diagram for a case of diplopia, (C) is an explanatory diagram for a case of confused vision, and (D) is an explanatory diagram for the function of the strabismus correction unit. FIG. 18 is an explanatory diagram for explaining the operation of a left-right eye display selection unit of a control device of a visual support device according to a second embodiment of the present invention, where (A) is an explanatory diagram for a field of view when the right eye is blind, and (B) is an explanatory diagram for a field of view when the left eye is blind. FIG. 19 is an explanatory diagram for explaining the operation of a left-right eye display selection unit of a control device of a visual support device according to a second embodiment of the present invention, where (A) is an explanatory diagram for a normal case, and (B) is an explanatory diagram for a field of view when the right eye is blind.
[0026] The visual support device of the present invention may be configured as follows: It is a visual support device including a head holder attached to the head of a wearer, a wide-angle camera device attached to the head holder, a display unit provided on the head holder for displaying a display visible to the wearer, and a control device for controlling the display of an image captured by the wide-angle camera device on the display unit, wherein the control device preferably includes an enlarged area display unit that causes the display unit to display a wide-area display unit and an enlarged display unit, and that displays an enlarged area on the wide-area display unit that represents an enlarged image area to be displayed on the enlarged display unit. The control device is preferably a visual support device of the first invention, characterized in that it includes a black-and-white inversion display unit for the image. Furthermore, the control device is preferably a visual support device of the first or second invention, characterized in that it includes a recording unit for recording still images of the image and at least an enlargement button or a reduction button, and that enlarges and displays the still image based on operation of the enlargement button, or reduces and displays the still image based on operation of the reduction button. Furthermore, the visual support device of the third invention is preferably characterized in that the enlarged or reduced display is performed around the center of the still image. Furthermore, the visual support device of the first or second invention is preferably characterized in that the control device includes a display unit position control unit that controls the arrangement of the wide-angle display unit and the enlarged display unit. Furthermore, the visual support device of the first or second invention is preferably characterized in that the control device includes a character size determination unit that determines the size of characters in the wide-angle display unit of characters in the image captured by the wide-angle camera device, and when the character size determination unit determines that the size is equal to or smaller than a predetermined size, the control device displays the enlarged display unit to enlarge a portion of the characters displayed on the wide-angle display unit. Furthermore, the visual support device of the first or second invention is preferably characterized in that a display size designation unit is provided, and the control device changes the display size of the enlarged display unit based on an instruction from the display size designation unit. Furthermore, the visual support device of the first or second invention is preferably characterized in that a brightness setting unit is provided, and an upper limit of the brightness of the display device is set by operating the brightness setting unit.Furthermore, the visual support device of the first or second invention is preferably characterized in that the display unit includes a projection unit that projects an image and a display surface that displays the image from the projection unit, the projection unit including a right projection unit and a left projection unit, and the display surface including a right display surface and a right display surface. Furthermore, the visual support device of the first or second invention is preferably characterized in that the display unit includes a display device that displays an image, the display device including a right display device and a left display device. Furthermore, the visual support device of the ninth invention is preferably characterized in that it includes a left-right eye display selection unit that selects the image to be displayed on the right display device or the left display device. Furthermore, the visual support device of the tenth invention is preferably characterized in that it includes a left-right eye display selection unit that selects the image to be displayed on the right display device or the left display device. Furthermore, the visual support device of the first or second invention is preferably characterized in that it includes an image position setting unit that displays a reduced image, obtained by reducing an image captured in the effective field of view by the wide-angle camera device at a predetermined reduction rate, in a predetermined non-field-of-view-defect portion. It is also preferable that the visual support device of the first or second invention includes a strabismus correction unit, which displays a refracted image obtained by refracting the image captured by the wide-angle camera device at a predetermined refractive index.
[0027] An overview of a visual support device 100 according to a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. In the description of the first embodiment, the terms "left" and "right" are used to refer to the right or left in a state in which a wearer wears the eyeglass-type visual support device 100 on their head HD. The visual support device 100 according to the present invention has a function of supporting the wearer's vision. More specifically, the visual support device 100 according to the first embodiment is scotopic vision / visual field support eyeglasses. In this first embodiment, the visual support device 100 is configured in an eyeglass-type configuration and includes at least a head-mounted device 102 and a control device 104.
[0028] First, the head mounting device 102 will be described mainly with reference to Figure 1. The head mounting device 102 holds a wide-angle camera device 108 and a frame 112 and has the function of mounting them on the head. In this embodiment 1, the head mounting device 102 is composed of at least the wide-angle camera device 108, the frame 112, a projection device 114, a head holder 116 for holding the frame 112 on the head, nose pads 118, and a filter 122. More specifically, the head mounting device 102 is configured in the shape of glasses, with the frame 112 positioned in front of the face of the wearer WP and the head holders 116 positioned on both sides of the face (head).
[0029] Next, the frame 112 will be described mainly with reference to FIG. 3. The frame 112 has a function of forming the display unit 109 and also having a function of mounting the wide-angle camera device 108, head holder 116, and nose pads 118. The frame 112 is rectangular bar-shaped, and a housing 134 and one end of the head holder 116 are attached to both ends of the frame 112, respectively. The nose pads 118 are attached to the lower center of the frame 112, and a filter 122 is attached to the front side of the frame 112 in a replaceable manner, forming a glasses-like configuration. The frame 112 also forms the projection unit 110, and is therefore composed of a light guide 124 and a transparent body 126. In this Example 1, the projection unit 110 is formed by the display surface 106. As shown in Figure 3, the frame body 112 is configured to be approximately rectangular in front view and approximately bow-shaped rod-like in plan view, and is made up of a transparent body 126 arranged in the middle part, a left light guide 124L fixed to the left end face of the transparent body 126, and a right light guide 124R fixed to the right end face of the transparent body 126.
[0030] Next, the display unit 109 will be described. The display unit 109 has a function of displaying an image captured by the wide-angle camera device 108 so that the wearer WP can view it. In this embodiment 1, the display unit 109 is composed of a projection device 114 and a display surface 106. With this configuration, image information VI projected from the projection device 114 is projected onto the display surface 106 via the light guide 124, so that the wearer WP can view it with their left eye EYEL and right eye EYER. However, the display unit 109 can also be an electronic display panel such as an organic EL display or a liquid crystal panel. In this embodiment 1, the display unit 109 is composed of a right display unit 109R and a left display unit 109L, the right display unit 109R being composed of a right projection device 114R and a right display surface 106R, and the left display unit 109L being composed of a left projection device 114L and a left display surface 106L. Note that the display unit 109 can be replaced with another device having a similar function.
[0031] Next, the transparent body 126 will be described mainly with reference to FIG. 3. The transparent body 126 constitutes the central portion of the frame body 112 and is made of a transparent material, allowing the wearer to see ahead through the transparent body 126. Furthermore, in this embodiment 1, the transparent body 126 has a function to which the wide-angle camera device 108 is fixed. Therefore, it can be replaced with another device having a similar function. In this embodiment 1, the transparent body 126 is made of transparent resin to reduce weight, and is configured in a gate shape with a recess 128 formed in the lower central portion when viewed from the front. The transparent body 126 can also be made of transparent glass. The transparent body 126 is composed of a left transparent body portion 126L, a right transparent body portion 126R, and a connecting portion 126J connecting them. The connecting portion 126J is positioned offset toward the upper side of the transparent body 126, forming a recess 128 below the center of the transparent body 126. The left transparent body portion 126L and the right transparent body portion 126R are connected by the connecting portion 126J, which is thin in the vertical direction, forming an inverted U-shape in front view. The transparent body 126 is formed in a dogleg shape in plan view. The connecting portion 126J also has a front mounting groove 126F and a rear mounting groove 126B for fixing the camera device main body 162. The front mounting groove 126F and the rear mounting groove 126B are grooves that extend in the vertical direction. The transparent body left end surface 126LE and the transparent body right end surface 126RE of the transparent body 126 are formed to have a parabolic shape in a plan view. In other words, the transparent body left end surface 126LE and the transparent body right end surface 126RE are formed to be line-symmetrical so as to present a concave curved surface with respect to the head HD of the wearer WP. The shapes of the transparent body left end surface 126LE and the transparent body right end surface 126RE are such that they come into surface contact with the display surface 106 formed on the end surface of the light guide body 124, which will be described later.
[0032] Next, the light guide 124 will be described. The light guide 124 has a function of receiving the image light VL ( FIG. 4 ) projected from the projection device 114 through a light incident surface 124I, guiding the image light VL by reflection, and projecting the image light VL onto the display surface 106, which is the projection unit 110. In other words, the light guide 124 is formed of a prism, and has a function of guiding the image light VL incident on the light incident surface 124I of the light guide 124, and projecting the image light VL onto the display surface 106 provided on the other end surface. In the first embodiment, the light guide 124 is formed by a left light guide 124L connected to a left end surface 126LE of the transparent body, and a right light guide 124R connected to a right end surface 126RE of the transparent body. The left light guide 124L and the right light guide 124R have the same configuration but are formed in line symmetry, so the left light guide 124L will be described as a representative, and the same parts of the right light guide 124R will be described by replacing the L at the end of the same numeral with an R, thereby omitting the description.
[0033] The left light guide 124L is a thick plate with a left light incident surface 124LI formed at one end and a left display end surface 124LM formed at the other end. The left light incident surface 124LI and the left display end surface 124LM are formed with a relative phase shift of approximately 90 degrees. The center portion of the left display end surface 124LM is covered with a known optically transparent reflective film to form the left display surface 106L. Therefore, the left display surface 106L is optically transparent and functions as a total reflection surface, thereby functioning as a screen (projection) for images. In other words, the left display surface 106L is formed by a left reflective film 132L, which is an optically transparent reflective film 132. The left reflective film 132L is formed, for example, by depositing a metal reflective film or a dielectric multilayer film. The left display end surface 124LM is formed in a parabolic shape and is in close surface contact with the left end surface 126LE of the transparent body. The left display end surface 124LM is formed in a part of the center of the end surface of the left light guide 124L, and the peripheral end surface portion of the left reflective film 132L, which is the left display surface 106L, is firmly adhered and fixed to the transparent body left end surface 126LE of the transparent body 126, thereby integrating the transparent body 126 and the left light guide 124L. In this embodiment 1, the left reflective film 132L is formed in a horizontally elongated rectangular shape. Most of the left light guide 124L, excluding the left light incident surface 124LI, is disposed in front of the left eye EYEL, and the left display surface 106L forms a part of it. The same is true for the right light guide 124R. In this embodiment 1, the left display surface 106L is a transmissive type, but it can be made a non-transmissive type.
[0034] Next, the projection device 114 will be described with reference to FIG. 4. The projection device 114 has a function of projecting an image captured by the wide-angle camera device 108 onto the display surface 106, which is the projection unit 110, via the light guide 124. In this embodiment 1, a known projection device 114 is used as the projection device 114. Specifically, a left projection device 114L that projects light onto a left light incident surface 124LI of the left light guide 124L and a right projection device 114R that projects light onto a right light incident surface 124RI of the right light guide 124R are provided. The projection device 114 is preferably a color projection device, but may also be a monochrome projection device. The projection device 114 is provided in a housing 134 fixed to the frame 112. The projection device 114 may be another device having a similar function.
[0035] Next, the projection unit 110 in this embodiment 1 will be described with reference to FIG. 3. The projection unit 110 is a so-called screen that has the function of displaying an image projected by a projection device 114. In this embodiment 1, the projection unit 110 is configured with a display surface 106, which is configured with a right display surface 106R and a left display surface 106L. Therefore, the projection unit 110 includes a right projection unit 110R and a left projection unit 110L, with the right projection unit 110R being the right display surface 106R and the left projection unit 110L being the left display surface 106L. Although the right display surface 106R and the left display surface 106L have the same configuration, they are configured symmetrically with respect to the camera axis CCL (see FIG. 7) as the center line. Therefore, the left display surface 106L will be described as a representative, and the right display surface 106R will be described by replacing the "L" added to the end of the same numeral with an "R" and omitting its description. The left display surface 106L is configured on a left display end surface 124LM formed on the left light guide 124L. The projection unit 110 may be a total reflection type, which is different from the transmission type.
[0036] Next, the housing 134 will be described with reference to FIG. 4. The housing 134 houses the projection device 114 and the like, and has the function of configuring the head mounted device 102 to have a good appearance. In this embodiment 1, the housing 134 is fixed to an end of the frame body 112. Specifically, the left housing 134L is fixed to the left end of the frame body 112, and the right housing 134R is fixed to the right end of the frame body 112. In this embodiment 1, the left housing 134L and the right housing 134R have the same structure and are arranged symmetrically with respect to the camera axis CCL of the wide-angle camera device 108. The left housing 134L will be described as a representative, and the description of the right housing 134R will be omitted by replacing the L at the end of the same numeral with an R. The left housing 134L is configured in a roughly rectangular box shape, and the left projection device 114L is disposed inside, with its front end fixed to the left end of the frame body 112. One end of a left head holder 116L serving as the head holder 116 is fixed to the inner side surface of the left housing 134L. A left filter locking portion 136L serving as a filter locking portion 136 for attaching a filter 122 is provided on the front surface of the left housing 134L. An illuminance sensor 138 is provided on the front surface of the left housing 134L. In this embodiment, a scale adjustment button 188, a moving image button 194M constituting the still / moving image switch button 194, and a split enlargement button 198 are disposed on the top surface of the right housing 134R. A brightness adjustment button 192 for adjusting brightness, a still image button 194S constituting the still / moving image switch button 194, a split stop button 200, and a black and white inversion display portion 202 are disposed on the top surface of the left housing 134L. The functions of these buttons will be described later.
[0037] Next, the illuminance sensor 138 will be described. The illuminance sensor 138 has the function of detecting the brightness (amount of received light) around the visual support device 100 and changing the amount of current output in accordance with the amount of received light. In this first embodiment, a light-receiving element such as a phototransistor or photodiode is used, which converts the received light (illuminance) into a current and outputs a current corresponding to the illuminance. It is preferable that the illuminance of the projection device 114 be automatically adjusted based on the output from the illuminance sensor 138.
[0038] An upper cover 142 for improving the appearance is provided on the upper side of the frame body 112 between the right housing 134R and the left housing 134L.
[0039] Next, the head holder 116 will be described. The head holder 116 has the function of holding the frame 112 so that it does not fall off the head HD of the wearer WP. Therefore, other devices having a similar function can be used as the head holder 116. In this embodiment 1, the head holder 116 is attached to the housing 134, sandwiches the head HD, and holds the head-mounted device 102 on the head HD of the wearer WP. In this embodiment 1, the head holder 116 is composed of a left head holder 116L and a right head holder 116R, each formed in the shape of an elastic, elongated thin plate and one end of which is fixed to the housing 134. In detail, the head holder 116L is composed of one end of the left head holder 116L fixed to the left housing 134L, and one end of the right head holder 116R is fixed to the right housing 134R. With this configuration, the right side of the wearer WP's head HD is held by the right head holder 116R, and the left side by the left head holder 116L, and they are placed on the left and right auricles AC (right auricle ACR, left auricle ACL), as shown in Figures 2(A) and 6, and the nose pad 118 determines the position of the front frame body 112, thereby holding the head-worn device 102 in a predetermined position. Note that one end of the right head holder 116R can be attached to the right housing 134R, and one end of the left head holder 116L can be attached to the left housing 134L, each rotatable by a hinge, like the temples of ordinary eyeglasses.
[0040] Next, the nose pads 118 will be described mainly with reference to FIGS. 2 and 6. The nose pads 118, in cooperation with the frame 112 and the head holder 116, function to hold the head-mounted device 102 in a predetermined position on the head HD. Therefore, other devices having a similar function may be used as the nose pads 118. In this embodiment 1, the nose pads 118 are composed of an inverted V-shaped wire 118W fixed to the back of the wide-angle camera device 108, which is fixed to the frame 112, and a left pad 118L and a right pad 118R fixed to the left and right ends of the wire 118W. With this configuration, part of the weight of the frame 112 and the like is supported by the left and right bases of the nose NZ of the wearer WP via the nose pads 118. The predetermined position is a state in which, as shown in FIG. 6, the horizontal camera axis CCL of the wide-angle camera device 108 overlaps with the line of sight VP when the wearer WP is standing upright with the line of sight VP horizontal.
[0041] Next, the filter 122 will be described with reference to FIG. 2 . The filter 122 functions to suppress the entry of specific light. In other words, it blocks or reduces light of specific wavelengths to prevent a wearer WP who experiences discomfort or pain when exposed to strong light in their eyes EYE from experiencing such a disability. In this embodiment, a spectacle-type filter capable of selectively blocking short wavelengths (blue light) is used as the filter 122. When it is not necessary to control specific light, the filter 122 can be used to protect the frame 112 or enhance the overall fashionability of the visual aid device 100. The filter 122 is made of resin in the shape of a roughly horizontally elongated thin plate, giving it elasticity. It is detachably attached to the housing 134 by a filter locking portion 136. The filter 122 has locking recesses 156 at its ends. In this embodiment, a semicircular left locking recess 156L is formed at the left end, and a semicircular right locking recess 156R is formed at the right end. Therefore, the filter 122 is configured integrally with the housing 134, and therefore the frame body 112, and constitutes a part of the visual aid device 100. However, when the filter 122 is not needed, it can be removed and used.
[0042] Next, the filter locking portion 136 will be described. The filter locking portion 136 functions to detachably attach the filter 122 to the housing 134. In this embodiment 1, the filter locking portion 136 is composed of a left filter locking portion 136L provided on the front surface of the left housing 134L and a right filter locking portion 136R provided on the front surface of the right housing 134R. The left filter locking portion 136L and the right filter locking portion 136R have the same configuration and are composed of a cylindrical protrusion with a ring-shaped groove around its periphery. The length between the left filter locking portion 136L and the right filter locking portion 136R is configured to be slightly shorter than the shortest length between the left locking recess 156L and the right locking recess 156R. Therefore, by bending the filter 122 and engaging the left locking recess 156L with the groove of the left filter locking portion 136L and the right locking recess 156R with the groove of the right filter locking portion 136R, the right filter locking portion 136R and the left filter locking portion 136L are pressed by the elasticity of the filter 122, thereby integrating them with the frame body 112.
[0043] Next, the wide-angle camera device 108 will be described mainly with reference to FIG. 4. The wide-angle camera device 108 has a function of capturing an image to be displayed on the display surface 106. Therefore, other devices having similar functions can be used as the wide-angle camera device 108. In this embodiment 1, the wide-angle camera device 108 is unitized and is composed of a camera device main body 162 and a camera unit 164.
[0044] Next, the camera device main body 162 will be described. The camera device main body 162 has the function of attaching the camera unit 164 to the transparent body 126, which is the frame 112. Therefore, other devices having a similar function can be used as the camera device main body 162. In this embodiment, the camera device main body 162 is made of resin and has a roughly rectangular thick plate shape. The upper end is formed with a receiving groove 162G that extends linearly in the extension direction of the frame 112. Below the receiving groove 162G, there is formed an attachment hole 162H that is drilled rearward from the front attachment groove portion 126F. The camera device main body 162 tightly receives the connecting portion 126J of the frame 112 in the receiving groove 162G, and is firmly fixed to the transparent body 126 by multiple fixing devices 158. With the fixing device 158 fixed to the transparent body 126, the camera device main body 162 is placed in the recess 128 of the transparent body 126, and the mounting hole 162H extends horizontally in the front-to-back direction of the wearer WP. In this embodiment 1, the fixing device 158 is composed of two bolts and nuts that penetrate the connecting portion 126J in the front-to-back direction. However, the fixing device 158 may have a different structure.
[0045] Next, the camera unit 164 will be described. The camera unit 164 has the function of capturing images of the scene in front of the wearer WP. In this embodiment 1, the camera unit 164 is a so-called well-known wide-angle camera. A wide-angle lens 172 consisting of a concave lens 166 and a convex lens 168 and a photographing device 174 are disposed in a horizontally oriented, bottomed, cylindrical camera housing 176. Various lenses with similar functions can be used for the wide-angle lens 172. The angle of view of the camera unit 164 is preferably approximately 25 degrees to approximately 90 degrees, with 43 degrees to 50 degrees being particularly preferred. The focal length is preferably less than 35 millimeters. For people with tunnel vision walking, the angle of view of the wide-angle lens 172 should be 90 degrees to 120 degrees. Furthermore, when used as a magnifying glass, the angle of view of the wide-angle lens 172 can be 5 degrees to 10 degrees. The camera housing 176 is tightly inserted and fixed in the mounting hole 162H of the camera device main body 162. The imager 174 is preferably a complementary metal-oxide-semiconductor (CMOS) imager, but other imagers such as a charge-coupled device (CCD), a thin-film imager, Foveon (registered trademark) X3, or a back-illuminated CCD can also be used.
[0046] Next, the relationship between the wide-angle camera device 108 and the light guide 124 will be described primarily with reference to Figure 2. When viewed from the front, the head-mounted device 102, specifically the filter 122 (light guide 124), is located on the vertical center line HCL and the horizontal center line VCL. The vertical center line HCL is located at the center of the vertical dimensions of the light guide 124, and therefore of the right display surface 106R (right reflective film 132R) and the left display surface 106L (left reflective film 132L). In other words, the vertical center line HCL is located at the vertical center of the reflective film 132. The right display surface 106R (right light guide 124R) and the left display surface 106L (left light guide 124L) are arranged symmetrically with respect to the horizontal center line VCL. The horizontal center line VCL overlaps with the face center line FCL. Furthermore, the camera center CC of the wide-angle camera device 108 is located at the intersection of the vertical center line HCL and the horizontal center line VCL. Therefore, when viewed from the front, the camera center CC is located on the facial center line FCL. Note that "located on the vertical center line HCL or the facial center line FCL" includes cases where they are completely overlapping as well as cases where they are roughly overlapping. Therefore, when the wearer WP wears the visual support device 100 in the correct position, as shown in Figure 6, the line of sight VP is overlapped with the camera axis line CCL and intersects with the vertical center line HCL at a right angle.
[0047] Next, the control device 104 will be described mainly with reference to FIG. 5 . The control device 104 has a function of controlling image capture by the wide-angle camera device 108 or display on the display device 234. In this first embodiment, the control device 104 has a function of controlling projection by the projection device 114. Furthermore, in this first embodiment, the control device 104 has a function of providing power to each component device in the visual support device 100. In this first embodiment, the control device 104 is provided in a control device housing 178 that is provided separately from the head-mounted device 102, and includes the wide-angle camera device 108, the projection device 114, an illuminance sensor 138, a display control unit 183, a recording unit 186, a scale adjustment button 188, a brightness adjustment button 192, a still / moving image switching button 194, a scroll button 196, a split enlargement button 198, a split stop button 200, a black and white inversion display unit 202, and a bus line 204. Electricity for operation is supplied to the control device 104 and other components from a storage battery 208, which serves as a power source 206. The top surface of the right housing 134R is provided with a scale adjustment button 188, a moving image button 194M constituting the still / moving image switch button 194, and a split enlargement button 198. The top surface of the left housing 134L is provided with a brightness adjustment button 192, a still image button 194S constituting the still / moving image switch button 194, a split stop button 200, and a black and white inversion display section 202. A scroll button 196 is disposed on the outer surface of the control device housing 178 of the control device 104. These operation buttons, the wide-angle camera device 108, and the illuminance sensor 138 are connected to the control device 104 via electric wires 180. The control device 104 includes a microcomputer 182, a projection control unit 184, a recording unit 186, a scale adjustment button 188, a brightness adjustment button 192, a still / moving image switching button 194, a scroll button 196, and a bus line 204. However, the scale adjustment button 188, the brightness adjustment button 192, the still / moving image switching button 194, or the scroll button 196 can be provided separately from the control device housing 178. In the first embodiment, a storage battery 208 for supplying current to function the control device 104 is installed inside the control device housing 178. However, by further miniaturizing the control device 104, it can be integrated into the head-worn device 102. The power source 206 can be a cable with a connector and can be provided separately from the head-worn device 102. In the first embodiment, the functions of the control device 104 are performed by a program.
[0048] Next, the microcomputer 182 will be described. The microcomputer 182 is a well-known microcomputer and is composed of a CPU (Central Processing Unit) 212, a ROM (Read Only Memory) 214, and a RAM (Random Access Memory) 216. The CPU 212 records and reads information in the RAM 216 at appropriate times based on a program recorded in the ROM 214, receives information from the illuminance sensor 138 and the wide-angle camera device 108, outputs a projection image PV to the left projection device 114L and the right projection device 114R, which are the projection devices 114, via a projection control unit 184, which is a display control unit 183, and performs predetermined functions based on signals from a scale adjustment button 188, a brightness adjustment button 192, a still / moving image switching button 194, a scroll button 196, a split enlargement button 198, a split stop button 200, and a black and white inversion display unit 202.
[0049] As described above, the wide-angle camera device 108 transmits the captured image information VI to the microcomputer 182 via the bus line 204, which will be described later.
[0050] Next, the display control unit 183 will be described. The display control unit 183 has a function of outputting the video information VI to be displayed on the display surface 106 in various set states, and in this embodiment 1, the display control unit 183 is configured by a projection control unit 184. The projection control unit 184 has a function of projecting the video information VI captured by the wide-angle camera device 108 from the projection device 114 in various set states. The projection control unit 184 outputs the same projection information PI to the projection device 114, typically the left projection device 114L and the right projection device 114R, and projects it from the left projection device 114L onto the left display surface 106L and from the right projection device 114R onto the right display surface 106R, thereby displaying a full-size image ASV ( FIG. 8 ) as a projected image PV as a virtual image. Typically, a full-size image ASV as a projected image PV at approximately the same scale as that viewed in the eye EYE of the wearer WP is projected onto the right display surface 106R and the left display surface 106L. This is to allow the wearer WP to visually recognize the real image and virtual image without feeling uncomfortable when viewing with the eye EYE. However, different image information VI can be output to the left projection device 114L and the right projection device 114R. For example, it is possible to project an image at full size onto the left projection device 114L, and a projection image PV enlarged at a predetermined magnification onto the right projection device 114R.
[0051] The projection device 114 is a so-called projector, and in this embodiment 1, is composed of a left projection device 114L and a right projection device 114R. Since the left projection device 114L and the right projection device 114R have the same configuration, the left projection device 114L will be described as a representative. As shown in FIG. 4E, the left projection device 114L is composed of a projection housing 144 and a light source-integrated display device 146 built into the projection housing 144. That is, an image projected from the light source-integrated display device 146 is projected from the left light incident surface 124LI onto the light guide 124 and then onto the left reflective film 132L. The image light VL (FIG. 4) projected from the left projection device 114L is usually displayed on the left display surface 106L, which serves as the projection unit 110, as shown in FIG. 8A. In this embodiment 1, the projection control unit 184 is configured to cause the enlarged area display unit 148 to display the enlarged display frame 160, which serves as the enlarged area.
[0052] Next, the enlarged area display unit 148 will be described. The left projection device 114L and the right projection device 114R have the same functions, so the left display surface 106L and the right display surface 106R will not be distinguished from each other and will be described as the display surface 106. When the split enlargement button 198 is operated, the enlarged area display unit 148 displays the wide-area display unit 152 and the enlarged display unit 154 side-by-side on the horizontally elongated rectangular display surface 106 in this embodiment. The wide-area display unit 152 has the function of displaying an image at a scale similar to that seen with the naked eye. However, if the wide-area display unit 152 displays a wider area than the enlarged display unit 154, it is included in the concept of a wide-area display unit. In this embodiment, the wide-area display unit 152 is arranged on the left side and the enlarged display unit 154 is arranged on the right side, are the same size, and a dividing line DL is displayed in the center. However, the display surface 106 can be circular or elliptical, and the dividing line DL can be omitted. When the split zoom button 198 is operated, the zoom area display unit 148 displays a zoom frame 160, which is a zoom area indicating the range of the zoomed display in the zoom display unit 154, as shown in FIG. 8(E). Naturally, the higher the magnification, the smaller the size of the zoom frame 160 in the wide-area display unit 152. The mode displaying the wide-area display unit 152 and the zoom display unit 154 shown in FIG. 8(E) functions as a so-called eyeglass-type magnifying reading device, which has the advantage of being usable outdoors and not requiring a handheld device, allowing both hands to be used. The zoom frame 160 is preferably displayed in the center of the wide-area display unit 152. The center refers to the center horizontally and vertically. The image displayed in the wide-area display unit 152 is a moving image MI captured by the camera device 174. The image displayed in the zoom display unit 154 is an enlarged image EVI enclosed by the zoom frame 160. The inside of the enlargement display frame 160 is preferably transparent so that the text and the like within the frame can be seen. The enlarged image EVI of the moving image MI enclosed by the enlargement display frame 160 is preferably displayed in the center of the enlargement display section 154. The enlargement display frame 160 can be formed in a circular or elliptical shape. As shown in FIG. 8(F), the inside of the enlargement display frame 160 can be made opaque or semi-transparent.Furthermore, as shown in FIG. 8(G), the wide-area display section 152 can be swapped to the right and the enlarged display section 154 to the left. This swapping of the wide-area display section 152 and the enlarged display section 154 can be performed by the display-position control section 150. That is, the positions of the wide-area display section 152 and the enlarged display section 154 are swapped each time an operation button 150B attached to the display-position control section 150 is pressed. The function of the display-position control section 150 is realized by a program. Furthermore, as shown in FIG. 8(H), even if the moving image MI displayed on the wide-area display section 152 is tilted, the enlarged image EVI can be displayed upright in the enlarged display section 154. For example, this can be achieved by recognizing the alignment direction of the characters from the image and displaying them on the enlarged display section 154 so that the alignment direction is parallel to the top or bottom edge, or the right or left edge, of the enlarged display section 154. This function is realized by a program. It should be noted that the wide-area display section 152 and the enlarged display section 154 can display a still image SV.
[0053] Next, the recording unit 186 will be described. The recording unit 186 has a function of recording video information VI as still image information SVI when a still image button 194S constituting a still / moving image switching button 194 (described later) is pressed. The still image information SVI at the time when the still image button 194S is pressed is recorded in the recording unit 186, and the recorded still image information SVI can be used as appropriate. However, moving image information MVI, which is video information VI for a predetermined period of time, can also be recorded as the still image information SVI. In the first embodiment, a known storage device is used for the recording unit 186.
[0054] Next, the scale adjustment button 188 will be described. The scale adjustment button 188 has a function of setting the scale of the projection information PI projected from the left projection device 114L onto the left display surface 106L or from the right projection device 114R onto the right display surface 106R. In this embodiment, the scale adjustment button 188 includes a zoom-in button 188M, a zoom-out button 188R, and a cancel button 188C. When the zoom-in button 188M is operated, i.e., when the zoom-in button 188M is pressed, the projection information PI projected onto the display surface 106 is enlarged around the image center PC. For example, when the video information VI is displayed on the display surface 106 as a single image as shown in FIG. 8A, an enlarged image EVI is displayed, enlarged at a predetermined rate, as shown in FIG. 8B. When the zoom-in button 188M is pressed repeatedly, the image is enlarged stepwise at a predetermined rate, and when the desired size is reached, the user stops pressing the zoom-in button 188M. As shown in FIG. 8(B), when the zoom-out button 188R is pressed while the enlarged image EVI is displayed, the image is projected onto the display surface 106 by the projection device 114 at a rate reduced by one step around the image center PC. On the other hand, when the zoom-out button 188R is continuously pressed, the displayed enlarged image EVI is reduced stepwise around the image center PC, as shown in FIG. 8(A), and projected onto the display surface 106. When the release button 188C is pressed, the enlarged image EVI, which is the projected image PV, is returned to the original size image ASV. Thus, by enabling the image information VI to be enlarged or reduced, the user's convenience is improved. When the still image button 194S is pressed, still image information SVI captured by the wide-angle camera device 108 is projected as projection information PI from the right projection device 114R and left projection device 114L, which are the projection devices 114. When the video button 194M is pressed, the image projected on the display surface 106 is switched from the still image information SVI to video information MVI.
[0055] Next, the brightness adjustment button 192 will be described. The brightness adjustment button 192 has a function of manually adjusting the brightness of the image projected on the display surface 106. In the first embodiment, the brightness adjustment button 192 includes a high brightness button 192H and a low brightness button 192L. When the high brightness button 192H is pressed, the difference in brightness between the projection information PI projected on the display surface 106 increases. On the other hand, when the low brightness button 192L is pressed, the difference in brightness between the projection information PI projected on the display surface 106 decreases. This brightness ratio is also applied to the illuminance information II from the illuminance sensor 138. In other words, the brightness ratio set by operating the high brightness button 192H or the low brightness button 192L is also applied to the still image information SVI received from the wide-angle camera device 108 when it is projected.
[0056] Next, the still / moving image switching button 194 will be described. The still / moving image switching button 194 has a function of switching between still image information SVI and moving image information MVI for the video information VI acquired by the wide-angle camera device 108. In the first embodiment, the button 194 includes a still image button 194S and a moving image button 194M. When the still image button 194S is operated, i.e., when the still image button 194S is pressed, the projection information PI projected from the projection device 114 becomes the projection information PI at the time when the still image button 194S was pressed. Naturally, the information on the projection information PI is recorded in the recording unit 186. When the moving image button 194M is operated, i.e., when the moving image button 194M is pressed, the video information VI, which is the moving image captured by the wide-angle camera device 108, is projected by the projection device 114 as the projection information PI.
[0057] Next, the scroll button 196 will be described. The scroll button 196 has the function of moving the video information VI displayed on the display surface 106, in other words, the projected projection information PI, to any position up, down, left, or right. In this embodiment, the scroll button 196 is composed of an up button 196U, a down button 196D, a left button 196L, and a right button 196R arranged on the surface of the control device housing 178. It is preferable to operate the scroll button 196 after pressing the still image button 194S. That is, when the up button 196U is pressed, for example, the projection image PV in FIG. 8A is moved upward at a predetermined speed. When the down button 196D is pressed, the still image SV is moved downward at a predetermined speed. When the right button 196R is pressed, the projection image PV is moved rightward at a predetermined speed, as shown in FIG. 8C. When the left button 196L is pressed, the projection image PV is moved leftward at a predetermined speed.
[0058] Next, the split enlargement button 198 will be described. The split enlargement button 198 has a function of being operated, in other words, when the split enlargement button 198 is pressed, the control device 104 displays the wide-area display section 152 and the enlarged display section 154 on the display surface 106 based on the video information VI, in other words, the projection information PI. As described above, the wide-area display section 152 displays the video information VI captured by the wide-angle camera device 108, in other words, a moving image based on the moving image information MVI, and the enlarged display frame 160, and the enlarged display section 154 displays the enlarged image EVI of the area surrounded by the enlarged display frame 160. In the first embodiment, these functions are implemented by a program.
[0059] Next, the split stop button 200 will be described. The split stop button 200 has the function of stopping the display of the wide-area display portion 152 and the enlarged display portion 154 on the display surface 106 and returning the display to the normal integrated display screen IV (FIG. 8A). In the present embodiment 1, this function is realized by a program.
[0060] Next, the black-and-white reversal display unit 202 will be described. The black-and-white reversal display unit 202 is a rotary switch that, when pressed once, displays (projects) color moving image information MVI on the display surface 106 in normal black-and-white mode, and when pressed again, displays the information in reversed black-and-white mode. When the black-and-white reversal display unit 202 is pressed again, the normal color moving image information MVI is projected. In normal black-and-white mode, light colored areas are displayed in white or light gray, and dark colored areas are displayed in black or dark gray. In reversed black-and-white mode, light colored areas are displayed in black or dark gray, and dark colored areas are displayed in white or light gray. The black-and-white reversal display unit 202 can be replaced with another device having similar functions.
[0061] Next, the bus line 204 will be described. The bus line 204 has a function of communicating signals between the wide-angle camera device 108, illuminance sensor 138, projection control unit 184, recording unit 186, scale adjustment button 188, brightness adjustment button 192, still / moving image switching button 194, scroll button 196, etc. and the microcomputer 182. In this embodiment 1, a known bus line is used as the bus line 204.
[0062] Next, the power supply 206 will be described. The power supply 206 has a function of providing power to the control device 104 and the like. In the first embodiment, the power supply 206 uses a storage battery 208, which is a secondary battery suitable for portability. However, if the range is limited, an outlet installed in a building can be used as the power supply 206, and wireless power transmission can be used.
[0063] Next, we will explain the storage battery 208. The storage battery 208 is a known storage battery, and a primary battery or a secondary battery can be used.
[0064] Next, we will explain the character analysis device 222. The character analysis device 222 has a function of analyzing the characters in the video information VI captured by the wide-angle camera device 108 and outputting the result as character information. In this embodiment 1, the character analysis device 222 is configured by a program.
[0065] Next, the character-to-speech conversion device 224 will be described. The character-to-speech conversion device 224 has a function of converting character information into an electrical signal and outputting it to a speaker 226. In the first embodiment, the character-to-speech conversion device 224 converts the character information analyzed by the character analysis device 222 into an electrical signal and outputs it from the speaker 226. The character-to-speech conversion device 224 is configured by a program.
[0066] Next, the speaker 226 will be described. The speaker 226 has a function of converting the electrical signal output from the character-to-speech conversion device 224 into sound and outputting the sound. In this embodiment 1, well-known speakers provided in the head holders 116 (right head holder 116R, left head holder 116L) are used, but bone conduction speakers or the like can also be used.
[0067] Next, the character size determination unit 228 will be described. The character size determination unit 228 has a function of determining the size of characters on the wide area display unit 152 of the video information VI captured by the wide-angle camera device 108. In the first embodiment, the character size determination unit 228 is configured by a program, and when it determines that the characters on the wide area display unit 152 are equal to or smaller than a predetermined size, it automatically displays the enlarged display unit 154 and enlarges a portion of the characters displayed on the wide area display unit 152. The size of the characters can be determined by using the font size.
[0068] Next, the display dimension designation unit 232 will be described. The display dimension designation unit 232 has a function of changing the display dimension in the enlarged display unit 154. In the present embodiment 1, the display dimension designation unit 232 is configured by a program, and designates the display dimension stepwise or steplessly by pressing the display dimension designation button 232B. However, the display dimension designation button 232B can also adopt other methods, such as directly inputting the display dimension.
[0069] Next, the operation of the visual support device 100 of the first embodiment will be described. As shown in FIG. 2, 6, or 7, the visual support device 100 is typically worn on the head HD of a wearer WP with low vision. That is, as shown in FIG. 2, the right head holder 116R is fastened to the right earlobe ACR, the left head holder 116L is fastened to the left earlobe ACL, and the nose pad 118 is placed on the base of the nose NZ, thereby allowing the wearer WP to wear the device on their head HD. In this state, when the wearer WP is standing upright and looking straight ahead, the wide-angle camera device 108, specifically the camera axis CCL of the wide-angle camera device 108, is positioned on the facial center line FCL (FIG. 2A). Furthermore, when viewed straight ahead, it is preferable that the facial center line FCL and the lateral center line VCL overlap (FIG. 2). Furthermore, in a side view, the line of sight VP of the eye EYE overlaps with the camera axis CCL (Fig. 6), and the camera axis CCL is perpendicular to the vertical center line HCL (Fig. 2). As a result, when the wearer WP looks forward, as shown in Fig. 7, the right eye EYER can see through the right display surface 106R (right reflective film 132R), right light guide 124R, and transparent body 126, and the left eye EYEL can see through the left display surface 106L (left reflective film 132L), left light guide 124L, and transparent body 126 to see what is ahead. In addition, the right eye EYER can see the original-size image ASV, which is the integrated display screen IV projected on the right display surface 106R, and the left eye EYEL can see the original-size image ASV, etc., projected on the left display surface 106L. Therefore, the projected images PV projected onto the right display surface 106R and the left display surface 106L do not deviate from the real images, and therefore the wearer WP does not step on empty feet, improving safety. Note that the wearer WP is assumed to be a visually impaired person or an eye disease patient with a similar symptom, specifically, a person with a symptom known as night blindness or narrowing of the visual field.
[0070] Next, the case where the split enlargement button 198 is pressed will be described with reference to the flowchart of FIG. 9. First, in step S1, it is determined whether the split enlargement button 198 has been pressed. If it is determined that it has been pressed, the process proceeds to step S2. If it has not been pressed, the process loops back to step S1 and enters a standby state. In step S2, the projection control unit 184 first displays the wide-area display portion 152 in half of the display surface 106, as shown in FIG. 8(E), and then proceeds to step S3. In other words, the dividing line DL is displayed in the horizontal center of the display surface 106, and video information VI captured by the wide-angle camera device 108 is projected as a projection image PV on the wide-area display portion 152, and then the process proceeds to step S3. In step S3, the enlarged display frame 160 is displayed on the wide-area display portion 152 by the enlarged area display unit 148, and the process proceeds to step S4. In step S4, the image surrounded by the enlargement frame 160 in the enlargement display section 154 of the display surface 106 is projected as an enlarged image EVI on the enlargement display section 154, and the process proceeds to step S5. In step S5, it is determined whether the split stop button 200 has been pressed. If it is determined that the button has been pressed, the process proceeds to step S6. If the button has not been pressed, the process loops back to step S5 and enters a standby state. In step S6, the split display on the display surface 106 is switched to, for example, an integrated display screen IV shown in FIG. 8A, and the process ends. As a result, enlarged characters and the like are displayed on the enlargement display section 154, improving visibility for people with visual constriction, etc.
[0071] An overview of a visual support device 201 according to a second embodiment of the present invention will be described with reference to Figures 11 and 12. The same components as those in the visual support device 100 of the first embodiment are denoted by the same reference numerals and will not be described again, but different configurations will be described. In this second embodiment, a display device 234 configured by an organic EL display or the like is used instead of the display unit 109 configured by the display surface 106 and the projection device 114, a second display control unit 236 is used instead of the display control unit 183, and the control device 104 is provided with a brightness setting unit 242, an image position setting unit 244, a strabismus correction unit 246, and a left / right eye display selection unit 248.
[0072] First, the display device 234, which is the display unit 109, will be described. The display device 234, like the projection device 114, is a so-called display that has the function of displaying the video information VI captured by the wide-angle camera device 108. In this second embodiment, the display device 234 is configured with an organic EL display or a liquid crystal display, and is configured with a right display device 234R facing the right eye EYER and a left display device 234L facing the left eye EYEL. Therefore, since the surface of the display device 234 constitutes the display surface 106, the surface of the right display device 234R facing the right eye EYER constitutes the right display surface 106R, and the surface of the left display device 234L facing the left eye EYEL constitutes the left display surface 106L. Normally, images based on the same video information VI are displayed on the right display device 234R and the left display device 234L. The right display device 234R and the left display device 234L have the same configuration, but as shown in FIG. 11(B), they are configured symmetrically with respect to the left-right center line VCL that passes through the camera center CC of the wide-angle camera device 108. Therefore, the left display device 234L will be described as a representative, and the right display device 234R will be described by replacing the "L" added to the end of the same number with an "R" and omitting the description thereof.
[0073] In this second embodiment, a known organic EL display is used as the left display device 234L, and is fitted into a recess formed in the left light guide 124L. The left display surface 106L of the left display device 234L is flush with the surface of the left light guide 124L on the left eye side. In this second embodiment, the left light guide 124L may be made of a material that does not have light-guiding properties. The left display device 234L is connected to the second display control unit 236 by a left lead wire 252L, which is a lead wire 252 disposed within the left light guide 124L. The left display device 234L is preferably a color display, but may also be a monochrome display. It is more preferable that the left display device 234L be switchable between color and monochrome display. In the case of monochrome display, it is preferable that the display be inverted.
[0074] The second display control unit 236 has the same function as the projection control unit 184 of the first embodiment. That is, similar to the first embodiment, when the split enlargement button 198 is operated, the enlargement area display unit 148 displays the wide area display unit 152 and the enlarged display unit 154 as shown in Fig. 8(E). The wide area display unit 152 displays an enlargement display frame 160 as an enlargement area that indicates the range to be enlarged. The enlargement display unit 154 displays the range surrounded by the enlargement display frame 160 enlarged at a predetermined magnification. The display in the wide area display unit 152 is preferably at actual size, and the display in the enlarged display unit 154 is enlarged more than the wide area display unit 152.
[0075] The left display device 234L normally does not transmit light, so the wearer WP cannot see ahead through the left light guide 124L. Therefore, the left light guide 124L can be made of a non-transparent material, in other words, an opaque material.
[0076] Next, the luminance setting unit 242 will be described. The luminance setting unit 242 has a function of setting the luminance condition LC of the image displayed on the display device 234, specifically, a function of setting an upper limit of the luminance on the display device 234. For example, if a person with impaired light perception, who is unable to properly adapt to light and darkness, suddenly moves from a dark place to a bright place, the person may not be able to properly adapt to light and may see a completely white state for a long period of time, which may result in safety not being guaranteed. Therefore, when the luminance information LUMI of the image information VI captured by the wide-angle camera device 108 reaches a predetermined luminance condition LC, the luminance setting unit 242 has a function of controlling the luminance information LUMI of the image information VI to fall within the predetermined luminance condition LC. The luminance condition LC is, for example, when the luminance on the display device 234 is brighter than a predetermined value.
[0077] For example, if the image information VI captured by the wide-angle camera device 108 contains luminance information LUMI greater than the luminance upper limit ULLUM set in the luminance setting unit 242, the second display control unit 236 converts and controls the image information VI to be displayed on the display device 234 so that the luminance does not exceed the luminance upper limit ULLUM. Specifically, as shown in FIG. 13A, the image information VI is information in which multiple frames F are arranged along a time axis T. As shown in FIG. 13B, each frame F is a single still image SV and is composed of multiple pixels P aligned vertically and horizontally. Each pixel P has luminance information LUMI for each of the three primary colors, red, green, and blue. As shown in FIG. 13C, each pixel P on the display device 234 emits light based on the luminance information LUMI of the three primary colors, RGB, which constitute the color information of the pixel P. Specifically, R255, G0, B0 represents red, R0, G255, B0 represents green, R0, G0, B255 represents blue, and R255, G255, B255 represents white. As the value of the 0 portion increases, the brightness of the color increases. Therefore, by analyzing the brightness information LUMI for each pixel P, it is possible to output a brightness analysis for each frame F. For example, the brightness increases as the value of the brightness information LUMI for RGB increases, so the brightness information LUMI is corrected so that it does not exceed a predetermined reference value.
[0078] The purpose of the luminance analysis is to perform luminance adjustment when the luminance information LUMI satisfies a predetermined luminance condition LC. For example, if the detected frequency of the numerical value of the luminance information LUMI under the luminance condition LC exceeds an upper limit value LMTU, luminance adjustment is performed so as not to exceed the upper limit value LMTU. Therefore, the upper limit value LMTU of the frequency of the luminance information LUMI constitutes the upper limit luminance ULLUM. In this second embodiment, using FIG. 13(D) as an example, a case where luminance adjustment is performed when the frequency of luminance information LUMI exceeding the upper limit value LMTU at 200 or more is described. At peak P1 where the luminance information LUMI exceeds a luminance value of 200, the luminance information exceeds the upper limit luminance ULLUM (upper limit value LMTU), which is the upper limit of the frequency, and therefore luminance adjustment is performed.
[0079] The brightness adjustment can be performed by uniformly reducing the brightness information LUMI of each pixel P so that the brightness information LUMI is a predetermined value, for example, a brightness value of 200 or less at which the frequency peak P1 does not exceed 200. If the brightness information LUMI is reduced uniformly, it may not be reduced at the intended rate, so it is preferable to use well-known gamma correction.
[0080] Gamma correction converts the luminance information LUMI of RGB for all pixels P using Equation 2. (Equation 2) Output = Input a Output: Corrected luminance information for the pixel, which is the result of calculating the right-hand side. Input: Luminance information before conversion. a: Exponent (integer). A preferred method is to first assign an appropriate initial value to the exponent a, calculate whether the luminance information LUMI at that exponent exceeds the upper limit value LMTU when the frequency of the luminance information at that exponent is 200 or greater, and then update the value of the exponent a to meet that condition. This algorithm gradually brings the value of the exponent a closer to the true value. If the exponent a in Equation 2 is changed to 2 to 4, as shown in Figure 13 (E), the luminance information LUMI at each pixel P is updated based on the curve rate value at each exponent a. This allows luminance adjustment to be performed so that the upper limit value LMTU under the luminance condition LC is not exceeded. Note that while the luminance information LUMI has been described using decimal code, well-known hexadecimal code, etc., can also be used.
[0081] In this second embodiment, an example of adjusting brightness based on the frequency of the brightness information LUMI has been described. However, instead of the frequency, adjustment may be performed when the brightness information LUMI of a predetermined region (area) exceeds a predetermined brightness standard.
[0082] This luminance analysis can be performed at predetermined time intervals, for example, every second. The luminance analysis is performed for one frame F at each predetermined time interval. For example, if the video is the same as that shown on Japanese television, there are 30 frames per second, so the luminance analysis is performed for every 30 frames F. This luminance analysis can be performed by a program.
[0083] An example of a luminance analysis program will be described with reference to Fig. 13(F). In this example, the luminance condition LC is set so that the frequency of luminance values above 200 does not exceed a predetermined luminance upper limit ULLUM. First, in step S21, luminance information LUMI is obtained from information on pixel P in a selected frame F in video information VI obtained from the wide-angle camera device 108, and the process proceeds to step S22.
[0084] In step S22, it is determined whether this luminance information LUMI satisfies the luminance condition LC set in the luminance setting unit 242. If the luminance condition LC is satisfied, the process returns to step S21, and if the luminance condition LC is not satisfied, the process proceeds to step S23.
[0085] In step S23, the brightness is adjusted so as to satisfy the brightness condition LC, and the process returns to step S21. Steps S21 to S23 are repeated for a predetermined time, for example, every second.
[0086] In determining whether the luminance condition LC is satisfied in step S22, the luminance information LUMI for pixel P in one frame F can be represented graphically as the histogram shown in FIG. 13(D). In the histogram in FIG. 13(D), a peak P1 appears when the luminance information LUMI exceeds 200. This indicates that the luminance condition LC is not satisfied. Therefore, the luminance value of the luminance information LUMI for each pixel P is corrected to be smaller so that peak P1 satisfies the luminance condition LC. Known methods for reducing luminance values can be used as the correction method, but for example, gamma correction, which converts pixel luminance by a power of a certain exponent, can be used. Specifically, the exponent a in Equation 2 is appropriately selected to reduce the luminance value of the entire image. As a result, as shown in FIG. 13(E), if the exponent is 2, correction is performed based on the first correction curve CC1; if the exponent is 3, correction is performed based on the second correction curve CC2; and if the exponent is 4, correction is performed based on the third correction curve CC3. That is, first, it is determined whether the frequency according to the luminance information LUMI calculated with index 2 conforms to the luminance condition LC, and if it conforms to the luminance condition LC, the luminance information LUMI calculated with index 2 is displayed on the display device 234. If the luminance information LUMI calculated with index 2 does not conform to the luminance condition LC, the luminance information LUMI is calculated with index 3 and it is determined whether it conforms to the luminance condition LC, and if it conforms to the luminance condition LC, the luminance information LUMI calculated with index 3 is displayed on the display device 234. If the luminance information LUMI calculated with index 3 does not conform to the luminance condition LC, luminance information LUMI is calculated with index 4, as in the case of index 2. The rest of the process is similar to that described above. As a result, the luminance of the moving image MI on the display device 234 satisfies the luminance condition LC.
[0087] Similarly, if a person has a condition in which dark adaptation (adaptation from bright to dark) is inadequate and the person continues to experience dark conditions while still having difficulty seeing, a correction is made to increase the brightness of each pixel so that the entire image can be seen. To increase the brightness value, the index a in Equation 2 can be corrected to be less than 1.
[0088] Next, the diagonal scrolling device 238 will be described with reference to FIG. 14. In this second embodiment, the diagonal scrolling device is configured to be able to scroll diagonally by operating the scroll button 196. In other words, while scrolling in the first embodiment is only possible in a linear direction, upward, downward, leftward, or rightward, in this second embodiment, scrolling in a diagonal direction is also possible. In this second embodiment, the scroll buttons 196 arranged on the control device 104 are composed of an up button 196U, a down button 196D, a left button 196L, and a right button 196R, as in the first embodiment, but each button is formed in the shape of an isosceles triangle with the same dimensions, and is arranged so that the vertices of the four triangles face each other so that adjacent buttons can be pressed simultaneously.
[0089] The functions when the up button 196U, down button 196D, left button 196L, or right button 196R are pressed individually are the same as in the first embodiment. However, a function has been added that allows diagonal scrolling when adjacent buttons are pressed simultaneously. When the up button 196U and the right button 196R are pressed simultaneously, the diagonal upper right button 196UR is configured, allowing scrolling in the diagonal upper right 45-degree direction UR. When the up button 196U and the left button 196L are pressed simultaneously, the diagonal upper left button 196UL is configured, allowing scrolling in the diagonal upper left 45-degree direction UL. When the up button 196U and the right button 196R are pressed simultaneously, the diagonal upper right button 196UR is configured, allowing scrolling in the diagonal upper left 45-degree direction UR. When the down button 196D and the left button 196L are pressed simultaneously, a diagonally downward left button 196LL is formed, and scrolling can be performed in the diagonally downward left direction LL. When the down button 196D and the right button 196R are pressed simultaneously, a diagonally downward right button 196LR is formed, and scrolling can be performed in the diagonally downward right direction LR.
[0090] Explaining with reference to FIG. 14(B), when it is desired to scroll the image IM displayed on the display surface 106 of the display device 234 from the image center PC in the "ka" direction, by simultaneously pressing the up button 196U and the left button 196L, the displayed image IM is scrolled diagonally upward and to the left at 45 degrees UL, allowing the user to quickly reach the position of the "ka" character. The same applies when moving in other diagonal directions. Note that, although an example of diagonal scrolling by pressing two buttons has been described in the second embodiment, the diagonal scrolling device 238 can also be used to move in each diagonal direction by pressing one button, or a joystick or the like can be used.
[0091] Next, the image position setting unit 244 will be described with reference to FIGS. 15 to 16. The image position setting unit 244 has a function to enable a wearer WP suffering from a visual field defect to view the image favorably. Specifically, the image position setting unit 244 has a function to display a reduced image RI obtained by reducing an image IM captured in the effective visual field EV by the wide-angle camera device 108 at a predetermined reduction ratio on a predetermined non-visual field defect portion NVFD (FIG. 16). Visual field defects occur due to unilateral blindness, glaucoma, retinal detachment, cataracts, etc. As shown in FIG. 15, when the wearer WP is healthy, the horizontal visual field HV is a range obtained by combining the left eye visual field LVF seen by the left eye EYEL and the right eye visual field RVF seen by the right eye EYER. The horizontal visual field HV is represented by the left eye visual field LVF and the right eye visual field RVF, and includes a central visual field CV of about 1-2 degrees, allowing for clear recognition of shapes and colors, an effective visual field EV of about 35 degrees to the left and right, allowing for identification of necessary objects, and peripheral visual fields PEV (left peripheral visual field PEVL, right peripheral visual field PEVR), outside of which shapes and colors cannot be clearly recognized. The horizontal visual field HV is approximately 200 degrees for both eyes. The effective visual field EV is the range in which shapes and colors can be recognized when gazed at, similar to the central visual field CV. When a visual field defect VFD exists in the left eye EYEL and / or right eye EYER, the image position setting unit 244 displays a reduced image RI in the horizontal visual field HV visible to both eyes within the effective visual field EV where no visual field defect VFD exists, thereby improving visibility for the wearer WP. Even if the visual field defect VFD is in either the right eye EYER or the left eye EYEL, the same reduced image RI is displayed at the same position on the right display device 234R and the left display device 234L.
[0092] The function of the image position setting unit 244 will be described with reference to FIG. 16(A). When both eyes have normal vision, image information VI captured by the wide-angle camera device 108 at a horizontal field of view HV of approximately 200 degrees is displayed on the right eye EYER and the left display device 234L, so that a mountain portion MS and a cloud portion CS are visible. On the other hand, as shown in FIG. 16(B), when a visual field defect portion VFD, indicated by diagonal lines, exists at the left end of the horizontal field of view HV, a portion of the mountain portion MS and the cloud portion CS are visually lost due to the visual field defect portion VFD. In such a case, by operating the image position setting unit 244, a reduced image RI in the effective field of view EV is displayed on the non-visual field defect portion NVFD, as shown in FIG. 16(C). The display position DP of the reduced image RI is displayed at the same position on each of the right display device 234R and the left display device 234L. The display position DP is determined in advance by a qualified person, such as a doctor, by diagnosing and identifying the visual field defect portion VFD, and the reduction ratio is also determined. In other words, the display position DP and reduction ratio are set in advance in the image position setting section 244, and by pressing, for example, the apply button 244B, this function is performed with the display position DP and reduction ratio set in advance, and when the apply button 244B is pressed again, this function is released.
[0093] Next, the strabismus correction unit 246 will be described with reference to FIG. 17. The strabismus correction unit 246 has a function of correcting double or overlapping vision caused by strabismus so that images appear normal. Specifically, the strabismus correction unit 246 has a function of displaying a refracted image RV obtained by refracting image information VI captured by the wide-angle camera device 108 with a predetermined refractive index. When both eyes are normal, as shown in FIG. 17(A), information about a person PS viewed at the left focus FL of the left retina LS of the left eye EYEL and the right focus FR of the right retina RS of the right eye EYER is processed in the brain, and a single viewer VRP is perceived.
[0094] On the other hand, in the case of diplopia as shown in Figure 17(B), for example, if the left eye EYEL is normal but the right eye EYER is esotropic, the brain processes information about the person PS seen at the left focus FL of the left retina LS of the left eye EYEL and the displaced right focus SFR of the right retina RS of the right eye EYER, and recognizes them as the left viewer VRPL seen with the left eye EYEL and the right viewer VRPR seen with the right eye EYER, so the person sees two viewers VRP (seeing double).
[0095] Furthermore, in the case of confused vision as shown in Figure 17(C), for example, if the left eye EYEL is normal but the right eye EYER is esotropic, the brain processes information about the person PS seen at the left focus FL of the left retina LS of the left eye EYEL and the tree TR seen at the right focus FR of the right retina RS of the right eye EYER, and recognizes them as the left-viewed person VRPL seen with the left eye EYEL and the right-viewed tree VTR seen with the right eye EYER, so the left-viewed person VRPL and the right-viewed tree VTR are perceived, and the left-viewed person VRPL and the right-viewed tree VTR appear double.
[0096] To solve this problem, one approach is to use a prism PR for correction, as shown in Fig. 17(D). The prism PR is fixed to a spectacle-type frame in the same way as eyeglasses, so it has been difficult to use it in combination with the spectacle-type visual support device 100. The strabismus correction unit 246 in this second embodiment performs the same function as the prism PR for strabismus correction.
[0097] Specifically, for example, a rotary type may be employed in which pressing the strabismus correction button 246B of the strabismus correction unit 246 in FIG. 12 activates the strabismus correction function, and pressing the strabismus correction button 246B again deactivates the function. Alternatively, a selection button type may be employed that allows the user to select whether to enable or disable the function. The strabismus correction function is similar to the function of the prism PR described above. Therefore, the strabismus correction unit 246 has the function of measuring the degree of strabismus of the right eye EYER of the wearer WP in advance and displaying an image on the right display device 234R similar to that seen through the prism PR. In other words, the video information VI from the wide-angle camera device 108 is converted by a program into a refracted image RV refracted at a predetermined refractive index and displayed on the right display device 234R. In this case, the left display device 234L may be omitted, and the left eye EYEL may be viewed with the naked eye. If the left eye EYEL is strabismus, a refracted image RV refracted with a predetermined refractive index is displayed on the right display device 234R, just like the right eye EYER. Therefore, this second embodiment is suitable for a wearer WP who has both visual field constriction and strabismus, since strabismus correction can also be achieved with a single visual support device 100. In this example, an example of the right eye EYER being esotropia has been described, but the same can be applied to exotropia.
[0098] Next, the left / right eye display selection unit 248 will be described with reference to Figures 18 and 19. When the wearer WP is blind in one eye, the left / right eye display selection unit 248 has a function of displaying an image within the range visible with both eyes on the right display device 234R or left display device 234L, which is the display unit 109 for the right eye EYER or left eye EYEL, which has visual acuity. As previously explained using Figure 15, the right eye EYER and the left eye EYEL have right eye visual fields RVF and left eye visual fields LVF, respectively, and when one eye is blind, they inevitably have a non-field of view area NV. Specifically, the non-field of view area NV is a non-right eye visual field area NVR when the right eye EYER is blind, and a non-left eye visual field area NVL when the left eye EYEL is blind.
[0099] Figure 18 shows the maximum range of vision that can be achieved by the left eye (EYE) and right eye (EYE) when a person with normal eyes looks directly ahead, and is represented by the left eye visual field (LVR) and right eye visual field (RVR). The left eye visual field (LVR) is a horizontally elongated ellipse that extends vertically and horizontally, with a slope slightly to the right, as shown by the two-dot chain line. The right eye visual field (RVR) is a horizontally elongated ellipse that extends vertically and horizontally, with a slope slightly to the left, as shown by the one-dot chain line. The right edge of the left eye visual field (LVR) and the left edge of the right eye visual field (RVR) overlap, and the center of these overlap is the central visual field (CV).
[0100] Therefore, if the right eye EYER is blind, the area with diagonal lines slanting upward to the right becomes the non-right eye visual field NVR, as shown in Figure 18(A), and if the left eye EYEL is blind, the area with diagonal lines slanting upward to the left becomes the non-left eye visual field NVL, as shown in Figure 18(B). A person with monocular blindness cannot see either of the non-visual fields NV, which can cause problems. For example, if there is a protrusion on the floor in the non-right eye visual field NVR or non-left eye visual field NVL, there is a risk that the protrusion may get caught on something and cause the person to fall while walking.
[0101] Therefore, by utilizing the monocular correction function of the left / right eye display selection unit 248, a reduced image RI of the range visible with both eyes (horizontal field of view HV) acquired by the wide-angle camera device 108 is displayed in the left eye field of view LVR or the right eye field of view RVR. In other words, the monocular correction function is a function that displays a reduced image RI of the range visible with both eyes for the one visible eye. For example, if the left eye EYEL is lost, a reduced image RI of the horizontal field of view HV range of both eyes is displayed in the right eye field of view RVR. Therefore, since the visual range of both eyes can be seen even with one eye, it is possible to check protrusions, etc. in the non-right eye field of view NVR or non-left eye field of view NVL, which has the advantage of preventing unexpected accidents.
[0102] Specifically, for example, when the eye selection button 248B of the left / right eye display selection unit 248 in FIG. 12 is pressed, the monocular correction function is activated; when the eye selection button 248B is pressed again, the monocular correction function is deactivated; and when the eye selection button 248B is pressed again, the monocular correction function is activated. Since the blind eye can be identified in advance, pressing the eye selection button 248B selects the left display device 234L or the right display device 234R that displays the reduced image RI. For example, if the right eye EYER is blind, the image seen in the right eye visual field RVR of the right eye EYER and the left eye visual field LVR of the left eye EYEL (FIG. 19(A)) within the left eye visual field LVR in FIG. 19 is reduced and displayed on the left display device 234L (FIG. 19(B)). In other words, the reduced image RI obtained by reducing the image seen by both eyes in the left eye visual field LVR at a preset reduction ratio is displayed on the left display device 234L. The reduction ratio and display position of this reduced image RI are determined by a program, and are reflected in the program after examining the visual field of the wearer WP in advance. In other words, the video information VI from the wide-angle camera device 108 is converted into a reduced image RI reduced at a predetermined reduction ratio by the program and displayed at a predetermined position on the display device 234. The left / right eye display selection unit 248 can also be applied to the right projection device 114R or the left projection device 114L in the first embodiment.
[0103] Also, a display can be made to call attention to a visual field other than the effective visual field EV. For example, if an image sensor or the like is provided on the head holder 116 and a sudden approaching object is detected, a display to warn of danger can be made by flashing or the like in the peripheral visual field PEV, which is a visual field other than the effective visual field EV of the right eye EYER and the left eye EYEL, for example, in the position P2 in the left peripheral visual field PEVL shown in Fig. 15 or in the right peripheral visual field PEVR.
[0104] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit and scope of the present invention. For example, in Example 1, independent head holders 116 are arranged on the left and right sides of the head HD. However, various structures can be adopted, such as a cantilevered U-shaped head holder 116 or a helmet-shaped head holder. Furthermore, the shape of the reflective film 132 can be various shapes, such as a circle, in addition to the rectangular shape of Example 1. Furthermore, the components of Example 1 and Example 2 can be selectively combined. For example, the display surface 106 in Example 1 can be replaced with the display device 234 in Example 2.
[0105] 100, 201 Visual support device 104 Control device 106 Display surface 106L Left display surface 106R Right display surface 108 Wide-angle camera device 112 Frame body 116 Head holder 122 Filter 134 Housing 124 Light guide 152 Wide-area display section 154 Magnification display section 172 Wide-angle lens 174 Imaging device 188M Magnification button 188R Reduce button 194 Still / moving image switching button 194S Still image button 202 Black and white inversion display section 228 Character size determination section 232 Display size instruction section 234 Display device 234R Right display device 234R 234L Left display device 234L 242 Brightness setting section 244 Image position setting section 246 Strabismus correction section 248 Right / left eye display selector CCL Camera axis EV Effective field of view EYEL Left eye EYER Right eye EVI Enlarged image HCL Vertical center line HD Head IM Image NVFD Non-visual field defect P2 Position PC Image center RI Reduced image RV Refraction image VFD Visual field defect WP Wearer
Claims
1. A visual support device (100, 201) including a head holder (116) to be attached to the head (HD) of a wearer (WP), a wide-angle camera device (108) attached to the head holder (116), a display unit (109) provided on the head holder (116) for displaying images visible to the wearer (WP), and a control device (104) for controlling the display of images captured by the wide-angle camera device (108) on the display unit (109), wherein the control device (104) causes the display unit (109) to display a wide-area display unit (152) and an enlarged display unit (154), and includes an enlarged area display unit (148) for displaying an enlarged area representing the enlarged image area to be displayed on the enlarged display unit (154) on the wide-area display unit (152).
2. The visual aid device according to claim 1, wherein the control device (104) includes a black and white inversion display unit (202) for the image.
3. The visual support device according to claim 1 or 2, characterized in that the control device (104) is provided with a recording unit (186) for recording still images of the video, and at least an enlargement button (188M) or a reduction button (188R), and enlarges and displays the still image based on the operation of the enlargement button (188M), or reduces and displays the still image based on the operation of the reduction button (188R).
4. The visual support device according to claim 3, wherein the enlarged or reduced display is performed with the image center (PC) of the still image as the center.
5. A visual assistance device as described in claim 1 or 2, characterized in that the control device (104) includes a display unit position control unit (150) that controls the placement positions of the wide-area display unit (152) and the enlarged display unit (154).
6. The visual support device described in claim 1 or 2, characterized in that the control device (104) includes a character size determination unit (228) that determines the size of the characters in the image captured by the wide-angle camera device (108) on the wide-area display unit (152), and when the character size determination unit (228) determines that the size is less than a predetermined size, the enlarged display unit (154) is displayed to enlarge a portion of the characters displayed on the wide-area display unit (152).
7. A visual aid device as described in claim 1 or 2, further comprising a display dimension instruction unit (232), and the control device (104) changes the display dimension in the enlarged display unit (154) based on an instruction from the display dimension instruction unit (232).
8. A visual aid device according to claim 1 or 2, characterized in that a brightness setting unit (242) is provided, and an upper limit of brightness on the display device (234) is set by operating the brightness setting unit (242).
9. A visual assistance device as described in claim 1 or 2, characterized in that the display unit (109) includes a projection unit (110) that projects the image and a display surface (106) that displays the image from the projection unit (110), the projection unit (110) includes a right projection unit (110R) and a left projection unit (110L), and the display surface (106) includes a right display surface (106R) and a left display surface (106L).
10. A visual assistance device as described in claim 1 or 2, characterized in that the display unit (109) includes a display device (234) that displays the image, and the display device (234) includes a right display device (234R) and a left display device (234L).
11. The visual support device according to claim 9, further comprising a right / left eye display selection unit (248) for selecting a projection from the right projection unit (110R) or the left projection unit (110L).
12. The visual support device according to claim 10, further comprising a right / left eye display selection unit (248) for selecting the image to be displayed on the right display device (234R) or the left display device (234L).
13. A visual support device as described in claim 1 or 2, characterized in that it includes an image position setting unit (244), and the image position setting unit (244) displays a reduced image (RI) obtained by reducing the image captured in the effective field of view (EV) by the wide-angle camera device (108) at a predetermined reduction rate in a predetermined non-field of view defect portion (NVFD).
14. A visual support device as described in claim 1 or 2, characterized in that it includes a strabismus correction unit (246), which displays a refracted image (RV) obtained by refracting the image captured by the wide-angle camera device (108) with a predetermined refractive index.
Citation Information
Patent Citations
Image processing device, image processing LSI, display, and car navigation system
JP2009265186A
Image display device
JP2017102220A
Image processing apparatus, wearable device, image processing program, image processing method, object recognition apparatus, object recognition program, and object recognition method
JP2020201723A
Head-mounted electronic visual support device and automatic image magnification method of the same
JP2022186616A
Visual Aid System
KR1020170079818A