Portable visual aids, smart devices, head-mounted visual aids

Abstract

The present invention discloses a portable visual aid device, which includes a processing unit, at least one image acquisition unit, and a display unit. The image acquisition unit is used to obtain two-dimensional or three-dimensional information of a target object. The processing unit processes the two-dimensional or three-dimensional information to form visual aid additional information. The display unit is used to superimpose and display the visual aid additional information on the target object. Compared with the prior art, the present invention superimposes and displays the visual aid additional information on the target object to add visualized travel information for users. It can be applied to multiple work scenarios of outdoor travel such as going up and down stairs and traveling at night, providing convenience for users, especially low-vision users, to travel outdoors, eliminating safety hazards and greatly improving the sense of safety of low-vision users traveling outdoors. The present invention also provides an intelligent electronic device, a head-mounted visual aid device, and a stair-climbing aid device.

Description

Technical Field

[0001] The present invention relates to the field of intelligent medical equipment, and in particular to a portable visual aid device, an intelligent electronic device, a head-mounted visual aid device and a stair climbing aid device. Background Art

[0002] Low vision usually refers to visual dysfunction that cannot be improved by surgery, drugs or general optometry, mainly including decreased vision and reduced visual field. The causes of low vision vary greatly among people of different age groups. According to foreign data, among people under 29 years old, congenital eye diseases account for the vast majority of the causes, and they are arranged in order of congenital eye structure defects and nystagmus, congenital cataracts, macular dystrophy, congenital optic atrophy, albinism, primary retinitis pigmentosa, and posterior crystalline fibrosis; among people aged 30 to 59, they are arranged in order of optic atrophy, primary retinitis pigmentosa, diabetic retinopathy, macular dystrophy, myopic retinal choroidopathy, etc.; among people over 60 years old, age-related macular damage accounts for the vast majority, reaching more than 50%, followed by glaucoma, senile cataracts, diabetic retinopathy, optic atrophy, myopic retinal choroidopathy, etc.

[0003] Among them, retinal detachment, glaucoma, retinal vein occlusion, retinitis pigmentosa, brain tumors or cerebrovascular disorders are the more common causes of visual field loss. Taking glaucoma as an example, the most notable feature of visual field loss in glaucoma is tubular vision. Glaucoma patients can only see the scenery within their own tubular vision but not the scenery outside their own vision, which greatly affects the life and study of glaucoma patients.

[0004] In the prior art, when people with low vision go out, especially when going up and down stairs in public places such as subway stations, they cannot see the outline of the stairs because the color of the stairs is similar, which greatly affects the outdoor travel of low vision users and makes them prone to falling, posing a great safety hazard. Therefore, there is an urgent need for a portable visual aid device, an intelligent electronic device, a head-mounted visual aid device, and a stair-climbing aid device that facilitates low vision users to go out to solve the deficiencies in the prior art. Summary of the invention

[0005] In order to solve the technical problems in the above-mentioned prior art, the purpose of the present invention is to provide a portable visual aid device, an intelligent electronic device, a head-mounted visual aid device and a stair climbing aid device that are convenient for low-vision users to travel outdoors.

[0006] To achieve one of the above-mentioned purposes of the invention, one embodiment of the present invention provides a portable visual aid device, which includes a processing unit, at least one image acquisition unit, and a display unit. The image acquisition unit is used to obtain two-dimensional or three-dimensional information of the target object, the processing unit processes the two-dimensional or three-dimensional information to form visual aid additional information, and the display unit is used to superimpose the visual aid additional information on the target object.

[0007] As a further improvement of one embodiment of the present invention, the image acquisition unit includes a projection unit and a camera unit. The projection unit is used to project structured light onto the surface of the target object, and the camera unit is used to obtain two-dimensional or three-dimensional information of the structured light image of the target object.

[0008] As a further improvement of an embodiment of the present invention, the display unit is a visible light projection device, an invisible light projection device or a display screen.

[0009] As a further improvement of an embodiment of the present invention, the visible light projection device or the invisible light projection device includes a galvanometer and a micro projector.

[0010] As a further improvement of an embodiment of the present invention, the two-dimensional or three-dimensional information includes height differences between different planes of the target object.

[0011] As a further improvement of an embodiment of the present invention, the visual auxiliary additional information includes difference prompts, safety prompts and danger prompts made according to the height difference.

[0012] As a further improvement of an embodiment of the present invention, when the target object is a staircase, the difference prompt includes displaying different steps at intervals of different colors or patterns, and the two-dimensional or three-dimensional information includes the vertical height difference between multiple steps of the staircase and the step where the user is located. When the height difference of any step is less than a preset safety threshold, the safety prompt is displayed on the step; when the height difference of any step is greater than the preset safety threshold, the danger prompt is displayed on the step.

[0013] As a further improvement of an embodiment of the present invention, the visual auxiliary additional information includes high color difference bright display, high color difference outline display, high color difference text prompt, and grid outline display.

[0014] As a further improvement of an embodiment of the present invention, the visual auxiliary additional information includes two-dimensional or three-dimensional information of the target object and horizontal distance information between the target object and the user.

[0015] To achieve one of the above-mentioned purposes of the invention, the present invention further provides an intelligent electronic device, comprising the portable visual aid device as described above.

[0016] In order to achieve one of the above-mentioned objects of the invention, the present invention also provides a head-mounted visual aid device, including a portable visual aid device as described above.

[0017] In order to achieve one of the above-mentioned purposes of the invention, the present invention also provides a device for assisting people in going up and down stairs, the device comprising a processing unit, at least one image acquisition unit, and a display unit, the image acquisition unit being used to obtain two-dimensional or three-dimensional information of the stairs, the processing unit processing the two-dimensional or three-dimensional information to form visual auxiliary information, and the display unit being used to superimpose and display the visual auxiliary information on the stairs.

[0018] Compared with the prior art, the beneficial effects of the present invention are as follows: the portable visual aid device of the present invention includes a processing unit, at least one image acquisition unit, and a display unit, wherein the image acquisition unit is used to obtain two-dimensional or three-dimensional information of the target object, the processing unit processes the two-dimensional or three-dimensional information to form visual aid additional information, and the display unit is used to superimpose and display the visual aid additional information on the target object. The portable visual aid device of the present invention can process the two-dimensional or three-dimensional information of the target object to form visual aid additional information, and superimpose and display the visual aid additional information on the target object to add visualized travel information for the user, and can be applied to multiple work scenarios of outdoor travel such as going up and down stairs, traveling at night, etc., providing convenience for users, especially low-vision users, to travel outdoors, eliminating potential safety hazards and greatly improving the sense of safety of low-vision users traveling outdoors. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram of hardware modules of an embodiment of a portable visual aid device;

[0020] Figure 2 is a schematic diagram showing a difference prompt displayed to a user in a stair work mode according to an embodiment of the present invention;

[0021] Figure 3 yes Figure 2 Schematic diagram of the stair work mode after the user goes down one step;

[0022] Figure 4 is a schematic diagram showing safety prompts and danger prompts displayed to a user in a stair work mode according to another embodiment of the present invention;

[0023] Figure 5 yes Figure 4 Schematic diagram of the stair work mode after the user in FIG. goes down one step.

[0024] in:

[0025] 100. Portable visual aid device; 101. Processing unit; 102. Image acquisition unit; 103. Display unit; 200. Target object; 300. User. DETAILED DESCRIPTION

[0026] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0027] The technical solution of the present invention is further described below with reference to the accompanying drawings and through specific implementation methods.

[0028] See also Figure 1 In order to achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a portable visual aid device 100, wherein the device 100 includes a processing unit 101, at least one image acquisition unit 102, and a display unit 103. The image acquisition unit 102 is used to obtain two-dimensional or three-dimensional information of the target object 200, the processing unit 101 processes the two-dimensional or three-dimensional information to form visual aid additional information, and the display unit 103 is used to superimpose and display the visual aid additional information on the target object. The processing unit 101 may include a processor (not shown) and a memory (not shown). For example, operating instructions of the portable visual aid device 100 may be stored in a memory, and the processor may be activated / instructed (for example, by a user 300) according to the stored instructions. In addition, data acquired and / or used during the operation of the portable visual aid device 100 may be stored in the memory of the processing unit 101.

[0029] In a specific embodiment, the image acquisition unit 102 can project structured light. For example, the image acquisition unit 102 can include a projection unit and a camera unit. The projection unit is configured to project structured light onto the surface of the target object. The camera unit is configured to obtain two-dimensional or three-dimensional information of the structured light image of the target object. In this specific embodiment, an optical means such as a camera is used to capture the appearance or three-dimensional structure information of the target object, and then the acquired information is processed to obtain two-dimensional or three-dimensional information of the target object. Those skilled in the art should understand that in other embodiments, other technical means such as time-of-flight ("TOF") technology can also be used to emit a continuous "surface light source", and the distance between the light source (such as laser, LED, etc.) and the object can be quickly calculated by recording the time when the reflected light reaches the receiver, thereby obtaining two-dimensional or three-dimensional information such as a 3D image and contour of the target object.

[0030] In one embodiment of the present invention, the display unit 103 may be a light projection device. The light projection device may project visible light and / or invisible light. The light projection device may be a visible light projection device, such as a galvanometer or a micro projector, and the visible light projection device is configured to project visible light onto a target object of interest to the user. For example, when a low-vision user is traveling outdoors, such as when going up and down stairs, the portable visual aid device 100 of the present invention may be used, and the light emitted by the image acquisition unit 102 forms the outline of the stairs on multiple steps and is superimposed and displayed on the stairs, so that the low-vision user can accurately see the width and height of the stairs, avoiding accidents caused by unclear boundaries of the stair steps.

[0031] Of course, the light projection device can also be an invisible light projection device, which is configured to project invisible light (for example, infrared light invisible to human eyes, etc.) onto the target object that the user is interested in. The user can see the visual auxiliary additional information superimposed on the stairs or other target objects through special devices such as a camera of a mobile phone or AR glasses.

[0032] In one embodiment of the present invention, the display unit 103 may be an electronic display screen, such as an AR augmented reality type of assisted vision glasses that integrates optical and electrical hardware and software. The assisted vision glasses are designed to capture the user's surrounding scene image, and display the captured scene in real time through the AR display system, and the displayed scene can be enlarged or modified to assist in enhancing the vision of low-vision users. Taking the above-mentioned use mode of low-vision users going up and down stairs ("stair working mode") as an example, low-vision users can see the stairs and the outlines superimposed on the stairs through the display screen of the assisted vision glasses to enhance the vision of low-vision users when traveling outdoors to improve personal safety. The two-dimensional or three-dimensional information includes the height difference between different planes of the target object. The two-dimensional or three-dimensional information includes not only the height and width of each staircase, but also the height difference between each staircase, so that the user can more intuitively feel the height difference of the stairs, eliminate safety hazards, and greatly enhance the sense of safety of low-vision users traveling outdoors. In another embodiment, the display unit 103 may be a screen of a handheld smart device, such as a smart phone screen.

[0033] The visual auxiliary additional information of the present invention includes high color difference bright display, high color difference outline display, high color difference text prompt, and grid outline display. Figure 2When the low-vision user 300 uses the portable visual aid device 100 of the present invention to go up and down the stairs ("stair working mode"), the image acquisition unit 102 projects light on the target object 200 of interest selected by the user to remind the user, such as the three steps under the feet (such as the three steps that the user will go down when going down the stairs). For example, the portable visual aid device 100 can be configured to select the target object by the user 300 pointing the portable visual aid device 100 and / or the image acquisition unit 102 to the target object 200. The three steps of the stairs all appear a bright display showing the outline of the stairs to show the width and height of each step of the stairs. In one embodiment, the portable visual aid device 100 is configured to display adjacent stairs on the stairs in different colors and / or patterns. In one embodiment, the first step of the stairs can display a yellow grid-like outline on the stairs, the second step of the stairs can display a blue grid-like outline, and the third step of the stairs is the same as the first step of the stairs, and also displays a yellow grid-like outline, so that the difference in the interval between the yellow and blue grids reminds the low-vision user to improve the safety of going up and down the stairs. In other embodiments, the difference prompts may be displayed at different steps in different colors or patterns at intervals.

[0034] Reference Figure 3 After the user goes down one step of stairs, the portable visual aid device 100 continues to work. Similarly, the three steps under the user's feet still display yellow grid outlines, blue grid outlines, and yellow grid outlines in sequence to distinguish each step of the stairs, thereby improving the vision and sense of security of low-vision users and meeting the needs of low-vision users when traveling outdoors.

[0035] It should be understood that in other embodiments, the portable visual aid device 100 can be configured to display the visual aid additional information on a number of steps other than three. In one embodiment, the portable visual aid device 100 can be configured to display the visual aid additional information on at least two steps (e.g., grid outlines of different colors are displayed on two steps). In another embodiment, the portable visual aid device 100 in other embodiments can be configured to display the visual aid additional information on at least three steps (e.g., three steps are illuminated and display grid outlines of different colors, four steps are illuminated and display grid outlines of different colors, etc.).

[0036] In one embodiment of the present invention, the visual auxiliary additional information displays a high color difference contour display, and the two-dimensional or three-dimensional information of the target object 200 acquired by the image acquisition unit 102 includes the vertical height difference between multiple steps of stairs and the step where the user is located (such as the height direction of the stairs). Different from the previous embodiment, in this embodiment, the visual auxiliary additional information also includes one or more difference prompts, safety prompts and danger prompts made according to the height difference. When the height difference of any step is less than a preset safety threshold, the safety prompt is displayed on the step; when the height difference of any step is greater than the preset safety threshold, the danger prompt is displayed on the step. Reference Figure 4 For example, the safety threshold is set to 25 cm, and only the next step closest to the user is less than 25 cm from the step where the user is. In one embodiment, the safety alert and the danger alert can be implemented by displaying different colors on the steps. For example, a step is displayed with a first color (e.g., green) for a safety alert, and a second color (e.g., red) is displayed for the next step. For example, a green grid outline is displayed only on the next step closest to the user, i.e., a safety prompt, while the other steps below are displayed with a red grid outline, i.e., a danger prompt.

[0037] Reference Figure 5 , after the user goes down one step of stairs, the portable visual aid device continues to work. Similarly, the three steps under the user's feet still display the green grid outline, the red grid outline, and the red grid outline in sequence. The user only needs to follow the prompts of the visual aid additional information and only needs to walk to the step where the green grid outline is located to go down the stairs safely. In other alternative implementations, the safety prompts and danger prompts can also be fonts or patterns or sound reminder signals, vibration reminder signals, and any combination of two or more thereof. Figure 2-Figure 5 The shape of the flashlight in the accompanying drawings is an embodiment of the portable visual aid device of the present invention. It should be understood that the shape / form of the portable visual aid device 100 can also be a necklace, glasses, a hat, or other shapes or structures wearable on the human body without being limited to the shapes or structures shown in the drawings.

[0038] In one embodiment of the present invention, the visual aid additional information includes two-dimensional or three-dimensional information of the target object and horizontal distance information between the target object and the user. For example, when a low-vision user is in a night travel mode, the low-vision user uses the portable visual aid device of the present invention, and the image acquisition unit 102 projects light forward to illuminate the object in front of the user. If an object in front is encountered, such as a door frame, the display unit 103 will superimpose the outline of the door frame on the door frame in reality, and can display the horizontal distance between the door frame and the user. If there are multiple objects in front, the user can also be prompted to take the route of the object without obstruction, that is, to help the user intelligently plan a safe route. In other embodiments, a sensor component, such as a distance sensor, can also be added to monitor the horizontal distance between the target object of interest to the user and the user. The distance sensor can be a micro-electromechanical MEMS sensor, an ultrasonic sensor, a laser ranging sensor, a millimeter wave sensor, a radar ranging sensor, a structured light sensor, an optical ranging sensor, and a camera. One or a combination of several.

[0039] The present invention also provides an intelligent electronic device, including the portable visual aid device as described above, and the intelligent electronic device may be a mobile phone, a tablet computer PAD or a laptop computer.

[0040] The present invention also provides a head-mounted visual aid device, including a portable visual aid device as described above. For example, the head-mounted visual aid device may be smart AR vision-enhancing glasses.

[0041] The present invention also provides a stair climbing and descending assisting device, the device comprising a processing unit, at least one image acquisition unit, and a display unit, the image acquisition unit being used to acquire two-dimensional or three-dimensional information of the stairs, the processing unit processing the two-dimensional or three-dimensional information to form visual assisting additional information, and the display unit being used to superimpose and display the visual assisting additional information on the stairs. The technical features of the image acquisition unit, the display unit, and the processing unit of the stair climbing and descending assisting device can refer to the technical features of the portable visual assisting device 100 in this specification, and will not be repeated here.

[0042] The users described in the present invention include low vision users, such as patients with early-stage macular degeneration, macular degeneration (AMD), glaucoma, macular holes and other FOV field-related blindness or vision defects, such as central macular scar, histoplasmosis, advanced glaucoma, macular degeneration, central serous retinopathy, myopic macular degeneration, diabetic macular edema, bladder ID macular edema, macular hole, macular atrophy, central macular scar, histoplasmosis, macular hole, anterior ischemic optic neuropathy and retinitis pigmentosa, etc.

[0043] Various aspects:

[0044] It should be understood that any one of aspects 1-11 may be combined with aspect 12.

[0045] Aspect 1: A portable visual aid device, comprising a processing unit, at least one image acquisition unit, and a display unit, wherein the image acquisition unit is used to obtain two-dimensional or three-dimensional information of a target object, the processing unit processes the two-dimensional or three-dimensional information to form visual aid additional information, and the display unit is used to superimpose and display the visual aid additional information on the target object.

[0046] Aspect 2: According to a portable visual aid device described in Aspect 1, the image acquisition unit includes a projection unit and a camera unit, the projection unit is used to project structured light onto the surface of the target object, and the camera unit is used to obtain two-dimensional or three-dimensional information of the structured light image of the target object.

[0047] Aspect 3: According to the portable visual aid device described in Aspect 1, the display unit is a visible light projection device, an invisible light projection device or a display screen.

[0048] Aspect 4: According to the portable visual aid device described in Aspect 3, the visible light projection device or the invisible light projection device includes a galvanometer or a micro projector.

[0049] Aspect 5: According to the portable visual aid device of Aspect 1, the two-dimensional or three-dimensional information includes the height difference between different planes of the target object.

[0050] Aspect 6: According to the portable visual aid device described in Aspect 5, the visual aid additional information includes difference prompts, safety prompts and danger prompts made according to the height difference.

[0051] Aspect 7: According to a portable visual aid device described in Aspect 6, when the target object is a staircase, the difference prompt includes displaying different steps at intervals of different colors or patterns, and the two-dimensional or three-dimensional information includes the vertical height difference between multiple steps of the staircase and the step where the user is located. When the height difference of any step is less than a preset safety threshold, the safety prompt is displayed on the step; when the height difference of any step is greater than the preset safety threshold, the danger prompt is displayed on the step.

[0052] Aspect 8: According to the portable visual aid device described in Aspect 1, the visual aid additional information includes high color difference bright display, high color difference outline display, high color difference text prompt, and grid outline display.

[0053] Aspect 9: According to the portable visual aid device of Aspect 1, the visual aid additional information includes two-dimensional or three-dimensional information of the target object and horizontal distance information between the target object and the user.

[0054] Aspect 10: An intelligent electronic device, comprising: a portable visual aid device as described in any one of Aspects 1-9.

[0055] Aspect 11: A head-mounted visual aid device, comprising: a portable visual aid device as described in any one of Aspects 1-9.

[0056] Aspect 12: A device for assisting people in going up and down stairs, the device comprising a processing unit, at least one image acquisition unit, and a display unit, the image acquisition unit being used to acquire two-dimensional or three-dimensional information of the stairs, the processing unit processing the two-dimensional or three-dimensional information to form additional visual assistance information, and the display unit being used to superimpose and display the additional visual assistance information on the stairs.

[0057] It should be understood that although this specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation mode may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

[0058] The portable visual aid device, intelligent electronic device and vision enhancement device provided in the embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A portable visual aid device, characterized in that: The device includes a processing unit, at least one image acquisition unit, and a display unit. The image acquisition unit is used to obtain three-dimensional information of the target object. The processing unit processes the three-dimensional information to form visual auxiliary additional information. The display unit is used to superimpose and display the visual auxiliary additional information on the target object, wherein the three-dimensional information includes the outline of the target object and the height difference between different planes of the target object. The processing unit distinguishes adjacent different planes with height difference of the target object based on the height difference. The visual auxiliary additional information includes light of different colors and / or different patterns projected onto the adjacent different planes with height difference of the target object.

2. A portable visual aid device according to claim 1, characterized in that: The image acquisition unit includes a projection unit and a camera unit. The projection unit is used to project structured light onto the surface of the target object, and the camera unit is used to obtain three-dimensional information of the structured light image of the target object.

3. A portable visual aid device according to claim 1, characterized in that: If the visual auxiliary additional information includes light of different colors, or light of different colors and different patterns, projected onto the adjacent different planes with height differences of the target object, then the display unit is a visible light projection device; If the visual auxiliary additional information includes light of different patterns projected onto the adjacent different planes with height differences of the target object, the display unit is a visible light projection device or an invisible light projection device.

4. A portable visual aid device according to claim 3, characterized in that: The visible light projection device or the invisible light projection device includes a galvanometer and a micro projector.

5. The portable visual aid device according to claim 1, characterized in that: The visual assistance additional information also includes difference prompts, safety prompts and danger prompts made according to the height difference.

6. A portable visual aid device according to claim 5, characterized in that: When the target object is a staircase, the difference prompt includes displaying different steps at intervals of different colors or patterns, and the three-dimensional information includes the vertical height difference between multiple steps of the staircase and the step where the user is located. When the height difference of any step is less than a preset safety threshold, the safety prompt is displayed on the step; when the height difference of any step is greater than the preset safety threshold, the danger prompt is displayed on the step.

7. A portable visual aid device according to claim 1, characterized in that: The visual assistance additional information also includes three-dimensional information of the target object and horizontal distance information between the target object and the user.

8. An intelligent electronic device, characterized in that: include: A portable visual aid device as claimed in any one of claims 1 to 7.

9. A head-mounted visual aid device, characterized in that: include: A portable visual aid device as claimed in any one of claims 1 to 7.

10. A stair climbing assisting device, characterized in that: The device includes a processing unit, at least one image acquisition unit, and a display unit. The image acquisition unit is used to obtain three-dimensional information of the stairs. The processing unit processes the three-dimensional information to form visual auxiliary additional information. The display unit is used to superimpose and display the visual auxiliary additional information on the stairs, wherein the three-dimensional information includes the outline of the stairs and the height difference between different planes of the stairs. The processing unit distinguishes adjacent different planes of the stairs with height difference based on the height difference. The visual auxiliary additional information includes light of different colors and / or different patterns projected onto the adjacent different planes of the stairs with height difference.

Images