Navigation system for visually impaired

The navigation system addresses the challenges of visually impaired navigation by providing Braille route information and object recognition, facilitating independent use of public transportation through a GPS and image recognition-based solution.

WO2025009950A1PCT designated stage expired Publication Date: 2025-01-09CHOI SEO YOON +1
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/095741
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-03
Filing Date
2024-04-16
Publication Date
2025-01-09

AI Technical Summary

Technical Problem

Visually impaired individuals face difficulties navigating public transportation due to inadequate assistive devices, particularly in noisy environments where sound-based announcements are hard to hear, and lack of Braille signs, leading to challenges in identifying destinations and obstacles.

Method used

A navigation system incorporating a GPS module, control module, and wand module that provides route information in Braille, extracts information from voice announcements, and recognizes objects through image recognition, using a Braille forming unit, voice collection module, and imaging module to assist visually impaired users.

Benefits of technology

Enables visually impaired individuals to receive essential navigation information in Braille even in noisy environments and identify objects and facilities, enhancing their ability to use public transportation safely and independently.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024095741_09012025_PF_FP_ABST
    Figure KR2024095741_09012025_PF_FP_ABST
Patent Text Reader

Abstract

The navigation system for the visually impaired comprises a GPS module, a control module, and a cane module. The GPS module collects location information by using a GPS satellite. The control module receives, from an external server, route guidance information corresponding to previously input destination and location information. The cane module is capable of communicating with the control module. The cane module comprises a handle part, a main body part, and a braille formation part. The handle part can be gripped. The main body part extends from one end of the handle in a first direction. The braille formation part is coupled to the surface of the handle part. The braille formation part forms braille corresponding to the route guidance information. By using the braille formed in the braille formation part, a user can acquire necessary information without relying on hearing.
Need to check novelty before this filing date? Find Prior Art

Description

Navigation system for the visually impaired

[0001] The present invention relates to a navigation system for the visually impaired. Specifically, the present invention relates to a navigation system that provides route guidance through Braille and assists the movement of the visually impaired through voice and image recognition.

[0002] Unlike non-disabled people, visually impaired people primarily rely on sound and touch to navigate. Therefore, assistive devices for the visually impaired (audio guides, Braille signage, Braille blocks, etc.) are being introduced to assist visually impaired people in using public transportation, including buses and subways.

[0003] However, there are still many areas and facilities that are not adequately equipped with assistive devices for the visually impaired. Furthermore, even when assistive devices are available, visually impaired people can still encounter various difficulties when using public transportation.

[0004] For example, in crowded subway cars, even when announcements are provided, the surrounding noise often makes it difficult for visually impaired passengers to hear them. Consequently, it's extremely difficult for visually impaired passengers to determine whether they've reached their destination based on the announcements. Furthermore, public restrooms often lack audio guides or Braille signs, making it difficult for visually impaired passengers to distinguish between men's and women's restrooms.

[0005] In addition, there are numerous situations where visually impaired people have difficulty using sound and touch to navigate, such as determining whether a desired bus has arrived at a bus stop without announcements, or determining whether it is possible to walk at a crosswalk without announcements.

[0006] The present invention is intended to solve the above-described conventional problems, and aims to provide a navigation system capable of conveying route guidance information in the form of Braille to a visually impaired person even in an environment where it is difficult to obtain information through sound due to ambient noise.

[0007] In addition, the present invention aims to provide a navigation system that can extract some information from announcements provided in public transportation such as subways, buses, and trains and deliver it to visually impaired people in the form of Braille.

[0008] In addition, the present invention aims to provide a navigation system that can extract some objects and corresponding information from collected images and convey them to a visually impaired person in the form of Braille.

[0009] A navigation system for the visually impaired according to one embodiment of the present invention may include a GPS module, a control module, and a cane module.

[0010] The GPS module can collect location information using GPS satellites.

[0011] The control module can receive route guidance information from an external server. The route guidance information may correspond to a pre-entered destination and the above location information.

[0012] The cane module can communicate with the control module. The cane module can include a handle, a main body, and a Braille forming part.

[0013] The handle can be broken.

[0014] The main body portion can extend in a first direction from one end of the handle portion.

[0015] The Braille forming unit can be combined with the surface of the handle unit to form Braille corresponding to the route guidance information.

[0016] A cane module of a navigation system for a visually impaired person according to one embodiment of the present invention may further include a first obstacle detection unit and a second obstacle detection unit.

[0017] The first obstacle detection unit can be coupled to the main body. The first obstacle detection unit can detect an object within a first radius.

[0018] A second obstacle detection unit may be coupled to the main body. The second obstacle detection unit may detect an object within a second radius greater than the first radius.

[0019] The distance from one end of the handle to the first obstacle detection unit may be longer than the distance from one end of the handle to the second obstacle detection unit.

[0020] A navigation system for the visually impaired according to one embodiment of the present invention may further include a voice collection module that collects a plurality of voice signals. The control module may extract a plurality of sample-feature vectors from the plurality of voice signals. Furthermore, the control module may compare each of the plurality of sample-feature vectors with a previously stored reference-feature vector to calculate a similarity. Furthermore, the control module may select a target-feature vector having the highest similarity among the plurality of sample-feature vectors. Furthermore, the control module may perform voice recognition on a target-voice signal corresponding to the target-feature vector to convert the target-voice signal into a string. Furthermore, the control module may extract a predetermined keyword from the string. The Braille generation unit may generate Braille corresponding to the predetermined keyword. The reference-feature vector may correspond to at least one of a feature vector of a subway announcement and a feature vector of a bus announcement. The above-mentioned keyword may correspond to at least one of a subway station name, a bus stop name, and a bus number.

[0021] A navigation system for the visually impaired according to one embodiment of the present invention may further include a photographing module that photographs the surroundings to generate a predetermined image. An artificial intelligence model for identifying objects in the image may be stored in the control module. The control module may identify predetermined objects in the predetermined image using the artificial intelligence model. In addition, the control module may generate facility guidance information based on the predetermined objects and the respective locations of the predetermined objects. The Braille generation unit may generate Braille corresponding to the facility guidance information. The predetermined objects may include at least one of a men's restroom sign, a women's restroom sign, a bus number, a traffic light signal, a handrail, a voice guide, and a Braille sign.

[0022] The cane module of the navigation system for the visually impaired according to one embodiment of the present invention may further include a light detection unit, a lighting unit, a power generation unit, and a battery.

[0023] The above illuminance detection unit may be coupled to the surface of the main body. In addition, the illuminance detection unit may detect the ambient illuminance and generate an electrical signal. The control module may compare the ambient illuminance with a reference illuminance based on the electrical signal. If the ambient illuminance is lower than the reference illuminance, the control module may control the lighting unit to turn on.

[0024] The above lighting unit can receive power and emit light. The lighting unit can extend in the first direction from the surface of the main body.

[0025] The above-mentioned power generation unit may include a lower pressure member, a cover member, a plurality of lower pressure springs, and a plurality of lower piezoelectric elements.

[0026] The lower pressure member can extend in the first direction from one end of the main body.

[0027] The cover member can accommodate the lower pressure member.

[0028] Each of the plurality of lower pressure springs can be accommodated in the cover member. Each of the plurality of lower pressure springs can extend in different directions from the lower pressure member.

[0029] Each of the plurality of lower piezoelectric elements can generate power based on the applied pressure. One end of each of the plurality of lower piezoelectric elements can be coupled to one of the plurality of lower pressure springs. The other end of each of the plurality of lower piezoelectric elements can be coupled to the cover member.

[0030] The above battery can store power generated from the plurality of lower piezoelectric elements.

[0031] A navigation system for the visually impaired according to one embodiment of the present invention may further include a wearable module. The wearable module may be worn on a body part. The wearable module may include a sound generating unit that generates a sound corresponding to the route guidance information. The wearable module may be provided in the form of at least one of glasses, a hat, and a necklace.

[0032] [Additional Example 1]

[0033] In paragraph 5,

[0034] Each of the first to fifth lower pressure springs is one of the plurality of lower pressure springs,

[0035] A navigation system for the visually impaired, wherein the first lower pressure spring extends from the lower pressure member in the first direction, the second lower pressure spring extends from the lower pressure member in a second direction intersecting the first direction, the third lower pressure spring extends from the lower pressure member in a third direction opposite to the second direction, the fourth lower pressure spring extends from the lower pressure member in a fourth direction intersecting the first direction to the third direction, and the fifth lower pressure spring extends from the lower pressure member in a fifth direction opposite to the fourth direction.

[0036] [Additional Example 2]

[0037] In paragraph 6,

[0038] The above development unit,

[0039] An upper pressure member coupled to the surface of the handle and receiving pressure from the outside;

[0040] An upper pressure spring that is accommodated in the handle portion and extends in a second direction intersecting the first direction from the upper pressure member; and

[0041] It further includes an upper piezoelectric element which is housed in the handle portion and generates power based on the applied pressure, one end of which is coupled to the upper pressure spring and the other end of which is coupled to the upper pressure member,

[0042] The above battery is a navigation system for the visually impaired that stores power generated from the upper piezoelectric element.

[0043] [Additional Example 3]

[0044] In the first paragraph,

[0045] The above walking stick module further includes a direction measuring unit that measures the direction of movement and a vibration generating unit that receives power and generates vibration.

[0046] The above direction measuring unit is housed in the main body,

[0047] The vibration generating unit is positioned adjacent to the handle unit,

[0048] A navigation system for the visually impaired, wherein the control module compares the direction of movement measured by the direction measuring unit with the route guidance information received from the external server to determine whether there is a deviation from the route, and controls the operation of the vibration generating unit based on whether there is a deviation from the direction.

[0049] According to one embodiment of the present invention, a navigation system can be provided that can convey route guidance information in the form of Braille to a visually impaired person even in an environment where it is difficult to obtain information through sound due to ambient noise.

[0050] According to one embodiment of the present invention, a navigation system can be provided that can extract some information from announcements provided in public transportation such as subways, buses, and trains and deliver it to visually impaired people in the form of Braille.

[0051] According to one embodiment of the present invention, a navigation system can be provided that can extract some objects and corresponding information from collected images and convey them to a visually impaired person in the form of Braille.

[0052] FIG. 1 is an exemplary illustration of a visually impaired user using a navigation system for the visually impaired according to one embodiment of the present invention.

[0053] FIG. 2 is a block diagram of a navigation system for the visually impaired according to one embodiment of the present invention.

[0054] FIG. 3 is a diagram illustrating a process in which a user finds a destination using a navigation system for the visually impaired according to one embodiment of the present invention.

[0055] FIG. 4 is an exemplary illustration of a user detecting an obstacle with an empty lower space using a walking stick module according to another embodiment of the present invention.

[0056] Figure 5 illustrates an example of a process in which a navigation system for the visually impaired recognizes guidance announcements and generates Braille to provide information to the user.

[0057] Figure 6 illustrates an example of a process in which a navigation system for the visually impaired recognizes a restroom sign and generates Braille to provide information to the user.

[0058] Figure 7 illustrates an example of a process in which a navigation system for the visually impaired recognizes a bus and bus number, generates Braille, and provides information to the user.

[0059] Figure 8 illustrates an example of a process in which a navigation system for the visually impaired recognizes a handrail and generates Braille to provide information to the user.

[0060] Figure 9 is a diagram illustrating the process of generating power in the power generation unit of the walking stick module.

[0061] FIG. 10 is a diagram illustrating a method of arranging multiple lower pressurized water springs to efficiently generate power by utilizing kinetic energy provided in various directions.

[0062] Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the attached drawings. In the drawings, the proportions and dimensions of components may be exaggerated for the purpose of effectively explaining the technical contents.

[0063] The terms "include" and the like are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0064] Additionally, when a component is described as "upper", it means above or below that component, and does not necessarily mean that it is located on the upper side with respect to the direction of gravity.

[0065] Additionally, when a component is described as being "connected" or "coupled" to another component, this may include not only cases where the component is directly connected or coupled to the other component, but also cases where the component is indirectly connected or coupled through another component.

[0066] Additionally, terms such as first, second, etc. may be used to describe certain components, but these terms are only intended to distinguish the components from other components and are not intended to limit the nature, order, or sequence of the components.

[0067] FIG. 1 illustrates an example of a visually impaired user (USR) using a navigation system (NVS) for the visually impaired according to one embodiment of the present invention. FIG. 2 illustrates a block diagram of a navigation system (NVS) for the visually impaired according to one embodiment of the present invention.

[0068] Referring to FIGS. 1 and 2, a navigation system (NVS) for the visually impaired according to one embodiment of the present invention may include a GPS module (GPM), a control module (CTM), a cane module (STM), a voice collection module (VCM), a photographing module (VDM), and a wearable module (WRM).

[0069] The GPS module (GPM) can collect location information using GPS satellites. The location information collected by the GPS module (GPM) may correspond to the user's (USR) current location.

[0070] The control module (CTM) can receive route guidance information from an external server. The route guidance information may correspond to a pre-input destination and location information collected from a GPS module (GPM). The control module (CTM) may be coupled to at least one of a smart device, a wearable device, a wearable module (WRM), and a walking stick module (STM) carried by a user (USR). For example, the wearable device may be at least one of a smart watch, a smart band, and smart glasses. However, the wearable device of the present invention is not limited thereto, and may be a device in the form of clothing, glasses, a bracelet, a watch, shoes, a hat, or the like that can be worn on the body.

[0071] A walking stick module (STM) may include a handle (HD), a body (MD), and a Braille forming part (BF). For example, the walking stick module (STM) may take the form of a walking stick for a visually impaired person that assists the user (USR) to walk without relying on sight.

[0072] The handle (HD) can be gripped. That is, the user (USR) can walk by gripping the handle (HD).

[0073] The main body (MD) can extend in a first direction from one end of the handle (HD). The main body (MD) can contact a support surface and support a user (USR).

[0074] The Braille forming unit (BF) can be attached to the surface of the handle unit (HD). The Braille forming unit (BF) can form Braille corresponding to the route guidance information. That is, even if the user (USR) has both visual and hearing impairments, the user (USR) can acquire information using the Braille formed by the Braille forming unit (BF). The Braille forming unit (BF) can include a plurality of Braille projections (PT) and an actuator (not shown).

[0075] A plurality of dot protrusions (PT) can form a dot by protruding or deprotruding. The plurality of dot protrusions (PT) can be coupled to an actuator.

[0076] The actuator can be controlled by a control module (CTM). The actuator can drive each of the plurality of dot protrusions (PT) to protrude or release.

[0077] The wearable module (WRM) can be worn on a part of the body. The wearable module (WRM) can include a sound generator (SG) that generates a sound corresponding to the route guidance information. The wearable module (WRM) can be provided in the form of at least one of glasses, a hat, and a necklace. That is, the sound generator (SG) can be placed adjacent to the ear of the user (USR) to provide information to the user through sound. In one embodiment of the present invention, the wearable module (WRM) can be omitted.

[0078] FIG. 3 is a diagram illustrating a process in which a user (USR) finds a destination (DS) using a navigation system (NVS) for the visually impaired according to one embodiment of the present invention.

[0079] Referring to Figure 3, when the user (USR) is located at the first point (P1), the route guidance information may include the string "10m straight ahead." Accordingly, the Braille forming unit (BF) may generate the corresponding Braille. can be formed. When the user (USR) reaches the second point (P2), the route guidance information may include the string "turn left." Accordingly, the Braille formation unit (BF) may generate the corresponding Braille. When the user (USR) reaches the third point (P3), the route guidance information may include the string "go straight 30m." Accordingly, the Braille formation unit (BF) may generate the corresponding Braille. can be formed. When the user (USR) reaches the fourth point (P4), the route guidance information may include the string "turn right." Accordingly, the Braille formation unit (BF) may generate the corresponding Braille. When the user (USR) reaches the fifth point (P5), the route guidance information may include the string "arrived at destination." Accordingly, the Braille formation unit (BF) may generate the corresponding Braille. can be formed.

[0080] FIG. 4 is an exemplary illustration of a user detecting an obstacle (HRD) with an empty lower space using a walking stick module (STM) according to another embodiment of the present invention.

[0081] Collisions frequently occur when visually impaired individuals use a cane to walk, failing to recognize an obstacle with a hollow lower surface (HRD). To prevent this problem, the present invention introduces a first obstacle detection unit (SS1) and a second obstacle detection unit (SS2) for detecting an obstacle with a hollow lower surface (HRD). Below, one embodiment of the present invention that implements the aforementioned technical features will be described.

[0082] Referring to FIG. 4, in one embodiment of the present invention, the walking stick module (STM) may include a first obstacle detection unit (SS1) and a second obstacle detection unit (SS2). The first obstacle detection unit (SS1) may be coupled to the main body (MD). The first obstacle detection unit (SS1) may detect an object within a first radius (DT1). The second obstacle detection unit (SS2) may be coupled to the main body (MD). The second obstacle detection unit (SS2) may detect an object within a second radius (DT2) greater than the first radius (DT1). The distance from one end of the handle (HD) to the first obstacle detection unit (SS1) may be longer than the distance from one end of the handle (HD) to the second obstacle detection unit (SS2).

[0083] That is, even in a situation where the first obstacle detection unit (SS1) fails to detect an obstacle (HRD) with an empty lower space, the second obstacle detection unit (SS2) can detect an obstacle (HRD) with an empty lower space. This is because the second obstacle detection unit (SS2) can detect an obstacle that is relatively further away from the support surface and further away than the first obstacle detection unit (SS1). Therefore, by using the present invention, the user (USR) can recognize and avoid an obstacle (HRD) with an empty lower space in advance.

[0084] For example, each of the first obstacle detection unit (SS1) and the second obstacle detection unit (SS2) may be an ultrasonic sensor. However, this is merely an example, and the first obstacle detection unit (SS1) and the second obstacle detection unit (SS2) of the present invention are not limited thereto. The first obstacle detection unit (SS1) and the second obstacle detection unit (SS2) may be sensors capable of detecting adjacent objects. In one embodiment of the present invention, the first obstacle detection unit (SS1) and the second obstacle detection unit (SS2) may be omitted.

[0085] Meanwhile, visually impaired people generally acquire information using their senses of hearing and touch. However, when using public transportation such as subways and buses, visually impaired people frequently experience inconvenience due to the inability to hear announcements due to surrounding noise. To prevent this problem, the present invention discloses a technical feature that selects only announcements from a plurality of collected audio signals and generates corresponding Braille to provide information to visually impaired people. Below, one embodiment of the present invention that implements the aforementioned technical feature is described.

[0086] Figure 5 illustrates an example of a process in which a navigation system (NVS) for the visually impaired recognizes a guidance broadcast and generates Braille to provide information to a user (USR).

[0087] Referring to FIG. 5, in one embodiment of the present invention, a voice collection module (VCM) can collect a plurality of voice signals. For example, the voice collection module (VCM) may be coupled to at least one of a smart device (Smart Device), a wearable device (Wearable Device), a wearable module (WRM), and a walking stick module (STM) carried by a user (USR). For example, the wearable device may be at least one of a smart watch, a smart band, and smart glasses. However, the wearable device of the present invention is not limited thereto, and may be a device in the form of clothing, glasses, a bracelet, a watch, shoes, a hat, or the like that can be worn on the body.

[0088] The control module (CTM) can extract multiple sample-feature vectors from multiple voice signals collected by the voice collection module (VCM). The control module (CTM) can extract feature vectors of a voice signal by converting a time-domain-based voice signal into a frequency-domain signal and then differently transforming the frequency energy of the converted signal. In this process, Mel-Frequency Cepstral Coefficients and Filter Bank Energy can be utilized.

[0089] Additionally, the control module (CTM) can calculate similarity by comparing each of the multiple sample feature vectors with a previously stored reference feature vector. For example, the reference feature vector may correspond to at least one of the feature vectors of subway announcements and the feature vectors of bus announcements. In other words, the reference feature vector may be a feature vector extracted and stored in advance from announcements broadcast on public transportation such as buses, subways, and trains.

[0090] Additionally, the control module (CTM) can select the target feature vector with the highest similarity among multiple sample feature vectors. In other words, in this process, the control module (CTM) can extract the voice signal with characteristics most similar to the announcement.

[0091] Additionally, the control module (CTM) can perform speech recognition on a target-speech signal corresponding to a target-feature vector and convert the target-speech signal into a string.

[0092] In addition, the control module (CTM) can extract a predetermined keyword from a string. The Braille generator (BF) can generate Braille corresponding to the predetermined keyword. The predetermined keyword may correspond to at least one of a subway station name, a bus stop name, and a bus number (BNM). For example, if the predetermined keyword is "Yeoksam Station," the Braille generator (BF) generates Braille corresponding to "Yeoksam Station." In addition, the sound generating unit (SG) of the wearable module (WRM) can generate a sound corresponding to the above-described specific string ("Yeok Sam Station").

[0093] Therefore, using the present invention, users (USRs) can obtain necessary information through Braille even in situations where ambient noise makes it difficult to hear announcements. Furthermore, even users (USRs) with both visual and hearing impairments can conveniently utilize public transportation using the present invention. In one embodiment of the present invention, the voice capture module (VCM) may be omitted.

[0094] Meanwhile, the introduction of devices to provide information to the visually impaired, such as voice guides and Braille signs, is still insufficient. Consequently, visually impaired individuals face difficulties using public transportation facilities such as subway stations, bus stops, and crosswalks. To address this issue, the present invention discloses technical features that assist visually impaired individuals in using public transportation facilities through image recognition technology. Below, one embodiment of the present invention that implements the aforementioned technical features is described.

[0095] In one embodiment of the present invention, the photographing module (VDM) can capture the surroundings to generate a predetermined image. The photographing module (VDM) can capture an area corresponding to the movement direction or field of view of the user (USR) to generate a predetermined image. For example, the photographing module (VDM) may be coupled to at least one of a smart device, a wearable device, a wearable module (WRM), and a walking stick module (STM) carried by the user (USR). For example, the wearable device may be at least one of a smart watch, a smart band, and smart glasses. However, the wearable device of the present invention is not limited thereto, and may be a device in the form of clothing, glasses, a bracelet, a watch, shoes, a hat, or the like that can be worn on the body.

[0096] The control module (CTM) may store an artificial intelligence model that identifies objects in an image. In addition, the control module (CTM) may use the artificial intelligence model to identify predetermined objects in predetermined images collected by the photographing module (VDM). For example, the predetermined objects may include at least one of a men's restroom sign (MTM), a women's restroom sign (FTM), a bus number (BNM), a traffic light signal (not shown), a handrail (HR), a voice guide (not shown), and a Braille sign (not shown). In addition, the control module (CTM) may generate facility guidance information based on the predetermined objects and the respective locations of the predetermined objects. The Braille generation unit (BF) may generate Braille corresponding to the facility guidance information. The sound generation unit (SG) of the wearable module (WRM) may generate a sound corresponding to the facility guidance information. In one embodiment of the present invention, the photographing module (VDM) may be omitted.

[0097] Figure 6 illustrates an example of a process in which a navigation system (NVS) for the visually impaired recognizes a restroom sign, generates Braille, and provides information to a user (USR).

[0098] Referring to Fig. 6, when objects corresponding to the men's restroom sign (MTM) and the women's restroom sign (FTM) are simultaneously identified in a predetermined image collected from the shooting module (VDM), the control module (CTM) can generate facility guidance information including a specific string ("left women's restroom", "right men's restroom"). Thereafter, the Braille generation unit (BF) generates Braille corresponding to the facility guidance information. can be formed. In addition, the sound generating unit (SG) of the wearable module (WRM) can generate a sound corresponding to the above-described specific string ("left women's restroom", "right men's restroom"). That is, by using the present invention, the user (USR) can conveniently use the restroom that matches his / her gender without experiencing the inconvenience caused by confusing the men's and women's restrooms.

[0099] Figure 7 illustrates an example of a process in which a navigation system (NVS) for the visually impaired recognizes a bus and bus number (BNM), generates Braille, and provides information to a user (USR).

[0100] Referring to Fig. 7, when a bus approaching the user (USR) and an object corresponding to the bus number are simultaneously identified in a predetermined image collected from the shooting module (VDM), the control module (CTM) can generate facility guidance information including a specific string ("472"). Thereafter, the Braille formation unit (BF) can generate Braille corresponding to the facility guidance information. can be formed. In addition, the sound generating unit (SG) of the wearable module (WRM) can generate a sound corresponding to the above-described specific string ("472"). That is, by using the present invention, even at a bus stop where no announcement is provided, the user (USR) can conveniently recognize whether the bus he or she wants to board has arrived using Braille.

[0101] Figure 8 illustrates an example of a process in which a navigation system (NVS) for the visually impaired recognizes a handrail (HR), generates Braille, and provides information to a user (USR).

[0102] Referring to Fig. 8, when an object corresponding to a handrail (HR) for assisting walking is identified in a predetermined image collected by the shooting module (VDM), the control module (CTM) can generate facility guidance information including a specific string ("left handrail"). Thereafter, the Braille generation unit (BF) can generate Braille corresponding to the facility guidance information. can be formed. In addition, the sound generating unit (SG) of the wearable module (WRM) can generate a sound corresponding to the above-described special string ("left handrail"). That is, by using the present invention, the user (USR) can conveniently recognize the position of the handrail (HR) that can be utilized for safe walking.

[0103] Although not shown in the drawing, the present invention allows the user (USR) to conveniently recognize and use traffic light signals, voice guidance devices, and Braille signs in the same manner.

[0104] In one embodiment of the present invention, a navigation system (NVS) for the visually impaired may further include a vibration module (not disclosed) that generates vibration. The vibration module may be coupled to a wearable module (WRM). A plurality of vibration modules may be provided. The plurality of vibration modules may generate vibrations corresponding to route guidance information and facility guidance information. The first vibration module and the second vibration module may each be any one of the plurality of vibration modules. The first vibration module may be coupled to one end of the wearable module (WRM), and the second vibration module may be coupled to the other end of the wearable module (WRM). That is, a user (USR) may recognize route guidance information and facility guidance information depending on whether the first vibration module and the second vibration module are operated, respectively.

[0105] Meanwhile, visually impaired individuals have difficulty recognizing the light emitted by vehicles at night and avoiding them. Drivers, too, face the risk of not noticing visually impaired individuals due to limited visibility during nighttime driving, potentially leading to accidents. To prevent this risk, the present invention discloses technical features that emit light in low-light conditions to aid driver visibility and prevent accidents. Below, one embodiment of the present invention that implements the aforementioned technical features will be described.

[0106] In one embodiment of the present invention, referring to the drawings, the walking stick module (STM) may further include a light detection unit (not shown), a lighting unit (not shown), a power generation unit (GNR), and a battery (not shown). The light detection unit may be coupled to the surface of the main body (MD). The light detection unit may detect ambient illuminance and generate an electrical signal. The control module (CTM) may compare the ambient illuminance with a reference illuminance based on the electrical signal. If the ambient illuminance is lower than the reference illuminance, the control module (CTM) may control the lighting unit to turn on. The lighting unit may receive power and emit light. The lighting unit may extend in a first direction from the surface of the main body (MD). That is, by using the present invention, the possibility of a nighttime accident caused by a vehicle may be reduced.

[0107] Meanwhile, power is continuously consumed for each component of the present invention to operate. When a visually impaired person walks using a walking stick module (STM), the tip of the walking stick module (STM) repeatedly taps the ground or obstacles to recognize surrounding obstacles. By generating power using the kinetic energy consumed during this process, a portion of the power consumption (used to operate each component) described above can be covered. In other words, energy harvesting is possible using the kinetic energy provided by the user (USR). Hereinafter, one embodiment of the present invention for implementing energy harvesting will be described.

[0108] Figure 9 is a diagram illustrating the process of generating power in the power generation unit (GNR) of the stick module (STM).

[0109] Referring to FIG. 9, in one embodiment of the present invention, the walking stick module (STM) may further include a light detection unit, a lighting unit, a power generation unit (GNR), and a battery (not shown). The power generation unit (GNR) may include a lower pressure member (PRS), a cover member (CVR), a plurality of lower pressure springs (PRR), and a plurality of lower piezoelectric elements (PZE). When a user (USR) performs a motion of holding the handle unit (HD) and hitting the ground or an obstacle, the kinetic energy generated at this time may be ultimately transferred to the plurality of lower piezoelectric elements (PZE) through the lower pressure member (PRS) and the plurality of lower pressure springs (PRR), thereby generating electric power.

[0110] A lower pressurizing member (PRS) can extend in a first direction from one end of the main body (MD). The lower pressurizing member (PRS) can transmit kinetic energy to a plurality of lower pressurizing springs (PRR).

[0111] The cover member (CVR) can accommodate the lower pressurizing member (PRS).

[0112] Each of the plurality of lower pressurized springs (PRR) can be housed in the cover member (CVR). Each of the plurality of lower piezoelectric elements (PZE) is fixed and coupled to the cover member (CVR), so that it can receive maximum kinetic energy. Each of the plurality of lower pressurized springs (PRR) can extend in different directions from the lower pressurized element (PRS). That is, the plurality of lower pressurized springs (PRR) can transfer kinetic energy provided in various directions to the plurality of lower piezoelectric elements (PZE).

[0113] Each of the plurality of lower piezoelectric elements (PZE) can generate power based on an applied pressure. One end of each of the plurality of lower piezoelectric elements (PZE) can be coupled to one of the plurality of lower pressure relief springs (PRR). The other end of each of the plurality of lower piezoelectric elements (PZE) can be coupled to a cover member (CVR).

[0114] The battery can store power generated from multiple piezoelectric elements (PZEs). The battery can supply power to each component.

[0115] Hereinafter, a method of arranging a plurality of lower pressurized water rollers (PRRs) for efficiently generating power by utilizing kinetic energy provided in various directions is specifically described.

[0116] FIG. 10 is a diagram illustrating a method of arranging a plurality of lower pressurized recirculating water springs (PRRs) to efficiently generate power by utilizing kinetic energy provided in various directions.

[0117] Referring to FIG. 10, in one embodiment of the present invention, each of the first lower pressure spring (PRR1) to the fifth lower pressure spring (PRR5) may be any one of a plurality of lower pressure springs (PRR).

[0118] The first lower pressure spring (PRR1) can extend from the lower pressure member (PRS) in a first direction (DR1). The second lower pressure spring (PRR2) can extend from the lower pressure member (PRS) in a second direction (DR2) intersecting the first direction (DR1). The third lower pressure spring (PRR3) can extend from the lower pressure member (PRS) in a third direction (DR3) opposite to the second direction (DR2). The fourth lower pressure spring (PRR4) can extend from the lower pressure member (PRS) in a fourth direction (DR4) intersecting the first direction (DR1) to the third direction (DR3). The fifth lower pressure spring (PRR5) can extend from the lower pressure member (PRS) in a fifth direction (DR5) opposite to the fourth direction (DR4). That is, regardless of whether the above-described kinetic energy is provided in any of the first direction (DR1) to the fifth direction (DR5) through the lower pressurizing member (PRS), the plurality of lower piezoelectric elements (PZE) can receive the kinetic energy and generate power. Accordingly, regardless of the angle at which the user (USR) grips the handle (HD) and performs a motion of hitting the ground or an obstacle, power can be generated.

[0119] Hereinafter, another embodiment of the present invention for implementing energy harvesting is additionally described.

[0120] In one embodiment of the present invention, the power generation unit (GNR) may further include an upper pressure member (not shown), an upper pressure spring (not shown), and an upper piezoelectric element (not shown).

[0121] The upper pressure member can be attached to the surface of the handle portion (HD). The upper pressure member can receive pressure from an external source. For example, the user (USR) can apply pressure to the upper pressure member by gripping the handle portion (HD).

[0122] The upper pressure spring can extend in a second direction (DR2) intersecting the first direction (DR1) from the upper pressure member.

[0123] The upper piezoelectric element can generate power based on the applied pressure. One end of the upper piezoelectric element can be coupled to the upper pressure spring. The other end of the upper piezoelectric element can be coupled to the upper pressure member.

[0124] Hereinafter, another embodiment of the present invention for detecting the direction of movement of a user (USR) and guiding the walking of the user (USR) is additionally described.

[0125] In one embodiment of the present invention, the walking stick module (STM) may further include a direction measuring unit (not shown) and a vibration generating unit (not shown).

[0126] The direction measuring unit can measure the direction of movement of the user (USR). The direction measuring unit can be stored in the main body (MD).

[0127] The vibration generating unit can generate vibrations by receiving power. The vibration generating unit can be positioned adjacent to the handle unit (HD).

[0128] The control module (CTM) can determine whether a path has been deviated by comparing the direction of movement measured by the direction measurement unit with the route guidance information received from an external server. The control module (CTM) can control the operation of the vibration generation unit depending on whether a path has been deviated. Therefore, using the present invention, the user (USR) can independently detect whether a path has been deviated through vibration and correct the direction of movement.

[0129] Although the present invention has been described with reference to specific embodiments, those skilled in the art will appreciate that various modifications and variations can be made to the present invention without departing from the spirit and scope of the present invention as defined in the following claims. Furthermore, the embodiments disclosed herein are not intended to limit the technical spirit of the present invention, and all technical ideas falling within the scope of the following claims and their equivalents should be construed as being included within the scope of the present invention.

[0130] The present invention provides a technology that enables visually impaired individuals to acquire necessary information using at least one of their senses, tactile and auditory. Therefore, the present invention offers a more convenient navigation system for visually impaired individuals, and thus has high industrial applicability.

Claims

1. GPS module that collects location information using GPS satellites; A control module that receives route guidance information corresponding to a pre-entered destination and the location information from an external server; and Includes a wand module capable of communicating with the above control module, The above wand module is, A handle that can be gripped; A main body extending in a first direction from one end of the handle portion; and A navigation system for the visually impaired, comprising a Braille forming unit that is coupled to the surface of the handle to form Braille corresponding to the route guidance information.

2. In paragraph 1, The above wand module is, A first obstacle detection unit coupled to the main body and detecting an object within a first radius; and It further includes a second obstacle detection unit coupled to the main body and detecting an object within a second radius greater than the first radius, A navigation system for the visually impaired, wherein the distance from one end of the handle to the first obstacle detection unit is longer than the distance from one end of the handle to the second obstacle detection unit.

3. In paragraph 1, It further includes a voice collection module that collects multiple voice signals, The control module extracts a plurality of sample-feature vectors from the plurality of voice signals, compares each of the plurality of sample-feature vectors with a previously stored reference-feature vector to calculate a similarity, selects a target-feature vector having the highest similarity among the plurality of sample-feature vectors, performs voice recognition on a target-voice signal corresponding to the target-feature vector to convert the target-voice signal into a string, and extracts a predetermined keyword from the string. The above Braille forming unit forms Braille corresponding to the predetermined keyword, A navigation system for the visually impaired, wherein the above-mentioned reference feature vector corresponds to at least one of a feature vector of a subway announcement and a feature vector of a bus announcement, and the above-mentioned predetermined keyword corresponds to at least one of a subway station name, a bus stop name, and a bus number.

4. In paragraph 1, It further includes a shooting module that takes pictures of the surroundings and creates a predetermined video, An artificial intelligence model that identifies objects in the above image is stored in the control module, The control module identifies predetermined objects in the predetermined image using the artificial intelligence model, and generates facility guidance information based on the predetermined objects and the locations of each of the predetermined objects, and the Braille forming unit forms Braille corresponding to the facility guidance information. A navigation system for the visually impaired, wherein the above-described objects include at least one of a men's restroom sign, a women's restroom sign, a bus number, a traffic light signal, a handrail, a voice guide, and a Braille sign.

5. In paragraph 1, The above-mentioned wand module further includes a light detection unit, a lighting unit, a power generation unit, and a battery. The above illuminance detection unit is coupled to the surface of the main body, detects the surrounding illuminance, and generates an electrical signal. The above control module compares the ambient illuminance with the reference illuminance based on the electrical signal, and controls the lighting unit to turn on when the ambient illuminance is lower than the reference illuminance. The above lighting unit receives power, emits light, and extends in the first direction from the surface of the main body, The above development unit, A lower pressure member extending in the first direction from one end of the main body; A cover member for storing the lower pressure member; A plurality of lower pressure springs each of which is housed in the cover member and extends in different directions from the lower pressure member; and Each of the plurality of lower piezoelectric elements generates power based on an applied pressure, each end of which is coupled to one of the plurality of lower pressurized water springs, and each other end of which is coupled to the lower pressurized member, The above battery is a navigation system for the visually impaired that stores power generated from the plurality of lower piezoelectric elements.

6. In paragraph 1, It further includes a wearable module worn on a body part, The above-mentioned wearing module includes a sound generating unit that generates a sound corresponding to the above-mentioned route guidance information, The above wearable module is a navigation system for the visually impaired provided in the form of at least one of glasses, a hat, and a necklace.

Citation Information

Patent Citations

  • Multi-purpose Stick of Self-generating Type

    KR101535581B1

  • Cane for the blind using electronic braille

    KR101782059B1

  • Stick for a blind person

    KR101822084B1

  • Self-electricity generation type cane for visually handicapped people

    KR1020140017993A

  • Smart system for blind people and method for obstacle detection

    KR1020170053061A