Orientation assistance system for the blind

Abstract

The present invention is part of an aid for the blind, in particular part of a dedicated orientation system. In particular, the present system is suitable both for home assistance and for outdoor use, advantageously freeing the user's hands.

Description

Technical Field

[0001] This invention is part of assistive devices for the blind, and in particular part of assistive devices for dedicated orientation systems. Background Technology

[0002] It is well known that one of the greatest inconveniences for blind or visually impaired people is the difficulty of orientation in enclosed environments and especially in open environments.

[0003] Generally speaking, we can say that blind and visually impaired people form a "mental map" of their familiar surrounding space; for able-bodied people who have been blind during their lifetime, this map is formed from memory; for congenitally blind people, the details constituting the map come from their understanding of the environment through touch. Any new input from the outside constantly updates and expands this mental representation of the surrounding space. More specifically, the main problem for blind people is that they cannot properly interpret the mental map until they identify a known reference point through touch (which allows them to refer to the map itself, indicating their location by defining a kind of "mental north"). A blind person can only move in a straight line, each step corresponding to a real unit of measurement. After identifying a subsequent tactile reference point, the object stops, and once a decision is made on which way to go, the mental map returns to reposition itself, allowing the person to start the journey again.

[0004] To date, systems have been designed to assist blind people with orientation, but these systems have not been very successful. In particular, consider, for example, the iBeacon system: a technology developed by Apple configured as an indoor positioning system, consisting of transmitters that use Bluetooth Low Energy (BLE) to provide localized services for iPhones and iOS devices (or the latest generation of Android smartphones). In practice, low-cost Bluetooth transmitters, called "beacons," are used to send signals to iOS or Android devices, which are then processed by installed apps that respond by performing programmed actions such as accessing the network or sending notifications to the device.

[0005] Basically, if an individual owns a device compatible with the iBeacon system and passes by a point with a beacon transmitter, the beacon device will lock onto the compatible device and send information, such as information about its installation location. Related to this information, iBeacon's functionality takes the form of sending a notification to a smartphone video in the form of a written pop-up window (which is then converted to audio via voice-over) after the relevant application is installed.

[0006] This feature is clearly not very effective and is not practical for blind people at all, because their hands are occupied by the smartphone, thus limiting their autonomy in movement. The particular disadvantage is that the device (smartphone) is difficult to manage without visual interaction.

[0007] Furthermore, the system is very expensive because it must take into account, for example, the purchase of a smartphone device that supports the BLE protocol, and the additional purchase of any licenses required to activate the beacon's functionality.

[0008] Therefore, in a completely disadvantageous way, the cost and (most importantly) the need to manually manage the smartphone greatly limit the possibility of blind users using such a system.

[0009] One object of the present invention is to describe an orientation assistive system for visually impaired people that is not cumbersome, and in particular, frees their hands.

[0010] Another object of the present invention is to describe an orientation assistive system for visually impaired people that is simple and quick to use.

[0011] Another object of the present invention is to describe an assistive system for visually impaired people that is economical in terms of purchase and use.

[0012] Another objective of this invention is to enable blind people to be independent at home and when they are out.

[0013] Another object of the present invention is to describe an assistive system for the blind, which is accessible to every user and every operator. Summary of the Invention

[0014] These and further objectives will be achieved through an innovative orientation assistive system for the blind, wherein the system comprises at least a first fixed wireless device acting as a receiver and / or transmitter, located in any internal or external location, and at least one additional mobile wireless device, and at least one remote server connected to the at least one fixed wireless device, the first mobile wireless device being provided to at least one user, characterized by comprising at least one additional second fixed wireless receiver / transmitter device, the first fixed wireless device being a master device, the remote server being connected to the master device, the master device being connected to at least the second fixed slave device, the at least one slave device being capable of connecting to at least the first mobile wireless device, the first mobile wireless device comprising at least two radio modules, such as Bluetooth, and being accommodated in a first wearable accessory; the system comprises at least one second mobile wireless device (receiver / transmitter) comprising at least one radio module, the second mobile wireless device being accommodated in a second wearable accessory, the second mobile wireless device being adapted to send at least one voice message to the user, the first and second devices being adapted to interconnect, the first mobile wireless device being adapted to connect with the second slave device, and subsequently the first mobile wireless device being adapted to connect with the second mobile wireless device to provide at least one audio message to the second mobile device for communication, enabling the user to find his / her way in enclosed / open spaces.

[0015] The first wearable accessory is connected to the second wearable accessory via the radio module; the first master device includes at least two radio modules, such as Bluetooth and Wi-Fi, to connect to at least one or more additional slave devices.

[0016] The first wearable accessory is, for example, a wristband, while the second wearable accessory is, for example, headphones. However, the first wearable accessory is a necklace, watch, belt, or other accessory that can be worn comfortably without obstructing the hand.

[0017] In one embodiment, the first wearable accessory further includes a gyroscope.

[0018] The system may optionally include additional fixed auxiliary equipment, including a radio receiver / transmitter device, which includes, for example, a Bluetooth module and includes means suitable for transmitting audible and visual warnings.

[0019] (Please note that known technologies used to implement smart bracelets or smartwatches will not be discussed here, but only innovative aspects introduced therein or similar accessories suitable for the purposes of interest in this invention.)

[0020] In addition, the second mobile device also includes at least one speaker and electronic device, which can be a classic pair of headphones or earrings, or integrated into the temple of a hat or a pair of glasses, or equipped with a clip (or pin) to hook it onto an area of ​​the user's clothing that is easily audible (e.g., a jacket or shirt collar). For example, at least one first master device is positioned in an enclosed or open space equipped with a Wi-Fi connection to connect to a cloud server (which includes information such as the owners of the master, slave, and mobile devices, the locations of the master and slave devices, and the identifiers of the respective master and slave devices in relation to their locations). For example, one or more slave devices are located within the radio signal coverage of the master device to connect to it, and can be wirelessly linked by the first mobile device when the wearer or user is at a given distance from the first slave device.

[0021] Basically, in public and / or private enclosed and open spaces, such as homes, pharmacies, shops, parks, public transportation, bus stops, etc., master equipment and associated slave equipment can be positioned to cover at least the area of ​​interest.

[0022] Therefore, when a user approaches the first slave device, the user will receive a voice message from the second mobile device. The slave device will then transmit the required message to the first mobile device via radio, and the first mobile device will then transmit it to the second mobile device.

[0023] Therefore, in a highly advantageous manner, the system allows blind users to receive warning messages about obstacles or points of interest.

[0024] Further details will be gained.

[0025] In one embodiment, an audio signal can be emitted to warn a blind person of a connection between two mobile devices.

[0026] The system includes a series of steps and actions in its first activation phase, which are used to activate various parts of the system. These steps may or may not be considered as steps describing a method for operating the system.

[0027] -By users wearing mobile devices one and two;

[0028] - Connect at least one master device to a remote (cloud) server via radio;

[0029] - Connect the master device to at least one (or more) additional receivers and / or slave devices via radio;

[0030] - Connect the first and second wearable accessories via radio (e.g., connect a wristband and headphones);

[0031] -Using the owner's identification documents and personal data, register fixed and mobile devices integrated into wearable accessories on a cloud server;

[0032] - Configure and customize one or more fixed master and / or slave devices as markers, or indicators of location / situation, etc., to send data to the at least one wearable device once it is connected to it;

[0033] In addition, it also includes the most distinctive phases of this innovative system, such as:

[0034] - When the first wearable accessory enters the radio field emitted by the fixed receiver / transmitter (slave device), the main wearable device is identified by the data stored in the cloud during registration, and then the main wearable accessory and slave device are connected via Bluetooth;

[0035] - Send data from the cloud to the main fixed device, and then to the secondary fixed device connected to the main wearable accessory;

[0036] - The primary wearable device decodes the data and sends the data to the secondary wearable device;

[0037] - Represent the data received on the secondary wearable device at least via audio and / or visual means;

[0038] - Optionally, the data is sent from the master fixed device to the slave device, and the data can be represented, for example, in audio and visual form on the slave device;

[0039] One or more users (U) are safely positioned in open and / or enclosed spaces, keeping their hands free.

[0040] It can be observed that there is an example of a known technology, such as the “DOVI” system described in the literature, which, although similar to the present invention at first glance, is conceptually contrary to it. In fact, the main difference lies precisely in the concept of the two systems; DOVI is the true “navigator” as commonly understood in the known technology, which essentially returns to the haptic display the step-by-step geographic location within the map.

[0041] On the other hand, the system described in this invention takes a step further by providing audio information (which can be configured arbitrarily by the user) when the audio information arrives within the range of the master or slave device; the information provided may be, for example, the name of the device, distance, direction, and building barrier alarms near the device. The system is also equipped with a sound sensor to further indicate the location of the device; therefore, unlike known systems, this invention predicts any movement of blind people and effectively warns them before they reach an area equipped with the device.

[0042] The current system is much simpler, with each system actually having only two basic components.

[0043] Its application scope is much wider; in fact, this system is fully applicable to both indoor and outdoor environments, unlike the known systems mentioned here which are basically only suitable for indoor environments.

[0044] In a particularly advantageous way, thanks to this system, the user's hands are always free, and he / she must wear a single, compact, interference-free device, with voice messages received through an earpiece, which is neither bulky nor intrusive.

[0045] The known system means that the user wears an ankle device and he / she can consult a Braille handheld computer during exercise, which is very uncomfortable and limits the ease of use.

[0046] Furthermore, for this system, three tags per environment are sufficient, while for the DOVI system, a mapping tag needs to be placed every 1.5 meters, and the cumbersome installation is well known.

[0047] This descriptive image shows that the two systems differ significantly in terms of technology, structure, and function.

[0048] In a particularly advantageous way, in addition to the practical headphones, the "portable" part of the system is made and integrated into a simple accessory or a comfortable pocket size.

[0049] The fact that the system implies that the user is wearing at least four devices at the same time makes it immediately clear how annoying and frustrating this is for the user, and objectively difficult to apply to daily life. Attached Figure Description

[0050] These and further advantages obtained by the innovative orientation assistive system for the blind described in this invention will be better illustrated and described with reference to the accompanying drawings, which are for illustrative and non-limiting purposes regarding the content of this invention.

[0051] Figure 1 A schematic assembly of the system is shown, including its physical components and functions;

[0052] Figure 2 Examples of its application in open spaces are shown. Detailed Implementation

[0053] Figure 1A graphical example of the architecture of a preferred embodiment of a navigation assistance system 1 for the blind is shown, in which a main marker 2 is connected via Wi-Fi to a cloud / server 3 and two slave markers 4 and 4', and the slave markers 4 are then connected via Bluetooth, for example, to a main mobile device 5, which is integrated, as already mentioned, into a wearable accessory, such as a wristband 5a worn on the wrist of a blind user, and the wristband 5a is connected via Bluetooth to an assistive wearable accessory, such as an earphone (not shown) worn in the ear of a blind user.

[0054] The wristband 5 (for simplicity, it can be summarized as the main mobile device / accessory component) can wirelessly connect to marker 4 at a predetermined distance from marker 4. This distance can be set for each marker, for example, by adjusting the transmitted signal strength of the radio. Upon pairing, the wristband 5a is subsequently recognized by the cloud server 3.

[0055] In the first phase of tag pre-installation, all information related to tags 2, 4, 4' and devices / wristbands 5, 5a is recorded on a server / cloud 3. Specifically, the server / cloud 3, based on computing and storage capabilities, will be deployed for end-users to register via a webpage, iOS, or Android application to consent to the access to their data in accordance with international guidelines, including the insertion of personal data and more, such as location information about one or more tags, preferably recording and managing voice messages to be transmitted to the wristband, and anything else that can be freely programmed or implemented. The cloud server is also capable of recording information about the owners of one or more wristbands.

[0056] Each individual tag 4, 4'…4n, after being set and associated with a user code generated during the pre-installation phase, is paired with the wristband 5 each time it approaches a tag 4. This means that when the wristband is near a tag 4, it transmits data such as wristband identification, connection date and time, and tag identification. The cloud or server will then verify the existence of the identifier in its database, and using only that information, several actions can be performed, such as tracking the device's owner and locating it.

[0057] In addition, in a completely innovative and advantageous manner, data is transmitted from the cloud 3 to the wristband 5…5n via main markers 2…2n and secondary markers 4…4n. This data is then converted into audio format and transmitted by the wristband 5 to the earphones 6…6n. The earphones will notify the blind user via an audio message, which consists of information previously entered on the server and related to the marker 4 to which the wristband 5 is connected. In particular, still in a completely innovative way, the blind person can, for example, be informed of approaching obstacles (steps), dangers (intersections), commercial activities, tourist information, etc.

[0058] Furthermore, the wristband 5a equipped with a gyroscope will be able to provide data on the object's movement, particularly monitoring any state that could pose a potential danger to a person, for example, by comparing gyroscope data over a period of time, whether long or short. Since this data must remain constant over time and be transmitted by the same marker, it may indicate no movement, thus suggesting a potential malfunction. In such cases, a cloud / server that identifies general information and inputs related to the owner's contacts can immediately alert, for example, family members, to conduct an investigation.

[0059] Furthermore, analysis of data related to all blind owners of the bracelet, based on assessments of these individuals' preferred movements, may suggest improvements to infrastructure and building barriers.

[0060] Figure 2 This presents a typical case of an innovative orientation assistive system for blind people used in an external environment.

[0061] A user U wearing a wristband 5a associated with headphones 6a (to be clear: wearable device 6a is or includes an auxiliary mobile device 6) approaches a pharmacy equipped with at least one marker (from the marker) 4. The wristband enters the marker's range of motion. The wristband is identified via a query from a cloud server (through data transfer between the from the marker, the main marker, and the cloud). If the wristband device is registered on the system, data is sent from the server of the from the marker, indicating that the aforementioned connection has occurred. This data will be encoded, for example, into audio, and then transmitted from the server to the main marker, the from the marker, the wristband, and finally to the headphones. This data will be sent to the user as an audio message; in this case, the message could be a simple warning, reminding the user that they are in front of the pharmacy, or warning them to be careful of steps before entering.

[0062] In a variant of this system, there may also be an auxiliary restraint device 7, which can warn pharmacy staff of a blind person approaching by using acoustic and light-emitting devices. Similarly, using the acoustic device, the auxiliary restraint device can invite the blind customer to wait for the person in charge to arrive and assist him.

[0063] However, continuing the journey, user U's wristband 5 will encounter another marker 4', as previously described for all data channels, which will be able to notify of the presence of a traffic light-controlled intersection.

[0064] It should be noted that the main wearable device 5 or wristband may have a button for listening to received messages when entering the marked action area.

[0065] In the same operating mode, by placing at least one master marker and various slave markers, the system 1 can also be installed in the home to warn of stairs and provide orientation in corridors (e.g., “You are in front of the kitchen door”), thereby greatly facilitating orientation for the blind and even in enclosed spaces.

[0066] Please note that the advantages of extreme innovation and affirmation are that blind users can be guided simply by listening, without using their hands or owning a smartphone, because the wristband is the least impactful accessory, and it is inexpensive and easy to use for most people.

[0067] In an innovative variant, the blind orientation assistance system can be represented by a primary wearable device (wristband x) for people with normal vision. This will be equipped with a display, vibration sensors, and an "idle / busy" button.

[0068] This X-band will be used by sighted individuals who volunteer for social services (accompanying or following blind people during shopping or other tasks). The band's function will be to vibrate to alert the blind person's presence when they are nearby, once turned on and placed in free mode. After the vibration, the display will show the address of the detected person's location; once the user (equipped with the band) arrives, the "busy" mode on the X-band can be activated, meaning that from that moment on, the volunteer wearing it will accompany and assist the blind person.

[0069] As mentioned above, all this information, data exchange, etc., will be managed and stored on at least one cloud server via a radio link.

[0070] Finally, a further development possibility is the introduction of additional wearable devices for the blind, such as glasses equipped with cameras that can independently identify potential physical obstacles placed in the blind person's path, constantly communicate with the wristband, and then receive audio information through headphones. As mentioned earlier, these glasses could also be equipped with a second wearable device that would be able to transmit voice messages to the user.

[0071] Clearly, the innovative assistive system 1 for visually impaired people can solve the aforementioned problems of the known art. Therefore, it should be noted that the materials used in the embodiments of various devices, their shapes, the protocols used for communication between devices, the number of various master, slave, primary wearable devices, secondary or other wearable devices, codes, data and signal transmission methods, message languages, etc., are all variations of the system described and protected by this invention, as better set forth in the appended claims.

Claims

1. A directional assistance system for blind people, comprising: at least a first fixed radio device receiver and / or transmitter and at least one further first mobile radio device receiver and / or transmitter located in any open or closed space, and at least one remote server connected only to at least one first fixed radio device, said first fixed radio device being fixedly installed in said open or closed space, said first mobile radio device being provided to at least one user, characterized in that said directional assistance system comprises: at least one further second fixed radio device receiver / transmitter, said second fixed radio device being fixedly installed in said open or closed space, said second fixed radio device being a slave device, so that said directional assistance system comprises at least one slave device, said first fixed radio device being a master device, said remote server being connected only to said master device, said master device connecting said at least one slave device, said at least one slave device being able to connect with at least said first mobile radio device, said first mobile radio device being adapted to be housed in a first wearable accessory, said first wearable accessory being suitable to be worn on said user, said directional assistance system comprising at least a second mobile radio device receiver / transmitter, said second mobile radio device being housed in a second wearable accessory, said second wearable accessory being suitable to be worn on said user, said second mobile radio device being adapted to connect with said first mobile radio device, said second mobile radio device being adapted to transmit at least one audio message to at least said user wearing it, to allow the user to safely locate himself while moving in said open / closed space, said first wearable accessory and said second wearable accessory always freeing the user's hands; said directional assistance system further comprising at least one further fixed assistance device, said fixed assistance device being fixedly installed in said open or closed space, said fixed assistance device comprising a radio receiver / transmitter device and comprising means suitable to send a sound and / or light warning, said fixed assistance device being configured to emit a sound and / or light warning when detecting that said user is approaching.

2. The orientation aid system for blind persons according to claim 1, characterized in that said first mobile radio device comprising at least two radio modules.

3. The orientation aid system for blind persons according to claim 2, characterized in that said radio modules comprising Bluetooth.

4. The orientation aid system for the blind according to claim 1, characterized in that, said first wearable accessory being an object suitable to be worn without hindering the user's hands, said second wearable accessory being an object suitable to be worn without hindering the user's hands.

5. The orientation aid system for blind persons according to claim 4, characterized in that said first wearable accessory comprising a bracelet, a watch or a necklace, said second wearable accessory comprising an earpiece, an earring or a necklace.

6. The orientation aid system for the blind according to claim 1, characterized in that, said first wearable accessory further comprising a gyroscope.

7. The orientation aid system for blind persons according to any one of claims 1 to 6, characterized in that, said at least one second mobile radio device comprising at least one loudspeaker and being comprised in said second wearable accessory, or being suitable to be integrated in a hat or in the temples of a pair of glasses, or being equipped with a clip or a pin to be hooked on the user's clothes in an area convenient to hear.

8. The orientation aid system for blind persons according to any one of claims 1 to 6, characterized in that, Said master devices are located in said open or closed spaces equipped with WI-FI connection to connect to said at least one remote server; said remote server comprises information related to the positioning of at least the master devices, the slave devices and the user owners of the mobile devices, the master devices and the slave devices, as well as information related to the position of the mobile devices and the identification of the corresponding master devices and slave devices related to the position; said master devices and said slave devices are located in indoor and outdoor public and / or private places, said master devices and a certain number of slave devices being positioned to cover at least one area of interest.

9. The orientation aid system for blind persons according to claim 8, characterized in that, Said indoor and outdoor public and / or private places comprise homes, pharmacies, shops, parks, public transport and / or bus stops.

10. Method for implementing an orientation aid system for blind people according to any one of claims 1 to 9, characterized in that, Said method comprises at least the following steps: - wearing by a user a first wearable accessory and a second wearable accessory, said first wearable accessory housing a first mobile radio device therein, said second wearable accessory housing a second mobile radio device therein; - connecting by radio at least one first fixed radio device as at least one master device to a remote server; - connecting by radio said master devices to one or more second fixed radio devices as one or more further slave devices; - connecting by radio said first wearable accessory and said second wearable accessory; - registering said first fixed radio device and said second fixed radio device and said first mobile radio device and said second mobile radio device integrated in said first wearable accessory and said second wearable accessory on said remote server with the owner's credentials and his personal data; - configuring and customizing one or more master devices and / or slave devices as markers, or indicating positions / cases, sending data to said first wearable accessory once it will be connected thereto; - identifying said first wearable accessory through the data stored in said remote server during registration, subsequently connecting said first wearable accessory and said slave device through Bluetooth when said first wearable accessory enters the radio field emitted by said slave device; - sending data from said remote server to the master devices, subsequently to the slave devices to which said first wearable accessory is connected; - decoding said data by said first wearable accessory and sending said data to said second wearable accessory; - representing said data received on said second wearable accessory at least through sound and / or visual means; - one or more users are positioned safely in open and / or closed spaces, freeing the hands.

11. The method of claim 10, wherein, Said representing said data received on said second wearable accessory at least through sound and / or visual means comprises the following steps: - sending said data received on said second wearable accessory by the master devices to at least one slave device and representing said data in audio and / or visual form on said slave devices.

Images