Wearable sensory device

Abstract

A wearable sensory device 100, the device comprising at least one LiDAR proximity sensor 280a-280c for identifying a presence within a predetermined distance from the device 100, a microprocessor 190, a power source 140 and at least one haptic device 240a-240c for providing haptic feedback to a wearer of the device if a detected presence is within the predetermined distance. The wearable device is preferably configured as a bracelet. A plurality of LiDAR proximity sensor 280a-280c may be provided, one may be configured to determine a presence within a first distance, and a second configured to determine a presence within a second distance. A switch may be provided for toggling between the first and second LiDAR sensors 280a-280c. A computer implemented method of assisting sensory impairment is also provided.

Description

[0001] This invention is a wearable sensory device.

[0002] Sensory impaired individuals often face challenges in navigating their surroundings, both indoors and outdoors. While some existing solutions, such as white canes or guide dogs, offer valuable assistance, there is a need for an innovative, discreet, and adaptable sensory aid that can be used independently or in conjunction with other assistive devices.

[0003] The present invention provides a wearable device which can monitor the distance between the user and other people and / or objects to alert the user when somebody or an object is too close.

[0004] Therefore, according to the present invention there is provided a wearable sensory device comprising at least one ultrasonic LiDAR proximity sensor for identifying a presence within a predetermined distance from the device; a microprocessor; a power source; at least one haptic device for providing haptic feedback to a wearer of the device if a presence is detected within the predetermined distance.

[0005] As used herein, the term “presence” could mean a person or any other detected object moving into range of the LiDAR proximity sensor. The device may be able to discriminate, such as with thresholds stored in the microprocessor, different objects based on their dimensions or movement, such as people or large inanimate objects such as walls.

[0006] The present device provides a discrete wearable unit that can be used to inform a user when a presence is detected within a predetermined distance. The predetermined distance can be any distance or distance range, the outer limits which will be set by the range of the LiDAR proximity device. A maximum distance may be 5 meters, and a minimum distance may be 50 cm. A minimum distance may ensure that false positives from the device detecting the user could be avoided. The distance may be changeable, where different maximum and / or minimum distances can be set.

[0007] The haptic device provides haptic feedback when a presence is detected within the predetermined distance and could additionally or alternatively provide further information such as battery life, an indication of the selected distance or an indication that the device is switched on. The haptic device may be at least partially disposed on an inside surface of the device so that in use contact is made with the user's skin and vibration can be felt when the haptic device is activated.

[0008] The device may additionally comprise a visual feedback device which may comprise an OLED display. The OLED display could display a visual alert when a presence is detected within the predetermined distance and could additionally or alternatively provide further information such as battery life, an indication of the selected distance or an indication that the device is switched on.

[0009] The device may additionally comprise an audio feedback device which may comprise a nanomembrane loudspeaker. The loudspeaker could provide an audible alert when a presence is detected within the predetermined distance and could additionally or alternatively provide further information such as battery life, an indication of the selected distance or an indication that the device is switched on.

[0010] The present device may be particularly useful to individuals with sensory impairment and so visual, audible and haptic feedback devices may be provided either alone or in combination depending on the intended user.

[0011] The wearable sensory device may be a bracelet which could be either a flexible strap or solid bangle and could comprise a closed-loop or a strap with a closure to adjust the size of the bracelet. A bracelet would be advantageous as it would be discrete, would be well-positioned on the body of the user to be exposed to the area about the user in order to detect a presence and it would also be likely to have skin contact so that the haptic device can be felt when it is activated.

[0012] Alternatively, the wearable device could be a single unit provided with a clip, for example, for attachment to an item of clothing such as to a waistband. Alternatively, the device could be integrated within a pair of glasses or brim of a hat, which could further comprise an earpiece so that the user can hear the audible alter. The haptic device could be integrated with the arms of the glasses.

[0013] If the device is a bracelet, the bracelet could comprise a strap made of a resilient material such as silicone, with the haptic device, microprocessor and LiDAR sensors housed within a casing. Alternatively, the bracelet may comprise opposed strips of a resilient material, with the microprocessor, power source, and haptic device sandwiched therebetween, with at least part of the LiDAR sensor extending through the bracelet. The ends of the strips may be fused together to form a closed loop or may be provided with a clasp or other closure mechanism. Skin contact may be preferable, and so the bracelet may either be elastic or adjustable about the user’s wrist.

[0014] The at least one LiDAR proximity sensor may have a particular Field of View (FoV) and so to ensure 360-degree sensor coverage about a user, the device may comprise a plurality of LiDAR proximity sensors arranged about the device. LiDAR proximity sensors may have a FoV of up to 180 degrees, and so the device may comprise a plurality of LiDAR proximity sensors arranged equidistantly about the device, such as on a bracelet. Two to six LiDAR proximity sensors may be provided. Four LiDAR proximity sensors may be provided.

[0015] When a plurality of LiDAR proximity sensors are provided the FoV of adjacent sensors may cross over and so a presence may be detected by two or more sensors at the same time.

[0016] Where there are a plurality of LiDAR proximity sensors, the microprocessor may determine which of the sensors has detected the presence. There will be a correlation between which of the sensors has detected a presence and the location and / or direction of the presence relative to the user. This may enable the device to inform the user of the direction and / or location of the presence. For example, a presence may be detected behind the user and the haptic device could alert the user that the presence is behind them. This will help the user in moving away from rather than towards the presence. A plurality of haptic devices could be provided about the device, for example spaced on an inside surface of a bracelet and selected haptic devices could be triggered by particular sensors to provide the user with feedback regarding the direction of the presence as well as identification of a presence. An audible and / or visual feedback device, if present, could also specify the position of the presence.

[0017] The device may comprises a first LiDAR system that comprises one or more LiDAR sensor to identify a presence within a first predetermined distance and a second LiDAR system that comprises one or more LiDAR sensor to identify a presence within a second predetermined distance.

[0018] The power source may include any suitable battery, which will preferably be light and slim, such as a thin-film lithium-ion battery. Such batteries are suitably slim, light and flexible and so could be held within a bracelet without adding too much weight. So that the power source may be charged, the device may further comprise a battery charger port. Any suitable ports such as a microUSB port can be used for this purpose and a user can recharge the battery when they are not using the device.

[0019] Auxiliary power sources may be provided in addition to or (should they be able to provide sufficient power) instead of batteries, such auxiliary power sources could include solar cells, which may extend battery life.

[0020] The device may further comprise a switch. Said switch could be used to switch on and off the device and additionally or alternatively may be used to toggle between the first and second LiDAR systems. The maximum distance and minimum distance may be set by pressing the switch which could toggle, for example, between ranges of 10 cm per depression. An indication of the distances could be provided through the haptic device or devices or visually on the OLED display or aurally through the loudspeaker, if present.

[0021] According to a different aspect of the present invention there is provided a computer implemented method of assisting sensory impairment, the method comprising: sensing, with a LiDAR sensor on a wearable device, a presence within a predetermined distance from the device; communicating to a microprocessor from the LiDAR sensor when a presence within the predetermined distance is detected; communicating from the microprocessor to a haptic device that a presence has been detected; providing haptic feedback from the haptic device to indicate to a user that a presence has been detected within the predetermined distance.

[0022] The method may further comprise toggling, with a switch on the device, between a first and second LiDAR system, each LiDAR system comprising one or more LiDAR sensor, and each LiDAR system being configured to monitor different predetermined distances.

[0023] The first LiDAR system may comprise a single LiDAR sensor and monitors a first predetermined distance and is linked, with the microprocessor, to all of the haptic devices on the wearable device and the or each LiDAR sensor within the second LiDAR system may be linked, via the microprocessor to individual haptic devices. The first LiDAR system may be intended for use indoors, where the user is more familiar with their surroundings, and the second LiDAR system may be intended for use outdoors where more detailed feedback is required.

[0024] The first LiDAR first predetermined distance could be a range of distances, for example 1 -3 meters, and the second predetermined distance could be a range of distances, for example 3-5 meters. The distances can be adjusted according to user requirements, ensuring adaptability across diverse environments.

[0025] Within a predetermined distance range, haptic feedback may change in intensity as the device nears or moves away from an object. For example, vibration intensity could increase as the user approaches an object, with an emergency intermittent vibration triggered if the user gets too close, ensuring their safety.

[0026] So that it may be better understood, embodiments of this invention will now be described in detail but by way of example only wherein:

[0027] Figure 1 shows an exploded view of a sensory device;

[0028] Figure 2 shows a top view of a PCB as shown in Figure 1;

[0029] Figure 3 shows an underside of the PCB shown in Figures 1 and 2;

[0030] Figure 4 shows a perspective view of a device according to the present invention;

[0031] Figure 5 shows a side view of the device of Figures 1 to 4;

[0032] Figure 6 shows a perspective view of the device;

[0033] Figure 7 is a plan view of the device of Figures 1 to 6;

[0034] Figure 8 shows a plan view of the device in use; and

[0035] Figure 9 shows a flow chart of the computer implemented method according to the present invention.

[0036] Turning to the Figures there is shown a wearable sensory device generally indicated 100 for alerting a user when a presence is detected within a predetermined distance from the device. The device 100 is a bracelet made from lightweight and flexible materials and components, though could alternatively be in a different form, such as integrated with a pair of glasses or be a unit that can be clipped onto clothing. The device comprises a housing which in turn comprises an upper bracelet component, generally indicated 110 and a lower bracelet component, generally indicated 120. Disposed between the upper bracelet component 110 and the lower bracelet component 120 is a flexible PCB generally indicated 130 which comprises the electronic components of the device 100. Alternatively, the electronic components could be houses within a separate unit, and be provided with straps such as watch straps.

[0037] In particular, mounted on, or in electrical contact with, the PCB 130 there is provided a lithium-ion thin film battery 140, an optional OLED display 150, a push button switch 160, two optional nanomembrane flexible speakers 170a, 170b, three haptic devices 240a, 240b, 240c, three LiDAR proximity sensors 180a, 180b and 180c, a microprocessor 190, and a charging module 200 comprising a charger port 210.

[0038] The microprocessor 190 acts as a “master” and controls the functions of the “slave” components, including the LiDAR proximity sensors 180a, 180b, 180c, the haptic devices 240a, 240b, 240c, speakers 170a, 170b and the OLED display 150.

[0039] The OLED display 150, two nanomembrane flexible speakers 170a and 170b, and haptic devices 240a, 240b, 240c are feedback devices which provide feedback to the user, which may be an alert if a presence is detected within the predetermined distance from the device.

[0040] As is shown in Figure 2 the OLED display 150, the push button 160, the speakers 170a, 170b and the LiDAR sensors 180a, 180b, 180c are provided on an upper surface 220 of the flexible PCB 130. Disposed on an underside 230 of the flexible PCB 130, as shown in Figure 3, is a flexible haptic device comprising three haptic units 240a, 240b and 240c in wired connection. The haptic devices 240a, 240b, 240c and the OLED display 150, a push button switch 160, two nanomembrane flexible speakers 170a and 170b, and three LiDAR sensors 180a, 180b, 180c are each in wired contact with the thin film battery 140, which is also in wired communication with the charging module 230.

[0041] . The LiDAR sensors 180a, 180b and 180c comprise an integrated microcontroller, which could alternatively be a separate component. As shown in Figure 5, three LiDAR sensors 180a, 180b and 180c are provided and are spaced about the length of the device 100. A transceiver of each LiDAR sensor 180a, 180b, 180c is exposed through apertures 280a, 280b, 280c extending through the upper bracelet portion 110. The proximity sensors have a FoV of up to 180 degrees and a range of up to 2 meters, though alternative sensors may have alternative FoV and / or ranges.

[0042] Any haptic device could be used if it is suitable small and lightweight, and preferably flexible to be formed into a bracelet. Examples of suitable haptic devices are made by Novasentis Inc of Berkley, California. The three haptic devices 240a, 240b, 240c are positioned along the length of the bracelet 100 and when activated will vibrate. The haptic devices 240a, 240b, 240c may vibrate individually or simultaneously when activated, and may be activated when a presence is detected within the predetermined distance to alert the user, or may additionally or alternatively be activated when the user sets the predetermined distances. The activation of one or more haptic device 240a, 240b, 240c may depend on the location of the presence detected. More, fewer or no haptic devices may be provided depending on the application. The haptic devices 240a, 240b, 240c may be provided on an inner surface of the bracelet so that they may be in contact with a user’s body or may be provided, as shown here, within the body of the bracelet 100. Additionally, or alternatively, the duration and / or intensity or vibration could be linked to the proximity of the presence detected within the predetermined distance.

[0043] LiDAR proximity sensors 180a, 180b, 180c may be linked to a single or all of the haptic devices 240a, 240b, 240c. A first LiDAR system could comprise LiDAR sensor 180a which is linked to all three haptic devices 240a, 240b, 240c and a second LiDAR system could comprise LiDAR sensors 180a, 180b and 180c linked individually to haptic devices 240a, 240b and 240c respectively.

[0044] The two speakers 170a, 170b are nanomembrane loudspeakers which are sufficiently small and flexible. The speakers 170a, 170b may provide an audible alert if a presence is detected within the predetermined distance or may additionally or alternatively provide aural feedback when the user sets the predetermined distances. The activation of one or more loudspeaker 170a, 170b, or the nature of the audible signal, depend on the location of the presence detected relative to the device 100. More, fewer or no speakers may be provided depending on the application. Additionally, or alternatively the speaker could be replaced with an earpiece, headphone jack or wireless transmitter (such as Bluetooth®) which can pair with a user’s mobile telephone or headphones.

[0045] The OLED display 150 may display visual feedback to a user, which could include a visual alert if a presence is detected within the predetermined distance, an indication of whether the device is switched on or off, battery life, or an indication of the predetermined distance or distances. More or no OLED display 150 may be provided depending on the application, for example if the device is intended for those with limited or no vision, a screen might not be provided.

[0046] The push button 160, acts as a switch to either switch on and off the device, but also to toggle between different predetermined distances and LiDAR systems. Optionally, the push button 160 may be used to set a minimum and maximum predetermined distance, with each depression of the button changing the distance by a pre-set amount, such as 10 cm.

[0047] As shown in Figure 1, the charger port 210 of the charger module 200 comprises a microUSB port for charging the thin film battery 140. Any charger module comprising a charging port which is small enough to sit within the bracelet 100 could be used, and an exemplary charging module is made by TPower Semiconductor Co. Ltd of Shenzen China.

[0048] As shown in Figure 4, the upper bracelet component 110 is bonded to the lower bracelet component 120 with the flexible PCB 120 disposed therebetween. As show in Figures 5 and 6, opposed ends of the upper bracelet component 110 and the lower bracelet component 120 are fused together to make a continuous bracelet loop. As shown best in in Figures 1 and 7 the upper and lower bracelet components 110, 120 are substantially rectangular and made from a resilient material such as an elasticated polymer. An upper surface 250 of the upper bracelet component 110 comprises a panel 260 which overlays the OLED 150 and push button 160 disposed on the PCB 130. A section of panel 260 is at least partially transparent to enable the OLED 150 to be visible. Part of panel 260 further comprises a flexible portion 270 which overlays the push button 160. The upper bracelet component 110 further comprises three apertures 280a, 280b, 280c which overlay the LiDAR proximity sensors 180a, 180b, 180c to permit the signal sent and received from the sensors 180a, 180b, 180c to avoid interference. As shown best in Figure 1 an upper surface 290 of the lower bracelet portion 120 comprises a first depression 300 in which the PCB 130 is disposed and within this depression 300 is a further depression 310 in which the battery 140 and microprocessor 190 are disposed when the device 100 is assembled. When assembled, as best shown in Figure 6, a charger port cover 320 is provided to cover the charger port 210 when not being used.

[0049] In use a user will apply the device 100 to their wrist and switch it on by depressing the push button 160 to switch on the device 100. By pressing the button 160 on further occasions, a user may be able to set a minimum and / or maximum distance threshold and / or LiDAR system which they would like monitored by the device 100. For example, the minimum distance could be 50cm and the maximum distance could be 2m. Setting the minimum and / or maximum distances could result in feedback to the user to indicate the distances selected. For example, the distances could be displayed on the OLED display or presented aurally through the speakers 170a, 170b. The microprocessor 190 will store the minimum and maximum distances and will control the LiDAR proximity sensors 180a, 180b, 180c which will begin sending out ultrasonic pulses and receiving any reflected signal within the defined distance range. Should a presence be detected within the predetermined distance then a signal will be sent to the microprocessor 190. The microprocessor 190 will then send an alert signal to one of the feedback devices, such as the haptic devices 240a, 240b 240c. The haptic devices 240a, 240b, 40c may then vibrate to indicate that a presence has been detected within the predetermined distance. The user may then move away from the presence.

[0050] As shown in Figure 8 a plan view of a user generally indicated 400 is shown, the user having a bracelet generally indicated 100 as previously described. The bracelet comprises three proximity sensors each having a field of view 410, 420, 430 of approximately 180 degrees, which combine to provide 360 degree of coverage about the user 400 along a horizontal plane.

[0051] The fields of view 410, 420, 430 overlap so areas 440, 450, 460 are monitored by two sensors. The fields of view 410, 420, 430 have an adjustable minimum detection range, which in the present example is of 50 centimetres about the user 400, as generally indicated 470. Nothing within this range will be detected by the sensors which means that the user 400 will not produce any false positive alerts.

[0052] The adjustable maximum range of the proximity sensors in the present example is two metres as indicated by the perimeter 480 at the outer range of the three fields of view 410, 420, 430.

[0053] If a person 490 walks into the field of view of one of the sensors then the proximity sensor, controlled via the microprocessor will cause an alert. In the present example, the haptic device will vibrate, and this will be sensed by the user 300.

[0054] As shown in Figure 8, person 490 has entered the field of view 410 of only one of the proximity sensors. The field of view 410 of this sensor may be linked to one out of three of the haptic devices present on the bracelet 100, and this particular haptic device vibrating will give the user 400 an indication of the location of the person 490 and therefore ensure that the person will know which direction they must move to avoid the person.

[0055] A further person 500 is also within the perimeter 480 and is therefore detectable by the bracelet 100. Person 500 is within the field of view 450 which is combined field of view 430 and 420. The sensors having field of view 430 and 420 will therefore both detect the person 500 and this may cause an alert. In this example, two of the haptic devices are associated with the two sensors and both haptic devices may therefore vibrate which will be able to provide the user 400 with a location of the person 500.

[0056] Figure 9 shows a flow chart of the computer implemented method according to the present invention. At Step 600, there is the step of sensing, with 5 a LiDAR sensor on a wearable device, a presence within a predetermined distance from the device. At Step 610 there is the step of Communicating to a microprocessor from the LiDAR sensor when a presence within the predetermined distance is detected. At Step 620 there is the step of communicating from the microprocessor to a haptic device that a presence has 10 been detected and at Step 630 there is the step of providing haptic feedback from the haptic device to indicate to a user that a presence has been detected within the predetermined distance.

Claims

1. A wearable sensory device comprising:at least one LiDAR proximity sensor for identifying a presence within a predetermined distance from the device;a microprocessor;a power source;at least one haptic device for providing haptic feedback to a wearer of the device if a presence is detected is within the predetermined distance.

2. A device as claimed in claim 1, wherein the device is a bracelet.

3. A device claimed in claim 1 or claim 2, comprising a plurality of LiDARproximity sensors arranged about the device.

4. A device as claimed in claim 3, wherein the device comprises a first LiDAR system that comprises one or more LiDAR sensor to identify a presence within a first predetermined distance and a second LiDAR system that comprises one or more LiDAR sensor to identify a presence within a second predetermined distance.

5. A device as claimed in claim 4, wherein the device further comprises a switch to toggle the device between the first and second LiDAR system.

6. A device as claimed in any preceding claim, wherein the haptic device is at least partially disposed on an inside surface of the device.

7. A device as claimed in any preceding claim, wherein the power source is a thin-film lithium-ion battery.

8. A device as claimed in any preceding claim further comprising a battery charger port.

9. A computer implemented method of assisting sensory impairment, the method comprising:sensing, with a LiDAR sensor on a wearable device, a presence within a predetermined distance from the device;communicating to a microprocessor from the LiDAR sensor when a presence within the predetermined distance is detected;communicating from the microprocessor to a haptic device that a presence has been detected;providing haptic feedback from the haptic device to indicate to a user that a presence has been detected within the predetermined distance.

10. A method as claimed in claim 9, the method further comprising:toggling, with a switch on the device, between a first and second LiDAR system, each LiDAR system comprising one or more LiDAR sensor, and each LiDAR system being configured to monitor different predetermined distances.

11. A method as claimed in claim 10, wherein the first LiDAR system comprises a single LiDAR sensor and monitors a first predetermined distance and is linked, with the microprocessor, to all of the haptic devices on the wearable device and wherein the or each LiDAR sensor within the second LiDAR system are linked, via the microprocessor to individual haptic devices.

Images