A system and method of providing audio-based guidance to visually-impaired users and wearable device thereof

Abstract

The present disclosure provides a system and method of providing audio-based guidance to visually-impaired users and wearable device thereof The method includes the following steps. First, capturing (301) an image by an image capturing means. Then, connecting (302) to a user device for transmitting the captured image, by the controller connected to the image capturing means. Next, processing (303) the captured image for providing audio-based guidance based on input received from the microcontroller, by a processor of the user device. Then, transmitting (304) the audio of the identified elements to an audio means connected to the user device, and controlling (305) a pre-defined haptic motor mounted at a direction matching the identified position of the elements, by the processor. Finally, emitting (306) the audio of the identified elements and the vibration in the identified direction of the element simultaneously by the audio means and the haptic motor.

Description

A SYSTEM AND METHOD OF PROVIDING AUDIO-BASEDGUIDANCE TO VISUALLY-IMPAIRED USERS ANDWEARABLE DEVICE THEREOFFIELD

[0001] The embodiments herein generally relate to providing guidance to visually impaired users based on audio. More particularly, the disclosure relates to a device, system and method for providing audio-based guidance to visually impaired users.BACKGROUND AND PRIOR ART

[0002] Visual impairment is widely prevalent among the population across the world. People suffering from various grades of vision difficulties necessitate assistance in carrying out regular day-to-day tasks safely.

[0003] Conventionally, various accessibility assistance technologies have been developed for helping visually impaired people in using electronic devices including smart phones. The technologies include Braille based devices, screen readers, electronic magnifiers, and software technologies such as OCR (Optical Character Recognition) for processing any given input and providing an audio output. However, various standalone devices have also been developed that can assist visually impaired users in performing certain tasks and comprehending data.

[0004] However, most of such devices are expensive due to customized manufacturing and complicated software for achieving the results. Also, these devices have not been incorporated as they necessitate a basic training to be imparted to the user for performing operations.

[0005] Therefore, there is a need for a user friendly multi-lingual device to provide guidance to visually impaired users. Moreover, there is a need for acompact and light in weight wearable device, system, and method for providing audio based guidance to visually impaired users.OBJECTS

[0006] Some of the objects of the present disclosure are described herein below:

[0007] The main objective of the present disclosure is to provide a wearable device, system, and method to provide guidance to visually impaired users.

[0008] Another objective of the present disclosure is to provide a cost-effective wearable device, system and method to provide guidance to visually impaired users.

[0009] Still another objective of the present disclosure is to provide a wearable device that is user friendly and includes ease-of-accessibility to provide guidance to visually impaired users.

[0010] Yet another objective of the present disclosure is to provide a wearable device, system, and method imparting complete audio-based and haptic-based guidance to visually impaired users.

[0011] Still another objective of the present disclosure is to provide a compact and light in weight device capable of being retrofit for facilitating guidance to visually impaired users.

[0012] The other objectives and advantages of the present disclosure will be apparent from the following description when read in conjunction with the accompanying drawings, which are incorporated for illustration of preferred embodiments of the present disclosure and are not intended to limit the scope thereof.SUMMARY

[0013] In view of the foregoing, an embodiment herein provides a system and method of providing audio-based guidance to visually-impaired users and wearable device thereof.

[0014] In accordance with an embodiment, the method can include the following steps. First, capturing an image, by an image capturing means mounted on a wearable frame worn by a user, wherein the image capturing means connected to a microcontroller on the wearable frame. Then, connecting to a user device through a communication network for transmitting the captured image, by the microcontroller. Next, processing the captured image for providing audio-based guidance based on input received from the microcontroller, by a processor of the user device. The processing can include identifying elements in the captured image and generating text of the identified elements, by the processor, identifying a position of the elements relative to the user in the captured image, by the processor, and converting the text of the identified elements to audio, by the processor of the user device. Then, transmitting the audio of the identified elements to an audio means connected to the user device, by the processor, and controlling a pre-defined haptic motor mounted at a direction matching the identified position of the elements, by the processor. Finally, emitting the audio of the identified elements and the vibration in the direction of the element simultaneously for providing audio-based guidance, by the audio means and the haptic motor.

[0015] In accordance with an embodiment, controlling the image capturing means to capture an image based on input received through one of control buttons, proximity sensors, and microphone, by the microcontroller.

[0016] In an embodiment, the elements including pre-defined living objects and non-living objects.

[0017] In accordance with an embodiment, wherein the input received including at least one of interpreting a scene, navigating, recognizing an element, and guidance in conversations, wherein the input received from one of the control buttons and microphone, by the processor.

[0018] In an embodiment, processing based on the input of interpreting a scene including the steps of identifying all the elements in the captured image, and position of each identified element in the captured image, and converting the text of the identified elements to audio, by the processor of the user device.

[0019] In an embodiment, processing based on the input of navigating including the steps of detecting a presence of elements within a threshold distance of the user, by the proximity sensors, identifying the elements, and a position of the identified elements in the captured image, by the processor. Then, identifying signs and symbols in the captured image, by the processor, and converting the text of the identified elements to audio, by the processor.

[0020] In an embodiment, processing based on the input of recognizing an element including the steps of identifying one or a combination of currency, faces, symbols, road signs, and text from the captured image, and converting the text of the identified elements to audio, by the processor.

[0021] In an embodiment, processing based on the input of guidance in conversations including the steps of recording an audio in surrounding of the user, by a microphone mounted on the wearable frame, and identifying direction of a source of the audio recorded based on the image processing of the captured image, by the processor of the user device; and controlling a pre-defined haptic motor mounted at a direction matching the direction of the audio source in the conversation, by the processor, identifying elements including faces, facial expression, hand gestures by image processing the captured image, by the processor; and converting the text of the identified elements to audio, by the processor.

[0022] In accordance with an embodiment, identifying the position of the element includes identifying a side and / or direction of the element relative to the user. The haptic motor is predefined based on a side and / or direction of the haptic motor mounted on the wearable frame matching with the identified position of the element.

[0023] In an embodiment, wherein the method including translating the text to a language selected by the user, by the processor of the user device. Selection of the language is received from the user, by the processor of the user device.

[0024] In accordance with an embodiment, the system of providing audio-based guidance comprises the following. A detecting means for detecting parameters and controlling capturing of an image, wherein the detecting means can include a plurality of proximity sensors. A control means for receiving an input from a user for controlling capturing of an image, wherein the control means including amicrophone and a plurality of control buttons. An image capturing means for capturing an image based on actuation received from one of the detecting means and the control means. A microcontroller connected to the image capturing means for storing the captured image and transmitting the captured images to a user device, wherein the user device connected to the microcontroller through a communication network. The user device including a processor and a memory, wherein the processor processing the captured image based on input received from the user. A plurality of haptic motors connected to the user device, wherein the haptic motors mounted on the wearable frame in multiple directions for emitting a vibration. An audio means connected to the user device for emitting an audio, wherein the processor of the user device identifying elements and generating text of the identified elements, identifying a position of the elements relative to the user, and converting the text of the identified elements to audio. The audio means controlled by the processor for emitting the audio of the identified elements, and a pre-defined haptic motor mounted in a direction at the identified position of the elements controlled by the processor for emitting the vibration, thereby providing audio-based guidance.

[0025] In an embodiment, the system can include an accelerometer mounted on the wearable frame for detecting fall of the user based on acceleration, and wherein the accelerometer connected to the microcontroller for transmitting the detection of the fall of the user, and a magnitude of the fall. The microcontroller notifies the user device for transmitting an emergency SOS message.

[0026] In accordance with an embodiment, the device for providing audio based guidance comprises the following. An image capturing means for capturing an image. A plurality of proximity sensors for detecting presence of an obstacle within a threshold distance of areas not visible to the camera. A plurality of haptic motors mounted at plurality of directions for indicating a direction to the user through vibrations. A microcontroller connected to the image capturing means, the proximity sensors, and the haptic motors. A microphone and a plurality of control buttons provided for receiving input from the user. The microcontroller can control the image capturing means based on input received from one of the control buttons.

[0027] In an embodiment, the device is capable of being retrofit on a wearable frame and / or conventional spectacles.

[0028] These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.BRIEF DESCRIPTION OF DRAWINGS

[0029] The detailed description is set forth with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies thefigure in which the reference number first appears. The use of the same reference numbers in different figures indicates similar or identical items.

[0030] Fig.l illustrates a block diagram of a system for providing audio-based guidance to visually impaired users, according to an embodiment herein;

[0031] Fig. 2a illustrates a isometric view of a device for providing audio-based guidance to visually impaired users, according to an embodiment herein;

[0032] Fig. 2b illustrates a top view of a device for providing audio-based guidance to visually impaired users, according to an embodiment herein;

[0033] Fig. 2c illustrates a three-dimensional view of a device for providing audio-based guidance to visually impaired users, according to an embodiment herein; and

[0034] Fig.3 illustrates a flow chart of a method for providing audio-based guidance to visually impaired users, according to an embodiment herein.DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0035] The embodiments herein and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments and detailed in the following description. Descriptions of well- known components and processing techniques are omitted so as to not unnecessarily obscure the embodiments herein. The examples used herein are intended merely to facilitate an understanding of ways in which the embodiments herein may be practiced and to further enable those of skill in the art to practice the embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the embodiments herein.

[0036] As mentioned above, there is a need for a user friendly device to provide guidance to visually impaired users. In particular, there is a need for a compactand light in weight wearable device, system, and method for providing audio based guidance to visually impaired users. The embodiments herein achieve this by providing “A System and Method of Providing Audio-Based Guidance to Visually-Impaired Users and Wearable Device Thereof’. Referring now to the drawings and more particularly to Fig.l to Fig.3, where similar reference characters denote corresponding features consistently throughout the figures, there are shown preferred embodiments.

[0037] Fig.l illustrates a system of providing audio-based guidance to visually impaired users. In an embodiment, the system includes a wearable device 101, a user device 129, and a communication network 127. In an embodiment, the components of the device can be mounted and / or retrofit on one of a wearable eyewear frame, head band, and conventional spectacles for being configured as the wearable device 101.

[0038] In an embodiment, the components of the wearable device 101 can include but not limited to a detecting means 103, a control means 109, an image capturing means 117, a microcontroller 115, an output means 119, and an accelerometer 125.

[0039] In an embodiment, the detecting means 103 is provided for detecting parameters. The parameters can include but not limited to presence of an obstacle.

[0040] The detecting means 103 can include but not limited to a sensor unit 105 including a plurality of proximity sensors 107. The proximity sensors 107 can be provided for detecting a presence of obstacle around the user. On detecting a presence of an obstacle, the proximity sensor 107 can notify the microcontroller 115. In an embodiment, the proximity sensor 107 can detect an obstacle within a threshold distance of the user.

[0041] In an embodiment, the control means 109 is provided for receiving an input from a user for controlling an operation of the wearable device. In an embodiment, the control means 109 can include but not limited to a microphone 111, and a plurality of control buttons 113.

[0042] In an embodiment, the microphone 111 is provided for receiving a voice input from the user. The voice input can include a plurality of commands for performing functionalities. The functionalities can include but not limited to switching ON and / or OFF the wearable device 101, connecting the wearable device 101 to the user device 129, and capturing an image. In an embodiment, the microphone 111 can transmit the voice input to the microcontroller 117.

[0043] In an embodiment, the control buttons 113 can be provided for manually operating the wearable device 101, by the user. The control button 113 can receive input for performing functionalities of the wearable device 101. The control button 113 can be connected to the microcontroller 115. In an embodiment, long pressing the control button 113 can emit an audio describing the functionality of the pressed control button, wherein the audio can be emitted through the audio means. In an embodiment, functionality of the control button can be set in the microcontroller 115, wherein the microcontroller 115 transmits the audio to the audio means on long pressing of the control button.

[0044] In an embodiment, the microcontroller 115 can be provided for controlling the image capturing means 117 based on control received from one or both of the detecting means 103 and the control means 109.

[0045] In an embodiment, the image capturing means 117 can be mounted on the wearable frame for capturing an image ahead of the user. The image capturing means can include but not limited to a camera. The image capturing means 117 can transmit the captured images to the microcontroller 115.

[0046] In an embodiment, the microcontroller 115 can store the images captured by the image capturing means 117. The microcontroller 115 can be connected to the user device 129 through the communication network 127. In an embodiment, the communication network 127 can include but not limited to Bluetooth, and WiFi. The microcontroller 115 can transmit the images captured by the image capturing means 117 to the user device 129 instantaneously.

[0047] In an embodiment, the user device can include a processor and a memory. The memory can store instructions for processing data to perform audio-based guidance, and the processor can execute the instructions stored in the memory for performing functionalities corresponding to the wearable device 101.

[0048] In an embodiment, the processor of the user device can be configured for performing the functionalities of processing the captured image as provided below. In an embodiment, an image processing engine 135 can be configured for performing processing of the captured image. The image processing engine 135 can perform the processing based on input received from the user. In an embodiment, the image processing unit can include a scene interpretation unit 137, a recognition unit 139, a navigation unit 141, and a conversational unit 143.

[0049] In an embodiment, the scene interpretation unit 137 can be provided for identifying each element in the captured image and identifying position of each of the identified element. In an embodiment, the element can include but not limited to pre-defined living objects, and non-living objects. The elements can be predefined in the processor of the user device. The position can include a direction of the element relative to the wearable device (worn by the user).

[0050] In an embodiment, the scene interpretation unit 137 can generate a text of the identified elements. The text is transmitted to an audio conversion unit 145 forconverting the generated text to audio. In an embodiment, the user device can transmit the generated audio to an audio means 121. The scene interpretation unit 137 can configure the processor to control the haptic motor 123 mounted at a direction matching with the identified position of the element in the captured image relative to the wearable device.

[0051] In an embodiment, the scene interpretation unit 137 can configure the processor to control the audio means to emit the audio of the element and control the haptic motor in the direction of element to emit the vibration simultaneously, thereby providing audio-based guidance to the visually impaired users in analyzing a scene.

[0052] In an embodiment, the audio means 121 can be connected to the user device 129. In another embodiment, the audio means 121 can be mounted on the wearable device 101. The audio means can include but not limited to earphones, speaker. In an embodiment, the processor controlling intensity of audio emitted from the audio means wherein the intensity emitted by the audio means in the direction of element greater than intensity emitted by the audio means in another direction for indicating the direction of origination of the sound to the user.

[0053] In an embodiment, the recognition unit 139 can be configured for specifically recognizing the elements in the captured image. The recognition unit 139 can be configured for recognizing elements including but not limited to currency, facial features, gestures, expression, symbols, road signs, and, text. The recognition unit 139 can include a pre-defined database corresponding to facial features. The recognition unit 139 can identify and define emotions based ondifferent facial features captured in the image. In an embodiment, the recognition unit 139 can generate a text of the identified elements. The text is transmitted to an audio conversion unit 145 for converting the generated text to audio. In an embodiment, the user device can transmit the generated audio to an audio means 121. In an embodiment, the recognition unit 139 can configure the processor to control the audio means to emit the audio of the element.

[0054] In an embodiment, the navigation unit 141 can be configured for guiding the users in identifying obstacle for navigating through an area. In an embodiment, the navigation unit 141 can receive input from the microcontroller based on detection of the presence of elements by the proximity sensors within a threshold distance. The input can include the detection of the presence of elements. In an embodiment, the threshold distance can be set by the user in the microcontroller using the user device.

[0055] In an embodiment, the navigation unit 141 can be provided for identifying the elements in the captured image and identifying position of each of the identified element. In an embodiment, the element can include but not limited to living objects, and non-living objects. The position can include a direction of the element relative to the wearable device (worn by the user). The navigation unit 141 can identify elements including signs, and symbols (road signs, maps) in the captured image for assisting navigation of the user in the area.

[0056] The navigation unit 141 can generate a text of all the identified elements and transmit to the audio conversion unit 145 for converting the generated text to audio. In an embodiment, the user device can transmit the generated audio to anaudio means 121. The navigation unit 141 can configure the processor to control the haptic motor 123 mounted at a direction matching with the identified position of the element in the captured image relative to the wearable device.

[0057] In an embodiment, the navigation unit 141 can configure the processor to control the audio means to emit the audio of the element and control the haptic motor in the direction of element to emit the vibration simultaneously, thereby providing audio-based guidance to the visually impaired users in navigating through an area.

[0058] In an embodiment, the conversational unit 143 can be provided for guiding the user in conversations. The conversational unit 143 can be configured for receiving an audio recorded by the microphone 111 mounted on the wearable frame 101. The conversational unit 143 can be configured for identifying direction of a source of the audio (speaker in the conversation) recorded based on image processing the captured image and real-time image capturing. The conversational unit 143 can configure the processor to control the haptic motor mounted at a direction of the audio source, for indicating a direction of the speaker in a conversation. The conversational unit 143 can configure the processor to identify elements including faces, gestures, facial expression of the people in the captured image. In an embodiment, the conversational unit 143 can generate a text of the identified elements and transmit to the audio conversion unit 145 for converting the generated text to audio. In an embodiment, the user device can transmit the generated audio to an audio means 121.

[0059] In an embodiment, the conversational unit 143 can configure the processor to control the audio means to emit the audio of the element, thereby assisting the visually impaired users in conversations. In an embodiment, the conversational unit can control the intensity of audio, wherein the audio emitted from the audio means in a direction of the audio source is greater than audio emitted from audio means in another direction, for indicating a direction of the speaker in a conversation. The audio with the greater intensity can indicate the direction of origination of the sound to the user.

[0060] In an embodiment, the scene interpretation unit 137, the recognition unit 141, the navigation unit 141, and the conversational unit 143 can perform identification of elements and position using technologies including but not limited to Machine Learning models, image processing technologies including computer vision, OCR (Optical Character Recognition).

[0061] In an embodiment, the accelerometer (125) can be mounted on the wearable frame for detecting fall of the user based on acceleration. The accelerometer can be connected to the microcontroller for transmitting the detection of the fall of the user. The microcontroller can notify the user device for transmitting an emergency SOS message. In an embodiment, the user device can transmit the emergency alert message to emergency contacts and emergency services as saved in the user device.

[0062] Fig. 2a illustrates the wearable device for providing audio based assistance to visually impaired users. The wearable device can be mounted on a frame 101 including but not limited conventional spectacles, head band. Theimage capturing mean 115 can be mounted on a front portion of the frame 101 of the wearable device for capturing images ahead of the user. The control buttons 113 can be affixed on the frame of the wearable device. The audio means 121 can be mounted on the frame for being positioned adjacent ears of the user. The haptic motors 123 can be mounted at plurality of directions on the wearable device 101 for vibrating and indicating a direction to the user.

[0063] The microcontroller 115 can be mounted at a side on the frame of the wearable device 101. The microcontroller 115 can be connected to the audio means 121, the image capturing means 117, the haptic motors, and the control buttons 113.

[0064] In an embodiment, a light source 203 can be mounted on the frame 101. The light source 203 can include but not limited to a LED light and / or Infrared light. The light source 203 can be disabled manually using the control button 114. In an embodiment, the light source 203 can be controlled to be switched ON by the microcontroller on detection of darkness by the image capturing means.

[0065] Fig. 2b illustrates a top view of the wearable device.

[0066] Fig. 2c illustrates a three-dimensional rendering of the wearable device.

[0067] Fig. 3 illustrates a method of providing audio based guidance to visually impaired users. In accordance with an embodiment, the method can include the following steps. Capturing 301 an image, by an image capturing means mounted on a wearable frame worn by a user. The image capturing means can be controlled based on control received through one of control buttons and proximity sensors, by the microcontroller.

[0068] The image capturing means can be connected to a microcontroller mounted on the wearable frame.

[0069] Then, connecting 302 to a user device through a communication network for transmitting the captured image, by the microcontroller.

[0070] Next, processing 303 the captured image for providing audio-based guidance based on input received from the microcontroller, by a processor of the user device. The processing can include but not limited to identifying (303a) elements in the captured image and generating text of the identified elements, by the processor, identifying 303b a position of the elements relative to the user in the captured image, by the processor, and converting (303c) the text of the identified elements to audio, by the processor of the user device. The elements can include but not limited to living objects and non-living objects.

[0071] In an embodiment, the input can include but not limited to one of interpreting a scene, navigating, recognizing an element, and guidance in conversations. The input can be received from one of the control buttons and the microphone, by the processor.

[0072] In an embodiment, interpreting a scene can include identifying all the elements in the captured image, and position of each identified element in the captured image, and converting the text of the identified elements to audio, by the processor of the user device.

[0073] In an embodiment, navigating can include detecting a presence of elements within a threshold distance of the user, by the plurality of proximity sensors, identifying all the elements detected by the proximity sensors, and aposition of the identified elements on receiving the detection from the proximity sensors, by the processor, and converting the text of the identified elements to audio, by the processor, thereby providing audio-based guidance in navigating in an area.

[0074] In an embodiment, recognizing an element can include identifying one or a combination of currency, faces, symbols, road signs, and text from the captured image, and converting the text of the identified elements to audio, by the processor.

[0075] In an embodiment, guidance in conversations can include recording an audio in surrounding of the user, by a plurality of microphones mounted on the wearable frame, and identifying direction of a source of the audio recorded based on image processing performed on the captured image, by the processor of the user device, and controlling a pre-defined haptic motor mounted at a direction of the audio source, by the processor.

[0076] Then, transmitting 304 the audio of the identified elements to an audio means connected to the user device, by the processor.

[0077] Next, controlling 305 a pre-defined haptic motor mounted at a direction of the identified position of the elements, by the processor.

[0078] Finally, emitting 306 the audio of the identified elements and the vibration in the identified direction of the element simultaneously for providing audio-based guidance, by the audio means and the haptic motor.

[0079] In an embodiment, identifying the position of the element can include identifying a direction of the element relative to the user (the direction can includebut not limited to north east, north west, south east, and south west). The haptic motor can be predefined based on a side of the haptic motor mounted on the wearable frame matching with the direction of the element.

[0080] In an embodiment, the method can include translating the text to a language selected by the user. The language can be selected by the user using the user device

[0081] A main advantage of the present disclosure is that it provides an audio based wearable device, system, and method to provide guidance to visually impaired users.

[0082] Another advantage of the present disclosure is that it provides a cost- effective wearable device providing guidance to visually impaired users being independent of intrinsic processors and hardware elements.

[0083] Yet another advantage of the present disclosure is that the wearable device, system, and method are user friendly with ease of accessibility in providing guidance to visually impaired users.

[0084] Still another advantage of the present disclosure is that it provides an efficient system and wearable device for guiding visually impaired users through audio.

[0085] Yet another advantage of the present disclosure is that the wearable device, system, and method provide a multi-lingual audio based guidance to visually impaired users.

[0086] Still another advantage of the present disclosure is that the wearable device, system, and method provide an emergency response system for assisting visually impaired users.

[0087] Yet another advantage of the present disclosure is that the wearable device, system, and method are not restrictive of the platform being used.

[0088] Still another advantage of the present disclosure is that the wearable device, system, and method are more affordable because of no dedicated processor.

[0089] Yet another advantage of the present disclosure is that the wearable device, system, and method focus on non-verbal communication (haptics, gestures et.) thereby reducing language dependency.

[0090] The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and / or adapt for various applications such specific embodiments without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the spirit and scope of the embodiments as described herein

Claims

We Claim:

1. A method of providing audio-based guidance, comprising the steps of: capturing (301) an image, by an image capturing means mounted on a wearable frame worn by a user; wherein the image capturing means connected to a microcontroller on the wearable frame; connecting (302) to a user device through a communication network for transmitting the captured image, by the microcontroller; processing (303) the captured image for providing audio-based guidance based on input received from the microcontroller, by a processor of the user device; wherein the processing including: identifying (303a) elements in the captured image and generating text of the identified elements, by the processor, identifying (303b) a position of the elements relative to the user in the captured image, by the processor, and converting (303c) the text of the identified elements to audio, by the processor of the user device; transmitting (304) the audio of the identified elements to an audio means connected to the user device, by the processor, controlling (305) a pre-defined haptic motor mounted at a direction matching the identified position of the elements, by the processor; and emitting (306) the audio of the identified elements and the vibration in the direction of the element simultaneously for providing audio-based guidance, by the audio means and the haptic motor.

2. The method as claimed in claim 1, wherein controlling the image capturing means to capture an image based on input received through one of control buttons, proximity sensors, and microphone, by the microcontroller.

3. The method as claimed in claim 1, wherein the elements comprising predefined living objects, and non-living objects; and wherein the elements pre-defined in the processor.

4. The method as claimed in claim 2, wherein the input received including one of interpreting a scene, navigating, recognizing an element, and guidance in conversations, and wherein the input received from one of the control buttons and microphone.

5. The method as claimed in claim 4, wherein processing based on the input of interpreting a scene including the steps of: identifying all the elements in the captured image, and position of each identified element in the captured image, and converting the text of the identified elements to audio, by the processor of the user device.

6. The method as claimed in claim 4, wherein processing based on the input of navigating including the steps of: detecting a presence of elements within a threshold distance of the user, by the proximity sensors identifying the elements, and a position of the identified elements in the captured image, by the processor; identifying signs and symbols in the captured image, by the processor; and converting the text of the identified elements to audio, by the processor.

7. The method as claimed in claim 4, wherein processing based on the input of recognizing an element including the steps of:identifying one or a combination of currency, faces, gestures, symbols, road signs, and text from the captured image; and converting the text of the identified elements to audio, by the processor.

8. The method as claimed in claim 4, wherein processing based on the input of guidance in conversations including the steps of: identifying direction of a source of the audio recorded based on image processing of the captured image, by the processor of the user device; controlling a pre-defined haptic motor mounted at a direction matching the direction of the source of the audio, by the processor; identifying elements including faces, facial expression, hand gestures in the captured image, by the processor; and converting the text of the identified elements to audio, by the processor.

9. The method as claimed in claim 8, wherein identifying the facial expression including identifying emotions from the image processing.

10. The method as claimed in claim 1, wherein identifying the position of the element including identifying a side of the element relative to the user; and wherein the haptic motor predefined based on a direction of the haptic motor mounted on the wearable frame matching with the identified position of the element.

11. The method as claimed in claim 1, wherein the method including translating the text to a language selected by the user, by the processor of the user device; and wherein selection of the language received from the user, by the processor of the user device.

12. The method as claimed in claim 11, wherein the processor controlling intensity of audio emitted from the audio means; andwherein the intensity emitted by the audio means in the direction of element greater than intensity emitted by the audio means in another direction.

13. A system of providing audio-based guidance, comprising: a detecting means (103) for detecting parameters and controlling capturing of an image; wherein the detecting means (103) including a plurality of proximity sensors (105); a control means (109) for receiving an input from a user for controlling capturing of an image, wherein the control means (109) including a microphone (111) and a plurality of control buttons (113); an image capturing means for capturing an image based on the control received from one of the detecting means (103) and the control means (109); a microcontroller (115) connected to the image capturing means for storing the captured image and transmitting the captured images to a user device, wherein the user device connected to the microcontroller (115) through a communication network (125); the user device (129) including a processor (129) and a memory (131), wherein the processor processing the captured image based on input received from the user; a plurality of haptic motors connected to the user device (129), wherein the haptic motors mounted on the wearable frame in multiple directions for emitting a vibration; an audio means connected to the user device (129) for emitting an audio; wherein the processor of the user device identifying elements and generating text of the identified elements, identifying a position of the elements relative to the user, and converting the text of the identified elements to audio;the audio means controlled by the processor for emitting the audio of the identified elements; and a pre-defined haptic motor mounted in a direction at the identified position of the elements controlled by the processor for emitting the vibration, thereby providing audio-based guidance.

14. The system as claimed in claim 12, wherein an accelerometer (125)mounted on the wearable frame for detecting fall of the user based on acceleration; and wherein the accelerometer (125) connected to the microcontroller (115) for transmitting the detection of the fall of the user; and wherein the microcontroller (115) notifying the user device (129) for transmitting an emergency SOS message.

15. A device for providing audio based guidance, comprising: an image capturing means (115) for capturing an image; a plurality of proximity sensors (107) for detecting presence of an obstacle within a threshold distance; a plurality of haptic motors (125) mounted at plurality of directions for indicating a direction to the user through vibrations; a microcontroller (115) connected to the image capturing means (115), the proximity sensors (107), and the haptic motors; a microphone (111) and a plurality of control buttons (113) for receiving input from the user; and wherein the microcontroller (115) controlling the image capturing means (115) based on input received from one of the control buttons.

16. The device as claimed in claim 14, wherein the device is capable of being retrofit on a wearable frame and / or conventional spectacles.

Images