Touch and listening multifunctional glove for assisting blind person in reading

Abstract

The utility model relates to the field of modern electronic application technology and visual impairment assisting technology, and discloses a multifunctional touching and hearing glove for assisting blind people in reading, which comprises glove fabric, a camera with an OCR character recognition system is arranged at the index finger part of the glove fabric, a data processing device and a tactile feedback system are arranged at the palm back part of the glove fabric, and the data processing device is connected with the tactile feedback system. The palm center part of the glove fabric is provided with an auditory feedback system, the camera is connected with the data processing device, the data processing device is connected with the tactile feedback system and the auditory feedback system, the fingertip sensor is connected with the tactile feedback system, and the tactile feedback system converts information into pulse signals and transmits the pulse signals to the fingertip sensor. The device is low in price and convenient to carry, can effectively help the blind to read non-braille books, and brings convenience to study and life of the blind.

Description

Technical Field

[0001] The present application relates to the fields of modern electronic application technology and visually impaired assistance technology, and in particular to a touch-and-hearing multifunctional glove for assisting the blind in reading. Background Art

[0002] Due to lack of vision, blind people have to obtain information through hearing and touch. However, the current Braille recognition technology mainly relies on the blind touching the protruding points on the paper to recognize Braille. This Braille recognition technology has great shortcomings: first, Braille reading is not convenient. At present, mobile phones are all touch screens and rarely have physical buttons, so blind people cannot easily use smartphones to read e-books. Secondly, the blind touching the paper for a long time can easily cause finger damage, and because many books do not have Braille versions, the range of books they can read is small.

[0003] The Chinese patent document with the prior art publication number CN110728886A discloses a Braille learning system. The utility model can obtain target text through the camera in the bracelet. The converter converts the target text to generate simulated Braille and sends it to the fingertip detector. The fingertip detector receives the simulated Braille sent by the bracelet, generates a Braille pulse signal according to the simulated Braille and stimulates the user's fingers to imitate the simulated Braille, thereby expanding the reading range of the blind and enabling the blind to perceive Braille through the tactile feedback function.

[0004] The Chinese patent document with the prior art publication number CN113081710A discloses a glove that assists the blind in avoiding obstacles. The utility model obtains environmental information through a visual processing device located at the palm of the glove, and processes the obtained environmental information into binary image information, and then generates tactile information from the binary image information through a tactile perception device located inside the visual processing device. The blind can obtain visual information through tactile perception of the palm, which can effectively assist the blind in obtaining picture information and help the blind perceive the world.

[0005] The information disclosed in this background technology section is only intended to enhance the understanding of the overall background of the application and should not be regarded as an admission or any form of suggestion that the information constitutes the prior art already known to ordinary technicians in the field. Summary of the invention

[0006] The utility model aims to provide a touch-hearing multifunctional glove for assisting the blind to read, which is low-priced, easy to carry, and can effectively help the blind to read non-Braille books, thus bringing convenience to their study and life.

[0007] In order to achieve the above objectives, this application is implemented by adopting the following technical solutions:

[0008] A touch-and-hear multifunctional glove for assisting the blind in reading comprises a glove fabric, wherein a camera with an OCR text recognition system is arranged at the index finger portion of the glove fabric, a data processing device and a tactile feedback system are arranged at the back of the palm portion of the glove fabric, fingertip sensors are installed at the fingertips of the glove fabric, an auditory feedback system is arranged at the palm portion of the glove fabric, the camera is connected to the data processing device, the data processing device is connected to the tactile feedback system and the auditory feedback system, the fingertip sensor is connected to the tactile feedback system, and the tactile feedback system converts information into a pulse signal and transmits it to the fingertip sensor.

[0009] Optionally, the data processing device includes an image acquisition module, an OCR recognition module and a translation module, wherein the input end of the image acquisition module is connected to a camera, the output end is connected to the OCR recognition module, and the OCR recognition module is connected to the translation module.

[0010] Optionally, the tactile feedback system includes a Blind-Chinese converter and an electric pulse generator, the input end of the Blind-Chinese converter is connected to a data processing device, the output end is connected to the electric pulse generator, and the output end of the electric pulse generator is connected to a fingertip sensor.

[0011] Optionally, the electric pulse generator includes a supporting tube, a rotating drive shaft, an extrusion component, an electric signal generating component and a power supply. The electric pulse generator is connected to a Braille-Chinese converter to generate a Braille pulse signal. The rotating drive shaft is installed inside the supporting tube on the same axis as the supporting tube. The output end of the power supply is connected to the rotating drive shaft. The fixed end of the extrusion component is installed on the rotating drive shaft. The free end of the extrusion component contacts the extrusion electric signal generating component, so that the electric signal generating component generates an electric pulse signal output. The electric signal generating component is a piezoelectric engine.

[0012] Optionally, the auditory feedback system comprises a sound synthesis processor and a speaker, wherein an input end of the sound synthesis processor is connected to the data processing device, and an output end of the sound synthesis processor is connected to the speaker.

[0013] Optionally, a solar charging system is provided on the back of the palm of the glove fabric, a circuit board is provided on the palm of the glove fabric, the solar charging system is connected to the circuit board, and the circuit board is connected to a camera, a data processing device, a tactile feedback system and an auditory feedback system.

[0014] Optionally, the fingertip sensor includes a first electrode and a second electrode arranged opposite to each other, and a pressure structure arranged between the first electrode and the second electrode, including multiple pressure layers, and the first electrode and the second electrode receive the Braille pulse signal produced by the electric pulse generator to generate pulses to squeeze the pressure structure, so that the blind person can obtain tactile information.

[0015] Optionally, the solar charging system includes a solar panel, a circuit board, a power storage device, a charging output interface, and a charging input interface. The solar panel is installed on the back of the glove fabric and is connected to the power storage device through the circuit board. The circuit board is provided with a control circuit for controlling the power storage device. The control circuit is connected to the power storage device, the charging output interface, and the charging input interface. The charging output interface is connected to the circuit board, and the charging input interface is installed on the side of the glove fabric opening.

[0016] Optionally, the Blind-Chinese converter includes a Blind-Chinese comparison editing and typesetting device, a Blind-Chinese automatic converter and a display, the Blind-Chinese comparison editing and typesetting device has an input end connected to a data processing device, an output end connected to the Blind-Chinese automatic converter, and the output end of the Blind-Chinese automatic converter is connected to a display screen.

[0017] Compared with the prior art, the present invention has the following beneficial effects:

[0018] 1. Connecting the data processing device with the tactile feedback system, including the three components of the Braille-Chinese converter, the electric pulse generator and the fingertip sensor, which are connected in sequence, generates tactile information from the recognized text information through the electric pulse signal and conveys it to the blind. The blind can read non-Braille books more easily through the tactile sense of their fingers;

[0019] 2. The tactile feedback system and the auditory feedback system are used at the same time, so that the blind can receive both tactile and auditory feedback information when reading non-Braille books, which is more convenient for the blind to learn and read. At the same time, the utility model has the advantages of easy use, easy to wear, good effect and low cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 This is a schematic diagram of the overall structure of a touch-hearing multifunctional glove for assisting the blind in reading;

[0022] Figure 2 This is a schematic diagram of the back structure of a multifunctional glove for assisting blind people in reading;

[0023] Figure 3 It is a circuit connection schematic diagram of the utility model;

[0024] Figure 4 It is a partial enlarged view of the connection between the electric pulse generator of the utility model and the fingertip sensor;

[0025] Figure 5 It is a partial enlarged view of the blind-Chinese converter of the utility model;

[0026] Figure 6 It is a structural diagram of the data processing device of the utility model;

[0027] Figure 7 The present invention is a schematic diagram of the working process of a touch-and-hearing multifunctional glove for assisting the blind in reading.

[0028] Description of reference numerals:

[0029] 1. Finger tip sensor; 2. Camera; 3. Data processing device; 301. Image acquisition module; 302. OCR recognition module; 303. Translation module; 4. Blind-Chinese converter; 5. Electric pulse generator; 6. Sound synthesis processor; 7. Speaker; 8. Charging input interface; 9. Circuit board; 10. Solar charging system; 501. Support cylinder; 502. Rotating drive shaft; 503. Power supply; 504. Extrusion component; 505. Electric signal generating component; 101. First electrode; 102. Second electrode; 401. Blind-Chinese comparison editing and typesetting device; 402. Blind-Chinese automatic converter; 403. Display. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present application and its application or use.

[0031] Embodiment 1:

[0032] A multifunctional glove for assisting the blind to read. Figure 1As shown, it includes glove fabric, the index finger part of the glove fabric is provided with a camera 2 with an OCR text recognition system, the back of the palm of the glove fabric is provided with a data processing device 3 and a tactile feedback system, the fingertips of the glove fabric are installed with a fingertip sensor 1, the palm part of the glove fabric is provided with an auditory feedback system, the camera 2 is connected to the data processing device 3, the data processing device 3 is connected to the tactile feedback system and the auditory feedback system, the fingertip sensor 1 is connected to the tactile feedback system, the tactile feedback system converts information into a pulse signal and transmits it to the fingertip sensor 1, and the camera 2 is located at the index finger of the glove fabric. The position is that of the second joint of the index finger. The index finger forms an angle of 30° with the paper surface. The camera 2 is perpendicular to the index finger and forms an angle of 30° with the paper surface to obtain graphic information. The data processing device 3 collects the graphic information taken by the camera 2, converts the graphic information into text information and recognizes the text. The auditory feedback system broadcasts the text processed by the data processing device 3. The tactile feedback system converts the information of the data processing device 3 into Braille pulse signals. The recognized text information generates tactile information through electric pulse signals and is conveyed to the blind. At the same time, the auditory feedback system also transmits information. At the same time, both tactile and auditory feedback information are received, which is more convenient for the blind to learn and read.

[0033] like Figure 6 As shown, the data processing device 3 includes an image acquisition module 301, an OCR recognition module 302 and a translation module 303. The input end of the image acquisition module is connected to the camera 2, and the output end is connected to the OCR recognition module. The OCR recognition module is connected to the translation module. The image acquisition module, the OCR recognition module and the translation module are connected to the camera 2. The image acquisition module is used to acquire images of the image and text information taken by the camera 2. The OCR recognition module converts the image and text information into text information through the OCR text recognition system. The translation module compares the text information through the basic characters of the character database to obtain recognized text. The camera 2 for OCR text recognition is model WN-L2112.K314L, with a frame rate of 30FPS. The camera 2 is separated from the image acquisition module, with a size of 10mm*10mm. The cable length between the camera 2 and the image acquisition module is 48mm.

[0034] like Figure 2As shown, the tactile feedback system includes a Braille-Chinese converter 4 and an electric pulse generator 5, the input end of the Braille-Chinese converter 4 is connected to the data processing device 3 and the output end is connected to the electric pulse generator 5, the output end of the electric pulse generator 5 is connected to the fingertip sensor 1, the Braille-Chinese converter 4 converts the information of the data processing device 3 into Braille using Chinese pinyin, the fingertip sensor 1 includes a first electrode 101 and a second electrode 102 arranged opposite to each other, and a pressure structure arranged between the first electrode 101 and the second electrode 102, including a plurality of pressure layers, the first electrode 101 and the second electrode 102 receive the Braille pulse signal produced by the electric pulse generator 5 to generate a pulse to squeeze the pressure structure, so that the blind can obtain tactile information, the pressure layer includes a PVDF and PZT particle composite material structure, the polymer grade 1010 / 0001 can be selected, and the size is 10*10*5mm, and the first electrode 101 and the second electrode 102 are arranged opposite to each other on the material.

[0035] like Figure 4 As shown, the electric pulse generator 5 includes a support tube 501, a rotating drive shaft 502, an extrusion component 504, an electric signal generating component 505 and a power supply 503. The electric pulse generator 5 is connected to the Braille-Chinese converter 4 to generate a Braille pulse signal. The rotating drive shaft 502 is installed inside the support tube 501 on the same axis as the support tube 501. The output end of the power supply 503 is connected to the rotating drive shaft 502. The fixed end of the extrusion component 504 is installed on the rotating drive shaft 502. The free end of the extrusion component 504 contacts the extrusion electric signal generating component. The material of the support tube 501 is a conductive material. The electric signal generating component 505 preferably has an insulating protective layer to prevent the electric signal generating component 505 from being electrically connected to the supporting tube 501. The rotating drive shaft 502 rotates axially based on the power supply of the power supply 503. The extrusion component 504 has a free end that is not connected to the rotating drive shaft 502. When the extrusion component 504 rotates driven by the rotation of the rotating drive shaft 502 relative to the supporting tube 501, the free end of the extrusion component 504 can contact and squeeze the electric signal generating component 505, so that the electric signal generating component generates an electric pulse signal output. The electric signal generating component is a piezoelectric engine.

[0036] like Figure 2 As shown, the auditory feedback system includes a sound synthesis processor 6 and a speaker 7. The sound synthesis processor 6 and the speaker 7 are connected to the data processing device 3. The sound synthesis processor 6 converts the information of the data processing device 3 into sound and transmits it to the blind person through the speaker 7.

[0037] like Figure 5 As shown, the Blind-Chinese converter 4 includes a Blind-Chinese comparison editing and typesetting device 401, a Blind-Chinese automatic converter 402 and a display 403. The input end of the Blind-Chinese comparison editing and typesetting device 401 is connected to the data processing device 3, and the output end is connected to the Blind-Chinese automatic converter 402. The output end of the Blind-Chinese automatic converter 402 is connected to the display screen 403.

[0038] Embodiment 2:

[0039] like Figure 3 As shown, a solar charging system 10 is provided on the back of the palm of the glove fabric, and a circuit board 9 is provided on the palm of the glove fabric. The solar charging system 10 is connected to the circuit board 9, and the circuit board 9 is connected to the camera 2, the data processing device 3, the tactile feedback system and the auditory feedback system.

[0040] The solar charging system 10 includes a solar panel, a circuit board, a power storage device, a charging output interface, and a charging input interface 8. The solar panel is installed on the back of the glove fabric and connected to the power storage device through the circuit board. The circuit board is provided with a control circuit for controlling the power storage device. The control circuit is connected to the power storage device, the charging output interface, and the charging input interface 8. The charging output interface is connected to the circuit board 9. The charging input interface 8 is installed on the side of the glove fabric mouth. Two charging methods are convenient to use. The power storage device is a 18650 lithium battery with a capacity of 1200mAH and an output voltage of 3.7V. The circuit board model is 868668, and the circuit board is connected through a nickel sheet terminal line PH2.0 / XH2.54.

[0041] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "inside", "outside", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the drawings, and are only used to explain the relative position relationship, movement, etc. between the components in a certain posture. If the specific posture changes, the directional indication will also change accordingly. It is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation to the present application.

[0042] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood by specific circumstances.

[0043] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A multifunctional glove for assisting the blind in reading, characterized in that: The invention comprises a glove fabric, wherein a camera (2) with an OCR text recognition system is arranged at the index finger portion of the glove fabric, a data processing device (3) and a tactile feedback system are arranged at the back of the palm portion of the glove fabric, a fingertip sensor (1) is installed at the fingertips of the glove fabric, and an auditory feedback system is arranged at the palm portion of the glove fabric, the camera (2) is connected to the data processing device (3), the data processing device (3) is connected to the tactile feedback system and the auditory feedback system, the fingertip sensor (1) is connected to the tactile feedback system, and the tactile feedback system converts information into a pulse signal and transmits it to the fingertip sensor (1).

2. The multifunctional gloves for assisting the blind in reading according to claim 1, characterized in that: The data processing device (3) comprises an image acquisition module, an OCR recognition module and a translation module. The input end of the image acquisition module is connected to the camera (2), and the output end is connected to the OCR recognition module. The OCR recognition module is connected to the translation module.

3. The multifunctional gloves for assisting the blind in reading according to claim 1, characterized in that: The tactile feedback system comprises a braille-Chinese converter (4) and an electric pulse generator (5), wherein the input end of the braille-Chinese converter (4) is connected to a data processing device (3), the output end is connected to the electric pulse generator (5), and the output end of the electric pulse generator (5) is connected to a fingertip sensor (1).

4. The multifunctional gloves for assisting the blind in reading according to claim 3, characterized in that: The electric pulse generator (5) comprises a support tube (501), a rotating drive shaft (502), an extrusion component (504), an electric signal generating component (505) and a power source (503). The electric pulse generator (5) is connected to a Braille-Chinese converter (4) to generate a Braille pulse signal. The rotating drive shaft (502) is installed inside the support tube (501) on the same axis as the support tube (501). The output end of the power source (503) is connected to the rotating drive shaft (502). The fixed end of the extrusion component (504) is installed on the rotating drive shaft (502). The free end of the extrusion component (504) contacts the extrusion electric signal generating component, so that the electric signal generating component generates an electric pulse signal output. The electric signal generating component is a piezoelectric motor.

5. The multifunctional gloves for assisting the blind in reading according to claim 1, characterized in that: The auditory feedback system comprises a sound synthesis processor (6) and a loudspeaker (7), wherein the input end of the sound synthesis processor (6) is connected to the data processing device (3) and the output end is connected to the loudspeaker (7).

6. The multifunctional gloves for assisting the blind in reading according to claim 1, characterized in that: The back of the glove fabric is provided with a solar charging system (10), the palm of the glove fabric is provided with a circuit board (9), the solar charging system is connected to the circuit board (9), and the circuit board (9) is connected to a camera (2), a data processing device (3), a tactile feedback system, and an auditory feedback system.

7. The multifunctional gloves for assisting the blind in reading according to claim 3, characterized in that: The fingertip sensor (1) comprises a first electrode (101) and a second electrode (102) arranged opposite to each other, and a pressure structure arranged between the first electrode (101) and the second electrode (102), comprising a plurality of pressure layers, wherein the first electrode (101) and the second electrode (102) receive a Braille pulse signal generated by the electric pulse generator (5) to generate a pulse to squeeze the pressure structure, thereby enabling a blind person to obtain tactile information.

8. The multifunctional gloves for assisting the blind in reading according to claim 6, characterized in that: The solar charging system (10) comprises a solar panel, a circuit board, a power storage device, a charging output interface, and a charging input interface (8); the solar panel is mounted on the back of the glove fabric and connected to the power storage device via the circuit board; a control circuit for controlling the power storage device is provided on the circuit board; the control circuit is connected to the power storage device, the charging output interface, and the charging input interface (8); the charging output interface is connected to a circuit board (9); and the charging input interface (8) is mounted on the side of the glove fabric opening.

9. The multifunctional gloves for assisting the blind in reading according to claim 3, characterized in that: The braille-Chinese converter (4) comprises a braille-Chinese comparison editing and typesetting device (401), a braille-Chinese automatic converter (402) and a display (403); the braille-Chinese comparison editing and typesetting device (401) has an input end connected to a data processing device (3), and an output end connected to the braille-Chinese automatic converter (402); and the output end of the braille-Chinese automatic converter (402) is connected to the display (403).

Images