Braille input method for multi-touch gesture identification based on phonetic notation prompts

Abstract

The invention discloses a braille input method for multi-touch gesture identification based on phonetic notation prompts. Firstly sixteen basic gestures are constructed according to a sliding area formed by four point locations above the braille, and then according to a point location logic arrangement rule of the braille, a touch area of a middle finger or a fourth finger of the left hand is added, sixty-four gestures corresponding to sixty-four braille points are constructed, the braille phonetic notation prompts are utilized, thereby selecting the input braille. According to the method, corresponding areas of a multi-touch screen are utilized to form graphics, the braille point locations are extracted after graphic recognition, and a blind person completes the braille input by using thetouch screen. Gesture sensing of both hands is achieved on the touch screen, after a gesture graphic formed by a finger slipping area or a finger clicking area is recognized, the gesture graphic is searched in a braille gesture comparison table, a voice prompt of the braille phonetic notation is given, a braille point is extracted, finally a 'determination' area is touched to input the corresponding braille.

Description

technical field [0001] The invention relates to a braille input method, in particular to a braille input method based on phonetic notation prompt multi-touch gesture recognition. Background technique [0002] According to statistics, there were about 12.63 million people with visual disabilities in my country at the end of 2010. The World Health Organization estimates that there are 40 million to 45 million blind people in the world. Low vision is three times that of blind people, about 140 million people. The growing population of people with disabilities and their urgent need for information is a serious challenge to the construction of information accessibility. Using computers for information processing is a basic ability of modern people, but the current human-computer interaction of information processing in ordinary computers is designed for ordinary people, and less consideration is given to the application needs of visually impaired people. For example, there are cu...

AI Technical Summary

Problems solved by technology

[0010] Disadvantages: Because the virtual keyboard area cannot be directly positioned, to enter m, you have to slide through multiple keys on the virtual keyboard at one time, which is less efficient and is rarely used at present

[0014] Disadvantages: ① It is difficult to input information in a noisy environment; ② It is not conducive to the protection of privacy; ③ Non-Chinese symbol information (mathematical and chemical symbols, music symbols, etc.) including Braille cannot be input

[0018] Disadvantages: ①There are too many graphics and lack of internal logic of Braille points, which is not conducive to the memory of point graphics, making the input efficiency low; ②Only using Braille as a conversion medium to input Chinese character information does not input real Braille; ③There is no real Braille on the touch screen. Tactile reference objects, the gesture graphics formed by touch will inevitably deviate, resulting in a large error, which greatly reduces the input speed

[0021] Disadvantages: Extremely inefficient, does not take into account the positioning of tactile reference objects

[0024] Disadvantages: There are large differences between devices, and the simulated keyboard for inputting Braille is not well resolved

In many cases, it is also impossible to input this input method. For example, when walking, the smartphone cannot be used if it cannot be placed on a flat surface.

Images