A text input method and electronic terminal for the blind
Through the text input method for blind people, using fingers to tap the back of the electronic terminal to collect voiceprint features and combine it with the Braille symbol comparison table, the text input of blind people in the electronic terminal is realized, solving the interaction obstacles for blind people when using electronic terminals.
Patent Information
- Application Number
- CN202310687488.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-12
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2043-06-12
AI Technical Summary
The lack of interactive methods for blind people to use electronic terminals for text input in the prior art has become a major obstacle for blind people to use electronic terminals such as mobile phones.
By designing a special text input method for blind people, use the index finger, middle finger or ring finger of both hands to tap the back of the electronic terminal to collect voiceprint characteristics, combine the six-point braille symbols and text comparison table to realize the conversion of braille symbols to text, and collect finger tap information through the microphone and sensor to generate text.
It has expanded the interaction between the blind and the electronic terminal, solved the text input barriers when the blind use the electronic terminal, and realized that the blind can enter text through finger tapping.
Smart Images

Figure CN116758799B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of electronic terminal interaction for the blind, and in particular to a text input method and an electronic terminal dedicated to the blind. Background Art
[0002] With the continuous advancement of technology, the use of electronic devices such as mobile communications, multimedia devices, and computers has become increasingly widespread, becoming indispensable for work, study, and daily life. People use them to communicate and connect to the internet, including sending and editing text messages, emails, building phone books, and performing word processing. Furthermore, creating blogs, posting on forums, and searching the web all require text input methods. However, for the blind, all of this is blocked. Currently, there is no interactive method for blind people to input information on electronic devices, which has become a major obstacle for them to use mobile phones and other electronic devices. Summary of the Invention
[0003] In view of the problems existing in the prior art, the purpose of the present invention is to provide a text input method and an electronic terminal specifically for the blind, so as to solve the text input obstacles faced by the blind when using the electronic terminal.
[0004] To achieve the above object, the technical solution adopted by the present invention is:
[0005] A text input method for the blind, applied to an electronic terminal, comprising:
[0006] The user holds the electronic terminal horizontally, with the thumbs and pinkies of both hands used to support the electronic terminal, and the tips of the index fingers, middle fingers, and ring fingers of both hands located on the back of the electronic terminal are used to freely tap the back of the electronic terminal; the tips of the index fingers, middle fingers, and ring fingers of both hands tap the back of the electronic terminal respectively, and the electronic terminal records the voiceprint features of the tapping of different fingers, and associates the voiceprint features of different fingers with one dot in the six-dot Braille; the six-dot Braille is used to form multiple Braille symbols, and each Braille symbol corresponds to a combination of voiceprint features;
[0007] Whenever a user inputs text, the user holds the electronic terminal horizontally and taps the back of the electronic terminal with the tips of the index, middle, or ring fingers of both hands. The electronic terminal collects the sound signals of the fingertips tapping the back of the electronic terminal in sequence, inputs an interval instruction as the end symbol of the input of the Braille symbol, extracts all the voiceprint features in sequence, and obtains the point information corresponding to all the voiceprint features. Based on all the point information, the Braille symbol is obtained, and the corresponding text is searched in the Braille symbol comparison table based on the Braille symbol, and the text is generated on the electronic terminal;
[0008] The Braille symbol comparison table stores Braille symbols and the corresponding characters.
[0009] The back of the electronic terminal is provided with six tapping areas, namely three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index finger, middle finger and ring finger of the user's left hand respectively, and the three tapping areas on the right correspond to the index finger, middle finger and ring finger of the user's right hand respectively;
[0010] When the user taps the back of the electronic terminal with his fingertips, the electronic terminal collects the voiceprint characteristics and tapping area information generated by the tapping action;
[0011] The electronic terminal determines whether there is a correspondence between each collected voiceprint feature and the corresponding tapping area information. If there is a correspondence, the corresponding Braille symbol in six-dot Braille is obtained, and the corresponding text is found in the Braille symbol comparison table based on the Braille symbol, and the text is generated in the electronic terminal; if there is no correspondence, no operation is performed or the voice prompt indicates an error.
[0012] When the tip of the user's left thumb and / or right thumb taps the front of the electronic terminal, the interval instruction is triggered.
[0013] The voiceprint feature generated by tapping the front of the electronic terminal with the left thumb or the right thumb is pre-recorded into the electronic terminal and bound to the interval instruction.
[0014] When the electronic terminal generates text, it plays the text in voice.
[0015] The electronic terminal stores a cancel instruction, which is bound to a voiceprint feature generated when a user's left thumb or right thumb taps the front of the electronic terminal when the user holds the electronic terminal horizontally;
[0016] When the user inputs text, after the electronic terminal generates the text, if the user taps the front of the electronic terminal with his left thumb or right thumb, it means canceling the input of the text; when the user's index finger, middle finger, or ring finger taps the back of the electronic terminal, if the electronic terminal receives a cancel command, it means canceling the previous tapping action.
[0017] An electronic terminal comprising
[0018] The microphone unit is used to collect the voiceprint characteristics when the index finger, middle finger, and ring finger of the user's hands tap the back of the electronic terminal when the user holds the electronic terminal horizontally;
[0019] a storage unit for storing voiceprint features generated when the tips of the index, middle, and ring fingers of a user's two hands tap the back of the electronic terminal, and an association between the voiceprint features and six-dot Braille dot positions; the storage unit is further configured to store a Braille symbol comparison table for six-dot Braille, the Braille symbol comparison table storing Braille symbols and corresponding text;
[0020] a decoding and analysis unit for analyzing the voiceprint features collected by the microphone unit and obtaining point information of the voiceprint features based on the correlation between the voiceprint features and the six-dot Braille points; the decoding and analysis unit is further configured to, upon receiving an interruption command, obtain Braille symbols based on the previously obtained point information corresponding to the voiceprint features, and search for corresponding text information based on a Braille symbol comparison table;
[0021] The text generation unit is used to generate the text information obtained by the decoding and analysis unit in the electronic terminal.
[0022] The microphone unit is also used to collect voiceprint features when the left thumb and / or right thumb of the user taps the front of the electronic terminal when the user holds the electronic terminal horizontally; the storage unit stores the voiceprint features when the left thumb and / or right thumb taps the front of the electronic terminal; when the decoding and analysis unit analyzes the voiceprint features collected by the microphone and obtains that the voiceprint features are the voiceprint features when the left thumb or the right thumb taps the front of the electronic terminal, an interrupt instruction is triggered.
[0023] The electronic terminal also includes
[0024] a sensor unit configured to collect vibration signals generated by six tapping areas on the back of the electronic terminal when the user taps the back of the electronic terminal with a fingertip; the six tapping areas are three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index finger, middle finger, and ring finger of the user's left hand, respectively, and the three tapping areas on the right correspond to the index finger, middle finger, and ring finger of the user's right hand, respectively;
[0025] The judgment unit is used to compare the strength of the vibration signals generated by the six tapping areas, and determine that the tapping area with the strongest vibration signal is the user's tapping area this time; the judgment unit is also used to determine whether there is a correspondence between each collected voiceprint feature and the corresponding tapping area information. If there is a correspondence, the decoding and analysis unit is triggered to start; if there is no correspondence, no operation is performed or a voice prompt indicates an error.
[0026] The microphone unit is further configured to collect voiceprint features when the user's left thumb and / or right thumb taps the front of the electronic terminal when the user holds the electronic terminal horizontally; the storage unit stores the voiceprint features when the left thumb and / or right thumb taps the front of the electronic terminal; and the decoding and analysis unit triggers a cancel instruction when analyzing the voiceprint features collected by the microphone and obtaining that the voiceprint features are voiceprint features when the left thumb or right thumb taps the front of the electronic terminal;
[0027] When the user inputs text, after the electronic terminal generates the text, if the user taps the front of the electronic terminal with his left thumb or right thumb, it means canceling the input of the text; when the user's index finger, middle finger, or ring finger taps the back of the electronic terminal, if the electronic terminal receives a cancel command, it means canceling the previous tapping action.
[0028] After adopting the above solution, the present invention uses different fingers to tap the electronic terminal to achieve interaction between the blind and the electronic terminal, expands the interaction mode of Braille input, and solves the text input obstacle when the blind use the electronic terminal. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 Finger tapping diagram for users with short nails;
[0030] Figure 2 Finger tapping diagram for users with long nails;
[0031] Figure 3 This is a schematic diagram of the Braille symbol comparison of this embodiment. DETAILED DESCRIPTION
[0032] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concepts of the example embodiments to those skilled in the art.
[0033] In addition, the described features, structures or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, well-known methods, devices, implementations or operations are not shown or described in detail to avoid blurring various aspects of the present disclosure.
[0034] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.
[0035] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, while others may be combined or partially combined. Therefore, the actual execution order may vary depending on the actual situation.
[0036] The present invention discloses a text input method for the blind, which is applied to an electronic terminal. The method of the present invention comprises:
[0037] Step 10: Record the voiceprint characteristics when your finger taps the back of the electronic terminal.
[0038] The user holds the electronic terminal horizontally, with the thumbs and little fingers of both hands used to support the holding of the electronic terminal, and the fingertips of the index fingers, middle fingers, and ring fingers of both hands located on the back of the electronic terminal used to freely tap the back of the electronic terminal; the fingertips of the index fingers, middle fingers, and ring fingers of both hands respectively tap the back of the electronic terminal, and the electronic terminal records the voiceprint features of the tapping of different fingers, and associates the voiceprint features of different fingers with one dot in the six-dot Braille respectively; the six-dot Braille is used to form multiple Braille symbols, and each Braille symbol corresponds to a combination of voiceprint features.
[0039] The user holds the electronic terminal horizontally, with the thumbs and pinkies supporting the terminal, while the index, middle, and ring fingers of both hands are free to move. In this state, the user's index, middle, and ring fingers of both hands tap the electronic terminal in sequence, recording the voiceprint characteristics of different fingers and storing them in the electronic terminal. The electronic terminal then associates each voiceprint characteristic with a dot in the six-dot Braille system.
[0040] In this embodiment, the six dots in six-dot Braille are divided into two columns, each with three dots. The three dots on the left, from top to bottom, are associated with the voiceprint features generated when the left index finger, left middle finger, and left ring finger tap the back of the electronic terminal, respectively. The three dots on the right, from top to bottom, are associated with the voiceprint features generated when the right index finger, right middle finger, and right ring finger tap the back of the electronic terminal, respectively.
[0041] When entering the voiceprint characteristics of your fingers, the electronic terminal can provide voice prompts, and users should enter the characteristics in the order of left index finger, left middle finger, left ring finger, right index finger, right middle finger, and right ring finger. When entering the voiceprint characteristics, each finger needs to tap the back of the electronic terminal multiple times to collect the voiceprint differences at different tapping forces and angles. A certain amount of error tolerance is set to ensure the success rate of the tapping operation.
[0042] Since the length, hardness, shape and characteristics of the fingernails of each person's fingers are different, and based on the principle that sound is generated by vibration, it can be determined that the sound produced by each finger tapping the back of the electronic terminal at a fixed angle is different. However, when the same finger repeatedly taps the same position on the back of the electronic terminal, the sound produced will be very similar. The reason why the sound is very stable when the same finger taps the same position is because the contact sequence of the fingertips and nails is very fixed. If the user's nails are shorter, the contact sequence of the fingers and the tapped surface in the same direction is very regular. The difference in single tapping speed is reflected in the sound as the difference in sound frequency. For example Figure 1 As shown in the figure, when the nail is short, the contact order of the downward-facing fingertip and nail is fixed. However, due to the presence of the phalanges, even when the nail does not touch the surface, the phalanges will still impact the surface through the fingertip skin. Therefore, there will be three kinds of vibrations with large differences between the fingertip flesh, phalanges, and nails. Figure 2 As shown, if a user has long nails, the length, hardness, and contact angle of the nails will produce different vibration effects, resulting in different characteristic sound frequencies. Therefore, when a user holds an electronic terminal with both hands, the sound characteristics of each finger tapping on the back of the electronic terminal will be different. The built-in recording device of the electronic terminal can receive the sound information and analyze the frequency characteristics of each finger tapping, and use this information to determine the source of subsequent tapping.
[0043] The electronic terminal stores a six-dot Braille symbol comparison table, which is used to illustrate the correspondence between Braille symbols and text. Figure 3 As shown, different dots are combined to form a Braille symbol, and each Braille symbol corresponds to a word.
[0044] Step 20: The user taps the electronic terminal with his fingers to input Braille.
[0045] Whenever the user inputs text, the user holds the electronic terminal horizontally and taps the back of the electronic terminal with the index finger, middle finger or ring finger of both hands. The electronic terminal collects the sound signals of the fingertips tapping the back of the electronic terminal in turn, inputs an interval instruction as the end symbol of the input of a Braille symbol, extracts all the voiceprint features in turn, and obtains the point information corresponding to all the voiceprint features. Based on all the point information, the Braille symbol is obtained, and the corresponding text is found in the Braille symbol comparison table based on the Braille symbol, and the text is generated on the electronic terminal.
[0046] Each Braille symbol entered requires a spacing instruction, which can be any instruction recognized by the electronic terminal. In this embodiment, the spacing instruction is triggered when the user's left thumb and / or right thumb taps the front of the electronic terminal. In this case, the voiceprint characteristics generated by the left or right thumb tapping the front of the electronic terminal are pre-recorded in the electronic terminal and bound to the spacing instruction.
[0047] For example, when the user holds the electronic terminal horizontally, he taps the back of the electronic terminal with the index finger and middle finger of his left hand, and then taps the front of the electronic terminal with the thumb of his left hand or the thumb of his right hand. The electronic terminal will recognize the tapping soundprint characteristics of the index finger and middle finger of his left hand, and determine its point position information in the six-dot Braille. When the electronic terminal recognizes the tapping soundprint characteristics of the left thumb or the right thumb, it forms a Braille symbol based on the previously determined point position information, searches for the corresponding text in the Braille symbol comparison table based on the Braille symbol, and displays it on the electronic terminal. If the Braille comparison table is as follows Figure 3 According to the Braille comparison table shown, the character input by the user in the electronic terminal this time is "e".
[0048] To facilitate users to confirm whether the text they input on the electronic terminal is correct, the electronic terminal plays the text in voice while it is generating the text. If the played text is not the text the user wants to input, the user can enter a cancel command. The cancel command can not only cancel the text generation, but also cancel a specific tapping action. Specifically, when the user's index finger, middle finger, and ring finger tap the back of the electronic terminal, the electronic terminal receives a cancel command, which means that the last tapping action is canceled. For example, the user wants to perform the tapping action on the back of the electronic terminal with the left index finger and the right index finger, but mistakenly uses the left index finger and the right ring finger. After completing the tapping action with the right ring finger, the user immediately enters the cancel command, and the tapping action with the right ring finger can be canceled. At this time, the user can use the right index finger to tap again and enter the interval command to generate the text he wants to enter on the electronic terminal.
[0049] The cancel command can be bound to the voiceprint feature of the user's left or right thumb tapping the front of the electronic terminal. When the user wants to cancel the text they just entered, they can tap the front of the electronic terminal with their left or right thumb. In this embodiment, the interval command is also bound to the voiceprint feature of the user's left or right thumb tapping the front of the electronic terminal. Therefore, when applying, duplicate binding of the two should be avoided. For example, if the voiceprint feature of the left thumb tapping the front of the electronic terminal is bound to the interval command, then the voiceprint feature of the right thumb tapping the front of the electronic terminal is bound to the cancel command. Alternatively, when binding the cancel command and the interval command to the voiceprint features, the number of taps should also be taken into account. For example, tapping the front of the electronic terminal with the left thumb once is considered to trigger the interval command, and tapping the front of the electronic terminal with the left thumb twice is considered to trigger the cancel command.
[0050] To improve the accuracy of finger tapping, six tapping areas are set on the back of the electronic terminal: three on the left and three on the right. The three on the left correspond to the index finger, middle finger, and ring finger of the user's left hand, respectively, and the three on the right correspond to the index finger, middle finger, and ring finger of the user's right hand, respectively.
[0051] When the user taps the back of the electronic terminal with his fingertips, the electronic terminal collects the voiceprint features and tapping area information generated by the tapping action.
[0052] The electronic terminal determines whether there is a correspondence between each collected voiceprint feature and the corresponding tapping area information. If there is a correspondence, the corresponding Braille symbol in six-dot Braille is obtained, and the corresponding text is found in the Braille symbol comparison table based on the Braille symbol, and the text is generated in the electronic terminal; if there is no correspondence, no operation is performed or the voice prompt indicates an error.
[0053] Among them, the tapping area information is obtained in the following way: when the finger taps the back of the electronic terminal, the vibration signal of each tapping area is collected, and then the vibration signals of each tapping area are compared, and the tapping area with the largest vibration signal intensity is determined to be the tapping area tapped by the finger.
[0054] Based on the same inventive concept, the present invention also discloses an electronic terminal, which includes:
[0055] The microphone unit is used to collect the voiceprint characteristics when the index finger, middle finger, and ring finger of the user's hands tap the back of the electronic terminal when the user holds the electronic terminal horizontally;
[0056] a storage unit for storing voiceprint features generated when the tips of the index, middle, and ring fingers of a user's two hands tap the back of the electronic terminal, and an association between the voiceprint features and six-dot Braille dot positions; the storage unit is further configured to store a Braille symbol comparison table for six-dot Braille, the Braille symbol comparison table storing Braille symbols and corresponding text;
[0057] a decoding and analysis unit for analyzing the voiceprint features collected by the microphone unit and obtaining point information of the voiceprint features based on the correlation between the voiceprint features and the six-dot Braille points; the decoding and analysis unit is further configured to, upon receiving an interruption command, obtain Braille symbols based on the previously obtained point information corresponding to the voiceprint features, and search for corresponding text information based on a Braille symbol comparison table;
[0058] The text generation unit is used to generate the text information obtained by the decoding and analysis unit in the electronic terminal.
[0059] When using it, the user still needs to hold the electronic terminal horizontally, and then use the index finger, middle finger or ring finger of both hands to tap the electronic terminal to input Braille symbols. Each time a Braille symbol is input, an interval instruction is input.
[0060] When a user inputs a Braille symbol, each time their finger taps the electronic terminal, the system collects the soundprint signature signal generated by the finger tapping the electronic terminal. This signature is then analyzed to obtain the point information associated with the soundprint signature signal. When an interval instruction is received, the previously acquired six-dot Braille point information is combined to form the Braille symbol. Based on this Braille symbol, the corresponding text is searched in a Braille symbol comparison table and generated on the electronic terminal, completing the text input for the blind user on the electronic terminal.
[0061] An interval instruction is required between each input Braille symbol, and the interval instruction can be any instruction that can be recognized by the electronic terminal. In this embodiment, the interval instruction is triggered when the user's left thumb and / or right thumb taps the front of the electronic terminal. Therefore, the microphone unit is also used to collect the voiceprint characteristics when the left thumb and / or right thumb of the user taps the front of the electronic terminal when the electronic terminal is held horizontally; the storage unit stores the voiceprint characteristics when the left thumb and / or right thumb taps the front of the electronic terminal; the decoding and analysis unit analyzes the voiceprint characteristics collected by the microphone and obtains that the voiceprint characteristics are the voiceprint characteristics when the left thumb or right thumb taps the front of the electronic terminal, and triggers the interruption instruction.
[0062] In order to improve the accuracy of the user's fingertip tapping, the electronic terminal also includes a sensor unit for collecting vibration signals generated by six tapping areas on the back of the electronic terminal when the user taps the back of the electronic terminal with the fingertip; the six tapping areas are three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index finger, middle finger and ring finger of the user's left hand, respectively, and the three tapping areas on the right correspond to the index finger, middle finger and ring finger of the user's right hand, respectively;
[0063] The judgment unit is used to compare the strength of the vibration signals generated by the six tapping areas, and determine that the tapping area with the strongest vibration signal is the user's tapping area this time; the judgment unit is also used to determine whether there is a correspondence between each collected voiceprint feature and the corresponding tapping area information. If there is a correspondence, the decoding and analysis unit is triggered to start; if there is no correspondence, no operation is performed or a voice prompt indicates an error.
[0064] In summary, the present invention utilizes different fingers to tap the electronic terminal to achieve interaction between the blind and the electronic terminal, expands the interaction mode of Braille input, and solves the text input obstacle when the blind use the electronic terminal.
[0065] The computer-readable medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiments.
[0066] It should be noted that although several modules or units of the device for action execution are mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.
[0067] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
[0068] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein.
[0069] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A text input method for the blind, applied to an electronic terminal, characterized in that: The method comprises: The user holds the electronic terminal horizontally, with the thumbs and pinkies of both hands used to support the electronic terminal, and the tips of the index fingers, middle fingers, and ring fingers of both hands located on the back of the electronic terminal are used to freely tap the back of the electronic terminal; the tips of the index fingers, middle fingers, and ring fingers of both hands tap the back of the electronic terminal respectively, and the electronic terminal records the voiceprint features of the tapping of different fingers, and associates the voiceprint features of different fingers with one dot in the six-dot Braille; the six-dot Braille is used to form multiple Braille symbols, and each Braille symbol corresponds to a combination of voiceprint features; Whenever a user inputs text, the user holds the electronic terminal horizontally and taps the back of the electronic terminal with the tips of the index, middle, or ring fingers of both hands. The electronic terminal collects the sound signals of the fingertips tapping the back of the electronic terminal in sequence, inputs an interval instruction as the end symbol of the input of the Braille symbol, extracts all the voiceprint features in sequence, and obtains the point information corresponding to all the voiceprint features. Based on all the point information, the Braille symbol is obtained, and the corresponding text is searched in the Braille symbol comparison table based on the Braille symbol, and the text is generated on the electronic terminal; The Braille symbol comparison table stores Braille symbols and the corresponding characters.
2. A text input method for the blind according to claim 1, characterized in that: The back of the electronic terminal is provided with six tapping areas, namely three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index finger, middle finger and ring finger of the user's left hand respectively, and the three tapping areas on the right correspond to the index finger, middle finger and ring finger of the user's right hand respectively; When the user taps the back of the electronic terminal with a fingertip, the electronic terminal collects the voiceprint characteristics and tapping area information generated by the tapping action; The electronic terminal determines whether there is a correspondence between each collected voiceprint feature and the corresponding tapping area information. If there is a correspondence, the corresponding Braille symbol in six-dot Braille is obtained, and the corresponding text is found in the Braille symbol comparison table based on the Braille symbol, and the text is generated in the electronic terminal; if there is no correspondence, no operation is performed or the voice prompt indicates an error.
3. The text input method for the blind according to claim 1, characterized in that: When the tip of the user's left thumb and / or right thumb taps the front of the electronic terminal, the interval instruction is triggered.
4. A text input method for the blind according to claim 3, characterized in that: The voiceprint feature generated by tapping the front of the electronic terminal with the left thumb or the right thumb is pre-recorded into the electronic terminal and bound to the interval instruction.
5. The text input method for the blind according to claim 1, characterized in that: When the electronic terminal generates text, it plays the text in voice.
6. The text input method for the blind according to claim 1, characterized in that: The electronic terminal stores a cancel instruction, which is bound to a voiceprint feature generated when a user's left thumb or right thumb taps the front of the electronic terminal when the user holds the electronic terminal horizontally; When the user inputs text, after the electronic terminal generates the text, if the user taps the front of the electronic terminal with his left thumb or right thumb, it means canceling the input of the text; when the user's index finger, middle finger, or ring finger taps the back of the electronic terminal, if the electronic terminal receives a cancel command, it means canceling the previous tapping action.
7. An electronic terminal, characterized in that: include The microphone unit is used to collect the voiceprint characteristics when the index finger, middle finger, and ring finger of the user's hands tap the back of the electronic terminal when the user holds the electronic terminal horizontally; a storage unit for storing voiceprint features generated when the tips of the index, middle, and ring fingers of a user's two hands tap the back of the electronic terminal, and an association between the voiceprint features and six-dot Braille dot positions; the storage unit is further configured to store a Braille symbol comparison table for six-dot Braille, the Braille symbol comparison table storing Braille symbols and corresponding text; a decoding and analysis unit for analyzing the voiceprint features collected by the microphone unit and obtaining point information of the voiceprint features based on the correlation between the voiceprint features and the six-dot Braille points; the decoding and analysis unit is further configured to, upon receiving an interruption command, obtain Braille symbols based on the previously obtained point information corresponding to the voiceprint features, and search for corresponding text information based on a Braille symbol comparison table; The text generation unit is used to generate the text information obtained by the decoding and analysis unit in the electronic terminal.
8. The electronic terminal according to claim 7, characterized in that: The microphone unit is further used to collect voiceprint features when the user's left thumb and / or right thumb taps the front of the electronic terminal when the user holds the electronic terminal horizontally; the storage unit stores the voiceprint features when the left thumb and / or right thumb taps the front of the electronic terminal; When the decoding and analyzing unit analyzes the voiceprint feature collected by the microphone and obtains that the voiceprint feature is a voiceprint feature when the left thumb or the right thumb taps the front of the electronic terminal, the interruption instruction is triggered.
9. The electronic terminal according to claim 7, characterized in that: The electronic terminal also includes The sensor unit is used to collect vibration signals generated by six tapping areas on the back of the electronic terminal when the user taps the back of the electronic terminal with a fingertip; The six tapping areas are three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index finger, middle finger and ring finger of the user's left hand respectively, and the three tapping areas on the right correspond to the index finger, middle finger and ring finger of the user's right hand respectively; The judgment unit is used to compare the strength of the vibration signals generated by the six tapping areas, and determine that the tapping area with the strongest vibration signal is the user's tapping area this time; the judgment unit is also used to determine whether there is a correspondence between each collected voiceprint feature and the corresponding tapping area information. If there is a correspondence, the decoding and analysis unit is triggered to start; if there is no correspondence, no operation is performed or a voice prompt indicates an error.
10. The electronic terminal according to claim 7, characterized in that: The microphone unit is further used to collect voiceprint features when the user's left thumb and / or right thumb taps the front of the electronic terminal when the user holds the electronic terminal horizontally; the storage unit stores the voiceprint features when the left thumb and / or right thumb taps the front of the electronic terminal; When the decoding and analysis unit analyzes the voiceprint feature collected by the microphone and obtains that the voiceprint feature is a voiceprint feature when the left thumb or the right thumb taps the front of the electronic terminal, a cancel instruction is triggered; When the user inputs text, after the electronic terminal generates the text, if the user taps the front of the electronic terminal with his left thumb or right thumb, it means canceling the input of the text; when the user's index finger, middle finger, or ring finger taps the back of the electronic terminal, if the electronic terminal receives a cancel command, it means canceling the previous tapping action.
Citation Information
Patent Citations
Game instruction identification method and electronic terminal
CN116650951A