A method and terminal for synchronous English vocabulary learning based on Braille touch feedback

Abstract

This invention discloses a method and terminal for synchronous English vocabulary learning based on Braille tactile feedback, relating to the field of special education assistive technology. The method includes: real-time acquisition of trigger signals from the Braille touch button module, constructing a letter sequence cache and calculating the time interval between adjacent trigger signals; real-time comparison of the letter sequence with a preset vocabulary; determining word spelling input completion when a first preset condition is met, and determining continuous spelling when a second preset condition is met; when spelling input is determined to be complete, generating a synchronous control command to simultaneously drive a height-adjustable Braille dot matrix display module to perform dot-level lifting actions to form a raised Braille shape, and controlling a speech synthesis module to broadcast the pronunciation and definition of the word, achieving synchronous perception of tactile and auditory feedback; when continuous spelling is determined to be a continuous spelling process, only the letter name or phonetic symbol is broadcast. This achieves intelligent linkage between Braille touch input, dynamic Braille dot matrix output, and speech broadcasting, improving learning efficiency.

Description

Technical Field

[0001] This application relates to the field of special education assistive technology, specifically to a method and terminal for synchronous English vocabulary learning based on Braille touch feedback. Background Technology

[0002] Currently, English learning for the visually impaired mainly relies on traditional paper-based Braille textbooks, ordinary Braille displays, and general-purpose audio playback devices. Most existing Braille displays on the market are computer peripherals, focusing on converting electronic text into Braille for reading. They lack dedicated logic design for English word spelling training. Existing learning devices or displays typically rely on button confirmation, touchscreen clicks, or visual interfaces to trigger word searches or result displays. The user interface is not optimized for pure tactile feedback for blind students. When visually impaired students continuously input letters, they find it difficult to know when the system has completed word recognition, resulting in a disjointed user experience and low learning efficiency.

[0003] In existing devices, Braille display and voice broadcast are mostly independent modules. The timing coordination between the two lacks precise control, which can easily lead to a sensory asynchrony, such as touching before hearing or hearing before touching, thus affecting cognitive performance.

[0004] Therefore, there is an urgent need for an English vocabulary learning method and terminal that can realize synchronized Braille touch input, dynamic Braille dot matrix output and voice broadcasting, in order to solve the problems of visually impaired students having difficulty in English spelling, memorizing words and self-learning. Summary of the Invention

[0005] To address the aforementioned issues, this invention provides a method and terminal for synchronous English vocabulary learning based on Braille touch feedback.

[0006] In a first aspect, the present invention provides a method for synchronous English vocabulary learning based on Braille touch feedback, applied to a terminal device including a Braille touch button module, a height-adjustable Braille dot matrix display module, and a speech synthesis module, the method comprising: S1. Real-time acquisition of trigger signals from the Braille touch button module, construction of a cache of the currently input letter sequence, and calculation of the time interval between two adjacent trigger signals; S2. Compare the letter sequence with a preset dictionary in real time: When the first preset condition is met, it is determined that the user has completed the spelling input of the target word; the first preset condition is: the letter sequence completely matches at least one target word in the word library, or (the number of candidate words converges to a preset range and the time interval exceeds a preset first time threshold). When the second preset condition is met, it is determined that the spelling process is continuous; the second preset condition is: the letter sequence matches the prefix of at least one word in the dictionary, and the time interval does not exceed the preset first time threshold. S3. When the spelling input is determined to be complete, a synchronization control command is generated: The driver of the height-adjustable Braille dot matrix display module performs dot position raising and lowering actions, refreshing the display area to the Braille raised shape corresponding to the target word; The speech synthesis module is controlled to start the broadcast process and output the standard pronunciation and definition of the target word. The starting time of the point raising and lowering action and the starting time of the broadcast process are triggered by the same synchronous control command to achieve the perception synchronization of tactile feedback and auditory feedback. S4. When it is determined to be a continuous spelling process, only the speech synthesis module is controlled to broadcast the name or phonetic symbol of the currently input letter, and the adjustable Braille dot matrix display module is controlled not to present the Braille form of the complete word until the first preset condition described in S2 is met.

[0007] As a further limitation of the technical solution of the present invention, step S2 also includes: When the third preset condition is met, the input is determined to be invalid or in a reset state; the third preset condition is: the letter sequence does not match any valid word prefix, and the time interval exceeds the preset second time threshold, wherein the second time threshold is greater than the first time threshold; If any of the first, second, or third preset conditions is not met, the current state will be maintained and monitoring will continue. S5: When the input is determined to be invalid or in a reset state, the adjustable Braille dot matrix display module is controlled to perform a reset and clear action, and the voice synthesis module is controlled to broadcast the status reset prompt information.

[0008] When the letter sequence fails to match any valid word prefix and the time interval exceeds the second time threshold, the input is deemed invalid or the system is reset. This mechanism can identify scenarios such as users giving up spelling after making input errors or restarting after a long period of thought, thus preventing the system from waiting for a long time or responding incorrectly due to invalid input.

[0009] Visually impaired students can perceive the dot matrix falling back through touch and receive reset prompts through hearing, clearly knowing that the system status has been reset, making it easier to start spelling again, thus improving the certainty and controllability of the operation.

[0010] As a further limitation of the technical solution of the present invention, the same synchronization control instruction in S3 includes timing alignment parameters: Simultaneously, synchronous control commands are sent to the liftable Braille dot matrix display module and the speech synthesis module; Among them, a dot position lifting command is sent to the liftable Braille dot matrix display module, which carries the first timestamp parameter; The voice broadcast command sent to the speech synthesis module carries a second timestamp parameter; The value of the second timestamp parameter is configured to be equal to the first timestamp parameter plus a preset mechanical response delay compensation value. The difference between this compensation value and the physical time required for the liftable Braille dot matrix display module to complete the lifting action of all dots is within a preset error range.

[0011] The timing alignment mechanism can accurately compensate for the physical time required for the mechanical raising and lowering of the dot matrix module, ensuring that voice broadcasting starts precisely after the dot matrix is ​​fully raised, achieving millisecond-level perception synchronization. By presetting the mechanical response delay compensation value and adapting it according to the dot matrix raising and lowering speed of different hardware platforms, the same method can be applied to dot matrix display modules using different driving technologies, exhibiting good hardware compatibility and portability.

[0012] As a further limitation of the technical solution of the present invention, the preset first time threshold in S2 adopts a composite adaptive adjustment strategy, and the specific calculation steps include: Get the number of candidate words that match the current letter sequence in a pre-defined dictionary. It also calculates a personalized proficiency coefficient based on the user's historical time interval data using a moving average algorithm. ; wherein, the personalized proficiency coefficient Used to characterize the user's spelling speed The smaller the value, the higher the user's spelling proficiency; Set a base time threshold According to the number of candidate words The increasing weighting factor f(N) and the increasing number of proficiency coefficients Increasing and decreasing proficiency mapping function ; According to the formula Calculate the final first time threshold; in, ≥1, >0, making With the number of candidate words The length increases with the amount of time spent on spelling and decreases with the user's improved spelling proficiency.

[0013] By obtaining the number N of candidate words matching the current letter sequence and setting a weighting factor that increases with N, the system allows for a longer judgment waiting time when there are many candidate words, preventing premature misjudgment when the user inputs a long word; conversely, the system shortens the waiting time when there are few candidate words, achieving a faster response. This improves the accuracy of word judgment.

[0014] It can automatically adjust according to the user's learning progress, avoiding the pressure on beginners or the stagnation of experienced learners caused by fixed thresholds, thus improving user experience and learning efficiency. It can adapt to both differences in word characteristics and differences in user ability, making the judgment logic more intelligent and human-centered.

[0015] As a further limitation of the technical solution of the present invention, the method also includes an auxiliary learning step triggered by error frequency: When the frequency of a user's spelling errors for the same target word exceeds a preset number, the speech synthesis module adds the root word breakdown pronunciation or example sentences to the playback process of the target word.

[0016] Compared to the basic mode that only broadcasts word pronunciation and definition, the supplementary broadcast helps users understand word formation rules and contextual usage, fundamentally reducing spelling error rates. By identifying frequently misspelled words and automatically triggering supplementary learning, users do not need to manually mark incorrect questions or select learning modes. This achieves intelligent and personalized teaching intervention based on learning behavior data, reducing the tutoring burden on teachers or parents.

[0017] As a further limitation of the technical solution of the present invention, the terminal device also includes a vibration feedback module; while controlling the speech synthesis module to start the broadcast process in S3, it also includes a multimodal tactile enhancement step: The vibration feedback module is controlled to execute a micro-vibration mode synchronized with the voice broadcast timing; The vibration timing of the micro-vibration mode is precisely aligned with the timing of the dot lifting and lowering action of the liftable Braille dot matrix display module, thereby enhancing the user's perception of the completion of word spelling in the tactile dimension.

[0018] Compared to static tactile feedback relying solely on Braille dots, dynamic vibration feedback provides an additional tactile cue the moment a word is spelled, enhancing the clarity of event boundary perception. Voice prompts, Braille dots, and vibration feedback simultaneously act on the user's perceptual system, creating a redundancy enhancement effect. Even if one modality is insufficiently perceived due to environmental or individual differences, other modalities can still provide effective feedback, improving the robustness and universality of the interaction.

[0019] As a further limitation of the technical solution of the present invention, the reset and clearing action of the adjustable Braille dot matrix display module in S5 specifically includes: Obtain the current raised height of each Braille dot in the height-adjustable Braille dot matrix display module; Following a preset order from the edge to the center or from the center to the edge, each Braille dot is sequentially controlled to descend to the reference plane; After the reset and clearing action is completed, the voice synthesis module is controlled to play a prompt sound effect and enter a low-power monitoring mode until the next trigger signal of the Braille touch button module is detected.

[0020] The Braille dots are sequentially lowered to the reference plane in a preset order, either from the edge to the center or from the center to the edge. Compared to random control or simultaneous reset, this avoids instantaneous current peaks and mechanical stress concentrations generated during the reset process, reducing the impact on the drive circuit and mechanical structure, and effectively extending the lifespan of the liftable Braille dot matrix display module. After the reset is complete, it enters a low-power monitoring mode, only resuming normal operating power consumption when the next button trigger signal is detected. This effectively reduces energy consumption in standby mode, making it particularly suitable for use scenarios requiring long standby times, such as classroom teaching and home learning.

[0021] As a further limitation of the technical solution of the present invention, the preset lexicon stores vocabulary association data; the method also includes a context association assistance step: After determining that the user has completed the spelling input of the target word, the word association data is queried to obtain the high-frequency subsequent collocations of the target word as prediction candidates. The predicted candidates are cached in a temporary storage; When it is detected that the letter sequence entered by the user in the next spelling input matches the prefix of the predicted candidate, the first time threshold is shortened by a first percentage of the original threshold, and the adjustable Braille dot matrix display module is controlled to present part of the Braille form corresponding to the predicted candidate in advance.

[0022] This proactive prediction and early presentation strategy significantly reduces the waiting time for users to input subsequent letters, improves spelling fluency, and helps visually impaired students build semantic associations between words.

[0023] As a further limitation of the technical solution of the present invention, the method also includes an environment adaptive output step: During the execution of S3, the ambient noise level in decibels is monitored in real time. When the ambient noise level exceeds the preset noise threshold, the output volume of the speech synthesis module is automatically increased. Meanwhile, when the height-adjustable Braille dot matrix display module supports multi-level height adjustment, the number of dot matrix protrusion height levels is increased to enhance tactile recognition.

[0024] By monitoring the ambient noise level in decibels in real time, the system automatically increases the output volume of the speech synthesis module when the ambient noise exceeds a preset threshold, ensuring that visually impaired students can still clearly hear the pronunciation and meaning of words in noisy environments, thus improving the terminal's scene adaptability.

[0025] When the height-adjustable Braille dot matrix display module supports multi-level height adjustment, the number of dot matrix protrusion height levels is simultaneously increased. In noisy environments, this enhances tactile recognition to compensate for potential environmental interference with auditory feedback. This multimodal joint adaptive adjustment strategy enables both auditory and tactile feedback channels to adjust collaboratively according to environmental changes, ensuring stable and perceptible learning feedback in any environment.

[0026] Secondly, the technical solution of the present invention also provides an English vocabulary synchronous learning terminal based on Braille touch feedback, comprising: The Braille touch button module is used to receive the user's Braille touch input and generate a trigger signal; The adjustable Braille dot matrix display module is used to perform dot lifting and lowering actions under control to form the raised Braille shape corresponding to the word; The speech synthesis module is used to broadcast the standard pronunciation and definition of words under control. The main control module is electrically connected to the Braille touch button module, the liftable Braille dot matrix display module and the speech synthesis module, respectively, and the main control module is configured to execute the method described in the first aspect.

[0027] As can be seen from the above technical solutions, this application has the following advantages: Visually impaired students can obtain system response without pressing an additional confirmation key during continuous letter input, making the operation process more coherent and natural, and reducing the learning burden. The starting moment of the position raising and lowering action and the starting moment of the broadcast process are triggered by the same instruction, ensuring that the moment the user's fingertip touches the raised Braille shape and the moment the word is pronounced are highly synchronized, realizing an integrated learning experience of form-sound-meaning where touch is heard immediately, effectively solving the cognitive disconnect problem caused by the asynchronous tactile and auditory feedback in existing devices.

[0028] When the spelling process is determined to be continuous, only the name or phonetic symbol of the currently entered letter is announced, without displaying the complete Braille word. This differentiated response strategy avoids prematurely displaying the complete word before the spelling is finished, thus preventing interference with the user's independent spelling thought process. At the same time, it reduces unnecessary and frequent raising and lowering movements of the height-adjustable Braille dot matrix display module, lowers power consumption, and extends the module's lifespan. Attached Figure Description

[0029] To more clearly illustrate the technical solution of this application, the accompanying drawings used in the description will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 This is a flowchart illustrating the method provided in an embodiment of the present invention.

[0031] Figure 2 This is a connection block diagram of a terminal provided in an embodiment of the present invention. Detailed Implementation

[0032] To make the purpose, features, and advantages of this application more apparent and understandable, specific embodiments and accompanying drawings will be used to clearly and completely describe the technical solution protected by this application. Obviously, the embodiments described below are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0033] Unless otherwise defined, all technical and scientific terms used in this application have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used in this application and in the specification of this invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

[0034] like Figure 1 As shown, this embodiment of the invention provides a method for synchronous English vocabulary learning based on Braille touch feedback, applied to a terminal device including a Braille touch button module, a height-adjustable Braille dot matrix display module, and a speech synthesis module. The method includes: S1. Real-time acquisition of trigger signals from the Braille touch button module, construction of a cache of the currently input letter sequence, and calculation of the time interval between two adjacent trigger signals; In this embodiment of the invention, the main control module monitors the output signal line of the Braille touch button module in real time. When the user presses any Braille touch button, the main control module captures the high-level or low-level transition of the trigger signal and records the current button's identifier code and the trigger time.

[0035] The main control module stores the currently input letters in the letter sequence buffer according to the order they were pressed. The main control module also calculates the time interval between two consecutive trigger signals. Assume the first... The trigger time of this key press is , No. The trigger time for +1 key press is Then the time interval These time interval data are stored in a time interval cache queue for subsequent adaptive threshold calculation.

[0036] S2. Compare the letter sequence with a preset dictionary in real time: When the first preset condition is met, it is determined that the user has completed the spelling input of the target word; the first preset condition is: the letter sequence completely matches at least one target word in the word library, or (the number of candidate words converges to a preset range and the time interval exceeds a preset first time threshold). When the second preset condition is met, it is determined that the spelling process is continuous; the second preset condition is: the letter sequence matches the prefix of at least one word in the dictionary, and the time interval does not exceed the preset first time threshold. The main control module compares the string in the current letter sequence cache with the pre-set dictionary in real time. The pre-set dictionary is stored using a prefix tree data structure, which supports efficient prefix matching and word lookup.

[0037] The specific determination process is as follows: Determination of the first preset condition: The main control module checks whether the current letter sequence completely matches at least one target word in the dictionary. If the main control module finds that the string completely matches the target word in the dictionary, it immediately determines that the user has completed the spelling input of the word.

[0038] If a complete match is not yet achieved, the main control module will further perform the following operations: Count the number N candidate words that match the current letter sequence in the dictionary. A candidate word is any word that has the current letter sequence as a prefix. For example, if the current letter sequence is "RE", then all words in the dictionary that start with "RE" are candidate words, and let the number of such candidate words be N.

[0039] The main control module determines whether N converges to a preset range. In this embodiment, the preset range is N≤2, meaning the number of candidate words is less than or equal to 2. When N converges to the preset range, it indicates that the user is about to complete the spelling of the unique word, and the system enters the pending judgment state. At this time, the main control module obtains the time interval between two consecutive key presses. That is, the interval between the last key press and the previous key press, and whether this time interval exceeds a preset first time threshold. .

[0040] When both conditions are met—the number of candidate words converges to a preset range and the time interval exceeds a preset first time threshold—it is determined that the user has completed the spelling input of the target word. For example, after the user inputs "RECEPT," there may only be one candidate word, "RECEPTION" (N=1). If the user pauses for more than [time threshold], [the user is considered to have completed the spelling input of the target word]. If the system automatically determines that the user has completed the spelling input of "RECEPTION", then the system will automatically determine that the user has completed the spelling input of "RECEPTION". If so, it will continue to wait for the user to enter the next letter.

[0041] When N fails to converge to the preset range, it indicates that the current letter sequence has a large number of candidate words that can be matched, and the user needs to continue inputting to narrow down the candidate range. At this time, regardless of whether the time interval exceeds the first time threshold, the system does not determine that the spelling input is complete, but maintains the continuous spelling process (i.e., executes step S4), waiting for the user to continue inputting subsequent letters until N converges to the preset range or a complete match occurs.

[0042] It should be noted that the preset range N≤2 in this embodiment is only an example. In actual applications, it can be adjusted to other thresholds according to the size of the dictionary and the user's proficiency. The smaller the preset range, the more conservative the judgment and the less likely it is to be misjudged; the larger the preset range, the more aggressive the judgment and the faster the response.

[0043] Determination of the second preset condition: The main control module checks whether the current letter sequence matches the prefix of at least one word in the dictionary, meaning the current letter sequence is the beginning of a word, and also determines the time interval of the most recent key press. Has the preset first time threshold not been exceeded? When both conditions are met, the user is determined to be in a continuous spelling process.

[0044] In some embodiments, the method further includes: determining a third preset condition. The main control module checks whether the current letter sequence does not match any valid word prefix, meaning that the current letter sequence does not have a corresponding word in the dictionary. At the same time, it determines whether the time interval between the most recent key press exceeds a preset second time threshold. In this embodiment of the invention, it is set to 3 seconds.

[0045] When both conditions are met, the input is deemed invalid or the system enters a reset state. For example, if a user inputs the letter combination "XYZ," which does not exist in the dictionary, and stops inputting for more than 3 seconds, the system determines that the user has abandoned the current input and enters a reset state.

[0046] If none of the above preset conditions are met, such as a prefix being matched but the time interval being exactly equal to the threshold, the current state will be maintained and monitoring will continue without clearing the cache or triggering feedback.

[0047] S3. When the spelling input is determined to be complete, the main control module generates a synchronization control command and performs the following operations: The main control module retrieves the Braille dot matrix code data corresponding to the target word from the storage unit. For example, the Braille dot matrix code corresponding to the target word "RECEPTION" is a series of 6-bit binary numbers, where each bit corresponds to the position of a dot matrix pin, where 1 indicates rising and 0 indicates falling.

[0048] The main control module sends dot-raising and lowering commands to the height-adjustable Braille dot matrix display module via a parallel or serial interface. These commands specify which dot matrix pins need to be raised and which need to be lowered. Upon receiving the commands, the drive circuit of the height-adjustable Braille dot matrix display module controls the corresponding electromagnetic drive unit to be energized or de-energized, causing the dot matrix pins to complete the raising and lowering of all dots within a set time, forming a raised Braille array of the target word.

[0049] The main control module simultaneously sends voice playback commands and playback text to the speech synthesis module. The playback text includes the standard pronunciation, phonetic transcription, and Chinese definition of the target word. After receiving the command, the speech synthesis module starts the playback process and outputs the voice through the speaker.

[0050] The start time of the point raising / lowering action and the start time of the broadcast process are triggered by the same synchronization control command. Specifically, when the main control module generates the synchronization control command, it simultaneously sends execution signals to both modules to ensure that the two actions are aligned in timing.

[0051] To compensate for the mechanical response delay of the height-adjustable Braille dot matrix display module, the main control module includes timing alignment parameters. Synchronous control commands are sent simultaneously to both the height-adjustable Braille dot matrix display module and the speech synthesis module. The dot matrix module's dot position raising / lowering command carries a first timestamp parameter. The voice broadcast command sent to the voice module carries a second timestamp parameter. . Configured to equal Add the preset mechanical response delay compensation value . The physical time required for the dot matrix module to complete the lifting action of all points The difference is within the preset error range.

[0052] Through the aforementioned timing alignment mechanism, the moment a user's fingertip touches the raised Braille dot matrix is ​​highly synchronized with the moment they hear the word's pronunciation, achieving a sensory synchronization experience where touching is equivalent to hearing.

[0053] S4. When S2 determines that the spelling process is continuous, the main control module performs the following operations: The main control module controls the speech synthesis module to read out the name or phonetic symbol of the currently input letter. The reading is done letter by letter, with each letter's reading time not exceeding 0.3 seconds.

[0054] The main control module controls the height-adjustable Braille dot matrix display module to prevent it from displaying complete Braille words. That is, it maintains the current display state, possibly displaying the Braille of the previous word, or keeping it flat to avoid displaying incomplete Braille due to partial input, thus preventing user interference. This step continues until the first preset condition described in S2 is met, at which point it proceeds to S3 to perform synchronous feedback.

[0055] S5: When the input is determined to be invalid or in a reset state, the adjustable Braille dot matrix display module is controlled to perform a reset and clear action, and the voice synthesis module is controlled to broadcast a status reset prompt. Further details on the reset and clear action are provided below.

[0056] When an input is deemed invalid or in a reset state, the main control module controls the height-adjustable Braille dot matrix display module to perform a reset and clearing action. Specifically, this includes: (1) The main control module obtains the current lifting height status of each Braille dot by reading the Hall sensor or photoelectric sensor of each dot matrix needle drive unit.

[0057] (2) The main control module controls each Braille dot to descend to the reference plane in a preset order. This embodiment provides two sequence modes: From edge to center: Prioritize resetting the dot matrix pins located at the edge of the display area, and gradually move towards the center; From center to edge: Prioritize resetting the dot matrix pins located in the center of the display area, and gradually expand towards the edge.

[0058] The preset sequence can be selected by the user via function keys, or automatically selected by the system based on the currently displayed content. Ordered reset, compared to simultaneous reset, avoids instantaneous current peaks and mechanical stress concentrations generated during the reset process of the dot matrix pin group, reducing the impact on the drive circuit and mechanical structure.

[0059] (3) After the reset and clearing action is completed, the main control module controls the speech synthesis module to play a prompt sound effect to inform the user that the system has been reset. Subsequently, the main control module enters a low-power monitoring mode: the main control module frequency is reduced to the lowest operating frequency, unnecessary peripherals are turned off, and only the detection circuit of the Braille touch button module is kept in working state.

[0060] In low-power monitoring mode, the system standby current can be reduced to less than 10% of the normal operating current. When the next trigger signal from the Braille touch button module is detected, the main control module immediately exits the low-power mode, restores the normal operating frequency and peripheral power supply, and prepares to receive new spelling input.

[0061] In some embodiments, the preset first time threshold mentioned in S2 is not a fixed value, but is dynamically calculated using a composite adaptive adjustment strategy. The specific calculation steps include: The main control module obtains the number N of candidate words matched by the current letter sequence in a preset dictionary. In this embodiment of the invention, the count is performed using prefix matching. The more candidate words there are, the more possible target words the user is currently inputting. The system should provide a longer judgment waiting time to avoid misjudgment before the user has completed the full word input.

[0062] Quantity weighting factor Defined as a function that increases with N, this embodiment uses the following linear function: When N=1, f(1)=1.0; When N=2, f(2)=1.2; When N=3, f(3)=1.4; When N≥4, f(N)=1.6; The above values ​​are based on experimental data from 30 visually impaired students: when N=1, the average interval between the last keystroke is 0.72 seconds, which serves as the baseline, f(1)=1.0; when N=2, it is 0.86 seconds (ratio of 1.19 to the baseline); when N=3, it is 0.98 seconds (ratio of 1.36 to the baseline); and when N≥4, it approaches 1.15 seconds (ratio of approximately 1.60 to the baseline). f(N) increases with N, allowing the system to provide a longer judgment waiting time when there are many candidate words, thus avoiding misjudgment before the user has completed the complete word input.

[0063] The main control module calculates personalized proficiency coefficients based on a moving average algorithm. The main control module maintains a time interval history queue of length L, storing the average keystroke interval time of the user's most recent L spelling attempts. In this embodiment, L=10. Let the reference time interval be... =0.5 seconds, representing the standard value for an intermediate proficiency level. This is calculated as the average interval between all adjacent keystrokes during the word input process, after each word is spelled. Add the data to the time interval history queue and remove the oldest data. Then calculate the average of all current values ​​in the queue. ,but . A smaller value indicates a higher level of spelling proficiency among users. A higher value indicates a lower level of proficiency.

[0064] Proficiency mapping function Using a linearly decreasing function: and limited The value range is [0.5, 1.5]. This adjustment coefficient =0.3, determined based on user experiments, can ensure response speed while avoiding excessive threshold fluctuations. Let the base time threshold be... =0.5 seconds. According to the formula Calculate the final first time threshold; in, ≥1, >0, making With the number of candidate words The length increases with the amount of time spent on spelling and decreases with the user's improved spelling proficiency.

[0065] It should be noted that the above numerical values ​​and function forms are merely examples, and those skilled in the art can adjust them according to actual application scenarios. and Make adaptive adjustments.

[0066] In some embodiments, the method further includes an auxiliary learning step triggered by error frequency: After each spell input judgment, the main control module compares the actual letter sequence entered by the user with the target word. If they do not match, the main control module records the error information, including: the target word, the incorrect sequence entered by the user, and the timestamp of the error.

[0067] The main control module maintains an error counter, accumulating the number of errors for each target word. When the error frequency of a word exceeds a preset number, the main control module marks the word as a high-frequency error. When this word is subsequently invoked, the main control module adds auxiliary playback content to the basic playback process of the speech synthesis module. Auxiliary playback includes, but is not limited to, word root decomposition pronunciation and example sentence playback.

[0068] Through the aforementioned learning assistance mechanisms, users can understand the word formation rules and contextual usage of words, thereby fundamentally reducing the spelling error rate.

[0069] In some embodiments, the terminal device also includes a separate vibration feedback module. The vibration feedback module includes an eccentric vibration motor or a linear resonator, which is electrically connected to the main control module.

[0070] In step S3, the main control module controls the speech synthesis module to start the broadcast process while simultaneously controlling the vibration feedback module to execute a micro-vibration mode synchronized with the speech broadcast timing. Specifically: The vibration timing is precisely aligned with the completion of the dot raising and lowering action of the adjustable Braille dot matrix display module. That is, the vibration feedback module generates a brief vibration lasting 100 to 200 milliseconds the instant that all the dot matrix pins are raised to their highest position.

[0071] The vibration intensity is configurable; in this embodiment, it is set to medium intensity, approximately 0.5G to 1.0G acceleration.

[0072] Through vibration feedback, as users touch the Braille dots with their fingers, their palms or fingers also feel a momentary vibration, further enhancing their perception of the moment when the spelling of a word is completed. The synergistic feedback of auditory, dot matrix, and vibrational tactile sensations creates a redundancy enhancement effect, so that even if one modality is not fully perceived due to environmental or individual differences, other modalities can still provide effective feedback.

[0073] In some embodiments, the pre-set lexicon stores vocabulary association data; this data can be pre-established through corpus statistics or obtained through cloud updates. The method also includes a context association assistance step. After the spell input determination is completed in step S3, the main control module performs the following operations: (1) The main control module queries the word association data to obtain the high-frequency subsequent collocations of the current target word as prediction candidates.

[0074] (2) The main control module caches the predicted candidates in a temporary storage.

[0075] (3) When the main control module detects that the letter sequence entered by the user in the next spelling input matches the prefix of the predicted candidate, the following optimization is performed: The first time threshold is shortened to 50% to 80% of the original threshold, achieving a faster judgment and response; The adjustable Braille dot matrix display module can be controlled to present the partial Braille form corresponding to the predicted candidate in advance, such as the raised Braille form corresponding to the first letter or first syllable.

[0076] The above-mentioned context association assistance steps reduce the waiting time for users to input subsequent letters, improve spelling fluency, and help visually impaired students establish semantic associations between words.

[0077] In some embodiments, the terminal device further includes an environmental monitoring module. The environmental monitoring module includes a microphone and audio processing circuitry, used to collect ambient sound signals in real time and calculate the ambient noise level in decibels. Specifically, the calculation method involves collecting an ambient sound sample lasting 100 milliseconds, calculating its root mean square amplitude, and converting it to a decibel value.

[0078] The main control module receives real-time ambient noise decibel values ​​reported by the environmental monitoring module. When the decibel value exceeds a preset noise threshold, the main control module automatically increases the output volume of the speech synthesis module.

[0079] Volume adjustment uses a tiered strategy: 60 dB ≤ Decibels < 70 dB: Increase volume by 20%; 70 dB ≤ decibel value < 80 dB: Volume increased by 40%; A decibel level of ≥80 decibels: increases volume by 60%; When the height-adjustable Braille dot matrix display module supports multi-level height adjustment, the main control module synchronously increases the height of the dot matrix protrusions according to the ambient noise level in decibels. The height adjustment mapping relationship is as follows: Decibels <60: Low-end; 60 dB ≤ decibel value < 70 dB: Medium range; Decibel level ≥ 70 decibels: High-end; Through the above-mentioned environmental adaptive adjustment, in noisy environments, users can not only hear voice feedback clearly through enhanced volume, but also obtain stronger tactile recognition through higher dot matrix protrusions to compensate for environmental interference that may affect auditory feedback.

[0080] like Figure 2 As shown, this embodiment of the invention also provides an English vocabulary synchronous learning terminal based on Braille touch feedback, including: The Braille touch button module is used to receive the user's Braille touch input and generate a trigger signal; In this embodiment of the invention, the Braille touch button module is disposed on the upper surface of the terminal device housing and includes at least 26 Braille touch buttons, corresponding to the English letters A to Z respectively. Each button surface has raised Braille markings; for example, the button surface corresponding to the letter "A" has Braille dots. The key corresponding to the letter "B" has Braille dots on its surface. And so on. Each key is arranged according to the standard English keyboard layout or alphabetical order, and there is a tactile differentiation interval between adjacent keys. In this embodiment of the invention, a recessed or raised ridge line of 0.5mm to 1mm is provided so that visually impaired users can accurately locate the required key by touching it with their fingers without visual assistance.

[0081] Each Braille touch button contains a mechanical switch or a capacitive touch sensor. When a user presses a button, a trigger signal is sent to the main control module. The trigger signal includes at least a button identification code to distinguish which letter button it is and information on the duration of the press.

[0082] The adjustable Braille dot matrix display module is used to perform dot lifting and lowering actions under control to form the raised Braille shape corresponding to the word; The height-adjustable Braille dot matrix display module is located on the upper surface of the terminal device housing, adjacent to the Braille touch button module. This module includes at least one set of Braille character display units, each set of display units containing 6 dot matrix pins arranged in a 2-column × 3-row matrix, consistent with the dot layout of standard Braille characters.

[0083] Each dot matrix pin is controlled by an independent electromagnetic drive unit. The electromagnetic drive unit includes an electromagnetic coil, an iron core, a return spring, and a guide sleeve. When the main control module sends a lift command to the electromagnetic drive unit, the electromagnetic coil is energized, generating electromagnetic force that drives the iron core to move the dot matrix pin upwards along the guide sleeve, causing the pin to protrude 0.3mm to 0.8mm above the display panel surface, forming tactile Braille dots. When the main control module sends a fall command or power is cut off, the electromagnetic force disappears, and the return spring drives the dot matrix pin back to its initial position, making it flush with or below the display panel surface.

[0084] The lifting response time of each dot matrix needle is less than 50 milliseconds, and the lifting height of the dot matrix needle can be configured with multiple levels. In this embodiment of the invention, three levels are set: low level 0.3mm, medium level 0.5mm, and high level 0.7mm, to adapt to the tactile sensitivity of different users.

[0085] The speech synthesis module is used to broadcast the standard pronunciation and definition of words under control. The speech synthesis module includes a speech synthesis chip (such as SYN6658 or XF-S4240), a power amplifier, and a speaker. The speech synthesis module is electrically connected to the main control module, receiving broadcast commands and text content from the main control module, and converting the text content into natural and fluent speech output. The speech synthesis module supports standard pronunciation of English words, phonetic transcription, letter name playback, and Chinese definition playback. The specific circuitry can be implemented using existing connection methods.

[0086] The main control module is electrically connected to the Braille touch button module, the height-adjustable Braille dot matrix display module, and the speech synthesis module, respectively. The main control module employs an embedded microcontroller. It has a built-in or external storage unit storing a preset vocabulary, including a basic English vocabulary database, a vocational college professional English vocabulary database, and a user-defined vocabulary database. The main control module also includes a timer unit for calculating the time interval between two adjacent button trigger signals, with millisecond-level accuracy. The main control module is configured to execute the methods described in the above embodiments.

[0087] The terminal device in this embodiment can be powered by a built-in rechargeable lithium battery. The casing features a rounded, non-slip design and is sized for handheld use, making it suitable for placement on classroom desks and for carrying around.

[0088] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for synchronous English vocabulary learning based on Braille touch feedback, applied to a terminal device including a Braille touch button module, a height-adjustable Braille dot matrix display module, and a speech synthesis module, characterized in that, The method includes: S1. Real-time acquisition of trigger signals from the Braille touch button module, construction of a cache of the currently input letter sequence, and calculation of the time interval between two adjacent trigger signals; S2. Compare the letter sequence with a preset dictionary in real time: When the first preset condition is met, it is determined that the user has completed the spelling input of the target word; the first preset condition is: the letter sequence completely matches at least one target word in the word library, or the number of candidate words converges to a preset range and the time interval exceeds a preset first time threshold. When the second preset condition is met, it is determined that the spelling process is continuous; the second preset condition is: the letter sequence matches the prefix of at least one word in the dictionary, and the time interval does not exceed the preset first time threshold. S3. When the spelling input is determined to be complete, a synchronization control command is generated: The driver of the height-adjustable Braille dot matrix display module performs dot position raising and lowering actions, refreshing the display area to the Braille raised shape corresponding to the target word; The speech synthesis module is controlled to start the broadcast process and output the standard pronunciation and definition of the target word. The starting time of the point raising and lowering action and the starting time of the broadcast process are triggered by the same synchronous control command to achieve the perception synchronization of tactile feedback and auditory feedback. S4. When it is determined to be a continuous spelling process, only the speech synthesis module is controlled to broadcast the name or phonetic symbol of the currently input letter, and the adjustable Braille dot matrix display module is controlled not to present the Braille form of the complete word until the first preset condition described in S2 is met.

2. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 1, characterized in that, Step S2 also includes: When the third preset condition is met, the input is determined to be invalid or in a reset state; the third preset condition is: the letter sequence does not match any valid word prefix, and the time interval exceeds the preset second time threshold, wherein the second time threshold is greater than the first time threshold; If any of the first, second, or third preset conditions is not met, the current state will be maintained and monitoring will continue. S5: When the input is determined to be invalid or in a reset state, the adjustable Braille dot matrix display module is controlled to perform a reset and clear action, and the voice synthesis module is controlled to broadcast the status reset prompt information.

3. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 1, characterized in that, The same synchronization control instruction described in S3 contains timing alignment parameters: Simultaneously, synchronous control commands are sent to the liftable Braille dot matrix display module and the speech synthesis module; Among them, a dot position lifting command is sent to the liftable Braille dot matrix display module, which carries the first timestamp parameter; The voice broadcast command sent to the speech synthesis module carries a second timestamp parameter; The value of the second timestamp parameter is configured to be equal to the first timestamp parameter plus a preset mechanical response delay compensation value. The difference between this compensation value and the physical time required for the liftable Braille dot matrix display module to complete the lifting action of all dots is within a preset error range.

4. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 1, characterized in that, The preset first time threshold mentioned in S2 adopts a composite adaptive adjustment strategy, and the specific calculation steps include: Get the number of candidate words that match the current letter sequence in a pre-defined dictionary. It also calculates a personalized proficiency coefficient based on the user's historical time interval data using a moving average algorithm. ; wherein, the personalized proficiency coefficient Used to characterize the user's spelling speed The smaller the value, the higher the user's spelling proficiency; Set a base time threshold According to the number of candidate words The increasing and incremental quantity weighting factor and with proficiency coefficient Increasing and decreasing proficiency mapping function ; According to the formula Calculate the final first time threshold; in, ≥1, >0, making With the number of candidate words The length increases with the amount of time spent on spelling and decreases with the user's improved spelling proficiency.

5. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 4, characterized in that, The method also includes an auxiliary learning step triggered by error frequency: When the frequency of a user's spelling errors for the same target word exceeds a preset number, the speech synthesis module adds the root word breakdown pronunciation or example sentences to the playback process of the target word.

6. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 1, characterized in that, The terminal device also includes a vibration feedback module; while controlling the speech synthesis module to start the broadcast process in S3, it also includes a multimodal haptic enhancement step: The vibration feedback module is controlled to execute a micro-vibration mode synchronized with the voice broadcast timing; The vibration timing of the micro-vibration mode is precisely aligned with the timing of the dot lifting and lowering action of the liftable Braille dot matrix display module, thereby enhancing the user's perception of the completion of word spelling in the tactile dimension.

7. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 2, characterized in that, The S5 controls the retractable Braille dot matrix display module to perform a reset and clearing action, specifically including: Obtain the current raised height of each Braille dot in the height-adjustable Braille dot matrix display module; Following a preset order from the edge to the center or from the center to the edge, each Braille dot is sequentially controlled to descend to the reference plane; After the reset and clearing action is completed, the voice synthesis module is controlled to play a prompt sound effect and enter a low-power monitoring mode until the next trigger signal of the Braille touch button module is detected.

8. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 1, characterized in that, The pre-set lexicon stores vocabulary association data; the method also includes a context association assistance step: After determining that the user has completed the spelling input of the target word, the word association data is queried to obtain the high-frequency subsequent collocations of the target word as prediction candidates. The predicted candidates are cached in a temporary storage; When it is detected that the letter sequence entered by the user in the next spelling input matches the prefix of the predicted candidate, the first time threshold is shortened by a first percentage of the original threshold, and the adjustable Braille dot matrix display module is controlled to present part of the Braille form corresponding to the predicted candidate in advance.

9. The method for synchronous English vocabulary learning based on Braille tactile feedback according to claim 1, characterized in that, The method also includes an environment-adaptive output step: During the execution of S3, the ambient noise level in decibels is monitored in real time. When the ambient noise level exceeds the preset noise threshold, the output volume of the speech synthesis module is automatically increased. Meanwhile, when the height-adjustable Braille dot matrix display module supports multi-level height adjustment, the number of dot matrix protrusion height levels is increased to enhance tactile recognition.

10. A synchronous English vocabulary learning terminal based on Braille touch feedback, characterized in that, include: The Braille touch button module is used to receive the user's Braille touch input and generate a trigger signal; The adjustable Braille dot matrix display module is used to perform dot lifting and lowering actions under control to form the raised Braille shape corresponding to the word; The speech synthesis module is used to broadcast the standard pronunciation and definition of words under control; The main control module is electrically connected to the Braille touch button module, the liftable Braille dot matrix display module and the speech synthesis module, respectively, and the main control module is configured to perform the method described in any one of claims 1-9.

Images