Portable intelligent braille dot matrix display device
The portable intelligent Braille dot matrix display device addresses the limitations of traditional Braille books and existing display devices by using a nickel-titanium memory alloy wire and metal spring probe with integrated interaction modules, offering a compact, reliable, and cost-effective solution for blind users to access diverse content.
Patent Information
- Application Number
- CN202322902562.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-28
- Publication Date
- 2024-12-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Traditional Braille books are cumbersome, costly, and limited in availability, leading to difficulties in reading and accessing diverse content for the blind, and existing Braille dot matrix display devices are large, costly, and lack practicality and economy.
A portable intelligent Braille dot matrix display device driven by an intelligent electronic system using a nickel-titanium memory alloy wire and metal spring probe, integrated with modules for voice, motion, and fingerprint interaction, and a compact mechanical structure for displaying Braille characters.
The device provides a convenient, diverse, and environmentally friendly way for blind users to access rich text content, enhancing reading experience with miniaturization, reliability, and cost-effectiveness, and supports barrier-free interaction methods.
Smart Images

Figure CN222106121U_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a portable intelligent Braille dot matrix display device. Background Art
[0002] Traditional Braille reading relies on paper Braille books. However, paper Braille books have the disadvantages of long compilation and printing cycles, high difficulty and high cost, which further leads to their limited stock and are often concentrated in public libraries and special education schools. These problems have brought certain difficulties to the borrowing of books by the blind. Paper Braille books also have the disadvantages of high storage requirements and short service life. Due to its material limitations, after a period of touch reading, such books often cause the dots to wear out due to skin friction, sweat infiltration, etc., making it difficult to continue reading. Traditional paper Braille books are also difficult to include a wide range of popular reading materials, making it difficult for the blind to obtain the latest news through text in a timely manner, and it is difficult to break through the restrictions on the selection of reading materials.
[0003] In view of the defects of paper Braille books, if an electronic system is used to drive the mechanical structure for Braille display, the reading experience of the blind can be greatly improved. In recent years, many research teams at home and abroad have explored Braille dot matrix display devices, but due to the lack of practicality and economy of the products, the above teams have not been able to promote their products to the market.
[0004] At present, the research on Braille dot matrix display equipment is mainly focused on the driving method of Braille contacts. The current mainstream Braille contact driving methods include: piezoelectric ceramic, electromagnetic, memory alloy, physical state change, pneumatic, etc. The Braille contact driving unit requires a simple structure, fast response, high reliability, easy processing, and low cost. In order to meet the needs of portable use of the equipment, the driving unit is also required to be small in size, light in weight, easy to control, and low in energy consumption.
[0005] Among traditional Braille dot matrix display devices, those that use piezoelectric ceramics to drive Braille contacts generally have the disadvantage of being too costly; and those that use electromagnetic, electrothermal, pneumatic, and other methods to drive Braille contacts generally have the disadvantages of being large in size and not very durable. Utility Model Content
[0006] In order to overcome the shortcomings of the existing Braille dot matrix display devices, such as large size, high cost, low intelligence, single interaction mode, and shortage of reading resources, the utility model provides a portable intelligent Braille dot matrix display device driven by an intelligent electronic system and based on a new mechanical structure of nickel-titanium memory alloy wire for Braille display. The device interacts with blind users in a barrier-free manner, has high practicality, ease of use, and economy, and can improve the reading experience of blind users as a whole.
[0007] The technical solution adopted by the utility model to solve the technical problem is: a portable intelligent Braille dot matrix display device, which is composed of a control module, a character display module, a battery and power management module, an insulating panel, a Braille button, a heat dissipation system, a device shell and other parts.
[0008] In the first aspect, an embodiment of the utility model provides an intelligent electronic system for driving a braille dot matrix display device. The intelligent electronic system is mainly carried by the control module described in the above-mentioned portable intelligent braille dot matrix display device, and the control module is composed of a control circuit board, a microcontroller module, a speech recognition and calculation module, a speech synthesis module, a display module state acquisition module, an inertial sensor module, a fingerprint recognition module, a storage module, a wireless transmission and audio codec module, a near-field communication module, a frequency modulation receiving module and a plurality of interfaces and related circuits. The submodules of the control module are integrated on the main body of the control circuit board, and inter-module communication is realized through the circuit carried by the control circuit board. The control module is generally in the shape of a flat rectangular parallelepiped.
[0009] The control module mentioned above, the control circuit board is a printed circuit board, the printed circuit board is composed of a glass fiber substrate, a double-layer copper foil layer, and a solder resist layer, and is used to carry the circuit and each sub-module of the control module.
[0010] The control module mentioned above, the microcontroller module schedules the use of each submodule of the control module. The microcontroller module is mainly composed of a main control microcontroller, which reads and processes the data in the storage module in SPI mode. The main control microcontroller communicates with the voice recognition and calculation module in UART mode to realize voice command control and transmission of calculation results. The main control microcontroller communicates with the speech synthesis module in UART mode, transmits Chinese character encoding information to realize offline text-to-speech conversion. The main control microcontroller communicates with the display module in GPIO mode, and transmits binary Braille code information to the display module. The main control microcontroller communicates with the display module status acquisition module in I2C mode to obtain the user's finger touch position information output by the touch chip of the display module to realize finger position recognition. The main control microcontroller also obtains the temperature and other information of the display module in this way.
[0011] The control module and the speech recognition and calculation module above complete the speech command recognition by running the deep neural network model, generate the response speech and output it through the speaker or headphone interface; by running the action recognition algorithm based on the dynamic time warping algorithm, the action recognition calculation of the data collected by the inertial sensor module is completed. The speech recognition and calculation module communicates with the microcontroller module in UART mode to realize the transmission of voice command control and calculation results. The speech recognition and calculation module communicates with the inertial sensor module in I2C mode, realizes action recognition by collecting acceleration data and running the action recognition algorithm. The speech recognition and calculation module communicates with the fingerprint recognition module in UART mode, and realizes fingerprint-based quick operation by binding different fingerprints to specific operations according to the principle that the fingerprints of each user's fingers are different. The speech recognition and calculation module is correspondingly connected with a microphone, a speaker, and a headphone interface.
[0012] The control module and the speech synthesis module complete the offline text-to-speech conversion by running the speech synthesis model. The speech synthesis module communicates with the microcontroller module in UART mode and performs speech synthesis by receiving the text character encoding output by the microcontroller module. The speech synthesis module is also connected to a speaker and a headphone interface accordingly.
[0013] The control module and the display module status acquisition module are mainly composed of an auxiliary single chip microcomputer. The auxiliary single chip microcomputer reads the contact information of the touch chip in the display module through I2C to obtain the touch information of each point of the display module. The auxiliary single chip microcomputer reads the information of multiple temperature sensors of the display module through a single bus. The display module status acquisition module communicates with the microcontroller module through the UART method and transmits the status information of each display module to the microcontroller module.
[0014] The control module and the inertial sensor module collect the three-axis gyroscope signal and the three-axis acceleration signal, and hand them over to the voice recognition and calculation module for action recognition and calculation, so that the user can complete the action command quick operation by holding the portable intelligent braille dot matrix display device. The inertial sensor module communicates with the voice recognition and calculation module in I2C mode for data transmission.
[0015] The control module and the fingerprint recognition module obtain the fingerprint image to be recognized by optical fingerprint acquisition, analyze the fingerprint features and compare them with the pre-stored target fingerprint features, and finally output the comparison results. The fingerprint recognition module communicates with the voice recognition and calculation module in UART mode. The latter obtains the comparison results of the fingerprint recognition module and realizes fingerprint-based quick operations by binding different fingerprints to specific operations based on the principle that the fingerprints of each finger of the user are different.
[0016] The control module and the storage module are composed of an SD card, a U disk, an SD card file management control chip, and a high-speed analog switch chip. The SD card of the storage module is connected to the high-speed analog switch chip, and the main control microcontroller controls the analog switch to control the SD card to be connected to the U disk and the SD card file management control chip or the wireless transmission module, respectively realizing the functions of the microcontroller reading and writing U disk or SD card files and wirelessly reading and writing SD card files. The storage module realizes the switching between the two modes of connecting the braille dot matrix display device as a slave to a computer or connecting the braille dot matrix display device as a host to a USB storage device through the high-speed analog switch chip.
[0017] The control module and the wireless transmission and audio codec module communicate with computers, mobile phones and other devices wirelessly through Wi-Fi and Bluetooth to complete file transmission. The wireless transmission and audio codec module reads and writes data in the SD card in the storage module in SPI mode, and cooperates with the file management system to add, modify and delete files in the SD card. The wireless transmission and audio codec module is also connected to the audio output chip to achieve multi-channel audio output.
[0018] The control module and the near field communication module can realize the functions of device pairing and data transmission by identifying the electronic tags of other devices, and communicate with the display module status acquisition module through SPI. The control module and the FM receiving module can realize the radio function by receiving FM signals.
[0019] The above-mentioned control module, the multiple interfaces include a charging interface, a USB-A interface, a 3.5mm headphone interface, a speaker interface, a display module interface, a screen interface, a battery pack interface, a vibration motor interface, a button interface, etc.
[0020] In a possible design, the above-mentioned control module, the microcontroller module is composed of the STC32G12K128 single-chip microcomputer chip of Shenzhen Hongjing Technology Co., Ltd., the CH340 USB-to-serial port chip of Nanjing Qinheng Microelectronics Co., Ltd., an external crystal oscillator, a flash memory chip and surrounding circuits.
[0021] In a possible design, the above-mentioned control module and the speech recognition and calculation module are composed of an ASRPRO speech recognition chip, an audio power amplifier and surrounding circuits produced by Hangzhou Tianwen Wuyao Technology Co., Ltd.
[0022] In a possible design, the above-mentioned control module and the speech synthesis module are composed of the SNR9816 speech synthesis chip of Shantou Xinnajie Technology Co., Ltd., an external crystal oscillator, a flash memory chip, an audio power amplifier and surrounding circuits.
[0023] In a possible design, the above-mentioned control module and the display module status acquisition module are composed of a CH32v003F4P6 single-chip microcomputer chip of Nanjing Qinheng Microelectronics Co., Ltd., a TCA9548APWR I2C multiplexer of Texas Instruments, and surrounding circuits.
[0024] In a possible design, the control module and the inertial sensor module are composed of a QMI8658 six-axis inertial sensor chip produced by Shanghai Si Rui Technology Co., Ltd. and surrounding circuits.
[0025] In a possible design, the above-mentioned control module and the fingerprint recognition module are composed of the AS608 fingerprint recognition chip, image sensor and surrounding circuits of Hangzhou Shengyuan Chip Technology Co., Ltd.
[0026] In one possible design, the above-mentioned control module and the storage module are composed of a ZDSD32GLGEAG type surface-mount SD card of Suzhou Lanzhi Integrated Circuit Co., Ltd., a CH376T type USB flash drive and SD card file management control chip of Nanjing Qinheng Microelectronics Co., Ltd., a CH442 type low-resistance analog switch chip of Nanjing Qinheng Microelectronics Co., Ltd., a CH440 type low-resistance analog switch chip of Nanjing Qinheng Microelectronics Co., Ltd. and surrounding circuits.
[0027] In a possible design, the above-mentioned control module and the wireless transmission and audio codec module are ESP32S dual-core WiFi-Bluetooth modules produced by Shenzhen Anxinke Technology Co., Ltd.
[0028] In one possible design, the control module and the near field communication module are composed of the MFRC522 radio frequency card chip and surrounding circuits of Shenzhen Jieshengwei Semiconductor Co., Ltd. In one possible design, the control module and the FM receiving module are composed of the TEA5767 module.
[0029] In a possible design, the above-mentioned control module, the multiple interfaces include a Type-C charging interface, a Type-A data transmission interface, and a 3.5mm headphone interface.
[0030] In the second aspect, the embodiment of the utility model provides a new mechanical structure for displaying braille dots based on nickel-titanium shape memory alloy wire and metal spring probe. The new mechanical structure for displaying braille dots is mainly carried by the character display module described in the portable intelligent braille dot matrix display device mentioned above. The new mechanical structure is mainly composed of nickel-titanium shape memory alloy wire and metal spring probe. The driving circuit energizes the alloy wire with a two-way shape memory effect, and uses the thermal effect of the current to heat the alloy wire to cause the reverse transformation of the thermoelastic martensitic phase transformation of the memory material so that the alloy wire is in the austenite phase. Because its atomic arrangement is relatively loose, the alloy wire is driven to produce elongation deformation on a macro scale. After the alloy wire is elongated, it no longer applies traction to the piston needle of the metal spring probe, causing the piston needle to pop out. The device also uses a heat sink to rapidly cool the alloy wire, causing the thermoelastic martensitic phase transformation of the memory material to place the alloy wire in the martensitic phase. The nickel and titanium atoms in the crystal structure of the alloy material are rearranged to form a dense structure, which drives the alloy wire to produce contraction deformation on a macro scale. Because the traction force during the contraction of the alloy wire is greater than the reverse spring force of the metal spring probe, the alloy wire can drive the piston needle of the metal spring probe connected thereto to contract. In summary, the convex and concave contacts of the Braille text can be displayed by controlling the extension and contraction of the piston needle of the metal spring probe.
[0031] The portable intelligent Braille dot matrix display device described above, the character display module, is composed of a new mechanical structure for realizing the movement of character dots and a plurality of circuit modules. A single character display module can control the mechanical structure to "display" 16 international standard Braille characters through the signal output by the control module. The character display module realizes the convex and concave touch of the Braille character dots by controlling the rising or falling movement of the piston needle of the metal spring probe of the 96 Braille character dots corresponding to the 16 Braille character positions in a single module. The character display module is generally in the shape of a narrow and long rectangular parallelepiped.
[0032] The above-mentioned display module, the new mechanical structure is composed of nickel-titanium shape memory alloy wire, metal spring probe, insulating sleeve, crimped metal hoop, metal anchor seat, crimped terminal, anchor screw, and anchor nut. One end of the alloy wire is connected to the piston needle of the metal spring probe by crimping. The other end of the alloy wire is crimped with a round terminal, which is fixed to the metal anchor seat on the bottom plate by screws. Each braille position has an independent mechanical structure for braille "display".
[0033] The above-mentioned display module, the multiple circuit modules include a touch sensing module, a shift register serial-to-parallel conversion and Darlington transistor drive circuit module, a field effect transistor drive circuit module, and an anchoring and current limiting circuit module.
[0034] The above-mentioned display module and the touch sensing module control the driving circuit corresponding to the touched braille position to work through the touch sensing key chip. When a finger touches the panel area of a braille position, the touch sensing key chip obtains the finger position information, controls the driving circuit of the currently touched position and the next position to work, and makes the driving circuit of other positions not work, so as to save energy.
[0035] The above-mentioned display module, the shift register serial-to-parallel conversion and Darlington tube drive circuit module obtain the high and low level signals of the word point code transmitted by the main control microcontroller in a serial manner, and convert them into parallel mode to output them with a shift register chip with a three-state output register, driving the Darlington tube element to control the subsequent drive circuit. A temperature sensor is also attached to the circuit board of the module to monitor the temperature of the display module.
[0036] The above-mentioned display module and the field effect tube driving circuit module control the conduction of the field effect tube by obtaining the high and low level signals output by the Darlington tube of the shift register serial-to-parallel conversion and the Darlington tube driving circuit module. When the field effect tube driving circuit is turned on, the circuit passes a large current into the above-mentioned nickel-titanium shape memory alloy wire, and uses the thermal effect of the current to cause the metal phase change of the memory alloy material, and drives the alloy wire to produce telescopic deformation on a macro scale. The metal spring probe is fixed on the circuit board of the field effect tube driving circuit module in the form of welding. One end of the nickel-titanium shape memory alloy wire is fixed on the piston needle of the metal spring probe in the form of crimping.
[0037] The above-mentioned display module and the above-mentioned anchoring and current limiting circuit module realize the current limiting of the driving circuit through the current limiting resistor and the self-recovering fuse. The end of the piston-type needle of the above-mentioned nickel-titanium shape memory alloy wire away from the metal spring probe is crimped with a round terminal, and the terminal is fixed to the metal anchoring seat on the bottom plate by screws, and the metal anchoring seat is welded to the circuit board of the anchoring and current limiting circuit module.
[0038] In a possible design, the above-mentioned display module and the touch sensing module are composed of the ADPT016 capacitive touch sensing key chip and surrounding circuits produced by Shenzhen Ada Electronics Co., Ltd.
[0039] In a possible design, the above-mentioned display module, the shift register serial-to-parallel conversion and Darlington transistor drive circuit module are composed of Texas Instruments' SN74HC595 8-bit shift register chip, Texas Instruments' ULN2003A 7-channel Darlington transistor array, Guangdong Youtai Semiconductor Co., Ltd.'s DS18B20 temperature sensor and surrounding circuits.
[0040] The embodiments of the present invention bring the following beneficial effects:
[0041] The utility model provides a portable intelligent Braille dot matrix display device driven by an intelligent electronic system and based on a new mechanical structure of a nickel-titanium memory alloy wire and a metal spring probe for Braille display. The device can restore rich text content to blind readers in a convenient, diversified and environmentally friendly way through the Braille dot matrix display, so that blind users can perceive and understand information more accurately, improve their reading experience, and expand the channels for the blind group to acquire knowledge. The device adopts a simple and compact mechanical structure for Braille dot display, realizes the miniaturization and portability of the device, and expands the use scenarios of the Braille dot matrix reader. The device uses a nickel-titanium memory alloy wire to drive the Braille dot display, has a low cost and a long service life, ensures the reliability of the device, and improves the economic benefits. The device interacts with the blind user through barrier-free methods such as voice, action, and quick fingerprint operation, so that the blind user can use the device more conveniently for reading and operation. This includes the use of touch screens, voice input and other functions, making the operation interface of the device more friendly and easy to understand. In general, the application of this technology can meet the needs of blind users for portable and easy-to-operate Braille display devices.
[0042] Other features and advantages of the utility model will be described in the subsequent description, or some features and advantages can be inferred or determined without doubt from the description, or can be learned by implementing the above-mentioned technology of the utility model.
[0043] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the following specifically cites preferred implementation modes and describes them in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] Figure 1 It is a structural schematic diagram of a portable intelligent Braille dot matrix display device provided in an embodiment of the present application.
[0045] Figure 2 It is a hardware system block diagram of the control module provided in the embodiment of the present application.
[0046] Figure 3 It is a schematic diagram of a control module provided in an embodiment of the present application.
[0047] Figure 4 It is another schematic diagram of the control module provided in an embodiment of the present application.
[0048] Figure 5 It is a schematic diagram of the shift register serial-to-parallel conversion and Darlington transistor drive circuit module of the display module provided in the embodiment of the present application.
[0049] Figure 6It is another schematic diagram of the shift register serial-to-parallel conversion and Darlington transistor drive circuit module of the display module provided in an embodiment of the present application.
[0050] Figure 7 Schematic diagram of a touch sensing module of a display module provided in an embodiment of the present application.
[0051] Figure 8 It is a schematic diagram of a field effect transistor driving circuit module of a display module provided in an embodiment of the present application.
[0052] Fig. 9 It is a schematic diagram of the anchoring and current limiting circuit module of the display module provided in the embodiment of the present application.
[0053] Fig.10 It is a main structural diagram of the character display module provided in the embodiment of the present application.
[0054] Fig.11 It is a structural schematic diagram of a new mechanical structure for displaying Braille dots based on nickel-titanium memory alloy wire and metal spring probe provided in an embodiment of the present application.
[0055] Fig.12 a and Fig.12 b is a motion schematic diagram of a new mechanical structure for displaying Braille dots based on nickel-titanium memory alloy wire and metal spring probe provided in an embodiment of the present application.
[0056] Fig.13 This is a usage status diagram of the portable intelligent Braille dot matrix display device provided in an embodiment of the present application.
[0057] Description of main component symbols.
[0058] Upper housing 10.
[0059] Lower shell 11.
[0060] Upper Braille key 12.
[0061] Press Braille key 13.
[0062] Insulation panel 14.
[0063] Control module 20.
[0064] Control circuit board 21.
[0065] Microcontroller module 22.
[0066] Speech recognition and calculation module 23.
[0067] Speech synthesis module 24.
[0068] Display module status acquisition module 25.
[0069] Inertial sensor module 26 .
[0070] Fingerprint recognition module 27.
[0071] Storage module 28.
[0072] Wireless transmission and audio codec module 29.
[0073] Near field communication module 30.
[0074] FM receiving module 31.
[0075] USB-A port 32.
[0076] 3.5mm headphone jack33.
[0077] Speaker interface 34.
[0078] Display module interface 35.
[0079] Screen interface 36.
[0080] Battery pack interface 37.
[0081] Vibration motor interface 38.
[0082] Key interface 39.
[0083] The character display module 40.
[0084] Shift register serial-to-parallel conversion and Darlington transistor drive circuit module 41.
[0085] Shift register chip 41a.
[0086] Darlington transistor chip 41b.
[0087] Temperature sensor 41c.
[0088] Touch sensing module 42.
[0089] Field effect transistor driving circuit module 43.
[0090] Anchoring and current limiting circuit module 44.
[0091] A mechanical structure 50 for displaying Braille dots.
[0092] Nickel-titanium shape memory alloy wire 51.
[0093] Metal spring probe 52.
[0094] The piston needle 52a of the metal spring probe.
[0095] The metal ferrule 53 is crimped.
[0096] The first through hole and the second through hole 53a and 53b.
[0097] Metal anchor seat 54.
[0098] The through hole 54a of the metal anchor seat.
[0099] Crimp terminal 55.
[0100] Anchor screw 56.
[0101] Anchor nut 57.
[0102] The following specific implementation methods will further illustrate the present application in conjunction with the above-mentioned drawings. DETAILED DESCRIPTION
[0103] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.
[0104] In the embodiments of the present application, the words "first", "second", etc. are only used to distinguish different objects, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order. For example, the first application, the second application, etc. are used to distinguish different applications, rather than to describe a specific order of applications. The features defined as "first" or "second" may explicitly or implicitly include one or more of the features.
[0105] In some scenarios, the dot matrix reader for the blind can be used as an independent desktop device or as an external device in conjunction with a computer. Users can read the Braille by touch and operate it by pressing buttons. In the above scenarios, such dot matrix readers for the blind are not miniaturized and cannot be used portable. Blind users are also unable to operate such dot matrix readers intelligently and quickly, which brings inconvenience to users.
[0106] In order to cope with the above situation, the embodiment of the present application provides a portable intelligent Braille dot matrix display device, which can realize the display of concave and convex dots in Braille by driving the longitudinal movement of the piston needle of the micro-mechanical structure by circuit. The device has a sophisticated structure, a small size, and a built-in battery, and the user can carry the device with him. In order to further facilitate the use of this device by blind users, this device adopts an intelligent design, and realizes a variety of convenient and fast operation methods such as voice interaction, motion interaction, fingerprint quick operation, near-field communication "touch and transmit", etc., which greatly improves the user experience of blind users.
[0107] See also Figure 1 , an embodiment of the present application provides a portable intelligent Braille dot matrix display device.
[0108] The portable intelligent Braille dot matrix display device may include an upper shell 10, a lower shell 11, an upper Braille button 12, a lower Braille button 13, an insulating panel 14 touched by a user, and a piston needle 52a of a metal spring probe that forms a concave and convex tactile feeling on the panel. It can be understood that the piston needle 52a of the metal spring probe in the embodiment of the present application can be used for the display of Braille. In some implementations, the insulating panel 14 uses hard nylon as a base material, and the surface in contact with the user is covered with a polymer insulating soft film, and the piston needle 52a of the metal spring probe is lined under the polymer insulating soft film and touched by the user.
[0109] The portable intelligent braille dot matrix display device may further include a control module 20, a display module 40, a battery and power management module, a heat dissipation system, etc. The control module 20 may be connected to the upper braille button 12, the lower braille button 13, the display module 40, the battery and power management module, and the heat dissipation system.
[0110] See also Figure 2 , a hardware system block diagram of a control module provided by an embodiment of the present application.
[0111] The control module 20 may include a control circuit board 21, a microcontroller module 22, a speech recognition and calculation module 23, a speech synthesis module 24, a display module state acquisition module 25, an inertial sensor module 26, a fingerprint recognition module 27, a storage module 28, a wireless transmission and audio codec module 29, a near field communication module 30, and an FM receiving module 31. The control module 20 may also include multiple interfaces, including a USB-A interface 32, a 3.5mm headphone interface 33, a speaker interface 34, a display module interface 35, a screen interface 36, a battery pack interface 37, a vibration motor interface 38, a button interface 39 and related circuits.
[0112] The control module 20 may include a control circuit board 21, a microcontroller module 22, a speech recognition and calculation module 23, a speech synthesis module 24, a display module state acquisition module 25, an inertial sensor module 26, a fingerprint recognition module 27, a storage module 28, a wireless transmission and audio codec module 29, a near field communication module 30, and an FM receiving module 31. The control module 20 may also include multiple interfaces, including a USB-A interface 32, a 3.5mm headphone interface 33, a speaker interface 34, a display module interface 35, a screen interface 36, a battery pack interface 37, a vibration motor interface 38, a button interface 39 and related circuits.
[0113] It can be understood that the sub-modules of the control module 20: microcontroller module 22, speech recognition and calculation module 23, speech synthesis module 24, display module status acquisition module 25, inertial sensor module 26, fingerprint recognition module 27, storage module 28, wireless transmission and audio codec module 29, near field communication module 30, and FM receiving module 31 can be connected through circuits. For example: a communication connection can be established between the microcontroller module 22 and the speech recognition and calculation module 23, the speech synthesis module 24, and the display module status acquisition module 25 via UART; a communication connection can be established between the speech recognition and calculation module 23 and the inertial sensor module 26 via I2C, and a communication connection can be established between the speech recognition and calculation module 23 and the fingerprint recognition module via UART; a communication connection can be established between the storage module 28 and the microcontroller module 22 and the wireless transmission and audio codec module 29 via SPI; a communication connection can be established between the wireless transmission and audio codec module 29 and the FM receiving module 31 via an analog audio interface; a communication connection can be established between the display module status acquisition module 25 and the near field communication module 30 via SPI.
[0114] It can be understood that the microcontroller module 22 and the storage module 28 of the control module 20 can establish a wired communication connection with the outside through the USB-A interface 32 via USB; the wireless transmission and audio codec module 29 of the control module 20 can establish a wireless communication connection with the outside through Wi-Fi and Bluetooth; the near-field communication module 30 of the control module 20 can establish a connection with the outside through near-field communication.
[0115] See also Figure 3 and Figure 4 , a schematic diagram of a control module provided by an embodiment of the present application.
[0116] like Figure 3 and Figure 4 As shown, in this embodiment, each submodule of the control module 20 is integrated on the control circuit board 21, and the inter-module communication is realized through the circuit carried by the control circuit board 21. The control module 20 is generally in the shape of a flat rectangular parallelepiped. It can be understood that the microcontroller module 22, the inertial sensor module 26, the fingerprint recognition module 27, the near field communication module 30, and the FM receiving module 31 can be connected to the control circuit board 21 by means of pin headers, female headers or connectors; the speech recognition and calculation module 23, the speech synthesis module 24, the wireless transmission and audio codec module 29 can be connected to the control circuit board 21 by means of a patch welding module; the display module state acquisition module 25 and the storage module 28 can be connected to the control circuit board 21 by means of a patch welding chip.
[0117] like Figure 3 and Figure 4 As shown, in this embodiment, the USB-A interface 32, 3.5mm headphone interface 33, speaker interface 34, display module interface 35, screen interface 36, battery pack interface 37, vibration motor interface 38, and button interface 39 of the control module 20 can be fixed on the control circuit board 21 by welding connectors. The control module 20 can communicate with the display module 40 through the display module interface 35.
[0118] In some implementations, the control module 20 may include two of the speaker interfaces 34 , two microphone interfaces, a plurality of the display module interfaces 35 , two of the battery pack interfaces 37 , and a plurality of the button interfaces 39 .
[0119] Based on the above design, the control module 20 can realize the voice interaction between the portable intelligent Braille dot matrix display device and the user in this embodiment through the voice recognition and calculation module 23 and the voice synthesis module 24. The control module 20 can collect the three-axis gyroscope signal and the three-axis acceleration signal of the inertial sensor module 26 and perform motion recognition calculation based on the dynamic time warping algorithm, so that the user can complete the action instruction quick operation by holding the portable intelligent Braille dot matrix display device. The control module 20 recognizes the fingerprints of the user's ten fingers through the fingerprint recognition module 27, and realizes the fingerprint-based quick operation by using the mapping method of binding different fingerprints to specific operations according to the principle of different fingerprints of the user's ten fingers.
[0120] See also Figure 5 and Figure 6 , is a schematic diagram of a sub-module shift register serial-to-parallel conversion and Darlington transistor drive circuit module of a display module provided in an embodiment of the present application.
[0121] like Figure 5 and Figure 6 As shown, in this embodiment, the submodule shift register serial-to-parallel conversion and Darlington tube drive circuit module 41 of the display word module 40 may include a shift register chip 41a, a Darlington tube chip 41b, a temperature sensor 41c and a display word module interface 35. The shift register chip 41a, the Darlington tube chip 41b and the temperature sensor 41c are connected to the circuit board of the shift register serial-to-parallel conversion and Darlington tube drive circuit module by welding. The shift register chip 41a selects the 8-bit shift register chip SN74HC595 with a three-state output register of Texas Instruments. Each shift register chip 41a can complete the storage of one Braille code. The display word module 40 can communicate with the control module 20 through the display word module interface 35.
[0122] In the embodiment of the present application, the microcontroller module 22 reads 640 bits of data from the storage module 28 into the cache at one time, and outputs the data to the five display word modules 40 through five GPIO ports in the form of 128 bits per segment. There are 16 cascaded shift register chips 41a with latches on the submodule shift register serial-to-parallel conversion and Darlington tube drive circuit module 41 of each display word module 40. The data is input into the first shift register chip 41a as serial data, output to the parallel output pin of the first shift register chip 41a as parallel data, and the overflow data is output serially to the second shift register chip 41a, and so on. Finally, the output state of the parallel output pins of all chips is maintained through the output register. The display word module 40 needs to drive the nickel-titanium shape memory alloy wire 51 to move with the high and low levels of the parallel output pins of the shift register chip 41a. The nickel-titanium shape memory alloy wire completes the metal phase change due to the thermal effect of the current, and realizes the macroscopic contraction movement, so it is necessary to design a control circuit that adapts to a larger current. Therefore, the Darlington transistor chip 41b is used in this control circuit to isolate the signal of the front-stage shift register chip 41a and drive the rear-stage field effect transistor circuit.
[0123] See also Figure 7 , a schematic diagram of a touch sensing module of a display module provided by an embodiment of the present application. The circuit board of the touch sensing module 42 has a slot at the braille display position, and the piston needle 52a of the metal spring probe of the mechanical structure 50 for displaying braille dots can pass through the slot to form a touch on the insulating panel 14.
[0124] See also Figure 8 , a schematic diagram of a field effect transistor drive circuit module of a display module provided in an embodiment of the present application. The metal spring probe 52 is welded and fixed on the circuit board of the field effect transistor drive circuit module 43. In some implementations, the circuit board of the field effect transistor drive circuit module 43 carries an array containing 16 drive circuits, and each drive circuit uses 6 metal spring probes 52 in the part of the module. In some implementations, the circuit board of the field effect transistor drive circuit module 43 has two slots on both sides of each drive circuit position, and one end of the nickel-titanium shape memory alloy wire 51 of the mechanical structure 50 for displaying braille dots is fixed on the piston needle 52a of the metal spring probe, and the other end will pass through the above two slots and be fixed on the metal anchor seat 54 of the anchor and current limiting circuit module 44. It can be understood that the nickel-titanium shape memory alloy wire 51 can pass through the above two slots and perform telescopic movement between multiple board layers.
[0125] See also Fig. 9, a schematic diagram of an anchoring and current limiting circuit module of a display module provided in an embodiment of the present application. The metal anchoring seat 54 is welded and fixed on the circuit board of the anchoring and current limiting circuit module 44. In some implementations, the circuit board of the anchoring and current limiting circuit module 44 carries an array containing 16 drive circuits, and each drive circuit uses 6 metal anchoring seats 54 in the module. One end of the nickel-titanium shape memory alloy wire 51 of the mechanical structure 50 for displaying braille dots is fixed to the piston needle 52a of the metal spring probe, and the other end is fixed to the metal anchoring seat 54 of the anchoring and current limiting circuit module 44.
[0126] See also Fig.10 , a schematic diagram of the main structure of a character display module provided by an embodiment of the present application.
[0127] The display module 40 may be composed of various submodules: a shift register serial-to-parallel conversion and Darlington transistor drive circuit module 41, a touch sensing module 42, a field effect transistor drive circuit module 43, an anchoring and current limiting circuit module 44 and a part of the connection structure. The spatial combination structure of the submodules of the display module 40 is as follows: Fig.10 Furthermore, the metal spring probe 52 and the metal anchor seat 54 are welded on the field effect transistor driving circuit module 43 and the anchor and current limiting circuit module 44 respectively.
[0128] See also Fig.11 , a schematic diagram of a novel mechanical structure for displaying Braille dots based on nickel-titanium memory alloy wire and metal spring probe provided by an embodiment of the present application.
[0129] The mechanical structure 50 for displaying braille dots can be composed of the nickel-titanium shape memory alloy wire 51, the metal spring probe 52, the crimping metal ferrule 53, the metal anchor seat 54, the crimping terminal 55, the anchoring screw 56, and the anchoring nut 57. The metal spring probe 52 has a hollow tubular structure inside, and a spring is built into the hollow tubular structure. The piston needle 52a of the metal spring probe can be pressed down or bounced up. The crimping metal ferrule 53 is provided with a first through hole 53a and a second through hole 53b. The piston needle 52a of the metal spring probe can pass through the first through hole 53a of the crimping metal ferrule 53. One end of the nickel-titanium shape memory alloy wire 51 can pass through the second through hole 53b of the crimping metal ferrule 53, and be pressed against the crimping metal ferrule 53 under the action of mechanical external force, so as to realize the fixed connection between the piston needle 52a of the metal spring probe and the nickel-titanium shape memory alloy wire 51. The field effect transistor driving circuit module 43 is provided with a slot, and it can be understood that the nickel-titanium shape memory alloy wire 51 can pass through the slot and perform telescopic movement between multiple plate layers. The other end of the nickel-titanium shape memory alloy wire 51 can be fixedly connected to the crimping terminal 55 by crimping. The metal anchor seat 54 is provided with a through hole 54a of the metal anchor seat, and the anchoring screw 56 can pass through the crimping terminal 55 and the through hole 54a of the metal anchor seat, and cooperate with the anchoring nut 57 to fix the crimping terminal 55 on the metal anchor seat 54. Based on such a design, the nickel-titanium shape memory alloy wire 51 and the metal anchor seat 54 can be fixedly connected. In a possible design, the metal spring probe 52 and the nickel-titanium shape memory alloy wire 51 will be covered by an insulating sleeve.
[0130] Based on such a design, the current can pass through the field effect transistor driving circuit module 43 into the metal spring probe 52 welded thereon, and flow through the crimped metal hoop 53, the nickel-titanium shape memory alloy wire 51, the crimped terminal 55, and the metal anchor seat 54, and finally pass through the anchor and current limiting circuit module 44 welded with the metal anchor seat 54 to form a loop.
[0131] It can be understood that when the nickel-titanium shape memory alloy wire 51 is passed through an electric current, its temperature rises due to the thermal effect of the electric current, and after exceeding the critical point, the alloy material undergoes a reverse transformation of the thermoelastic martensitic phase transition, and the martensite phase that has been formed in the alloy material can be reversed to the austenite phase, and the nickel-titanium shape memory alloy wire 51 will produce a strain that transforms to the original shape, which is manifested in the macroscopic elongation of the length of the nickel-titanium shape memory alloy wire 51. After the nickel-titanium shape memory alloy wire 51 is elongated, it no longer applies traction to the piston-type needle 52a of the metal spring probe, causing the needle to pop out. Furthermore, the device also uses a heat dissipation device to rapidly cool the nickel-titanium shape memory alloy wire 51, causing the thermoelastic martensitic phase transition of the memory material, so that the nickel-titanium shape memory alloy wire 51 is in the martensitic phase, and the nickel and titanium atoms in the crystal structure of the alloy material are rearranged to form a dense structure, which drives the nickel-titanium shape memory alloy wire 51 to produce shrinkage deformation in the macroscopic sense. Because the traction force of the nickel-titanium shape memory alloy wire 51 during the contraction process is greater than the reverse spring force of the metal spring probe 52, the nickel-titanium shape memory alloy wire 51 can achieve contraction deformation. And because one end of the nickel-titanium shape memory alloy wire 51 is fixed to the metal anchor seat 54 by the crimping terminal 55, the anchoring screw 56, and the anchoring nut 57 and cannot move, the nickel-titanium shape memory alloy wire 51 can only pull the piston needle 52a of the metal spring probe connected by the crimping metal hoop 53 to produce contraction movement. It can be understood that the device can realize the convex and concave contacts of the Braille characters by controlling the extension and contraction movement of the piston needle 52a of the metal spring probe.
[0132] In a possible implementation method, six sets of mechanical structures 50 for displaying Braille characters are required to display each Braille character. Each of the character display modules 40 is designed to display 16 Braille characters. Each of the character display modules 40 requires a total of 96 sets of mechanical structures 50 for displaying Braille characters.
[0133] See also Fig.12 a and Fig.12 b, a schematic diagram of the movement of a new mechanical structure for displaying Braille dots based on nickel-titanium memory alloy wire and metal spring probe provided by an embodiment of the present application.
[0134] like Fig.12 As shown in a, the nickel-titanium shape memory alloy wire 51 realizes contraction deformation, pulling the piston needle 52a of the metal spring probe to move downward. Fig.12 As shown in FIG. 2 b, the nickel-titanium shape memory alloy wire 51 is stretched and deformed, and the piston needle 52a of the metal spring probe is naturally bounced. It can be understood that the bounce of the piston needle 52a of the metal spring probe can display the raised dots in the Braille.
[0135] See also Fig.13, a usage status diagram of the portable intelligent Braille dot matrix display device provided in an embodiment of the present application.
[0136] like Fig.13 As shown, a blind user places a finger on the touch panel 14 of the portable intelligent Braille dot matrix display device provided in an embodiment of the present application. When the user selects the text content to be read, the device will generate corresponding protrusions on the dot matrix area according to the instruction to form a Braille dot matrix. The blind user touches the dot matrix area and reads with his fingers. By feeling the protrusions and arrangement of the dot matrix, the blind user can recognize different Braille characters and words. The user can move his fingers word by word or line by line to perceive, recognize and understand the text content on the dot matrix area. As the finger moves, the device will update the dot matrix information in real time to keep in sync with the user's interaction. The user can read at his own reading speed and get the required information at any time. As needed, the user can adjust parameters such as the dot matrix character spacing to obtain a reading experience that is more suitable for him.
[0137] It is obvious to those skilled in the art that the present application is not limited to the details of the above exemplary embodiments, and that the present application can be implemented in other specific forms without departing from the spirit or basic features of the present application. Therefore, as long as they are within the scope of the essence and spirit of the present application, appropriate changes and modifications made to the above embodiments should fall within the scope of protection claimed in the present application.
Claims
1. A portable intelligent braille dot matrix display device, comprising an upper housing (10), a lower housing (11), an upper braille button (12), a lower braille button (13), an insulating panel (14), a control module (20), a character display module (40), a battery and power management module, and a heat dissipation system, characterized in that: A control module (20) and at least three character display modules (40) are arranged in the upper and lower shells. The control module (20) carries an intelligent electronic system to drive a braille dot matrix display device. The character display module (40) uses a new mechanical structure including a nickel-titanium shape memory alloy wire (51) and a metal spring probe (52) to display braille dots.
2. The portable intelligent Braille dot matrix display device according to claim 1, characterized in that: The character display module (40) may be composed of a sub-module shift register serial-to-parallel conversion and Darlington transistor drive circuit module (41), a touch sensing module (42), a field effect transistor drive circuit module (43), an anchoring and current limiting circuit module (44) and a portion of a connection structure, and the metal spring probe (52) and the metal anchoring seat (54) are respectively welded to the field effect transistor drive circuit module (43) and the anchoring and current limiting circuit module (44).
3. The portable intelligent Braille dot matrix display device according to claim 2, characterized in that: The control module (20) transmits the stored Braille code data to the shift register chip (41a), drives the field effect transistor drive circuit module (43) through the shift register chip (41a), and passes current through the nickel-titanium shape memory alloy wire (51).
4. The portable intelligent Braille dot matrix display device according to claim 2, characterized in that: The mechanical structure (50) for displaying Braille characters of the character display module (40) is composed of a nickel-titanium shape memory alloy wire (51), a metal spring probe (52), a crimped metal ferrule (53), a metal anchoring seat (54), a crimped terminal (55), an anchoring screw (56), and an anchoring nut (57); the interior of the metal spring probe (52) is a hollow tubular structure, a spring is built into the hollow tubular structure, and the piston needle (52a) of the metal spring probe can be pressed down or popped up.
5. The portable intelligent Braille dot matrix display device according to claim 4, characterized in that: The crimping metal hoop (53) is provided with a first through hole (53a) and a second through hole (53b); the piston needle (52a) of the metal spring probe passes through the first through hole (53a) of the crimping metal hoop (53); one end of the nickel-titanium shape memory alloy wire (51) passes through the second through hole (53b) of the crimping metal hoop (53) and is pressed against the crimping metal hoop (53) under the action of a mechanical external force, thereby achieving a fixed connection between the piston needle (52a) of the metal spring probe and the nickel-titanium shape memory alloy wire (51); the field effect tube drive circuit module (43) is provided with a slot hole; the nickel-titanium shape memory alloy wire (51) passes through the above-mentioned slot hole. The slot performs telescopic movement between the multiple plate layers, the other end of the nickel-titanium shape memory alloy wire (51) is fixedly connected to the crimping terminal (55) by crimping, the metal anchor seat (54) is provided with a through hole (54a) of the metal anchor seat, the anchoring screw (56) passes through the crimping terminal (55) and the through hole (54a) of the metal anchor seat, and the crimping terminal (55) is fixedly installed on the metal anchor seat (54) in cooperation with the anchoring nut (57), so as to fix the nickel-titanium shape memory alloy wire (51) and the metal anchor seat (54), and the metal spring probe (52) and the nickel-titanium shape memory alloy wire (51) are covered by an insulating sleeve.
6. The portable intelligent Braille dot matrix display device according to claim 4, characterized in that: The current can pass through the circuit on the field effect transistor driving circuit module (43) into the metal spring probe (52) welded thereon, and flow through the crimped metal ferrule (53), the nickel-titanium shape memory alloy wire (51), the crimped terminal (55), and the metal anchor seat (54), and finally pass through the circuit of the anchor and current limiting circuit module (44) welded with the metal anchor seat (54) to form a loop.
7. The portable intelligent Braille dot matrix display device according to claim 1, characterized in that: The piston-type needle head (52a) of the metal spring probe of the character display module (40) forms a concave-convex tactile feeling on the insulating panel (14), thereby realizing the display of Braille character dots.
8. The portable intelligent Braille dot matrix display device according to claim 1, characterized in that: The insulating panel (14) is coated with an insulating soft film on a base material, the insulating soft film serving as an outer surface in contact with a user, and a piston-type needle head (52a) of a metal spring probe is placed under the insulating soft film to be touched by a user.
9. The portable intelligent Braille dot matrix display device according to claim 1, characterized in that: The control module (20) comprises a control circuit board (21), a microcontroller module (22), a speech recognition and calculation module (23), a speech synthesis module (24), an inertial sensor module (26), a fingerprint recognition module (27), a storage module (28), a wireless transmission and audio codec module (29), and multiple submodules, wherein communication connections are established between the modules via lines.
10. The portable intelligent Braille dot matrix display device according to claim 1, characterized in that: The control module (20) further comprises submodules: a near field communication module (30) and a frequency modulation receiving module (31).
