Networking method, electronic device, computer readable medium and computer program product
The automatic networking of Braille devices is achieved through distributed service architecture, which solves the problem that existing devices cannot interact easily and realizes convenient interoperability and safe use of blind devices.
Patent Information
- Application Number
- CN202411267297.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-11-22
AI Technical Summary
Existing blind special equipment cannot easily interact with smart terminals and requires others to assist in networking operations, which leads to inconvenience for blind people to use.
A distributed service architecture (soft bus) is used to realize mutual discovery and networking of devices, and equipment mapping tables are provided through Braille services, and collaborative connections are automatically established, supporting Braille input and output, simplifying the networking process.
Automatic networking of multiple Braille devices can be achieved without additional operations, which facilitates blind people to organize networking, lowers the threshold for use, and ensures the interoperability and security of equipment.
Smart Images

Figure CN119012416A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of wireless terminal technology, and in particular to a networking method, an electronic device, a computer-readable medium, and a computer program product. Background Art
[0002] With the continuous development of mobile Internet technology and more and more devices connected to the Internet, more and more information and news are transmitted and circulated through the Internet, which has brought a lot of convenience to our lives and studies. In order to facilitate the blind to enjoy the convenience brought by the Internet, some special equipment for the blind group has emerged, but the existing special equipment is either designed to be unable to interact with existing smart terminals, or cannot interact with smart terminals conveniently, and often requires the assistance of others for networking operations. Summary of the invention
[0003] The present disclosure provides a networking method, an electronic device, a computer-readable medium, and a computer program product.
[0004] In a first aspect, an embodiment of the present disclosure provides a networking method, which is applied to a first device, and the method includes:
[0005] Determine that there is a need for Braille interaction;
[0006] In response to the braille interaction service, a device list of second devices supporting the braille interaction service is obtained; the device list is a device mapping table of first devices and second devices based on the braille service and having a device mutual discovery capability obtained through a distributed service architecture;
[0007] According to the device list, the first device and the second device establish a collaborative connection network.
[0008] In a second aspect, an embodiment of the present disclosure provides an electronic device, including a memory and a processor; the memory stores a computer program that can be executed by the processor, and when the computer program is executed by the processor, any one of the networking methods of the embodiments of the present disclosure is implemented.
[0009] In a third aspect, an embodiment of the present disclosure provides a computer-readable medium having a computer program stored thereon, and when the computer program is executed by a processor, any one of the networking methods of the embodiments of the present disclosure is implemented.
[0010] In a fourth aspect, an embodiment of the present disclosure provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, any one of the networking methods of the embodiments of the present disclosure is implemented.
[0011] In the disclosed embodiment, when it is determined that there is a need for Braille interaction (such as Braille input, Braille output), multiple devices (first device, second device) equipped with Braille services can be automatically networked without the need for additional operations, thereby facilitating networking operations for the blind. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] In the accompanying drawings of the embodiments of the present disclosure:
[0013] Figure 1 A flowchart of a networking method provided by an embodiment of the present disclosure;
[0014] Figure 2 A schematic diagram of the configuration of a first device and a second device provided in an embodiment of the present disclosure;
[0015] Figure 3 A network flow chart of establishing a collaborative connection between a first device and a second device provided in an embodiment of the present disclosure;
[0016] Figure 4 A network flow chart of establishing a collaborative connection between a first device and a second device provided in an embodiment of the present disclosure;
[0017] Figure 5 A flowchart of obtaining the overall cost of each candidate hotspot provided in an embodiment of the present disclosure;
[0018] Figure 6 A flowchart of obtaining a comprehensive cost of connecting to each second device provided in an embodiment of the present disclosure;
[0019] Figure 7 A schematic diagram of a network environment before network connection of a smart phone, a braille stylus, and a braille display provided in an embodiment of the present disclosure;
[0020] Figure 8 A flow chart of device discovery provided for an embodiment of the present disclosure;
[0021] Fig. 9 A flowchart of the network provided by the embodiment of the present disclosure;
[0022] Fig.10 A schematic diagram of a network of a stylus pen for the blind, a Braille display and a smart phone provided in the disclosed embodiment;
[0023] Fig.11 A block diagram of the components of a stylus pen for the blind provided in the disclosed embodiment;
[0024] Fig.12 A schematic diagram of the structure of a stylus pen for the blind provided in the disclosed embodiment;
[0025] Fig.13 A block diagram of a display for the blind provided in the disclosed embodiment;
[0026] Fig.14 A schematic diagram of the structure of a display for the blind provided in the disclosed embodiment;
[0027] Fig.15 A schematic diagram of a logical process in which a user uses a braille stylus to input in a handwriting area of a braille display in a braille input method provided by an embodiment of the present disclosure;
[0028] Fig.16 A schematic diagram of a logical process for a user to confirm an input font in a Braille input method provided by an embodiment of the present disclosure;
[0029] Fig.17 A schematic diagram of a logical process for a user to confirm an input font in a Braille input method provided by an embodiment of the present disclosure;
[0030] Fig.18 A logical process diagram of a Braille output method provided by an embodiment of the present disclosure;
[0031] Fig.19 A logical process diagram of a Braille modification method provided by an embodiment of the present disclosure;
[0032] Fig. 20 A block diagram of an electronic device provided in an embodiment of the present disclosure;
[0033] Fig.21 A block diagram of a computer-readable medium provided for an embodiment of the present disclosure. DETAILED DESCRIPTION
[0034] In order to enable those skilled in the art to better understand the technical solution of the present disclosure, the embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
[0035] The present disclosure will be described more fully below with reference to the accompanying drawings, but the embodiments shown may be embodied in different forms, and the present disclosure should not be construed as being limited to the embodiments set forth below. On the contrary, the purpose of providing these embodiments is to make the present disclosure thorough and complete, and will enable those skilled in the art to fully understand the scope of the present disclosure.
[0036] The accompanying drawings of the embodiments of the present disclosure are used to provide a further understanding of the embodiments of the present disclosure, and constitute a part of the specification, and are used together with the detailed embodiments to explain the present disclosure, and do not constitute a limitation of the present disclosure. By describing the detailed embodiments with reference to the accompanying drawings, the above and other features and advantages will become more apparent to those skilled in the art.
[0037] The present disclosure may be described with reference to plan views and / or cross-sectional views by means of ideal schematic views of the present disclosure. Therefore, the exemplary illustrations may be modified according to manufacturing techniques and / or tolerances.
[0038] In the absence of conflict, the various embodiments of the present disclosure and the various features therein may be combined with each other.
[0039] The terms used in the present disclosure are only used to describe specific embodiments and are not intended to limit the present disclosure. The term "and / or" as used in the present disclosure includes any and all combinations of one or more related enumerated items. The singular forms "one" and "the" as used in the present disclosure are also intended to include plural forms, unless the context clearly indicates otherwise. The terms "including", "made of..." as used in the present disclosure specify the presence of the features, wholes, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof.
[0040] Unless otherwise defined, all terms (including technical and scientific terms) used in this disclosure have the same meaning as commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this disclosure, and will not be interpreted as having an idealized or overly formal meaning unless explicitly defined in this disclosure.
[0041] The present disclosure is not limited to the embodiments shown in the drawings, but includes modifications of the configurations formed based on the manufacturing process. Therefore, the regions illustrated in the drawings have schematic properties, and the shapes of the regions shown in the drawings illustrate the specific shapes of the regions of the elements, but are not intended to be limiting.
[0042] With the continuous development of mobile Internet technology and more and more devices connected to the Internet, more and more information and news are transmitted and circulated through the Internet, which brings a lot of convenience to our life and study. In order to facilitate the blind group to enjoy the convenience brought by the Internet, some special equipment for the blind group has emerged, such as Braille reading system, Braille input device and Braille output device.
[0043] Existing braille reading systems are often highly dependent on the software and hardware capabilities of the device itself, with complex operating logic, high development costs, and the inability to interact with other smart devices. Existing braille input devices and braille output devices often focus more on their functional implementation, cannot conveniently interact with Internet devices, and often require the assistance of others to network. Therefore, it is still inconvenient for the blind to use.
[0044] In a first aspect, an embodiment of the present disclosure provides a networking method, which is applied to a first device. Figure 1 As shown, the method includes:
[0045] Step S01: Determine whether there is a need for Braille interaction;
[0046] Step S02: In response to the braille interactive service, a device list of second devices supporting the braille service is obtained; the device list is a device mapping table of first devices and second devices based on the braille service and having a device mutual discovery capability obtained through a distributed service architecture;
[0047] Step S03: According to the device list, the first device and the second device establish a collaborative connection network.
[0048] In the embodiment of the present disclosure, the distributed service architecture (Distributed SoftBus) is a distributed soft bus (also called a soft bus), which can provide discovery services and networking services, thereby realizing functions such as device discovery and device networking. Figure 2 As shown, both the first device and the second device have built-in soft bus processes. In this way, through the soft bus, the first device and the second device have the ability to discover each other and can be connected to each other. In addition, both the first device and the second device have built-in Braille services. The Braille service in the present disclosure can provide functions related to Braille processing, such as Braille input, Braille output, Braille translation, etc. In actual applications, the Braille service can be implemented as an application software (APP). It should be noted that Figure 2 Although only two devices (a first device and a second device) are shown, in fact the devices to be networked may be three or more, that is, there may be multiple second devices.
[0049] With the help of the device discovery function of the soft bus (which will be described later), the surrounding second devices that support the braille service can be obtained. That is, in response to the braille interaction demand, a device list of second devices based on the braille service and capable of mutual device discovery with the first device can be obtained through the soft bus. In addition, in the distributed architecture of the present disclosure, each device is equal, that is, the first device and the second device are equal. For example, a device is a first device in some cases and a second device in other cases. In practical applications, the party that triggers or confirms the braille interaction demand can be regarded as the first device.
[0050] In the embodiments of the present disclosure, when it is confirmed that there is a need for Braille interaction, multiple devices (first device, second device) that support Braille services can be automatically networked through a soft bus, so that the blind can directly use Braille services (such as Braille input and output services) without performing additional operations (such as cumbersome network configuration operations), thereby making it convenient for the blind to perform networking operations and use devices.
[0051] In some embodiments, the first device and at least part of the second device can be connected to each other through a plurality of different candidate hotspots; Figure 3 As shown, step S03: according to the device list, the first device and the second device establish a collaborative connection network, including:
[0052] Step S031: Obtaining the overall cost of each candidate hotspot, wherein the overall cost of the candidate hotspot is the sum of the comprehensive costs of the first device connecting to each of the at least one second device through the candidate hotspot, and the comprehensive cost is positively correlated with the energy consumption and time of information exchange between the first device and the second device;
[0053] Step S032: selecting the candidate hotspot with the lowest overall cost as the public hotspot;
[0054] Step S033: The first device and each second device access a public hotspot.
[0055] The soft bus supports a variety of near field communication capabilities, such as Bluetooth, LAN (Local Area Network) / WLAN (Wireless Local Area Network), etc. As one embodiment of the present disclosure, the first device and at least one second device in the device list support WI FI (mobile hotspot) connection, that is, the first device and at least one second device can be connected to each other through the hotspot. At this time, by selecting a public hotspot through a comprehensive analysis of the energy consumption and interaction time (message delay) of multiple collaborative devices (first device and at least one second device) rather than a single device, the network delay and energy consumption of the grouped network can be balanced.
[0056] It is understandable that when there are multiple candidate hotspots, the signal strengths of all candidate hotspots are first obtained, and candidate hotspots with low signal strengths (for example, signal strengths below a threshold) are directly excluded. For candidate hotspots whose signal strengths meet the requirements, their overall costs are obtained, and the candidate hotspot with the lowest overall cost is selected as the public hotspot.
[0057] In some embodiments, the number of at least one second device is multiple, and at least some of the multiple second devices supporting WIFI connection are Bluetooth second devices that can also be connected to the first device via Bluetooth; Figure 4 As shown, the first device and the second device establish a collaborative connection network further comprising:
[0058] Step S034: obtaining a comprehensive cost of connecting to each Bluetooth second device via Bluetooth;
[0059] Step S035: In response to the comprehensive cost of connecting to any Bluetooth second device via Bluetooth being less than the comprehensive cost of connecting to the Bluetooth second device via a public hotspot, establishing a Bluetooth connection with the Bluetooth second device.
[0060] As one mode of an embodiment of the present disclosure, at least part of the second device (Bluetooth second device) supports Bluetooth connection and WI FI connection, that is, it can be connected to the first device via a hotspot, and can also be connected to the second device via Bluetooth. By selecting a connection method with a lower overall cost, a better transmission channel can be selected. It should be noted that some devices in the device list can only be connected via Bluetooth, some devices can only be connected via WI FI, and some can be connected via both Bluetooth and WI FI. For devices that can be connected via WI FI, you can select a suitable hotspot access through the above steps. For devices that can only be connected via Bluetooth (Bluetooth devices), it is sufficient to directly establish a collaborative network through Bluetooth, that is, the first device and the second device establish a collaborative connection network that also includes: the Bluetooth device accesses via Bluetooth.
[0061] In some embodiments, Figure 5 As shown, step S031: obtaining the overall cost of each candidate hotspot includes:
[0062] Step S0311: the first device and each second device access the candidate hotspot;
[0063] Step S0312: Obtaining the comprehensive cost of connecting to each second device;
[0064] Step S0313: sum up the comprehensive costs of connecting to each second device to obtain the overall cost of the candidate hotspot.
[0065] like Figure 6 As shown, the comprehensive cost of obtaining a connection with each second device includes:
[0066] Step S001: sending preset test data to each second device, and determining the transmission energy consumed by sending the test data;
[0067] Step S002: receiving reply information from each second device; the reply information includes receiving energy consumed by the second device to receive the test data;
[0068] Step S003: Determine the comprehensive cost of connecting to the second device according to the sending energy, receiving energy, and the time difference between sending test data and receiving reply information corresponding to each second device.
[0069] It should be noted that Figure 6 The method for obtaining the comprehensive cost of connecting to each second device is applicable to both step S0312 and step S04, and the difference is only in the different communication modes of sending and receiving. When used in step S0312, the test data is sent and the reply information is received via WI FI, while when used in step S04, the test data is sent and the reply information is received via Bluetooth.
[0070] In the case where the first device initiates networking, the measurement of energy consumption and network delay can be initiated by the first device. The test data is data of a fixed size. During measurement, the first device sends the test data to the second device and measures the energy consumption (sending energy) of sending the test data; after receiving the data, the second device gives a reply message to the first device, and the reply message carries the energy consumption (receiving energy) of the second device receiving the test data and the information of the second device; the first device determines the network delay based on the difference between the time of sending the test data and the time of receiving the reply message, and obtains the comprehensive cost with the second device based on the network delay, sending energy and receiving energy.
[0071] In some embodiments, the first device and the second device establishing a collaborative connection network include:
[0072] A braille stylus, comprising a first braille display module;
[0073] A braille display, comprising a second braille display module and a handwriting board;
[0074] terminal.
[0075] As a method of the embodiment of the present disclosure, a braille stylus, a braille display, a terminal, etc. can be used as a first device and a second device. With the help of a soft bus, the braille stylus, the braille display, and the terminal can realize automatic networking and omit complicated networking settings, thereby facilitating the blind to use the braille stylus and the braille display. In addition, with the terminal as the entrance, the braille display as the output device, and the braille stylus as the input device, the terminal can be operated simply and conveniently.
[0076] In some embodiments, the first device is a braille stylus, and the braille stylus further includes a sensing module for sensing whether the braille stylus is held up; and determining whether there is a braille interaction requirement includes:
[0077] In response to the sensing module sensing that the Braille stylus is held up, it is determined that there is a Braille interaction requirement.
[0078] As one method of the embodiment of the present disclosure, a braille stylus can be used as a first device, and a braille display or terminal can be used as a second device. The first device includes a sensing module, which can include one or more of a gravity sensor, a pressure sensor, a temperature sensor, or a touch sensor. The sensing module senses that the braille stylus is held up and directly determines that there is a need for braille interaction, avoiding operations such as turning the stylus on and off, and making it easier for blind people to use the braille stylus.
[0079] In some embodiments, the braille stylus further includes a first verification unit for collecting authentication information, the authentication information including voiceprint information or fingerprint information; in response to the sensing module sensing that the braille stylus is held up, determining that there is a braille interaction requirement includes:
[0080] In response to the sensing module sensing that the Braille stylus is held up, receiving the authentication information collected by the first verification unit, and verifying the authentication information;
[0081] In response to the verification being passed, it is determined that there is a Braille interaction requirement.
[0082] As one embodiment of the present disclosure, the first verification unit may include a fingerprint identifier or a microphone. The fingerprint identifier may collect the user's fingerprint information. The microphone may collect the user's voiceprint information. By verifying the information (authentication information) collected by the first verification unit, and determining that there is a need for Braille interaction only if the verification passes, it can be ensured that only authorized persons can use the Braille stylus.
[0083] As one method of an embodiment of the present disclosure, after downloading and installing the APP on a terminal (such as a smart phone), user information is registered with the help of the terminal. After the terminal collects the user's fingerprint and voiceprint information, the fingerprint and voiceprint information is sent to the server, and then the fingerprint and voiceprint information is saved in the database of the user authentication server for subsequent verification.
[0084] In some embodiments, the first device is a Braille stylus; after the first device establishes a collaborative connection network with at least one second device, the method further includes:
[0085] inputting the trajectory image into a handwriting tablet of a braille display;
[0086] receiving a braille font to be confirmed from a braille display;
[0087] Displaying the Braille font to be confirmed by the first Braille display module;
[0088] In response to receiving a confirmation instruction from the user, the braille font to be confirmed is sent to the terminal as an input braille font.
[0089] The second device may include a braille display; after the first device and the second device establish a collaborative connection network, the second device is further used to:
[0090] receiving a trace image of a Braille stylus input via a handwriting tablet;
[0091] Send the trajectory image to the terminal;
[0092] receiving at least one candidate Braille font from the terminal, and displaying the candidate Braille font through a second Braille display module;
[0093] According to the selection instruction of the user, a braille font to be confirmed is selected from the candidate braille fonts;
[0094] Send the braille font to be confirmed to the braille stylus.
[0095] The second device may further include a terminal; after the first device and the second device establish a collaborative connection network, the terminal is further used to:
[0096] receiving a track image from a braille display;
[0097] generating at least one candidate Braille font according to the trajectory image;
[0098] sending an alternative braille font to a braille display;
[0099] An input braille font is received from a braille stylus, and the input braille font is entered.
[0100] Through the above operations, after the braille stylus is networked with the braille display and the terminal, braille can be input into the terminal through the coordinated action of the braille stylus, the braille display and the terminal.
[0101] That is, a braille stylus is used to input (track image) on a braille display, and the braille display sends the track image to the terminal. The terminal analyzes (such as through AI) the track image to determine one or more braille fonts (alternative braille fonts) that it may represent, and sends the alternative braille fonts to the braille display for display. The blind person touches it to determine which one is the braille font he wants to input (the braille font to be confirmed), and the braille font to be confirmed is then sent to the braille stylus and displayed by the first braille display module thereon. If the blind person confirms the braille font to be confirmed, the braille font to be confirmed is sent to the terminal to complete the input.
[0102] As one method of the embodiment of the present disclosure, the braille display can be used as the first device, and the braille stylus and terminal can be used as the second device. The first device includes a second verification unit, which receives authentication information and directly determines that there is a braille interaction requirement after the verification is passed, which can not only facilitate the use of the braille display by the blind (for example, avoiding switch operation), but also ensure that only authorized persons can use the braille display.
[0103] In some embodiments, the braille display further includes a second verification unit for collecting authentication information, the authentication information including fingerprint information; and determining that there is a braille interaction requirement includes:
[0104] In response to the authentication information received by the second verification unit, verifying the authentication information;
[0105] In response to the verification being passed, it is determined that there is a Braille interaction requirement.
[0106] As one embodiment of the present disclosure, the second verification unit may include a fingerprint identifier, which can collect fingerprint information of the user.
[0107] In some embodiments, the first device is a braille display, and after the first device establishes a collaborative connection network with at least one second device, the method further includes:
[0108] Send reading request to the user and accept the user's voice command;
[0109] Send the user's voice command to the terminal;
[0110] Receive and display Braille files sent by the terminal.
[0111] The second device may include a terminal; after the first device establishes a collaborative connection network with at least one second device, the terminal is further used to:
[0112] Receive and analyze the user's voice commands, search for the corresponding files and translate the files into Braille files;
[0113] Returns a braille file to the braille display.
[0114] Through the above operations, after the braille display and the terminal are networked, braille output can be completed through the synergy of the braille display and the terminal.
[0115] That is, the braille display sends a reading request to the user, receives the user's voice command (the voice command includes the article the user wants to read), and then sends the user's voice command to the terminal. After receiving the user's voice command, the terminal searches and downloads the relevant article on the Internet, then calls the terminal's braille translation software, translates the article into braille, and then transmits the translated braille font to the braille display to complete the display.
[0116] Exemplarily, as a specific form of the embodiment of the present disclosure, the first device and the second device include a terminal (hereinafter, a smart phone is used as an example of a terminal), a Braille stylus, and a Braille display. Figure 2 As shown, the smart phone, the braille stylus and the braille display are all built with a soft bus process and a braille service. When the braille service is implemented as an application software (such as a mobile phone APP), the information of the blind user can be registered with the help of the barrier-free mode of the smart phone. The smart phone can collect the fingerprint and voiceprint information of the blind user, send the fingerprint and voiceprint information to the server, and then save the fingerprint and voiceprint information in the database of the user authentication server for subsequent user authentication.
[0117] Figure 7 Figure 1 shows the network environment before the smartphone, Braille stylus, and Braille display are connected to the network. Figure 7As shown, there are multiple WI FI hotspots in the environment, and some terminals are connected to each WI FI hotspot. In addition, the smartphone, braille stylus and braille display are not connected to any network, but all support Bluetooth connection and WI FI connection. It is understandable that Figure 7 What is shown is only an exemplary form of an embodiment of the present disclosure. In an actual environment, at least some of these terminals may also support Bluetooth connection; at least one of the smart phone, the Braille stylus and the Braille display may also only support Bluetooth connection or only support WI FI connection.
[0118] When the need for Braille interaction is confirmed, the Braille stylus or Braille display as the first device will call its built-in distributed soft bus to form a network. Specifically, the distributed soft bus will form a network through discovery services and networking services. As an exemplary method, the discovery service will first start the following Figure 8 The device discovery process is shown in Figure 1. Figure 8 As shown, the discovery service will start Bluetooth scanning and WI FI scanning. Bluetooth scanning will scan all devices with Bluetooth broadcasting around (for example, obtaining device A, device B and device C), and the service list of the device can be obtained by connecting to each device, so as to obtain the device information of the device supporting the soft bus and determine whether the device supports the braille service. After completing the scan, the discovery service will obtain the device list (first device list) of all Bluetooth devices supporting the braille service around. At the same time, the WI FI scan will connect to all hotspots that can be connected, and after connecting, it will start, for example, CoAP (The Constrained Application Protocol) scanning to obtain the device list (second device list) of all WI FI devices supporting the braille service in the hotspot. After obtaining all device lists (including the first device list and the second device list, it is determined which device lists in the device list have completed authentication and have been added to the trusted device, thereby obtaining the device list of the collaborative device (trusted device) (that is, obtaining the device list of the second device supporting the braille service).
[0119] After obtaining the device list of the coordinated devices, the networking service will start as follows Fig. 9 The networking process is shown in Figure 1. Fig. 9As shown in the figure, after obtaining all trusted devices, the networking service will determine the way each collaborative device can be connected. For example, some collaborative devices can only be connected via Bluetooth, and some collaborative devices can only be connected via WI FI, thereby obtaining a list of devices that support Bluetooth and a list of devices connected to the hotspot (a list of devices that support WI FI). For collaborative devices in the list of devices that support Bluetooth, the networking service will share the WI FI name and password with all collaborative devices via Bluetooth; for collaborative devices in the list of devices that support WI FI, the networking service will share the WI FI name and password with all collaborative devices via CoAP (The Constrained Application Protocol). Then, by measuring the energy consumption and speed of each hotspot, a suitable hotspot is selected as a public hotspot. The collaborative devices are connected to the public hotspot and can discover and connect to each other through CoAP messages. At this point, the networking of collaborative devices is completed. Here, different devices may be connected to different networks, some devices are connected via Bluetooth, and some devices are connected to the same WI FI hotspot, thus forming a collaborative heterogeneous network. Even if Bluetooth or WIFI is disconnected, you can reconnect through the networking service or start another communication protocol to maintain the connection channel between collaborative devices.
[0120] Regarding the measurement of energy consumption and speed, it should be noted that: during the networking process, each device will measure the energy consumed by sending or receiving data. After sending a message (or data), the sender (for example, the first device) will measure the energy consumed by sending the message (sending energy), and the receiver (for example, the second device) will measure the energy consumed by receiving the message (receiving energy). Then, by replying a response to the sender, the sender will obtain the total energy consumption of sending and receiving on this path after receiving the response.
[0121] The following will refer to Fig.10 The network shown further illustrates the measurement of energy consumption and speed. To facilitate understanding of the measurement of energy consumption and speed, Fig.10 A smartphone, a braille stylus, a braille display, hotspot AP1 and hotspot AP2 are shown. Among them, the braille stylus supports Bluetooth and WI FI, the smartphone supports Bluetooth and WI FI, and the braille display only supports WI FI connection. When the braille stylus initiates networking, the braille stylus performs energy consumption and speed measurements. When measuring energy consumption, a fixed size of data is used as test data. During measurement, the braille stylus sends the test data to the other end, and then the other end replies with a response after receiving the test data. The response carries information about the other end and information such as energy consumption.
[0122] like Fig.10 As shown, after the networking starts, there are five possible data paths: path P1 between the braille stylus and the smart phone via Bluetooth; path P2 between the braille stylus and the smart phone via hotspot AP1; path P3 between the braille stylus and the smart phone via hotspot AP2; path P4 between the braille stylus and the braille display via hotspot AP1; and path P5 between the braille stylus and the braille display via hotspot AP2.
[0123] For each path, the comprehensive cost f of energy consumption and time spent on each message sending can be calculated according to the formula: f = e1 + e2 + kt, where e1 is the energy consumption (sending energy) spent by the sender, e2 is the energy consumption (receiving energy) spent by the receiver, t is the time spent from sending to receiving the response (i.e., the time difference between sending the test data and receiving the reply information), and k is the weighting coefficient. Here, by adjusting k, it can be adjusted whether energy consumption is more important or network delay is more important. It can be understood that the network delay reflected by time t is negatively correlated with speed. The larger t is, the slower the speed is. Conversely, the smaller t is, the faster the speed is.
[0124] When hotspot AP1 is connected, the total cost of sending to the smartphone and the braille display is measured by the braille stylus, thereby obtaining the overall cost of hotspot AP1. When AP2 is connected, the total cost of sending to the smartphone and the braille display is measured by the braille stylus, thereby obtaining the overall cost of hotspot AP2. The two overall costs are then compared, and the hotspot with the smaller overall cost is selected as the public hotspot. The three devices are then connected to this public hotspot.
[0125] The above formula can also be used to measure the comprehensive cost of sending data via Bluetooth. For data transmission between the Braille stylus and the smartphone, the communication method with the smaller f value (Bluetooth or hotspot) can be selected to send data by comparing the comprehensive cost f of sending test data via Bluetooth with the comprehensive cost f of sending test data via a public hotspot.
[0126] It should be noted that Fig.10 The types, quantities, and communication modes supported by the devices shown are only exemplary, and the types, quantities, and communication modes supported by each device to be networked can be adjusted according to actual needs. For example, when the devices to be networked can be a smart phone, a stylus pen for the blind, and a braille display, each of the smart phone, the stylus pen for the blind, and the braille display can support Bluetooth and WI FI.
[0127] In addition, for collaborative devices in the list of devices that support Bluetooth, connections can be established and speeds can be measured through classic Bluetooth and low-power Bluetooth (Bluetooth Low Energy, BLE) respectively, so as to select a suitable protocol to establish a control channel according to actual needs, and share the WI FI name and password through the control channel. In some embodiments, considering that the braille stylus and braille display are lightweight devices, a connection can be established through BLE. It can be understood that when the networking device is used for large-capacity data transmission (such as audio equipment, file transfer), a connection can be established through classic Bluetooth. In addition, the appropriate protocol can be selected by comprehensively considering power consumption and the amount of data transmitted. For example, for devices with strict requirements on power consumption, long-term operation, and small amount of data transmission, BLE is preferred. For devices with low power consumption requirements but high-speed data transmission requirements, classic Bluetooth is preferred. Of course, a suitable protocol can also be selected according to the connection distance requirements, and classic Bluetooth usually has a wider connection range. In practical applications, it is also possible to choose between classic Bluetooth and BLE according to the type of message to be transmitted. For example, when the content to be transmitted is a control instruction, BLE can be selected; and when transmitting files such as audio, classic Bluetooth is selected. The present disclosure is not limited to the selection of a specific dental protocol.
[0128] After completing the connection between Bluetooth and WI FI, the collaborative devices use lightweight encryption methods, CoAP protocol and BLE protocol to form the control channel of the distributed soft bus; a relatively complex encryption method is used, with the help of RFcomm and CoAP protocol, to form the data channel of the distributed soft bus. After the smartphone, Braille stylus and Braille display are networked, the control channel and data channel are used for the transmission of control instructions and data in the subsequent Braille input and Braille output (the specific process will be described later).
[0129] The collaborative heterogeneous network formed by the above method has both Bluetooth-based network connections and hotspot-based network connections, and uses the CoAP protocol to transmit messages and data, thereby solving the problem of disconnection and blocking of a single network, and also solving the problem of difficult data transmission in different networks. In addition, in the collaborative heterogeneous network formed by the above method, the data format and calling method are unified, so that the transmission of data is invisible to the application layer, and the control channel and the data channel are separated, which can not only ensure the reliable transmission of data, but also avoid the delay of control instructions. Moreover, the optimal AP is selected as the public AP based on energy consumption and message delay, and the comprehensive analysis of energy consumption and message delay at this time is based on the overall calculation of each collaborative device, rather than based on the energy consumption and delay of one device. In addition, when transmitting messages and data, the message delay and power consumption can also be detected at the same time to select the optimal transmission channel.
[0130] Hereinafter, the braille stylus, braille display, and smart device provided by the embodiments of the present disclosure, as well as the input method and output method executed by part or all of the braille stylus, braille display, and smart device will be described. Fig.11 As shown, the braille stylus includes: a handwriting module 1, a first control module 2 and a first braille display module 3, wherein the handwriting module 1 is used to input a track image to the handwriting board of the braille display; the first control module 2 is used to receive the candidate braille font corresponding to the track image; the first braille display module 3 is used to display the candidate braille font; and the first control module 2 is also used to respond to the user confirming that the candidate braille font is the input braille font and send the input braille font to the terminal. The first control module 2 may include a processor and a memory, and has a built-in soft bus process and a braille service.
[0131] In some embodiments, the braille stylus may further include a sensing module 4, which is used to sense that the braille stylus is picked up, and to send an instruction to the first control module 2 after sensing that the braille stylus is picked up; the first control module 2 is also used to call the distributed soft bus process for networking in response to the instruction of the sensing module. In practical applications, the sensing module 4 may include one or more of a gravity sensor, a pressure sensor, a temperature sensor, or a touch sensor.
[0132] In some embodiments, the braille stylus may further include a first verification unit 5 for collecting authentication information, the authentication information including voiceprint information or fingerprint information; the first control module 2 is used to respond to the instruction of the sensing module, send an authentication request to the user, receive the authentication information collected by the first verification unit 5, and call the distributed soft bus process for networking after the authentication is passed. The first verification unit 5 can be a sound collection unit or a fingerprint collection unit. In practical applications, the first verification unit 5 can include a fingerprint identifier or a microphone, the fingerprint identifier can collect the user's fingerprint information, and the microphone can collect the user's voiceprint information.
[0133] Fig.12 A Braille stylus according to an embodiment of the present disclosure is shown. Fig.12 As shown, the braille stylus may include a pen tip 11 and a pen body 12. A first braille display 3 (first braille display module 3) and a first button 6 are provided on the outside of the pen body 12. An electronic eraser 13 is provided on the side of the pen body away from the pen tip. When the eraser 13 starts the erasing action on the handwriting board of the braille display, the handwriting board senses the erasing action and erases the braille touched by the finger on the second braille display at this time. It can be understood that the handwriting module 1 includes a pen tip 11, a pen body 12 and an electronic eraser 13; the first control module 2 is built into the pen body 12, and is connected to the first braille display 3, the sensing module 4, the first verification unit 5 and the first button 6.
[0134] like Fig.13As shown, the braille display comprises a second braille display module 7, a second control module 8 and a handwriting board 9, the handwriting board 9 is used to receive the track image input by the blind stylus; the second control module 8 is used to send the track image to the terminal and receive at least one alternative braille font from the terminal; the second braille display module 7 is used to display at least one alternative braille font received from the terminal; and the second control module is also used to respond to the user's selection and send the user's selected alternative braille font to the braille stylus. The second control module 8 may include a processor and a memory, with a built-in soft bus process and braille service.
[0135] In some embodiments, the braille display further includes a second verification unit 10 for collecting authentication information; the second control module 8 is further used to receive the authentication information collected by the second verification unit 10, and call the distributed soft bus process for networking after the authentication is passed, and after the networking is established, instruct the terminal to start braille output, and receive the braille file sent by the terminal; and the second braille display module 7 is used to display the braille file. In practical applications, the second verification unit 10 may include a fingerprint identifier.
[0136] Fig.14 A braille display according to an embodiment of the present disclosure is shown. Fig.14 As shown, the braille display includes a second braille display (second braille display module) 7, a second button 16, and a handwriting board 9. The second control module 8 is built into the braille display and is connected to the second braille display 7, the handwriting board 9, the second verification unit 10, and the second button 16.
[0137] The second braille display 7 includes a plurality of braille display units arranged in one or more rows, each of which is equipped with a light sensor 17 for sensing the position of a user's finger; each braille display unit includes six braille contacts and a contact control unit for controlling the lifting and lowering of the six braille contacts, and the contact control unit is made of photosensitive liquid crystal material. By using a photosensitive liquid crystal as the control unit of the braille display, the deformation of the liquid crystal can be controlled by controlling the brightness of the light source, thereby controlling the lifting and lowering of the contact, thereby solving the problem of complex mechanical structure.
[0138] The terminal is any smart phone with built-in soft bus process and braille service. In actual application, after the braille user downloads the mobile phone APP, he can register the user information with the help of the barrier-free mode of the smart phone. After the mobile phone collects the user's fingerprint and voiceprint information, it sends the fingerprint and voiceprint information to the server, and then saves the fingerprint and voiceprint information in the database of the user authentication server for subsequent authentication.
[0139] Of course, the braille stylus, braille display and terminal all have a communication module for performing at least one of WI FI and Bluetooth connection. In some embodiments of the present disclosure, the braille stylus, braille display and terminal are all configured to support WI FI and Bluetooth connection simultaneously.
[0140] Fig.15 This is a schematic diagram of the logical process of a user using a braille stylus to input in the handwriting area of a braille display in a braille input method according to an embodiment of the present disclosure. After the user picks up the braille stylus (the sensing module senses that the braille stylus is picked up), the braille stylus will send an authentication request to the user. In the case where the first verification unit 5 is a microphone, the braille stylus requests the user to perform voiceprint authentication. The user inputs a voiceprint instruction through the microphone, and the voiceprint instruction obtained by the microphone is compared with the voiceprint information in the database of the authentication server. After the authentication is passed, the braille service calls the distributed soft bus process to discover the peripheral devices. For the user's first networking, you can execute Figure 8 The device discovery shown in the figure is used to discover nearby trusted devices. For users who are not networking for the first time, the networking service will retain the trusted devices that have been authenticated in the surrounding area. After that, the trusted device will be awakened and start, for example, Fig. 9 The networking process shown in the figure is used for automatic networking. Using the automatic networking capability provided by the distributed soft bus, the braille stylus will select an appropriate networking method to network with the braille display and the smart phone, and instruct each device in the network to start the braille service (at this time, the braille service enters the braille input mode). The braille user only needs to pick up the braille stylus to complete the automatic networking of the braille stylus and other devices (braille display and smart phone) and enable each device to start the braille service. After that, Fig.15 As shown, the user uses a braille stylus to input in the handwriting area of the braille display, and the braille display transmits the trajectory image received in the handwriting area to the smart phone through the data channel. The smart phone generates one or more alternative braille fonts based on the received trajectory image, and transmits the generated one or more alternative braille fonts back to the braille display through the data channel for display.
[0141] Fig.16 FIG. 1 is a schematic diagram of a logical process of a user confirming an input font in a Braille input method according to an embodiment of the present disclosure. Fig.16 As shown, the user selects the font he wants to input from the alternative braille fonts displayed on the braille display (the light sensor 17 can sense which alternative braille font the user's finger is on, that is, the light sensor 17 can sense the position of the user's finger to confirm the alternative braille font currently selected by the user). When it is confirmed that the font currently located by the finger is the font he wants to input, the user clicks the confirmation button ( Fig.12One of the first buttons 6 in the input may be a confirmation button, and the other may be a give-up button), the braille display sends the selected braille font (the braille font to be confirmed) to the braille stylus, which is displayed by the first braille display 3 of the braille stylus. When the customer confirms that the braille font to be confirmed displayed on the first braille display 3 is the font the customer wants to input (the customer clicks the confirmation button of the braille stylus again), the braille stylus will transmit the alternative braille font to the smart phone through the data channel, and at the same time transmit the confirmation instruction to the smart phone. At this time, the braille font to be confirmed is input into the smart phone as the input font. In some embodiments, when the customer confirms that the braille font to be confirmed displayed on the first braille display 3 is the font the customer wants to input (the customer clicks the confirmation button of the braille stylus again), the braille stylus transmits the confirmation instruction to the braille display and the braille display. After receiving the confirmation instruction, the braille display transmits the alternative braille font to the smart phone through the data channel, and the smart phone confirms the input of the alternative braille font according to the confirmation instruction.
[0142] In addition, after completing a line of input, the user can confirm the entire line of input or cancel the entire line of input through the second button 16 (including up and down arrow buttons) of the braille display. After pressing the confirmation button, the entire line of braille data will be saved by the smartphone, and after pressing the cancel button, the braille display will clear the line of braille data and proceed to the next input.
[0143] It should be noted that, in the case where the first braille display 3 is not provided on the braille stylus, the following steps can be omitted: the braille display sends the selected braille font (the braille font to be confirmed) to the braille stylus, which is displayed by the first braille display 3 of the braille stylus. That is, when it is confirmed that the font currently located by the finger is the font to be input, the user clicks the confirmation button of the braille stylus, and the braille stylus sends an instruction to the braille display, instructing the braille display to transmit the alternative braille font to the smart phone through the data channel, and the braille stylus transmits the confirmation instruction to the smart phone, such as Fig.17 shown.
[0144] The Braille input method provided by the embodiments of the present disclosure can effectively improve the accuracy and speed of Braille input and lower the threshold for blind people to use various terminals (such as smart phones).
[0145] Fig.18Schematic diagram of the logical process of a Braille output method according to an embodiment of the present disclosure. In the case where the second verification unit 10 is a fingerprint identifier, after the user presses his finger to the handwriting board, the fingerprint identifier obtains the user's fingerprint, and the fingerprint instruction obtained by the fingerprint identifier is compared with the fingerprint information in the database of the authentication server. After the authentication is passed, the braille service calls the soft bus process to start discovery and networking. The process of discovery and networking can refer to the discovery and networking after the authentication of the pattern information received by the braille stylus in the above-mentioned braille input method is passed, and will not be repeated here. After the networking is completed, each device in the network starts the braille service (at this time, the braille service enters the braille output mode). The braille display sends a reading request to the user, and receives the user's voice command through the microphone (the voice command includes the article you want to read), and then sends the user's voice command to the smartphone. After receiving the user's voice command, the smartphone searches and downloads the relevant article on the Internet, then calls the smartphone's Braille translation software to translate the article into Braille and then calls the soft bus to transmit the translated Braille font to the Braille display for display. The second button 16 (including up and down arrow buttons) is used for the user to turn pages.
[0146] In actual applications, the user can send a reading demand request (voice request) to the user through the braille display, and input a voice command through the microphone set on the braille display to select the article he wants to read. Then the braille display transmits the voice data (voice command) to the smartphone through the data channel, and commands the smartphone to output braille through the control channel. Alternatively, after the braille service enters the braille output mode, the smartphone can also send a reading demand request to the customer through voice, requesting the customer to provide information about the article he wants to read (including at least one of the title, author, date, etc.), and the customer can select the article he wants to read through the smartphone voice interaction. After the smartphone receives the user's command, it uses AI (artificial intelligence) to parse the voice command, then searches for the required article through a search engine, and then translates the searched article into braille through the braille translation service, and outputs braille to the braille display through the data channel.
[0147] Fig.19 FIG. 1 is a logic process diagram of a braille modification method according to an embodiment of the present disclosure. The method is applied to the braille output mode. When the braille display outputs braille, the user can read the braille. If the braille currently being read happens to be the user's notes, the user can modify his or her notes. Fig.19As shown, in the braille output mode, in response to the user holding the braille stylus, the soft bus will start automatic networking, and the braille service will switch to the braille modification mode. Since each braille display component on the braille reader is equipped with a light sensor, the braille display can sense which braille the user is reading when the user reads by hand. Therefore, if the user uses the eraser of the braille stylus to erase the handwriting board area of the braille display, the braille display will send the erase command to the smartphone through the control channel of the soft bus. After the braille service of the smartphone receives the instruction, it will erase the font, and then confirm to the braille display that the font has been successfully erased, and the braille service will enter the second input mode at this time. Different from the above-mentioned input mode, in the second input mode, in addition to referring to the above-mentioned input method for input, that is, using the tip of the braille stylus to write on the handwriting board, and inputting the handwritten font into the document, the second input mode will also synchronously display the modified document on the braille display after the input is completed. The embodiment of the present disclosure also provides a braille input and output system, including a braille stylus, a braille display and a smart phone. The structures of the braille stylus and the braille display can refer to the above description, which will not be repeated here.
[0148] In some embodiments, in response to the braille stylus being picked up and authenticated, the smartphone automatically forms a network with the braille stylus and the braille display through a soft bus, and its built-in braille service starts and enters the input mode; in response to the fingerprint information received on the handwriting board of the braille display passing the authentication, the smartphone automatically forms a network with the braille display through a soft bus, and its built-in braille service starts and enters the output mode; in the output mode, in response to the braille stylus being picked up, the braille service will enter the braille modification mode. Through this startup method, the braille input and output of the smartphone can be separated from the normal functions, so as not to affect the normal operation of the smartphone.
[0149] In addition, standardized Braille services can be provided to smartphones with the help of soft bus technology, so that smartphones can quickly integrate the input and output method. With the help of the capabilities of smartphones, the cost of the Braille input and output system can be reduced, so that the Braille input and output devices only have the most basic functions, and many software and hardware capabilities are provided by smart devices such as smartphones. For blind users, using a smartphone as an entry, a Braille display as an output device, and a Braille stylus as an input device, they can easily and conveniently integrate into the mobile Internet. In a second aspect, the embodiments of the present disclosure provide an electronic device, such as Fig. 20 As shown, it includes a memory and a processor; the memory stores a computer program that can be executed by the processor, and when the computer program is executed by the processor, any networking method of the embodiments of the present disclosure is implemented.
[0150] Thirdly, Fig.21As shown, an embodiment of the present disclosure provides a computer-readable medium on which a computer program is stored. When the computer program is executed by a processor, any networking method of the embodiment of the present disclosure is implemented.
[0151] In a fourth aspect, an embodiment of the present disclosure provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, any one of the networking methods of the embodiments of the present disclosure is implemented.
[0152] Among them, the processor is a device with data processing capabilities, including but not limited to the central processing unit (CPU); the memory is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH); the I / O interface (read-write interface) is connected between the processor and the memory, and can realize information exchange between the memory and the processor, including but not limited to the data bus (Bus), etc.
[0153] Those skilled in the art will appreciate that all or some of the steps, systems, and functional modules / units in the apparatus disclosed above may be implemented as software, firmware, hardware, or a suitable combination thereof.
[0154] In hardware implementations, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation.
[0155] Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit (CPU), a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-temporary medium) and a communication medium (or temporary medium). As known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data). Computer storage media include, but are not limited to, random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH) or other disk storage; read-only compact disk (CD-ROM), digital versatile disk (DVD) or other optical disk storage; magnetic cassettes, magnetic tapes, disk storage or other magnetic storage; any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0156] The present disclosure has disclosed example embodiments, and although specific terms are employed, they are used and should be interpreted only in a general illustrative sense and not for limiting purposes. In some instances, it will be apparent to those skilled in the art that, unless otherwise expressly stated, features, characteristics, and / or elements described in conjunction with a particular embodiment may be used alone or in combination with features, characteristics, and / or elements described in conjunction with other embodiments. Therefore, those skilled in the art will appreciate that various changes in form and detail may be made without departing from the scope of the present disclosure as set forth in the appended claims.
Claims
1. A networking method, applied to a first device, the method include: Determine that there is a need for Braille interaction; In response to the braille interaction requirement, obtaining a device list of second devices supporting braille services; The device list is a device mapping table of a first device and a second device based on a Braille service and having a device mutual discovery capability obtained through a distributed service architecture; According to the device list, the first device and the second device establish a collaborative connection network.
2. The method according to claim 1, in, The first device and at least one of the second devices can be connected to each other through a plurality of different candidate hotspots; wherein, according to the device list, the first device and the second device establish a collaborative connection network including: Obtaining the overall cost of each of the candidate hotspots; the overall cost of the candidate hotspot is the sum of the comprehensive costs of the first device connecting to each of the at least one second device through the candidate hotspot, and the comprehensive cost is positively correlated with the energy consumption and time of information exchange between the first device and the second device; Selecting the candidate hotspot with the lowest overall cost as the public hotspot; The first device and the at least one second device access the public hotspot.
3. The method according to claim 2, in, The number of the at least one second device is multiple, and at least some of the second devices are Bluetooth second devices that can be connected to the first device via Bluetooth; the method further includes: Obtaining a comprehensive cost of connecting to each of the Bluetooth second devices via Bluetooth; In response to the comprehensive cost of connecting with any Bluetooth second device via Bluetooth being less than the comprehensive cost of connecting with the Bluetooth second device via the public hotspot, establishing a Bluetooth connection with the Bluetooth second device.
4. The method according to claim 2, in, The overall cost of obtaining each candidate hotspot includes: The first device and each of the second devices access the candidate hotspot; Obtaining a comprehensive cost of connecting to each of the second devices; summing the comprehensive costs of connecting to each of the second devices to obtain the overall cost of the candidate hotspots; The comprehensive cost of obtaining the connection with each second device includes: Sending preset test data to each of the second devices, and determining the transmission energy consumed by sending the test data; receiving reply information from each of the second devices; the reply information including reception energy consumed by the second device in receiving the test data; The comprehensive cost of connecting to the second device is determined based on the sending energy, the receiving energy, and the time difference between sending the test data and receiving the reply information corresponding to each of the second devices.
5. The method according to claim 1, in, The first device and the second device for establishing a collaborative connection network include: A braille stylus, comprising a first braille display module; A braille display, comprising a second braille display module and a handwriting board; terminal.
6. The method according to claim 5, in, The first device is the Braille stylus, and the Braille stylus further comprises a sensing module for sensing whether the Braille stylus is held up; Determining whether there is a need for Braille interaction includes: In response to the sensing module sensing that the Braille stylus is held up, it is determined that there is a Braille interaction requirement.
7. The method according to claim 6, in, The Braille stylus also includes a first verification unit for collecting authentication information, wherein the authentication information includes voiceprint information or fingerprint information; In response to the sensing module sensing that the braille stylus is held up, determining that there is a braille interaction requirement includes: In response to the sensing module sensing that the Braille stylus pen is held up, receiving the authentication information collected by the first verification unit, and verifying the authentication information; In response to the verification being passed, it is determined that there is a Braille interaction requirement.
8. The method according to claim 5, in, The first device is the Braille stylus; After the first device establishes a collaborative connection network with at least one of the second devices, the method further includes: Inputting a trajectory image into a handwriting board of the braille display; receiving a braille font to be confirmed from the braille display; Displaying the to-be-confirmed Braille font by means of the first Braille display module; In response to receiving a confirmation instruction from the user, the to-be-confirmed Braille font is sent to the terminal as an input Braille font.
9. The method according to claim 8, in, The second device includes the braille display; after the first device establishes a collaborative connection network with at least one of the second devices, the braille display is further used to: receiving, through the handwriting board, a trajectory image input by the Braille stylus; Sending the trajectory image to the terminal; receiving at least one candidate Braille font from the terminal, and displaying the candidate Braille font through the second Braille display module; According to the user's selection instruction, select the braille font to be confirmed from the candidate braille fonts; The to-be-confirmed Braille font is sent to the Braille stylus.
10. The method according to claim 9, in, The second device further includes the terminal; after the first device establishes a collaborative connection network with at least one of the second devices, the terminal is further used to: receiving a trajectory image from the braille display; generating at least one candidate Braille font according to the trajectory image; sending the candidate braille font to the braille display; Receive input braille font from the braille stylus, and enter the input braille font.
11. The method according to claim 5, in, The first device is the braille display, and the braille display further comprises a second verification unit for collecting authentication information, and the authentication information comprises fingerprint information; Determining whether there is a need for Braille interaction includes: In response to the authentication information received by the second verification unit, verify the authentication information; In response to the verification being passed, determining that there is a Braille interaction requirement, and After the first device establishes a collaborative connection network with at least one of the second devices, the method further includes: Send reading request to the user and accept the user's voice command; Send the user's voice command to the terminal; Receive and display the Braille file sent by the terminal.
12. The method according to claim 5, in, The second device is the terminal; after the first device establishes a collaborative connection network with at least one of the second devices, the terminal is further used to: Receive and analyze the user's voice commands, search for the corresponding files and translate the files into Braille files; The Braille file is returned to the Braille display.
13. An electronic device comprising a memory and a processor; the memory stores a computer program that can be executed by the processor, and when the computer program is executed by the processor, it implements the networking method described in any one of claims 1 to 12.
14. A computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the networking method according to any one of claims 1 to 12.
15. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the networking method according to any one of claims 1 to 12 is implemented.
