Reading assisting device and method, equipment and storage medium

Abstract

The embodiment of the invention provides a reading assisting device, method and equipment and a storage medium, the reading assisting device comprises a host and a shell, the host is detachably arranged on the shell, a scanning module is arranged on the host, and the host is further used for being connected with an earphone. When a user needs reading assistance, the user can take down the host from the shell of the reading assistance device and use the scanning module to scan newspapers or magazines, after the scanning module collects image information on the newspapers or magazines, the host recognizes characters in the image information, converts the recognized characters into voice data, and sends the voice data to the user. The voice data is played through the earphone, so that a user can acquire information on newspapers or magazines through voice. According to the embodiment of the invention, the external information acquisition mode of the blind can be expanded, so that the blind can know text information without relying on braille alphabets, and the technical problem that the external information acquisition mode of the blind is limited in the existing mode is solved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of information technology, and in particular to a reading assistance device, method, equipment and storage medium. Background Art

[0002] At present, there are 17 million blind people in my country, which means that one in every 80 people is visually impaired. For the blind, they can only obtain external information through Braille, but not all newspapers and magazines are friendly with Braille, which leads to limited ways for the blind to obtain information.

[0003] To sum up, how to expand the channels for blind people to obtain external information has become a technical problem that urgently needs to be solved. Summary of the invention

[0004] The embodiments of the present invention provide a reading assistance device, method, equipment and storage medium. The embodiments of the present invention can expand the ways in which blind people obtain external information, and solve the technical problem that the ways in which blind people obtain external information in the existing methods are limited.

[0005] In a first aspect, an embodiment of the present invention provides a reading assistance device, comprising a host and a shell, wherein the host is detachably arranged on the shell, a scanning module is arranged on the host, and the host is also used to connect to a headset;

[0006] The host is used to send a start instruction to the scanning module in response to the scanning instruction to start the scanning module; and is used to obtain the image information scanned by the scanning module, recognize the text in the image information, generate voice data according to the recognized text, and play the voice data through the earphone;

[0007] The scanning module is used to start scanning in response to the start instruction to collect image information on the scanning path.

[0008] Preferably, the host is magnetically attracted to the shell.

[0009] Preferably, the headset is a Bluetooth headset, and the host is used to wirelessly connect to the Bluetooth headset and transmit the voice data to the Bluetooth headset for playback.

[0010] Preferably, an earphone compartment is provided on the shell, and the host is provided on the shell as a cover of the earphone compartment, and the earphone compartment is used for placing the Bluetooth earphone.

[0011] Preferably, the earphones are magnetically attached to the host.

[0012] Preferably, the host also obtains auxiliary information in response to the information playing instruction, converts the auxiliary information into auxiliary voice data, and plays the auxiliary voice data through the earphone.

[0013] In a second aspect, an embodiment of the present invention provides a reading assistance method, which is applicable to a host of a reading assistance device, wherein a scanning module is provided on the host, and the host is also used to connect to a headset, and the method includes:

[0014] In response to the scanning instruction, sending a start instruction to the scanning module to start the scanning module;

[0015] Acquire the image information scanned by the scanning module, and recognize the text in the image information;

[0016] Voice data is generated according to the recognized text, and the voice data is played through the earphone.

[0017] Preferably, the headset is a Bluetooth headset, and after the host sends a start instruction to the scanning module, the host further includes:

[0018] Connect with the Bluetooth headset.

[0019] In a third aspect, an embodiment of the present invention provides a reading assistance device, the reading assistance device comprising a processor and a memory;

[0020] The memory is used to store a computer program and transmit the computer program to the processor;

[0021] The processor is used to execute a reading assistance method as described in the first aspect according to instructions in the computer program.

[0022] In a fourth aspect, an embodiment of the present invention provides a storage medium storing computer executable instructions, wherein the computer executable instructions, when executed by a computer processor, are used to execute a reading assistance method as described in the first aspect.

[0023] As described above, the embodiments of the present invention provide a reading assistance device, method, equipment and storage medium. The reading assistance device includes a host and a shell. The host is detachably arranged on the shell. A scanning module is arranged on the host. The host is also used to connect to headphones. When a user needs reading assistance, the user can remove the host from the shell of the reading assistance device and use the scanning module to scan on a newspaper or magazine. After the scanning module collects the image information on the newspaper or magazine, the host recognizes the text in the image information and converts the recognized text into voice data. The voice data is played through the headphones, so that the user can obtain information on the newspaper or magazine through voice. The embodiments of the present invention can expand the ways in which blind people obtain external information, allowing blind people to understand text information without relying on Braille. The blind do not even need to be literate, as long as they can understand Mandarin. This solves the technical problem of the limited ways in which blind people obtain external information in the existing methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A front view of a reading assistance device provided by an embodiment of the present invention.

[0025] Figure 2 A side view of a reading assistance device provided by an embodiment of the present invention.

[0026] Figure 3 A working principle diagram of a reading assistance device provided by an embodiment of the present invention.

[0027] Figure 4 A flowchart of a reading assistance method provided by an embodiment of the present invention.

[0028] Figure 5 A schematic diagram of an earphone compartment provided in a reading assistance device provided in an embodiment of the present invention.

[0029] Figure 6 A schematic diagram of an earphone magnetically attached to a host provided by an embodiment of the present invention.

[0030] Figure 7 A structural schematic diagram of a reading assistance device provided by an embodiment of the present invention.

[0031] Reference numerals:

[0032] Shell 10 , strap 11 , host 20 , scanning module 21 , earphone 30 , earphone compartment 12 , magnet 22 . DETAILED DESCRIPTION

[0033] The following description and accompanying drawings fully illustrate the specific embodiments of the present application so that those skilled in the art can practice them. The examples represent possible variations only. Unless explicitly required, separate components and functions are optional, and the order of operation can vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. The scope of the embodiments of the present application includes the entire scope of the claims, and all available equivalents of the claims. In this article, each embodiment may be represented individually or generally by the term "invention", which is only for convenience, and if more than one invention is disclosed in fact, it is not intended to automatically limit the scope of the application to any single invention or inventive concept. In this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, without requiring or implying any actual relationship or order between these entities or operations. Moreover, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method or device including a series of elements includes not only those elements, but also other elements that are not explicitly listed. The various embodiments are described in a progressive manner herein, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other. As for the structures, products, etc. disclosed in the embodiments, since they correspond to the parts disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method part.

[0034] like Figure 1 As shown, Figure 1 The structure diagram of a reading assistance device provided by an embodiment of the present invention is as follows. The reading assistance device provided by an embodiment of the present invention comprises a host and a shell. The host is detachably mounted on the shell, and the shell is used to fix the host. For example, Figure 1 and Figure 2 As shown, Figure 1 is a front view of a reading assistive device, Figure 2 1 is a side view of a reading assistance device, which can be in the form of a watch, a strap 11 and a bracket 20 for fixing a host can be provided on a housing 10, and the host 20 can be detachably provided on the bracket 10, so as to facilitate the user to take it. In addition, in this embodiment, a scanning module 21 is provided on the host 20, and the host 20 is also used to connect with a headset 30.

[0035] The host is used to respond to the scanning instruction and send a start instruction to the scanning module to start the scanning module; and is used to obtain the image information scanned by the scanning module, recognize the text in the image information, generate voice data according to the recognized text, and play the voice data through the earphone.

[0036] In this embodiment, when the user needs to use a reading assistance device to assist reading, the user needs to send a scanning instruction to the host to activate the reading assistance function of the host. The method in which the user sends the scanning instruction to the host can be set according to actual needs. For example, a physical button can be set on the host, and when the physical button is triggered, the user can send a scanning instruction to the host; or the user can send a scanning instruction to the host by voice command; or, a posture sensor is set on the host, and when the user removes the host from the shell, the scanning instruction can be automatically triggered. It can be understood that the specific method in which the user sends the scanning instruction in this embodiment can be set according to actual needs, and the specific method in which the user sends the scanning instruction is not limited in this embodiment.

[0037] After receiving the scanning instruction, the host responds to the scanning instruction. At this time, the host sends a start instruction to the scanning module, thereby starting the scanning module to scan the text and generate image information according to the scanning results. After the scanning module generates the image information, the host obtains the image information from the scanning acquisition and recognizes the text in the image information. The host can use the OCR method to recognize the text information in the image. OCR (Optical Character Recognition) refers to the process of electronic devices scanning characters printed on paper, determining their shapes by detecting dark and light patterns, and then translating the shapes into computer text using character recognition methods. After recognizing the text in the image information, the host can further convert the recognized text into voice data. There are several ways to convert text into voice data: 1. Model-based text-to-speech: a method that uses a statistical pronunciation model and a voice feature library to map text to speech. 2. Phoneme synthesis: by dividing the text into units and then generating speech according to rules, the units are assembled into complete sentences. 3. Text-to-speech based on neural network: The task of converting text to speech is implemented using neural network technology, which can directly output the backend feature sequence based on the speech feature library and the sequence of characters in the input text. 4. Text-to-speech based on deep learning: Using deep learning algorithms, using a massive text-to-speech corpus, extract text features and map them to speech. After generating speech data, the host can play the speech data through headphones.

[0038] The scanning module is used to start scanning in response to a start instruction to collect image information on the scanning path.

[0039] In this embodiment, after receiving the start instruction sent by the host, the scanning module responds to the start instruction, and then the scanning module starts scanning and captures image information on the scanning path.

[0040] For example, when a user needs reading assistance, the user can wear headphones and remove the host from the shell of the reading assistance device. After the host detects that it has been removed by the user, it triggers a scanning instruction. The host responds to the scanning instruction and sends a start instruction to the scanning module to start the scanning module. After that, the user can use the scanning module to scan newspapers or magazines. After the scanning module collects image information on the newspaper or magazine, the host recognizes the text in the image information, converts the recognized text into voice data, and plays the voice data through the headphones, so that the user can obtain information on the newspaper or magazine. The specific process is as follows: Figure 3 shown.

[0041] In addition, the embodiment of the present invention also provides a reading assistance method, such as Figure 4 As shown, Figure 4 The flowchart of a reading assistance method provided by an embodiment of the present invention is shown in FIG. 1 . The reading assistance method provided by an embodiment of the present invention is applicable to a host of a reading assistance device. The reading assistance method includes:

[0042] Step 201: In response to a scanning instruction, a start instruction is sent to a scanning module to start the scanning module.

[0043] Step 202: Acquire the image information scanned by the scanning module, and recognize the text in the image information.

[0044] Step 203: Generate voice data according to the recognized text, and play the voice data through headphones.

[0045] As mentioned above, an embodiment of the present invention provides a reading assistance device, including a host and a shell, wherein the host is detachably arranged on the shell, and a scanning module is arranged on the host, and the host is also used to connect to headphones. When a user needs reading assistance, the user can remove the host from the shell of the reading assistance device, and use the scanning module to scan on a newspaper or magazine. After the scanning module collects the image information on the newspaper or magazine, the host recognizes the text in the image information, and after converting the recognized text into voice data, the voice data is played through the headphones, so that the user can obtain information on the newspaper or magazine through voice. The embodiment of the present invention can expand the way blind people obtain external information, so that blind people can understand text information without relying on Braille, and even blind people do not need to be literate, as long as they can understand Mandarin, which solves the technical problem of limited ways for blind people to obtain external information in the existing method.

[0046] Based on the above embodiment, the host is magnetically attracted to the shell.

[0047] In one embodiment, the host is magnetically mounted on the housing. Specifically, permanent magnets with opposite polarities can be mounted on the host and the housing, respectively, to achieve the magnetic attraction function. The magnetic mounting method makes it easy for users to pick up the device, which is stable and reliable. At the same time, the insertion and extraction force can be adjusted by the size and orientation of the permanent magnet, giving users a better experience.

[0048] Based on the above embodiment, the headset is a Bluetooth headset, and the host is used to wirelessly connect to the Bluetooth headset and transmit voice data to the Bluetooth headset for playback.

[0049] In one embodiment, the headset is a Bluetooth headset, and the host is used to wirelessly connect to the Bluetooth headset, and to transmit the voice data to the Bluetooth headset for playback after the voice data is subsequently generated. Specifically, the host is also provided with Bluetooth, and the host can turn on Bluetooth after power-on, search for Bluetooth headsets within the Bluetooth connection range, and connect to the Bluetooth headset. In addition, the host can also turn on Bluetooth after receiving the headset connection instruction, for example, the host triggers the headset connection instruction when it detects that it is removed from the shell by the user; or it directly turns on Bluetooth after power-on. On the basis of the above embodiment, after the host sends a startup instruction to the scanning module, it also includes: connecting with the Bluetooth headset.

[0050] In one embodiment, after the host sends a start instruction to the scanning module, the host will also connect to the Bluetooth headset, so that the user will only connect to the Bluetooth headset when the user needs to assist in reading, saving power of the host and the Bluetooth headset. In this embodiment, by setting the headset as a Bluetooth headset, the constraints of the data cable can be further eliminated, thereby improving the flexibility of the use process and the user's experience.

[0051] On the basis of the above embodiment, an earphone compartment is provided on the shell, and the host is provided on the shell as a cover of the earphone compartment, and the earphone compartment is used to place the Bluetooth earphone.

[0052] In one embodiment, if Figure 5 As shown, the housing 10 is also provided with an earphone compartment 12, wherein the earphone compartment 12 is used to place a Bluetooth earphone, and the host 20 is provided on the housing 10 as a cover of the earphone compartment 12. By providing an earphone compartment and placing the Bluetooth earphone in the earphone compartment, the integration of the Bluetooth earphone and the reading assistive device can be improved, and the Bluetooth earphone and the reading assistive device can be conveniently carried together, thereby avoiding the situation where the user forgets to bring the Bluetooth earphone. When the user removes the host of the reading assistive device, the Bluetooth earphone in the earphone compartment can be removed; and when the user is finished using it, the Bluetooth earphone can be placed back in the earphone compartment and the host can be covered. This method can avoid the loss of the Bluetooth earphone due to the user forgetting the storage location of the Bluetooth earphone as much as possible, and the user can also quickly and conveniently take and store the earphone during use, which greatly improves the user experience.

[0053] Based on the above embodiment, the earphones are magnetically attached to the host.

[0054] In one embodiment, when the Bluetooth headset is placed in the headset compartment, the Bluetooth headset will be magnetically attracted to the host, so that when the user removes the host from the shell, the headset will be adsorbed on the host and follow the host out of the headset compartment. Figure 6 As shown, Figure 6 The reference numeral 22 is a magnet. The user only needs to remove the earphone from the host, and does not need to take out the Bluetooth earphone from the earphone compartment, which simplifies the user's operation steps and further improves the user's experience.

[0055] On the basis of the above embodiment, the host also responds to the information playing instruction, obtains auxiliary information, converts the auxiliary information into auxiliary voice data, and plays the auxiliary voice data through the earphone.

[0056] In one embodiment, when the user needs the headset to play auxiliary voice data, the user can also send an information playback instruction to the host so that the host transmits the auxiliary voice data to the headset for playback. For example, the auxiliary voice data can be voice data including the current time, voice data including the current weather, or voice data including the current location, etc. The user can send an information playback instruction to the host by means of a voice signal or by pressing a physical button on the host. After receiving the information playback instruction, the host can obtain the corresponding auxiliary information. For example, if the user presses the physical button once, the auxiliary information obtained is the information of the current time, if the user presses the physical button twice, the auxiliary information obtained is the current weather information, and if the user presses the physical button three times, the auxiliary information obtained is the current location information. The method for obtaining the auxiliary information can be set according to actual needs, for example, it can be obtained locally or through a server, etc. This embodiment does not limit the specific method for obtaining the auxiliary information. After obtaining the auxiliary information, the host can convert the auxiliary information into auxiliary voice data and play the auxiliary voice data through the headset, so that the user can know the current time, weather or location, etc., to improve the user experience.

[0057] As mentioned above, an embodiment of the present invention provides a reading assistance device, including a host and a shell, wherein the host is detachably arranged on the shell, and a scanning module is arranged on the host, and the host is also used to connect to headphones. When a user needs reading assistance, the user can remove the host from the shell of the reading assistance device, and use the scanning module to scan on a newspaper or magazine. After the scanning module collects the image information on the newspaper or magazine, the host recognizes the text in the image information, and after converting the recognized text into voice data, the voice data is played through the headphones, so that the user can obtain information on the newspaper or magazine through voice. The embodiment of the present invention can expand the way blind people obtain external information, so that blind people can understand text information without relying on Braille, and even blind people do not need to be literate, as long as they can understand Mandarin, which solves the technical problem of limited ways for blind people to obtain external information in the existing method.

[0058] It is worth noting that in the above-mentioned embodiment of the reading assistance device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present invention.

[0059] This embodiment also provides a reading auxiliary device, such as Figure 7 As shown, Figure 7 This is a structural diagram of a reading assistance device provided by an embodiment of the present invention. The reading assistance device 30 includes a processor 300 and a memory 301;

[0060] The memory 301 is used to store the computer program 302 and transmit the computer program 302 to the processor 300;

[0061] The processor 300 is used to execute the steps in the above-mentioned reading assistance method embodiment according to the instructions in the computer program 302.

[0062] Exemplarily, the computer program 302 may be divided into one or more modules / units, one or more modules / units are stored in the memory 301, and executed by the processor 300 to complete the present application. One or more modules / units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 302 in the reading assistive device 30.

[0063] The reading assistance device 30 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The reading assistance device 30 may include, but is not limited to, a processor 300 and a memory 301. Those skilled in the art will appreciate that Figure 7This is only an example of the reading assistance device 30 and does not constitute a limitation of the reading assistance device 30. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the reading assistance device 30 may also include input and output devices, network access devices, buses, etc.

[0064] The processor 300 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0065] The memory 301 may be an internal storage unit of the reading assistive device 30, such as a hard disk or memory of the reading assistive device 30. The memory 301 may also be an external storage device of the reading assistive device 30, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the reading assistive device 30. Further, the memory 301 may also include both an internal storage unit of the reading assistive device 30 and an external storage device. The memory 301 is used to store computer programs and other programs and data required by the reading assistive device 30. The memory 301 may also be used to temporarily store data that has been output or is to be output.

[0066] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0067] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0068] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0069] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0070] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store computer programs.

[0071] An embodiment of the present invention further provides a storage medium containing computer executable instructions. When the computer executable instructions are executed by a computer processor, they are used to perform a reading assistance method. The method includes the following steps:

[0072] In response to the scanning instruction, sending a start instruction to the scanning module to start the scanning module;

[0073] Acquire the image information scanned by the scanning module and recognize the text in the image information;

[0074] Voice data is generated according to the recognized text, and the voice data is played through the earphone.

[0075] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the embodiments of the present invention are not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the embodiments of the present invention. Therefore, although the embodiments of the present invention are described in more detail through the above embodiments, the embodiments of the present invention are not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.

Claims

1. A reading assisting device, characterized in that: It comprises a host and a shell, wherein the host is detachably arranged on the shell, a scanning module is arranged on the host, and the host is also used to connect with the earphone; The host is used to send a start instruction to the scanning module in response to the scanning instruction to start the scanning module; and is used to obtain the image information scanned by the scanning module, recognize the text in the image information, generate voice data according to the recognized text, and play the voice data through the earphone; The scanning module is used to start scanning in response to the start instruction to collect image information on the scanning path.

2. A reading assistance device according to claim 1, characterized in that: The host is magnetically attracted to the shell.

3. A reading assistance device according to claim 1, characterized in that: The earphone is a Bluetooth earphone, and the host is used to wirelessly connect to the Bluetooth earphone and transmit the voice data to the Bluetooth earphone for playback.

4. A reading assistance device according to claim 3, characterized in that: The shell is provided with an earphone compartment, and the host is arranged on the shell as a cover of the earphone compartment, and the earphone compartment is used to place the Bluetooth earphone.

5. A reading assistance device according to claim 4, characterized in that: The earphone is magnetically attached to the host.

6. A reading assistance device according to claim 1, characterized in that: The host also obtains auxiliary information in response to the information playing instruction, converts the auxiliary information into auxiliary voice data, and plays the auxiliary voice data through the earphone.

7. A reading assistance method, characterized in that: The method is applicable to a host of a reading assistance device, wherein a scanning module is provided on the host, and the host is also used to connect to a headset, and the method comprises: In response to the scanning instruction, sending a start instruction to the scanning module to start the scanning module; Acquire the image information scanned by the scanning module, and recognize the text in the image information; Voice data is generated according to the recognized text, and the voice data is played through the earphone.

8. A reading assistance method according to claim 7, characterized in that: The headset is a Bluetooth headset, and after the host sends a start instruction to the scanning module, the host further includes: Connect with the Bluetooth headset.

9. A reading assistive device, characterized in that: The reading assistance device includes a processor and a memory; The memory is used to store a computer program and transmit the computer program to the processor; The processor is used to execute a reading assistance method according to any one of claims 1 to 6 according to instructions in the computer program.

10. A storage medium storing computer executable instructions, characterized in that: When the computer executable instructions are executed by a computer processor, they are used to perform a reading assistance method according to any one of claims 1 to 6.

Images