A scanning and reading method, system and scanning and reading pen based on big data

Abstract

The present invention relates to the field of scanning pen technology, and specifically discloses a scanning and reading method, system, and scanning and reading pen based on big data. The system comprises a scanning module for scanning image information; a main control module for outputting control instructions; an image preprocessing module for preprocessing image information scanned by the scanning module; and a dual-mode communication module for performing wireless data communication and transmitting preprocessed image information. The present invention utilizes dual-mode online communication to implement complex calculations on a cloud server, thereby reducing the hardware configuration and terminal cost of the scanning and reading pen terminal. Communication utilizes LTE CAT1 or Wi-Fi, allowing users to use the pen anytime and anywhere, free from location restrictions. Furthermore, the scanning pen can also perform autonomous learning to adapt to different fonts, reducing inaccuracies.

Description

Technical Field

[0001] The present invention relates to the field of scanning pen technology, and in particular to a scanning method, system and scanning pen based on big data. Background Art

[0002] Big data technology refers to techniques and tools used to process, analyze, and manage large-scale data sets. With the widespread adoption of the Internet and the Internet of Things, the amount of data continues to grow, and the demand for data processing and analysis is also increasing, giving rise to big data technology. Existing scanning pens primarily rely on image acquisition and recognition, but this recognition method suffers from numerous drawbacks, such as:

[0003] First, most scanning pen products use a combination of offline and online solutions, which have relatively high requirements for hardware configuration such as processors and memory, resulting in high product prices and no competitive advantage in the market. Second, scanning pens rely on Wi-Fi network communication, which limits their use in places without Wi-Fi, such as outdoors. In addition, image recognition is mainly based on printed publications, which are relatively prone to dirt and different fonts that affect recognition.

[0004] In order to solve the above problems, we propose a scanning method, system and scanning pen based on big data. Summary of the Invention

[0005] The present invention aims to provide a big data-based scanning method, system, and scanning pen that reduces application processor requirements, supports LTE CAT1 and Wi-Fi wireless communications, and eliminates limitations on usage locations. This will facilitate product adoption and enhance user experience.

[0006] To achieve the above objectives, the present invention provides the following technical solution: a scanning and reading system based on big data, wherein:

[0007] A scanning module, configured to scan image information;

[0008] A main control module, the control module is used to output control instructions;

[0009] An image preprocessing module, configured to preprocess the image information scanned by the scanning module;

[0010] A dual-mode communication module, the dual-mode communication module is used to perform wireless data communication and send pre-processed image information;

[0011] A cloud server connected to the dual-mode communication unit, configured to provide big data services, recognize pre-processed images, and feed back voice data;

[0012] The sound-generating module is used to generate sound based on the sound data fed back by the cloud server.

[0013] As a preferred embodiment of the present invention, it further includes:

[0014] A local recognition module, the local recognition module is used to recognize the scanned image information when offline, and compare the information with local information to retrieve the sound information;

[0015] A storage module is used to store local data, and the local data includes a dictionary data package.

[0016] As a preferred embodiment of the present invention, the image preprocessing module includes a cropping module for performing image cropping and a format conversion module for performing format conversion.

[0017] As a preferred embodiment of the present invention, the dual-mode communication module includes an LTE CAT1 wireless communication module and a Wi-Fi module.

[0018] As a preferred embodiment of the present invention, the cloud server includes:

[0019] An image processing module, which is used to perform grayscale processing, brightness and contrast adjustment, image cropping, and image background removal on the image;

[0020] An OCR recognition module is used to recognize the processed image and output a recognition result;

[0021] A data packet generation module, which is used to translate, segment, and perform TTS processing on the recognized text;

[0022] The database module is used to store vocabulary data to provide a reference for the OCR recognition module.

[0023] A big data-based scanning and reading pen includes: a main control board, a Wi-Fi module connected to the main control board, a scanning head connected to the main control board, a speaker connected to the main control board, a microphone connected to the main control board, an LCD connected to the main control board, a battery connected to the main control board, and a TF card connected to the main control board. The main control board includes an LTE CAT1 wireless communication unit for data communication between the scanning and reading pen and a backend server; the TF card is used to store resource files required for point reading; the LTE CAT1 wireless communication unit and the Wi-Fi module are used to communicate with a cloud server; the LTE CAT1 wireless communication unit includes a USIM unit and an antenna.

[0024] As a preferred embodiment of the present invention, it further includes a fill light connected to the main control board and an infrared fill light connected to the main control board;

[0025] As a preferred embodiment of the present invention, the scanning pen further includes an OTA remote software upgrade module and a data line online software upgrade module.

[0026] A scanning method based on big data, the method comprising the following steps:

[0027] Step S1: When the scanning pen scans text, a scanning base point is determined by using a first point of identifiable data to generate a first scanning image and a first base point motion image;

[0028] Step S2: detecting the user's directional operation on the target object through the first base point motion image, wherein the directional operation is used to determine the recognized point reading intention;

[0029] Step S3: Image recognition: the scanned image is recognized and the corresponding voice information is retrieved from the local database. If it cannot be recognized, it is uploaded to the cloud and recognized by the cloud database. If it still cannot be recognized, the image information is recorded and uploaded to the cloud server;

[0030] Step S4: Scan the text again and repeat steps S1-S3 until the text information is recognized. The image information uploaded to the cloud server is linked to the voice information corresponding to the text information, the image features are analyzed, and a new recognition package is generated and sent to the scanning pen for data upgrade.

[0031] As a preferred embodiment of the present invention, in this method, after the scanning pen completes scanning and taking pictures, it only needs to perform a series of image data cropping and format conversion processing, and image recognition, feature analysis and generation of new data packets are all completed on the online cloud server.

[0032] Compared with the prior art, the present invention has the following beneficial effects:

[0033] This invention uses dual-mode online communication to offload complex calculations to a cloud server, reducing the hardware configuration and terminal costs of the scanning pen. Communication uses LTE CAT1 or Wi-Fi, allowing users to use it anytime, anywhere, without being restricted by location. Furthermore, the scanning pen can autonomously learn to adapt to different fonts, reducing inaccuracies. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention.

[0035] Figure 1 The structure of the system of the present invention Figure 1 ;

[0036] Figure 2 The structure of the system of the present invention Figure 2 ;

[0037] Figure 3 This is a structural diagram of the image preprocessing module of the system of the present invention;

[0038] Figure 4 This is a diagram of the cloud server structure of the system of the present invention;

[0039] Figure 5 This is a structural diagram of the scanning pen of the present invention;

[0040] Figure 6 The present invention is a flowchart of the method. DETAILED DESCRIPTION

[0041] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0042] Example 1

[0043] See also Figure 1 In order to achieve the above-mentioned purpose, the present invention describes the technical solution of the present invention in detail.

[0044] The present invention proposes a scanning and reading system based on big data, wherein:

[0045] A scanning module 100, which is used to scan image information;

[0046] A main control module 200, which is used to output control instructions;

[0047] An image preprocessing module 300, configured to preprocess the image information scanned by the scanning module;

[0048] A dual-mode communication module 400, configured to perform wireless data communication and transmit pre-processed image information;

[0049] A cloud server 500, connected to the dual-mode communication unit, is used to provide big data services, recognize pre-processed images, and feed back sound data;

[0050] The sounding module 600 is used to make sounds according to the sounding data fed back by the cloud server.

[0051] When in use, first start the device through the main control module control device, connect the device to the cloud server through the dual-mode communication module, then scan the image information through the scanning module, and feed the image information back to the image preprocessing module for image cropping and format conversion preprocessing. In order to facilitate the identification of the image information, the image information is numbered and named, and then the image information is uploaded to the cloud server. The cloud server further processes the image information and identifies the text information, and feeds the text information back to the main control module. The main control module controls the sound module to make sound based on the information.

[0052] For further information, see Figure 2 , also includes:

[0053] A local recognition module 700 is used to recognize scanned image information offline and compare the information with local information to retrieve sound information;

[0054] A storage module 800 is used to store local data, including dictionary data packets;

[0055] Specifically, the device is first started through the control device of the main control module, and the device is connected to the cloud server through the dual-mode communication module. Then, the image information is scanned through the scanning module, and the image information is fed back to the image preprocessing module for image cropping and format conversion preprocessing. In order to facilitate the identification of the image information, the image information is numbered and named. Then, the text is recognized through the local recognition module combined with the information stored in the storage module, and the main control module controls the sound module to make sound according to the information; through the setting of the local recognition module, it can be optionally installed to meet the needs of offline use.

[0056] For further information, see Figure 3 The image pre-processing module 300 includes a cropping module 310 for performing image cropping and a format conversion module 320 for performing format conversion.

[0057] Furthermore, the dual-mode communication module 400 includes an LTE CAT1 wireless communication module and a Wi-Fi module. By using dual-mode communication online, communication adopts LTE CAT1 or Wi-Fi, and users can use it anytime and anywhere, breaking away from the restriction of use location.

[0058] For further information, see Figure 4, the cloud server 600 includes:

[0059] An image processing module 610 is used to perform grayscale processing, brightness and contrast adjustment, image cropping, and image background removal on an image;

[0060] An OCR recognition module 620 is used to recognize the processed image and output a recognition result;

[0061] A data packet generation module 630 is used to translate, segment, and perform TTS (text-to-speech) processing on the recognized text.

[0062] Database module 640, the database is used to store vocabulary data to provide reference for the OCR recognition module;

[0063] By completing complex image processing and OCR recognition through the image processing module in the cloud server and analyzing cloud data, complex calculations are implemented on the cloud server, reducing the hardware configuration of the scanning pen terminal and lowering the terminal cost.

[0064] Example 2

[0065] See also Figure 5 In order to achieve the above-mentioned purpose, the present invention describes the technical solution of the present invention in detail.

[0066] A big data-based scanning pen includes: a main control board 1, a Wi-Fi module 2 connected to the main control board, a scanning head 3 connected to the main control board, a speaker 4 connected to the main control board, a microphone 5 connected to the main control board, an LCD display 6 connected to the main control board, a battery 7 connected to the main control board, and a TF card 8 connected to the main control board. The main control board includes an LTE CAT1 wireless communication unit 11 for data communication between the scanning pen and a backend server; the TF card is used to store resource files required for point reading; the LTE CAT1 wireless communication unit 11 and the Wi-Fi module 2 are used to communicate with a cloud server; the LTE CAT1 wireless communication unit 11 includes a USIM unit and an antenna; furthermore, the scanning pen includes a fill light connected to the main control board and an infrared fill light connected to the main control board; the scanning pen also includes an OTA remote software upgrade module and a data line online software upgrade module;

[0067] The main control board has a single-core processor, and the processor may adopt an ARM Cortex-R5 with a main frequency of 832 MHz. In order to optimize the data transmission effect, the LTE CAT1 wireless communication unit of the scanning pen is also provided with an antenna.

[0068] Example 3

[0069] See also Figure 6 In order to achieve the above-mentioned purpose, the present invention describes the technical solution of the present invention in detail.

[0070] A scanning method based on big data, the method comprising the following steps:

[0071] Step S1: When the scanning pen scans text, a scanning base point is determined by using a first point of identifiable data to generate a first scanning image and a first base point motion image;

[0072] Step S2: detecting the user's directional operation on the target object through the first base point motion image, wherein the directional operation is used to determine the recognized point reading intention;

[0073] Step S3: Image recognition: the scanned image is recognized and the corresponding voice information is retrieved from the local database. If it cannot be recognized, it is uploaded to the cloud and recognized by the cloud database. If it still cannot be recognized, the image information is recorded and uploaded to the cloud server;

[0074] Step S4: Scan the text again and repeat steps S1-S3 until the text information is recognized. The image information uploaded to the cloud server is linked to the voice information corresponding to the text information, the image features are analyzed, and a new recognition package is generated and sent to the scanning pen for data upgrade.

[0075] In this method, the target area of the scanning pen can be identified by identifying the base point motion image, that is, the area of the relatively straight line motion is the target area, which can easily determine the target area and the scanning intention, and is conducive to the subsequent image stitching and graphic area selection.

[0076] Furthermore, in this method, after the scanning pen completes scanning and taking pictures, it only needs to perform a series of image data cropping and format conversion processing, and image recognition, feature analysis and generation of new data packets are all completed on the online cloud server.

[0077] In summary, the present invention utilizes dual-mode online communication, offloading complex computations to a cloud server, reducing the hardware requirements and terminal costs of the scanner pen. Communication utilizes LTE CAT1 or Wi-Fi, allowing users to use the pen anytime, anywhere, eliminating location restrictions. Furthermore, the scanner pen can autonomously learn to adapt to different fonts, minimizing inaccuracies.

[0078] The processor retrieves instructions from the memory one by one, analyzes the instructions, and then performs corresponding operations according to the instructions, generating a series of control commands, so that the various parts of the computer can automatically, continuously and coordinately operate as an organic whole, realizing program input, data input, calculation and output of results. The arithmetic operations or logical operations generated in this process are all completed by the operator; the memory includes a read-only memory (ROM), which is used to store computer programs, and a protection device is provided on the outside of the memory.

[0079] For example, a computer program may be divided into one or more modules, one or more of which are stored in a memory and executed by a processor to implement the present invention. One or more modules may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in a terminal device.

[0080] Those skilled in the art will understand that the description of the above-mentioned service device is merely an example and does not constitute a limitation on the terminal device. It may include more or fewer components than described above, or a combination of certain components, or different components, for example, it may include input and output devices, network access devices, buses, etc.

[0081] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor. The processor is the control center of the terminal device, connecting all parts of the user terminal using various interfaces and lines.

[0082] The memory can be used to store computer programs and / or modules. The processor implements the various functions of the terminal device by running or executing the computer programs and / or modules stored in the memory and accessing data stored in the memory. The memory may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as an information collection template display function and a product information release function); the data storage area may store data generated based on the use of the berth status display system (such as product information collection templates corresponding to different product types and product information required to be released by different product providers). Furthermore, the memory may include high-speed random access memory (RAM) and non-volatile memory, such as a hard disk, internal memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash memory card, at least one disk storage device, a flash memory device, or other volatile solid-state storage device.

[0083] If the modules / units integrated into the terminal device are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the present invention can also implement all or part of the modules / units in the above-mentioned system embodiments by instructing the relevant hardware through a computer program. The above-mentioned computer program can be stored in a computer-readable storage medium. When executed by a processor, the computer program can implement the functions of each of the above-mentioned system embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file, or some intermediate form. Computer-readable media can include: any entity or device capable of carrying computer program code, recording media, USB flash drives, mobile hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunications signals, and software distribution media.

[0084] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0085] The above description is a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent replacements, and improvements made within the scope of the present invention should be included in the scope of protection of the present invention.

[0086] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0087] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A scanning system based on big data, characterized in that: The system: A scanning module, configured to scan image information; A main control module, the control module is used to output control instructions; An image preprocessing module, configured to preprocess the image information scanned by the scanning module; A dual-mode communication module, the dual-mode communication module is used to perform wireless data communication and send pre-processed image information; A cloud server connected to the dual-mode communication unit, configured to provide big data services, recognize pre-processed images, and feed back voice data; A sound module, configured to generate sound based on sound data fed back by the cloud server; Also included is a scanning method, the method comprising the following steps: Step S1: When the scanning pen scans text, a scanning base point is determined by using a first point of identifiable data to generate a first scanning image and a first base point motion image; Step S2: detecting the user's directional operation on the target object through the first base point motion image, wherein the directional operation is used to determine the recognized point reading intention; Step S3: Image recognition: the scanned image is recognized and the corresponding voice information is retrieved from the local database. If it cannot be recognized, it is uploaded to the cloud and recognized by the cloud database. If it still cannot be recognized, the image information is recorded and uploaded to the cloud server; Step S4: Scan the text again and repeat steps S1-S3 until the text information is recognized. The image information uploaded to the cloud server is linked to the voice information corresponding to the text information, the image features are analyzed, and a new recognition package is generated and sent to the scanning pen for data upgrade.

2. A scanning and reading system based on big data according to claim 1, characterized in that: Also includes: A local recognition module, the local recognition module is used to recognize the scanned image information when offline, and compare the information with local information to retrieve the sound information; A storage module is used to store local data, and the local data includes a dictionary data package.

3. The big data-based scanning system according to claim 1, characterized in that: The image preprocessing module includes a cropping module for performing image cropping and a format conversion module for performing format conversion.

4. The big data-based scanning system according to claim 1, characterized in that: The dual-mode communication module includes an LTE CAT1 wireless communication module and a Wi-Fi module.

5. The scanning and reading system based on big data according to claim 1, characterized in that: The cloud server includes: An image processing module is used to perform image stitching, grayscale processing, brightness and contrast adjustment, image cropping, and image background removal processing on the image; An OCR recognition module is used to recognize the processed image and output a recognition result; A data packet generation module, which is used to translate, segment, and perform TTS processing on the recognized text; The database module is used to store vocabulary data to provide a reference for the OCR recognition module.

6. The scanning and reading system based on big data according to claim 1, characterized in that: After the scanning pen completes scanning and taking pictures, it only needs to perform a series of image data cropping and format conversion processing. Image recognition, feature analysis and generation of new data packets are all completed on the online cloud server.

7. A scanning pen based on big data, characterized in that: The scanning pen is used in any one of claims 1-6 of the big data-based scanning and reading system, comprising: a main control board, a Wi-Fi module connected to the main control board, a scanning head connected to the main control board, a speaker connected to the main control board, a microphone connected to the main control board, an LCD display connected to the main control board, a battery connected to the main control board, and a TF card connected to the main control board. The main control board includes an LTE CAT1 wireless communication unit for data communication between the scanning pen and a backend server; the TF card is used to store resource files required for point reading; the LTE CAT1 wireless communication unit and the Wi-Fi module are used to communicate with a cloud server; and the LTE CAT1 wireless communication unit includes a USIM unit and an antenna.

8. The scanning pen based on big data according to claim 7, characterized in that: It also includes a fill light connected to the main control board and an infrared fill light connected to the main control board.

9. The scanning pen based on big data according to claim 8, characterized in that: The scanning pen also includes an OTA remote software upgrade module and a data line online software upgrade module.

Images