Handwriting and point reading two-in-one product

Abstract

The invention discloses a handwriting and point reading two-in-one product, and belongs to the technical field of OID optical coding, liquid crystal display principle and CMOS image recognition, the handwriting and point reading two-in-one product comprises a liquid crystal board and a handwriting and point reading two-in-one pen, the liquid crystal board is composed of a plastic bottom shell, a plastic top shell, a liquid crystal layer and a code point layer, and OID3S point reading codes are laid on the code point layer. The handwriting and point reading two-in-one pen comprises a hardware framework and a software framework. According to the handwriting and point-reading two-in-one product, pen lifting and pen falling actions are judged by the pressure sensor, so that misrecognition is avoided. In the process of pen falling and pen lifting, the pen point can recognize the coordinate data, but the actual pressure-sensitive display pen refill does not make contact with the liquid crystal board, and the recognized coordinate data are invalid at the moment. Coordinate points are inserted into data queues of coordinates through pen lifting and falling actions to be used as partitions among strokes, so that the use efficiency of the liquid crystal board is improved, a handwriting track is finer and more accurate, handwriting and point reading functions are fused, the learning experience is enriched, and the application scene is widened.

Description

Technical Field

[0001] The invention relates to the fields of OID optical coding, liquid crystal display principle and CMOS image recognition technology, and specifically to a handwriting point reading two-in-one product. Background Art

[0002] As an auxiliary learning tool, the main function of the reading pen is to read the text or pictures on the accompanying books to provide voice assistance. However, the characteristics of the reading pen that can only read but not write have some limitations in terms of function, learning experience, applicable scenarios and complementarity with other learning tools. The reading pen needs to be equipped with an optical recognition pen tip to obtain functional information. The stylus needs a handwriting board or special paper to record handwritten information. The OID technology refers to the storage of certain information on printed materials by laying a carbon-containing fine code dot array that is not easily recognizable by the naked eye on the printed material. After that, the code dot array on the printed material is photographed by exposing the CMOS image sensor that only senses infrared light and the infrared LED, and the decoder is used to parse the information contained in the code dot array. The code dot array used for positioning (called OID handwritten code) can obtain the integer part of the pen tip position through the arrangement shape of the code dot array, and the decimal part of the pen tip position can be obtained by judging the position of the central pixel of the image sensor in the code dot array, and its positioning accuracy reaches more than 0.5mm.

[0003] Prior art 1 (application number CN202320488115.4, Chinese patent with application date of 2023-03-02) is a point-reading and handwriting integrated pen. The other end of the point-reading pen body is a point-reading optical lens cover, and the point-reading optical lens sensor is built in it, which is clamped with the circuit board by a straight-plug arrangement. The smart point-reading pen mainly uses optical image recognition to clearly read out the recognized text, and can translate, etc.; there is also prior art 2 (application number CN202121929600.8, Chinese patent with application date of 2021-08-17) in a three-purpose smart pen for scanning, point-reading and handwriting. After being turned on by the switch button, the pressure sensor is in working state, and the lens assembly is photographed. The picture is sent to the MCU on the PCB board. If the MCU parses that the picture has code points, the point reading and handwriting modes are started; if the MCU parses that the picture has no code points, the scanning mode is started. The pressure sensor recognizes the picture to trigger the point reading, handwriting, and scanning functions. In the intelligent handwriting point reading device of prior art 3 (application number CN202221410182.6, application date 2022-06-06 Chinese patent), the end face of the transparent plate without the identification code is attached to the screen of the external display. When the scanning head of the handwriting point reading pen scans at least one identification code, the screen position of at least one identification code relative to the display is transmitted to the control board, so that the control board can recognize the information displayed by the relative screen position of the identification code. The traditional handwriting LCD board mainly has three layers: the top layer is a transparent hard plastic sheet, the middle layer is a thin layer of liquid crystal film, and the bottom layer is a black plastic film. Under normal circumstances, the liquid crystal is in the FC state, the molecular long axis is perpendicular to the layer plane, and the light directly passes through the liquid crystal layer and is absorbed by the bottom black plastic film, presenting a completely black state. When you press the liquid crystal film with a pen or finger, the liquid crystal is squeezed and flipped by the pressure, and the flipped area becomes the P state. The P state reflects green light and absorbs light of other wavelengths, making the writing track appear green. The thickness of the lines on the screen is determined by the writing pressure. The greater the pressure, the more liquid crystals are twisted, and the thicker the lines will be, which reduces the efficiency of the stylus and is less practical.

[0004] Therefore, we proposed a two-in-one handwriting and point-reading product to solve the above problems. Summary of the invention

[0005] The purpose of the present invention is to provide a two-in-one handwriting and point-reading product to solve the problem raised by the above background technology that the thickness of the lines on the screen in the current market is determined by the writing pressure. The greater the pressure, the more liquid crystals are twisted, and the thicker the lines will be, which reduces the efficiency of the handwriting pen and has poor practicality.

[0006] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a two-in-one handwriting and point-reading product, including a liquid crystal panel and a two-in-one handwriting and point-reading pen, wherein the liquid crystal panel is composed of a plastic bottom shell, a plastic top shell, a liquid crystal layer and a code point layer, and the code point layer is paved with an OID3S point-reading code, and other areas are paved with an OID3S handwriting code; a user can switch to different types of functions and gameplay by clicking different icons above the liquid crystal panel with a stylus, supporting functions such as uppercase and lowercase letter writing recognition, word dictation, formula dictation, calculator, etc., and repeatedly clicking the same icon can switch to different sub-category functions or gameplay, and then the corresponding content can be written in the writing area, and the handwriting in the writing area can be cleared by pressing a clear display button; the two-in-one handwriting and point-reading pen includes a hardware framework and a software framework, wherein the hardware framework is a main control IC SN95310+pen tip module SNM9S5630BC2100A, and SN95310 has a built-in voice Codec, supports recording and broadcasting, and the pen tip module SNM9S5630BC2100A provides writing trajectory data together with the pressure switch; the software framework is without an operating system, with message queues and various functional modes as the basic architecture to respond to various events and implement necessary functions.

[0007] Preferably, SN95310 is a voice IC equipped with a dual-core ARMCortex-M3 processor and a built-in Codec, and its maximum main frequency is 96MHZ.

[0008] Preferably, SN95310 has a built-in audio Codec, AUD01, which supports recording and broadcasting, and supports a sampling rate range of 8KHz to 48KHz. The LightGuide pen tip SNM9S5630BC2100A is a very short OID module that supports OID3S point reading and handwriting codes. The maximum effective frame rate during writing can reach 120FPS, and the code points can be effectively identified within the range of ±40° deviation from vertical, achieving high-precision and high-efficiency handwriting recognition.

[0009] Preferably, SN95310 supports up to 256M SPIFlash, and its maximum SPI clock frequency is 48MHZ. SN95310 supports up to 2TB SD card, and its maximum clock frequency is 48MHZ. It uses USB-TypeC interface, supports USB2.0 protocol, uses ADC button, one sampling IO can support multiple buttons, uses RGB serial light as indicator light, and can control the brightness and color of RGB with one IO port.

[0010] Preferably, the pressure-sensitive switch is a switch that is turned on by the conductive silicone at the rear end of the pen tip when there is pressure on the pen tip. During the process of putting the pen down and lifting the pen, the pen tip will recognize the coordinate data, but the actual pressure-sensitive display shows that the pen core does not touch the LCD panel, and the recognized coordinate data is invalid at this time.

[0011] Preferably, the most important message queue of the software framework is AppFifo, i.e. MainFifo, which is used to save various triggered events to wait for corresponding processing functions to process them. Another commonly used message queue is AudFifo, i.e. AudioActionFifo, which is used to save the broadcasting or recording actions that need to be processed, so as to facilitate the orderly execution of sound actions to complete their specific functions, and different functional modes can be switched through messages.

[0012] Preferably, the functional modes are implemented as independent parts, with only one functional mode in operation at a time to complete its specific function, and different functional modes can be switched through messages, integrating handwriting and point reading functions, enriching the learning experience and broadening the applicable scenarios.

[0013] Preferably, a pen tip module is provided at the bottom of the handwriting and reading two-in-one pen, a speaker is also provided at the top of the handwriting and reading two-in-one pen, and a USB-type interface is provided on the outside of the handwriting and reading two-in-one pen, which improves the multifunctional performance of the handwriting and reading two-in-one pen and has a wider applicability.

[0014] Preferably, an RGB serial light is provided in the outer groove on the top of the handwriting and reading two-in-one pen, and the bottom of the RGB serial light corresponds to the power button, the volume up button and the volume down button, and the power button, the volume up button and the volume down button are installed at equal intervals, which can be adjusted and controlled according to the preferences of different groups of people, can meet the needs of different groups of people, and is more practical.

[0015] Compared with the prior art, the beneficial effect of the present invention is that the black plastic film of the third layer of the traditional liquid crystal panel is replaced with a transparent plastic film, and a code paper with a point reading code and a position code is added under the transparent plastic film. By obtaining the position of the optical recognition pen tip in the handwriting area of ​​the liquid crystal panel, the trajectory of its movement on the liquid crystal panel can be obtained for recognition into characters. A new structural design is adopted, and its specific contents are as follows.

[0016] (1) The coordinate information is recorded by the OID handwritten code laid on the LCD panel. The coordinate information consists of the X-axis coordinate and the Y-axis coordinate. The coordinate data of each axis consists of an unsigned integer part and a signed decimal part. The unsigned integer part is up to 14 bits, and the signed decimal part is also 8 bits.

[0017] (2) The OID pen tip is used to obtain coordinate data from the LCD panel, which is faster and more accurate. The OID pen tip consists of an optical lens, an infrared LED, an image sensor SoC with decoding function, a PCB and a black plastic shell. The image sensor causes the IRLED to emit infrared light that is invisible to the human eye during exposure to illuminate the recognition area of ​​the printed matter. The black code points containing carbon absorb infrared light, which appears as black dots in the image sensor, while the other parts reflect infrared light and display a white or gray background in the image sensor, so that the image sensor captures a black and white image of the code point array on the LCD panel. The image of the code point is then decoded by the decoder built into the SoC to obtain the coordinate data and send it out.

[0018] (3) The pressure sensor is used to determine the pen lift and pen drop actions to avoid misidentification. During the pen drop and pen lift process, the pen tip will recognize the coordinate data, but the actual pressure sensor shows that the pen core is not in contact with the LCD panel. At this time, the recognized coordinate data is invalid. The pen lift and pen drop actions will insert coordinate points into the coordinate data queue to serve as separators between strokes.

[0019] (4) Improved the efficiency of LCD panel usage, making handwriting tracks more precise and accurate. Integrating handwriting and point reading functions enriches the learning experience and broadens the applicable scenarios. Through the combination of OID technology and pressure sensor, high-precision and high-efficiency handwriting recognition is achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a schematic diagram of the three-dimensional structure of the handwriting and reading two-in-one pen of the present invention;

[0021] Figure 2 It is a schematic diagram of the structure of the liquid crystal panel of the present invention;

[0022] Figure 3 It is a functional structure diagram of the liquid crystal panel of the present invention;

[0023] Figure 4 This is a schematic diagram of the hardware framework structure of the handwriting and reading two-in-one pen of the present invention;

[0024] Figure 5 This is a schematic diagram of the handwriting and reading two-in-one software framework structure of the present invention.

[0025] In the picture: 1. Handwriting and reading two-in-one pen; 2. Power button; 3. Volume up button; 4. Volume down button; 5. Pen tip module; 6. RGB serial light; 7. USB-type interface; 8. Speaker. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] The present invention provides the following technical solutions:

[0028] Embodiment, in order to solve the problem that the thickness of the lines on the screen in the existing market is determined by the writing pressure, the greater the pressure, the more the liquid crystal is twisted, the thicker the line will be, which reduces the efficiency of the stylus and has poor practicality, a handwriting point reading two-in-one product is disclosed: a liquid crystal panel and a handwriting point reading two-in-one pen 1, wherein the liquid crystal panel is composed of a plastic bottom shell, a plastic top shell, a liquid crystal layer and a code point layer, and the code point layer is paved with OID3S point reading code, and other areas are paved with OID3S handwriting code; users use the stylus to click on different icons above the liquid crystal panel to switch to different types of functions and gameplay, supporting uppercase and lowercase letter writing recognition, word dictation, formula dictation, calculator and other functions, and repeatedly clicking on the same You can switch between different sub-category functions or gameplay by clicking an icon, and then you can write the corresponding content in the writing area. By pressing the clear display button, you can clear the handwriting in the writing area; the handwriting and point reading two-in-one pen 1 includes a hardware framework and a software framework, wherein the hardware framework is the main control ICSN95310 + pen module 5SNM9S5630BC2100A, and the SN95310 has a built-in voice Codec, which supports recording and broadcasting, and the pen module 5SNM9S5630BC2100A provides writing trajectory data together with the pressure switch; the software framework is a non-operating system, with message queues and various functional modes as the basic architecture to respond to various events and implement necessary functions.

[0029] SN95310 is a voice IC equipped with a dual-core ARMCortex-M3 processor and a built-in Codec, with a maximum main frequency of 96MHZ.

[0030] SN95310 has a built-in audio Codec, AUD01, which supports recording and broadcasting, and supports a sampling rate range of 8KHz to 48KHz. The LightGuide pen tip SNM9S5630BC2100A is a very short OID module that supports OID3S point reading and handwriting codes. The maximum effective frame rate during writing can reach 120FPS, and it can effectively identify code points within the range of ±40° deviation from vertical.

[0031] SN95310 supports up to 256M SPIFlash, and its maximum SPI clock frequency is 48MHZ. SN95310 supports up to 2TB SD card, and its maximum clock frequency is 48MHZ. It uses USB-TypeC interface, supports USB2.0 protocol, uses ADC button, and one sampling IO can support multiple buttons. It uses RGB serial light 6 as an indicator light, and one IO port can control the brightness and color of RGB.

[0032] The pressure-sensitive switch is a switch that is turned on by the conductive silicone at the rear end of the pen tip when there is pressure on the pen tip.

[0033] The most important message queue of the software framework is AppFifo, namely MainFifo, which is used to save various triggered events to wait for the corresponding processing functions to handle them. Another commonly used message queue is AudFifo, namely AudioActionFifo, which is used to save the broadcasting or recording actions that need to be processed to facilitate the orderly execution of sound actions.

[0034] In addition, there are many non-message data queues, such as OID data queue, USBHID data queue, etc. Functional modes are implemented as independent parts, only one functional mode is in operation at a time to complete its specific function, and different functional modes can be switched through messages.

[0035] The functional modes are implemented as independent parts, with only one functional mode in operation at a time to complete its specific function, and different functional modes can be switched through messages.

[0036] A pen head module 5 is disposed at the bottom of the handwriting and reading two-in-one pen 1 , a speaker 8 is disposed at the top of the handwriting and reading two-in-one pen 1 , and a USB-type interface 7 is provided on the outer side of the handwriting and reading two-in-one pen 1 .

[0037] An RGB serial light 6 is provided in a groove on the top outer side of the handwriting and reading two-in-one pen 1, and a power button 2, a volume up button 3 and a volume down button 4 are provided at the bottom of the RGB serial light 6, and the power button 2, the volume up button 3 and the volume down button 4 are installed at equal intervals.

[0038] The functional design of the handwriting and point reading two-in-one pen 1 is as follows: long press the power button 2 to turn on or off, and short press to switch the Chinese and English prompt tone mode. Short press the volume up button 3 to increase the volume, long press to start recording, and short press again to end recording and play. Short press the volume down button 4 to reduce the volume, and long press to start playing the recording. The USB-type interface 7 interface is used for the SD card content in the handwriting and point reading two-in-one pen 1, uploading handwritten data, and firmware program updates. The pen head module 5 is SNM9S5630BC2100A, which reads the OID3S point reading code and handwritten code and provides pressure feedback. The RGB serial light 6 is always white when it is turned on, and slowly flashes red when the power is low. After writing, the light goes out when valid data is received, and it lights up red when invalid data. It lights up red during charging and green when fully charged. The speaker is used to play sound.

[0039] like Figure 1-Figure 5 As shown, first lay out the point reading codes corresponding to different functions and the handwriting codes in the handwriting area according to the needs, then print the code paper, put the code paper under the transparent plastic film, install the LCD panel, and when using the handwriting point reading two-in-one product, the user can perform handwriting operations on the LCD panel through the pen head module 5 set at the bottom of the handwriting point reading two-in-one pen 1. The OID pen head will obtain the position information of the pen head on the LCD panel in real time and convert it into coordinate data. At the same time, the pressure sensor will judge the pen lifting and pen dropping actions to ensure that only valid handwriting trajectories are recognized. The recognized handwriting trajectory will be converted into character information and displayed on the LCD panel or the corresponding sound information such as point reading content will be played through the speaker 8. The handwriting point reading two-in-one pen 1 is designed with different functions according to different needs. The basic framework of the hardware design is: main control IC SN95310 + pen head module 5SNM9S5630BC2100A. SN95310 has a built-in voice Codec that supports recording and broadcasting. The pen tip module 5SNM9S5630BC2100A provides writing trajectory data together with the pressure switch. The software design framework is: no operating system, using message queues and various functional modes as the basic framework to respond to various events and implement necessary functions, timely collecting pen tip data during interrupts, and using multi-level cache areas with pipeline design to minimize delays, and recognize written characters as quickly as possible, which not only improves the efficiency of the LCD panel and makes the handwriting trajectory more refined and accurate, but also integrates handwriting and point reading functions, enriches the learning experience, broadens the applicable scenarios, and through the combination of OID technology and pressure sensors, achieves high-precision and high-efficiency handwriting recognition to complete a series of tasks.

[0040] The above is the working process of the entire device, and the contents not described in detail in this specification belong to the existing technology known to professional and technical personnel in this field.

[0041] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A handwriting point reading two-in-one product, comprising a liquid crystal panel and a handwriting point reading two-in-one pen (1), wherein the liquid crystal panel is composed of a plastic bottom shell, a plastic top shell, a liquid crystal layer and a code point layer, and the code point layer is paved with an OID3S point reading code, and other areas are paved with an OID3S handwriting code; Users can use the stylus to click on different icons above the LCD panel to switch to different types of functions and gameplay. It supports uppercase and lowercase letter recognition, word dictation, formula dictation, calculator and other functions. Repeatedly clicking the same icon can switch to different sub-category functions or gameplay, and then you can write the corresponding content in the writing area. Pressing the clear display button can clear the handwriting in the writing area. Features: The handwriting point reading two-in-one pen (1) includes a hardware framework and a software framework, wherein the hardware framework is a main control ICSN95310 + a pen head module (5) SNM9S5630BC2100A, and the SN95310 has a built-in voice Codec to support recording and broadcasting, and the pen head module (5) SNM9S5630BC2100A provides writing trajectory data together with a pressure-sensitive switch; The software framework is without an operating system and uses message queues and various functional modes as the basic architecture to respond to various events and implement necessary functions.

2. The handwriting point reading two-in-one product according to claim 1, characterized in that: SN95310 is a voice IC equipped with a dual-core ARMCortex-M3 processor and a built-in Codec, with a maximum main frequency of 96MHZ.

3. The handwriting point reading two-in-one product according to claim 2, characterized in that: SN95310 has a built-in audio Codec, AUD01, which supports recording and broadcasting, and supports a sampling rate range of 8KHz to 48KHz. The LightGuide pen tip SNM9S5630BC2100A is a very short OID module that supports OID3S point reading and handwriting codes. The maximum effective frame rate during writing can reach 120FPS, and it can effectively identify code points within the range of ±40° deviation from vertical.

4. The handwriting point reading two-in-one product according to claim 3 is characterized by: SN95310 supports up to 256M SPIFlash, and its maximum SPI clock frequency is 48MHZ. SN95310 supports up to 2TB SD card, and its maximum clock frequency is 48MHZ. It uses USB-TypeC interface, supports USB2.0 protocol, uses ADC button, and one sampling IO can support multiple buttons. It uses RGB serial light (6) as an indicator light, and one IO port can control the brightness and color of RGB.

5. The handwriting point reading two-in-one product according to claim 1, characterized in that: The pressure-sensitive switch is a switch that is turned on by the conductive silicone at the rear end of the pen tip when there is pressure on the pen tip.

6. The handwriting point reading two-in-one product according to claim 1, characterized in that: The most important message queue of the software framework is AppFifo, i.e. MainFifo, which is used to save various triggered events to wait for the corresponding processing functions to process them. Another commonly used message queue is AudFifo, i.e. AudioActionFifo, which is used to save the broadcasting or recording actions that need to be processed to facilitate the orderly execution of sound actions.

7. The handwriting point reading two-in-one product according to claim 1, characterized in that: The functional modes are implemented as independent parts, with only one functional mode in operation at a time to complete its specific function, and different functional modes can be switched through messages.

8. The handwriting point reading two-in-one product according to claim 1, characterized in that: The bottom of the handwriting and point-reading two-in-one pen (1) is provided with a pen head module (5), the top of the handwriting and point-reading two-in-one pen (1) is also provided with a speaker (8), and the outer side of the handwriting and point-reading two-in-one pen (1) is provided with a USB-type interface (7).

9. The handwriting point reading two-in-one product according to claim 8, characterized in that: The top outer side of the handwriting and reading two-in-one pen (1) is provided with an RGB serial light (6) in a slot, and the bottom of the RGB serial light (6) corresponds to a power button (2), a volume up button (3) and a volume down button (4), and the power button (2), the volume up button (3) and the volume down button (4) are installed at equal intervals.

Images