Intelligent pen integrated with multi-dimensional sensor

Abstract

The invention relates to the technical field of intelligent writing equipment, and discloses an intelligent pen integrated with a multi-dimensional sensor, which comprises a refill body and a holding sleeve arranged on one side of the refill body, the pen point assembly is arranged on the outer side of the pen refill body, the pen point assembly comprises a pen point arranged on the outer side of the pen refill body, an optical cabin is fixedly connected to the interior of the pen point, an infrared LED is arranged in the optical cabin, a non-planar convex lens is arranged in the optical cabin, and an image sensor is arranged on the inner wall of the optical cabin; the pen body assembly is arranged on one side of the pen point, the pen body assembly comprises a pen tube arranged on one side of the pen point, and a capacitive pressure sensor is arranged at one end of the pen refill body; according to the invention, writing track capture and writing quality evaluation are realized through optical positioning, pressure sensing, time sequence recording and data analysis.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent writing equipment, in particular to an intelligent pen integrated with multi-dimensional sensors. BACKGROUND

[0002] The "intelligent writing equipment" refers to a kind of electronic equipment that can perceive, record, process, store and transmit handwriting content by combining traditional writing experience with modern digital technology, and its core feature is to convert physical writing action into digital information and give it functions beyond paper.

[0003] The traditional writing tool can only realize basic writing function and cannot quantitatively analyze the writing process. In the prior art, some intelligent writing equipment converts pressure and direction information, but when using it, since it relies on the combination of gravity accelerometer and pressure sensor to infer the writing trajectory by measuring the inclination angle and pressing degree of the pen body, it may cause the accelerometer to be easily disturbed by hand shaking, resulting in a trajectory deviation error of more than 2mm, which cannot meet the strict requirements of stroke order and structure of Chinese characters writing. At the same time, it lacks optical positioning support and cannot realize accurate distance detection of the pen tip and the paper surface. In addition, when using it, the "single machine + offline server" hybrid mode is often used, which needs to rely on external equipment to store data, and the data caching ability in off-network scenarios is not optimized. At the same time, it can only realize simple pressure curve recording and cannot analyze stroke order, connected pen features or writing speed in detail. SUMMARY

[0004] The purpose of the present application is to provide an intelligent pen integrated with multi-dimensional sensors to solve the problem that the writing accuracy of some intelligent writing pens is low during use, and the storage data capacity is poor and the analysis degree of writing features is low when using it.

[0005] To achieve the above purpose, the present application provides the following technical scheme: an intelligent pen integrated with multi-dimensional sensors, comprising a pen core body, further comprising: a holding sleeve arranged on one side of the pen core body; a pen tip assembly arranged on the outer side of the pen core body, the pen tip assembly comprising a pen head arranged on the outer side of the pen core body, the interior of the pen head being fixedly connected with an optical cabin, the interior of the optical cabin being provided with an infrared LED, the interior of the optical cabin being provided with a non-planar convex lens, and the inner wall of the optical cabin being provided with an image sensor; a pen body assembly arranged on one side of the pen head, the pen body assembly comprising a pen tube arranged on one side of the pen head, one end of the pen core body being provided with a capacitive pressure sensor, and the interior of the pen tube being respectively provided with a three-axis accelerometer and a temperature sensor; The tail assembly is arranged on the side of the pen tube away from the pen head, and the tail assembly comprises a tail body arranged on the side of the pen tube, and the tail body is provided with a sleeve on the outside, and the tail body is provided with a main control chip, a wireless network module and a quartz crystal oscillator inside.

[0006] Preferably, the tail body is provided with a storage chip, a lithium battery, a Bluetooth module and a charging chip inside, and the inside of the sleeve is provided with a USB interface.

[0007] Preferably, the infrared LED is connected with the main control chip, and the infrared LED is used for lighting and providing light when writing, and the main control chip is used for transmitting data of various sensors and modules and communicating between various modules.

[0008] Preferably, the storage chip, the wireless network module and the Bluetooth module are connected with the main control chip, the storage chip adopts an SPI Flash storage chip, supports continuous writing data storage for hours in an off-network state, and the wireless network module and the Bluetooth module are used for signal connection and data transmission.

[0009] Preferably, the non-planar convex lens is connected with the image sensor, the image sensor is connected with the main control chip, the non-planar convex lens is used for collecting light reflected from the pen tip and forming an image on the image sensor, and the image sensor is used for converting the light into an electrical signal to generate an image sequence of the pen tip movement.

[0010] Preferably, the capacitive pressure sensor is connected with the main control chip, the three-axis accelerometer is connected with the main control chip, and the temperature sensor is connected with the main control chip, the capacitive pressure sensor is used for measuring the writing pressure in real time, and the data conversion formula is F_actual= F_sensor-m·g·cosθ where m is the mass of the pen body, and θ is the angle between the pen tip and the direction of gravity, The three-axis accelerometer is used for real-time monitoring of the three-dimensional motion state of the pen body to provide compensation parameters.

[0011] Preferably, the lithium battery and the USB interface are connected with the charging chip, the charging chip is connected with the main control chip, the lithium battery is used for power supply of the device, the USB interface is used for power supply of the lithium battery and data transmission, and the charging chip is used for power management of the device.

[0012] Preferably, the inside of the optical cabin is fixedly connected with a support, the inside of the support is fixedly connected with the outside of the infrared LED, and the number of the infrared LED is four.

[0013] Preferably, the inside of the pen head is provided with a placing groove, the outside of the placing groove is provided with a hose, the inner wall of the hose is provided with a pressure sensor, the number of the pressure sensor is six, the pressure sensor is connected with a master control chip, and the pressure sensor is used for sensing the pressure borne by the pen head and detecting the pen holding posture of the user.

[0014] Preferably, the outside of the pen core body is provided with an outer tube, the outside of the outer tube is provided with a spring, one end of the outer tube is provided with a first connecting pipe, and one side of the first connecting pipe is provided with a second connecting pipe.

[0015] Compared with the prior art, the application has the following beneficial effects: The optical cabin, the infrared LED, the non-planar convex lens and the image sensor are arranged, under the action of the plurality of infrared LED illuminations and the non-planar convex lens for collecting reflected light, so that the image sensor is provided with clear light input, a pen tip motion image sequence is generated to realize trajectory tracking, the capacitive pressure sensor is arranged, the writing pressure can be measured in real time, then data conversion and transmission are performed, accurate pressure values are obtained to support writing force analysis, the three-axis accelerometer is arranged, under the action of real-time monitoring of three-dimensional motion states, motion compensation parameters are provided, the movement state of the pen in the three-dimensional space can be sensed in real time, the master control chip is arranged, under the action of integrated data processing and communication control, multi-sensor data fusion and efficient cooperation between modules are realized, the storage chip is arranged, under the action of supporting off-network continuous storage, 72 hours of writing data are ensured not to be lost, the exclusive data format.iwb format is adopted, conflict with a general format is avoided, the wireless network and the Bluetooth module are arranged, under the action of dual-mode wireless communication, flexible data transmission and device interconnection are realized, the connection interval is dynamically adjusted, the interval is 50 ms in an active state and 5 s in an idle state, the lithium battery and the charging chip are arranged, under the action of power supply management and USB interface support, persistent endurance and convenient charging functions are provided, the position quartz crystal oscillator adopts a 32.768 kHz quartz crystal oscillator, a 1 Hz reference pulse is generated through a 15-stage frequency divider, and millisecond level time stamp recording can be realized by combining the RTC chip. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 A structure schematic view of a preferred embodiment of the intelligent pen provided with the integrated multi-dimensional sensor; Figure 2 A structure connection schematic view of a pen tip assembly provided by the application; Figure 3 A structure connection schematic view of a pen body assembly provided by the application; Figure 4 A structure connection schematic view of a pen tail assembly provided by the application; Figure 5 The internal structure diagram of the holding sleeve provided by the present application; Figure 6 The signal connection diagram of the intelligent pen provided by the present application In the figure: 1, the pen core body; 2, the holding sleeve; 3, the pen tip assembly; 301, the pen head; 302, the optical cabin; 303, the infrared LED; 304, the non-planar convex lens; 305, the image sensor; 4, the pen body assembly; 401, the pen tube; 402, the capacitive pressure sensor; 403, the three-axis accelerometer; 404, the temperature sensor; 5, the pen tail assembly; 501, the pen tail body; 502, the sleeve; 503, the main control chip; 504, the wireless network module; 505, the quartz crystal oscillator; 6, the bracket; 7, the placing groove; 8, the outer tube; 9, the spring; 10, the first connecting tube; 11, the second connecting tube; 12, the storage chip; 13, the lithium battery; 14, the Bluetooth module; 15, the charging chip; 16, the hose; 17, the pressure sensor; 18, the USB interface. DETAILED DESCRIPTION

[0017] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0018] Please refer to Figures 1-6As shown, a multi-dimensional sensor integrated smart pen, including a pen body 1, further comprising: a holding sleeve 2 arranged on one side of the pen body 1; by arranging the holding sleeve 2, the user can hold the device under the action of the holding sleeve 2, a pen tip assembly 3 arranged on the outside of the pen body 1, the pen tip assembly 3 includes a pen head 301 arranged on the outside of the pen body 1, the inside of the pen head 301 is fixedly connected with an optical cabin 302, by arranging the optical cabin 302, the light can be concentrated under the action of the optical cabin 302, and then the image sensor 305 can generate image data, the inside of the optical cabin 302 is provided with four infrared LED 303, under the action of the four infrared LED 303, the part of the pen body 1 contacting the paper can be illuminated, the inside of the optical cabin 302 is provided with a non-planar convex lens 304, the inner wall of the optical cabin 302 is provided with an image sensor 305, under the action of the non-planar convex lens 304 and the image sensor 305, the image data can be transmitted, wherein the image sensor 305 is a CMOS image sensor, the model is OmniVision OV7670, and the focal length of the non-planar convex lens 304 is about 5mm, the best field of view angle is 40°-60°, and then submillimeter level positioning within 8mm below the pen tip can be realized; a pen body assembly 4 is arranged on one side of the pen head 301, the pen body assembly 4 includes a pen tube 401 arranged on one side of the pen head 301, by arranging the pen tube 401, the pen head 301 can be connected under the action of the pen tube 401, so that the pen body 1 can be used normally, one end of the pen body 1 is provided with a capacitive pressure sensor 402, wherein the capacitive pressure sensor 402 is model Tekscan FlexiForce A201, the range is 0-10N, the resolution is 0.01N, the integrated idle stroke adjusting mechanism eliminates the mechanical gap error of the pen tip, the inside of the pen tube 401 is respectively provided with a three-axis accelerometer 403 and a temperature sensor 404, by arranging the three-axis accelerometer 403, the motion parameter compensation of the device can be realized under the action of the three-axis accelerometer 403; a pen tail assembly 5 is arranged on the side of the pen tube 401 away from the pen head 301, the pen tail assembly 5 includes a pen tail body 501 arranged on one side of the pen tube 401, the outside of the pen tail body 501 is provided with a sleeve 502, the inside of the pen tail body 501 is respectively provided with a master control chip 503, a wireless network module 504 and a quartz crystal oscillator 505, under the action of the quartz crystal oscillator 505, in combination with the RTC chip, millisecond level timestamp recording is realized, wherein the RTC chip is model PCF8563, the frame rate is reduced to 100Hz in the static state, and the power consumption is reduced to 15μA.

[0019] Reference Figure 4 and Figure 5As shown, the inner part of the pen tail body 501 is respectively provided with a storage chip 12, a lithium battery 13, a Bluetooth module 14 and a charging chip 15. The storage chip 12 is a 32Mbit SPI Flash with a model of Winbond W25Q256, which supports more than 200 hours of data caching. The lithium battery is a 133.7V 100mAh lithium battery, and the charging chip 15 is a TP4056 charging chip. The inner part of the sleeve 502 is provided with a USB interface 18. The infrared LED 303 is connected with the main control chip 503. The infrared LED 303 is used for lighting and providing light when writing. The main control chip 503 is used for transmitting data of various sensors and modules, and communicating between various modules. The storage chip 12, the wireless network module 504 and the Bluetooth module 14 are all connected with the main control chip 503. The wireless network module 504 is an ESP8266, and the Bluetooth module 14 is an nRF52840. The storage chip 12 is an SPI Flash storage chip, which supports 200 hours of continuous writing data storage in off-network state. The wireless network module 504 and the Bluetooth module 14 are used for signal connection and data transmission. The non-planar convex lens 304 is connected with the image sensor 305, and the image sensor 305 is connected with the main control chip 503. The non-planar convex lens 304 is used for collecting light reflected from the pen tip and forming an image on the image sensor 305. The image sensor 305 is used for converting light into electrical signals to generate an image sequence of pen tip movement. The capacitive pressure sensor 402 is connected with the main control chip 503. The three-axis accelerometer 403 is connected with the main control chip 503. The temperature sensor 404 is connected with the main control chip 503. The capacitive pressure sensor 402 is used for real-time measurement of writing pressure, and its data conversion formula is F_actual= F_sensor-m·g·cosθ where m is the mass of the pen body, and θ is the angle between the pen tip and the direction of gravity. The writing jitter noise is eliminated by Kalman filtering. The triaxial accelerometer 403 is used for real-time monitoring of the three-dimensional motion state of the pen body, providing compensation parameters, the lithium battery 13 and the USB interface 18 are connected with the charging chip 15, the charging chip 15 is connected with the main control chip 503, the lithium battery 13 is used for power supply of the device, the USB interface 18 is used for power supply of the lithium battery 13, and is also used for data transmission, the charging chip 15 is used for power management of the device, the inside of the optical cabin 302 is fixedly connected with the bracket 6, the inside of the bracket 6 is fixedly connected with the outside of the infrared LED 303, the number of the infrared LED 303 is four, the inside of the pen head 301 is provided with the placing groove 7, the outside of the placing groove 7 is provided with the hose 16, the inner wall of the hose 16 is provided with the pressure sensor 17, the number of the pressure sensor 17 is six, the pressure sensor 17 is connected with the main control chip 503, and the pressure sensor 17 is used for sensing the pressure borne by the pen head 301 and detecting the pen holding posture of the user, the outside of the pen core body 1 is provided with the outer tube 8, the outside of the outer tube 8 is provided with the spring 9, one end of the outer tube 8 is provided with the first connecting pipe 10, and one side of the first connecting pipe 10 is provided with the second connecting pipe 11.

[0020] Working principle: when the user writes through the device, first, the user naturally holds the smart pen through the holding sleeve 2 on one side of the pen core body 1. Six pressure sensors 17 are distributed on the inner wall of the hose 16, which can sense the finger pressure distribution in real time and detect whether the pen holding posture is correct. If the pen holding angle deviates or the force is uneven, the main control chip 503 will remind the user to adjust through pen body vibration, helping the user to form a standard writing habit. When the user starts writing, the four infrared LEDs 303 of the pen tip assembly 3 automatically light up, illuminating the contact area between the pen tip and the paper. The non-planar convex lens 304 focuses the reflected light to the CMOS image sensor 305, capturing the pen tip motion trajectory at a sampling frequency of 17000 frames / second, generating an image sequence with sub-millimeter positioning. At the same time, the capacitive pressure sensor 402 measures the pressing force in real time and corrects the influence of gravity through the formula F_actual = F_sensor - m·g·cosθ, combined with Kalman filtering to eliminate hand jitter noise. At the same time, the three-axis accelerometer 403 monitors the three-dimensional motion state of the pen body, providing trajectory compensation parameters. The temperature sensor 404 adjusts the infrared light intensity dynamically according to the environmental temperature to ensure data accuracy. The main control chip 503 synchronously processes four-channel data, i.e. XYZ coordinates, pressure value, and timestamp. Each record contains 10 bytes of data, i.e. 4 bytes of coordinates + 2 bytes of pressure + 4 bytes of timestamp, which is written into the 32Mbit SPI Flash memory chip 12 in real time. If it is in a disconnected state, the memory chip 12 can cache more than 200 hours of writing data, thereby avoiding data loss. When the device is connected to a mobile phone or computer, the Bluetooth module 14 or Wi-Fi wireless network module 504 automatically starts and transmits data to the matching APP. The built-in cw2vec algorithm in the APP improves the model to analyze the stroke sequence and connected pen features, and the dynamic time warping DTW algorithm matches the standard glyph library to mark the strokes with a similarity of less than 85% as wrong words, and generate a wrong word book and a speed report. The threshold for grades 1-3 is 15-25 words / minute, and the threshold for grades 4-6 is 25-35 words / minute. Connect the charger through the USB interface 18 in the sleeve 502. The TP4056 charging chip automatically adjusts the charging power to prevent the battery from overheating. After the lithium battery 13 is fully charged, it can support 72 hours of continuous use in Bluetooth mode.

[0021] It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting; it is not intended to exclude myriad other embodiments of the present application that other inventors can develop based on the same general inventive concepts embodied by the described embodiments. That is, although the present application is described in terms of particular embodiments and implementations, it is to be understood that the terminology used is for the purpose of descriptive clarity and that it should be taken in a descriptive sense and not a limiting sense.

[0022] While the embodiments of the application have been shown and described herein, it is to be understood that the application is not limited to these embodiments. Rather, many modifications, changes, substitutions, and alterations can be made to the embodiments of the application without departing from the spirit and scope of the application as defined by the appended claims and their equivalents.

Claims

1. A smart pen integrated with multi-dimension sensor, comprising a pen core body (1), characterized in that, Also include: The grip sleeve (2) is arranged on one side of the pen core body (1); The pen tip assembly (3) is arranged on the outside of the pen core body (1), the pen tip assembly (3) includes a pen head (301) arranged on the outside of the pen core body (1), the inside of the pen head (301) is fixedly connected with an optical cabin (302), the inside of the optical cabin (302) is provided with an infrared LED (303), the inside of the optical cabin (302) is provided with a non-planar convex lens (304), and the inner wall of the optical cabin (302) is provided with an image sensor (305); The pen body assembly (4) is arranged on one side of the pen head (301), the pen body assembly (4) includes a pen tube (401) arranged on one side of the pen head (301), one end of the pen core body (1) is provided with a capacitive pressure sensor (402), and the inside of the pen tube (401) is respectively provided with a three-axis accelerometer (403) and a temperature sensor (404); The tail assembly (5) is arranged on the side of the pen tube (401) away from the pen head (301), the tail assembly (5) includes a tail body (501) arranged on one side of the pen tube (401), the outside of the tail body (501) is provided with a sleeve (502), and the inside of the tail body (501) is respectively provided with a main control chip (503), a wireless network module (504) and a quartz crystal oscillator (505).

2. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The inside of the tail body (501) is respectively provided with a storage chip (12), a lithium battery (13), a Bluetooth module (14) and a charging chip (15), and the inside of the sleeve (502) is provided with a USB interface (18).

3. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The infrared LED (303) is connected with the main control chip (503), the infrared LED (303) is used for lighting and providing light when writing, and the main control chip (503) is used for transmitting data of various sensors and modules and communicating between various modules.

4. The smart pen integrated with multi-dimension sensors according to claim 2, wherein: The storage chip (12), the wireless network module (504) and the Bluetooth module (14) are connected with the main control chip (503), the storage chip (12) adopts an SPI Flash storage chip, supports 200 hours of continuous writing data storage in an off-network state, and the wireless network module (504) and the Bluetooth module (14) are used for signal connection and data transmission.

5. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The non-planar convex lens (304) is connected with the image sensor (305), the image sensor (305) is connected with the main control chip (503), the non-planar convex lens (304) is used for collecting light reflected from the pen tip and forming an image sequence of the pen tip movement on the image sensor (305), and the image sensor (305) is used for converting light into an electrical signal to generate an image sequence of the pen tip movement.

6. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The capacitive pressure sensor (402) is connected with the master control chip (503), the three-axis accelerometer (403) is connected with the master control chip (503), and the temperature sensor (404) is connected with the master control chip (503), the capacitive pressure sensor (402) is used for measuring the writing pressure in real time, and the data conversion formula is F_actual= F_sensor-m·g·cosθ Wherein m is the pen body mass, and θ is the pen tip and the gravity direction angle, The three-axis accelerometer (403) is used for monitoring the three-dimensional motion state of the pen body in real time, and providing compensation parameters.

7. The smart pen integrated with multi-dimension sensors according to claim 2, wherein: The lithium battery (13) and the USB interface (18) are connected with the charging chip (15), the charging chip (15) is connected with the master control chip (503), the lithium battery (13) is used for power supply of the device, the USB interface (18) is used for power supply of the lithium battery (13) and data transmission, and the charging chip (15) is used for power management of the device.

8. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The inside of the optical cabin (302) is fixedly connected with the support (6), the inside of the support (6) is fixedly connected with the outside of the infrared LED (303), and the number of the infrared LED (303) is four.

9. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The inside of the pen head (301) is provided with a placing groove (7), the outside of the placing groove (7) is provided with a hose (16), the inner wall of the hose (16) is provided with a pressure sensor (17), the number of the pressure sensor (17) is six, the pressure sensor (17) is connected with the master control chip (503), and the pressure sensor (17) is used for sensing the pressure borne by the pen head (301) and detecting the pen holding posture of the user.

10. The smart pen integrated with multi-dimension sensors according to claim 1, wherein: The outside of the pen core body (1) is provided with an outer tube (8), the outside of the outer tube (8) is provided with a spring (9), one end of the outer tube (8) is provided with a first connecting tube (10), and one side of the first connecting tube (10) is provided with a second connecting tube (11).

Images