Smart Pen Infrared Trajectory Recognition with Lightweight Network

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart pen systems face challenges in reducing resource usage while maintaining recognition accuracy, particularly in processing writing trajectories.

Innovation Solution

The method involves monitoring a second pressure switch to trigger an infrared signal, collecting reflected signals, and using a lightweight network model with convolution channels to extract features and classify writing trajectories, then sending a time-ordered trajectory vector via Bluetooth for real-time display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional image processing methods are used for smart pen trajectory recognition, then recognition accuracy can be maintained, but system resource consumption increases

Engineering Contradiction:
Improvetrajectory recognition accuracyVSAvoidsmart pen system resource usage
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The image processing task is segmented into multiple stages: infrared signal capture, original image formation, feature extraction using lightweight network model, and trajectory classification. This segmentation allows resource-intensive operations to be performed only when necessary while maintaining recognition accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters of the network model by using a lightweight version with optimized convolution calculation channels instead of traditional heavy models. This parameter optimization reduces computational load and energy consumption while preserving the essential trajectory recognition capability.

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If lightweight network models are used to reduce resource usage, then energy consumption decreases, but processing speed may be affected

Engineering Contradiction:
Improvesmart pen energy consumptionVSAvoidtrajectory processing speed
Core Design Contradiction:
Use of energy by moving objectVSSpeed

Solution Approach 1:

The infrared signal is captured and original image is formed in advance using pressure switch triggers, preparing the data for subsequent lightweight model processing. This preliminary action ensures that when the lightweight model processes the pre-prepared features, it can operate at optimal speed without waiting for raw data acquisition.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts only the essential features from the original image using the lightweight network model's convolution channels, removing unnecessary data processing steps. This extraction approach maintains processing speed by focusing computational resources only on trajectory-relevant features.

Inventive Principle:
Principle #2Taking out (Extraction)

3Ease of operation

If real-time trajectory display is implemented, then user experience improves, but system resource consumption increases

Engineering Contradiction:
Improvereal-time display capabilityVSAvoidsmart pen resource usage
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system uses periodic infrared signal emission triggered by pressure switch events rather than continuous transmission. This periodic action enables real-time trajectory display at key moments (when writing pressure is detected) while significantly reducing energy consumption compared to continuous operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The smart pen system uses its own pressure switch signals to automatically trigger the infrared capture and processing sequence, eliminating the need for external control signals. This self-service mechanism enables real-time display functionality while minimizing additional resource consumption.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves the efficiency of image processing for smart pens by balancing accuracy and resource usage, enabling real-time writing trajectory display.

Implementation Method 1

controlling, after it is detected that the second pressure switch generates a trigger signal, an infrared transceiver circuit on the smart pen to send an infrared signal to an area where the smart pen writes, and to collect, in the form of an original image, a reflected signal corresponding to the infrared signal in the writing area

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentUS11853483B2Image processing method and apparatus for smart pen including pressure switches, and electronic device
Publication Date: 2023.12.26 SHENZHEN EAGLESOUL EDUCATION SERVICE CO LTD
  • US11853483B2 patent drawing
  • US11853483B2 patent drawing
  • US11853483B2 patent drawing

AI summary

An image processing method and apparatus for a smart pen, and an electronic device where the method comprises: monitoring a working state of a second pressure switch provided at a pen tip of a smart pen after a first pressure switch of the smart pen is in a closed state; controlling an infrared transceiver circuit on the smart pen to send an infrared signal to an area where the smart pen writes; acquiring a lightweight network model preset in the smart pen, so as to perform feature extraction processing on an original image; performing classification processing on a feature matrix by using a fully connected layer in the lightweight network model, to obtain a trajectory classification result; and displaying a writing trajectory of the smart pen on a target object in real time.