Digital processing of physical notes with artificial intelligence integration
The integration of patterned paper, smart pens, and AI algorithms in the system automates note digitization, providing efficient, context-aware, and meaningful content conversion.
Patent Information
- Application Number
- PCT/TR2025/050969
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-08-15
- Publication Date
- 2026-02-26
AI Technical Summary
Existing systems for digitizing physical notes lack artificial intelligence support, requiring manual intervention for data processing, summarization, translation, and contextual expansion, and fail to automatically detect tasks or provide meaningful content.
A system integrating specially patterned paper, a smart pen, and multi-layered software architecture with artificial intelligence algorithms for automatic data processing, including semantic search, summarization, translation, contextual expansion, and task detection.
Enables efficient, automated conversion of handwritten notes into rich, meaningful content with enhanced organization and time-saving features, preserving context and facilitating quick editing and management.
Smart Images

Figure 00000018_0000 
Figure 00000019_0000 
Figure 00000020_0000
Abstract
Description
[0001] D E S C R I P T I O N
[0002] Digital Processing of Physical Notes with Artificial Intelligence Integration
[0003] Technical Field
[0004] The invention relates to a system and method for instantly transferring physical technical drawings or notes to a digital environment using specially patterned paper and a smart pen, and the method that ensures the operation of this system
[0005] Prior Art
[0006] Some known technologies are used in instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pens. The technology used ensures the digitalization of writings written with a physical pen in a physical notebook using traditional methods.
[0007] The main feature of notebooks developed for transferring physical writing to digital media is that they are covered with a special micro pattern. The mentioned pattern generally consists of small dots or codes that are difficult to detect with the human eye. With the help of these micro patterns integrated on the notebook surface, the smart pen's optical sensors and / or cameras detect the pen's movements with high precision. The detected movements and written texts are converted to a digital format through advanced image processing algorithms on the device.
[0008] In the technology used for converting physical writing to digital in the current technique, the digitalization process is only performed and concluded as an image or raw text. Advanced processing cannot be performed on the digitalized data. This situation requires users to manually intervene to make the digitalized raw data meaningful.
[0009] The American patent document with code US11853544B2 in the current technique mentions an electronic device, electronic device operation method, and data recording application control method. This document basically describes the digitalization of handwriting information using an electronic pen and electronic device, recording, time-sequential reproduction, and facilitating the content creation process. There is no artificial intelligence support, therefore operations such as summarizing notes, contextual expansion, answering questions, or translation to other languages cannot be performed. Purpose of the Invention
[0010] The purpose of the invention is to obtain a system / method that provides automatic data processing and organization by integrating artificial intelligence algorithms with the technology used in instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pen.
[0011] Another purpose of the invention is to obtain a system / method that enables users to manage their notes faster and more efficiently by eliminating the need for manual intervention.
[0012] Another purpose of the invention is to obtain a system / method that produces rich and meaningful content while preserving the context of notes.
[0013] Another purpose of the invention is to obtain a system / method that enables summarization of digitalized notes, translation to different languages, and contextual expansion.
[0014] Another purpose of the invention is to obtain a system / method that automatically detects tasks from users' written notes and offers reminder suggestions.
[0015] With these features, the invention is to obtain a system / method that ensures users save time and manage written content more efficiently.
[0016] The system developed to achieve the mentioned purposes includes:
[0017] • Specially patterned paper whose surface is covered with a special optical pattern to enable writing or drawing on it and detection by the smart pen,
[0018] • Smart pen equipped with sensors or optical reader hardware that converts the position information of writings or drawings made on said paper into X- Y coordinate data and transmits this data via wireless communication protocol,
[0019] • Electronic device that receives coordinate data from the smart pen and converts, stores, and processes it into digital format; multi-layered software architecture consisting of mobile or desktop application, data layer, business logic layer, common layer, presentation layer, and platform layer running on said electronic device,
[0020] • Artificial intelligence processing layer in communication with the electronic device, processing coordinate data with large language models (LLM) and natural language processing (NLP) techniques; performing semantic search, summarization, translation, contextual expansion, task detection, and chat features, and
[0021] • An interface module that presents processed data to the user through mobile or web-based user interface.
[0022] Explanation of Figures
[0023] The attached Figure-1 is the flow diagram of the system.
[0024] • Figure-2 is the schematic view of the system's detailed architectural structure.
[0025] • Figure-3 is the schematic view of the system's detailed architectural structure.
[0026] • The main elements expressed in the figures are given below as numbers and names.
[0027] Detailed Description of the Invention
[0028] The invention relates to a method used for instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pen, and to the system that ensures the operation of this method.
[0029] Traditional note-taking methods are integrated with digital technology through the subject system and method of the invention. With the mentioned integration, while preserving the paper and pen note-taking experience, simultaneous transfer and organization of created notes to digital media is ensured. The general flow schematic view of the subject system of the invention is presented in Figure-1, and its detailed architectural structure is presented in Figure-2 and Figure-3. The invention also has artificial intelligence-based functions and multi-language support.
[0030] The invention relates to an integrated system that provides digital data transfer and synchronization. The system basically consists of three main physical elements such as pen, specially structured notebook, and electronic device (e.g., smartphone, tablet, or computer): These physical elements work together supported by a cloudbased server infrastructure, processor unit, and related software. The general purpose of the system is the instant transfer, storage, and processing of handwritten records to digital media.
[0031] Smart Pen is an electronic device that precisely determines the pen's position with X and Y coordinates during writing on the notebook and transfers this coordinate data in real-time to digital devices such as phones, tablets, or computers. The smart pen records the pen's movements on a coordinate basis by detecting the special pattern points on the notebook surface through internal sensors or digital optical reader system.
[0032] Notebook is the specially printed paper surface on which the smart pen writes. Each page of the notebook is equipped with a unique optical pattern to enable the pen to detect its position accurately and error-free. Thanks to these special patterns, the pen precisely detects and digitally positions the location of writings and / or drawings on the page with the optical reader system. Thus, all drawings and writings made on the notebook are transferred and recorded with high accuracy in digital media.
[0033] Electronic devices are devices that receive the coordinate data provided by the smart pen and convert and process this information into digital format. As shown in Figure-2, the electronic device has a multi-layered architectural structure including mobile application layer, data layer, platform runtime, and cloud-based services. Through these devices, writings and drawings on the notebook are digitalized and presented to the user. Additionally, advanced operations such as text recognition, automatic language translation, and content editing can be performed on this digital data with artificial intelligence-based technologies.
[0034] Smart pen, notebook, and electronic device systems are integrated; thus, users' notetaking in the physical environment is transferred, organized, and processed to digital platforms. The mentioned system makes note-taking and management processes effective and practical.
[0035] Technically, the invention includes a method that processes digitally processed physical notes through advanced artificial intelligence algorithms. Said method consists of the following stages:
[0036] Notes taken by the user on specially designed papers in a physical environment are converted to digital signals through the smart pen. These signals are detected by the smart pen and transmitted to the software developed within the scope of the invention. Digital data is processed in the data acquisition layer and converted to text with large language models.
[0037] Data that has undergone text translation is analyzed in the artificial intelligence processing layer and subjected to some advanced Al-supported processes. These processes include the sub-steps specified below:
[0038] • Semantic Search: More relevant and more content related to the subject can be obtained by performing semantic search on notes.
[0039] • Summarization: Creates summary information by identifying important sections of notes.
[0040] • Translation: Automatically translates digitalized notes into different languages. • Expansion: Details and expands short or incomplete content notes using artificial intelligence algorithms while preserving semantic integrity.
[0041] • Smart Task Detection: Detects tasks within notes and offers suggestions to users.
[0042] • Chat: It is possible to chat with the taken notes and discuss the subject. As a result of the discussion, people can make the event more meaningful and enjoyable by talking with their own written text. The chat interface can be activated according to queries made by the user. It includes an Al-supported smart chat interface that processes texts using natural language processing (NLP) techniques and creates meaningful content.
[0043] When performing semantic search, it works on basic components such as NLP (Natural Language Processing), Word Embeddings, Context Understanding, Ontologies and Knowledge Graphs, Machine Learning.
[0044] The explanations of the basic components are explained below:
[0045] • Natural Language Processing (NLP): Analyzes linguistic structures and meanings in the user's query.
[0046] • Word Embeddings: Represents words as vectors and measures the semantic distance between them.
[0047] • Context Understanding: Evaluates the general context of the query and the user's possible intent.
[0048] • Ontologies and Knowledge Graphs: Uses connections between concepts and relationships.
[0049] • Machine Learning: Produces better results by learning the user's past search data or behavior patterns.
[0050] With semantic search, for example, when searching for "cat", pages with cat drawings are found even if that word doesn't appear. In another example, when searching for "what was the name of the sushi restaurant?", a result like "Hand Roll Bistro" that is related to sushi but doesn't directly contain that word is returned.
[0051] As shown in Figure-2 and Figure-3, the subject system of the invention has a multilayered architectural structure. The user layer (KI 000) mostly works on the mobile application (Ml 000).
[0052] Mobile application (Ml 000) includes many layers such as presentation layer (MS 1000), common layer (MO 1000), business logic layer (Mil 000), data layer (MV1000), and platform layer (MP 1000).
[0053] Presentation Layer (MS 1000) provides all visual, functional, and interactive communication between the user and the system. The mentioned presentation layer (MS1000) includes sub-elements such as user interface (MS1001), navigation (navigation API) (MS 1002), forms and validation (MS 1003), state management (MS 1004), and localization (MS 1005). User interface (MS1001) includes user interface (UI) components. Navigation (navigation API) (MS 1002) provides transitions between screens (navigation API). Forms and validation (MS1003) is the form and data validation mechanism. Localization (MS 1005) is the part where localization of incoming information / text and multi-language support is provided.
[0054] All inputs received from the user are first passed through the common layer (MO 1000). After security and configuration checks are performed by the Common Layer (MO 1000), data is transmitted to the business logic layer (Mil 000). Processed results from the business logic layer (Mil 000) return to the presentation layer (MS 1000) through the common layer (MO 1000) and are presented to the user.
[0055] Common layer (MO 1000) provides services commonly used in all layers of the application, security controls, and configuration management. Common layer (MO 1000) includes security (MO 1001), notifications (MO 1002), configuration (MO1003), tools (MO1004), and local extensions (MO1005) components.
[0056] Security (MO1001) is the element containing security services (access control, encryption). Notifications (MO 1002) is the component containing notification services (both in-app and backend-triggered). Configuration (MO 1003) is the component where configuration management is performed. Tools (MO1004) is the component where auxiliary tools are located, and extensions (MO 1005) is the component where local platform extensions are located. All data and commands from the Presentation Layer (MS 1000) go through validation, authorization, and configuration stages here. Then transmitted to the business logic layer (Mil 000).
[0057] Business Logic Layer (Mil 000) executes the application's business rules and flows, makes data request and processing decisions. The mentioned business logic layer (MI1000) includes services / local modules (MI1001), workflow management (MI1002), analytics and logging (MI1003), and tools / helpers (MI1004) modules.
[0058] Processing requests from the Common Layer (MO 1000) are evaluated according to business rules. When data access or storage operations are required, they are directed to the data layer (MV1000). Results from the data layer (MV1000) are transmitted back to the presentation layer (MS 1000) through the common layer (MO 1000).
[0059] Data Layer (MV1000) manages the application's data on the device, synchronizes with the backend database. Provides offline work support. Data Layer (MV1000): Performs local database and offline support (MV1001), query management (MV1001), and cache / storage (MV1001) functions. Data Layer (MV1000) fulfills data read / write requests from the business logic layer (Mil OOO). All data exchange is done API-based through Backend Services (AAY1000). In offline mode, data is kept in cache / storage (MV1001) and synchronized incrementally when connection is established.
[0060] Platform Layer (MP1000): Includes native platform API (MP1001), application framework (MP1002), router (MP1003), and application update system (MP1004) components. Platform Layer (MP 1000) ensures the mobile application works compatible with device hardware and operating system. Platform layer (MP 1000) also supports the smooth execution of low-level functions such as database access, storage, and network connections.
[0061] Mobile application (Ml 000) ensures the mobile application works compatibly with device hardware and operating system. Ensures all other layers work compatibly with hardware / OS. Supports the smooth execution of low-level functions such as database access, storage, and network connections. Works integrated with the backend system (Al 001). Database (VI 000) contains separate services such as synchronization service (V1001), dynamic data partitioning (V1002), and database service (VI 003). Database (VI 000) works integrated with the data layer (MV1000) in the mobile application (Ml 000).
[0062] Backend systems (A1001) internally include data acquisition layer (AVA1000), artificial intelligence processing layer (AY1000), chat layer (AS 1000), backend services (AAY1000), infrastructure (AA1000), and database layer (AVK1000). The mentioned backend system (A1001) is configured to receive data from the mobile application, process it, analyze it with artificial intelligence, and transmit the results back to the mobile application.
[0063] The data acquisition layer (AVA1000) in backend systems (A1001) includes message queue (AVA1001), duplicate entry prevention (AVA1002), text conversion with large language models (LLMs) (AVA1003), and data validation elements (AVA1004).
[0064] Data Acquisition Layer (AVA1000) collects raw data from the mobile application, queues it, prevents duplicates, converts to text, and validates. Data converted to text with text conversion (AVA1003) is transmitted to the artificial intelligence processing layer (AY1000) after being validated by data validation elements (AVA1004).
[0065] In the artificial intelligence processing layer (AY1000), there is an artificial intelligence service (AY1001). Features such as semantic search (AY1002), note summarization (AY1003), event detection (AY1004), and task detection (AY1005) can be used directly with the artificial intelligence service (AY1001). Artificial Intelligence Processing Layer (AY1000) analyzes digital text data, enriches, summarizes, and performs task / event detection. If chat mode is closed, processed data is transmitted to the Database Layer (AVK1000) and from there to the mobile application. When necessary, if chat mode is open, it can communicate with the chat layer (AS 1000).
[0066] Information from the artificial intelligence layer (AY1000) is transmitted to the database layer (AVK1000), backend services (AAY1000), and chat layer (AS 1000).
[0067] The database layer (AVK1000) has different sub -elements such as main database (AVK1001), cache database (AVK1002), and file storage system (AVK1003). The database layer (AVK1000) conducts bidirectional data exchange with the data layer (MV1000). Queries come through backend services (AAY1000) and are handled within the database layer (AVK1000).
[0068] In the chat layer (AS 1000), there are large language model (AS 1001), content validator (AS 1002), and content categorization (AS 1003). The chat layer (AS 1000) enables users to interact with notes through natural language. It only activates when the user enables chat mode. Data from artificial intelligence processing (AY1000) is converted to dialog format and transmitted to the mobile application through Backend Services (AAY1000).
[0069] Backend services (AAY1000) include API Gateway (AAY1001), authentication (AAY1002), rate limiting (AAY1003), and error method (AAY1004) elements. All API-based communication of the mobile application is provided through Backend Services (AAY1000). Access to Data Acquisition Layer (AVA1000), artificial intelligence processing layer (AY1000), and database layer (AVK1000) is provided through backend services (AAY1000).
[0070] Infrastructure (AA1000) consists of sub -elements such as server framework, authentication system, and application server. Infrastructure (AA100) provides the physical and virtual operating environment of the backend system. All backend modules run on infrastructure (AA1000). System security, scalability, and continuity are provided by the mentioned infrastructure (AA1000).
[0071] The data layer (MV1000) of the mobile application is in constant synchronization with the database layer (AVK1000) in the backend system. Results of artificial intelligence processing (AY1000), chat (AS 1000), and other server operations are also transmitted to the mobile application through this channel.
[0072] The subject system of the invention includes the following process steps:
[0073] . Start (SI 001),
[0074] • Writing / drawing on specially patterned paper (SI 002), • Smart Pen data is converted to X-Y coordinates (S 1003),
[0075] • Coordinate data is transferred to device via Bluetooth (SI 004),
[0076] • Processing method is selected (SI 005),
[0077] • Processing is done through cloud server and LLM (SI 006),
[0078] • Processing is done on device with local artificial intelligence model (SI 007),
[0079] • Digital text conversion and semantic analysis are performed with NLP (S1008),
[0080] • Artificial intelligence processes are applied to note content (SI 009),
[0081] • Presented to user through mobile / web interface (S 1010),
[0082] . End (SlOl l).
[0083] Figure- 1 shows the data processing flow of the proposed system step by step. The process begins with writing or drawing on a specially patterned paper surface using a smart pen (SI 002). The raw data produced by the smart pen is converted to X-Y coordinate format for numerical processing of position information (SI 003). The obtained coordinate data is transferred to the target device via Bluetooth wireless communication protocol (SI 004).
[0084] After the data reaches the device, the appropriate processing method is determined by the system (SI 005). Depending on the processing method selection, data is either processed on a cloud-based server and large language model (LLM) (SI 006) or processed locally through an artificial intelligence model running on the device (S1007).
[0085] The processed data is converted to digital text using natural language processing (NLP) techniques and semantic analysis is performed (S1008). The content obtained as a result of this analysis is subjected to determined artificial intelligence processes and enriched in terms of meaning (SI 009).
[0086] In the final stage, the final processed content is presented to the user through a mobile or web-based user interface (S1010). The process ends with the completion of the system's workflow.
[0087] The invention presents an innovative system that makes physical and digital notetaking processes smarter, more efficient, and user-friendly compared to traditional digital note-taking tools. Below, it is explained in detail how the said invention resolves the technical problems encountered by previous systems and which elements, features, and algorithms are used to provide these solutions.
[0088] Provided Advantages a) Smart Data Processing Advantage: The invention not only enables the digitalization of notes but also processes this data intelligently to provide valuable content to the user.
[0089] Solution: Texts identified with Multi-model LLMs can be summarized, expanded, translated, or analyzed in different ways by the artificial intelligence service. Thus, the deficiencies of traditional methods in data processing are eliminated. b) Time Saving and Efficiency
[0090] Advantage: The need for manual editing on notes is minimized. The Al-supported system automatically performs the operations the user needs.
[0091] Solution: Artificial intelligence-based algorithms enable quick editing and organization of notes, both saving time and increasing efficiency. c) Meaningful Digitalization
[0092] Advantage: Notes are transformed into meaningful and rich content instead of remaining in a simple text format.
[0093] Solution: The artificial intelligence service analyzes digitalized data to preserve and even expand the context and meaning of content when necessary. This makes notes much more functional.
[0094] Technical Solution and Elements Used
[0095] Conversion of Physical Notes to Digital Signals with Multi -model LLM Integration Explanation: Physical notes are converted to digital signals. Then these signals are processed in the data acquisition layer and converted to digital text through Multimodel LLM.
[0096] Contribution: This method enables handwritten notes to be correctly identified and transferred to digital media.
[0097] Artificial Intelligence-Supported Data Processing Algorithms
[0098] Explanation: Data identified with Multi-model LLMs is processed using artificial intelligence algorithms. These algorithms are based on deep learning and natural language processing (NLP) techniques.
[0099] • Summarization Algorithm: Creates short and meaningful summaries of long texts by identifying key information in notes.
[0100] • Translation Algorithm: Automatically translates identified texts into desired languages.
[0101] • Expansion Algorithm: Enables short texts to be detailed and transformed into more comprehensive content by artificial intelligence.
[0102] • Contextual Interpretation: Enables more accurate and meaningful operations by understanding the context within the text.
[0103] Automatic Task Detection and Management with Al Explanation: The artificial intelligence service detects important information or actionable items from notes and presents them to the user as reminders or task lists through the task detection module.
[0104] Contribution: This feature enables automatic extraction of tasks from notes, allowing for more effective time management.
[0105] The invention overcomes the limitations of traditional systems with innovative solutions such as smart data processing, time-saving algorithms, and meaningful digitalization. Thanks to the combination of physical note digitalization technology with artificial intelligence, the note-taking process not only becomes digital but also becomes smarter, more efficient, and richer in content for users.
[0106] The invention is a system used for instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pen; to enable real-time transfer of physical technical drawings or handwritten notes taken using specially patterned paper and smart pen to digital media, automatic processing, semantic enrichment, and presentation to the user as functional content through artificial intelligence integration,
[0107] • Specially patterned paper whose surface is covered with a special optical pattern to enable writing or drawing on it and detection by the smart pen,
[0108] • Smart pen equipped with sensors or optical reader hardware that converts the position information of writings or drawings made on said paper into X- Y coordinate data and transmits this data via wireless communication protocol,
[0109] • Electronic device that receives coordinate data from the smart pen and converts, stores, and processes it into digital format; multi-layered software architecture consisting of mobile or desktop application, data layer, business logic layer, common layer, presentation layer, and platform layer running on said electronic device,
[0110] • Artificial intelligence processing layer in communication with the electronic device, processing coordinate data with large language models (LLM) and natural language processing (NLP) techniques; performing semantic search, summarization, translation, contextual expansion, task detection, and chat features, and
[0111] • Characterized by including an interface module that presents processed data to the user through mobile or web-based user interface.
[0112] The invention is a method used for instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pen;
[0113] • User writing or drawing on paper whose surface is covered with special optical pattern using smart pen, • Smart pen detecting the position information of writings or drawings as X- Y coordinate data,
[0114] • Transmission of detected coordinate data to electronic device via wireless communication protocol, • Electronic device converting coordinate data to digital text,
[0115] • Processing of data according to user preference,
[0116] • on cloud-based server and large language model (LLM) or
[0117] • through local artificial intelligence model running on device,
[0118] • Performing semantic analysis of digital text using natural language processing (NLP) techniques during processing,
[0119] • Application of artificial intelligence functions on analyzed data; including semantic search, summarization, translation to different languages, contextual expansion, task detection, and chatting with user steps, and
[0120] • Characterized by including the process steps of presenting processed and semantically enriched data to the user through mobile or web-based user interface.
Claims
C L A I M S1. The invention is a system used for instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pen, characterized by; to enable real-time transfer of physical technical drawings or handwritten notes taken using specially patterned paper and smart pen to digital media, automatic processing, semantic enrichment, and presentation to the user as functional content through artificial intelligence integration,• Specially patterned paper whose surface is covered with a special optical pattern to enable writing or drawing on it and detection by the smart pen,• Smart pen equipped with sensors or optical reader hardware that converts the position information of writings or drawings made on said paper into X- Y coordinate data and transmits this data via wireless communication protocol,• Multi-layered software architecture consisting of mobile or desktop application, data layer, business logic layer, common layer, presentation layer, and platform layer running on an electronic device that receives coordinate data from the smart pen and converts, stores, and processes it into digital format,• Artificial intelligence processing layer in communication with the electronic device, processing coordinate data with large language models (LLM) and natural language processing (NLP) techniques; performing semantic search, summarization, translation, contextual expansion, task detection, and chat features, and• Including an interface module that presents processed data to the user through mobile or web-based user interface.
2. The invention is a method used for instantly transferring physical technical drawings or notes to digital media using specially patterned paper and smart pen, characterized by;• User writing or drawing on paper whose surface is covered with special optical pattern using smart pen,• Smart pen detecting the position information of writings or drawings as X-Y coordinate data,• Transmission of detected coordinate data to electronic device via wireless communication protocol,• Electronic device converting coordinate data to digital text,• Processing of data according to user preference,• on cloud-based server and large language model (LLM) or• through local artificial intelligence model running on device,• Performing semantic analysis of digital text using natural language processing (NLP) techniques during processing,• Application of artificial intelligence functions on analyzed data; including semantic search, summarization, translation to different languages, contextual expansion, task detection, and chatting with user steps, and• Including the process steps of presenting processed and semantically enriched data to the user through mobile or web-based user interface.
3. The system mentioned in Claim 1, characterized by including;• presentation layer (MS 1000) containing user interface (MS 1001), navigation module (MS 1002), forms and validation (MS 1003), state management (MS 1004), and localization (MS 1005) components,• common layer (MO 1000) containing security (MO 1001), notifications (MO 1002), configuration (MO 1003), tools (MO 1004), and local extensions (MO 1005) components,• business logic layer (MI1000) containing services / local modules (MI1001), workflow management (Mil 002), analytics and logging (Mil 003), and tools / helpers (Mil 004) components,• data layer (MV1000) containing local database and offline support (MV1001), query management (MV1002), and cache / storage (MV1003) components, and• platform layer (MP 1000) containing native platform API (MP 1001), application framework (MP 1002), router (MP 1003), and application update system (MP 1004) components.
4. The system mentioned in Claim 1, characterized by including a database (V1000) consisting of synchronization service (V1001) that provides bidirectional data flow between the electronic device's database and backend system and performs incremental synchronization when connection is established with offline work support, containing dynamic data partitioning (VI 002) algorithms for performant management of data sets, and database service (VI 003) modules that provide caching, data integrity control, and query optimization in data access and storage operations.
5. The system mentioned in Claim 1, characterized by including data acquisition layer (AVA1000), artificial intelligence processing layer (AY1000), chat layer (AS1000), backend services (AAY1000), infrastructure layer (AA1000), and database layer (AVK1000).
6. The data acquisition layer (AVA1000) mentioned in Claim 5, characterized by including message queue (AVA1001) that queues raw data from mobile application to balance processing load, duplicate entry prevention (AVA1002) that prevents the same data from being processed multiple times, text conversionmodule (AVA1003) that directly converts coordinate or raw signals from smart pen to digital text through large language models (LLM), and data validation component (AVA1004) that filters erroneous or incomplete entries by checking the integrity, format, and validity of converted data.
7. The artificial intelligence processing layer (AY1000) mentioned in Claim 5, characterized by including through artificial intelligence service (AY1001) that analyzes and enriches digital text data; semantic search module (AY1002) that detects related content using natural language processing (NLP), word embeddings, context understanding, ontologies, knowledge graphs, and machine learning techniques; note summarization module (AY1003) that converts texts to short and meaningful summaries by identifying key information; event detection module (AY1004) that automatically detects event information contained in text; and task detection module (AY1005) subcomponents that identify actionable expressions and present them to the user as task lists or reminder suggestions.
8. The chat layer (AS 1000) mentioned in Claim 5, characterized by including components that activate only when chat mode is enabled by the user and enable interaction with notes through natural language, converting note content to dialog format through large language model (AS 1001) and generating contextpreserving responses to user queries; content validator (AS 1002) that checks generated chat content for semantic integrity and accuracy, and content categorization module (AS 1003) that classifies chat texts by topic headings or content type.
9. The backend service (AAY1000) mentioned in Claim 5, characterized by including API gateway (AAY1001) that performs routing and load balancing functions as the central entry point for requests, authentication module (AAY1002) that verifies user and device access permissions, rate limiting module (AAY1003) that limits the number of requests that can be made in certain time periods to protect system resources and prevent abuse, and error management module (AAY1004) components that detect and record errors occurring during communication process, transmitting error messages or codes when necessary.
10. The infrastructure layer (AA1000) mentioned in Claim 5, characterized by including server framework (AA1001) that provides the physical and virtual operating environment of the backend system and forms the basic platform on which all modules run, authentication system (AA1002) that ensures system- wide security and verifies user and service access permissions, and applicationserver (AA1003) components that ensure the operation of backend modules, generate responses to requests, and execute application logic.
11. The database layer (AVK1000) mentioned in Claim 5, characterized by including main database (AVK1001) where system data is centrally stored and managed, cache database (AVK1002) where frequently used data is temporarily stored to increase access speed, and file storage system (AVK1003) components where file-based content such as drawing images and additional documents are stored.
12. The system mentioned in Claim 1, characterized by including mobile application (M1000) that operates on the user layer (K1000) providing visual, functional, and interactive communication between user and system; performing bidirectional data synchronization with database (VI 000) by working compatibly with device hardware and operating system; and conducting data processing, storage, and artificial intelligence-based analysis operations in an integrated manner by establishing API-based communication with backend system (A1001).
13. The mobile application (M1000) mentioned in Claim 12, characterized by including presentation layer (MS 1000) that provides all visual, functional, and interactive communication between user and system; common layer (MO 1000) that provides commonly used services, security controls, notifications, and configuration management across all layers; business logic layer (Mil 000) that manages application business rules and data processing flows; data layer (MV1000) that manages data on the device and performs synchronization with local database and backend database; and platform layer (MP 1000) components that ensure compatible operation between the mobile application's device hardware and operating system.
14. The presentation layer (MS1000) mentioned in Claim 13, characterized by including user interface (MS1001) that provides all visual and interactive communication between user and system; navigation module (MS 1002) that performs transitions and routing between screens; forms and validation component (MS 1003) that ensures input accuracy; state management (MS 1004) that manages visible / interactive states throughout the application; and localization module (MS 1005) components that provide multi-language support and local content presentation.
15. The common layer (M01000) mentioned in Claim 13, characterized by providing commonly used services, security controls, and configuration management across all layers of the application; including security module(MO 1001) containing access control and encryption operations, notifications module (MO 1002) that manages both in-app and backend-triggered notifications, configuration module (MO 1003) where system configuration settings are managed, tools component (MO 1004) that houses auxiliary tools used throughout the application, and local extensions component (MO 1005) that supports platform-specific functions.
16. The business logic layer (MI1000) mentioned in Claim 13, characterized by being configured to execute application business rules and flows, make data request and processing decisions; including services / local modules (MI1001) that perform application functions, workflow management module (Mil 002) that ensures sequential and conditional execution of processes, analytics and logging module (Mil 003) for monitoring system performance, recording events, and reporting, and tools and helpers component (Mil 004) that assists in applying business rules.
17. The data layer (MV1000) mentioned in Claim 13, characterized by managing application data on the device and providing synchronization with backend database; including local database and offline support module (MV1001) that offers offline work support, query management module (MV1002) that manages data access and processing requests, and cache / storage module (MV1003) where frequently used data is temporarily held for quick access.
18. The platform layer (MP1000) mentioned in Claim 13, characterized by ensuring compatible operation of the mobile application with device hardware and operating system; including native platform API module (MP 1001) that provides access to device hardware features and native operating system functions, application framework module (MP 1002) that manages the application's basic working structure and inter-component interaction, router component (MP1003) that manages data and process flow, and application update system (MP 1004) that manages, distributes, and installs application updates.
Citation Information
Patent Citations
Digital pen
US20110310066A1
Handwritten paper-based input digital record management
US20110320924A1
Smart pen device and method of implementing a smart pen device
US20200233506A1