Handwriting synchronization method and electronic device

By analyzing the stylus input by the user, generating search data and action link data, and correlating it with link logo information, the problems of long recognition time and low data sharing efficiency in the prior art are solved, and the rapid identification and sharing of handwritten files are realized action link data.

CN118946873APending Publication Date: 2024-11-12SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380030613.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-05
Filing Date
2023-02-08
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

When existing electronic devices recognize handwriting input by users, they need to pre-construct a database of action link data, resulting in an increase in recognition time and it is difficult to effectively share and identify action link data.

Method used

By analyzing the stylus entered by the user, search data and action link data are generated, and associated with link logo information, inserted into the handwriting file, and stored in the corresponding database to reduce identification time and improve the efficiency of data sharing.

Benefits of technology

It realizes the rapid identification and sharing of action link data in handwritten files, reduces the database size, and improves the generation and recognition speed of action link data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118946873A_ABST
    Figure CN118946873A_ABST
Patent Text Reader

Abstract

Various embodiments of the present disclosure disclose a method and apparatus including a memory and a processor operably connected to the memory, where the processor is configured to analyze strokes of input handwriting when a user inputs handwriting, generate search data and action link data based on the analyzed strokes, and transmit the search data and the action link data to the memory. Search-based identification data including the search data and link flag information associated with the action link data is generated, and a handwritten file including the generated search-based identification data is stored. Various embodiments are possible.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Various embodiments of the present disclosure relate to a method and an electronic device for synchronizing handwriting. Background Art

[0002] With the development of digital technology, various types of electronic devices (such as mobile communication terminals, personal digital assistants (PDAs), electronic notepads, smart phones, tablet personal computers (PCs), and wearable devices) have been widely used. The hardware and / or software parts of electronic devices are constantly improved to improve support and increase their functions.

[0003] For example, the electronic device provides a function that allows the user to record a memo anytime and anywhere without any notebook or pen. For example, the user can directly record a note on a display (e.g., a touch screen) by using the user's finger or an electronic pen. The electronic device can receive an input of a touch track (or coordinates) of a touch (or contact) on the display as handwriting (or a note). The user can input handwriting with an electronic pen, just like recording a note with a pen, so that the note can be recorded conveniently while feeling the analog sensitivity. Summary of the invention

[0004] Technical issues

[0005] In order to recognize handwriting input by a user, the electronic device should be able to pre-record the recognition results of search (or text) data or action link data. The action link data can be used to provide an icon associated with a function so that the function corresponding to the handwriting (e.g., a phone call or an email address) can be executed. Since providing the action link data to the handwriting requires recognition time, it is necessary to pre-build a database for the action link data.

[0006] Various embodiments may disclose a method and apparatus for analyzing handwriting to generate each of search data and action link data when handwriting (or a note) is input, inserting search-based recognition data including the search data and link marker information associated with the action link data into a handwriting file, and storing the handwriting file.

[0007] Solution to the problem

[0008] According to various embodiments of the present disclosure, an electronic device includes a memory and a processor operably connected to the memory, wherein the processor is configured to analyze strokes of the input handwriting when a user inputs handwriting, generate search data and action link data based on the analyzed strokes, generate search-based recognition data including the search data and link mark information associated with the action link data, and store a handwriting file including the generated search-based recognition data.

[0009] The method of operating an electronic device according to various embodiments of the present disclosure includes: when a user inputs handwriting, analyzing the strokes of the input handwriting, generating search data and action link data based on the analyzed strokes, generating search-based recognition data including the search data and link mark information associated with the action link data, and storing a handwriting file including the generated search-based recognition data.

[0010] Advantageous Effects of the Invention

[0011] According to various embodiments, the electronic device can analyze input handwriting to generate each of search data and action link data, insert search-based recognition data including the search data and link mark information associated with the action link data into a handwriting file, and store the handwriting file, thereby reducing the time spent on recognizing the action link data.

[0012] According to various embodiments, the electronic device may store search data for inputting handwriting, store it in a search DB, distinguish action link data for each link type, and store the action link data in the action link DB, thereby effectively using the search DB and the action link DB to identify future search data and action link data.

[0013] According to various embodiments, the electronic device may insert search-based recognition data including search data and marker information associated with action link data into a handwritten file, and store the handwritten file in a file DB, so that when the handwritten file is shared with another user, the search data can be easily identified and action link data can be generated from the search-based recognition data included in the handwritten file in the electronic device of the other user.

[0014] According to various embodiments, the electronic device may identify search data based on search-based recognition data included in a handwritten file and generate action link data, thereby reducing the time taken to recognize the action link data and easily using the action link data.

[0015] According to various embodiments, the electronic device may increase the speed of generating and recognizing action link data based on an index offset of link flag information included in search-based recognition data.

[0016] According to various embodiments, the electronic device constructs the search DB, the action link DB, and the file DB separately, and thus does not need to store DBs of all recognition techniques, thereby reducing the database size. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a block diagram illustrating electronic devices within a network environment according to various embodiments.

[0018] Figure 2is a flowchart illustrating a method of operating an electronic device according to various embodiments.

[0019] Figure 3 An example of an electronic device generating search-based recognition data associated with handwriting according to various embodiments is shown.

[0020] Figure 4 is a flowchart illustrating a method in which an electronic device generates link mark information associated with handwriting according to various embodiments.

[0021] Figure 5 An example in which an electronic device generates link mark information associated with handwriting according to various embodiments is shown.

[0022] Fig. 6A and Figure 6B is a flowchart illustrating a method in which an electronic device generates search data or action link data from a shared handwriting file according to various embodiments.

[0023] Figure 7 An example in which an electronic device generates search data or action link data from a shared handwriting file according to various embodiments is shown.

[0024] Figure 8 An example in which an electronic device provides action link data to a shared handwriting file according to various embodiments is shown.

[0025] Fig. 9 is a flowchart illustrating a method in which an electronic device generates action link data from a shared handwriting file according to various embodiments.

[0026] Fig.10 is a flowchart illustrating a method in which an electronic device searches for data from a shared handwriting file identification and generates action link data according to various embodiments.

[0027] Fig.11 An example in which an electronic device uses search-based recognition data according to various embodiments is shown.

[0028] Fig.12 An example is shown in which an electronic device recognizes handwriting by using search-based recognition data according to various embodiments.

[0029] Fig.13 An example in which an electronic device uses search-based recognition data according to various embodiments is shown.

[0030] Fig.14 Another example of using search-based recognition data by an electronic device according to various embodiments is shown.

[0031] Fig.15A and Fig. 15BAnother example of using search-based recognition data by an electronic device according to various embodiments is shown. DETAILED DESCRIPTION

[0032] Figure 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments.

[0033] Reference Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160) 11.

[0034] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent or combined with the main processor 121. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0035] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 1011 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 180 or a communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0036] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0037] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0038] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0039] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0040] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0041] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0042] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0043] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0044] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0045] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0046] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0047] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0048] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0049] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0050] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip).

[0051] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 197.

[0052] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a specified high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the specified high frequency band.

[0053] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0054] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the function or service requested, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request in the case of further processing the result or in the case of not further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on 5G communication technology or IoT-related technologies.

[0055] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0056] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0057] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0058] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.

[0059] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0060] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities, and some entities in the multiple entities may be separately arranged in different components. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as the corresponding one component in the multiple components before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0061] According to various embodiments of the present disclosure, an electronic device (eg, Figure 1 The electronic device 101 may include a memory (eg, Figure 1 130) and a processor operatively connected to the memory (e.g., Figure 1 The processor 120 may be configured to analyze the strokes of the input handwriting when the user inputs handwriting, generate search data and action link data based on the analyzed strokes, generate search-based recognition data including the search data and link mark information associated with the action link data, and store a handwriting file including the generated search-based recognition data.

[0062] The processor may be configured to determine lines of handwriting based on the analyzed strokes, and generate search data or action link data for each of the determined lines.

[0063] The link flag information may include at least one of an action link type, stroke information, or an index offset. The processor may be configured to configure the action link type when an action link function corresponding to input handwriting is provided, and not configure the action link type when an action link function corresponding to input handwriting is not provided.

[0064] The processor may be configured to configure the action link type as at least one of a phone number, an internet address, an email address, or an equation.

[0065] The stroke information may include at least one of the total number of strokes for one line, a first stroke ID, or a last stroke ID.

[0066] The index offset may include an offset value of an index where the next action link data exists, and the processor may be configured to configure the index offset of the previous link flag information after determining the action link type of the next action link data.

[0067] The processor can be configured to determine the action link type and stroke information of the link mark information based on the analyzed strokes, determine whether there is a next line in the handwriting, analyze the strokes of the next line when there is a next line in the handwriting, determine whether there is an action link in the next line based on the analyzed strokes, and configure the index offset of the link mark information when there is an action link in the next line, and do not configure the index offset of the link mark information when there is no action link in the next line.

[0068] The processor may be configured to obtain a second handwriting file different from the handwriting file, extract second search-based recognition data included in the second handwriting file, and identify and store second search data or generate and store second action link data based on the second search-based recognition data.

[0069] The processor may be configured to, after completing identification and storage of the second search data for each row, perform an operation of generating and storing the second action link data.

[0070] The processor can be configured to determine whether an action link type of a linked link flag information is configured based on the second search-based identification data, and when the action link type is configured, collect stroke information based on the stroke area of ​​the second search data, cyclically check the strokes and identify the stroke ID based on the collected stroke information, determine whether the stroke ID corresponds to the stroke sequence information included in the second search-based identification data, and repeatedly perform the operations of identifying the strokes and determining whether the stroke ID corresponds to the stroke sequence information until the stroke ID corresponds to the stroke sequence information.

[0071] The processor can be configured to: generate second action link data when the stroke ID corresponds to stroke sequence information, determine whether an index offset of second link flag information included in the second search-based identification data is configured, move and collect stroke information with the value configured in the index offset when the index offset of the second link flag information is configured, and end the action link data generation operation when the index offset of the second link flag information is not configured.

[0072] Figure 2 is a flow chart 200 illustrating a method of operating an electronic device according to various embodiments.

[0073] Reference Figure 2 In operation 201, an electronic device (eg, Figure 1A processor (eg, Figure 1 The processor 120 of the electronic device 101 can analyze the strokes according to the note (or handwriting) input. The user can touch the display of the electronic device 101 (for example, Figure 1 The processor 120 may input handwriting by using a display module 160 of the display module 160. For example, the processor 120 may execute an application for inputting handwriting (e.g., a memo application), and receive an input of a touch trajectory (or coordinates) input into an input area of ​​the executed memo application as handwriting. Handwriting includes strokes, and each stroke may be a stick or dot in writing or a picture (e.g., a figure). The stroke may include points (e.g., feature points), and the processor 120 may acquire feature points from the stroke and analyze the stroke based on the acquired feature points. When a handwriting file including handwriting needs to be stored, the processor 120 may analyze the stroke according to the handwriting input. Alternatively, the processor 120 may analyze the stroke in real time according to the handwriting input when the handwriting is input.

[0074] In operation 203, the processor 120 may generate and store search data based on the analyzed strokes. The search data may include text information indicating which characters or numbers correspond to handwriting. For example, the processor 120 may determine the handwritten line (or lines) based on the analyzed strokes and generate search data for each line. The search data may include at least one of a search type, a page width, a stroke area, or recognized text. The search type may be a value for searching, the page width may be a position value (or position coordinate) of the stroke, the stroke area may be an area in which the stroke exists, and the recognized text may include characters recognized according to handwriting.

[0075] The processor 120 may determine whether the handwriting corresponds to a character (or text) based on the analyzed strokes. The character (text or letter) may be a visual symbol system for writing human language, and may include numbers or letters in the language of each country. The processor 120 may identify which country corresponds to the handwriting or whether the handwriting is a number, and may insert it into the recognized text of the search data. When the handwriting file includes three lines, the processor 120 may generate three search data and store the generated three search data in the search database. The search database may include a memory (e.g., Figure 1 Since the search data is generated in the form of a binary code that can be recognized by the processor 120, the search data may have a relatively small capacity (or size).

[0076] According to various embodiments, after generating all search data for all lines included in the handwritten file, the processor 120 may perform operation 205. For example, when the handwritten file includes three lines, the processor 120 may generate first to third search data corresponding to the first to third lines, and then generate first to third action link data corresponding to the first to third lines.

[0077] Alternatively, the processor 120 may sequentially generate search data and action link data for corresponding lines of the handwritten file. For example, when the handwritten file includes three lines, the processor 120 may generate first search data and first action link data corresponding to the first line, generate second search data and second action link data corresponding to the second line, and then generate third search data and third action link data corresponding to the third line.

[0078] Alternatively, when receiving an input indicating that handwriting is completed from a user, the processor 120 can generate search data and action link data at the same time. For example, when a user enters the first line, the second line, or the third line into a handwritten file and then receives an input to complete the handwriting, the processor can simultaneously generate the first search data and the first action link data corresponding to the first line, the second search data and the second action link data corresponding to the second line, and the third search data and the third action link data corresponding to the third line. In operation 205, the processor 120 can generate and store action link data based on the analyzed strokes. The action link data can be used to provide icons related to functions so that the functions corresponding to handwriting (e.g., phone calls or email addresses) can be executed. Since it takes recognition time to provide action link data to handwriting, it is necessary to pre-build a database for action link data. When storing a handwritten file, the processor 120 can generate action link data and store the action link data in an action link database. The action link database can be included in the memory 130. The action link data is generated in the form of a binary code that can be recognized by the processor 120, and therefore can have a relatively small capacity (or size). The processor 120 may determine lines (or strips) of handwriting based on the analyzed strokes and generate action link data for each line.

[0079] For example, the action link data may include at least one of a link type, a page width, a recognized text, a stroke area, a first character area, a last character area, a handle list, or a unique value. The link type is configured differently depending on the type of function used to execute the action link data, and may include, for example, at least one of a telephone number, an Internet address (e.g., a URL (Uniform Resource Locator)), an email address, or an equation. For example, when handwriting corresponds to a telephone number, the processor 120 may provide a telephone call function for directly making a telephone call to the telephone number corresponding to the handwriting. The processor 120 may distinguish the action link data according to the link type, and store the action link data in an action link database. The page width is a position value (or coordinate) of the stroke, and may be the same or similar to the page width of the search data. The recognized text includes characters recognized according to the handwriting, and may be the same or similar to the recognized text of the search data. The stroke area is an area in which a stroke exists, and may be the same or similar to the stroke area of ​​the search data. The first character area may be an area of ​​the first located stroke in the stroke area. The last character area may be an area of ​​the last located stroke in the stroke area. The handle list may include an identifier (ID) configured for each stroke included in the stroke area. The processor 120 may configure (or assign) IDs in the order of the strokes included in the stroke area. For example, when the number of strokes included in the stroke area is 3 in total, the processor 120 may configure the first stroke ID as '1', the second stroke ID as '2', and the third stroke ID as '3'. The unique value may be a value uniquely specified by the electronic device 101 that generates the action link data. The unique value may be different for each electronic device that generates the action link data.

[0080] In operation 207, the processor 120 may generate search-based recognition data including the search data and the link mark information. The link mark information is associated with the action link data, and the processor 120 may generate the link mark information based on the action link data. For example, the search-based recognition data may be included in a handwritten file and shared with another user (or counterpart). The electronic device (e.g., Figure 1 The electronic device 102 can easily generate action link data based on the link flag information included in the search-based recognition data. That is, the link flag information may include information about the action link data required to generate the action link data (or help generate the action link data).

[0081] For example, the link flag information may include at least one of an action link type, stroke information, or an index offset. The action line type corresponds to the link type of the action link data, and may include, for example, at least one of a phone number, an Internet address, an email address, or an equation. The processor 120 may configure (or determine) the action link type of the link flag information according to the link type of the action link data.

[0082] In the following, the action link type is divided into four types, but another action link type for providing a function corresponding to handwriting may also be included. This example is only used to help understand the present disclosure, and the present disclosure is not limited to this example. For example, when the action link type is a telephone number, the action link type can be configured as "0" (for example, binary number 00), when the action link type is an Internet address, the action link type can be configured as "1" (for example, binary number 01), when the action link type is an email address, the action link type can be configured as "2" (for example, binary number 10), and when the action link type is an equation, the action link type can be configured as "3" (for example, binary number 11). Since the processor 120 generates link flag information for each line when storing a handwritten file, when the handwriting does not correspond to action link data, the processor 120 can configure the action link type to a configuration value (for example, -1). The value of the action link type is only used to help understand the present disclosure, and the present disclosure is not limited by the description.

[0083] The stroke information may include at least one of the total number of strokes, the first stroke ID, or the last stroke ID. The processor 120 may generate the stroke information of the link mark information based on at least one of the first character area, the last character area, or the handle list included in the action link data. For example, the processor 120 may determine (or configure) the first stroke ID of the link mark information based on the first character area or the handle list of the action link data. The handle list includes the stroke ID included in the stroke area, and thus the processor 120 may determine the first stroke ID based on the first character area or the handle list. The processor 120 may determine the last stroke ID of the link mark information based on the last character area or the handle list of the action link data.

[0084] Link mark information may be generated for each line, and the stroke information of the second line may be associated with the stroke information of the first line (e.g., the last stroke ID of the first line). For example, when the number of lines included in the handwritten file is 2 and the total number of strokes included in the first line is "10", the first stroke ID of the first line may be "1", and the last stroke ID of the first line may be "10". When the total number of strokes included in the second line is "7", the first stroke ID of the second line may be "11", and the last stroke ID of the second line may be "17". The stroke information of the first line may be included in the first link mark information, and the stroke information of the second line may be included in the second link mark information.

[0085] The index offset may include an offset value of the index where the next action link data exists. When a handwritten file is shared with a counterpart, the index offset may be used to generate link mark information from the shared handwritten file. After generating the action link type or stroke information of the link mark information for each line of the handwritten file, the processor 120 may finally configure the index offset of each link mark information. Alternatively, when link mark information is generated for each line while storing a handwritten file and the next line (e.g., the second line) does not correspond to the action link data, the processor 120 may configure the index offset of the link mark information of the previous line (e.g., the first line) to a configuration value (e.g., -1). The processor 120 may configure the index offset so as to allow the electronic device of the counterpart receiving the sharing of the handwritten file to generate the next action link data with reference to the index offset of the first link mark information when generating the action link data from the handwritten file. After determining the action link type of the next link mark information, the processor 120 may configure the index offset of the previous link mark information.

[0086] For example, when a handwritten file includes 3 lines and only the first and third lines include action links (for example, when the action link type is one of 0 to 3), the processor 120 can configure the index offset so that the second link is skipped and the action link data of the third line is generated after the action line data of the first line is generated. In this case, the processor 120 can configure the index offset of the first link flag information of the first line to "2", the index offset of the second link flag information of the second line to "1", and the index offset of the third link flag information of the third line to "-1". In this case, since the index offset of the first link flag information is configured to "2" after the first link flag information of the first line is generated from the handwritten file, the counterpart's electronic device 102 can skip the second line and move to the third line so as to generate the second action link data based on the third link flag information of the third line.

[0087] Alternatively, when the handwritten file includes 3 lines and only the first and second lines include action links (for example, when the action link type is one of 0 to 3), the processor 120 may generate action link data for the first and second lines, and then configure the index offset to end the action link data generation operation. In this case, the processor 120 may configure the index offset of the first link flag information of the first line to "1", the index offset of the second link flag information of the second line to "-1", and the index offset of the third link flag information of the third line to "-1". In this case, since the index offset of the first link flag information is configured to "1" after the first action link data of the first line is generated from the handwritten file, the counterpart's electronic device 102 may move to the second line and generate the second action link data based on the second link flag information of the second line. The index offset of the second link flag information is configured to "-1", and therefore the counterpart's electronic device 102 may end (or stop) the action link data generation operation without moving to the third line.

[0088] The processor 120 may generate search-based identification data for each row. The processor 120 generates search data and link flag information and action link data for each row, so that the search-based identification data may include both search data and link flag information. In the case of non-action link data, the action link type of the link flag information included in the search-based identification data may be configured as a configuration value (e.g., -1).

[0089] In operation 209, the processor 120 may store the handwriting file including the generated search-based recognition data. The processor 120 may store the handwriting file in a file database of the memory 130. The handwriting file may be shared with another user. For example, the search-based recognition data includes link flag information associated with the action link data, and thus the electronic device 102 of the counterpart receiving the sharing of the handwriting file may easily generate the action link data from the search-based recognition data included in the handwriting file.

[0090] Figure 3 An example of an electronic device generating search-based recognition data associated with handwriting according to various embodiments is shown.

[0091] Reference Figure 3 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1The processor 120 of the computer 350 may generate search data 310 for each line by analyzing the strokes from the handwriting input, and store the search data 310 in the search database 350. The search data 310 may include at least one of a search type 311, a page width 313, a stroke area (stroke rectangle (rect)) 315, or a recognized text 317. The search type 311 may be a value for searching, the page width 313 may be a position value (or position coordinates) of the stroke, the stroke area 315 may be an area where the stroke exists, and the recognized text 317 may include recognized characters (e.g., including language letters and numbers) according to handwriting recognition.

[0092] In addition, the processor 120 can generate action link data 360 for each line based on the analyzed strokes, and store the action link data 360 in the action link database 370. The action link data 360 can be used to provide an icon associated with a function so that a function corresponding to handwriting (e.g., a phone call or an email address) can be executed. The action link data 360 may include at least one of a link type, a page width, a recognized text, a stroke area (stroke rectangle), a first character area (first character rectangle), a last character area (last character rectangle), a handle list, or a unique value (UUID). The link type may be configured differently depending on the type of function used to execute the action link data, and may include, for example, at least one of a telephone number, an Internet address, an email address, or an equation. The processor 120 may distinguish the action link data according to the link type, and store the action link data in the action link database.

[0093] The page width is the position value (or coordinate) of the stroke, and may be the same as or similar to the page width of the search data. The recognized text includes characters recognized according to handwriting, and may be the same as or similar to the recognized text of the search data. The stroke area is an area in which the stroke exists, and may be the same as or similar to the stroke area of ​​the search data. The first character area may be the area of ​​the first positioned stroke in the stroke area. The last character area may be the area of ​​the last positioned stroke in the stroke area. The handle list may include an identifier (ID) configured for each stroke included in the stroke area. The unique value may be a value uniquely specified by the electronic device 101 that generates the action link data. The unique value may be different for each electronic device that generates the action link data.

[0094] The processor 120 may generate link flag information 330 based on the action link data 360. The link flag information 330 may include at least one of an action link type (LT) 331, stroke information (SC 333, SH 335, and LH 337), or an index offset (LO) 339. The action link type 331 is configured differently depending on the type of function executed, and may include, for example, at least one of a phone number, an Internet address (URL), an email address, or an equation. The processor 120 may determine the action link type of the link flag information 330 to correspond to the link type of the action link data 360. When the action link type is a phone number, the action link type may be configured as "0" (e.g., binary number 00), when the action link type is an Internet address, the action link type may be configured as "1" (e.g., binary number 01), when the action link type is an email address, the action link type may be configured as "2" (e.g., binary number 10), and when the action link type is an equation, the action link type may be configured as "3" (e.g., binary number 11).

[0095] The stroke information may include at least one of the total number of strokes (stroke count) 333, the first stroke ID (start handle) 335, or the last stroke ID (last handle) 337. The processor 120 may generate the stroke information of the link mark information 330 based on at least one of the first character area, the last character area, or the handle list included in the action link data 360. For example, the processor 120 may determine the first stroke ID of the link mark information 330 based on the first character area or the handle list of the action link data 360. The processor 120 may determine the last stroke ID of the link mark information 360 based on the last character area or the handle list of the action link data 360. The first stroke ID 335 and the last stroke ID 337 may be included in the stroke sequence information.

[0096] For example, when the number of lines included in the handwritten file is 2, the processor 120 may generate first link mark information corresponding to the first line and second link mark information corresponding to the second line. When the total number of strokes 333 included in the first link mark information is "10", the first stroke ID 335 of the first link mark information may be "1", and the last stroke ID 337 of the first link mark information may be "10". When the total number of strokes 333 included in the second link mark information is "7", the first stroke ID 335 of the second link mark information may be "11", and the last stroke ID 337 of the second link mark information may be "17". The processor 120 may determine the stroke ID of the second line based on the stroke ID of the first line.

[0097] The index offset 339 may include an offset value of the index where the next action link data exists. When a handwritten file is shared with another user (e.g., a counterpart), the index offset 339 may be used when generating action link data from the shared handwritten file. After generating the action link type or stroke information of the link mark information for each line of the handwritten file, the processor 120 may finally configure the index offset of each link mark information. Alternatively, when link mark information is generated for each line while storing the handwritten file and the next line (e.g., the second line) does not correspond to the action link data, the processor 120 may configure the index offset of the link mark information of the previous line (e.g., the first line) to a configuration value (e.g., -1).

[0098] When the handwritten file includes 3 lines, only the first line and the third line include action types (for example, the action link type is one of 0 to 3), and the second line does not include an action link (for example, the action link type is -1), the processor 120 can configure the index offset of the first link flag information of the first link to "2", the index offset of the second link flag information of the second line to "1", and the index offset of the third link flag information of the third line to "-1".

[0099] The processor 120 may generate search-based recognition data 300 including search data 310 and link mark information 330. The processor 120 may store a handwriting file 305 including the search-based recognition data 300 in a handwriting database 390. The handwriting file 305 may be shared with another user. For example, since the search-based recognition data 300 includes the link mark information 330, the electronic device 102 of the counterpart receiving the shared handwriting file 305 may easily generate the link mark information 330 from the link mark information 330 of the search-based recognition data 300 included in the handwriting file 305.

[0100] Figure 4 4 is a flowchart 400 illustrating a method in which an electronic device generates link mark information associated with handwriting according to various embodiments. Figure 4 Shown in detail in Figure 2 The operation of generating link flag information in operation 207.

[0101] Reference Figure 4 In operation 401, an electronic device (eg, Figure 1 A processor (eg, Figure 1The processor 120 may determine the action link type based on the analyzed strokes. The action link type is configured differently depending on the type of function performed, and may include, for example, at least one of a phone number, an Internet address, an email address, or an equation. When the analyzed stroke corresponds to an action link, the processor 120 may configure the action link type corresponding to the action link (e.g., one of 0 to 3). When the analyzed stroke does not correspond to an action link, the processor 120 may configure the action link type to a preset value (e.g., -1). The processor 120 may determine the action link type based on the analyzed strokes. Figure 2 The action link type of the link flag information is determined based on the link type of the action link data generated in operation 205 .

[0102] In operation 403, the processor 120 may determine stroke information based on the analyzed strokes. Figure 3 SC 333, SH 335, and LH 337) may include a total number of strokes (e.g., Figure 3 SC 333), the first stroke ID (e.g., Figure 3 SH 335) or the last stroke ID (e.g. Figure 3 At least one of LH 337 of . Link flag information can be generated for each row, and the stroke information of the second row can be associated with the stroke information of the first row. For example, when the total number of strokes included in the first row is "10", the processor 120 can determine the first stroke ID of the first row as "1", and determine the last stroke ID of the first row as "10". When the total number of strokes included in the second row is "7", the processor 120 can determine the first stroke ID of the second row as "11", and determine the last stroke ID of the second row as "17". The processor 120 can determine the stroke ID of the second row based on the stroke ID of the first row. The first stroke ID and the last stroke ID can be included in the stroke sequence information.

[0103] In operation 405, the processor 120 may determine whether there is a next line. Link mark information may be generated for each line. When the first action link type and the first stroke information of the first line are determined in operations 401 and 403, the next line may be the second line. Alternatively, when the second action link type and the second stroke information of the second line are determined in operations 401 and 403, the next line may be the third line. When the action link type and the stroke information of the link mark information of the first line are generated, the processor 120 may determine whether there is a next line in the handwritten file before configuring the index offset. The processor 120 may perform operation 407 when the next line exists in the handwritten file, and may perform operation 415 when the next line does not exist in the handwritten file.

[0104] When the next line exists in the handwritten document, the processor 120 may analyze the strokes of the next line in operation 407. The stroke may include points (eg, feature points), and the processor 120 may acquire the feature points from the stroke and analyze the stroke based on the acquired feature points.

[0105] In operation 409, processor 120 may determine whether there is an action link in the next line. When the strokes of the next line correspond to at least one of a phone number, an internet address (URL), an email address, or an equation corresponding to the action link type, processor 120 may determine that there is an action link. Alternatively, when the strokes of the next line do not correspond to the action link type (e.g., the action link type is -1), it may be determined that there is no action link. When there is an action link in the next line, processor 120 may perform operation 411, and when there is no action link in the next line, processor 120 may perform operation 415.

[0106] When there is an action link in the next row, the processor 120 may configure an index offset in operation 411. The index offset (e.g., Figure 3 LO 339) may include an offset value of the index where the next action link data exists. When there is an action link in the next row, the processor 120 may configure the index offset to "1". When the first action link type and the first stroke information of the first row are determined in operations 401 and 403, the processor 120 may configure the first index offset in operation 411. The first action link type, the first stroke information, and the first index offset may be included in the first link flag information corresponding to the first row. Alternatively, when the second action type and the second stroke information of the second row are determined in operations 401 and 403, the processor 120 may configure the second index offset in operation 411. The second action link type, the second stroke information, and the second index offset may be included in the second link flag information corresponding to the second row.

[0107] In operation 413, the processor 120 may generate link flag information. For example, the processor 120 determines the first action link type and the first stroke information of the first row in operations 401 and 403, and configures (or does not configure) the first index offset in operation 411 or operation 415, and thus can complete the generation of the first link flag information corresponding to the first row, and insert the first link flag information into the first search-based recognition data. After completing the generation of the first link flag information, the processor 120 may return to operation 401 and perform the operation of generating the link flag information of the second row. The processor 120 determines the second action link type and the second stroke information of the second row in operations 401 and 403, and configures (or does not configure) the second index offset in operation 411 or operation 415, and thus can complete the generation of the second link flag information corresponding to the second row, and insert the second link flag information into the second search-based recognition data. After storing the second link flag information, the processor 120 may return to operation 401 and perform the operation of generating the link flag information of the third row.

[0108] When there is no next line or there is no action link in the next line, the processor 120 may not configure the index offset in operation 415. Not configuring the index offset may mean that there is no index offset value or the index offset is configured as a preset value (e.g., -1). For example, when the first action link type and the first stroke information of the first line are determined in operations 401 and 403, the processor 120 may not configure the first index offset in operation 415. The first action link type, the first stroke information, and the first index offset may be included in the first link flag information corresponding to the first line. Alternatively, when the second action link type and the second stroke information of the second line are determined in operations 401 and 403, the processor 120 may not configure the second index offset in operation 415. The second action link type, the second stroke information, and the second index offset may be included in the second link flag information corresponding to the second line. After performing operation 415, the processor 120 may perform operation 413.

[0109] According to various embodiments, when the next line does not exist, the processor 120 may generate link flag information including the action link type and stroke information determined in operations 401 and 403 and the index offset not configured in operation 415, insert the generated link flag information into the search-based recognition data, and then end the process.

[0110] According to various embodiments, when there is a next line but there is no action link in the next line, the processor 120 may generate link flag information including the action link type and stroke information determined in operations 401 and 403 and the index offset not configured in operation 415, insert the generated link flag information into the search-based recognition data, and then return to operation 401 to perform the operation of generating the link flag information for the next line.

[0111] Figure 5 An example in which an electronic device generates link mark information associated with handwriting according to various embodiments is shown.

[0112] Reference Figure 5 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the handwriting file 500 may analyze the strokes of the handwriting included in the handwriting file 500. For example, the processor 120 may generate the first search data and the first action link data by analyzing the strokes included in the first line 510 from the handwriting file 500. The processor 120 may generate the first link flag information 5113 based on the generated first action link data. Alternatively, the processor 120 may generate the first link flag information 5113 by analyzing the strokes of the first line 510. The processor 120 may generate the first search-based recognition data including the first search data and the first link flag information 513. The first link flag information 513 may include an action link type (LT) corresponding to "1" (e.g., an Internet address), a total number of strokes (SC) corresponding to "14", a first stroke ID (SH) corresponding to "1", a last stroke ID (LH) corresponding to "14", and an index offset (LO) corresponding to "1".

[0113] The processor 120 may generate the second search data and the second action link data by analyzing the strokes included in the second line 530 from the handwriting file 500. The processor 120 may generate the second link flag information 533 based on the generated second action link data. Alternatively, the processor 120 may generate the second link flag information 533 by analyzing the strokes of the second line 530. The processor 120 may generate the second search-based recognition data including the second search data and the second link flag information 533. The second link flag information 533 may include an action link type (LT) corresponding to "2" (e.g., an email address), a total number of strokes (SC) corresponding to "17", a first stroke ID (SH) corresponding to "15", a last stroke ID (LH) corresponding to "31", and an index offset (LO) corresponding to "1". The first stroke ID (SH) of the second line 530 may be associated with the last stroke ID (LH) of the first line 510.

[0114] The processor 120 may generate the third search data and the third action link data by analyzing the strokes included in the third line 550 from the handwritten document 500. The processor 120 may generate the third link flag information 553 based on the generated third action link data. Alternatively, the processor 120 may generate the third link flag information 553 by analyzing the strokes of the third line 550. The processor 120 may generate the third search-based recognition data including the third search data and the third link flag information 553. The third link flag information 553 may include an action link type (LT) corresponding to "0" (e.g., a telephone number), a total number of strokes (SC) corresponding to "9", a first stroke ID (SH) corresponding to "32", a last stroke ID (LH) corresponding to "40", and an index offset (LO) corresponding to "1". The first stroke ID (SH) of the third line 550 may be associated with the last stroke ID (LH) of the second line 530.

[0115] The processor 120 may generate fourth search data and fourth action link data by analyzing the strokes included in the fourth line 570 from the handwritten file 500. The processor 120 may generate fourth link flag information 573 based on the generated fourth action link data. Alternatively, the processor 120 may generate fourth link flag information 573 by analyzing the strokes of the fourth line 570. The processor 120 may generate fourth search-based recognition data including the fourth search data and the fourth link flag information 573. The fourth link flag information 573 may include an action link type (LT) (e.g., equation) corresponding to "3", a total number of strokes (SC) corresponding to "12", a first stroke ID (SH) corresponding to "41", a last stroke ID (LH) corresponding to "52", and an index offset (LO) corresponding to "-1". The first stroke ID (SH) of the fourth line 570 may be associated with the last stroke ID (LH) of the third line 550.

[0116] The processor 120 may generate the fifth search data by analyzing the strokes included in the fifth line 590 from the handwritten file 500. Since the fifth line 590 does not include an action link, the processor 120 may not generate the fifth action link data. The processor 120 may generate the fifth link flag information 593 by analyzing the strokes of the fifth line 590. The processor 120 may generate the fifth search-based recognition data including the fifth search data and the fifth link flag information 593. The fifth link flag information 593 may include an action link type (LT) corresponding to "-1" (e.g., non-action link), a total number of strokes (SC) corresponding to "1", a first stroke ID (SH) corresponding to "53", a last stroke ID (LH) corresponding to "53", and an index offset (LO) corresponding to "-1". The first stroke ID (SH) of the fifth line 590 may be associated with the last stroke ID (LH) of the fourth line 570.

[0117] Fig. 6A and Figure 6B 6 is a flowchart 600 illustrating a method by which an electronic device generates search data or action link data from a shared handwriting file according to various embodiments.

[0118] Reference Fig. 6A In operation 601, an electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 can obtain the handwritten file. The processor 120 can obtain the handwritten file through the communication module (for example, Figure 1 The communication module 190) receives information from an external electronic device (eg, Figure 1 electronic device 102) or an external server (e.g., Figure 1 The handwriting file may include recognition data based on the search. The processor 120 may store the handwriting file in a memory (e.g., Figure 1 in the memory 130).

[0119] In operation 603, the processor 120 may extract search-based recognition data included in the handwriting file. The search-based recognition data may include search data and link flag information generated for each line of the handwriting file. The link flag information may be associated with action link data. The action link data may be used to provide icons associated with functions so that the function corresponding to the handwriting (e.g., a phone call or an email address) may be executed. Since providing action link data to handwriting requires recognition time, a database for action link data needs to be pre-built.

[0120] In operation 605, the processor 120 may generate and store search data or action link data based on the extracted search-based recognition data. After identifying and storing the search data based on the search-based recognition data, the processor 120 may generate and store the action link data based on the link flag information included in the search-based recognition data. That is, Fig. 6A The method of performing the operation of generating search data and the operation of generating action link data respectively is shown. Fig. 6A When generating action link data in the same manner as in the method described above, the processor 120 may generate action link data by referring to the index offset of the link flag information. Fig. 9 Correspond to Fig. 6A According to an embodiment, the processor 120 may simultaneously identify and store the search data and the action link data based on the search-based recognition data.

[0121] The search-based recognition data may include both the search data and the link flag information, but the processor 120 may not generate the action link data of the link flag information whose action link type is configured as a preset value (e.g., -1). For example, when the handwritten file includes 3 search-based recognition data, the processor 120 may identify the 3 search data. When one action link type among the 3 search-based recognition data is configured as a preset value, the processor 120 may generate 2 action link data. The processor 120 may generate the action link data only when the action link type of the 3 search-based recognition data corresponds to at least one of a telephone number, an Internet address, an email address, or an equation.

[0122] Reference Figure 6B , since operations 601 and 603 are related to Fig. 6A The same or similar, so their description may be omitted. Figure 6B A method for simultaneously performing to store search data and action link data based on the search-based recognition data is shown.

[0123] In operation 607, the processor 120 may determine whether the search-based identification data includes action link data. The processor 120 may determine whether the action link data is included by sequentially identifying the action link type of the link flag information included in the search-based identification data for the corresponding row. For example, the processor 120 may determine whether the first action link type of the first link flag information included in the first search-based identification data corresponds to at least one of a telephone number, an Internet address, an email address, or an equation. When the first action link type corresponds to at least one of a telephone number, an Internet address, an email address, or an equation, the processor 120 may perform operation 611, and when the first action link type does not correspond to at least one of a telephone number, an Internet address, an email address, or an equation, the processor 120 may perform operation 609.

[0124] When the action link data is not included in the search-based recognition data, the processor 120 may identify and store the search data in operation 609. The processor 120 may identify the search data included in the search-based recognition data and store the search data in a search database.

[0125] When the action link data is not included in the search-based recognition data, the processor 120 may identify and store the search data and generate and store the action link data in operation 611. The processor 120 may identify the search data included in the search-based recognition data and store the search data in a search database. In addition, the processor 120 may generate and store the action link data based on the link flag information included in the search-based recognition data.

[0126] According to various embodiments, after identifying and storing the first search data or the first action link data corresponding to the first row, the processor 120 may determine whether the action link data is included in the second search-based recognition data corresponding to the second row. The processor 120 may generate the search data and the action link data for each row simultaneously. Fig.10 Correspond to Figure 6B Detailed description.

[0127] Figure 7 An example in which an electronic device generates search data or action link data from a shared handwriting file according to various embodiments is shown.

[0128] Reference Figure 7 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the device can obtain the handwritten file 710. The handwritten file 710 can be obtained from an external electronic device (e.g., Figure 1electronic device 102) or an external server (e.g., Figure 1 The handwriting file 710 may be stored in a memory (e.g., Figure 1 The handwritten file 710 may include search-based recognition data 730. The processor 120 may extract the search-based recognition data 730 from the handwritten file 710. The search-based recognition data 730 may include search data 731 and link flag information 733. The processor 120 may identify the search data 731 based on the search-based recognition data 730 and store the search data 731 in the search database 750. The processor 120 may generate action link data based on the link flag information 733 of the search-based recognition data 730 and store the action link data in the action link database 770. The search database 750 and the action link database 770 may be included in the memory 130. The processor 120 may generate the search data 731 and the action link data separately or simultaneously.

[0129] Figure 8 An example in which an electronic device provides action link data to a shared handwriting file according to various embodiments is shown.

[0130] Reference Figure 8 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the embodiment of the present invention can obtain the handwriting file 810. The handwriting file 810 may include recognition data based on the search (for example, Figure 7 The processor 120 may extract the search-based recognition data from the handwritten file 810. The search-based recognition data may include search data (e.g., Figure 7 The processor 120 may identify the search data 731 based on the search-based recognition data 730 and generate action link data. The processor 120 may store the search data 731 and the generated action link data. After storing the search data 731 and the action link data, the processor 120 may provide a user interface 830 including action links in handwriting.

[0131] The user interface 830 may provide a first action link 843 (e.g., an Internet access application icon) according to the handwriting 841 of the first row, a second action link 843 (e.g., an email sending application icon) according to the handwriting 851 of the second row, a third action link 863 (e.g., a phone call application icon) according to the handwriting 861 of the third row, and a fourth action link 873 (e.g., a calculator application icon) according to the handwriting 871 of the fourth row. Since the handwriting 891 of the fifth row is not an action link, no action link may be provided.

[0132] Fig. 9 900 is a flowchart illustrating a method by which an electronic device generates motion link data from a shared handwriting file according to various embodiments. Fig. 9 Shown in detail Fig. 6A The operations of generating and storing action link data.

[0133] Reference Fig. 9 In operation 901, an electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the handwriting document may identify the search-based recognition data of the first line. The handwriting document may include the search-based recognition data of each line. The search-based recognition data may include search data and link flag information. The search data may include at least one of a search type, a page width, a stroke area, or a recognized text. The link flag information is associated with the action link data and may include information about the action link data. The link flag information may include the action link type, the stroke information (e.g., Figure 3 The processor 120 may identify (or extract) first search-based recognition data corresponding to the first line from the search-based recognition data included in the handwritten document. Operation 901 may be performed after all search data of each line is identified and stored based on the search-based recognition data.

[0134] In operation 903, the processor 120 may determine whether an action link type is configured. A configured action link type may mean that the action link type included in the link flag information of the search-based identification data corresponds to at least one of a phone number, an Internet address, an email address, or an equation. An unconfigured action link type may mean that the action link type included in the link flag information does not correspond to at least one of a phone number, an Internet address, an email address, or an equation.

[0135] The processor 120 may perform operation 905 when the action link type is configured, and may perform operation 913 when the action link type is not configured.

[0136] When the action link type is configured, the processor 120 may collect stroke information based on the stroke area of ​​the search data in operation 905. The stroke information may include all strokes included in one line.

[0137] In operation 907, the processor 120 may cyclically check the strokes included in the stroke information. Cyclic checking of the strokes may be identifying the stroke ID (e.g., stroke identifier) ​​while cyclically checking the strokes from the first stroke to the last stroke included in a row. For example, the processor 120 may identify the first stroke ID included in a row in the first cyclic check and perform operation 909, and may identify the second stroke ID included in a row in the second cyclic check and perform operation 909.

[0138] In operation 909, the processor 120 may determine whether the stroke ID is greater than or equal to the first stroke ID (SH) and equal to or less than the last stroke ID (LH). The first stroke ID and the last stroke ID may be included in the stroke sequence information. The processor 120 may determine whether the stroke ID corresponds to the stroke sequence information. The link flag information based on the searched recognition data may include stroke information, and the stroke information may include a total number of strokes (SC) and stroke sequence information (e.g., Figure 3 The processor 120 may identify (or configure) a first stroke ID (SH) and a last stroke ID (LH) based on the first stroke information included in the first link flag information corresponding to the first row.

[0139] When the row changes, the processor 120 may identify the first stroke ID (SH) and the last stroke ID (LH) based on the stroke information included in the link flag information corresponding to the changed row. When the row changes, the stroke order information changes, and thus the processor 120 may determine whether the stroke ID corresponds to the stroke order information of the changed row. For example, when the row changes to the third row, the processor 120 may identify the first stroke ID (SH) and the last stroke ID (LH) based on the stroke information included in the third link flag information corresponding to the third row.

[0140] When the first stroke ID is greater than or equal to the first stroke ID (SH) and equal to or less than the last stroke ID (LH), the processor 120 may return to operation 907 and loop to check the second stroke. When the second stroke ID is greater than or equal to the first stroke ID (SH) and equal to or less than the last stroke ID (LH), the processor 120 may return to operation 907 and loop to check the third stroke. The processor 120 may repeatedly perform operations 907 and 909 until the stroke ID is greater than or equal to the first stroke ID (SH) and less than or equal to the last stroke ID (LH). When the stroke ID is greater than or equal to the first stroke ID (SH) and equal to or less than the last stroke ID (LH), the processor 120 may perform operation 911.

[0141] In operation 911, the processor 120 may generate and store action link data. For example, when operations 901 to 909 are sequentially performed once, the processor 120 may generate and store first action link data. Thereafter, when operations 903 to 909 are sequentially performed twice, the processor 120 may generate and store second action link data. The generated action link data may be stored in an action link database.

[0142] When action link data is generated and stored or when the action link type is not configured, in operation 913, the processor 120 can determine whether an index offset is configured based on the link flag information. For example, after generating and storing the first action link data based on the first search-based identification data corresponding to the first row, the processor 120 can identify the index offset of the first link flag information included in the first search-based identification data. The index offset can be a configured index offset value where the next action link data exists. When the action link type is not configured, the processor 120 can determine whether an index offset is configured based on the search-based identification data, and when the index offset is not configured, the process can be ended.

[0143] The processor 120 may perform operation 915 when the index offset is configured, and end the process when the index offset is not configured. When the index offset is not configured, there is no next action link data, and thus the action link data generation operation may end.

[0144] When the index offset is configured, in operation 915, the processor 120 may move with the value configured in the index offset. For example, when the index offset included in the first link flag information is configured to "1" after generating the first action link data of the first row, the processor 120 may move to the second row and perform operation 905. Alternatively, when the index offset included in the first link flag information is configured to "2" after generating the first action link data of the first row, the processor 120 may move to the third row and perform operation 905. The processor 120 may move with the value configured in the index offset, and then return to operation 905. The processor 120 may refer to the index offset of the link flag information included in the search-based recognition data to directly move to the row where the action link exists, and generate the action link data, without determining whether the action link exists relative to all the rows included in the handwriting file. The processor 120 may increase the generation and recognition speed of the action link data based on the index offset.

[0145] Fig.10 1000 is a flowchart illustrating a method by which an electronic device generates search data and action link data from a shared handwriting file according to various embodiments. Fig.10 Describes in detail Figure 6B Operation 607 to operation 611.

[0146] Reference Fig.10 In operation 1001, an electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the computer readable medium may identify link marker information (e.g., first link marker information) included in the search-based recognition data of the first line. The handwritten document may include search-based recognition data for each line. The search-based recognition data may include search data and link marker information. The search data may include at least one of a search type, a page width, a stroke area, or recognized text. The link marker information is associated with the action link data and may include information about the action link data. For example, the link marker information may include an action link type, stroke information (e.g., Figure 3 The processor 120 may identify (or extract) first search-based recognition data corresponding to the first line among the search-based recognition data included in the handwritten document.

[0147] In operation 1003, the processor 120 may determine whether an action link type is configured. A configured action link type may mean that the action link type included in the link flag information of the search-based recognition data corresponds to at least one of a phone number, an Internet address, an email address, or an equation. An unconfigured action link type may mean that the action link type included in the link flag information does not correspond to at least one of a phone number, an Internet address, an email address, or an equation.

[0148] When the action link type is configured, the processor 120 may perform operation 1009 , and when the action link type is not configured, the processor 120 may perform operation 1005 .

[0149] When the action link type is not configured, the processor 120 may identify and store the search data in operation 1005. Since the first search-based recognition data included in the first row does not include an action link, the processor 120 may identify the first search data from the first search-based recognition data corresponding to the first row and store the first search data in the search database.

[0150] In operation 1007, the processor 120 may determine whether there is a second line (e.g., the next line). For example, since the first search data corresponding to the first line is identified and stored in operations 1001 to 1005, the processor 120 may determine whether the second line is included in the handwritten file. When the second line exists in the handwritten file, the processor 120 may perform operation 1008. When the second line does not exist in the handwritten file, an operation of identifying search data for the handwritten file or an operation of generating an action link file is no longer required, and thus the processor 120 may end the process.

[0151] In operation 1008, the processor 120 may identify link flag information (e.g., second link flag information) included in the search-based recognition data of the second line. The processor 120 may identify (or extract) the second search-based recognition data corresponding to the second line in the search-based recognition data included in the handwritten file. After performing operation 1008, the processor 120 may return to operation 1003 and determine whether an action link type (e.g., a second action link type included in the second link flag information) is configured.

[0152] When the action link type is configured, the processor 120 may identify and store the search data in operation 1009. The processor 120 may identify the first search data from the first search-based recognition data included in the first row and store the first search data in the search database. Operation 1009 may be the same or similar to operation 1005.

[0153] In operation 1011, the processor 120 may collect stroke information based on the stroke rectangle of the search data. The stroke information may include all strokes included in a row. Operation 1011 may be performed in conjunction with Fig. 9 The operation 905 is the same or similar.

[0154] In operation 1013, the processor 120 may cyclically check the strokes included in the stroke information. Cyclic checking of the strokes may be identifying the stroke IDs (e.g., stroke identifiers) while cyclically checking the strokes from the first stroke to the last stroke included in a row. For example, the processor 120 may identify the first stroke ID included in a row in a first cyclic check and perform operation 1015, and identify the second stroke ID included in a row in a second cyclic check and perform operation 1015. Operation 1013 may be similar to Fig. 9 The operation 907 is the same or similar.

[0155] In operation 1015, the processor 120 may determine whether the stroke ID is greater than or equal to the first stroke ID (SH) and equal to or less than the last stroke ID (LH). The first stroke ID and the last stroke ID may be included in the stroke sequence information. The processor 120 may determine whether the stroke ID corresponds to the stroke sequence information. The link flag information based on the searched recognition data may include the stroke information, and the stroke information may include the total number of strokes (SC) and the stroke sequence information (e.g., Figure 3 The processor 120 may identify (or configure) a first stroke ID (SH) and a last stroke ID (LH) based on the first stroke information included in the first link flag information corresponding to the first row.

[0156] When the row changes, the processor 120 may identify the first stroke ID (SH) and the last stroke ID (LH) based on the stroke information included in the link flag information corresponding to the changed row. When the row changes, the stroke order information changes, and thus the processor 120 may determine whether the stroke ID corresponds to the stroke order information of the changed row. For example, when the row changes to the third row, the processor 120 may identify the first stroke ID (SH) and the last stroke ID (LH) based on the stroke information included in the third link flag information corresponding to the third row.

[0157] When the first stroke ID is greater than or equal to the first stroke ID (SH) and is not equal to or less than the last stroke ID (LH), the processor 120 may return to operation 1013 and loop to check the second stroke. When the second stroke ID is greater than or equal to the first stroke ID (SH) and is not equal to or less than the last stroke ID (LH), the processor 120 may return to operation 1013 and loop to check the third stroke. The processor 120 may repeatedly perform operations 1013 and 1015 until the stroke ID is greater than or equal to the first stroke ID (SH) and is equal to or less than the last stroke ID (LH). When the stroke ID is greater than or equal to the first stroke ID (SH) and is equal to or less than the last stroke ID (LH), the processor 120 may perform operation 1017.

[0158] In operation 1017, the processor 120 may generate and store action link data. For example, when operations 1003 to 1015 are sequentially performed once, the processor 120 may generate and store first action link data. Thereafter, when operations 1003 to 1015 are sequentially performed twice, the processor 120 may generate and store second action link data. The generated action link data may be stored in an action link database.

[0159] After generating and storing the action link data, the processor 120 may return to operation 1007 and determine whether the second row exists. When the second row exists, the processor 120 may return to operation 1008 and identify the link flag information included in the search-based recognition data corresponding to the second row (e.g., the next row). When the second row does not exist in the handwritten file, an operation of identifying search data or generating an action link file with respect to the handwritten file is no longer required, and thus the processor 120 may end the process. The processor 120 may simultaneously identify search data with respect to all rows included in the handwritten file and generate and store the action link data.

[0160] Fig.11 An example in which an electronic device uses search-based recognition data according to various embodiments is shown.

[0161] Reference Fig.11 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1The processor 120 of the embodiment of the present invention may provide a first user interface 1110 for using the search-based recognition data. When the search-based recognition data 1111 is selected through the first user interface 1110, the processor 120 may provide a second user interface 1130. The second user interface 1130 may be used to configure the application scope of the search-based recognition data. For example, the second user interface 1130 may include a first application scope 1131 or a second application scope 1133, the first application scope 1131 being used to use the search-based recognition data for handwriting-related search, leveling, or text conversion, and the second application scope 1133 being used to use the search-based recognition data for at least one of search data or action link data.

[0162] Fig.12 An example is shown in which an electronic device recognizes handwriting by using search-based recognition data according to various embodiments.

[0163] Reference Fig.12 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 may use the search-based recognition data for runtime recognition techniques. For example, the processor 120 may generate text conversion data based on the search-based recognition data. The processor 120 may provide text conversion information 1250 from the handwriting file 1230 with reference to keywords (e.g., constructed constructions) included in the document file 1210.

[0164] Fig.13 An example in which an electronic device uses search-based recognition data according to various embodiments is shown.

[0165] Reference Fig.13 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the search-based recognition data 1310 may generate the text conversion data 1330 based on the search-based recognition data 1310. For example, the stroke area (stroke rectangle) of the search-based recognition data 1310 may be included in the stroke area (stroke rectangle), the left point, and the right point of the text conversion data 1330. In addition, since the stroke should be changed into the text in the text conversion data 1330, the processor 120 may insert some (SC, SH, LH, or LO) of the action link data of the search-based recognition data 1310 into the handle list (or stroke list) of the text conversion data 1330.

[0166] The processor 120 can generate the number of words of the text conversion data 1330 based on the number of spaces of the text of the search-based recognition data 1310. After detecting the number of words, the processor 120 can analyze the spatial information by the distance between the strokes. In the case of N words, the processor 120 can analyze the interval between the widest N-1 strokes as the spacing, and detect the strokes of the word based on the analyzed spacing. The page ID can be the ID of the page located in the stroke area, and the active flag can be used at runtime. The word list can be to analyze the spacing by calculating the distance between the handle list and the separation of each word. For example, the word list can include at least one of the joint area, text, number of strokes, or color.

[0167] Fig.14 Another example of using search-based recognition data by an electronic device according to various embodiments is shown.

[0168] Reference Fig.14 , according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the handwriting file 1450 can open the handwriting file 1450 to generate a hash table 1410 for each page and cache the hash table 1410 in the memory. Index 1460 can be assigned to the handwriting file 1450 for the corresponding real page. Since a large amount of resource consumption is generated to identify the hash table 1410, the processor 120 can reuse the hash table 1410 that has been generated once. When the user requests the recognition results of all strokes on all pages multiple times, the hash table 1410 can be fully filled. The processor 120 can generate a row map 1430 from the hash table 1410.

[0169] The search-based recognition data may have a storage layer very similar to the spatial locality cache 1420 of the text conversion data. The processor 120 may generate a hash table 1410 based on the stroke information (SC, SH, and LH) of the action link data included in the search-based recognition data without recognition. When modifying the hash table 1410, the processor 120 may change the line data of the modified area inserted in the first spatial locality cache 1420. The processor 120 may generate a second spatial locality cache 1440 for displaying the location information of each page in the first spatial locality cache 1420.

[0170] Fig.15A and Fig. 15B Another example of using search-based recognition data by an electronic device according to various embodiments is shown.

[0171] Reference Fig.15A, according to various embodiments of the electronic device (eg, Figure 1 A processor (eg, Figure 1 The processor 120 of the invention can perform text leveling based on search-based recognition data. Although only geometric information is used and arranged without knowing the handwriting content in the prior art, if there is recognized text information, non-characters are automatically classified, and thus the processor 120 can accurately arrange only strokes corresponding to the text.

[0172] Reference Fig. 15B , the processor 120 may arrange the handwriting by applying an indentation according to a bullet point (eg, a number or a bullet point) preceding the text based on the search-based recognition data.

[0173] According to various embodiments of the present disclosure, an operating electronic device (eg, Figure 1 The method of the electronic device 101) may include an operation of analyzing strokes of input handwriting when a user inputs handwriting, an operation of generating search data and action link data based on the analyzed strokes, an operation of generating search-based recognition data including the search data and link mark information associated with the action link data, and an operation of storing a handwriting file including the generated search-based recognition data.

[0174] The operation of generating the search data and the action link data may include an operation of determining lines of handwriting based on the analyzed strokes, and an operation of generating the search data or the action link data for each of the determined lines.

[0175] The action link data may include at least one of an action link type, stroke information, or index offset, and the operation of generating the action link data may include an operation of configuring the action link type when an action link function corresponding to input handwriting is provided, and an operation of not configuring the action link type when an action link function corresponding to input handwriting is not provided.

[0176] The operation of configuring the action link type may include an operation of configuring the action link type to be at least one of a phone number, an Internet address, an email address, or an equation.

[0177] The index offset may include an offset value of an index where the next action link data exists, and the operation of generating the action link data may include an operation of configuring the index offset of the previous link flag information after determining the action link type of the next action link data.

[0178] The operations for generating action link data may include: determining the action link type and stroke information of the link mark information based on the analyzed strokes, determining whether there is a next line in the handwriting, analyzing the strokes of the next line when there is a next line in the handwriting, determining whether there is an action link in the next line based on the analyzed strokes, and configuring the index offset of the link mark information when there is an action link in the next line, and not configuring the index offset of the link mark information when there is no action link in the next line.

[0179] The method may also include an operation of acquiring a second handwritten file different from the handwritten file, an operation of extracting second search-based recognition data included in the second handwritten file, and an operation of identifying and storing second search data or generating and storing second action link data based on the second search-based recognition data.

[0180] The operation of identifying and storing the second search data or generating and storing the second action link data may further include the operation of generating and storing the second action link data after completing the identification and storage of the second search data of each row.

[0181] The method may include an operation of determining whether an action link type of link flag information of a link is configured based on second search-based identification data, an operation of collecting stroke information based on a stroke rectangle of the second search data when the action link type is configured, an operation of cyclically checking strokes and identifying stroke IDs based on the collected stroke information, an operation of determining whether the stroke ID corresponds to stroke sequence information included in the second search-based identification data, and an operation of repeatedly performing a cyclic check of strokes and determining whether the number of strokes cyclically checked corresponds to the stroke sequence information until the number of strokes cyclically checked corresponds to the stroke sequence information.

[0182] The various embodiments of the present disclosure disclosed in the specification and the drawings present specific examples to facilitate description of the technical content of the present disclosure and to help understand the present disclosure, but are not intended to limit the scope of the present disclosure. Therefore, it should be interpreted that not only the embodiments disclosed herein but also all modifications or modified forms that can be derived based on the technical concept of the present disclosure are included in the scope of the present disclosure.

Claims

1. An electronic device, include: Memory; as well as a processor operatively connected to the memory, Wherein, the processor is configured to: When the user inputs handwriting, analyzing the strokes of the input handwriting; Generate search data and action link data based on the analyzed strokes; generating search-based identification data, the search-based identification data comprising the search data and link flag information associated with the action link data; and A handwriting file including the generated search-based recognition data is stored.

2. The electronic device according to claim 1, in, The processor is configured to: determining a line of the handwriting based on the analyzed strokes; and The search data or the action link data is generated for each of the determined rows.

3. The electronic device according to claim 1, in, The link mark information includes at least one of an action link type, stroke information or index offset, and Wherein, the processor is configured to: In case an action link function corresponding to the input handwriting is provided, configuring the action link type; and In the case where an action link function corresponding to the input handwriting is not provided, the action link type is not configured.

4. The electronic device according to claim 3, in, The processor is configured to configure the action link type as at least one of a phone number, an internet address, an email address, or an equation.

5. The electronic device according to claim 3, in, The stroke information includes at least one of the total number of strokes for a line, a first stroke ID, or a last stroke ID.

6. The electronic device according to claim 3, in, The index offset includes an offset value of the index where the next action link data exists, and The processor is configured to configure an index offset of previous link flag information after determining the action link type of the next action link data.

7. The electronic device according to claim 3, in, The processor is configured to: Based on the analyzed strokes, determining the action link type and stroke information of the link mark information; determining whether there is a next line in the handwriting; If there is a next line in the handwriting, analyzing the strokes of the next line; Based on the analyzed strokes of the next line, determining whether there is an action link in the next line; as well as If the action link exists in the next row, the index offset of the link flag information is allocated, and if the action link does not exist in the next row, the index offset of the link flag information is not allocated.

8. The electronic device according to claim 1, in, The processor is configured to: Acquire a second handwritten file different from the handwritten file; extracting second search-based recognition data included in the second handwritten document; as well as Based on the second search-based recognition data, second search data is identified and stored or second action link data is generated and stored.

9. The electronic device according to claim 8, in, The processor is configured to perform an operation of generating and storing second action link data after completing identification and storage of the second search data for each row.

10. The electronic device according to claim 9, in, The processor is configured to: Based on the second search-based identification data, determining whether an action link type of link flag information of a link is configured; In case the action link type is configured, collecting stroke information based on the stroke rectangle of the second search data; Loop through the strokes based on the collected stroke information and identify the stroke IDs; determining whether the stroke ID corresponds to stroke order information included in the second search-based recognition data; as well as The operation of identifying the strokes and the operation of determining whether the stroke ID corresponds to the stroke order information are repeatedly performed until the stroke ID corresponds to the stroke order information.

11. The electronic device according to claim 10, in, The processor is configured to: generating second action link data when the stroke ID corresponds to the stroke sequence information; determining whether an index offset of second link flag information included in the second search-based identification data is configured; In case the index offset of the second link mark information is configured, moving and collecting the stroke information according to the value configured in the index offset; as well as If the index offset of the second link flag information is not configured, the action link data generation operation is terminated.

12. A method for operating an electronic device, the method include: When the user inputs handwriting, analyzing the strokes of the input handwriting; Generate search data and action link data based on the analyzed strokes; generating search-based identification data, the search-based identification data comprising the search data and link flag information associated with the action link data; as well as A handwriting file including the generated search-based recognition data is stored.

13. The method according to claim 12, in, Generating the search data and the action link data includes: determining a line of the handwriting based on the analyzed strokes; and The search data or the action link data is generated for each of the determined rows.

14. The method according to claim 12, in, The action link data includes at least one of an action link type, stroke information, or an index offset, and The generation of the action link data includes: In case of providing an action link function corresponding to the input handwriting, configuring the action link type; and In the case where the action link function corresponding to the input handwriting is not provided, the action link type is not configured, The configuration of the action link type includes configuring the action link type as at least one of a telephone number, an Internet address, an email address, or an equation.

15. The method according to claim 14, in, The index offset includes an offset value of the index where the next action link data exists, and The generation of the action link data includes: after determining the action link type of the next action link data, configuring the index offset of the previous link flag information.